Evaluator 2127

LFv-sim

aborted

2020-11-02 15:36:28+00:00

2020-11-02 15:37:11+00:00

0:00:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9340/LFv-sim-Sandy2-sandy-1-job36516-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36510

10010

Fernanda Custodio Pereira do Carmo 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-02 14:21:03+00:00

2020-11-02 14:30:52+00:00

0:09:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.9190339537605696
survival_time_median	14.950000000000076
deviation-center-line_median	0.5314276419834365
in-drivable-lane_median	5.700000000000058

other stats

agent_compute-ego_max	0.022620692253112792
agent_compute-ego_mean	0.021178659598032633
agent_compute-ego_median	0.02075886329015096
agent_compute-ego_min	0.02057621955871582
complete-iteration_max	0.2128572988510132
complete-iteration_mean	0.20883979419867196
complete-iteration_median	0.21188743988672892
complete-iteration_min	0.19872699817021688
deviation-center-line_max	1.0793173731549162
deviation-center-line_mean	0.6021471854502576
deviation-center-line_min	0.2664160846792409
deviation-heading_max	2.6834311423080814
deviation-heading_mean	1.451329347001736
deviation-heading_median	1.1216837934029245
deviation-heading_min	0.8785186588930146
driven_any_max	3.2673402036126045
driven_any_mean	3.2646611320102132
driven_any_median	3.267309822562107
driven_any_min	3.2566846793040334
driven_lanedir_consec_max	3.254074638959944
driven_lanedir_consec_mean	2.1413422031735294
driven_lanedir_consec_min	1.4732262662130338
driven_lanedir_max	3.254074638959944
driven_lanedir_mean	2.1413422031735294
driven_lanedir_median	1.9190339537605696
driven_lanedir_min	1.4732262662130338
get_state_dump_max	0.016139955520629884
get_state_dump_mean	0.01509034295876821
get_state_dump_median	0.014914050102233886
get_state_dump_min	0.01439331610997518
get_ui_image_max	0.03567978064219157
get_ui_image_mean	0.034659353295962016
get_ui_image_median	0.03506555120150248
get_ui_image_min	0.03282653013865153
in-drivable-lane_max	7.4500000000000846
in-drivable-lane_mean	4.71250000000005
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.2566846793040334, "get_ui_image": 0.03567978064219157, "step_physics": 0.09015573024749755, "survival_time": 14.950000000000076, "driven_lanedir": 1.5180245437699778, "get_state_dump": 0.01439331610997518, "sim_render-ego": 0.00693781057993571, "in-drivable-lane": 7.4500000000000846, "agent_compute-ego": 0.02082518498102824, "deviation-heading": 1.2928714001459245, "complete-iteration": 0.2128572988510132, "set_robot_commands": 0.0052519663174947105, "deviation-center-line": 0.2664160846792409, "driven_lanedir_consec": 1.5180245437699778, "sim_compute_sim_state": 0.017851696014404297, "sim_compute_performance-ego": 0.004641955693562826, "sim_compute_robot_state-ego": 0.008759119510650636, "sim_compute_robot_state-parked0": 0.00819873332977295}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.267336015709423, "get_ui_image": 0.0354793651898702, "step_physics": 0.08980976661046346, "survival_time": 14.950000000000076, "driven_lanedir": 2.3200433637511617, "get_state_dump": 0.014848776658376058, "sim_render-ego": 0.006966063181559245, "in-drivable-lane": 4.150000000000059, "agent_compute-ego": 0.02069254159927368, "deviation-heading": 0.9504961866599244, "complete-iteration": 0.21251552899678547, "set_robot_commands": 0.005377936363220215, "deviation-center-line": 0.5030184257327388, "driven_lanedir_consec": 2.3200433637511617, "sim_compute_sim_state": 0.016880288124084472, "sim_compute_performance-ego": 0.004705411593119303, "sim_compute_robot_state-ego": 0.00913763205210368, "sim_compute_robot_state-parked0": 0.00845128854115804}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.267283629414791, "get_ui_image": 0.03282653013865153, "step_physics": 0.08044268210728964, "survival_time": 14.950000000000076, "driven_lanedir": 1.4732262662130338, "get_state_dump": 0.016139955520629884, "sim_render-ego": 0.006664425532023112, "in-drivable-lane": 7.250000000000057, "agent_compute-ego": 0.022620692253112792, "deviation-heading": 2.6834311423080814, "complete-iteration": 0.19872699817021688, "set_robot_commands": 0.005159144401550293, "deviation-center-line": 0.5598368582341343, "driven_lanedir_consec": 1.4732262662130338, "sim_compute_sim_state": 0.014424197673797608, "sim_compute_performance-ego": 0.004394234816233317, "sim_compute_robot_state-ego": 0.007813266118367513, "sim_compute_robot_state-parked0": 0.00807010571161906}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.2673402036126045, "get_ui_image": 0.03465173721313477, "step_physics": 0.09036204417546592, "survival_time": 14.950000000000076, "driven_lanedir": 3.254074638959944, "get_state_dump": 0.014979323546091716, "sim_render-ego": 0.006734769344329834, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02057621955871582, "deviation-heading": 0.8785186588930146, "complete-iteration": 0.21125935077667235, "set_robot_commands": 0.005339620113372803, "deviation-center-line": 1.0793173731549162, "driven_lanedir_consec": 3.254074638959944, "sim_compute_sim_state": 0.016832146644592285, "sim_compute_performance-ego": 0.004526650110880534, "sim_compute_robot_state-ego": 0.008950052261352539, "sim_compute_robot_state-parked0": 0.008143397172292073}}
set_robot_commands_max	0.005377936363220215
set_robot_commands_mean	0.005282166798909506
set_robot_commands_median	0.005295793215433757
set_robot_commands_min	0.005159144401550293
sim_compute_performance-ego_max	0.004705411593119303
sim_compute_performance-ego_mean	0.004567063053448995
sim_compute_performance-ego_median	0.0045843029022216795
sim_compute_performance-ego_min	0.004394234816233317
sim_compute_robot_state-ego_max	0.00913763205210368
sim_compute_robot_state-ego_mean	0.008665017485618591
sim_compute_robot_state-ego_median	0.008854585886001586
sim_compute_robot_state-ego_min	0.007813266118367513
sim_compute_robot_state-parked0_max	0.00845128854115804
sim_compute_robot_state-parked0_mean	0.008215881188710531
sim_compute_robot_state-parked0_median	0.008171065251032512
sim_compute_robot_state-parked0_min	0.00807010571161906
sim_compute_sim_state_max	0.017851696014404297
sim_compute_sim_state_mean	0.016497082114219665
sim_compute_sim_state_median	0.01685621738433838
sim_compute_sim_state_min	0.014424197673797608
sim_render-ego_max	0.006966063181559245
sim_render-ego_mean	0.006825767159461975
sim_render-ego_median	0.006836289962132772
sim_render-ego_min	0.006664425532023112
simulation-passed	1
step_physics_max	0.09036204417546592
step_physics_mean	0.08769255578517914
step_physics_median	0.0899827484289805
step_physics_min	0.08044268210728964
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

36504

6757

Liam Paull 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 06:47:56+00:00

2020-11-02 07:48:41+00:00

1:00:45

Waited 3602 seconds [...]

Waited 3602 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36493

6803

Anthony Courchesne 🇨🇦

baseline-duckietown

LFv-sim

failed

2020-11-02 06:44:09+00:00

2020-11-02 06:47:28+00:00

0:03:19

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 481, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 241, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 485, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36487

6806

Anthony Courchesne 🇨🇦

baseline-duckietown

LFv-sim

success

2020-11-02 06:38:11+00:00

2020-11-02 06:43:34+00:00

0:05:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4366244480654584
survival_time_median	4.674999999999992
deviation-center-line_median	0.30235620843499067
in-drivable-lane_median	0.9249999999999968

other stats

agent_compute-ego_max	0.021651371787576115
agent_compute-ego_mean	0.020776127798884523
agent_compute-ego_median	0.020968198939865713
agent_compute-ego_min	0.019516741528230554
complete-iteration_max	0.2034351657418644
complete-iteration_mean	0.1944861256725648
complete-iteration_median	0.19484986466519977
complete-iteration_min	0.1848096076179953
deviation-center-line_max	0.4359954898526317
deviation-center-line_mean	0.3095824874105573
deviation-center-line_min	0.1976220429196164
deviation-heading_max	2.286581164642681
deviation-heading_mean	1.1645862618115042
deviation-heading_median	0.8548827100318721
deviation-heading_min	0.6619984625395918
driven_any_max	1.939997261048641
driven_any_mean	0.87290559520545
driven_any_median	0.5725844520211546
driven_any_min	0.4064562157308501
driven_lanedir_consec_max	0.6802395853288715
driven_lanedir_consec_mean	0.4567689421819272
driven_lanedir_consec_min	0.2735872872679206
driven_lanedir_max	0.6802395853288715
driven_lanedir_mean	0.4567689421819272
driven_lanedir_median	0.4366244480654584
driven_lanedir_min	0.2735872872679206
get_state_dump_max	0.015797034431906307
get_state_dump_mean	0.015500070768244126
get_state_dump_median	0.015549126793356502
get_state_dump_min	0.015104995054357192
get_ui_image_max	0.03279031304752125
get_ui_image_mean	0.031965087874262936
get_ui_image_median	0.032034158169054514
get_ui_image_min	0.03100172211142147
in-drivable-lane_max	8.700000000000092
in-drivable-lane_mean	2.85000000000002
in-drivable-lane_min	0.849999999999997
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.5129966915856362, "get_ui_image": 0.03279031304752125, "step_physics": 0.08035472140592688, "survival_time": 4.249999999999993, "driven_lanedir": 0.3781075339199065, "get_state_dump": 0.015797034431906307, "sim_render-ego": 0.007322000054752125, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.021651371787576115, "deviation-heading": 0.8218240116725859, "complete-iteration": 0.2034351657418644, "set_robot_commands": 0.0055978578679701865, "deviation-center-line": 0.25178734328466934, "driven_lanedir_consec": 0.3781075339199065, "sim_compute_sim_state": 0.016103186326868395, "sim_compute_performance-ego": 0.00505217103397145, "sim_compute_robot_state-ego": 0.010260281843297622, "sim_compute_robot_state-parked0": 0.008334998523487765}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.4064562157308501, "get_ui_image": 0.03100172211142147, "step_physics": 0.07641827008303474, "survival_time": 3.399999999999996, "driven_lanedir": 0.2735872872679206, "get_state_dump": 0.015104995054357192, "sim_render-ego": 0.006075105246375589, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.019516741528230554, "deviation-heading": 0.8879414083911582, "complete-iteration": 0.1848096076179953, "set_robot_commands": 0.004383122219758875, "deviation-center-line": 0.1976220429196164, "driven_lanedir_consec": 0.2735872872679206, "sim_compute_sim_state": 0.01359015703201294, "sim_compute_performance-ego": 0.004165095441481646, "sim_compute_robot_state-ego": 0.007355237708372229, "sim_compute_robot_state-parked0": 0.0070421695709228516}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.939997261048641, "get_ui_image": 0.031912907759348554, "step_physics": 0.07915490627288818, "survival_time": 14.950000000000076, "driven_lanedir": 0.6802395853288715, "get_state_dump": 0.015531500180562338, "sim_render-ego": 0.006566974322001139, "in-drivable-lane": 8.700000000000092, "agent_compute-ego": 0.021213667392730715, "deviation-heading": 2.286581164642681, "complete-iteration": 0.19194276571273805, "set_robot_commands": 0.004697268009185791, "deviation-center-line": 0.4359954898526317, "driven_lanedir_consec": 0.6802395853288715, "sim_compute_sim_state": 0.013535509904225668, "sim_compute_performance-ego": 0.004289736747741699, "sim_compute_robot_state-ego": 0.007584942976633708, "sim_compute_robot_state-parked0": 0.0072848113377889}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.632172212456673, "get_ui_image": 0.03215540857876048, "step_physics": 0.08496141667459525, "survival_time": 5.09999999999999, "driven_lanedir": 0.4951413622110103, "get_state_dump": 0.015566753406150668, "sim_render-ego": 0.006305386038387523, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.02072273048700071, "deviation-heading": 0.6619984625395918, "complete-iteration": 0.19775696361766143, "set_robot_commands": 0.004611557605219823, "deviation-center-line": 0.35292507358531194, "driven_lanedir_consec": 0.4951413622110103, "sim_compute_sim_state": 0.014722358946706735, "sim_compute_performance-ego": 0.00403451685811959, "sim_compute_robot_state-ego": 0.007380099857554716, "sim_compute_robot_state-parked0": 0.007130274585649079}}
set_robot_commands_max	0.0055978578679701865
set_robot_commands_mean	0.004822451425533669
set_robot_commands_median	0.0046544128072028065
set_robot_commands_min	0.004383122219758875
sim_compute_performance-ego_max	0.00505217103397145
sim_compute_performance-ego_mean	0.004385380020328596
sim_compute_performance-ego_median	0.004227416094611672
sim_compute_performance-ego_min	0.00403451685811959
sim_compute_robot_state-ego_max	0.010260281843297622
sim_compute_robot_state-ego_mean	0.008145140596464569
sim_compute_robot_state-ego_median	0.007482521417094212
sim_compute_robot_state-ego_min	0.007355237708372229
sim_compute_robot_state-parked0_max	0.008334998523487765
sim_compute_robot_state-parked0_mean	0.00744806350446215
sim_compute_robot_state-parked0_median	0.00720754296171899
sim_compute_robot_state-parked0_min	0.0070421695709228516
sim_compute_sim_state_max	0.016103186326868395
sim_compute_sim_state_mean	0.014487803052453434
sim_compute_sim_state_median	0.014156257989359836
sim_compute_sim_state_min	0.013535509904225668
sim_render-ego_max	0.007322000054752125
sim_render-ego_mean	0.006567366415379094
sim_render-ego_median	0.006436180180194331
sim_render-ego_min	0.006075105246375589
simulation-passed	1
step_physics_max	0.08496141667459525
step_physics_mean	0.08022232860911127
step_physics_median	0.07975481383940752
step_physics_min	0.07641827008303474
survival_time_max	14.950000000000076
survival_time_mean	6.925000000000014
survival_time_min	3.399999999999996

No reset possible

36482

6812

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-02 06:28:38+00:00

2020-11-02 06:37:43+00:00

0:09:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	14.950000000000076
deviation-center-line_median	0.3071094952840746
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.02289100726445516
agent_compute-ego_mean	0.022063231666882833
agent_compute-ego_median	0.02185208042462667
agent_compute-ego_min	0.02165775855382283
complete-iteration_max	0.20940271457036336
complete-iteration_mean	0.19801597734292348
complete-iteration_median	0.195731874704361
complete-iteration_min	0.19119744539260863
deviation-center-line_max	0.6863069918481528
deviation-center-line_mean	0.35998819605511767
deviation-center-line_min	0.13942680180416853
deviation-heading_max	3.7258518640401217
deviation-heading_mean	1.6586762301304627
deviation-heading_median	1.2113904039371066
deviation-heading_min	0.486072248607516
driven_any_max	1.3686924727581474e-13
driven_any_mean	6.950391439969185e-14
driven_any_median	7.057320516147632e-14
driven_any_min	0.0
driven_lanedir_consec_max	1.7821788787841797e-05
driven_lanedir_consec_mean	4.455447196960449e-06
driven_lanedir_consec_min	0.0
driven_lanedir_max	1.7821788787841797e-05
driven_lanedir_mean	4.455447196960449e-06
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_state_dump_max	0.016106035709381104
get_state_dump_mean	0.01593950847784678
get_state_dump_median	0.015992564757664997
get_state_dump_min	0.015666868686676026
get_ui_image_max	0.03270918448766073
get_ui_image_mean	0.032088850339253745
get_ui_image_median	0.03208222150802613
get_ui_image_min	0.031481773853302
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.032452193101247154, "step_physics": 0.07515066067377726, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01591115872065226, "sim_render-ego": 0.006816062132517496, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02178690195083618, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.1949137854576111, "set_robot_commands": 0.005403415362040202, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.015589063962300618, "sim_compute_performance-ego": 0.004584701855977377, "sim_compute_robot_state-ego": 0.008872268994649251, "sim_compute_robot_state-parked0": 0.008171621958414714}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.0317122499148051, "step_physics": 0.075323646068573, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.016073970794677733, "sim_render-ego": 0.006589627265930176, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02165775855382283, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.19119744539260863, "set_robot_commands": 0.0051960420608520505, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.014288613001505534, "sim_compute_performance-ego": 0.004350810845692952, "sim_compute_robot_state-ego": 0.008022441069285074, "sim_compute_robot_state-parked0": 0.007805941104888916}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.03270918448766073, "step_physics": 0.07825202226638794, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.015666868686676026, "sim_render-ego": 0.006993213494618734, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02289100726445516, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.19654996395111085, "set_robot_commands": 0.005561140378316244, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.012278531392415365, "sim_compute_performance-ego": 0.004660523732503255, "sim_compute_robot_state-ego": 0.009017220338185628, "sim_compute_robot_state-parked0": 0.008340837160746257}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.031481773853302, "step_physics": 0.08935698986053467, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.016106035709381104, "sim_render-ego": 0.007031945387522379, "in-drivable-lane": 0.0, "agent_compute-ego": 0.021917258898417155, "deviation-heading": 0.486072248607516, "complete-iteration": 0.20940271457036336, "set_robot_commands": 0.005733782450358073, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.014679787158966064, "sim_compute_performance-ego": 0.004770510991414388, "sim_compute_robot_state-ego": 0.009769310156504313, "sim_compute_robot_state-parked0": 0.008375537395477296}}
set_robot_commands_max	0.005733782450358073
set_robot_commands_mean	0.005473595062891642
set_robot_commands_median	0.005482277870178223
set_robot_commands_min	0.0051960420608520505
sim_compute_performance-ego_max	0.004770510991414388
sim_compute_performance-ego_mean	0.004591636856396993
sim_compute_performance-ego_median	0.004622612794240316
sim_compute_performance-ego_min	0.004350810845692952
sim_compute_robot_state-ego_max	0.009769310156504313
sim_compute_robot_state-ego_mean	0.008920310139656065
sim_compute_robot_state-ego_median	0.00894474466641744
sim_compute_robot_state-ego_min	0.008022441069285074
sim_compute_robot_state-parked0_max	0.008375537395477296
sim_compute_robot_state-parked0_mean	0.008173484404881796
sim_compute_robot_state-parked0_median	0.008256229559580486
sim_compute_robot_state-parked0_min	0.007805941104888916
sim_compute_sim_state_max	0.015589063962300618
sim_compute_sim_state_mean	0.014208998878796897
sim_compute_sim_state_median	0.0144842000802358
sim_compute_sim_state_min	0.012278531392415365
sim_render-ego_max	0.007031945387522379
sim_render-ego_mean	0.006857712070147196
sim_render-ego_median	0.006904637813568116
sim_render-ego_min	0.006589627265930176
simulation-passed	1
step_physics_max	0.08935698986053467
step_physics_mean	0.07952082971731822
step_physics_median	0.07678783416748047
step_physics_min	0.07515066067377726
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

36473

10008

Mo Kleit 🇨🇦

sim-exercise-1

LFv-sim

success

2020-11-02 06:18:15+00:00

2020-11-02 06:28:17+00:00

0:10:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.017219046634005
survival_time_median	14.950000000000076
deviation-center-line_median	0.5333023120028553
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.02271662950515747
agent_compute-ego_mean	0.022475032011667888
agent_compute-ego_median	0.022520492871602377
agent_compute-ego_min	0.022142512798309325
complete-iteration_max	0.20791276454925536
complete-iteration_mean	0.20331811050573984
complete-iteration_median	0.20277988513310752
complete-iteration_min	0.19979990720748905
deviation-center-line_max	0.6136558465806736
deviation-center-line_mean	0.5461784441687207
deviation-center-line_min	0.5044533060884991
deviation-heading_max	2.7434535165858467
deviation-heading_mean	2.1582962609933416
deviation-heading_median	2.233159696535859
deviation-heading_min	1.4234121343158024
driven_any_max	3.5087338377898134
driven_any_mean	2.8798438364581296
driven_any_median	3.0555652149825776
driven_any_min	1.89951107807755
driven_lanedir_consec_max	3.4807969050307035
driven_lanedir_consec_mean	2.7891487526949863
driven_lanedir_consec_min	1.6413600124812315
driven_lanedir_max	3.4807969050307035
driven_lanedir_mean	2.7891487526949863
driven_lanedir_median	3.017219046634005
driven_lanedir_min	1.6413600124812315
get_state_dump_max	0.01648104508717855
get_state_dump_mean	0.016278400421142578
get_state_dump_median	0.016334643761316936
get_state_dump_min	0.015963269074757893
get_ui_image_max	0.03315747261047363
get_ui_image_mean	0.03243593792120616
get_ui_image_median	0.03228794654210408
get_ui_image_min	0.032010385990142824
in-drivable-lane_max	3.0500000000000433
in-drivable-lane_mean	0.7625000000000108
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.640626558722447, "get_ui_image": 0.03315747261047363, "step_physics": 0.07623548905054728, "survival_time": 14.950000000000076, "driven_lanedir": 2.610587308085063, "get_state_dump": 0.015963269074757893, "sim_render-ego": 0.0069594717025756835, "in-drivable-lane": 0.0, "agent_compute-ego": 0.022142512798309325, "deviation-heading": 2.1368664868543137, "complete-iteration": 0.19979990720748905, "set_robot_commands": 0.005635058879852295, "deviation-center-line": 0.5106091345604399, "driven_lanedir_consec": 2.610587308085063, "sim_compute_sim_state": 0.01742311159769694, "sim_compute_performance-ego": 0.004660563468933105, "sim_compute_robot_state-ego": 0.00911839803059896, "sim_compute_robot_state-parked0": 0.00832904020945231}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.470503871242708, "get_ui_image": 0.032066389719645184, "step_physics": 0.07839403867721557, "survival_time": 14.950000000000076, "driven_lanedir": 3.4238507851829474, "get_state_dump": 0.01622615973154704, "sim_render-ego": 0.007392760117848714, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02250649929046631, "deviation-heading": 2.329452906217404, "complete-iteration": 0.20393683671951293, "set_robot_commands": 0.006083070437113444, "deviation-center-line": 0.6136558465806736, "driven_lanedir_consec": 3.4238507851829474, "sim_compute_sim_state": 0.017211036682128908, "sim_compute_performance-ego": 0.00498702605565389, "sim_compute_robot_state-ego": 0.010094117323557536, "sim_compute_robot_state-parked0": 0.00879405419031779}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.89951107807755, "get_ui_image": 0.032010385990142824, "step_physics": 0.07993753910064698, "survival_time": 14.950000000000076, "driven_lanedir": 1.6413600124812315, "get_state_dump": 0.016443127791086833, "sim_render-ego": 0.0072298971811930336, "in-drivable-lane": 3.0500000000000433, "agent_compute-ego": 0.02271662950515747, "deviation-heading": 2.7434535165858467, "complete-iteration": 0.20162293354670208, "set_robot_commands": 0.005800127983093262, "deviation-center-line": 0.5559954894452706, "driven_lanedir_consec": 1.6413600124812315, "sim_compute_sim_state": 0.014118415514628092, "sim_compute_performance-ego": 0.004917484919230143, "sim_compute_robot_state-ego": 0.009736584027608236, "sim_compute_robot_state-parked0": 0.008529307047526042}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.5087338377898134, "get_ui_image": 0.032509503364562986, "step_physics": 0.08215187946955363, "survival_time": 14.950000000000076, "driven_lanedir": 3.4807969050307035, "get_state_dump": 0.01648104508717855, "sim_render-ego": 0.007340058485666911, "in-drivable-lane": 0.0, "agent_compute-ego": 0.022534486452738443, "deviation-heading": 1.4234121343158024, "complete-iteration": 0.20791276454925536, "set_robot_commands": 0.0060418907801310226, "deviation-center-line": 0.5044533060884991, "driven_lanedir_consec": 3.4807969050307035, "sim_compute_sim_state": 0.017336382071177166, "sim_compute_performance-ego": 0.0049058771133422855, "sim_compute_robot_state-ego": 0.009935816129048666, "sim_compute_robot_state-parked0": 0.008493920167287191}}
set_robot_commands_max	0.006083070437113444
set_robot_commands_mean	0.005890037020047506
set_robot_commands_median	0.005921009381612143
set_robot_commands_min	0.005635058879852295
sim_compute_performance-ego_max	0.00498702605565389
sim_compute_performance-ego_mean	0.004867737889289856
sim_compute_performance-ego_median	0.004911681016286215
sim_compute_performance-ego_min	0.004660563468933105
sim_compute_robot_state-ego_max	0.010094117323557536
sim_compute_robot_state-ego_mean	0.00972122887770335
sim_compute_robot_state-ego_median	0.009836200078328451
sim_compute_robot_state-ego_min	0.00911839803059896
sim_compute_robot_state-parked0_max	0.00879405419031779
sim_compute_robot_state-parked0_mean	0.008536580403645834
sim_compute_robot_state-parked0_median	0.008511613607406616
sim_compute_robot_state-parked0_min	0.00832904020945231
sim_compute_sim_state_max	0.01742311159769694
sim_compute_sim_state_mean	0.016522236466407776
sim_compute_sim_state_median	0.017273709376653037
sim_compute_sim_state_min	0.014118415514628092
sim_render-ego_max	0.007392760117848714
sim_render-ego_mean	0.007230546871821087
sim_render-ego_median	0.007284977833429972
sim_render-ego_min	0.0069594717025756835
simulation-passed	1
step_physics_max	0.08215187946955363
step_physics_mean	0.07917973657449087
step_physics_median	0.07916578888893128
step_physics_min	0.07623548905054728
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

36464

6826

Liam Paull 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-02 06:08:16+00:00

2020-11-02 06:17:39+00:00

0:09:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	14.950000000000076
deviation-center-line_median	0.3071094952840746
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.02259734074274699
agent_compute-ego_mean	0.022186914881070455
agent_compute-ego_median	0.02217513918876648
agent_compute-ego_min	0.021800040404001873
complete-iteration_max	0.20560047070185344
complete-iteration_mean	0.19866697311401368
complete-iteration_median	0.19824570099512737
complete-iteration_min	0.19257601976394653
deviation-center-line_max	0.6863069918481528
deviation-center-line_mean	0.35998819605511767
deviation-center-line_min	0.13942680180416853
deviation-heading_max	3.7258518640401217
deviation-heading_mean	1.6586762301304627
deviation-heading_median	1.2113904039371066
deviation-heading_min	0.486072248607516
driven_any_max	1.3686924727581474e-13
driven_any_mean	6.950391439969185e-14
driven_any_median	7.057320516147632e-14
driven_any_min	0.0
driven_lanedir_consec_max	1.7821788787841797e-05
driven_lanedir_consec_mean	4.455447196960449e-06
driven_lanedir_consec_min	0.0
driven_lanedir_max	1.7821788787841797e-05
driven_lanedir_mean	4.455447196960449e-06
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_state_dump_max	0.01607339064280192
get_state_dump_mean	0.01589295943578084
get_state_dump_median	0.015855213006337483
get_state_dump_min	0.015788021087646483
get_ui_image_max	0.03241228421529134
get_ui_image_mean	0.03212948977947235
get_ui_image_median	0.0321995735168457
get_ui_image_min	0.03170652786890666
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.03199450174967448, "step_physics": 0.07568827708562215, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.015788021087646483, "sim_render-ego": 0.006404316425323487, "in-drivable-lane": 0.0, "agent_compute-ego": 0.022006545066833496, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.19257601976394653, "set_robot_commands": 0.005024470488230387, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.015615428288777667, "sim_compute_performance-ego": 0.004330586592356364, "sim_compute_robot_state-ego": 0.007622405687967937, "sim_compute_robot_state-parked0": 0.007940825621287027}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.03241228421529134, "step_physics": 0.07736227591832479, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.015887985229492186, "sim_render-ego": 0.007222379048665364, "in-drivable-lane": 0.0, "agent_compute-ego": 0.022343733310699464, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.198929705619812, "set_robot_commands": 0.006008592446645101, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.014554664293924968, "sim_compute_performance-ego": 0.00483231782913208, "sim_compute_robot_state-ego": 0.009629073143005372, "sim_compute_robot_state-parked0": 0.008506948153177898}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.032404645284016924, "step_physics": 0.07741653919219971, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.01582244078318278, "sim_render-ego": 0.007274929682413737, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02259734074274699, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.1975616963704427, "set_robot_commands": 0.005879886945088704, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.012293077309926351, "sim_compute_performance-ego": 0.004917341073354085, "sim_compute_robot_state-ego": 0.01003537654876709, "sim_compute_robot_state-parked0": 0.008749057451883951}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.03170652786890666, "step_physics": 0.088595396677653, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01607339064280192, "sim_render-ego": 0.006776922543843587, "in-drivable-lane": 0.0, "agent_compute-ego": 0.021800040404001873, "deviation-heading": 0.486072248607516, "complete-iteration": 0.20560047070185344, "set_robot_commands": 0.005207489331563314, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.014442145029703776, "sim_compute_performance-ego": 0.0044946392377217615, "sim_compute_robot_state-ego": 0.008395787874857584, "sim_compute_robot_state-parked0": 0.007939310073852538}}
set_robot_commands_max	0.006008592446645101
set_robot_commands_mean	0.005530109802881877
set_robot_commands_median	0.005543688138326009
set_robot_commands_min	0.005024470488230387
sim_compute_performance-ego_max	0.004917341073354085
sim_compute_performance-ego_mean	0.004643721183141073
sim_compute_performance-ego_median	0.004663478533426921
sim_compute_performance-ego_min	0.004330586592356364
sim_compute_robot_state-ego_max	0.01003537654876709
sim_compute_robot_state-ego_mean	0.008920660813649495
sim_compute_robot_state-ego_median	0.00901243050893148
sim_compute_robot_state-ego_min	0.007622405687967937
sim_compute_robot_state-parked0_max	0.008749057451883951
sim_compute_robot_state-parked0_mean	0.008284035325050353
sim_compute_robot_state-parked0_median	0.008223886887232463
sim_compute_robot_state-parked0_min	0.007939310073852538
sim_compute_sim_state_max	0.015615428288777667
sim_compute_sim_state_mean	0.014226328730583193
sim_compute_sim_state_median	0.014498404661814372
sim_compute_sim_state_min	0.012293077309926351
sim_render-ego_max	0.007274929682413737
sim_render-ego_mean	0.006919636925061544
sim_render-ego_median	0.006999650796254475
sim_render-ego_min	0.006404316425323487
simulation-passed	1
step_physics_max	0.088595396677653
step_physics_mean	0.0797656222184499
step_physics_median	0.07738940755526225
step_physics_min	0.07568827708562215
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

36463

6828

exercise_ros_template

LFv-sim

failed

2020-11-02 06:04:43+00:00

2020-11-02 06:08:07+00:00

0:03:24

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 481, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 36 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 241, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 485, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36456

6833

exercise_ros_template

LFv-sim

success

2020-11-02 05:54:48+00:00

2020-11-02 06:04:07+00:00

0:09:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	14.950000000000076
deviation-center-line_median	0.3071094952840746
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.024340833028157552
agent_compute-ego_mean	0.023049337863922117
agent_compute-ego_median	0.02300514618555705
agent_compute-ego_min	0.02184622605641683
complete-iteration_max	0.2048626136779785
complete-iteration_mean	0.19660169263680777
complete-iteration_median	0.1971696209907532
complete-iteration_min	0.18720491488774615
deviation-center-line_max	0.6863069918481528
deviation-center-line_mean	0.35998819605511767
deviation-center-line_min	0.13942680180416853
deviation-heading_max	3.7258518640401217
deviation-heading_mean	1.6586762301304627
deviation-heading_median	1.2113904039371066
deviation-heading_min	0.486072248607516
driven_any_max	1.3686924727581474e-13
driven_any_mean	6.950391439969185e-14
driven_any_median	7.057320516147632e-14
driven_any_min	0.0
driven_lanedir_consec_max	1.7821788787841797e-05
driven_lanedir_consec_mean	4.455447196960449e-06
driven_lanedir_consec_min	0.0
driven_lanedir_max	1.7821788787841797e-05
driven_lanedir_mean	4.455447196960449e-06
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_state_dump_max	0.017700533866882324
get_state_dump_mean	0.01701434890429179
get_state_dump_median	0.01699812094370524
get_state_dump_min	0.016360619862874348
get_ui_image_max	0.031937573750813804
get_ui_image_mean	0.03133995831012726
get_ui_image_median	0.03162192424138387
get_ui_image_min	0.03017841100692749
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.031371291478474936, "step_physics": 0.06993027051289877, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01762611945470174, "sim_render-ego": 0.0075044600168863934, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024340833028157552, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.20061208089192709, "set_robot_commands": 0.006956234773000081, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01635656674702962, "sim_compute_performance-ego": 0.005158135890960694, "sim_compute_robot_state-ego": 0.011665640672047933, "sim_compute_robot_state-parked0": 0.009517938296000162}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.03017841100692749, "step_physics": 0.06837222576141358, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.017700533866882324, "sim_render-ego": 0.0065835229555765784, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02402904272079468, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.18720491488774615, "set_robot_commands": 0.0051746328671773275, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.014427017370859782, "sim_compute_performance-ego": 0.0045082410176595054, "sim_compute_robot_state-ego": 0.00763340950012207, "sim_compute_robot_state-parked0": 0.008413694699605305}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.031937573750813804, "step_physics": 0.07973517497380575, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.01637012243270874, "sim_render-ego": 0.006548671722412109, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02184622605641683, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.19372716108957927, "set_robot_commands": 0.005079440275828044, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.011938373247782389, "sim_compute_performance-ego": 0.004344925880432129, "sim_compute_robot_state-ego": 0.007641526063283285, "sim_compute_robot_state-parked0": 0.008110072612762451}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.031872557004292805, "step_physics": 0.0890691876411438, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.016360619862874348, "sim_render-ego": 0.006501835982004801, "in-drivable-lane": 0.0, "agent_compute-ego": 0.021981249650319418, "deviation-heading": 0.486072248607516, "complete-iteration": 0.2048626136779785, "set_robot_commands": 0.0050206780433654785, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01399536371231079, "sim_compute_performance-ego": 0.004370532035827637, "sim_compute_robot_state-ego": 0.007634738286336263, "sim_compute_robot_state-parked0": 0.00787952184677124}}
set_robot_commands_max	0.006956234773000081
set_robot_commands_mean	0.005557746489842733
set_robot_commands_median	0.005127036571502685
set_robot_commands_min	0.0050206780433654785
sim_compute_performance-ego_max	0.005158135890960694
sim_compute_performance-ego_mean	0.004595458706219991
sim_compute_performance-ego_median	0.004439386526743571
sim_compute_performance-ego_min	0.004344925880432129
sim_compute_robot_state-ego_max	0.011665640672047933
sim_compute_robot_state-ego_mean	0.008643828630447388
sim_compute_robot_state-ego_median	0.007638132174809774
sim_compute_robot_state-ego_min	0.00763340950012207
sim_compute_robot_state-parked0_max	0.009517938296000162
sim_compute_robot_state-parked0_mean	0.00848030686378479
sim_compute_robot_state-parked0_median	0.00826188365618388
sim_compute_robot_state-parked0_min	0.00787952184677124
sim_compute_sim_state_max	0.01635656674702962
sim_compute_sim_state_mean	0.014179330269495643
sim_compute_sim_state_median	0.014211190541585286
sim_compute_sim_state_min	0.011938373247782389
sim_render-ego_max	0.0075044600168863934
sim_render-ego_mean	0.006784622669219971
sim_render-ego_median	0.006566097338994344
sim_render-ego_min	0.006501835982004801
simulation-passed	1
step_physics_max	0.0890691876411438
step_physics_mean	0.07677671472231548
step_physics_median	0.07483272274335226
step_physics_min	0.06837222576141358
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

36449

6842

Himanshu Arora 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-02 05:44:53+00:00

2020-11-02 05:54:20+00:00

0:09:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9131898382443404
survival_time_median	14.775000000000077
deviation-center-line_median	0.4199940815652547
in-drivable-lane_median	7.325000000000056

other stats

agent_compute-ego_max	0.02408197005589803
agent_compute-ego_mean	0.022976248822076835
agent_compute-ego_median	0.023185394033449425
agent_compute-ego_min	0.021452237165510448
complete-iteration_max	0.2124908844904916
complete-iteration_mean	0.2037804838226428
complete-iteration_median	0.2035235369477642
complete-iteration_min	0.1955839769045512
deviation-center-line_max	0.7896603401857312
deviation-center-line_mean	0.4867934080611675
deviation-center-line_min	0.31752512892842955
deviation-heading_max	2.612260077746975
deviation-heading_mean	1.8351571441308276
deviation-heading_median	1.85761812728292
deviation-heading_min	1.013132244210495
driven_any_max	2.0420994282759506
driven_any_mean	2.010735136988761
driven_any_median	2.014314461986757
driven_any_min	1.9722121957055805
driven_lanedir_consec_max	1.6975274986835518
driven_lanedir_consec_mean	1.0055207590889603
driven_lanedir_consec_min	0.4981758611836096
driven_lanedir_max	1.6975274986835518
driven_lanedir_mean	1.0055207590889603
driven_lanedir_median	0.9131898382443404
driven_lanedir_min	0.4981758611836096
get_state_dump_max	0.017959144115447998
get_state_dump_mean	0.016775882839045284
get_state_dump_median	0.016673605126333018
get_state_dump_min	0.0157971769880671
get_ui_image_max	0.032751654783884684
get_ui_image_mean	0.03139003059076021
get_ui_image_median	0.031116244014238313
get_ui_image_min	0.03057597955067953
in-drivable-lane_max	10.400000000000077
in-drivable-lane_mean	6.762500000000054
in-drivable-lane_min	2.0000000000000284
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.035446091107002, "get_ui_image": 0.03057597955067953, "step_physics": 0.07272128740946451, "survival_time": 14.950000000000076, "driven_lanedir": 1.133980495827501, "get_state_dump": 0.017959144115447998, "sim_render-ego": 0.00677566130956014, "in-drivable-lane": 5.900000000000021, "agent_compute-ego": 0.02408197005589803, "deviation-heading": 2.426479180318582, "complete-iteration": 0.1955839769045512, "set_robot_commands": 0.005203073819478353, "deviation-center-line": 0.7896603401857312, "driven_lanedir_consec": 1.133980495827501, "sim_compute_sim_state": 0.017175006071726482, "sim_compute_performance-ego": 0.004483910401662191, "sim_compute_robot_state-ego": 0.007829955418904622, "sim_compute_robot_state-parked0": 0.008587125937143962}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.993182832866512, "get_ui_image": 0.03086858334606641, "step_physics": 0.07456232260351311, "survival_time": 14.600000000000072, "driven_lanedir": 1.6975274986835518, "get_state_dump": 0.0172254206383065, "sim_render-ego": 0.006781265343705269, "in-drivable-lane": 2.0000000000000284, "agent_compute-ego": 0.023757087041253913, "deviation-heading": 1.2887570742472585, "complete-iteration": 0.1968463977722273, "set_robot_commands": 0.005434046869408594, "deviation-center-line": 0.42586417583399394, "driven_lanedir_consec": 1.6975274986835518, "sim_compute_sim_state": 0.016746114378106105, "sim_compute_performance-ego": 0.004554492153533518, "sim_compute_robot_state-ego": 0.008216560703434357, "sim_compute_robot_state-parked0": 0.008511944176399545}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.0420994282759506, "get_ui_image": 0.032751654783884684, "step_physics": 0.08730899572372436, "survival_time": 14.950000000000076, "driven_lanedir": 0.6923991806611797, "get_state_dump": 0.016121789614359536, "sim_render-ego": 0.007485241889953613, "in-drivable-lane": 8.750000000000092, "agent_compute-ego": 0.022613701025644938, "deviation-heading": 2.612260077746975, "complete-iteration": 0.2102006761233012, "set_robot_commands": 0.005763954321543376, "deviation-center-line": 0.4141239872965155, "driven_lanedir_consec": 0.6923991806611797, "sim_compute_sim_state": 0.014126683076222736, "sim_compute_performance-ego": 0.0049441687266031905, "sim_compute_robot_state-ego": 0.010170454184214276, "sim_compute_robot_state-parked0": 0.008726843198140462}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9722121957055805, "get_ui_image": 0.03136390468241022, "step_physics": 0.09579952530382414, "survival_time": 14.45000000000007, "driven_lanedir": 0.4981758611836096, "get_state_dump": 0.0157971769880671, "sim_render-ego": 0.006680088472201338, "in-drivable-lane": 10.400000000000077, "agent_compute-ego": 0.021452237165510448, "deviation-heading": 1.013132244210495, "complete-iteration": 0.2124908844904916, "set_robot_commands": 0.005052694399876578, "deviation-center-line": 0.31752512892842955, "driven_lanedir_consec": 0.4981758611836096, "sim_compute_sim_state": 0.01600830612710603, "sim_compute_performance-ego": 0.004417711475728705, "sim_compute_robot_state-ego": 0.007804788932668297, "sim_compute_robot_state-parked0": 0.007924270464887256}}
set_robot_commands_max	0.005763954321543376
set_robot_commands_mean	0.005363442352576726
set_robot_commands_median	0.005318560344443474
set_robot_commands_min	0.005052694399876578
sim_compute_performance-ego_max	0.0049441687266031905
sim_compute_performance-ego_mean	0.004600070689381901
sim_compute_performance-ego_median	0.004519201277597855
sim_compute_performance-ego_min	0.004417711475728705
sim_compute_robot_state-ego_max	0.010170454184214276
sim_compute_robot_state-ego_mean	0.008505439809805388
sim_compute_robot_state-ego_median	0.00802325806116949
sim_compute_robot_state-ego_min	0.007804788932668297
sim_compute_robot_state-parked0_max	0.008726843198140462
sim_compute_robot_state-parked0_mean	0.008437545944142807
sim_compute_robot_state-parked0_median	0.008549535056771754
sim_compute_robot_state-parked0_min	0.007924270464887256
sim_compute_sim_state_max	0.017175006071726482
sim_compute_sim_state_mean	0.01601402741329034
sim_compute_sim_state_median	0.016377210252606068
sim_compute_sim_state_min	0.014126683076222736
sim_render-ego_max	0.007485241889953613
sim_render-ego_mean	0.00693056425385509
sim_render-ego_median	0.006778463326632705
sim_render-ego_min	0.006680088472201338
simulation-passed	1
step_physics_max	0.09579952530382414
step_physics_mean	0.08259803276013153
step_physics_median	0.08093565916361874
step_physics_min	0.07272128740946451
survival_time_max	14.950000000000076
survival_time_mean	14.737500000000075
survival_time_min	14.45000000000007

No reset possible

36441

6849

Daniil Lisus

exercise_ros_template

LFv-sim

success

2020-11-02 05:35:17+00:00

2020-11-02 05:44:31+00:00

0:09:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2647876291163085
survival_time_median	14.950000000000076
deviation-center-line_median	0.33972817547863043
in-drivable-lane_median	0.7999999999999972

other stats

agent_compute-ego_max	0.024681494235992432
agent_compute-ego_mean	0.022944599390029907
agent_compute-ego_median	0.022929489215215045
agent_compute-ego_min	0.021237924893697104
complete-iteration_max	0.2023263112703959
complete-iteration_mean	0.19696347296237943
complete-iteration_median	0.1957785181204478
complete-iteration_min	0.19397054433822633
deviation-center-line_max	0.9151343056397956
deviation-center-line_mean	0.4775527492464215
deviation-center-line_min	0.31562034038862935
deviation-heading_max	3.3683034553234616
deviation-heading_mean	2.504982620812936
deviation-heading_median	2.5204693329045194
deviation-heading_min	1.610688362119244
driven_any_max	1.93087561648864
driven_any_mean	1.5996217834170217
driven_any_median	1.6884524270975998
driven_any_min	1.0907066629842468
driven_lanedir_consec_max	1.9125790872487785
driven_lanedir_consec_mean	1.2790171980589848
driven_lanedir_consec_min	0.6739144467545445
driven_lanedir_max	1.9125790872487785
driven_lanedir_mean	1.4537608963655266
driven_lanedir_median	1.614249268428543
driven_lanedir_min	0.6739659613562422
get_state_dump_max	0.017683590253194173
get_state_dump_mean	0.016305124560991924
get_state_dump_median	0.01622339089711507
get_state_dump_min	0.015090126196543376
get_ui_image_max	0.03313449223836263
get_ui_image_mean	0.03172917346159617
get_ui_image_median	0.031667546033859253
get_ui_image_min	0.03044710954030355
in-drivable-lane_max	8.800000000000091
in-drivable-lane_mean	2.6000000000000214
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4818857904377642, "get_ui_image": 0.03044710954030355, "step_physics": 0.07384174903233846, "survival_time": 14.950000000000076, "driven_lanedir": 1.378390747712234, "get_state_dump": 0.017683590253194173, "sim_render-ego": 0.007031302452087402, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.024681494235992432, "deviation-heading": 3.3683034553234616, "complete-iteration": 0.19721907059351604, "set_robot_commands": 0.005688114166259766, "deviation-center-line": 0.9151343056397956, "driven_lanedir_consec": 0.6794674690877647, "sim_compute_sim_state": 0.015740175247192383, "sim_compute_performance-ego": 0.004711310863494873, "sim_compute_robot_state-ego": 0.008729186058044434, "sim_compute_robot_state-parked0": 0.008478525479634604}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.93087561648864, "get_ui_image": 0.031133574644724528, "step_physics": 0.07212912480036418, "survival_time": 14.950000000000076, "driven_lanedir": 1.9125790872487785, "get_state_dump": 0.016978378295898437, "sim_render-ego": 0.006756821473439535, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02391048749287923, "deviation-heading": 1.610688362119244, "complete-iteration": 0.19397054433822633, "set_robot_commands": 0.00538315216700236, "deviation-center-line": 0.34673221130292325, "driven_lanedir_consec": 1.9125790872487785, "sim_compute_sim_state": 0.016386844317118326, "sim_compute_performance-ego": 0.00450155258178711, "sim_compute_robot_state-ego": 0.007909944852193197, "sim_compute_robot_state-parked0": 0.008697521686553956}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.0907066629842468, "get_ui_image": 0.03313449223836263, "step_physics": 0.07912614345550537, "survival_time": 14.950000000000076, "driven_lanedir": 0.6739659613562422, "get_state_dump": 0.015468403498331706, "sim_render-ego": 0.006600336233774821, "in-drivable-lane": 8.800000000000091, "agent_compute-ego": 0.02194849093755086, "deviation-heading": 2.464040668246744, "complete-iteration": 0.19433796564737957, "set_robot_commands": 0.005081462860107422, "deviation-center-line": 0.31562034038862935, "driven_lanedir_consec": 0.6739144467545445, "sim_compute_sim_state": 0.012793460687001544, "sim_compute_performance-ego": 0.004296849568684896, "sim_compute_robot_state-ego": 0.007638031641642252, "sim_compute_robot_state-parked0": 0.008073700269063315}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.8950190637574351, "get_ui_image": 0.03220151742299398, "step_physics": 0.08232410510381062, "survival_time": 14.950000000000076, "driven_lanedir": 1.850107789144852, "get_state_dump": 0.015090126196543376, "sim_render-ego": 0.00692729393641154, "in-drivable-lane": 0.0, "agent_compute-ego": 0.021237924893697104, "deviation-heading": 2.5768979975622948, "complete-iteration": 0.2023263112703959, "set_robot_commands": 0.005737960338592529, "deviation-center-line": 0.33272413965433767, "driven_lanedir_consec": 1.850107789144852, "sim_compute_sim_state": 0.016262427171071372, "sim_compute_performance-ego": 0.004694367249806722, "sim_compute_robot_state-ego": 0.009296364784240722, "sim_compute_robot_state-parked0": 0.008378995259602865}}
set_robot_commands_max	0.005737960338592529
set_robot_commands_mean	0.005472672382990519
set_robot_commands_median	0.005535633166631063
set_robot_commands_min	0.005081462860107422
sim_compute_performance-ego_max	0.004711310863494873
sim_compute_performance-ego_mean	0.0045510200659434
sim_compute_performance-ego_median	0.004597959915796916
sim_compute_performance-ego_min	0.004296849568684896
sim_compute_robot_state-ego_max	0.009296364784240722
sim_compute_robot_state-ego_mean	0.008393381834030152
sim_compute_robot_state-ego_median	0.008319565455118815
sim_compute_robot_state-ego_min	0.007638031641642252
sim_compute_robot_state-parked0_max	0.008697521686553956
sim_compute_robot_state-parked0_mean	0.008407185673713685
sim_compute_robot_state-parked0_median	0.008428760369618735
sim_compute_robot_state-parked0_min	0.008073700269063315
sim_compute_sim_state_max	0.016386844317118326
sim_compute_sim_state_mean	0.015295726855595906
sim_compute_sim_state_median	0.016001301209131878
sim_compute_sim_state_min	0.012793460687001544
sim_render-ego_max	0.007031302452087402
sim_render-ego_mean	0.006828938523928324
sim_render-ego_median	0.006842057704925537
sim_render-ego_min	0.006600336233774821
simulation-passed	1
step_physics_max	0.08232410510381062
step_physics_mean	0.07685528059800466
step_physics_median	0.07648394624392191
step_physics_min	0.07212912480036418
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

36431

6854

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-02 05:26:08+00:00

2020-11-02 05:35:07+00:00

0:08:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.8760234091926495
survival_time_median	14.950000000000076
deviation-center-line_median	0.6863928588630757
in-drivable-lane_median	2.175000000000004

other stats

agent_compute-ego_max	0.02404701312383016
agent_compute-ego_mean	0.022914996839887104
agent_compute-ego_median	0.023026261125656373
agent_compute-ego_min	0.021560451984405517
complete-iteration_max	0.20210800329844156
complete-iteration_mean	0.19742265166339604
complete-iteration_median	0.19859450697898867
complete-iteration_min	0.1903935893971652
deviation-center-line_max	0.7791982595228107
deviation-center-line_mean	0.6116224732590468
deviation-center-line_min	0.2945059157872253
deviation-heading_max	2.695229374392675
deviation-heading_mean	1.703939986531456
deviation-heading_median	1.437021131991711
deviation-heading_min	1.2464883077497266
driven_any_max	2.3231558319134864
driven_any_mean	1.9855645384745324
driven_any_median	2.226202587007916
driven_any_min	1.1666971479688115
driven_lanedir_consec_max	2.23009309866434
driven_lanedir_consec_mean	1.645710945389873
driven_lanedir_consec_min	0.6007038645098526
driven_lanedir_max	2.23009309866434
driven_lanedir_mean	1.6478329499886155
driven_lanedir_median	1.8760234091926495
driven_lanedir_min	0.6091918829048233
get_state_dump_max	0.017104851404825847
get_state_dump_mean	0.01643650945813898
get_state_dump_median	0.016401768859057503
get_state_dump_min	0.01583764870961507
get_ui_image_max	0.03164231458449746
get_ui_image_mean	0.03139670630083577
get_ui_image_median	0.031448871294657385
get_ui_image_min	0.03104676802953084
in-drivable-lane_max	5.250000000000014
in-drivable-lane_mean	2.4000000000000057
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.3231558319134864, "get_ui_image": 0.03104676802953084, "step_physics": 0.0717768677075704, "survival_time": 14.950000000000076, "driven_lanedir": 1.5527043652902957, "get_state_dump": 0.017104851404825847, "sim_render-ego": 0.007121659914652506, "in-drivable-lane": 5.250000000000014, "agent_compute-ego": 0.02404701312383016, "deviation-heading": 1.6075362175209056, "complete-iteration": 0.19733108520507817, "set_robot_commands": 0.005877823829650879, "deviation-center-line": 0.6556285245783747, "driven_lanedir_consec": 1.5527043652902957, "sim_compute_sim_state": 0.01719408591588338, "sim_compute_performance-ego": 0.004754532178243002, "sim_compute_robot_state-ego": 0.009760910669962566, "sim_compute_robot_state-parked0": 0.008470743497212729}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.210208714235926, "get_ui_image": 0.03137023607889811, "step_physics": 0.07570237716039022, "survival_time": 14.950000000000076, "driven_lanedir": 2.199342453095004, "get_state_dump": 0.0164396071434021, "sim_render-ego": 0.0070846072832743325, "in-drivable-lane": 0.0, "agent_compute-ego": 0.023352842330932617, "deviation-heading": 1.2665060464625164, "complete-iteration": 0.1998579287528992, "set_robot_commands": 0.006001718044281006, "deviation-center-line": 0.7171571931477766, "driven_lanedir_consec": 2.199342453095004, "sim_compute_sim_state": 0.016810181935628256, "sim_compute_performance-ego": 0.004759070078531901, "sim_compute_robot_state-ego": 0.009695193767547608, "sim_compute_robot_state-parked0": 0.00846654733022054}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.1666971479688115, "get_ui_image": 0.03164231458449746, "step_physics": 0.07581041458456274, "survival_time": 9.349999999999998, "driven_lanedir": 0.6091918829048233, "get_state_dump": 0.016363930574712908, "sim_render-ego": 0.006360334508559283, "in-drivable-lane": 4.350000000000008, "agent_compute-ego": 0.022699679920380127, "deviation-heading": 2.695229374392675, "complete-iteration": 0.1903935893971652, "set_robot_commands": 0.005248420378741096, "deviation-center-line": 0.2945059157872253, "driven_lanedir_consec": 0.6007038645098526, "sim_compute_sim_state": 0.01213303224288206, "sim_compute_performance-ego": 0.004343892163771359, "sim_compute_robot_state-ego": 0.007556069980968128, "sim_compute_robot_state-parked0": 0.008062064328933145}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.2421964597799056, "get_ui_image": 0.031527506510416664, "step_physics": 0.08090637763341268, "survival_time": 14.950000000000076, "driven_lanedir": 2.23009309866434, "get_state_dump": 0.01583764870961507, "sim_render-ego": 0.007067685127258301, "in-drivable-lane": 0.0, "agent_compute-ego": 0.021560451984405517, "deviation-heading": 1.2464883077497266, "complete-iteration": 0.20210800329844156, "set_robot_commands": 0.005824160575866699, "deviation-center-line": 0.7791982595228107, "driven_lanedir_consec": 2.23009309866434, "sim_compute_sim_state": 0.01629302978515625, "sim_compute_performance-ego": 0.00477416197458903, "sim_compute_robot_state-ego": 0.009784475962320963, "sim_compute_robot_state-parked0": 0.00836129347483317}}
set_robot_commands_max	0.006001718044281006
set_robot_commands_mean	0.005738030707134921
set_robot_commands_median	0.005850992202758789
set_robot_commands_min	0.005248420378741096
sim_compute_performance-ego_max	0.00477416197458903
sim_compute_performance-ego_mean	0.004657914098783823
sim_compute_performance-ego_median	0.0047568011283874514
sim_compute_performance-ego_min	0.004343892163771359
sim_compute_robot_state-ego_max	0.009784475962320963
sim_compute_robot_state-ego_mean	0.009199162595199817
sim_compute_robot_state-ego_median	0.009728052218755086
sim_compute_robot_state-ego_min	0.007556069980968128
sim_compute_robot_state-parked0_max	0.008470743497212729
sim_compute_robot_state-parked0_mean	0.008340162157799896
sim_compute_robot_state-parked0_median	0.008413920402526854
sim_compute_robot_state-parked0_min	0.008062064328933145
sim_compute_sim_state_max	0.01719408591588338
sim_compute_sim_state_mean	0.015607582469887483
sim_compute_sim_state_median	0.016551605860392254
sim_compute_sim_state_min	0.01213303224288206
sim_render-ego_max	0.007121659914652506
sim_render-ego_mean	0.006908571708436106
sim_render-ego_median	0.007076146205266316
sim_render-ego_min	0.006360334508559283
simulation-passed	1
step_physics_max	0.08090637763341268
step_physics_mean	0.076049009271484
step_physics_median	0.07575639587247648
step_physics_min	0.0717768677075704
survival_time_max	14.950000000000076
survival_time_mean	13.550000000000058
survival_time_min	9.349999999999998

No reset possible

36430

9226

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 05:25:04+00:00

2020-11-02 05:25:53+00:00

0:00:49

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9226/LFv-sim-Sandy2-sandy-1-job36430-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36427

9230

Olga (Ge Ya) Xu 🇨🇦

exercise_ros_template

LFv-sim

aborted

2020-11-02 05:23:39+00:00

2020-11-02 05:24:29+00:00

0:00:50

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9230/LFv-sim-Sandy2-sandy-1-job36427-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36426

9230

Olga (Ge Ya) Xu 🇨🇦

exercise_ros_template

LFv-sim

aborted

2020-11-02 05:22:35+00:00

2020-11-02 05:23:23+00:00

0:00:48

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9230/LFv-sim-Sandy2-sandy-1-job36426-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36424

9233

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 05:21:22+00:00

2020-11-02 05:22:11+00:00

0:00:49

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9233/LFv-sim-Sandy2-sandy-1-job36424-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36421

9235

exercise_ros_template

LFv-sim

error

2020-11-02 05:20:15+00:00

2020-11-02 05:20:59+00:00

0:00:44

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9235/LFv-sim-Sandy2-sandy-1-job36421-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36417

9235

exercise_ros_template

LFv-sim

error

2020-11-02 05:19:11+00:00

2020-11-02 05:19:57+00:00

0:00:46

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9235/LFv-sim-Sandy2-sandy-1-job36417-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36413

9238

exercise_ros_template

LFv-sim

error

2020-11-02 05:17:37+00:00

2020-11-02 05:18:30+00:00

0:00:53

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9238/LFv-sim-Sandy2-sandy-1-job36413-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36410

9239

exercise_ros_template

LFv-sim

error

2020-11-02 05:16:42+00:00

2020-11-02 05:17:29+00:00

0:00:47

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9239/LFv-sim-Sandy2-sandy-1-job36410-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36409

9242

exercise_ros_template

LFv-sim

error

2020-11-02 05:15:41+00:00

2020-11-02 05:16:26+00:00

0:00:45

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9242/LFv-sim-Sandy2-sandy-1-job36409-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36406

9243

exercise_ros_template

LFv-sim

error

2020-11-02 05:14:12+00:00

2020-11-02 05:14:54+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9243/LFv-sim-Sandy2-sandy-1-job36406-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36404

9247

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 05:12:46+00:00

2020-11-02 05:13:30+00:00

0:00:44

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9247/LFv-sim-Sandy2-sandy-1-job36404-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36402

9248

exercise_ros_template

LFv-sim

error

2020-11-02 05:11:41+00:00

2020-11-02 05:12:26+00:00

0:00:45

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9248/LFv-sim-Sandy2-sandy-1-job36402-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36400

9249

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 05:10:36+00:00

2020-11-02 05:11:24+00:00

0:00:48

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9249/LFv-sim-Sandy2-sandy-1-job36400-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36396

9253

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 05:09:33+00:00

2020-11-02 05:10:22+00:00

0:00:49

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9253/LFv-sim-Sandy2-sandy-1-job36396-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36392

9254

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 05:08:09+00:00

2020-11-02 05:08:58+00:00

0:00:49

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9254/LFv-sim-Sandy2-sandy-1-job36392-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36379

10006

Fernanda Custodio Pereira do Carmo 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-02 04:58:39+00:00

2020-11-02 05:07:54+00:00

0:09:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.0935703459672697
survival_time_median	14.950000000000076
deviation-center-line_median	0.5248422264741708
in-drivable-lane_median	3.4500000000000375

other stats

agent_compute-ego_max	0.023750949700673422
agent_compute-ego_mean	0.02323714406681463
agent_compute-ego_median	0.023463654120763143
agent_compute-ego_min	0.02227031832505882
complete-iteration_max	0.20184669415156045
complete-iteration_mean	0.1974230640749388
complete-iteration_median	0.19749998323525053
complete-iteration_min	0.1928455956776937
deviation-center-line_max	0.7841389944846712
deviation-center-line_mean	0.5303770743910605
deviation-center-line_min	0.2876848501312294
deviation-heading_max	1.9430747324645767
deviation-heading_mean	1.2329782017780189
deviation-heading_median	1.21232201913538
deviation-heading_min	0.5641940363767379
driven_any_max	3.1652198488627503
driven_any_mean	2.994729558674326
driven_any_median	3.165157043152986
driven_any_min	2.483384299528581
driven_lanedir_consec_max	3.147068862227603
driven_lanedir_consec_mean	2.1753611354049407
driven_lanedir_consec_min	1.36723498745762
driven_lanedir_max	3.147068862227603
driven_lanedir_mean	2.1753611354049407
driven_lanedir_median	2.0935703459672697
driven_lanedir_min	1.36723498745762
get_state_dump_max	0.01699612299601237
get_state_dump_mean	0.016715268424794646
get_state_dump_median	0.01686184247334798
get_state_dump_min	0.016141265756470242
get_ui_image_max	0.03170425378823582
get_ui_image_mean	0.03093453179683363
get_ui_image_median	0.03085668961207072
get_ui_image_min	0.03032049417495727
in-drivable-lane_max	7.350000000000086
in-drivable-lane_mean	3.56250000000004
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.483384299528581, "get_ui_image": 0.03170425378823582, "step_physics": 0.07418400929446965, "survival_time": 11.850000000000032, "driven_lanedir": 1.36723498745762, "get_state_dump": 0.016141265756470242, "sim_render-ego": 0.006658071204076839, "in-drivable-lane": 5.100000000000049, "agent_compute-ego": 0.02227031832505882, "deviation-heading": 0.5641940363767379, "complete-iteration": 0.19369044686168557, "set_robot_commands": 0.0050200188713234685, "deviation-center-line": 0.2876848501312294, "driven_lanedir_consec": 1.36723498745762, "sim_compute_sim_state": 0.01730116510190038, "sim_compute_performance-ego": 0.004347575867729348, "sim_compute_robot_state-ego": 0.007667716545394704, "sim_compute_robot_state-parked0": 0.00821568794894319}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.1652198488627503, "get_ui_image": 0.03032049417495727, "step_physics": 0.07228043476740519, "survival_time": 14.950000000000076, "driven_lanedir": 3.147068862227603, "get_state_dump": 0.01691774606704712, "sim_render-ego": 0.006689052581787109, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02326890389124553, "deviation-heading": 1.2907459956086091, "complete-iteration": 0.1928455956776937, "set_robot_commands": 0.005287297566731771, "deviation-center-line": 0.5056041464230143, "driven_lanedir_consec": 3.147068862227603, "sim_compute_sim_state": 0.01699413776397705, "sim_compute_performance-ego": 0.004546282291412354, "sim_compute_robot_state-ego": 0.008113792737325033, "sim_compute_robot_state-parked0": 0.008238840103149413}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.1651144863335894, "get_ui_image": 0.030979331334431967, "step_physics": 0.07711172183354696, "survival_time": 14.950000000000076, "driven_lanedir": 1.4492160339520068, "get_state_dump": 0.01699612299601237, "sim_render-ego": 0.007347470919291179, "in-drivable-lane": 7.350000000000086, "agent_compute-ego": 0.023750949700673422, "deviation-heading": 1.9430747324645767, "complete-iteration": 0.20130951960881552, "set_robot_commands": 0.0062185271581014, "deviation-center-line": 0.5440803065253274, "driven_lanedir_consec": 1.4492160339520068, "sim_compute_sim_state": 0.014718857606252037, "sim_compute_performance-ego": 0.004901942412058513, "sim_compute_robot_state-ego": 0.010214698314666749, "sim_compute_robot_state-parked0": 0.00887753168741862}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.165199599972382, "get_ui_image": 0.030734047889709473, "step_physics": 0.07632656812667847, "survival_time": 14.950000000000076, "driven_lanedir": 2.7379246579825325, "get_state_dump": 0.016805938879648843, "sim_render-ego": 0.007198495070139567, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.02365840435028076, "deviation-heading": 1.133898042662151, "complete-iteration": 0.20184669415156045, "set_robot_commands": 0.006244957447052002, "deviation-center-line": 0.7841389944846712, "driven_lanedir_consec": 2.7379246579825325, "sim_compute_sim_state": 0.017165961265563964, "sim_compute_performance-ego": 0.004768404960632324, "sim_compute_robot_state-ego": 0.009695730209350583, "sim_compute_robot_state-parked0": 0.009059536457061769}}
set_robot_commands_max	0.006244957447052002
set_robot_commands_mean	0.00569270026080216
set_robot_commands_median	0.005752912362416585
set_robot_commands_min	0.0050200188713234685
sim_compute_performance-ego_max	0.004901942412058513
sim_compute_performance-ego_mean	0.004641051382958134
sim_compute_performance-ego_median	0.004657343626022339
sim_compute_performance-ego_min	0.004347575867729348
sim_compute_robot_state-ego_max	0.010214698314666749
sim_compute_robot_state-ego_mean	0.008922984451684268
sim_compute_robot_state-ego_median	0.008904761473337809
sim_compute_robot_state-ego_min	0.007667716545394704
sim_compute_robot_state-parked0_max	0.009059536457061769
sim_compute_robot_state-parked0_mean	0.008597899049143248
sim_compute_robot_state-parked0_median	0.008558185895284016
sim_compute_robot_state-parked0_min	0.00821568794894319
sim_compute_sim_state_max	0.01730116510190038
sim_compute_sim_state_mean	0.016545030434423357
sim_compute_sim_state_median	0.017080049514770507
sim_compute_sim_state_min	0.014718857606252037
sim_render-ego_max	0.007347470919291179
sim_render-ego_mean	0.006973272443823674
sim_render-ego_median	0.006943773825963338
sim_render-ego_min	0.006658071204076839
simulation-passed	1
step_physics_max	0.07711172183354696
step_physics_mean	0.07497568350552507
step_physics_median	0.07525528871057406
step_physics_min	0.07228043476740519
survival_time_max	14.950000000000076
survival_time_mean	14.175000000000065
survival_time_min	11.850000000000032

No reset possible

36378

9268

exercise_ros_template

LFv-sim

error

2020-11-02 04:57:49+00:00

2020-11-02 04:58:31+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9268/LFv-sim-Sandy2-sandy-1-job36378-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36375

9269

exercise_ros_template

LFv-sim

aborted

2020-11-02 04:56:20+00:00

2020-11-02 04:57:14+00:00

0:00:54

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9269/LFv-sim-Sandy2-sandy-1-job36375-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36372

9274

exercise_ros_template

LFv-sim

error

2020-11-02 04:55:15+00:00

2020-11-02 04:56:04+00:00

0:00:49

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9274/LFv-sim-Sandy2-sandy-1-job36372-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36369

9277

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:54:24+00:00

2020-11-02 04:55:06+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9277/LFv-sim-Sandy2-sandy-1-job36369-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36368

9277

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:53:26+00:00

2020-11-02 04:54:09+00:00

0:00:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9277/LFv-sim-Sandy2-sandy-1-job36368-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36366

9279

exercise_ros_template

LFv-sim

aborted

2020-11-02 04:51:57+00:00

2020-11-02 04:52:50+00:00

0:00:53

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9279/LFv-sim-Sandy2-sandy-1-job36366-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36363

9284

exercise_ros_template

LFv-sim

error

2020-11-02 04:50:42+00:00

2020-11-02 04:51:30+00:00

0:00:48

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9284/LFv-sim-Sandy2-sandy-1-job36363-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36358

9286

Liam Paull 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:49:42+00:00

2020-11-02 04:50:26+00:00

0:00:44

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9286/LFv-sim-Sandy2-sandy-1-job36358-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36356

9287

exercise_ros_template

LFv-sim

error

2020-11-02 04:48:36+00:00

2020-11-02 04:49:19+00:00

0:00:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9287/LFv-sim-Sandy2-sandy-1-job36356-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36354

9289

exercise_ros_template

LFv-sim

aborted

2020-11-02 04:47:03+00:00

2020-11-02 04:47:55+00:00

0:00:52

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9289/LFv-sim-Sandy2-sandy-1-job36354-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36350

9294

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:45:59+00:00

2020-11-02 04:46:42+00:00

0:00:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9294/LFv-sim-Sandy2-sandy-1-job36350-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36348

9297

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:44:33+00:00

2020-11-02 04:45:25+00:00

0:00:52

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9297/LFv-sim-Sandy2-sandy-1-job36348-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36345

9301

Raphael Jean

real-exercise-1

LFv-sim

error

2020-11-02 04:43:23+00:00

2020-11-02 04:44:14+00:00

0:00:51

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9301/LFv-sim-Sandy2-sandy-1-job36345-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36342

9303

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:41:46+00:00

2020-11-02 04:42:32+00:00

0:00:46

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9303/LFv-sim-Sandy2-sandy-1-job36342-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36338

9304

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:40:45+00:00

2020-11-02 04:41:30+00:00

0:00:45

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9304/LFv-sim-Sandy2-sandy-1-job36338-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36333

10005

Fernanda Custodio Pereira do Carmo 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-02 04:30:35+00:00

2020-11-02 04:40:30+00:00

0:09:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.820402347277254
survival_time_median	14.950000000000076
deviation-center-line_median	0.7412499351328129
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.021994597911834717
agent_compute-ego_mean	0.021933232744534813
agent_compute-ego_median	0.021931869586308796
agent_compute-ego_min	0.02187459389368693
complete-iteration_max	0.20598982095718385
complete-iteration_mean	0.20162096083164216
complete-iteration_median	0.20099486390749616
complete-iteration_min	0.1985042945543925
deviation-center-line_max	0.8995563227571086
deviation-center-line_mean	0.7292312988660832
deviation-center-line_min	0.5348690024415981
deviation-heading_max	1.610325902019056
deviation-heading_mean	1.3301633847735892
deviation-heading_median	1.3764349369873077
deviation-heading_min	0.957457763100686
driven_any_max	2.8589239134758895
driven_any_mean	2.8565651040041793
driven_any_median	2.858868674895521
driven_any_min	2.8495991527497857
driven_lanedir_consec_max	2.8422659455719548
driven_lanedir_consec_mean	2.666226060074846
driven_lanedir_consec_min	2.1818336001729204
driven_lanedir_max	2.8422659455719548
driven_lanedir_mean	2.666226060074846
driven_lanedir_median	2.820402347277254
driven_lanedir_min	2.1818336001729204
get_state_dump_max	0.016417775948842365
get_state_dump_mean	0.016099263032277426
get_state_dump_median	0.01602729360262553
get_state_dump_min	0.015924688975016275
get_ui_image_max	0.031892025470733644
get_ui_image_mean	0.03157977859179179
get_ui_image_median	0.03170333584149679
get_ui_image_min	0.03102041721343994
in-drivable-lane_max	3.300000000000047
in-drivable-lane_mean	0.8250000000000117
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.8495991527497857, "get_ui_image": 0.03102041721343994, "step_physics": 0.07795681794484456, "survival_time": 14.950000000000076, "driven_lanedir": 2.8087642939006443, "get_state_dump": 0.016417775948842365, "sim_render-ego": 0.006905504862467448, "in-drivable-lane": 0.0, "agent_compute-ego": 0.021960330804189045, "deviation-heading": 1.610325902019056, "complete-iteration": 0.1985042945543925, "set_robot_commands": 0.005520723660786947, "deviation-center-line": 0.6598500159856107, "driven_lanedir_consec": 2.8087642939006443, "sim_compute_sim_state": 0.016913461685180663, "sim_compute_performance-ego": 0.004675501982371012, "sim_compute_robot_state-ego": 0.008893744150797526, "sim_compute_robot_state-parked0": 0.008069086869557698}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.8589156093497827, "get_ui_image": 0.031892025470733644, "step_physics": 0.07960443973541259, "survival_time": 14.950000000000076, "driven_lanedir": 2.832040400653864, "get_state_dump": 0.01597361405690511, "sim_render-ego": 0.007262975374857585, "in-drivable-lane": 0.0, "agent_compute-ego": 0.021903408368428547, "deviation-heading": 1.2722126567709342, "complete-iteration": 0.2023838257789612, "set_robot_commands": 0.00578581968943278, "deviation-center-line": 0.5348690024415981, "driven_lanedir_consec": 2.832040400653864, "sim_compute_sim_state": 0.016612939834594727, "sim_compute_performance-ego": 0.0048782547314961755, "sim_compute_robot_state-ego": 0.009754108587900797, "sim_compute_robot_state-parked0": 0.008538241386413575}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8588217404412597, "get_ui_image": 0.03168639341990153, "step_physics": 0.08213251829147339, "survival_time": 14.950000000000076, "driven_lanedir": 2.1818336001729204, "get_state_dump": 0.015924688975016275, "sim_render-ego": 0.006935899257659912, "in-drivable-lane": 3.300000000000047, "agent_compute-ego": 0.02187459389368693, "deviation-heading": 1.4806572172036805, "complete-iteration": 0.1996059020360311, "set_robot_commands": 0.005086665153503418, "deviation-center-line": 0.8995563227571086, "driven_lanedir_consec": 2.1818336001729204, "sim_compute_sim_state": 0.014483656883239746, "sim_compute_performance-ego": 0.004575425783793131, "sim_compute_robot_state-ego": 0.008537100156148275, "sim_compute_robot_state-parked0": 0.008189612229665121}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8589239134758895, "get_ui_image": 0.03172027826309204, "step_physics": 0.08522501150767009, "survival_time": 14.950000000000076, "driven_lanedir": 2.8422659455719548, "get_state_dump": 0.01608097314834595, "sim_render-ego": 0.0069049437840779625, "in-drivable-lane": 0.0, "agent_compute-ego": 0.021994597911834717, "deviation-heading": 0.957457763100686, "complete-iteration": 0.20598982095718385, "set_robot_commands": 0.0054265435536702475, "deviation-center-line": 0.8226498542800151, "driven_lanedir_consec": 2.8422659455719548, "sim_compute_sim_state": 0.016658841768900555, "sim_compute_performance-ego": 0.004574728012084961, "sim_compute_robot_state-ego": 0.008872131506601969, "sim_compute_robot_state-parked0": 0.00835554043451945}}
set_robot_commands_max	0.00578581968943278
set_robot_commands_mean	0.005454938014348348
set_robot_commands_median	0.005473633607228598
set_robot_commands_min	0.005086665153503418
sim_compute_performance-ego_max	0.0048782547314961755
sim_compute_performance-ego_mean	0.00467597762743632
sim_compute_performance-ego_median	0.004625463883082072
sim_compute_performance-ego_min	0.004574728012084961
sim_compute_robot_state-ego_max	0.009754108587900797
sim_compute_robot_state-ego_mean	0.00901427110036214
sim_compute_robot_state-ego_median	0.008882937828699748
sim_compute_robot_state-ego_min	0.008537100156148275
sim_compute_robot_state-parked0_max	0.008538241386413575
sim_compute_robot_state-parked0_mean	0.008288120230038961
sim_compute_robot_state-parked0_median	0.008272576332092284
sim_compute_robot_state-parked0_min	0.008069086869557698
sim_compute_sim_state_max	0.016913461685180663
sim_compute_sim_state_mean	0.01616722504297892
sim_compute_sim_state_median	0.01663589080174764
sim_compute_sim_state_min	0.014483656883239746
sim_render-ego_max	0.007262975374857585
sim_render-ego_mean	0.007002330819765727
sim_render-ego_median	0.0069207020600636805
sim_render-ego_min	0.0069049437840779625
simulation-passed	1
step_physics_max	0.08522501150767009
step_physics_mean	0.08122969686985015
step_physics_median	0.08086847901344299
step_physics_min	0.07795681794484456
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

36331

9313

Raphael Jean

sim-exercise-1

LFv-sim

error

2020-11-02 04:29:33+00:00

2020-11-02 04:30:15+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9313/LFv-sim-Sandy2-sandy-1-job36331-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36326

9314

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:28:36+00:00

2020-11-02 04:29:19+00:00

0:00:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9314/LFv-sim-Sandy2-sandy-1-job36326-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36323

9314

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:27:32+00:00

2020-11-02 04:28:15+00:00

0:00:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9314/LFv-sim-Sandy2-sandy-1-job36323-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36321

9316

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:26:23+00:00

2020-11-02 04:27:10+00:00

0:00:47

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9316/LFv-sim-Sandy2-sandy-1-job36321-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36318

9320

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:25:02+00:00

2020-11-02 04:25:55+00:00

0:00:53

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9320/LFv-sim-Sandy2-sandy-1-job36318-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36315

9321

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:23:53+00:00

2020-11-02 04:24:40+00:00

0:00:47

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9321/LFv-sim-Sandy2-sandy-1-job36315-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36312

9324

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:22:47+00:00

2020-11-02 04:23:38+00:00

0:00:51

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9324/LFv-sim-Sandy2-sandy-1-job36312-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36310

9328

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:21:38+00:00

2020-11-02 04:22:25+00:00

0:00:47

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9328/LFv-sim-Sandy2-sandy-1-job36310-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36308

9330

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:20:17+00:00

2020-11-02 04:21:04+00:00

0:00:47

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9330/LFv-sim-Sandy2-sandy-1-job36308-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36305

9332

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

error

2020-11-02 04:18:53+00:00

2020-11-02 04:19:50+00:00

0:00:57

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9332/LFv-sim-Sandy2-sandy-1-job36305-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36302

9334

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:17:47+00:00

2020-11-02 04:18:33+00:00

0:00:46

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9334/LFv-sim-Sandy2-sandy-1-job36302-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36298

9336

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

error

2020-11-02 04:16:30+00:00

2020-11-02 04:17:18+00:00

0:00:48

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9336/LFv-sim-Sandy2-sandy-1-job36298-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36295

9337

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

aborted

2020-11-02 04:14:47+00:00

2020-11-02 04:15:52+00:00

0:01:05

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-Sandy2-sandy-1-job36295-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36293

9338

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

error

2020-11-02 04:13:19+00:00

2020-11-02 04:14:14+00:00

0:00:55

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9338/LFv-sim-Sandy2-sandy-1-job36293-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36291

9339

Himanshu Arora 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:11:50+00:00

2020-11-02 04:12:39+00:00

0:00:49

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9339/LFv-sim-Sandy2-sandy-1-job36291-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36289

9340

Jerome Labonte 🇨🇦

sim-exercise-1

LFv-sim

aborted

2020-11-02 04:10:19+00:00

2020-11-02 04:11:11+00:00

0:00:52

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9340/LFv-sim-Sandy2-sandy-1-job36289-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36287

9342

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

error

2020-11-02 04:08:53+00:00

2020-11-02 04:09:44+00:00

0:00:51

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9342/LFv-sim-Sandy2-sandy-1-job36287-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36285

9349

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

error

2020-11-02 04:07:29+00:00

2020-11-02 04:08:18+00:00

0:00:49

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9349/LFv-sim-Sandy2-sandy-1-job36285-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36281

9354

Himanshu Arora 🇨🇦

exercise_ros_template

LFv-sim

error

2020-11-02 04:06:06+00:00

2020-11-02 04:07:01+00:00

0:00:55

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9354/LFv-sim-Sandy2-sandy-1-job36281-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36279

9357

exercise_ros_template

LFv-sim

error

2020-11-02 04:04:44+00:00

2020-11-02 04:05:38+00:00

0:00:54

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9357/LFv-sim-Sandy2-sandy-1-job36279-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36277

9358

exercise_ros_template

LFv-sim

error

2020-11-02 04:03:12+00:00

2020-11-02 04:04:05+00:00

0:00:53

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9358/LFv-sim-Sandy2-sandy-1-job36277-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36275

9359

exercise_ros_template

LFv-sim

error

2020-11-02 04:01:42+00:00

2020-11-02 04:02:39+00:00

0:00:57

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9359/LFv-sim-Sandy2-sandy-1-job36275-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36262

10004

Mo Kleit 🇨🇦

sim-exercise-1

LFv-sim

success

2020-11-02 03:51:30+00:00

2020-11-02 04:01:10+00:00

0:09:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.675470496547572
survival_time_median	14.950000000000076
deviation-center-line_median	0.826687405728705
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.024750638008117675
agent_compute-ego_mean	0.024570524096488952
agent_compute-ego_median	0.024524512688318886
agent_compute-ego_min	0.024482433001200357
complete-iteration_max	0.2024127475420634
complete-iteration_mean	0.19927456279595693
complete-iteration_median	0.2003113802274068
complete-iteration_min	0.1940627431869507
deviation-center-line_max	1.1497938799802636
deviation-center-line_mean	0.8031888837105894
deviation-center-line_min	0.409586843404684
deviation-heading_max	2.352757789876516
deviation-heading_mean	1.8168732008253632
deviation-heading_median	1.9037248040898924
deviation-heading_min	1.1072854052451515
driven_any_max	3.5300743139810447
driven_any_mean	2.6751242630917536
driven_any_median	2.691345150063708
driven_any_min	1.7877324382585529
driven_lanedir_consec_max	3.4976653231132104
driven_lanedir_consec_mean	2.6326997831446044
driven_lanedir_consec_min	1.6821928163700637
driven_lanedir_max	3.4976653231132104
driven_lanedir_mean	2.6326997831446044
driven_lanedir_median	2.675470496547572
driven_lanedir_min	1.6821928163700637
get_state_dump_max	0.01737871805826823
get_state_dump_mean	0.017225405772527055
get_state_dump_median	0.017241969108581542
get_state_dump_min	0.017038966814676922
get_ui_image_max	0.031648798783620195
get_ui_image_mean	0.03125651856263478
get_ui_image_median	0.031298933823903405
get_ui_image_min	0.03077940781911214
in-drivable-lane_max	1.0000000000000142
in-drivable-lane_mean	0.25000000000000355
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.1563270969534623, "get_ui_image": 0.03153487205505371, "step_physics": 0.07168638229370117, "survival_time": 14.950000000000076, "driven_lanedir": 2.137632306522342, "get_state_dump": 0.017257259686787922, "sim_render-ego": 0.007347002029418946, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02450696309407552, "deviation-heading": 2.024447706565792, "complete-iteration": 0.20144173224767048, "set_robot_commands": 0.006377514998118083, "deviation-center-line": 1.1497938799802636, "driven_lanedir_consec": 2.137632306522342, "sim_compute_sim_state": 0.017813393274943034, "sim_compute_performance-ego": 0.004954110781351725, "sim_compute_robot_state-ego": 0.010569520791371663, "sim_compute_robot_state-parked0": 0.009220801989237469}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.5300743139810447, "get_ui_image": 0.031648798783620195, "step_physics": 0.07267465273539225, "survival_time": 14.950000000000076, "driven_lanedir": 3.4976653231132104, "get_state_dump": 0.017038966814676922, "sim_render-ego": 0.007393852074940999, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024482433001200357, "deviation-heading": 1.7830019016139929, "complete-iteration": 0.2024127475420634, "set_robot_commands": 0.006521544456481934, "deviation-center-line": 0.5052795666454553, "driven_lanedir_consec": 3.4976653231132104, "sim_compute_sim_state": 0.017682150999704997, "sim_compute_performance-ego": 0.004921284516652425, "sim_compute_robot_state-ego": 0.010497769514719646, "sim_compute_robot_state-parked0": 0.00938071091969808}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.7877324382585529, "get_ui_image": 0.03077940781911214, "step_physics": 0.07442758957544962, "survival_time": 14.950000000000076, "driven_lanedir": 1.6821928163700637, "get_state_dump": 0.01737871805826823, "sim_render-ego": 0.006816892623901367, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.024750638008117675, "deviation-heading": 2.352757789876516, "complete-iteration": 0.1940627431869507, "set_robot_commands": 0.005242280165354411, "deviation-center-line": 1.1480952448119548, "driven_lanedir_consec": 1.6821928163700637, "sim_compute_sim_state": 0.013739288647969564, "sim_compute_performance-ego": 0.004441997210184733, "sim_compute_robot_state-ego": 0.007852203845977783, "sim_compute_robot_state-parked0": 0.008460330963134765}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.226363203173954, "get_ui_image": 0.031062995592753093, "step_physics": 0.0745967157681783, "survival_time": 14.950000000000076, "driven_lanedir": 3.213308686572802, "get_state_dump": 0.017226678530375163, "sim_render-ego": 0.0068564772605896, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024542062282562255, "deviation-heading": 1.1072854052451515, "complete-iteration": 0.19918102820714317, "set_robot_commands": 0.0056714177131652836, "deviation-center-line": 0.409586843404684, "driven_lanedir_consec": 3.213308686572802, "sim_compute_sim_state": 0.017354156176249188, "sim_compute_performance-ego": 0.004570929209391276, "sim_compute_robot_state-ego": 0.00853138526280721, "sim_compute_robot_state-parked0": 0.008595496018727621}}
set_robot_commands_max	0.006521544456481934
set_robot_commands_mean	0.005953189333279927
set_robot_commands_median	0.006024466355641684
set_robot_commands_min	0.005242280165354411
sim_compute_performance-ego_max	0.004954110781351725
sim_compute_performance-ego_mean	0.00472208042939504
sim_compute_performance-ego_median	0.00474610686302185
sim_compute_performance-ego_min	0.004441997210184733
sim_compute_robot_state-ego_max	0.010569520791371663
sim_compute_robot_state-ego_mean	0.009362719853719077
sim_compute_robot_state-ego_median	0.009514577388763427
sim_compute_robot_state-ego_min	0.007852203845977783
sim_compute_robot_state-parked0_max	0.00938071091969808
sim_compute_robot_state-parked0_mean	0.008914334972699483
sim_compute_robot_state-parked0_median	0.008908149003982544
sim_compute_robot_state-parked0_min	0.008460330963134765
sim_compute_sim_state_max	0.017813393274943034
sim_compute_sim_state_mean	0.016647247274716694
sim_compute_sim_state_median	0.017518153587977092
sim_compute_sim_state_min	0.013739288647969564
sim_render-ego_max	0.007393852074940999
sim_render-ego_mean	0.007103555997212728
sim_render-ego_median	0.007101739645004273
sim_render-ego_min	0.006816892623901367
simulation-passed	1
step_physics_max	0.0745967157681783
step_physics_mean	0.07334633509318034
step_physics_median	0.07355112115542094
step_physics_min	0.07168638229370117
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

36255

9372

Himanshu Arora 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-02 03:41:30+00:00

2020-11-02 03:51:06+00:00

0:09:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.071349301483161
survival_time_median	14.950000000000076
deviation-center-line_median	0.6283851026252831
in-drivable-lane_median	2.025000000000025

other stats

agent_compute-ego_max	0.02437310464392404
agent_compute-ego_mean	0.02306556167009051
agent_compute-ego_median	0.022882807652155557
agent_compute-ego_min	0.02212352673212687
complete-iteration_max	0.21871627887090048
complete-iteration_mean	0.20970667983840977
complete-iteration_median	0.21203097065289817
complete-iteration_min	0.19604849917694225
deviation-center-line_max	0.7867882767212048
deviation-center-line_mean	0.5636847228254517
deviation-center-line_min	0.21118040933003593
deviation-heading_max	2.6266830244586727
deviation-heading_mean	1.945553172199478
deviation-heading_median	2.059322992672709
deviation-heading_min	1.0368836789938218
driven_any_max	2.944337302105569
driven_any_mean	2.6728243258011917
driven_any_median	2.7486360047884917
driven_any_min	2.2496879915222134
driven_lanedir_consec_max	2.911589511859374
driven_lanedir_consec_mean	2.109681983255431
driven_lanedir_consec_min	1.3844398181960271
driven_lanedir_max	2.911589511859374
driven_lanedir_mean	2.109681983255431
driven_lanedir_median	2.071349301483161
driven_lanedir_min	1.3844398181960271
get_state_dump_max	0.01788246989761811
get_state_dump_mean	0.016472403507717007
get_state_dump_median	0.016277726093928017
get_state_dump_min	0.01545169194539388
get_ui_image_max	0.033312293688456215
get_ui_image_mean	0.031685899302512616
get_ui_image_median	0.03142621874809265
get_ui_image_min	0.030578866025408963
in-drivable-lane_max	6.950000000000082
in-drivable-lane_mean	2.750000000000033
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.2496879915222134, "get_ui_image": 0.030578866025408963, "step_physics": 0.07349311844985372, "survival_time": 11.65000000000003, "driven_lanedir": 1.449779405254878, "get_state_dump": 0.01788246989761811, "sim_render-ego": 0.006685188399875625, "in-drivable-lane": 4.05000000000005, "agent_compute-ego": 0.02437310464392404, "deviation-heading": 1.0368836789938218, "complete-iteration": 0.19604849917694225, "set_robot_commands": 0.005122735264986881, "deviation-center-line": 0.21118040933003593, "driven_lanedir_consec": 1.449779405254878, "sim_compute_sim_state": 0.017220573875525478, "sim_compute_performance-ego": 0.004469328172217111, "sim_compute_robot_state-ego": 0.007804049954393903, "sim_compute_robot_state-parked0": 0.008237081535896007}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.944337302105569, "get_ui_image": 0.03120146830876668, "step_physics": 0.08820636590321859, "survival_time": 14.950000000000076, "driven_lanedir": 2.911589511859374, "get_state_dump": 0.016147438685099283, "sim_render-ego": 0.007145264943440755, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0227286696434021, "deviation-heading": 1.7635845941617656, "complete-iteration": 0.2137324182192485, "set_robot_commands": 0.006107877890268961, "deviation-center-line": 0.7088004336439275, "driven_lanedir_consec": 2.911589511859374, "sim_compute_sim_state": 0.018472691377003983, "sim_compute_performance-ego": 0.0048273793856302896, "sim_compute_robot_state-ego": 0.01017067035039266, "sim_compute_robot_state-parked0": 0.008542072772979737}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.7140072013037964, "get_ui_image": 0.033312293688456215, "step_physics": 0.08935177087783813, "survival_time": 14.950000000000076, "driven_lanedir": 1.3844398181960271, "get_state_dump": 0.01545169194539388, "sim_render-ego": 0.007232174873352051, "in-drivable-lane": 6.950000000000082, "agent_compute-ego": 0.02212352673212687, "deviation-heading": 2.355061391183652, "complete-iteration": 0.21032952308654784, "set_robot_commands": 0.005587802728017171, "deviation-center-line": 0.5479697716066386, "driven_lanedir_consec": 1.3844398181960271, "sim_compute_sim_state": 0.014601295789082844, "sim_compute_performance-ego": 0.004725933869679769, "sim_compute_robot_state-ego": 0.00931936264038086, "sim_compute_robot_state-parked0": 0.008443192640940348}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.7832648082731875, "get_ui_image": 0.031650969187418616, "step_physics": 0.0919793995221456, "survival_time": 14.950000000000076, "driven_lanedir": 2.6929191977114444, "get_state_dump": 0.016408013502756755, "sim_render-ego": 0.007437930107116699, "in-drivable-lane": 0.0, "agent_compute-ego": 0.023036945660909015, "deviation-heading": 2.6266830244586727, "complete-iteration": 0.21871627887090048, "set_robot_commands": 0.0063406999905904135, "deviation-center-line": 0.7867882767212048, "driven_lanedir_consec": 2.6929191977114444, "sim_compute_sim_state": 0.017418963114420573, "sim_compute_performance-ego": 0.005044161478678385, "sim_compute_robot_state-ego": 0.010219985644022624, "sim_compute_robot_state-parked0": 0.008997195561726888}}
set_robot_commands_max	0.0063406999905904135
set_robot_commands_mean	0.005789778968465857
set_robot_commands_median	0.005847840309143066
set_robot_commands_min	0.005122735264986881
sim_compute_performance-ego_max	0.005044161478678385
sim_compute_performance-ego_mean	0.004766700726551389
sim_compute_performance-ego_median	0.004776656627655029
sim_compute_performance-ego_min	0.004469328172217111
sim_compute_robot_state-ego_max	0.010219985644022624
sim_compute_robot_state-ego_mean	0.00937851714729751
sim_compute_robot_state-ego_median	0.009745016495386758
sim_compute_robot_state-ego_min	0.007804049954393903
sim_compute_robot_state-parked0_max	0.008997195561726888
sim_compute_robot_state-parked0_mean	0.008554885627885745
sim_compute_robot_state-parked0_median	0.008492632706960043
sim_compute_robot_state-parked0_min	0.008237081535896007
sim_compute_sim_state_max	0.018472691377003983
sim_compute_sim_state_mean	0.01692838103900822
sim_compute_sim_state_median	0.017319768494973027
sim_compute_sim_state_min	0.014601295789082844
sim_render-ego_max	0.007437930107116699
sim_render-ego_mean	0.007125139580946282
sim_render-ego_median	0.007188719908396403
sim_render-ego_min	0.006685188399875625
simulation-passed	1
step_physics_max	0.0919793995221456
step_physics_mean	0.08575766368826401
step_physics_median	0.08877906839052836
step_physics_min	0.07349311844985372
survival_time_max	14.950000000000076
survival_time_mean	14.125000000000064
survival_time_min	11.65000000000003

No reset possible

36251

9373

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-02 03:34:39+00:00

2020-11-02 03:40:54+00:00

0:06:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9223926134230244
survival_time_median	9.299999999999995
deviation-center-line_median	0.2986156213885245
in-drivable-lane_median	3.5750000000000126

other stats

agent_compute-ego_max	0.021770451750074114
agent_compute-ego_mean	0.021387955818159155
agent_compute-ego_median	0.021451663648580352
agent_compute-ego_min	0.020878044225401796
complete-iteration_max	0.2047382248521416
complete-iteration_mean	0.19664232583629115
complete-iteration_median	0.19469114637174528
complete-iteration_min	0.1924487857495324
deviation-center-line_max	0.4897421930144883
deviation-center-line_mean	0.2944257463289259
deviation-center-line_min	0.0907295495241662
deviation-heading_max	1.411993874805973
deviation-heading_mean	0.6905931384280879
deviation-heading_median	0.475273217389467
deviation-heading_min	0.39983224412744456
driven_any_max	2.85430048120387
driven_any_mean	2.145175380791284
driven_any_median	2.498244463752129
driven_any_min	0.7299121144570085
driven_lanedir_consec_max	1.7765945309447713
driven_lanedir_consec_mean	1.0183206663128184
driven_lanedir_consec_min	0.45190290746045303
driven_lanedir_max	1.7765945309447713
driven_lanedir_mean	1.0183206663128184
driven_lanedir_median	0.9223926134230244
driven_lanedir_min	0.45190290746045303
get_state_dump_max	0.016672398362840925
get_state_dump_mean	0.01573707635920356
get_state_dump_median	0.015559479556842736
get_state_dump_min	0.015156947960287838
get_ui_image_max	0.03290398681865019
get_ui_image_mean	0.03192962269154856
get_ui_image_median	0.03212452951765739
get_ui_image_min	0.030565444912229265
in-drivable-lane_max	7.5000000000000115
in-drivable-lane_mean	3.900000000000008
in-drivable-lane_min	0.9499999999999966
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.240022122546936, "get_ui_image": 0.030565444912229265, "step_physics": 0.0750600936866942, "survival_time": 8.399999999999984, "driven_lanedir": 1.2140757282365449, "get_state_dump": 0.016672398362840925, "sim_render-ego": 0.0066933901537032355, "in-drivable-lane": 3.6499999999999937, "agent_compute-ego": 0.021770451750074114, "deviation-heading": 0.39983224412744456, "complete-iteration": 0.19335584129605973, "set_robot_commands": 0.004875305153074719, "deviation-center-line": 0.42552031561630094, "driven_lanedir_consec": 1.2140757282365449, "sim_compute_sim_state": 0.01683382335163298, "sim_compute_performance-ego": 0.004489654586428688, "sim_compute_robot_state-ego": 0.007980620577221825, "sim_compute_robot_state-parked0": 0.008241278784615653}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.7299121144570085, "get_ui_image": 0.03161001205444336, "step_physics": 0.07783395557080285, "survival_time": 2.9499999999999975, "driven_lanedir": 0.45190290746045303, "get_state_dump": 0.015156947960287838, "sim_render-ego": 0.006224648427155058, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.020878044225401796, "deviation-heading": 0.47031223390133103, "complete-iteration": 0.1924487857495324, "set_robot_commands": 0.004807419696096647, "deviation-center-line": 0.171710927160748, "driven_lanedir_consec": 0.45190290746045303, "sim_compute_sim_state": 0.015695466833599542, "sim_compute_performance-ego": 0.004337367364915751, "sim_compute_robot_state-ego": 0.007769645270654711, "sim_compute_robot_state-parked0": 0.007963160337027857}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.7564668049573218, "get_ui_image": 0.03290398681865019, "step_physics": 0.08011956191530414, "survival_time": 10.20000000000001, "driven_lanedir": 0.6307094986095041, "get_state_dump": 0.015229295281802906, "sim_render-ego": 0.007065964680092007, "in-drivable-lane": 7.5000000000000115, "agent_compute-ego": 0.021390473141389733, "deviation-heading": 0.48023420087760293, "complete-iteration": 0.1960264514474308, "set_robot_commands": 0.005443308867660223, "deviation-center-line": 0.0907295495241662, "driven_lanedir_consec": 0.6307094986095041, "sim_compute_sim_state": 0.01211531255759445, "sim_compute_performance-ego": 0.00468447862886915, "sim_compute_robot_state-ego": 0.008890965405632468, "sim_compute_robot_state-parked0": 0.00800794479893703}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.85430048120387, "get_ui_image": 0.03263904698087141, "step_physics": 0.08268851578518113, "survival_time": 10.550000000000017, "driven_lanedir": 1.7765945309447713, "get_state_dump": 0.015889663831882568, "sim_render-ego": 0.007002744629484782, "in-drivable-lane": 3.500000000000032, "agent_compute-ego": 0.021512854155770977, "deviation-heading": 1.411993874805973, "complete-iteration": 0.2047382248521416, "set_robot_commands": 0.005582557470312615, "deviation-center-line": 0.4897421930144883, "driven_lanedir_consec": 1.7765945309447713, "sim_compute_sim_state": 0.016643125299028876, "sim_compute_performance-ego": 0.00472070255550728, "sim_compute_robot_state-ego": 0.009450571231932436, "sim_compute_robot_state-parked0": 0.008429443666720278}}
set_robot_commands_max	0.005582557470312615
set_robot_commands_mean	0.00517714779678605
set_robot_commands_median	0.005159307010367471
set_robot_commands_min	0.004807419696096647
sim_compute_performance-ego_max	0.00472070255550728
sim_compute_performance-ego_mean	0.004558050783930217
sim_compute_performance-ego_median	0.004587066607648919
sim_compute_performance-ego_min	0.004337367364915751
sim_compute_robot_state-ego_max	0.009450571231932436
sim_compute_robot_state-ego_mean	0.00852295062136036
sim_compute_robot_state-ego_median	0.008435792991427146
sim_compute_robot_state-ego_min	0.007769645270654711
sim_compute_robot_state-parked0_max	0.008429443666720278
sim_compute_robot_state-parked0_mean	0.008160456896825204
sim_compute_robot_state-parked0_median	0.008124611791776343
sim_compute_robot_state-parked0_min	0.007963160337027857
sim_compute_sim_state_max	0.01683382335163298
sim_compute_sim_state_mean	0.015321932010463965
sim_compute_sim_state_median	0.01616929606631421
sim_compute_sim_state_min	0.01211531255759445
sim_render-ego_max	0.007065964680092007
sim_render-ego_mean	0.0067466869726087704
sim_render-ego_median	0.006848067391594008
sim_render-ego_min	0.006224648427155058
simulation-passed	1
step_physics_max	0.08268851578518113
step_physics_mean	0.07892553173949558
step_physics_median	0.07897675874305349
step_physics_min	0.0750600936866942
survival_time_max	10.550000000000017
survival_time_mean	8.025000000000002
survival_time_min	2.9499999999999975

No reset possible

36244

9381

Himanshu Arora 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-02 03:23:49+00:00

2020-11-02 03:34:08+00:00

0:10:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.418507153961122
survival_time_median	14.950000000000076
deviation-center-line_median	0.3108800994921877
in-drivable-lane_median	2.475000000000035

other stats

agent_compute-ego_max	0.023145726521809896
agent_compute-ego_mean	0.022316296100616455
agent_compute-ego_median	0.02211923599243164
agent_compute-ego_min	0.021880985895792644
complete-iteration_max	0.21438779830932617
complete-iteration_mean	0.2094652227560679
complete-iteration_median	0.21015428264935812
complete-iteration_min	0.20316452741622928
deviation-center-line_max	0.475794700612825
deviation-center-line_mean	0.3402358222691853
deviation-center-line_min	0.2633883894795408
deviation-heading_max	1.926242574779539
deviation-heading_mean	1.5580987675525788
deviation-heading_median	1.5041064545430354
deviation-heading_min	1.297939586344706
driven_any_max	2.996918331295171
driven_any_mean	2.7841074100024836
driven_any_median	2.8194564509475297
driven_any_min	2.500598406819705
driven_lanedir_consec_max	2.980884020228041
driven_lanedir_consec_mean	2.331473966432085
driven_lanedir_consec_min	1.5079975375780543
driven_lanedir_max	2.980884020228041
driven_lanedir_mean	2.331473966432085
driven_lanedir_median	2.418507153961122
driven_lanedir_min	1.5079975375780543
get_state_dump_max	0.01666882912317912
get_state_dump_mean	0.016112104256947837
get_state_dump_median	0.016106543143590293
get_state_dump_min	0.01556650161743164
get_ui_image_max	0.03294880946477254
get_ui_image_mean	0.03238303025563558
get_ui_image_median	0.032225563526153564
get_ui_image_min	0.032132184505462645
in-drivable-lane_max	5.9500000000000846
in-drivable-lane_mean	2.7250000000000387
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.9463586552346093, "get_ui_image": 0.032132184505462645, "step_physics": 0.08621342341105143, "survival_time": 14.950000000000076, "driven_lanedir": 2.9238421544110977, "get_state_dump": 0.01666882912317912, "sim_render-ego": 0.007430564562479655, "in-drivable-lane": 0.0, "agent_compute-ego": 0.023145726521809896, "deviation-heading": 1.5515676159230276, "complete-iteration": 0.21438779830932617, "set_robot_commands": 0.006093509197235107, "deviation-center-line": 0.35197415714676106, "driven_lanedir_consec": 2.9238421544110977, "sim_compute_sim_state": 0.018059688409169515, "sim_compute_performance-ego": 0.005091050465901693, "sim_compute_robot_state-ego": 0.010573987166086832, "sim_compute_robot_state-parked0": 0.008803168137868245}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.996918331295171, "get_ui_image": 0.032174208958943684, "step_physics": 0.08671075979868571, "survival_time": 14.950000000000076, "driven_lanedir": 2.980884020228041, "get_state_dump": 0.016176616350809733, "sim_render-ego": 0.007431000868479411, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0222921625773112, "deviation-heading": 1.297939586344706, "complete-iteration": 0.2116461730003357, "set_robot_commands": 0.005955264568328857, "deviation-center-line": 0.26978604183761434, "driven_lanedir_consec": 2.980884020228041, "sim_compute_sim_state": 0.017159214019775392, "sim_compute_performance-ego": 0.004932080109914144, "sim_compute_robot_state-ego": 0.010043448607126871, "sim_compute_robot_state-parked0": 0.008591624895731608}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.500598406819705, "get_ui_image": 0.03294880946477254, "step_physics": 0.08520015796025594, "survival_time": 14.950000000000076, "driven_lanedir": 1.5079975375780543, "get_state_dump": 0.01556650161743164, "sim_render-ego": 0.006769318580627442, "in-drivable-lane": 5.9500000000000846, "agent_compute-ego": 0.021946309407552083, "deviation-heading": 1.926242574779539, "complete-iteration": 0.20316452741622928, "set_robot_commands": 0.005251161257425944, "deviation-center-line": 0.475794700612825, "driven_lanedir_consec": 1.5079975375780543, "sim_compute_sim_state": 0.014333606561024984, "sim_compute_performance-ego": 0.004529381593068441, "sim_compute_robot_state-ego": 0.008255972862243652, "sim_compute_robot_state-parked0": 0.008187984625498454}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.69255424666045, "get_ui_image": 0.032276918093363444, "step_physics": 0.08772999048233032, "survival_time": 14.950000000000076, "driven_lanedir": 1.9131721535111463, "get_state_dump": 0.01603646993637085, "sim_render-ego": 0.006875591278076172, "in-drivable-lane": 4.95000000000007, "agent_compute-ego": 0.021880985895792644, "deviation-heading": 1.4566452931630431, "complete-iteration": 0.20866239229838057, "set_robot_commands": 0.005280598799387614, "deviation-center-line": 0.2633883894795408, "driven_lanedir_consec": 1.9131721535111463, "sim_compute_sim_state": 0.017151310443878173, "sim_compute_performance-ego": 0.004623541037241618, "sim_compute_robot_state-ego": 0.008517827192942301, "sim_compute_robot_state-parked0": 0.00811008373896281}}
set_robot_commands_max	0.006093509197235107
set_robot_commands_mean	0.005645133455594382
set_robot_commands_median	0.005617931683858235
set_robot_commands_min	0.005251161257425944
sim_compute_performance-ego_max	0.005091050465901693
sim_compute_performance-ego_mean	0.004794013301531474
sim_compute_performance-ego_median	0.004777810573577881
sim_compute_performance-ego_min	0.004529381593068441
sim_compute_robot_state-ego_max	0.010573987166086832
sim_compute_robot_state-ego_mean	0.009347808957099914
sim_compute_robot_state-ego_median	0.009280637900034586
sim_compute_robot_state-ego_min	0.008255972862243652
sim_compute_robot_state-parked0_max	0.008803168137868245
sim_compute_robot_state-parked0_mean	0.008423215349515279
sim_compute_robot_state-parked0_median	0.00838980476061503
sim_compute_robot_state-parked0_min	0.00811008373896281
sim_compute_sim_state_max	0.018059688409169515
sim_compute_sim_state_mean	0.016675954858462017
sim_compute_sim_state_median	0.017155262231826784
sim_compute_sim_state_min	0.014333606561024984
sim_render-ego_max	0.007431000868479411
sim_render-ego_mean	0.00712661882241567
sim_render-ego_median	0.007153077920277914
sim_render-ego_min	0.006769318580627442
simulation-passed	1
step_physics_max	0.08772999048233032
step_physics_mean	0.08646358291308084
step_physics_median	0.08646209160486856
step_physics_min	0.08520015796025594
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

36241

9383

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

error

2020-11-02 03:22:32+00:00

2020-11-02 03:23:17+00:00

0:00:45

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9383/LFv-sim-Sandy2-sandy-1-job36241-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36239

9383

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

error

2020-11-02 03:21:08+00:00

2020-11-02 03:22:08+00:00

0:01:00

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9383/LFv-sim-Sandy2-sandy-1-job36239-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36237

9384

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

error

2020-11-02 03:19:27+00:00

2020-11-02 03:20:25+00:00

0:00:58

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9384/LFv-sim-Sandy2-sandy-1-job36237-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36227

9389

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

success

2020-11-02 03:08:47+00:00

2020-11-02 03:18:46+00:00

0:09:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.5160078004018116
survival_time_median	14.950000000000076
deviation-center-line_median	0.3157801935613048
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.024764135678609217
agent_compute-ego_mean	0.023382757902145387
agent_compute-ego_median	0.023142390251159668
agent_compute-ego_min	0.022482115427652993
complete-iteration_max	0.20384867986043295
complete-iteration_mean	0.20021345913410188
complete-iteration_median	0.20117387851079305
complete-iteration_min	0.19465739965438844
deviation-center-line_max	0.6205771163647175
deviation-center-line_mean	0.3674494477423788
deviation-center-line_min	0.2176602874821881
deviation-heading_max	2.615531673023862
deviation-heading_mean	1.772416869588544
deviation-heading_median	1.5897131287171282
deviation-heading_min	1.2947095478960584
driven_any_max	1.5315700299352473
driven_any_mean	1.5303194872343362
driven_any_median	1.5315610490572575
driven_any_min	1.5265858208875824
driven_lanedir_consec_max	1.523383989774238
driven_lanedir_consec_mean	1.5104664923583635
driven_lanedir_consec_min	1.4864663788555923
driven_lanedir_max	1.523383989774238
driven_lanedir_mean	1.5104664923583635
driven_lanedir_median	1.5160078004018116
driven_lanedir_min	1.4864663788555923
get_state_dump_max	0.017686304251352945
get_state_dump_mean	0.01679939329624176
get_state_dump_median	0.016973328590393067
get_state_dump_min	0.015564611752827962
get_ui_image_max	0.03399538278579712
get_ui_image_mean	0.03198266923427582
get_ui_image_median	0.03172810157140096
get_ui_image_min	0.030479091008504232
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.5265858208875824, "get_ui_image": 0.03399538278579712, "step_physics": 0.07914964437484741, "survival_time": 14.950000000000076, "driven_lanedir": 1.5097735033885074, "get_state_dump": 0.015564611752827962, "sim_render-ego": 0.0070705167452494305, "in-drivable-lane": 0.0, "agent_compute-ego": 0.022482115427652993, "deviation-heading": 1.760658677947021, "complete-iteration": 0.20384867986043295, "set_robot_commands": 0.005772452354431152, "deviation-center-line": 0.4134471757164227, "driven_lanedir_consec": 1.5097735033885074, "sim_compute_sim_state": 0.016687943935394287, "sim_compute_performance-ego": 0.004738057454427083, "sim_compute_robot_state-ego": 0.009623982906341554, "sim_compute_robot_state-parked0": 0.00857008695602417}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.5315679945870693, "get_ui_image": 0.03251110712687175, "step_physics": 0.07802257378896077, "survival_time": 14.950000000000076, "driven_lanedir": 1.522242097415116, "get_state_dump": 0.016526591777801514, "sim_render-ego": 0.007191461722056071, "in-drivable-lane": 0.0, "agent_compute-ego": 0.022653319040934244, "deviation-heading": 1.4187675794872354, "complete-iteration": 0.203524759610494, "set_robot_commands": 0.006251839796702067, "deviation-center-line": 0.21811321140618684, "driven_lanedir_consec": 1.522242097415116, "sim_compute_sim_state": 0.015911719799041747, "sim_compute_performance-ego": 0.0049044187863667805, "sim_compute_robot_state-ego": 0.010484375953674316, "sim_compute_robot_state-parked0": 0.008868741989135741}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.5315541035274458, "get_ui_image": 0.030945096015930176, "step_physics": 0.07497648000717164, "survival_time": 14.950000000000076, "driven_lanedir": 1.4864663788555923, "get_state_dump": 0.017686304251352945, "sim_render-ego": 0.0068189207712809246, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024764135678609217, "deviation-heading": 2.615531673023862, "complete-iteration": 0.19465739965438844, "set_robot_commands": 0.005247411727905274, "deviation-center-line": 0.6205771163647175, "driven_lanedir_consec": 1.4864663788555923, "sim_compute_sim_state": 0.013012607097625733, "sim_compute_performance-ego": 0.00454884131749471, "sim_compute_robot_state-ego": 0.007933556238810221, "sim_compute_robot_state-parked0": 0.008517824014027913}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.5315700299352473, "get_ui_image": 0.030479091008504232, "step_physics": 0.07699666261672973, "survival_time": 14.950000000000076, "driven_lanedir": 1.523383989774238, "get_state_dump": 0.01742006540298462, "sim_render-ego": 0.0068613624572753905, "in-drivable-lane": 0.0, "agent_compute-ego": 0.023631461461385093, "deviation-heading": 1.2947095478960584, "complete-iteration": 0.19882299741109213, "set_robot_commands": 0.005486102898915609, "deviation-center-line": 0.2176602874821881, "driven_lanedir_consec": 1.523383989774238, "sim_compute_sim_state": 0.015817763010660808, "sim_compute_performance-ego": 0.004611891110738118, "sim_compute_robot_state-ego": 0.008785252571105956, "sim_compute_robot_state-parked0": 0.008530941804250082}}
set_robot_commands_max	0.006251839796702067
set_robot_commands_mean	0.005689451694488526
set_robot_commands_median	0.00562927762667338
set_robot_commands_min	0.005247411727905274
sim_compute_performance-ego_max	0.0049044187863667805
sim_compute_performance-ego_mean	0.0047008021672566725
sim_compute_performance-ego_median	0.004674974282582601
sim_compute_performance-ego_min	0.00454884131749471
sim_compute_robot_state-ego_max	0.010484375953674316
sim_compute_robot_state-ego_mean	0.009206791917483012
sim_compute_robot_state-ego_median	0.009204617738723754
sim_compute_robot_state-ego_min	0.007933556238810221
sim_compute_robot_state-parked0_max	0.008868741989135741
sim_compute_robot_state-parked0_mean	0.008621898690859477
sim_compute_robot_state-parked0_median	0.008550514380137125
sim_compute_robot_state-parked0_min	0.008517824014027913
sim_compute_sim_state_max	0.016687943935394287
sim_compute_sim_state_mean	0.015357508460680642
sim_compute_sim_state_median	0.01586474140485128
sim_compute_sim_state_min	0.013012607097625733
sim_render-ego_max	0.007191461722056071
sim_render-ego_mean	0.006985565423965454
sim_render-ego_median	0.0069659396012624105
sim_render-ego_min	0.0068189207712809246
simulation-passed	1
step_physics_max	0.07914964437484741
step_physics_mean	0.07728634019692739
step_physics_median	0.07750961820284524
step_physics_min	0.07497648000717164
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

36224

9394

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

success

2020-11-02 02:58:49+00:00

2020-11-02 03:08:14+00:00

0:09:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.8138405596268672
survival_time_median	14.950000000000076
deviation-center-line_median	0.4149403220554386
in-drivable-lane_median	5.000000000000071

other stats

agent_compute-ego_max	0.02254449486732483
agent_compute-ego_mean	0.022098127305507656
agent_compute-ego_median	0.02201978921890259
agent_compute-ego_min	0.021808435916900636
complete-iteration_max	0.21425859610239664
complete-iteration_mean	0.2100142498811086
complete-iteration_median	0.2093686274687449
complete-iteration_min	0.20706114848454793
deviation-center-line_max	0.7795547141088169
deviation-center-line_mean	0.45680273868208665
deviation-center-line_min	0.21777559650865252
deviation-heading_max	1.6115968350966774
deviation-heading_mean	1.2017507632177558
deviation-heading_median	1.1257713564743306
deviation-heading_min	0.9438635048256848
driven_any_max	3.2588823485192684
driven_any_mean	2.8038148960418323
driven_any_median	2.9758773763943527
driven_any_min	2.004622482859356
driven_lanedir_consec_max	2.2167142308477583
driven_lanedir_consec_mean	1.7903808600076323
driven_lanedir_consec_min	1.3171280899290374
driven_lanedir_max	2.2167142308477583
driven_lanedir_mean	1.7903808600076323
driven_lanedir_median	1.8138405596268672
driven_lanedir_min	1.3171280899290374
get_state_dump_max	0.016381609439849853
get_state_dump_mean	0.01598698377609253
get_state_dump_median	0.01595229427019755
get_state_dump_min	0.015661737124125164
get_ui_image_max	0.0344259516398112
get_ui_image_mean	0.0335167117913564
get_ui_image_median	0.03349364042282105
get_ui_image_min	0.03265361467997233
in-drivable-lane_max	7.850000000000095
in-drivable-lane_mean	5.512500000000064
in-drivable-lane_min	4.20000000000002
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.004622482859356, "get_ui_image": 0.033658244609832765, "step_physics": 0.08295639634132385, "survival_time": 10.000000000000009, "driven_lanedir": 1.3171280899290374, "get_state_dump": 0.016381609439849853, "sim_render-ego": 0.0073963463306427005, "in-drivable-lane": 4.20000000000002, "agent_compute-ego": 0.02254449486732483, "deviation-heading": 0.9438635048256848, "complete-iteration": 0.2104239559173584, "set_robot_commands": 0.006034784317016602, "deviation-center-line": 0.21777559650865252, "driven_lanedir_consec": 1.3171280899290374, "sim_compute_sim_state": 0.01722587823867798, "sim_compute_performance-ego": 0.004997830390930175, "sim_compute_robot_state-ego": 0.010519825220108033, "sim_compute_robot_state-parked0": 0.008536792993545532}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.2240358195991257, "get_ui_image": 0.0344259516398112, "step_physics": 0.08486744085947673, "survival_time": 14.950000000000076, "driven_lanedir": 2.2167142308477583, "get_state_dump": 0.015661737124125164, "sim_render-ego": 0.006821165084838867, "in-drivable-lane": 4.20000000000006, "agent_compute-ego": 0.021808435916900636, "deviation-heading": 1.6115968350966774, "complete-iteration": 0.20831329902013143, "set_robot_commands": 0.005334946314493815, "deviation-center-line": 0.7795547141088169, "driven_lanedir_consec": 2.2167142308477583, "sim_compute_sim_state": 0.01741793155670166, "sim_compute_performance-ego": 0.004627602895100912, "sim_compute_robot_state-ego": 0.008892593383789062, "sim_compute_robot_state-parked0": 0.008284238974253337}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.2588823485192684, "get_ui_image": 0.03265361467997233, "step_physics": 0.08513312180836996, "survival_time": 14.950000000000076, "driven_lanedir": 1.621349297684688, "get_state_dump": 0.01582874377568563, "sim_render-ego": 0.007304722468058268, "in-drivable-lane": 7.850000000000095, "agent_compute-ego": 0.02184537649154663, "deviation-heading": 1.05125860951373, "complete-iteration": 0.20706114848454793, "set_robot_commands": 0.0058281636238098145, "deviation-center-line": 0.39626456190216314, "driven_lanedir_consec": 1.621349297684688, "sim_compute_sim_state": 0.01507771094640096, "sim_compute_performance-ego": 0.004923563003540039, "sim_compute_robot_state-ego": 0.009850552082061767, "sim_compute_robot_state-parked0": 0.008442956606547038}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.72771893318958, "get_ui_image": 0.03332903623580932, "step_physics": 0.0890707778930664, "survival_time": 14.950000000000076, "driven_lanedir": 2.006331821569047, "get_state_dump": 0.01607584476470947, "sim_render-ego": 0.007040720780690511, "in-drivable-lane": 5.800000000000082, "agent_compute-ego": 0.022194201946258544, "deviation-heading": 1.2002841034349312, "complete-iteration": 0.21425859610239664, "set_robot_commands": 0.0057923523585001625, "deviation-center-line": 0.43361608220871417, "driven_lanedir_consec": 2.006331821569047, "sim_compute_sim_state": 0.017915852864583335, "sim_compute_performance-ego": 0.004772090117136638, "sim_compute_robot_state-ego": 0.009467166264851888, "sim_compute_robot_state-parked0": 0.008426853020985921}}
set_robot_commands_max	0.006034784317016602
set_robot_commands_mean	0.005747561653455099
set_robot_commands_median	0.005810257991154989
set_robot_commands_min	0.005334946314493815
sim_compute_performance-ego_max	0.004997830390930175
sim_compute_performance-ego_mean	0.004830271601676941
sim_compute_performance-ego_median	0.004847826560338338
sim_compute_performance-ego_min	0.004627602895100912
sim_compute_robot_state-ego_max	0.010519825220108033
sim_compute_robot_state-ego_mean	0.009682534237702689
sim_compute_robot_state-ego_median	0.009658859173456828
sim_compute_robot_state-ego_min	0.008892593383789062
sim_compute_robot_state-parked0_max	0.008536792993545532
sim_compute_robot_state-parked0_mean	0.008422710398832956
sim_compute_robot_state-parked0_median	0.00843490481376648
sim_compute_robot_state-parked0_min	0.008284238974253337
sim_compute_sim_state_max	0.017915852864583335
sim_compute_sim_state_mean	0.016909343401590983
sim_compute_sim_state_median	0.01732190489768982
sim_compute_sim_state_min	0.01507771094640096
sim_render-ego_max	0.0073963463306427005
sim_render-ego_mean	0.0071407386660575865
sim_render-ego_median	0.007172721624374389
sim_render-ego_min	0.006821165084838867
simulation-passed	1
step_physics_max	0.0890707778930664
step_physics_mean	0.08550693422555923
step_physics_median	0.08500028133392334
step_physics_min	0.08295639634132385
survival_time_max	14.950000000000076
survival_time_mean	13.71250000000006
survival_time_min	10.000000000000009

No reset possible

36218

9660

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

2020-11-02 02:54:29+00:00

2020-11-02 02:58:27+00:00

0:03:58

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 481, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 125 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 241, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 485, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36214

9758

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

2020-11-02 02:50:28+00:00

2020-11-02 02:54:17+00:00

0:03:49

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 481, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 93 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 241, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 485, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36210

9760

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

2020-11-02 02:46:28+00:00

2020-11-02 02:50:16+00:00

0:03:48

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 481, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 97 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 241, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 485, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36204

9765

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-02 02:36:39+00:00

2020-11-02 02:45:36+00:00

0:08:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9729429411938282
survival_time_median	14.950000000000076
deviation-center-line_median	0.35049044171678256
in-drivable-lane_median	9.575000000000044

other stats

agent_compute-ego_max	0.021417479515075683
agent_compute-ego_mean	0.020932636208274735
agent_compute-ego_median	0.020870255126434117
agent_compute-ego_min	0.02057255506515503
complete-iteration_max	0.21927579730546393
complete-iteration_mean	0.2093494914218682
complete-iteration_median	0.20707695325215655
complete-iteration_min	0.2039682618776957
deviation-center-line_max	0.3626136292986355
deviation-center-line_mean	0.30559464734355535
deviation-center-line_min	0.15878407664202074
deviation-heading_max	2.5965034528794657
deviation-heading_mean	1.817224725365678
deviation-heading_median	2.0487286715784907
deviation-heading_min	0.5749381054262656
driven_any_max	4.0500010069299535
driven_any_mean	3.357934146892399
driven_any_median	3.7482485870100586
driven_any_min	1.8852384066195256
driven_lanedir_consec_max	1.238666373062479
driven_lanedir_consec_mean	0.9325123394554872
driven_lanedir_consec_min	0.5454971023718134
driven_lanedir_max	1.238666373062479
driven_lanedir_mean	0.9325123394554872
driven_lanedir_median	0.9729429411938282
driven_lanedir_min	0.5454971023718134
get_state_dump_max	0.01498446496976476
get_state_dump_mean	0.014710674764347724
get_state_dump_median	0.014634623130162555
get_state_dump_min	0.014588987827301026
get_ui_image_max	0.03480680783589681
get_ui_image_mean	0.03433186650276184
get_ui_image_median	0.03431083599726359
get_ui_image_min	0.03389898618062337
in-drivable-lane_max	9.850000000000058
in-drivable-lane_mean	8.425000000000033
in-drivable-lane_min	4.699999999999983
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.884626135354583, "get_ui_image": 0.034057079950968426, "step_physics": 0.08435861666997274, "survival_time": 14.950000000000076, "driven_lanedir": 0.9227370464804544, "get_state_dump": 0.014635204474131266, "sim_render-ego": 0.006619752248128255, "in-drivable-lane": 9.850000000000058, "agent_compute-ego": 0.021417479515075683, "deviation-heading": 2.4770810010793145, "complete-iteration": 0.20631803592046105, "set_robot_commands": 0.005314881006876627, "deviation-center-line": 0.3472532966727329, "driven_lanedir_consec": 0.9227370464804544, "sim_compute_sim_state": 0.018266000747680665, "sim_compute_performance-ego": 0.004526646137237549, "sim_compute_robot_state-ego": 0.008826602300008137, "sim_compute_robot_state-parked0": 0.008133521874745687}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.0500010069299535, "get_ui_image": 0.03456459204355876, "step_physics": 0.08832190990447998, "survival_time": 14.950000000000076, "driven_lanedir": 1.0231488359072018, "get_state_dump": 0.014634041786193848, "sim_render-ego": 0.006652391751607259, "in-drivable-lane": 9.650000000000048, "agent_compute-ego": 0.02057255506515503, "deviation-heading": 2.5965034528794657, "complete-iteration": 0.20783587058385217, "set_robot_commands": 0.0051381587982177734, "deviation-center-line": 0.3626136292986355, "driven_lanedir_consec": 1.0231488359072018, "sim_compute_sim_state": 0.01722338358561198, "sim_compute_performance-ego": 0.004469944636027018, "sim_compute_robot_state-ego": 0.008050576051076253, "sim_compute_robot_state-parked0": 0.008042283058166504}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.611871038665534, "get_ui_image": 0.03389898618062337, "step_physics": 0.08653611580530803, "survival_time": 14.950000000000076, "driven_lanedir": 1.238666373062479, "get_state_dump": 0.014588987827301026, "sim_render-ego": 0.006862385272979736, "in-drivable-lane": 9.50000000000004, "agent_compute-ego": 0.021121724446614584, "deviation-heading": 1.620376342077667, "complete-iteration": 0.2039682618776957, "set_robot_commands": 0.005076648394266765, "deviation-center-line": 0.35372758676083227, "driven_lanedir_consec": 1.238666373062479, "sim_compute_sim_state": 0.014536489645640057, "sim_compute_performance-ego": 0.004566102822621663, "sim_compute_robot_state-ego": 0.008654569784800212, "sim_compute_robot_state-parked0": 0.007957512537638347}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.8852384066195256, "get_ui_image": 0.03480680783589681, "step_physics": 0.10123646826971144, "survival_time": 7.349999999999982, "driven_lanedir": 0.5454971023718134, "get_state_dump": 0.01498446496976476, "sim_render-ego": 0.006561533934405061, "in-drivable-lane": 4.699999999999983, "agent_compute-ego": 0.020618785806253655, "deviation-heading": 0.5749381054262656, "complete-iteration": 0.21927579730546393, "set_robot_commands": 0.004991325391393129, "deviation-center-line": 0.15878407664202074, "driven_lanedir_consec": 0.5454971023718134, "sim_compute_sim_state": 0.015893194951167724, "sim_compute_performance-ego": 0.004313032643324664, "sim_compute_robot_state-ego": 0.007925917502163218, "sim_compute_robot_state-parked0": 0.007768901837926332}}
set_robot_commands_max	0.005314881006876627
set_robot_commands_mean	0.005130253397688574
set_robot_commands_median	0.005107403596242269
set_robot_commands_min	0.004991325391393129
sim_compute_performance-ego_max	0.004566102822621663
sim_compute_performance-ego_mean	0.004468931559802724
sim_compute_performance-ego_median	0.004498295386632284
sim_compute_performance-ego_min	0.004313032643324664
sim_compute_robot_state-ego_max	0.008826602300008137
sim_compute_robot_state-ego_mean	0.008364416409511955
sim_compute_robot_state-ego_median	0.008352572917938231
sim_compute_robot_state-ego_min	0.007925917502163218
sim_compute_robot_state-parked0_max	0.008133521874745687
sim_compute_robot_state-parked0_mean	0.007975554827119218
sim_compute_robot_state-parked0_median	0.007999897797902425
sim_compute_robot_state-parked0_min	0.007768901837926332
sim_compute_sim_state_max	0.018266000747680665
sim_compute_sim_state_mean	0.016479767232525106
sim_compute_sim_state_median	0.016558289268389852
sim_compute_sim_state_min	0.014536489645640057
sim_render-ego_max	0.006862385272979736
sim_render-ego_mean	0.006674015801780078
sim_render-ego_median	0.006636071999867757
sim_render-ego_min	0.006561533934405061
simulation-passed	1
step_physics_max	0.10123646826971144
step_physics_mean	0.09011327766236804
step_physics_median	0.087429012854894
step_physics_min	0.08435861666997274
survival_time_max	14.950000000000076
survival_time_mean	13.050000000000054
survival_time_min	7.349999999999982

No reset possible

36201

9767

exercise_ros_template

LFv-sim

error

2020-11-02 02:35:30+00:00

2020-11-02 02:36:16+00:00

0:00:46

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9767/LFv-sim-Sandy2-sandy-1-job36201-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36197

9774

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-02 02:27:01+00:00

2020-11-02 02:35:19+00:00

0:08:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.5377252860447026
survival_time_median	14.950000000000076
deviation-center-line_median	0.6169814531753295
in-drivable-lane_median	7.800000000000056

other stats

agent_compute-ego_max	0.02144954909741039
agent_compute-ego_mean	0.020676842902747676
agent_compute-ego_median	0.02055376450220744
agent_compute-ego_min	0.02015029350916545
complete-iteration_max	0.21221330803884583
complete-iteration_mean	0.2072492649213809
complete-iteration_median	0.20608667612075807
complete-iteration_min	0.2046103994051615
deviation-center-line_max	0.7589243905593287
deviation-center-line_mean	0.5515849363520291
deviation-center-line_min	0.2134524484981288
deviation-heading_max	2.588285461142581
deviation-heading_mean	1.5089396392909804
deviation-heading_median	1.526043995706972
deviation-heading_min	0.3953851046073967
driven_any_max	3.791001958776909
driven_any_mean	2.996022562234513
driven_any_median	3.630012083445376
driven_any_min	0.9330641232703908
driven_lanedir_consec_max	1.8818296250143176
driven_lanedir_consec_mean	1.4142628587091126
driven_lanedir_consec_min	0.6997712377327283
driven_lanedir_max	1.8818296250143176
driven_lanedir_mean	1.4142628587091126
driven_lanedir_median	1.5377252860447026
driven_lanedir_min	0.6997712377327283
get_state_dump_max	0.015356057126757123
get_state_dump_mean	0.01475732079134301
get_state_dump_median	0.014701967239379884
get_state_dump_min	0.014269291559855145
get_ui_image_max	0.035475828278232625
get_ui_image_mean	0.03476065328423406
get_ui_image_median	0.03492822329203288
get_ui_image_min	0.03371033827463786
in-drivable-lane_max	8.900000000000055
in-drivable-lane_mean	6.300000000000041
in-drivable-lane_min	0.6999999999999975
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.9330641232703908, "get_ui_image": 0.035475828278232625, "step_physics": 0.08645566752259161, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6997712377327283, "get_state_dump": 0.015356057126757123, "sim_render-ego": 0.007461739258027412, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.02144954909741039, "deviation-heading": 0.3953851046073967, "complete-iteration": 0.21221330803884583, "set_robot_commands": 0.006124748310572664, "deviation-center-line": 0.2134524484981288, "driven_lanedir_consec": 0.6997712377327283, "sim_compute_sim_state": 0.016237396589467223, "sim_compute_performance-ego": 0.004865263549374862, "sim_compute_robot_state-ego": 0.009814017255541305, "sim_compute_robot_state-parked0": 0.008789267338497537}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.5690148311733627, "get_ui_image": 0.03371033827463786, "step_physics": 0.08545486768086752, "survival_time": 14.950000000000076, "driven_lanedir": 1.8818296250143176, "get_state_dump": 0.014773045380910238, "sim_render-ego": 0.006891301472981771, "in-drivable-lane": 6.950000000000055, "agent_compute-ego": 0.020693124135335285, "deviation-heading": 2.588285461142581, "complete-iteration": 0.2056741730372111, "set_robot_commands": 0.005478212038675944, "deviation-center-line": 0.7589243905593287, "driven_lanedir_consec": 1.8818296250143176, "sim_compute_sim_state": 0.017137715021769206, "sim_compute_performance-ego": 0.004521838823954264, "sim_compute_robot_state-ego": 0.008726116021474202, "sim_compute_robot_state-parked0": 0.008111120859781901}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.791001958776909, "get_ui_image": 0.03505968729654948, "step_physics": 0.08600630680720012, "survival_time": 14.950000000000076, "driven_lanedir": 1.3644958944527323, "get_state_dump": 0.014269291559855145, "sim_render-ego": 0.006898239453633626, "in-drivable-lane": 8.650000000000055, "agent_compute-ego": 0.02041440486907959, "deviation-heading": 2.586301583218672, "complete-iteration": 0.2046103994051615, "set_robot_commands": 0.005396300156911214, "deviation-center-line": 0.5026830347870097, "driven_lanedir_consec": 1.3644958944527323, "sim_compute_sim_state": 0.014943660100301109, "sim_compute_performance-ego": 0.004600660800933838, "sim_compute_robot_state-ego": 0.008767464955647786, "sim_compute_robot_state-parked0": 0.008072818120320638}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.6910093357173888, "get_ui_image": 0.03479675928751628, "step_physics": 0.08829678694407145, "survival_time": 14.950000000000076, "driven_lanedir": 1.7109546776366726, "get_state_dump": 0.014630889097849528, "sim_render-ego": 0.006567396322886149, "in-drivable-lane": 8.900000000000055, "agent_compute-ego": 0.02015029350916545, "deviation-heading": 0.4657864081952717, "complete-iteration": 0.20649917920430505, "set_robot_commands": 0.00491977055867513, "deviation-center-line": 0.7312798715636492, "driven_lanedir_consec": 1.7109546776366726, "sim_compute_sim_state": 0.017079865932464598, "sim_compute_performance-ego": 0.004333804448445638, "sim_compute_robot_state-ego": 0.007849528789520263, "sim_compute_robot_state-parked0": 0.007692917188008627}}
set_robot_commands_max	0.006124748310572664
set_robot_commands_mean	0.005479757766208738
set_robot_commands_median	0.0054372560977935785
set_robot_commands_min	0.00491977055867513
sim_compute_performance-ego_max	0.004865263549374862
sim_compute_performance-ego_mean	0.004580391905677151
sim_compute_performance-ego_median	0.004561249812444051
sim_compute_performance-ego_min	0.004333804448445638
sim_compute_robot_state-ego_max	0.009814017255541305
sim_compute_robot_state-ego_mean	0.00878928175554589
sim_compute_robot_state-ego_median	0.008746790488560995
sim_compute_robot_state-ego_min	0.007849528789520263
sim_compute_robot_state-parked0_max	0.008789267338497537
sim_compute_robot_state-parked0_mean	0.008166530876652176
sim_compute_robot_state-parked0_median	0.00809196949005127
sim_compute_robot_state-parked0_min	0.007692917188008627
sim_compute_sim_state_max	0.017137715021769206
sim_compute_sim_state_mean	0.016349659411000535
sim_compute_sim_state_median	0.01665863126096591
sim_compute_sim_state_min	0.014943660100301109
sim_render-ego_max	0.007461739258027412
sim_render-ego_mean	0.006954669126882239
sim_render-ego_median	0.006894770463307698
sim_render-ego_min	0.006567396322886149
simulation-passed	1
step_physics_max	0.08829678694407145
step_physics_mean	0.08655340723868267
step_physics_median	0.08623098716489586
step_physics_min	0.08545486768086752
survival_time_max	14.950000000000076
survival_time_mean	12.100000000000056
survival_time_min	3.5499999999999954

No reset possible

36188

9780

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-02 02:19:14+00:00

2020-11-02 02:26:25+00:00

0:07:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.5595637393281012
survival_time_median	8.949999999999992
deviation-center-line_median	0.2530751216048039
in-drivable-lane_median	1.5000000000000115

other stats

agent_compute-ego_max	0.02461518640593281
agent_compute-ego_mean	0.023298833701031297
agent_compute-ego_median	0.023352492177107022
agent_compute-ego_min	0.021875164043978327
complete-iteration_max	0.2036765956278867
complete-iteration_mean	0.20007128184418016
complete-iteration_median	0.1993655277667357
complete-iteration_min	0.19787747621536256
deviation-center-line_max	0.28922949286138555
deviation-center-line_mean	0.25243919035420714
deviation-center-line_min	0.21437702534583508
deviation-heading_max	2.3978275544569234
deviation-heading_mean	1.6127708040505069
deviation-heading_median	1.3833836852346963
deviation-heading_min	1.2864882912757116
driven_any_max	2.7186266225024456
driven_any_mean	2.1151267556946873
driven_any_median	2.136131835988968
driven_any_min	1.4696167282983674
driven_lanedir_consec_max	1.9486233390085048
driven_lanedir_consec_mean	1.4534471433309015
driven_lanedir_consec_min	0.7460377556588993
driven_lanedir_max	1.9486233390085048
driven_lanedir_mean	1.4534471433309015
driven_lanedir_median	1.5595637393281012
driven_lanedir_min	0.7460377556588993
get_state_dump_max	0.01764268011558713
get_state_dump_mean	0.016842897709463952
get_state_dump_median	0.017062385799098054
get_state_dump_min	0.015604139124072571
get_ui_image_max	0.032237728636468475
get_ui_image_mean	0.031627190670599846
get_ui_image_median	0.03180448994696515
get_ui_image_min	0.030662054152000608
in-drivable-lane_max	10.550000000000058
in-drivable-lane_mean	3.5625000000000195
in-drivable-lane_min	0.6999999999999975
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4696167282983674, "get_ui_image": 0.030662054152000608, "step_physics": 0.0698863127100186, "survival_time": 6.349999999999985, "driven_lanedir": 1.2714023896136388, "get_state_dump": 0.01764268011558713, "sim_render-ego": 0.007490452818983183, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.02461518640593281, "deviation-heading": 1.2864882912757116, "complete-iteration": 0.20051766756012684, "set_robot_commands": 0.006946156344075841, "deviation-center-line": 0.21437702534583508, "driven_lanedir_consec": 1.2714023896136388, "sim_compute_sim_state": 0.01707331965288778, "sim_compute_performance-ego": 0.005133298438365065, "sim_compute_robot_state-ego": 0.011539752089132474, "sim_compute_robot_state-parked0": 0.009331834597850409}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.235791163896224, "get_ui_image": 0.032237728636468475, "step_physics": 0.07386601031126089, "survival_time": 9.950000000000006, "driven_lanedir": 1.9486233390085048, "get_state_dump": 0.017176358544047754, "sim_render-ego": 0.006974405978792277, "in-drivable-lane": 2.1000000000000263, "agent_compute-ego": 0.0229952826571824, "deviation-heading": 1.3849149443494737, "complete-iteration": 0.1982133879733445, "set_robot_commands": 0.005900468059520625, "deviation-center-line": 0.28922949286138555, "driven_lanedir_consec": 1.9486233390085048, "sim_compute_sim_state": 0.016737289764174264, "sim_compute_performance-ego": 0.004638076427593902, "sim_compute_robot_state-ego": 0.009030925568623758, "sim_compute_robot_state-parked0": 0.00843724174116125}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.7186266225024456, "get_ui_image": 0.03151305278142293, "step_physics": 0.07601553440093994, "survival_time": 14.950000000000076, "driven_lanedir": 0.7460377556588993, "get_state_dump": 0.016948413054148355, "sim_render-ego": 0.007020007769266764, "in-drivable-lane": 10.550000000000058, "agent_compute-ego": 0.023709701697031654, "deviation-heading": 2.3978275544569234, "complete-iteration": 0.19787747621536256, "set_robot_commands": 0.0056065384546915694, "deviation-center-line": 0.2638468357219559, "driven_lanedir_consec": 0.7460377556588993, "sim_compute_sim_state": 0.014135659535725912, "sim_compute_performance-ego": 0.004749949773152669, "sim_compute_robot_state-ego": 0.009325749079386393, "sim_compute_robot_state-parked0": 0.008659376303354898}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.036472508081712, "get_ui_image": 0.03209592711250737, "step_physics": 0.0814682867542003, "survival_time": 7.94999999999998, "driven_lanedir": 1.8477250890425636, "get_state_dump": 0.015604139124072571, "sim_render-ego": 0.007086690866722251, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.021875164043978327, "deviation-heading": 1.3818524261199192, "complete-iteration": 0.2036765956278867, "set_robot_commands": 0.005936685598121499, "deviation-center-line": 0.24230340748765192, "driven_lanedir_consec": 1.8477250890425636, "sim_compute_sim_state": 0.01630375070391961, "sim_compute_performance-ego": 0.004901942966869043, "sim_compute_robot_state-ego": 0.009823718160953164, "sim_compute_robot_state-parked0": 0.0083944707546594}}
set_robot_commands_max	0.006946156344075841
set_robot_commands_mean	0.0060974621141023835
set_robot_commands_median	0.005918576828821062
set_robot_commands_min	0.0056065384546915694
sim_compute_performance-ego_max	0.005133298438365065
sim_compute_performance-ego_mean	0.00485581690149517
sim_compute_performance-ego_median	0.004825946370010856
sim_compute_performance-ego_min	0.004638076427593902
sim_compute_robot_state-ego_max	0.011539752089132474
sim_compute_robot_state-ego_mean	0.009930036224523948
sim_compute_robot_state-ego_median	0.00957473362016978
sim_compute_robot_state-ego_min	0.009030925568623758
sim_compute_robot_state-parked0_max	0.009331834597850409
sim_compute_robot_state-parked0_mean	0.00870573084925649
sim_compute_robot_state-parked0_median	0.008548309022258074
sim_compute_robot_state-parked0_min	0.0083944707546594
sim_compute_sim_state_max	0.01707331965288778
sim_compute_sim_state_mean	0.016062504914176892
sim_compute_sim_state_median	0.01652052023404694
sim_compute_sim_state_min	0.014135659535725912
sim_render-ego_max	0.007490452818983183
sim_render-ego_mean	0.007142889358441118
sim_render-ego_median	0.007053349317994508
sim_render-ego_min	0.006974405978792277
simulation-passed	1
step_physics_max	0.0814682867542003
step_physics_mean	0.07530903604410494
step_physics_median	0.07494077235610042
step_physics_min	0.0698863127100186
survival_time_max	14.950000000000076
survival_time_mean	9.800000000000011
survival_time_min	6.349999999999985

No reset possible

36184

9784

Charlie Gauthier 🇨🇦

template-ros

LFv-sim

success

2020-11-02 02:06:21+00:00

2020-11-02 02:18:33+00:00

0:12:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.141268170364367
survival_time_median	14.950000000000076
deviation-center-line_median	0.08955827824708931
in-drivable-lane_median	7.375000000000043

other stats

agent_compute-ego_max	0.020721498330434164
agent_compute-ego_mean	0.019892285664876302
agent_compute-ego_median	0.019815315802892048
agent_compute-ego_min	0.019217012723286943
complete-iteration_max	0.20878629763921103
complete-iteration_mean	0.2065812027454376
complete-iteration_median	0.20649882674217224
complete-iteration_min	0.20454085985819495
deviation-center-line_max	0.26114710533295626
deviation-center-line_mean	0.11808846572567314
deviation-center-line_min	0.03209020107555766
deviation-heading_max	6.044362435489037
deviation-heading_mean	5.748595047920594
deviation-heading_median	5.66604065410889
deviation-heading_min	5.617936447975552
driven_any_max	0.4425638263246755
driven_any_mean	0.4365107031564367
driven_any_median	0.4376331293705604
driven_any_min	0.4282127275599505
driven_lanedir_consec_max	0.15138791499339632
driven_lanedir_consec_mean	0.14226760400280977
driven_lanedir_consec_min	0.13514616028910875
driven_lanedir_max	0.15138791499339632
driven_lanedir_mean	0.14226760400280977
driven_lanedir_median	0.141268170364367
driven_lanedir_min	0.13514616028910875
get_state_dump_max	0.01535233974456787
get_state_dump_mean	0.014738457798957823
get_state_dump_median	0.01458820382754008
get_state_dump_min	0.014425083796183269
get_ui_image_max	0.03549249728520711
get_ui_image_mean	0.03452706793944041
get_ui_image_median	0.03461473584175109
get_ui_image_min	0.03338630278905233
in-drivable-lane_max	7.65000000000004
in-drivable-lane_mean	7.35000000000004
in-drivable-lane_min	7.000000000000036
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.4282127275599505, "get_ui_image": 0.03338630278905233, "step_physics": 0.08682095448176066, "survival_time": 14.950000000000076, "driven_lanedir": 0.14151560697155796, "get_state_dump": 0.01466135581334432, "sim_render-ego": 0.006803189118703206, "in-drivable-lane": 7.350000000000042, "agent_compute-ego": 0.019812307357788085, "deviation-heading": 5.617936447975552, "complete-iteration": 0.205777428150177, "set_robot_commands": 0.005457855860392252, "deviation-center-line": 0.07225533728793135, "driven_lanedir_consec": 0.14151560697155796, "sim_compute_sim_state": 0.016787930329640707, "sim_compute_performance-ego": 0.004610876242319743, "sim_compute_robot_state-ego": 0.008839852015177408, "sim_compute_robot_state-parked0": 0.008434658845265706}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.43941487330198786, "get_ui_image": 0.03459689935048421, "step_physics": 0.08907241900761922, "survival_time": 14.950000000000076, "driven_lanedir": 0.15138791499339632, "get_state_dump": 0.014425083796183269, "sim_render-ego": 0.006919652620951335, "in-drivable-lane": 7.000000000000036, "agent_compute-ego": 0.01981832424799601, "deviation-heading": 6.044362435489037, "complete-iteration": 0.20722022533416748, "set_robot_commands": 0.005310219923655192, "deviation-center-line": 0.03209020107555766, "driven_lanedir_consec": 0.15138791499339632, "sim_compute_sim_state": 0.0150653870900472, "sim_compute_performance-ego": 0.004670560359954834, "sim_compute_robot_state-ego": 0.00873894770940145, "sim_compute_robot_state-parked0": 0.008436908721923828}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.4425638263246755, "get_ui_image": 0.03549249728520711, "step_physics": 0.08899916887283325, "survival_time": 14.950000000000076, "driven_lanedir": 0.13514616028910875, "get_state_dump": 0.01535233974456787, "sim_render-ego": 0.006890069643656412, "in-drivable-lane": 7.65000000000004, "agent_compute-ego": 0.020721498330434164, "deviation-heading": 5.629083850464798, "complete-iteration": 0.20878629763921103, "set_robot_commands": 0.005701310634613037, "deviation-center-line": 0.10686121920624726, "driven_lanedir_consec": 0.13514616028910875, "sim_compute_sim_state": 0.012750657399495442, "sim_compute_performance-ego": 0.004707252979278565, "sim_compute_robot_state-ego": 0.009473566214243572, "sim_compute_robot_state-parked0": 0.008531952699025472}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.43585138543913304, "get_ui_image": 0.03463257233301798, "step_physics": 0.08765669107437134, "survival_time": 14.950000000000076, "driven_lanedir": 0.14102073375717605, "get_state_dump": 0.01451505184173584, "sim_render-ego": 0.006776985327402751, "in-drivable-lane": 7.400000000000042, "agent_compute-ego": 0.019217012723286943, "deviation-heading": 5.702997457752984, "complete-iteration": 0.20454085985819495, "set_robot_commands": 0.005053323904673258, "deviation-center-line": 0.26114710533295626, "driven_lanedir_consec": 0.14102073375717605, "sim_compute_sim_state": 0.01542980432510376, "sim_compute_performance-ego": 0.0044734573364257815, "sim_compute_robot_state-ego": 0.008286401430765788, "sim_compute_robot_state-parked0": 0.008334565957387288}}
set_robot_commands_max	0.005701310634613037
set_robot_commands_mean	0.005380677580833435
set_robot_commands_median	0.005384037892023722
set_robot_commands_min	0.005053323904673258
sim_compute_performance-ego_max	0.004707252979278565
sim_compute_performance-ego_mean	0.004615536729494731
sim_compute_performance-ego_median	0.004640718301137289
sim_compute_performance-ego_min	0.0044734573364257815
sim_compute_robot_state-ego_max	0.009473566214243572
sim_compute_robot_state-ego_mean	0.008834691842397055
sim_compute_robot_state-ego_median	0.008789399862289429
sim_compute_robot_state-ego_min	0.008286401430765788
sim_compute_robot_state-parked0_max	0.008531952699025472
sim_compute_robot_state-parked0_mean	0.008434521555900574
sim_compute_robot_state-parked0_median	0.008435783783594768
sim_compute_robot_state-parked0_min	0.008334565957387288
sim_compute_sim_state_max	0.016787930329640707
sim_compute_sim_state_mean	0.015008444786071778
sim_compute_sim_state_median	0.01524759570757548
sim_compute_sim_state_min	0.012750657399495442
sim_render-ego_max	0.006919652620951335
sim_render-ego_mean	0.006847474177678426
sim_render-ego_median	0.00684662938117981
sim_render-ego_min	0.006776985327402751
simulation-passed	1
step_physics_max	0.08907241900761922
step_physics_mean	0.08813730835914613
step_physics_median	0.0883279299736023
step_physics_min	0.08682095448176066
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

36182

10003

Olga (Ge Ya) Xu 🇨🇦

exercise_ros_template

LFv-sim

success

aido5-LFV-sim-validation

2020-11-02 01:57:58+00:00

2020-11-02 02:05:53+00:00

0:07:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.6122484236220442
survival_time_median	10.650000000000016
deviation-center-line_median	0.3549448007780061
in-drivable-lane_median	3.975000000000032

other stats

agent_compute-ego_max	0.021146979331970215
agent_compute-ego_mean	0.02065487240559684
agent_compute-ego_median	0.020697947141063006
agent_compute-ego_min	0.02007661600829113
complete-iteration_max	0.2184511876106262
complete-iteration_mean	0.21024242296355652
complete-iteration_median	0.2102575174433441
complete-iteration_min	0.2020034693569117
deviation-center-line_max	0.6580779520168177
deviation-center-line_mean	0.4286747260873908
deviation-center-line_min	0.3467313507767332
deviation-heading_max	3.5052781894695952
deviation-heading_mean	1.584925400791681
deviation-heading_median	1.084783947583928
deviation-heading_min	0.6648555185292738
driven_any_max	2.825419744911084
driven_any_mean	2.438968823443925
driven_any_median	2.5369387671377908
driven_any_min	1.8565780145890345
driven_lanedir_consec_max	1.9385513958036773
driven_lanedir_consec_mean	1.5869840406485518
driven_lanedir_consec_min	1.1848879195464417
driven_lanedir_max	1.9385513958036773
driven_lanedir_mean	1.5869840406485518
driven_lanedir_median	1.6122484236220442
driven_lanedir_min	1.1848879195464417
get_state_dump_max	0.01516439437866211
get_state_dump_mean	0.014781880449958928
get_state_dump_median	0.014826192904069934
get_state_dump_min	0.014310741613033732
get_ui_image_max	0.034805771509806314
get_ui_image_mean	0.0344861293043275
get_ui_image_median	0.034495793397256634
get_ui_image_min	0.0341471589129904
in-drivable-lane_max	6.650000000000059
in-drivable-lane_mean	4.287500000000028
in-drivable-lane_min	2.549999999999991
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.8565780145890345, "get_ui_image": 0.034805771509806314, "step_physics": 0.0899134922027588, "survival_time": 7.499999999999981, "driven_lanedir": 1.286226280159406, "get_state_dump": 0.01516439437866211, "sim_render-ego": 0.006789644559224446, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.020952887535095215, "deviation-heading": 0.7549464834904357, "complete-iteration": 0.21253998279571537, "set_robot_commands": 0.005536095301310221, "deviation-center-line": 0.3585327596211202, "driven_lanedir_consec": 1.286226280159406, "sim_compute_sim_state": 0.017306027412414552, "sim_compute_performance-ego": 0.004557642936706543, "sim_compute_robot_state-ego": 0.00901665210723877, "sim_compute_robot_state-parked0": 0.008319509824117026}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.825419744911084, "get_ui_image": 0.03443110747144401, "step_physics": 0.08192911313448338, "survival_time": 8.649999999999988, "driven_lanedir": 1.9385513958036773, "get_state_dump": 0.014744141198307104, "sim_render-ego": 0.006919966956783582, "in-drivable-lane": 2.5500000000000016, "agent_compute-ego": 0.0204430067470308, "deviation-heading": 0.6648555185292738, "complete-iteration": 0.2020034693569117, "set_robot_commands": 0.00511741224740971, "deviation-center-line": 0.3467313507767332, "driven_lanedir_consec": 1.9385513958036773, "sim_compute_sim_state": 0.016723860205942496, "sim_compute_performance-ego": 0.004649275300130679, "sim_compute_robot_state-ego": 0.008602156115405133, "sim_compute_robot_state-parked0": 0.008264267375703491}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.2518401547833644, "get_ui_image": 0.03456047932306926, "step_physics": 0.09848697980244954, "survival_time": 14.950000000000076, "driven_lanedir": 1.1848879195464417, "get_state_dump": 0.014908244609832763, "sim_render-ego": 0.00704046090443929, "in-drivable-lane": 6.650000000000059, "agent_compute-ego": 0.021146979331970215, "deviation-heading": 3.5052781894695952, "complete-iteration": 0.2184511876106262, "set_robot_commands": 0.005525772571563721, "deviation-center-line": 0.6580779520168177, "driven_lanedir_consec": 1.1848879195464417, "sim_compute_sim_state": 0.0144121519724528, "sim_compute_performance-ego": 0.004625742435455322, "sim_compute_robot_state-ego": 0.009221344788869225, "sim_compute_robot_state-parked0": 0.008339409033457439}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8220373794922176, "get_ui_image": 0.0341471589129904, "step_physics": 0.0881273652253886, "survival_time": 12.650000000000045, "driven_lanedir": 1.9382705670846825, "get_state_dump": 0.014310741613033732, "sim_render-ego": 0.006778493700291328, "in-drivable-lane": 5.4000000000000625, "agent_compute-ego": 0.02007661600829113, "deviation-heading": 1.4146214116774205, "complete-iteration": 0.2079750520909728, "set_robot_commands": 0.005365087109592121, "deviation-center-line": 0.35135684193489203, "driven_lanedir_consec": 1.9382705670846825, "sim_compute_sim_state": 0.017437615413439602, "sim_compute_performance-ego": 0.004591786343118419, "sim_compute_robot_state-ego": 0.00887224985205609, "sim_compute_robot_state-parked0": 0.008085698478306706}}
set_robot_commands_max	0.005536095301310221
set_robot_commands_mean	0.005386091807468943
set_robot_commands_median	0.005445429840577921
set_robot_commands_min	0.00511741224740971
sim_compute_performance-ego_max	0.004649275300130679
sim_compute_performance-ego_mean	0.004606111753852741
sim_compute_performance-ego_median	0.0046087643892868705
sim_compute_performance-ego_min	0.004557642936706543
sim_compute_robot_state-ego_max	0.009221344788869225
sim_compute_robot_state-ego_mean	0.008928100715892303
sim_compute_robot_state-ego_median	0.008944450979647429
sim_compute_robot_state-ego_min	0.008602156115405133
sim_compute_robot_state-parked0_max	0.008339409033457439
sim_compute_robot_state-parked0_mean	0.008252221177896164
sim_compute_robot_state-parked0_median	0.008291888599910258
sim_compute_robot_state-parked0_min	0.008085698478306706
sim_compute_sim_state_max	0.017437615413439602
sim_compute_sim_state_mean	0.01646991375106236
sim_compute_sim_state_median	0.017014943809178524
sim_compute_sim_state_min	0.0144121519724528
sim_render-ego_max	0.00704046090443929
sim_render-ego_mean	0.006882141530184661
sim_render-ego_median	0.006854805758004014
sim_render-ego_min	0.006778493700291328
simulation-passed	1
step_physics_max	0.09848697980244954
step_physics_mean	0.08961423759127007
step_physics_median	0.0890204287140737
step_physics_min	0.08192911313448338
survival_time_max	14.950000000000076
survival_time_mean	10.937500000000025
survival_time_min	7.499999999999981

No reset possible

36179

9943

Bea Baselines 🐤

baseline-duckietown

LFVv-sim

success

aido5-LFVI-sim-validation

2020-11-02 01:45:58+00:00

2020-11-02 01:57:24+00:00

0:11:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2999514582036675
survival_time_median	12.500000000000044
deviation-center-line_median	0.40433756384008424
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.05213023900985718
agent_compute-ego_mean	0.04417166981095594
agent_compute-ego_median	0.04772303747893566
agent_compute-ego_min	0.029110365276095233
complete-iteration_max	0.3756203343026081
complete-iteration_mean	0.3561071709825227
complete-iteration_median	0.36048855423927306
complete-iteration_min	0.3278312411489366
deviation-center-line_max	0.9170333106512044
deviation-center-line_mean	0.47543723241287505
deviation-center-line_min	0.1760404913201274
deviation-heading_max	2.776356354655022
deviation-heading_mean	1.587316528943123
deviation-heading_median	1.6367851079510949
deviation-heading_min	0.2993395452152807
driven_any_max	1.9399906710247816
driven_any_mean	1.410628511515558
driven_any_median	1.6146792114607194
driven_any_min	0.473164952116011
driven_lanedir_consec_max	1.8948579737850324
driven_lanedir_consec_mean	1.2416451290974946
driven_lanedir_consec_min	0.4718196261976111
driven_lanedir_max	1.8948579737850324
driven_lanedir_mean	1.2416451290974946
driven_lanedir_median	1.2999514582036675
driven_lanedir_min	0.4718196261976111
get_state_dump_max	0.030518970489501952
get_state_dump_mean	0.02986641530328752
get_state_dump_median	0.02983684421088625
get_state_dump_min	0.02927300230187563
get_ui_image_max	0.05348764604596949
get_ui_image_mean	0.05221340883869737
get_ui_image_median	0.0523123769468396
get_ui_image_min	0.050741235415140785
in-drivable-lane_max	3.7500000000000537
in-drivable-lane_mean	0.9375000000000132
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.473164952116011, "get_ui_image": 0.05184253861632528, "step_physics": 0.13554548915428452, "survival_time": 3.949999999999994, "driven_lanedir": 0.4718196261976111, "get_state_dump": 0.029776796509947957, "sim_render-ego": 0.006668766842612737, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029110365276095233, "deviation-heading": 0.2993395452152807, "complete-iteration": 0.3278312411489366, "set_robot_commands": 0.0055027762545815, "deviation-center-line": 0.1760404913201274, "driven_lanedir_consec": 0.4718196261976111, "sim_compute_sim_state": 0.017045413391499578, "sim_compute_performance-ego": 0.004482070101967341, "sim_compute_robot_state-ego": 0.008449973939340326, "sim_compute_robot_state-npc0": 0.007877002788495414, "sim_compute_robot_state-npc1": 0.007584991334359857, "sim_compute_robot_state-npc2": 0.007489814033991174, "sim_compute_robot_state-npc3": 0.007861849627917326, "sim_compute_robot_state-parked0": 0.008361049845248839}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.2894025094317132, "get_ui_image": 0.05348764604596949, "step_physics": 0.16700472167475305, "survival_time": 10.050000000000008, "driven_lanedir": 1.2728422222553033, "get_state_dump": 0.02927300230187563, "sim_render-ego": 0.006528376346796899, "in-drivable-lane": 0.0, "agent_compute-ego": 0.04507212733747947, "deviation-heading": 0.9921311997775156, "complete-iteration": 0.3756203343026081, "set_robot_commands": 0.005129945811940663, "deviation-center-line": 0.4783617196905008, "driven_lanedir_consec": 1.2728422222553033, "sim_compute_sim_state": 0.01525540019742292, "sim_compute_performance-ego": 0.0043665105430640986, "sim_compute_robot_state-ego": 0.008598104638246755, "sim_compute_robot_state-npc0": 0.007909910002751137, "sim_compute_robot_state-npc1": 0.007992562963001763, "sim_compute_robot_state-npc2": 0.008184954894715874, "sim_compute_robot_state-npc3": 0.008270519882885378, "sim_compute_robot_state-parked0": 0.0082989047415814}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9399559134897255, "get_ui_image": 0.052782215277353925, "step_physics": 0.14009331067403158, "survival_time": 14.950000000000076, "driven_lanedir": 1.8948579737850324, "get_state_dump": 0.029896891911824545, "sim_render-ego": 0.006642026901245117, "in-drivable-lane": 0.0, "agent_compute-ego": 0.05037394762039184, "deviation-heading": 2.281439016124674, "complete-iteration": 0.35755648295084635, "set_robot_commands": 0.0053211728731791174, "deviation-center-line": 0.9170333106512044, "driven_lanedir_consec": 1.8948579737850324, "sim_compute_sim_state": 0.01783172845840454, "sim_compute_performance-ego": 0.004347931543986002, "sim_compute_robot_state-ego": 0.008617503643035889, "sim_compute_robot_state-npc0": 0.008319648106892903, "sim_compute_robot_state-npc1": 0.008274680773417155, "sim_compute_robot_state-npc2": 0.00827764352162679, "sim_compute_robot_state-npc3": 0.008320884704589844, "sim_compute_robot_state-parked0": 0.008205142815907797}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399906710247816, "get_ui_image": 0.050741235415140785, "step_physics": 0.14395031531651814, "survival_time": 14.950000000000076, "driven_lanedir": 1.3270606941520315, "get_state_dump": 0.030518970489501952, "sim_render-ego": 0.006895565191904704, "in-drivable-lane": 3.7500000000000537, "agent_compute-ego": 0.05213023900985718, "deviation-heading": 2.776356354655022, "complete-iteration": 0.36342062552769977, "set_robot_commands": 0.005593274434407552, "deviation-center-line": 0.3303134079896677, "driven_lanedir_consec": 1.3270606941520315, "sim_compute_sim_state": 0.01626538117726644, "sim_compute_performance-ego": 0.004591147899627685, "sim_compute_robot_state-ego": 0.009037532806396483, "sim_compute_robot_state-npc0": 0.008756969769795736, "sim_compute_robot_state-npc1": 0.008625381787618002, "sim_compute_robot_state-npc2": 0.008631305694580078, "sim_compute_robot_state-npc3": 0.008687666257222493, "sim_compute_robot_state-parked0": 0.008736963272094727}}
set_robot_commands_max	0.005593274434407552
set_robot_commands_mean	0.005386792343527208
set_robot_commands_median	0.005411974563880309
set_robot_commands_min	0.005129945811940663
sim_compute_performance-ego_max	0.004591147899627685
sim_compute_performance-ego_mean	0.0044469150221612816
sim_compute_performance-ego_median	0.00442429032251572
sim_compute_performance-ego_min	0.004347931543986002
sim_compute_robot_state-ego_max	0.009037532806396483
sim_compute_robot_state-ego_mean	0.008675778756754864
sim_compute_robot_state-ego_median	0.008607804140641322
sim_compute_robot_state-ego_min	0.008449973939340326
sim_compute_robot_state-npc0_max	0.008756969769795736
sim_compute_robot_state-npc0_mean	0.008215882666983797
sim_compute_robot_state-npc0_median	0.008114779054822021
sim_compute_robot_state-npc0_min	0.007877002788495414
sim_compute_robot_state-npc1_max	0.008625381787618002
sim_compute_robot_state-npc1_mean	0.008119404214599195
sim_compute_robot_state-npc1_median	0.00813362186820946
sim_compute_robot_state-npc1_min	0.007584991334359857
sim_compute_robot_state-npc2_max	0.008631305694580078
sim_compute_robot_state-npc2_mean	0.00814592953622848
sim_compute_robot_state-npc2_median	0.008231299208171332
sim_compute_robot_state-npc2_min	0.007489814033991174
sim_compute_robot_state-npc3_max	0.008687666257222493
sim_compute_robot_state-npc3_mean	0.008285230118153762
sim_compute_robot_state-npc3_median	0.008295702293737611
sim_compute_robot_state-npc3_min	0.007861849627917326
sim_compute_robot_state-parked0_max	0.008736963272094727
sim_compute_robot_state-parked0_mean	0.00840051516870819
sim_compute_robot_state-parked0_median	0.00832997729341512
sim_compute_robot_state-parked0_min	0.008205142815907797
sim_compute_sim_state_max	0.01783172845840454
sim_compute_sim_state_mean	0.01659948080614837
sim_compute_sim_state_median	0.01665539728438301
sim_compute_sim_state_min	0.01525540019742292
sim_render-ego_max	0.006895565191904704
sim_render-ego_mean	0.0066836838206398635
sim_render-ego_median	0.006655396871928928
sim_render-ego_min	0.006528376346796899
simulation-passed	1
step_physics_max	0.16700472167475305
step_physics_mean	0.14664845920489683
step_physics_median	0.14202181299527486
step_physics_min	0.13554548915428452
survival_time_max	14.950000000000076
survival_time_mean	10.97500000000004
survival_time_min	3.949999999999994

No reset possible

36175

9946

Bea Baselines 🐤

baseline-duckietown

LFVIv-sim

success

aido5-LFVI_multi-sim-validation

2020-11-02 01:41:06+00:00

2020-11-02 01:45:38+00:00

0:04:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6929880028800863
survival_time_median	14.950000000000076
deviation-center-line_median	0.3543816897760188
in-drivable-lane_median	8.000000000000064

other stats

agent_compute-ego_max	0.030702433586120605
agent_compute-ego_mean	0.030702433586120605
agent_compute-ego_median	0.030702433586120605
agent_compute-ego_min	0.030702433586120605
complete-iteration_max	0.3508356690406799
complete-iteration_mean	0.3508356690406799
complete-iteration_median	0.3508356690406799
complete-iteration_min	0.3508356690406799
deviation-center-line_max	0.3543816897760188
deviation-center-line_mean	0.3543816897760188
deviation-center-line_min	0.3543816897760188
deviation-heading_max	3.456547222615163
deviation-heading_mean	3.456547222615163
deviation-heading_median	3.456547222615163
deviation-heading_min	3.456547222615163
driven_any_max	1.9336179607492496
driven_any_mean	1.9336179607492496
driven_any_median	1.9336179607492496
driven_any_min	1.9336179607492496
driven_lanedir_consec_max	0.6929880028800863
driven_lanedir_consec_mean	0.6929880028800863
driven_lanedir_consec_min	0.6929880028800863
driven_lanedir_max	0.6929880028800863
driven_lanedir_mean	0.6929880028800863
driven_lanedir_median	0.6929880028800863
driven_lanedir_min	0.6929880028800863
get_state_dump_max	0.03142594257990519
get_state_dump_mean	0.03142594257990519
get_state_dump_median	0.03142594257990519
get_state_dump_min	0.03142594257990519
get_ui_image_max	0.05697405576705933
get_ui_image_mean	0.05697405576705933
get_ui_image_median	0.05697405576705933
get_ui_image_min	0.05697405576705933
in-drivable-lane_max	8.000000000000064
in-drivable-lane_mean	8.000000000000064
in-drivable-lane_min	8.000000000000064
per-episodes	details {"udem1-sc0-0-ego": {"driven_any": 1.9336179607492496, "get_ui_image": 0.05697405576705933, "step_physics": 0.14998801946640014, "survival_time": 14.950000000000076, "driven_lanedir": 0.6929880028800863, "get_state_dump": 0.03142594257990519, "sim_render-ego": 0.006735246181488037, "in-drivable-lane": 8.000000000000064, "agent_compute-ego": 0.030702433586120605, "deviation-heading": 3.456547222615163, "complete-iteration": 0.3508356690406799, "set_robot_commands": 0.0053096302350362145, "deviation-center-line": 0.3543816897760188, "driven_lanedir_consec": 0.6929880028800863, "sim_compute_sim_state": 0.016476033528645833, "sim_compute_performance-ego": 0.004450512727101644, "sim_compute_robot_state-ego": 0.008907578786214192, "sim_compute_robot_state-npc0": 0.008059887091318767, "sim_compute_robot_state-npc1": 0.007696955998738607, "sim_compute_robot_state-npc2": 0.007749997774759929, "sim_compute_robot_state-npc3": 0.00797057310740153, "sim_compute_robot_state-parked0": 0.00813432772954305}}
set_robot_commands_max	0.0053096302350362145
set_robot_commands_mean	0.0053096302350362145
set_robot_commands_median	0.0053096302350362145
set_robot_commands_min	0.0053096302350362145
sim_compute_performance-ego_max	0.004450512727101644
sim_compute_performance-ego_mean	0.004450512727101644
sim_compute_performance-ego_median	0.004450512727101644
sim_compute_performance-ego_min	0.004450512727101644
sim_compute_robot_state-ego_max	0.008907578786214192
sim_compute_robot_state-ego_mean	0.008907578786214192
sim_compute_robot_state-ego_median	0.008907578786214192
sim_compute_robot_state-ego_min	0.008907578786214192
sim_compute_robot_state-npc0_max	0.008059887091318767
sim_compute_robot_state-npc0_mean	0.008059887091318767
sim_compute_robot_state-npc0_median	0.008059887091318767
sim_compute_robot_state-npc0_min	0.008059887091318767
sim_compute_robot_state-npc1_max	0.007696955998738607
sim_compute_robot_state-npc1_mean	0.007696955998738607
sim_compute_robot_state-npc1_median	0.007696955998738607
sim_compute_robot_state-npc1_min	0.007696955998738607
sim_compute_robot_state-npc2_max	0.007749997774759929
sim_compute_robot_state-npc2_mean	0.007749997774759929
sim_compute_robot_state-npc2_median	0.007749997774759929
sim_compute_robot_state-npc2_min	0.007749997774759929
sim_compute_robot_state-npc3_max	0.00797057310740153
sim_compute_robot_state-npc3_mean	0.00797057310740153
sim_compute_robot_state-npc3_median	0.00797057310740153
sim_compute_robot_state-npc3_min	0.00797057310740153
sim_compute_robot_state-parked0_max	0.00813432772954305
sim_compute_robot_state-parked0_mean	0.00813432772954305
sim_compute_robot_state-parked0_median	0.00813432772954305
sim_compute_robot_state-parked0_min	0.00813432772954305
sim_compute_sim_state_max	0.016476033528645833
sim_compute_sim_state_mean	0.016476033528645833
sim_compute_sim_state_median	0.016476033528645833
sim_compute_sim_state_min	0.016476033528645833
sim_render-ego_max	0.006735246181488037
sim_render-ego_mean	0.006735246181488037
sim_render-ego_median	0.006735246181488037
sim_render-ego_min	0.006735246181488037
simulation-passed	1
step_physics_max	0.14998801946640014
step_physics_mean	0.14998801946640014
step_physics_median	0.14998801946640014
step_physics_min	0.14998801946640014
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

36169

9975

Bea Baselines 🐤

template-pytorch

LFVIv-sim

success

2020-11-02 01:30:13+00:00

2020-11-02 01:40:38+00:00

0:10:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.21995497055080193
survival_time_median	14.950000000000076
deviation-center-line_median	0.2452929165287098
in-drivable-lane_median	12.350000000000083

other stats

agent_compute-ego0_max	0.04371504545211792
agent_compute-ego0_mean	0.04371504545211793
agent_compute-ego0_median	0.04371504545211792
agent_compute-ego0_min	0.04371504545211792
agent_compute-ego1_max	0.04156718651453654
agent_compute-ego1_mean	0.04156718651453654
agent_compute-ego1_median	0.04156718651453654
agent_compute-ego1_min	0.04156718651453654
agent_compute-ego2_max	0.04133169094721476
agent_compute-ego2_mean	0.04133169094721476
agent_compute-ego2_median	0.04133169094721476
agent_compute-ego2_min	0.04133169094721476
complete-iteration_max	0.7496065314610799
complete-iteration_mean	0.7496065314610799
complete-iteration_median	0.7496065314610799
complete-iteration_min	0.7496065314610799
deviation-center-line_max	0.49916640148966096
deviation-center-line_mean	0.2968526151896134
deviation-center-line_min	0.1460985275504696
deviation-heading_max	4.999520746331471
deviation-heading_mean	2.6373220627555995
deviation-heading_median	1.6943358157912287
deviation-heading_min	1.218109626144099
driven_any_max	3.2799824141437584
driven_any_mean	2.5433486664472724
driven_any_median	3.2007400329201285
driven_any_min	1.1493235522779297
driven_lanedir_consec_max	0.7817403201275721
driven_lanedir_consec_mean	0.3661290814583798
driven_lanedir_consec_min	0.09669195369676542
driven_lanedir_max	0.7817403201275721
driven_lanedir_mean	0.3661290814583798
driven_lanedir_median	0.21995497055080193
driven_lanedir_min	0.09669195369676542
get_state_dump_max	0.041345330079396565
get_state_dump_mean	0.041345330079396565
get_state_dump_median	0.041345330079396565
get_state_dump_min	0.041345330079396565
get_ui_image_max	0.0668957789738973
get_ui_image_mean	0.0668957789738973
get_ui_image_median	0.0668957789738973
get_ui_image_min	0.0668957789738973
in-drivable-lane_max	13.15000000000007
in-drivable-lane_mean	11.433333333333405
in-drivable-lane_min	8.80000000000006
per-episodes	details {"udem1-sc0-0-ego0": {"driven_any": 1.1493235522779297, "get_ui_image": 0.0668957789738973, "step_physics": 0.3541918961207072, "survival_time": 14.950000000000076, "driven_lanedir": 0.09669195369676542, "get_state_dump": 0.041345330079396565, "sim_render-ego0": 0.007064833641052246, "sim_render-ego1": 0.006170347531636556, "sim_render-ego2": 0.00602934996287028, "in-drivable-lane": 12.350000000000083, "deviation-heading": 1.6943358157912287, "agent_compute-ego0": 0.04371504545211792, "agent_compute-ego1": 0.04156718651453654, "agent_compute-ego2": 0.04133169094721476, "complete-iteration": 0.7496065314610799, "set_robot_commands": 0.005025492509206136, "deviation-center-line": 0.2452929165287098, "driven_lanedir_consec": 0.09669195369676542, "sim_compute_sim_state": 0.041753198305765786, "sim_compute_performance-ego0": 0.004543205102284749, "sim_compute_performance-ego1": 0.0041231966018676755, "sim_compute_performance-ego2": 0.003991844654083252, "sim_compute_robot_state-ego0": 0.010300684769948325, "sim_compute_robot_state-ego1": 0.006969484488169352, "sim_compute_robot_state-ego2": 0.0068249964714050294, "sim_compute_robot_state-parked0": 0.0067830642064412435, "sim_compute_robot_state-parked1": 0.007339870134989421, "sim_compute_robot_state-parked2": 0.007453414599100748, "sim_compute_robot_state-parked3": 0.008072158495585124, "sim_compute_robot_state-parked4": 0.008447584311167398, "sim_compute_robot_state-parked5": 0.008711277643839518}, "udem1-sc0-0-ego1": {"driven_any": 3.2007400329201285, "get_ui_image": 0.0668957789738973, "step_physics": 0.3541918961207072, "survival_time": 14.950000000000076, "driven_lanedir": 0.7817403201275721, "get_state_dump": 0.041345330079396565, "sim_render-ego0": 0.007064833641052246, "sim_render-ego1": 0.006170347531636556, "sim_render-ego2": 0.00602934996287028, "in-drivable-lane": 8.80000000000006, "deviation-heading": 4.999520746331471, "agent_compute-ego0": 0.04371504545211792, "agent_compute-ego1": 0.04156718651453654, "agent_compute-ego2": 0.04133169094721476, "complete-iteration": 0.7496065314610799, "set_robot_commands": 0.005025492509206136, "deviation-center-line": 0.49916640148966096, "driven_lanedir_consec": 0.7817403201275721, "sim_compute_sim_state": 0.041753198305765786, "sim_compute_performance-ego0": 0.004543205102284749, "sim_compute_performance-ego1": 0.0041231966018676755, "sim_compute_performance-ego2": 0.003991844654083252, "sim_compute_robot_state-ego0": 0.010300684769948325, "sim_compute_robot_state-ego1": 0.006969484488169352, "sim_compute_robot_state-ego2": 0.0068249964714050294, "sim_compute_robot_state-parked0": 0.0067830642064412435, "sim_compute_robot_state-parked1": 0.007339870134989421, "sim_compute_robot_state-parked2": 0.007453414599100748, "sim_compute_robot_state-parked3": 0.008072158495585124, "sim_compute_robot_state-parked4": 0.008447584311167398, "sim_compute_robot_state-parked5": 0.008711277643839518}, "udem1-sc0-0-ego2": {"driven_any": 3.2799824141437584, "get_ui_image": 0.0668957789738973, "step_physics": 0.3541918961207072, "survival_time": 14.950000000000076, "driven_lanedir": 0.21995497055080193, "get_state_dump": 0.041345330079396565, "sim_render-ego0": 0.007064833641052246, "sim_render-ego1": 0.006170347531636556, "sim_render-ego2": 0.00602934996287028, "in-drivable-lane": 13.15000000000007, "deviation-heading": 1.218109626144099, "agent_compute-ego0": 0.04371504545211792, "agent_compute-ego1": 0.04156718651453654, "agent_compute-ego2": 0.04133169094721476, "complete-iteration": 0.7496065314610799, "set_robot_commands": 0.005025492509206136, "deviation-center-line": 0.1460985275504696, "driven_lanedir_consec": 0.21995497055080193, "sim_compute_sim_state": 0.041753198305765786, "sim_compute_performance-ego0": 0.004543205102284749, "sim_compute_performance-ego1": 0.0041231966018676755, "sim_compute_performance-ego2": 0.003991844654083252, "sim_compute_robot_state-ego0": 0.010300684769948325, "sim_compute_robot_state-ego1": 0.006969484488169352, "sim_compute_robot_state-ego2": 0.0068249964714050294, "sim_compute_robot_state-parked0": 0.0067830642064412435, "sim_compute_robot_state-parked1": 0.007339870134989421, "sim_compute_robot_state-parked2": 0.007453414599100748, "sim_compute_robot_state-parked3": 0.008072158495585124, "sim_compute_robot_state-parked4": 0.008447584311167398, "sim_compute_robot_state-parked5": 0.008711277643839518}}
set_robot_commands_max	0.005025492509206136
set_robot_commands_mean	0.005025492509206136
set_robot_commands_median	0.005025492509206136
set_robot_commands_min	0.005025492509206136
sim_compute_performance-ego0_max	0.004543205102284749
sim_compute_performance-ego0_mean	0.004543205102284749
sim_compute_performance-ego0_median	0.004543205102284749
sim_compute_performance-ego0_min	0.004543205102284749
sim_compute_performance-ego1_max	0.0041231966018676755
sim_compute_performance-ego1_mean	0.0041231966018676755
sim_compute_performance-ego1_median	0.0041231966018676755
sim_compute_performance-ego1_min	0.0041231966018676755
sim_compute_performance-ego2_max	0.003991844654083252
sim_compute_performance-ego2_mean	0.003991844654083252
sim_compute_performance-ego2_median	0.003991844654083252
sim_compute_performance-ego2_min	0.003991844654083252
sim_compute_robot_state-ego0_max	0.010300684769948325
sim_compute_robot_state-ego0_mean	0.010300684769948325
sim_compute_robot_state-ego0_median	0.010300684769948325
sim_compute_robot_state-ego0_min	0.010300684769948325
sim_compute_robot_state-ego1_max	0.006969484488169352
sim_compute_robot_state-ego1_mean	0.006969484488169353
sim_compute_robot_state-ego1_median	0.006969484488169352
sim_compute_robot_state-ego1_min	0.006969484488169352
sim_compute_robot_state-ego2_max	0.0068249964714050294
sim_compute_robot_state-ego2_mean	0.0068249964714050294
sim_compute_robot_state-ego2_median	0.0068249964714050294
sim_compute_robot_state-ego2_min	0.0068249964714050294
sim_compute_robot_state-parked0_max	0.0067830642064412435
sim_compute_robot_state-parked0_mean	0.0067830642064412435
sim_compute_robot_state-parked0_median	0.0067830642064412435
sim_compute_robot_state-parked0_min	0.0067830642064412435
sim_compute_robot_state-parked1_max	0.007339870134989421
sim_compute_robot_state-parked1_mean	0.007339870134989421
sim_compute_robot_state-parked1_median	0.007339870134989421
sim_compute_robot_state-parked1_min	0.007339870134989421
sim_compute_robot_state-parked2_max	0.007453414599100748
sim_compute_robot_state-parked2_mean	0.007453414599100749
sim_compute_robot_state-parked2_median	0.007453414599100748
sim_compute_robot_state-parked2_min	0.007453414599100748
sim_compute_robot_state-parked3_max	0.008072158495585124
sim_compute_robot_state-parked3_mean	0.008072158495585124
sim_compute_robot_state-parked3_median	0.008072158495585124
sim_compute_robot_state-parked3_min	0.008072158495585124
sim_compute_robot_state-parked4_max	0.008447584311167398
sim_compute_robot_state-parked4_mean	0.008447584311167398
sim_compute_robot_state-parked4_median	0.008447584311167398
sim_compute_robot_state-parked4_min	0.008447584311167398
sim_compute_robot_state-parked5_max	0.008711277643839518
sim_compute_robot_state-parked5_mean	0.008711277643839518
sim_compute_robot_state-parked5_median	0.008711277643839518
sim_compute_robot_state-parked5_min	0.008711277643839518
sim_compute_sim_state_max	0.041753198305765786
sim_compute_sim_state_mean	0.041753198305765786
sim_compute_sim_state_median	0.041753198305765786
sim_compute_sim_state_min	0.041753198305765786
sim_render-ego0_max	0.007064833641052246
sim_render-ego0_mean	0.007064833641052246
sim_render-ego0_median	0.007064833641052246
sim_render-ego0_min	0.007064833641052246
sim_render-ego1_max	0.006170347531636556
sim_render-ego1_mean	0.0061703475316365565
sim_render-ego1_median	0.006170347531636556
sim_render-ego1_min	0.006170347531636556
sim_render-ego2_max	0.00602934996287028
sim_render-ego2_mean	0.00602934996287028
sim_render-ego2_median	0.00602934996287028
sim_render-ego2_min	0.00602934996287028
simulation-passed	1
step_physics_max	0.3541918961207072
step_physics_mean	0.3541918961207072
step_physics_median	0.3541918961207072
step_physics_min	0.3541918961207072
survival_time_max	14.950000000000076
survival_time_mean	14.95000000000008
survival_time_min	14.950000000000076

No reset possible

36166

9950

Bea Baselines 🐤

template-random

LFv-sim

success

aido5-LFVI-sim-validation

2020-11-02 01:25:57+00:00

2020-11-02 01:29:58+00:00

0:04:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.644037326580434
survival_time_median	4.7749999999999915
deviation-center-line_median	0.10361109150784235
in-drivable-lane_median	2.4999999999999916

other stats

agent_compute-ego_max	0.020698026374534325
agent_compute-ego_mean	0.019986343972250145
agent_compute-ego_median	0.019989641801357025
agent_compute-ego_min	0.01926806591175221
complete-iteration_max	0.20828044775760535
complete-iteration_mean	0.2008715920168563
complete-iteration_median	0.19857000180631784
complete-iteration_min	0.19806591669718424
deviation-center-line_max	0.16903725139344317
deviation-center-line_mean	0.11205170891507578
deviation-center-line_min	0.07194740125117521
deviation-heading_max	1.0591787743887835
deviation-heading_mean	0.5173698010971932
deviation-heading_median	0.3699448057537461
deviation-heading_min	0.27041081849249704
driven_any_max	2.8947982051486587
driven_any_mean	1.8407029710701357
driven_any_median	1.9986666350865232
driven_any_min	0.470680408958837
driven_lanedir_consec_max	0.9173215489126276
driven_lanedir_consec_mean	0.6302220642381553
driven_lanedir_consec_min	0.31549205487912557
driven_lanedir_max	0.9173215489126276
driven_lanedir_mean	0.6302220642381553
driven_lanedir_median	0.644037326580434
driven_lanedir_min	0.31549205487912557
get_state_dump_max	0.01501664790240201
get_state_dump_mean	0.01472409213319908
get_state_dump_median	0.014868904791459
get_state_dump_min	0.01414191104747631
get_ui_image_max	0.03523151256419994
get_ui_image_mean	0.03390174104964931
get_ui_image_median	0.0336898974749022
get_ui_image_min	0.032995656684592915
in-drivable-lane_max	4.699999999999983
in-drivable-lane_mean	2.4999999999999916
in-drivable-lane_min	0.30000000000000027
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.16193217979593, "get_ui_image": 0.0337006762876349, "step_physics": 0.08428389743223029, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6085881804686812, "get_state_dump": 0.014791949320647675, "sim_render-ego": 0.0063832089052361955, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.01975893166105626, "deviation-heading": 0.27041081849249704, "complete-iteration": 0.19879314859034652, "set_robot_commands": 0.004723128625902079, "deviation-center-line": 0.1246386243322534, "driven_lanedir_consec": 0.6085881804686812, "sim_compute_sim_state": 0.01577820212154065, "sim_compute_performance-ego": 0.004230382078785008, "sim_compute_robot_state-ego": 0.007545531806299242, "sim_compute_robot_state-parked0": 0.007434780314817267}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.470680408958837, "get_ui_image": 0.032995656684592915, "step_physics": 0.08089835555465133, "survival_time": 1.3500000000000003, "driven_lanedir": 0.31549205487912557, "get_state_dump": 0.014945860262270329, "sim_render-ego": 0.006716560434412073, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.020698026374534325, "deviation-heading": 0.3286388301882016, "complete-iteration": 0.19806591669718424, "set_robot_commands": 0.0047382425378870085, "deviation-center-line": 0.07194740125117521, "driven_lanedir_consec": 0.31549205487912557, "sim_compute_sim_state": 0.014974894347014251, "sim_compute_performance-ego": 0.004356852284184209, "sim_compute_robot_state-ego": 0.00925551520453559, "sim_compute_robot_state-parked0": 0.008331210524947555}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.835401090377117, "get_ui_image": 0.03523151256419994, "step_physics": 0.08362545613889341, "survival_time": 6.749999999999984, "driven_lanedir": 0.6794864726921869, "get_state_dump": 0.01414191104747631, "sim_render-ego": 0.006461692739416052, "in-drivable-lane": 4.699999999999983, "agent_compute-ego": 0.01926806591175221, "deviation-heading": 0.41125078131929055, "complete-iteration": 0.19834685502228913, "set_robot_commands": 0.004861512007536712, "deviation-center-line": 0.08258355868343131, "driven_lanedir_consec": 0.6794864726921869, "sim_compute_sim_state": 0.013760404233579285, "sim_compute_performance-ego": 0.004301701651679145, "sim_compute_robot_state-ego": 0.008628578539247866, "sim_compute_robot_state-parked0": 0.007906417493466978}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8947982051486587, "get_ui_image": 0.03367911866216949, "step_physics": 0.08841102773492987, "survival_time": 6.5999999999999845, "driven_lanedir": 0.9173215489126276, "get_state_dump": 0.01501664790240201, "sim_render-ego": 0.006948530673980713, "in-drivable-lane": 3.7999999999999865, "agent_compute-ego": 0.020220351941657787, "deviation-heading": 1.0591787743887835, "complete-iteration": 0.20828044775760535, "set_robot_commands": 0.005248897003405022, "deviation-center-line": 0.16903725139344317, "driven_lanedir_consec": 0.9173215489126276, "sim_compute_sim_state": 0.017383291865840103, "sim_compute_performance-ego": 0.004635272604046446, "sim_compute_robot_state-ego": 0.008475959300994873, "sim_compute_robot_state-parked0": 0.008093777931097782}}
set_robot_commands_max	0.005248897003405022
set_robot_commands_mean	0.004892945043682705
set_robot_commands_median	0.00479987727271186
set_robot_commands_min	0.004723128625902079
sim_compute_performance-ego_max	0.004635272604046446
sim_compute_performance-ego_mean	0.0043810521546737025
sim_compute_performance-ego_median	0.0043292769679316775
sim_compute_performance-ego_min	0.004230382078785008
sim_compute_robot_state-ego_max	0.00925551520453559
sim_compute_robot_state-ego_mean	0.008476396212769393
sim_compute_robot_state-ego_median	0.00855226892012137
sim_compute_robot_state-ego_min	0.007545531806299242
sim_compute_robot_state-parked0_max	0.008331210524947555
sim_compute_robot_state-parked0_mean	0.007941546566082395
sim_compute_robot_state-parked0_median	0.00800009771228238
sim_compute_robot_state-parked0_min	0.007434780314817267
sim_compute_sim_state_max	0.017383291865840103
sim_compute_sim_state_mean	0.015474198141993571
sim_compute_sim_state_median	0.015376548234277452
sim_compute_sim_state_min	0.013760404233579285
sim_render-ego_max	0.006948530673980713
sim_render-ego_mean	0.006627498188261258
sim_render-ego_median	0.006589126586914062
sim_render-ego_min	0.0063832089052361955
simulation-passed	1
step_physics_max	0.08841102773492987
step_physics_mean	0.08430468421517623
step_physics_median	0.08395467678556184
step_physics_min	0.08089835555465133
survival_time_max	6.749999999999984
survival_time_mean	4.412499999999992
survival_time_min	1.3500000000000003

No reset possible

36163

9955

Bea Baselines 🐤

template-random

LFVIv-sim

success

2020-11-02 01:23:46+00:00

2020-11-02 01:25:49+00:00

0:02:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6419379600343871
survival_time_median	3.999999999999994
deviation-center-line_median	0.1440401596261301
in-drivable-lane_median	1.8999999999999932

other stats

agent_compute-ego_max	0.030259352922439576
agent_compute-ego_mean	0.030259352922439576
agent_compute-ego_median	0.030259352922439576
agent_compute-ego_min	0.030259352922439576
complete-iteration_max	0.3387933820486069
complete-iteration_mean	0.3387933820486069
complete-iteration_median	0.3387933820486069
complete-iteration_min	0.3387933820486069
deviation-center-line_max	0.1440401596261301
deviation-center-line_mean	0.1440401596261301
deviation-center-line_min	0.1440401596261301
deviation-heading_max	0.7649721039644373
deviation-heading_mean	0.7649721039644373
deviation-heading_median	0.7649721039644373
deviation-heading_min	0.7649721039644373
driven_any_max	1.65406851544617
driven_any_mean	1.65406851544617
driven_any_median	1.65406851544617
driven_any_min	1.65406851544617
driven_lanedir_consec_max	0.6419379600343871
driven_lanedir_consec_mean	0.6419379600343871
driven_lanedir_consec_min	0.6419379600343871
driven_lanedir_max	0.6467016616800385
driven_lanedir_mean	0.6467016616800385
driven_lanedir_median	0.6467016616800385
driven_lanedir_min	0.6467016616800385
get_state_dump_max	0.030717626214027405
get_state_dump_mean	0.030717626214027405
get_state_dump_median	0.030717626214027405
get_state_dump_min	0.030717626214027405
get_ui_image_max	0.05532799065113068
get_ui_image_mean	0.05532799065113068
get_ui_image_median	0.05532799065113068
get_ui_image_min	0.05532799065113068
in-drivable-lane_max	1.8999999999999932
in-drivable-lane_mean	1.8999999999999932
in-drivable-lane_min	1.8999999999999932
per-episodes	details {"udem1-sc0-0-ego": {"driven_any": 1.65406851544617, "get_ui_image": 0.05532799065113068, "step_physics": 0.14033100605010987, "survival_time": 3.999999999999994, "driven_lanedir": 0.6467016616800385, "get_state_dump": 0.030717626214027405, "sim_render-ego": 0.0069928765296936035, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.030259352922439576, "deviation-heading": 0.7649721039644373, "complete-iteration": 0.3387933820486069, "set_robot_commands": 0.005229726433753967, "deviation-center-line": 0.1440401596261301, "driven_lanedir_consec": 0.6419379600343871, "sim_compute_sim_state": 0.015462857484817506, "sim_compute_performance-ego": 0.004471105337142944, "sim_compute_robot_state-ego": 0.008734428882598877, "sim_compute_robot_state-npc0": 0.008178019523620605, "sim_compute_robot_state-npc1": 0.008056712150573731, "sim_compute_robot_state-npc2": 0.008130314946174621, "sim_compute_robot_state-npc3": 0.008401483297348022, "sim_compute_robot_state-parked0": 0.008281797170639038}}
set_robot_commands_max	0.005229726433753967
set_robot_commands_mean	0.005229726433753967
set_robot_commands_median	0.005229726433753967
set_robot_commands_min	0.005229726433753967
sim_compute_performance-ego_max	0.004471105337142944
sim_compute_performance-ego_mean	0.004471105337142944
sim_compute_performance-ego_median	0.004471105337142944
sim_compute_performance-ego_min	0.004471105337142944
sim_compute_robot_state-ego_max	0.008734428882598877
sim_compute_robot_state-ego_mean	0.008734428882598877
sim_compute_robot_state-ego_median	0.008734428882598877
sim_compute_robot_state-ego_min	0.008734428882598877
sim_compute_robot_state-npc0_max	0.008178019523620605
sim_compute_robot_state-npc0_mean	0.008178019523620605
sim_compute_robot_state-npc0_median	0.008178019523620605
sim_compute_robot_state-npc0_min	0.008178019523620605
sim_compute_robot_state-npc1_max	0.008056712150573731
sim_compute_robot_state-npc1_mean	0.008056712150573731
sim_compute_robot_state-npc1_median	0.008056712150573731
sim_compute_robot_state-npc1_min	0.008056712150573731
sim_compute_robot_state-npc2_max	0.008130314946174621
sim_compute_robot_state-npc2_mean	0.008130314946174621
sim_compute_robot_state-npc2_median	0.008130314946174621
sim_compute_robot_state-npc2_min	0.008130314946174621
sim_compute_robot_state-npc3_max	0.008401483297348022
sim_compute_robot_state-npc3_mean	0.008401483297348022
sim_compute_robot_state-npc3_median	0.008401483297348022
sim_compute_robot_state-npc3_min	0.008401483297348022
sim_compute_robot_state-parked0_max	0.008281797170639038
sim_compute_robot_state-parked0_mean	0.008281797170639038
sim_compute_robot_state-parked0_median	0.008281797170639038
sim_compute_robot_state-parked0_min	0.008281797170639038
sim_compute_sim_state_max	0.015462857484817506
sim_compute_sim_state_mean	0.015462857484817506
sim_compute_sim_state_median	0.015462857484817506
sim_compute_sim_state_min	0.015462857484817506
sim_render-ego_max	0.0069928765296936035
sim_render-ego_mean	0.0069928765296936035
sim_render-ego_median	0.0069928765296936035
sim_render-ego_min	0.0069928765296936035
simulation-passed	1
step_physics_max	0.14033100605010987
step_physics_mean	0.14033100605010987
step_physics_median	0.14033100605010987
step_physics_min	0.14033100605010987
survival_time_max	3.999999999999994
survival_time_mean	3.999999999999994
survival_time_min	3.999999999999994

No reset possible

36151

9962

Bea Baselines 🐤

template-ros

aido5-LFV-sim-testing

LFVv-sim

success

aido5-LFVI_multi-sim-validation

2020-11-02 01:00:18+00:00

2020-11-02 01:23:23+00:00

0:23:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.753877662411756
survival_time_median	6.0499999999999865
deviation-center-line_median	0.19930787474219055
in-drivable-lane_median	2.749999999999992

other stats

agent_compute-ego_max	0.031209303273095023
agent_compute-ego_mean	0.029771661927342825
agent_compute-ego_median	0.029855689355882547
agent_compute-ego_min	0.028110265731811523
complete-iteration_max	0.364027480284373
complete-iteration_mean	0.32792558832895874
complete-iteration_median	0.32344147284253894
complete-iteration_min	0.2988769297014203
deviation-center-line_max	0.5897518909152781
deviation-center-line_mean	0.23056997312724611
deviation-center-line_min	0.07892968630840232
deviation-heading_max	2.3372711902288232
deviation-heading_mean	0.9414086574282644
deviation-heading_median	0.7815173196374596
deviation-heading_min	0.33133350226720304
driven_any_max	4.3121590324197365
driven_any_mean	1.9010899857311137
driven_any_median	1.6787579231589926
driven_any_min	0.39899555763732375
driven_lanedir_consec_max	1.996712793544888
driven_lanedir_consec_mean	0.7756158086214759
driven_lanedir_consec_min	0.18371000849455552
driven_lanedir_max	1.996712793544888
driven_lanedir_mean	0.7756158086214759
driven_lanedir_median	0.753877662411756
driven_lanedir_min	0.18371000849455552
get_state_dump_max	0.03225398725933499
get_state_dump_mean	0.030943108513792592
get_state_dump_median	0.031128595124429732
get_state_dump_min	0.028898854409494707
get_ui_image_max	0.05313849449157715
get_ui_image_mean	0.05000082204378339
get_ui_image_median	0.05000476260761638
get_ui_image_min	0.047645782169542815
in-drivable-lane_max	10.550000000000066
in-drivable-lane_mean	3.4900000000000033
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.8903069192735136, "get_ui_image": 0.04775738219420115, "step_physics": 0.12630893621179792, "survival_time": 7.199999999999982, "driven_lanedir": 0.8056848992014513, "get_state_dump": 0.03225398725933499, "sim_render-ego": 0.007084053423669603, "in-drivable-lane": 3.099999999999989, "agent_compute-ego": 0.030052211549546983, "deviation-heading": 1.5975732981404454, "complete-iteration": 0.3241303314765294, "set_robot_commands": 0.005785695380634732, "deviation-center-line": 0.3472408365892611, "driven_lanedir_consec": 0.8056848992014513, "sim_compute_sim_state": 0.0183526873588562, "sim_compute_performance-ego": 0.004551140798462762, "sim_compute_robot_state-ego": 0.009726120365990533, "sim_compute_robot_state-npc0": 0.008207811249627007, "sim_compute_robot_state-npc1": 0.008267324831750657, "sim_compute_robot_state-npc2": 0.008231265677346123, "sim_compute_robot_state-npc3": 0.008533711234728495, "sim_compute_robot_state-parked0": 0.008785054087638855}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.011424936861067, "get_ui_image": 0.04845812071615191, "step_physics": 0.14969387161197947, "survival_time": 6.699999999999984, "driven_lanedir": 1.996712793544888, "get_state_dump": 0.031128595124429732, "sim_render-ego": 0.006546475994053172, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02968868568762025, "deviation-heading": 0.5615112620800198, "complete-iteration": 0.3366448985996531, "set_robot_commands": 0.004964072312881697, "deviation-center-line": 0.5897518909152781, "driven_lanedir_consec": 1.996712793544888, "sim_compute_sim_state": 0.01640556641479037, "sim_compute_performance-ego": 0.004444253978444569, "sim_compute_robot_state-ego": 0.00767305893684501, "sim_compute_robot_state-npc0": 0.007735154521999074, "sim_compute_robot_state-npc1": 0.007161595928135203, "sim_compute_robot_state-npc2": 0.007309406550962533, "sim_compute_robot_state-npc3": 0.007613158937710435, "sim_compute_robot_state-parked0": 0.007595515962856919}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.3121590324197365, "get_ui_image": 0.050296502194162145, "step_physics": 0.11848681902481338, "survival_time": 14.750000000000076, "driven_lanedir": 1.323494486785833, "get_state_dump": 0.03095499701419119, "sim_render-ego": 0.00711794950194278, "in-drivable-lane": 9.40000000000006, "agent_compute-ego": 0.029855689355882547, "deviation-heading": 2.3372711902288232, "complete-iteration": 0.3187931561874131, "set_robot_commands": 0.005592555514836716, "deviation-center-line": 0.4371707048013203, "driven_lanedir_consec": 1.323494486785833, "sim_compute_sim_state": 0.01923736232822224, "sim_compute_performance-ego": 0.004512652704271219, "sim_compute_robot_state-ego": 0.009390923936488264, "sim_compute_robot_state-npc0": 0.008448328406123792, "sim_compute_robot_state-npc1": 0.008493876053115069, "sim_compute_robot_state-npc2": 0.008611408330626407, "sim_compute_robot_state-npc3": 0.008784445261551163, "sim_compute_robot_state-parked0": 0.008774063142679506}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.553122905166779, "get_ui_image": 0.05048199366497737, "step_physics": 0.1431083115198279, "survival_time": 9.299999999999995, "driven_lanedir": 0.753877662411756, "get_state_dump": 0.029898694766465055, "sim_render-ego": 0.006775303553509456, "in-drivable-lane": 6.049999999999984, "agent_compute-ego": 0.030043732735418504, "deviation-heading": 1.3222462208767165, "complete-iteration": 0.33641162482641074, "set_robot_commands": 0.005603923592516171, "deviation-center-line": 0.23452251665127052, "driven_lanedir_consec": 0.753877662411756, "sim_compute_sim_state": 0.01627017092961137, "sim_compute_performance-ego": 0.004376593456473401, "sim_compute_robot_state-ego": 0.00866906617277412, "sim_compute_robot_state-npc0": 0.00805733537161222, "sim_compute_robot_state-npc1": 0.008030883727535125, "sim_compute_robot_state-npc2": 0.008409401421905846, "sim_compute_robot_state-npc3": 0.008304328046819215, "sim_compute_robot_state-parked0": 0.008146733366033082}, "ETHZ_autolab_technical_track-sc4-0-ego": {"driven_any": 4.111584469161227, "get_ui_image": 0.05178892955505591, "step_physics": 0.12869491680062933, "survival_time": 13.900000000000064, "driven_lanedir": 0.8060206108797701, "get_state_dump": 0.030185413875168175, "sim_render-ego": 0.006879538940868789, "in-drivable-lane": 10.550000000000066, "agent_compute-ego": 0.029734988864377247, "deviation-heading": 1.1019767417247763, "complete-iteration": 0.32344147284253894, "set_robot_commands": 0.005507562657912001, "deviation-center-line": 0.34813576797931617, "driven_lanedir_consec": 0.8060206108797701, "sim_compute_sim_state": 0.014655851631713427, "sim_compute_performance-ego": 0.004502899355167966, "sim_compute_robot_state-ego": 0.009111262053894485, "sim_compute_robot_state-npc0": 0.00833146863704105, "sim_compute_robot_state-npc1": 0.00840433209920101, "sim_compute_robot_state-npc2": 0.008435682427111289, "sim_compute_robot_state-npc3": 0.008428525581634302, "sim_compute_robot_state-parked0": 0.008550093328352455}, "ETHZ_autolab_technical_track-sc5-0-ego": {"driven_any": 1.2768678260789623, "get_ui_image": 0.05000476260761638, "step_physics": 0.14280235898363722, "survival_time": 4.549999999999992, "driven_lanedir": 1.1562044865956336, "get_state_dump": 0.03162628477746314, "sim_render-ego": 0.007136748387263372, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.030079066098391356, "deviation-heading": 0.7815173196374596, "complete-iteration": 0.34418072543301426, "set_robot_commands": 0.006028681010990352, "deviation-center-line": 0.15386283870112313, "driven_lanedir_consec": 1.1562044865956336, "sim_compute_sim_state": 0.01797162307487739, "sim_compute_performance-ego": 0.004666928406600114, "sim_compute_robot_state-ego": 0.010077361222151872, "sim_compute_robot_state-npc0": 0.008649042674473353, "sim_compute_robot_state-npc1": 0.008568648453597184, "sim_compute_robot_state-npc2": 0.008627619062151228, "sim_compute_robot_state-npc3": 0.008858146248282968, "sim_compute_robot_state-parked0": 0.008840057876083877}, "ETHZ_autolab_technical_track-sc6-0-ego": {"driven_any": 2.2751211021063904, "get_ui_image": 0.04839261121387723, "step_physics": 0.12163113793240318, "survival_time": 7.89999999999998, "driven_lanedir": 0.6221249667426814, "get_state_dump": 0.031678133373019064, "sim_render-ego": 0.006924161428137671, "in-drivable-lane": 5.399999999999981, "agent_compute-ego": 0.029937557027309755, "deviation-heading": 0.46886179397005673, "complete-iteration": 0.3226690594154068, "set_robot_commands": 0.005757274506967279, "deviation-center-line": 0.1130726546413123, "driven_lanedir_consec": 0.6221249667426814, "sim_compute_sim_state": 0.021533196485495263, "sim_compute_performance-ego": 0.004495886307728442, "sim_compute_robot_state-ego": 0.009450336045856718, "sim_compute_robot_state-npc0": 0.008458375930786133, "sim_compute_robot_state-npc1": 0.00850985020021849, "sim_compute_robot_state-npc2": 0.008419676672054243, "sim_compute_robot_state-npc3": 0.00844608832009231, "sim_compute_robot_state-parked0": 0.00880511501167394}, "ETHZ_autolab_technical_track-sc7-0-ego": {"driven_any": 0.4290291091053353, "get_ui_image": 0.05313849449157715, "step_physics": 0.17140826914045543, "survival_time": 1.800000000000001, "driven_lanedir": 0.2928520350538273, "get_state_dump": 0.03216622273127238, "sim_render-ego": 0.006695164574517144, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.031209303273095023, "deviation-heading": 0.3725649633946418, "complete-iteration": 0.364027480284373, "set_robot_commands": 0.005036301083034939, "deviation-center-line": 0.15853717897671343, "driven_lanedir_consec": 0.2928520350538273, "sim_compute_sim_state": 0.014236847559611002, "sim_compute_performance-ego": 0.00457714663611518, "sim_compute_robot_state-ego": 0.00791217221154107, "sim_compute_robot_state-npc0": 0.00735722647772895, "sim_compute_robot_state-npc1": 0.007342861758338081, "sim_compute_robot_state-npc2": 0.007166577710045708, "sim_compute_robot_state-npc3": 0.008134179645114474, "sim_compute_robot_state-parked0": 0.0074126455518934466}, "ETHZ_autolab_technical_track-sc8-0-ego": {"driven_any": 1.2711337592549683, "get_ui_image": 0.048888489257457646, "step_physics": 0.1219999873360922, "survival_time": 4.299999999999993, "driven_lanedir": 0.18371000849455552, "get_state_dump": 0.030808249185251636, "sim_render-ego": 0.006827301757280217, "in-drivable-lane": 3.2999999999999927, "agent_compute-ego": 0.030531057091646416, "deviation-heading": 0.33133350226720304, "complete-iteration": 0.31552079389261645, "set_robot_commands": 0.005163167798241904, "deviation-center-line": 0.09098055370008476, "driven_lanedir_consec": 0.18371000849455552, "sim_compute_sim_state": 0.019553633623344953, "sim_compute_performance-ego": 0.0044060252433599425, "sim_compute_robot_state-ego": 0.008261217627414438, "sim_compute_robot_state-npc0": 0.007635756980541141, "sim_compute_robot_state-npc1": 0.007843308670576228, "sim_compute_robot_state-npc2": 0.007685802703679994, "sim_compute_robot_state-npc3": 0.007946455201437308, "sim_compute_robot_state-parked0": 0.007751392763714457}, "ETHZ_autolab_technical_track-sc9-0-ego": {"driven_any": 1.6511506056638323, "get_ui_image": 0.04860568913546476, "step_physics": 0.12287800745530562, "survival_time": 5.4999999999999885, "driven_lanedir": 1.2611459072240176, "get_state_dump": 0.03138745047829368, "sim_render-ego": 0.006857434186068448, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.030222008445046165, "deviation-heading": 0.7960292476563325, "complete-iteration": 0.3160799698396163, "set_robot_commands": 0.005813243172385476, "deviation-center-line": 0.2723982585847055, "driven_lanedir_consec": 1.2611459072240176, "sim_compute_sim_state": 0.015559317848899148, "sim_compute_performance-ego": 0.0043401934883811255, "sim_compute_robot_state-ego": 0.0087786696173928, "sim_compute_robot_state-npc0": 0.0082402381029996, "sim_compute_robot_state-npc1": 0.008050459081476386, "sim_compute_robot_state-npc2": 0.008120892264626242, "sim_compute_robot_state-npc3": 0.008363806117664683, "sim_compute_robot_state-parked0": 0.008637694879011674}, "ETHZ_autolab_technical_track-sc10-0-ego": {"driven_any": 1.0736478598598795, "get_ui_image": 0.04959021387873469, "step_physics": 0.12253027993279536, "survival_time": 3.699999999999995, "driven_lanedir": 0.6249975414974891, "get_state_dump": 0.0315349327551352, "sim_render-ego": 0.007124736502363875, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.029671598125148465, "deviation-heading": 0.5568234504393137, "complete-iteration": 0.31903078104998617, "set_robot_commands": 0.00624228168178249, "deviation-center-line": 0.10992034606398228, "driven_lanedir_consec": 0.6249975414974891, "sim_compute_sim_state": 0.014385471472869048, "sim_compute_performance-ego": 0.004387832976676323, "sim_compute_robot_state-ego": 0.01024432117874558, "sim_compute_robot_state-npc0": 0.008520229442699536, "sim_compute_robot_state-npc1": 0.008445810627292943, "sim_compute_robot_state-npc2": 0.00839467950769373, "sim_compute_robot_state-npc3": 0.008623915749627191, "sim_compute_robot_state-parked0": 0.009115992365656671}, "ETHZ_autolab_technical_track-sc11-0-ego": {"driven_any": 0.7388778080155927, "get_ui_image": 0.047645782169542815, "step_physics": 0.112165886059142, "survival_time": 2.849999999999998, "driven_lanedir": 0.2953839802094318, "get_state_dump": 0.03165671699925473, "sim_render-ego": 0.006373622961211623, "in-drivable-lane": 1.2999999999999972, "agent_compute-ego": 0.02909071403637267, "deviation-heading": 0.3878109607374531, "complete-iteration": 0.2988769297014203, "set_robot_commands": 0.004647497545208847, "deviation-center-line": 0.07892968630840232, "driven_lanedir_consec": 0.2953839802094318, "sim_compute_sim_state": 0.019229575207358914, "sim_compute_performance-ego": 0.004191285685489052, "sim_compute_robot_state-ego": 0.00728339061402438, "sim_compute_robot_state-npc0": 0.007377666339539645, "sim_compute_robot_state-npc1": 0.007043231997573585, "sim_compute_robot_state-npc2": 0.007036301127651282, "sim_compute_robot_state-npc3": 0.007320232558668705, "sim_compute_robot_state-parked0": 0.007588704427083333}, "ETHZ_autolab_technical_track-sc12-0-ego": {"driven_any": 2.844169972203104, "get_ui_image": 0.05107728517972506, "step_physics": 0.1471449289566431, "survival_time": 9.750000000000004, "driven_lanedir": 0.47071018668261777, "get_state_dump": 0.03056341929313464, "sim_render-ego": 0.0068198424119215745, "in-drivable-lane": 7.2000000000000055, "agent_compute-ego": 0.029370907025459487, "deviation-heading": 1.593150441691558, "complete-iteration": 0.3445271492004395, "set_robot_commands": 0.0055538629874204975, "deviation-center-line": 0.19930787474219055, "driven_lanedir_consec": 0.47071018668261777, "sim_compute_sim_state": 0.01842016073373648, "sim_compute_performance-ego": 0.0045491218566894535, "sim_compute_robot_state-ego": 0.009068039136055188, "sim_compute_robot_state-npc0": 0.007952122810559395, "sim_compute_robot_state-npc1": 0.008349018830519457, "sim_compute_robot_state-npc2": 0.008377465223654722, "sim_compute_robot_state-npc3": 0.008577313789954553, "sim_compute_robot_state-parked0": 0.0084776425972963}, "ETHZ_autolab_technical_track-sc13-0-ego": {"driven_any": 0.39899555763732375, "get_ui_image": 0.051757012644121726, "step_physics": 0.15112556949738534, "survival_time": 1.5500000000000007, "driven_lanedir": 0.284420350416136, "get_state_dump": 0.028898854409494707, "sim_render-ego": 0.006433825339040448, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.028110265731811523, "deviation-heading": 0.4661985925710566, "complete-iteration": 0.3320292119056948, "set_robot_commands": 0.004655853394539126, "deviation-center-line": 0.08110851177240416, "driven_lanedir_consec": 0.284420350416136, "sim_compute_sim_state": 0.01336713760129867, "sim_compute_performance-ego": 0.0040576227249637725, "sim_compute_robot_state-ego": 0.0067212581634521484, "sim_compute_robot_state-npc0": 0.0075811416872086064, "sim_compute_robot_state-npc1": 0.007149557913503339, "sim_compute_robot_state-npc2": 0.007173438226023028, "sim_compute_robot_state-npc3": 0.007361811976278981, "sim_compute_robot_state-parked0": 0.007411818350515058}, "ETHZ_autolab_technical_track-sc14-0-ego": {"driven_any": 1.6787579231589926, "get_ui_image": 0.05212906175408481, "step_physics": 0.1257079967782517, "survival_time": 6.0499999999999865, "driven_lanedir": 0.75689721358205, "get_state_dump": 0.029404675664980548, "sim_render-ego": 0.006674870971805793, "in-drivable-lane": 2.749999999999992, "agent_compute-ego": 0.028977143863015923, "deviation-heading": 1.4462608760081117, "complete-iteration": 0.3225202402792686, "set_robot_commands": 0.0053555945719569184, "deviation-center-line": 0.24360997648132757, "driven_lanedir_consec": 0.75689721358205, "sim_compute_sim_state": 0.019785392382913384, "sim_compute_performance-ego": 0.004432650637035527, "sim_compute_robot_state-ego": 0.008818598818187872, "sim_compute_robot_state-npc0": 0.00808716214392796, "sim_compute_robot_state-npc1": 0.008038116880684844, "sim_compute_robot_state-npc2": 0.008362511957972503, "sim_compute_robot_state-npc3": 0.008210871830459468, "sim_compute_robot_state-parked0": 0.008307405739776359}}
set_robot_commands_max	0.00624228168178249
set_robot_commands_mean	0.005447171147420609
set_robot_commands_median	0.0055538629874204975
set_robot_commands_min	0.004647497545208847
sim_compute_performance-ego_max	0.004666928406600114
sim_compute_performance-ego_mean	0.0044328156170572565
sim_compute_performance-ego_median	0.004444253978444569
sim_compute_performance-ego_min	0.0040576227249637725
sim_compute_robot_state-ego_max	0.01024432117874558
sim_compute_robot_state-ego_mean	0.008745719740054296
sim_compute_robot_state-ego_median	0.008818598818187872
sim_compute_robot_state-ego_min	0.0067212581634521484
sim_compute_robot_state-npc0_max	0.008649042674473353
sim_compute_robot_state-npc0_mean	0.008042604051791165
sim_compute_robot_state-npc0_median	0.00808716214392796
sim_compute_robot_state-npc0_min	0.00735722647772895
sim_compute_robot_state-npc1_max	0.008568648453597184
sim_compute_robot_state-npc1_mean	0.007979925136901175
sim_compute_robot_state-npc1_median	0.008050459081476386
sim_compute_robot_state-npc1_min	0.007043231997573585
sim_compute_robot_state-npc2_max	0.008627619062151228
sim_compute_robot_state-npc2_mean	0.008024141924233659
sim_compute_robot_state-npc2_median	0.008362511957972503
sim_compute_robot_state-npc2_min	0.007036301127651282
sim_compute_robot_state-npc3_max	0.008858146248282968
sim_compute_robot_state-npc3_mean	0.008233799366668283
sim_compute_robot_state-npc3_median	0.008363806117664683
sim_compute_robot_state-npc3_min	0.007320232558668705
sim_compute_robot_state-parked0_max	0.009115992365656671
sim_compute_robot_state-parked0_mean	0.008279995296684396
sim_compute_robot_state-parked0_median	0.0084776425972963
sim_compute_robot_state-parked0_min	0.007411818350515058
sim_compute_sim_state_max	0.021533196485495263
sim_compute_sim_state_mean	0.01726426631023986
sim_compute_sim_state_median	0.01797162307487739
sim_compute_sim_state_min	0.01336713760129867
sim_render-ego_max	0.007136748387263372
sim_render-ego_mean	0.0068180686622435985
sim_render-ego_median	0.006827301757280217
sim_render-ego_min	0.006373622961211623
simulation-passed	1
step_physics_max	0.17140826914045543
step_physics_mean	0.1337124851494106
step_physics_median	0.12630893621179792
step_physics_min	0.112165886059142
survival_time_max	14.750000000000076
survival_time_mean	6.653333333333335
survival_time_min	1.5500000000000007

No reset possible

36145

9966

Bea Baselines 🐤

template-ros

LFVIv-sim

success

2020-11-02 00:56:33+00:00

2020-11-02 00:59:55+00:00

0:03:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4096808148795912
survival_time_median	1.6500000000000008
deviation-center-line_median	0.05714392017121866
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.03754930062727495
agent_compute-ego0_mean	0.03754930062727495
agent_compute-ego0_median	0.03754930062727495
agent_compute-ego0_min	0.03754930062727495
agent_compute-ego1_max	0.04024741866371848
agent_compute-ego1_mean	0.04024741866371848
agent_compute-ego1_median	0.04024741866371848
agent_compute-ego1_min	0.04024741866371848
agent_compute-ego2_max	0.03945943803498239
agent_compute-ego2_mean	0.03945943803498239
agent_compute-ego2_median	0.03945943803498239
agent_compute-ego2_min	0.03945943803498239
complete-iteration_max	0.8616177818991921
complete-iteration_mean	0.861617781899192
complete-iteration_median	0.8616177818991921
complete-iteration_min	0.8616177818991921
deviation-center-line_max	0.11830584980811933
deviation-center-line_mean	0.07223690546188065
deviation-center-line_min	0.04126094640630395
deviation-heading_max	0.41126873335593017
deviation-heading_mean	0.2823792660486013
deviation-heading_median	0.25915269635125365
deviation-heading_min	0.1767163684386201
driven_any_max	0.4643642449154331
driven_any_mean	0.41170652670962826
driven_any_median	0.4169016477053597
driven_any_min	0.35385368750809204
driven_lanedir_consec_max	0.4576442700393142
driven_lanedir_consec_mean	0.40345653993603775
driven_lanedir_consec_min	0.34304453488920794
driven_lanedir_max	0.4576442700393142
driven_lanedir_mean	0.40345653993603775
driven_lanedir_median	0.4096808148795912
driven_lanedir_min	0.34304453488920794
get_state_dump_max	0.039033752499204696
get_state_dump_mean	0.039033752499204696
get_state_dump_median	0.039033752499204696
get_state_dump_min	0.039033752499204696
get_ui_image_max	0.06949922532746286
get_ui_image_mean	0.06949922532746286
get_ui_image_median	0.06949922532746286
get_ui_image_min	0.06949922532746286
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"udem1-sc0-0-ego0": {"driven_any": 0.4169016477053597, "get_ui_image": 0.06949922532746286, "step_physics": 0.4771576939207135, "survival_time": 1.6500000000000008, "driven_lanedir": 0.4096808148795912, "get_state_dump": 0.039033752499204696, "sim_render-ego0": 0.006593610301162257, "sim_render-ego1": 0.006541483330004143, "sim_render-ego2": 0.006009499231974284, "in-drivable-lane": 0.0, "deviation-heading": 0.25915269635125365, "agent_compute-ego0": 0.03754930062727495, "agent_compute-ego1": 0.04024741866371848, "agent_compute-ego2": 0.03945943803498239, "complete-iteration": 0.8616177818991921, "set_robot_commands": 0.0049730358701763734, "deviation-center-line": 0.05714392017121866, "driven_lanedir_consec": 0.4096808148795912, "sim_compute_sim_state": 0.04400646325313684, "sim_compute_performance-ego0": 0.004453001600323301, "sim_compute_performance-ego1": 0.004105741327459162, "sim_compute_performance-ego2": 0.004543420040246212, "sim_compute_robot_state-ego0": 0.007373744791204279, "sim_compute_robot_state-ego1": 0.007191824190544359, "sim_compute_robot_state-ego2": 0.007661523240985292, "sim_compute_robot_state-parked0": 0.007609555215546579, "sim_compute_robot_state-parked1": 0.007219560218579842, "sim_compute_robot_state-parked2": 0.007453311573375355, "sim_compute_robot_state-parked3": 0.007857763406002161, "sim_compute_robot_state-parked4": 0.0075410207112630205, "sim_compute_robot_state-parked5": 0.0071908127177845345}, "udem1-sc0-0-ego1": {"driven_any": 0.4643642449154331, "get_ui_image": 0.06949922532746286, "step_physics": 0.4771576939207135, "survival_time": 1.6500000000000008, "driven_lanedir": 0.4576442700393142, "get_state_dump": 0.039033752499204696, "sim_render-ego0": 0.006593610301162257, "sim_render-ego1": 0.006541483330004143, "sim_render-ego2": 0.006009499231974284, "in-drivable-lane": 0.0, "deviation-heading": 0.1767163684386201, "agent_compute-ego0": 0.03754930062727495, "agent_compute-ego1": 0.04024741866371848, "agent_compute-ego2": 0.03945943803498239, "complete-iteration": 0.8616177818991921, "set_robot_commands": 0.0049730358701763734, "deviation-center-line": 0.04126094640630395, "driven_lanedir_consec": 0.4576442700393142, "sim_compute_sim_state": 0.04400646325313684, "sim_compute_performance-ego0": 0.004453001600323301, "sim_compute_performance-ego1": 0.004105741327459162, "sim_compute_performance-ego2": 0.004543420040246212, "sim_compute_robot_state-ego0": 0.007373744791204279, "sim_compute_robot_state-ego1": 0.007191824190544359, "sim_compute_robot_state-ego2": 0.007661523240985292, "sim_compute_robot_state-parked0": 0.007609555215546579, "sim_compute_robot_state-parked1": 0.007219560218579842, "sim_compute_robot_state-parked2": 0.007453311573375355, "sim_compute_robot_state-parked3": 0.007857763406002161, "sim_compute_robot_state-parked4": 0.0075410207112630205, "sim_compute_robot_state-parked5": 0.0071908127177845345}, "udem1-sc0-0-ego2": {"driven_any": 0.35385368750809204, "get_ui_image": 0.06949922532746286, "step_physics": 0.4771576939207135, "survival_time": 1.6500000000000008, "driven_lanedir": 0.34304453488920794, "get_state_dump": 0.039033752499204696, "sim_render-ego0": 0.006593610301162257, "sim_render-ego1": 0.006541483330004143, "sim_render-ego2": 0.006009499231974284, "in-drivable-lane": 0.0, "deviation-heading": 0.41126873335593017, "agent_compute-ego0": 0.03754930062727495, "agent_compute-ego1": 0.04024741866371848, "agent_compute-ego2": 0.03945943803498239, "complete-iteration": 0.8616177818991921, "set_robot_commands": 0.0049730358701763734, "deviation-center-line": 0.11830584980811933, "driven_lanedir_consec": 0.34304453488920794, "sim_compute_sim_state": 0.04400646325313684, "sim_compute_performance-ego0": 0.004453001600323301, "sim_compute_performance-ego1": 0.004105741327459162, "sim_compute_performance-ego2": 0.004543420040246212, "sim_compute_robot_state-ego0": 0.007373744791204279, "sim_compute_robot_state-ego1": 0.007191824190544359, "sim_compute_robot_state-ego2": 0.007661523240985292, "sim_compute_robot_state-parked0": 0.007609555215546579, "sim_compute_robot_state-parked1": 0.007219560218579842, "sim_compute_robot_state-parked2": 0.007453311573375355, "sim_compute_robot_state-parked3": 0.007857763406002161, "sim_compute_robot_state-parked4": 0.0075410207112630205, "sim_compute_robot_state-parked5": 0.0071908127177845345}}
set_robot_commands_max	0.0049730358701763734
set_robot_commands_mean	0.0049730358701763734
set_robot_commands_median	0.0049730358701763734
set_robot_commands_min	0.0049730358701763734
sim_compute_performance-ego0_max	0.004453001600323301
sim_compute_performance-ego0_mean	0.004453001600323301
sim_compute_performance-ego0_median	0.004453001600323301
sim_compute_performance-ego0_min	0.004453001600323301
sim_compute_performance-ego1_max	0.004105741327459162
sim_compute_performance-ego1_mean	0.004105741327459162
sim_compute_performance-ego1_median	0.004105741327459162
sim_compute_performance-ego1_min	0.004105741327459162
sim_compute_performance-ego2_max	0.004543420040246212
sim_compute_performance-ego2_mean	0.004543420040246212
sim_compute_performance-ego2_median	0.004543420040246212
sim_compute_performance-ego2_min	0.004543420040246212
sim_compute_robot_state-ego0_max	0.007373744791204279
sim_compute_robot_state-ego0_mean	0.00737374479120428
sim_compute_robot_state-ego0_median	0.007373744791204279
sim_compute_robot_state-ego0_min	0.007373744791204279
sim_compute_robot_state-ego1_max	0.007191824190544359
sim_compute_robot_state-ego1_mean	0.00719182419054436
sim_compute_robot_state-ego1_median	0.007191824190544359
sim_compute_robot_state-ego1_min	0.007191824190544359
sim_compute_robot_state-ego2_max	0.007661523240985292
sim_compute_robot_state-ego2_mean	0.007661523240985293
sim_compute_robot_state-ego2_median	0.007661523240985292
sim_compute_robot_state-ego2_min	0.007661523240985292
sim_compute_robot_state-parked0_max	0.007609555215546579
sim_compute_robot_state-parked0_mean	0.00760955521554658
sim_compute_robot_state-parked0_median	0.007609555215546579
sim_compute_robot_state-parked0_min	0.007609555215546579
sim_compute_robot_state-parked1_max	0.007219560218579842
sim_compute_robot_state-parked1_mean	0.007219560218579842
sim_compute_robot_state-parked1_median	0.007219560218579842
sim_compute_robot_state-parked1_min	0.007219560218579842
sim_compute_robot_state-parked2_max	0.007453311573375355
sim_compute_robot_state-parked2_mean	0.007453311573375355
sim_compute_robot_state-parked2_median	0.007453311573375355
sim_compute_robot_state-parked2_min	0.007453311573375355
sim_compute_robot_state-parked3_max	0.007857763406002161
sim_compute_robot_state-parked3_mean	0.007857763406002161
sim_compute_robot_state-parked3_median	0.007857763406002161
sim_compute_robot_state-parked3_min	0.007857763406002161
sim_compute_robot_state-parked4_max	0.0075410207112630205
sim_compute_robot_state-parked4_mean	0.0075410207112630205
sim_compute_robot_state-parked4_median	0.0075410207112630205
sim_compute_robot_state-parked4_min	0.0075410207112630205
sim_compute_robot_state-parked5_max	0.0071908127177845345
sim_compute_robot_state-parked5_mean	0.0071908127177845345
sim_compute_robot_state-parked5_median	0.0071908127177845345
sim_compute_robot_state-parked5_min	0.0071908127177845345
sim_compute_sim_state_max	0.04400646325313684
sim_compute_sim_state_mean	0.04400646325313684
sim_compute_sim_state_median	0.04400646325313684
sim_compute_sim_state_min	0.04400646325313684
sim_render-ego0_max	0.006593610301162257
sim_render-ego0_mean	0.006593610301162257
sim_render-ego0_median	0.006593610301162257
sim_render-ego0_min	0.006593610301162257
sim_render-ego1_max	0.006541483330004143
sim_render-ego1_mean	0.006541483330004143
sim_render-ego1_median	0.006541483330004143
sim_render-ego1_min	0.006541483330004143
sim_render-ego2_max	0.006009499231974284
sim_render-ego2_mean	0.006009499231974284
sim_render-ego2_median	0.006009499231974284
sim_render-ego2_min	0.006009499231974284
simulation-passed	1
step_physics_max	0.4771576939207135
step_physics_mean	0.4771576939207135
step_physics_median	0.4771576939207135
step_physics_min	0.4771576939207135
survival_time_max	1.6500000000000008
survival_time_mean	1.650000000000001
survival_time_min	1.6500000000000008

No reset possible

36140

9968

Bea Baselines 🐤

template-pytorch

LFv-sim

error

aido5-LFVI-sim-validation

2020-11-02 00:55:09+00:00

2020-11-02 00:56:11+00:00

0:01:02

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 196, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego" aborted with the following error:

error in ego |Unexpected error:
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             ||     call_if_fun_exists(node, "init", context=context_data)
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 45, in init
             ||     raise Exception(msg)
             || Exception: I need a GPU; bailing.
             ||
             || The above exception was the direct cause of the following exception:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     raise Exception(msg) from e
             || Exception: Exception while calling the node's init() function.
             ||
             || | Traceback (most recent call last):
             || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             || |     call_if_fun_exists(node, "init", context=context_data)
             || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             || |     f(**kwargs)
             || |   File "solution.py", line 45, in init
             || |     raise Exception(msg)
             || | Exception: I need a GPU; bailing.
             || |
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36133

9973

Bea Baselines 🐤

template-pytorch

LFVIv-sim

error

aido5-LFP-sim-validation

2020-11-02 00:52:22+00:00

2020-11-02 00:54:40+00:00

0:02:18

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 196, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego" aborted with the following error:

error in ego |Unexpected error:
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             ||     call_if_fun_exists(node, "init", context=context_data)
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 45, in init
             ||     raise Exception(msg)
             || Exception: I need a GPU; bailing.
             ||
             || The above exception was the direct cause of the following exception:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     raise Exception(msg) from e
             || Exception: Exception while calling the node's init() function.
             ||
             || | Traceback (most recent call last):
             || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             || |     call_if_fun_exists(node, "init", context=context_data)
             || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             || |     f(**kwargs)
             || |   File "solution.py", line 45, in init
             || |     raise Exception(msg)
             || | Exception: I need a GPU; bailing.
             || |
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36129

9976

Bea Baselines 🐤

template-tensorflow

LFP-sim

error

2020-11-02 00:51:11+00:00

2020-11-02 00:52:14+00:00

0:01:03

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 196, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego" aborted with the following error:

error in ego |Unexpected error:
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             ||     call_if_fun_exists(node, "init", context=context_data)
             ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 32, in init
             ||     raise Exception(msg)
             || Exception: Could not find gpu device.
             ||
             || The above exception was the direct cause of the following exception:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     raise Exception(msg) from e
             || Exception: Exception while calling the node's init() function.
             ||
             || | Traceback (most recent call last):
             || |   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             || |     call_if_fun_exists(node, "init", context=context_data)
             || |   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             || |     f(**kwargs)
             || |   File "solution.py", line 32, in init
             || |     raise Exception(msg)
             || | Exception: Could not find gpu device.
             || |
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36125

9978

Bea Baselines 🐤

template-tensorflow

aido5-LF-sim-testing

LFt-sim

error

aido5-LFP-sim-validation

2020-11-02 00:49:36+00:00

2020-11-02 00:51:04+00:00

0:01:28

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 196, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego" aborted with the following error:

error in ego |Unexpected error:
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             ||     call_if_fun_exists(node, "init", context=context_data)
             ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 32, in init
             ||     raise Exception(msg)
             || Exception: Could not find gpu device.
             ||
             || The above exception was the direct cause of the following exception:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     raise Exception(msg) from e
             || Exception: Exception while calling the node's init() function.
             ||
             || | Traceback (most recent call last):
             || |   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             || |     call_if_fun_exists(node, "init", context=context_data)
             || |   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             || |     f(**kwargs)
             || |   File "solution.py", line 32, in init
             || |     raise Exception(msg)
             || | Exception: Could not find gpu device.
             || |
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36114

9994

Bea Baselines 🐤

straight

LFP-sim

success

2020-11-02 00:43:56+00:00

2020-11-02 00:49:21+00:00

0:05:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	7.474999999999983
in-drivable-lane_median	2.049999999999994
driven_lanedir_consec_median	0.7605383985487653
deviation-center-line_median	0.24500683454142905

other stats

agent_compute-ego_max	0.019659528454530582
agent_compute-ego_mean	0.01907130171204008
agent_compute-ego_median	0.019022646920575467
agent_compute-ego_min	0.01858038455247879
complete-iteration_max	0.21481382992209455
complete-iteration_mean	0.20392967729809103
complete-iteration_median	0.20324134714539768
complete-iteration_min	0.1944221849794741
deviation-center-line_max	0.5442231045907214
deviation-center-line_mean	0.30373769485061636
deviation-center-line_min	0.18071400572888607
deviation-heading_max	0.8865944828555883
deviation-heading_mean	0.7873900320094054
deviation-heading_median	0.8030415855889292
deviation-heading_min	0.656882474004175
driven_any_max	1.6419358463897749
driven_any_mean	1.1186964370405053
driven_any_median	1.1792552454664742
driven_any_min	0.47433941083929854
driven_lanedir_consec_max	0.8875163355320987
driven_lanedir_consec_mean	0.6769826355717046
driven_lanedir_consec_min	0.29933740965718925
driven_lanedir_max	0.8875163355320987
driven_lanedir_mean	0.6769826355717046
driven_lanedir_median	0.7605383985487653
driven_lanedir_min	0.29933740965718925
get_state_dump_max	0.015968061376501013
get_state_dump_mean	0.01534542670919543
get_state_dump_median	0.01525380706541168
get_state_dump_min	0.014906031329457352
get_ui_image_max	0.03715747304079009
get_ui_image_mean	0.03588577296341831
get_ui_image_median	0.035604054469940735
get_ui_image_min	0.03517750987300167
in-drivable-lane_max	5.2000000000000215
in-drivable-lane_mean	2.5625000000000018
in-drivable-lane_min	0.9499999999999966
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.2994563656887796, "get_ui_image": 0.03715747304079009, "step_physics": 0.09333312075312544, "survival_time": 8.199999999999982, "driven_lanedir": 0.8875163355320987, "get_state_dump": 0.014906031329457352, "sim_render-ego": 0.006684511173062208, "in-drivable-lane": 2.449999999999994, "agent_compute-ego": 0.018603067572523908, "deviation-heading": 0.656882474004175, "complete-iteration": 0.21481382992209455, "set_robot_commands": 0.0051863789558410645, "deviation-center-line": 0.5442231045907214, "driven_lanedir_consec": 0.8875163355320987, "sim_compute_sim_state": 0.017290321792044292, "sim_compute_performance-ego": 0.004661094851610138, "sim_compute_robot_state-ego": 0.008744796601737418, "sim_compute_robot_state-parked0": 0.008078089574488198}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.059054125244169, "get_ui_image": 0.03517750987300167, "step_physics": 0.0800225575764974, "survival_time": 6.749999999999984, "driven_lanedir": 0.7598629581691766, "get_state_dump": 0.015968061376501013, "sim_render-ego": 0.006441628491436994, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.019442226268627027, "deviation-heading": 0.8865944828555883, "complete-iteration": 0.1944221849794741, "set_robot_commands": 0.0048638838308828845, "deviation-center-line": 0.2465061142488824, "driven_lanedir_consec": 0.7598629581691766, "sim_compute_sim_state": 0.01276144098352503, "sim_compute_performance-ego": 0.004328953778302228, "sim_compute_robot_state-ego": 0.007526217566596137, "sim_compute_robot_state-parked0": 0.0077171661235668045}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.6419358463897749, "get_ui_image": 0.03525860679959788, "step_physics": 0.08015971855052466, "survival_time": 10.300000000000011, "driven_lanedir": 0.7612138389283539, "get_state_dump": 0.015260816777794109, "sim_render-ego": 0.006981228161784051, "in-drivable-lane": 5.2000000000000215, "agent_compute-ego": 0.019659528454530582, "deviation-heading": 0.8493666692836567, "complete-iteration": 0.20417196079365257, "set_robot_commands": 0.005602904893819568, "deviation-center-line": 0.24350755483397565, "driven_lanedir_consec": 0.7612138389283539, "sim_compute_sim_state": 0.018763557221125632, "sim_compute_performance-ego": 0.004815768269659246, "sim_compute_robot_state-ego": 0.009144925376743948, "sim_compute_robot_state-parked0": 0.008351057478525107}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.47433941083929854, "get_ui_image": 0.035949502140283585, "step_physics": 0.08329137414693832, "survival_time": 3.1999999999999966, "driven_lanedir": 0.29933740965718925, "get_state_dump": 0.015246797353029253, "sim_render-ego": 0.006653629243373871, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.01858038455247879, "deviation-heading": 0.7567165018942017, "complete-iteration": 0.2023107334971428, "set_robot_commands": 0.004770796746015549, "deviation-center-line": 0.18071400572888607, "driven_lanedir_consec": 0.29933740965718925, "sim_compute_sim_state": 0.017641887068748474, "sim_compute_performance-ego": 0.004460543394088745, "sim_compute_robot_state-ego": 0.007830940186977386, "sim_compute_robot_state-parked0": 0.007707666605710983}}
set_robot_commands_max	0.005602904893819568
set_robot_commands_mean	0.005105991106639766
set_robot_commands_median	0.0050251313933619745
set_robot_commands_min	0.004770796746015549
sim_compute_performance-ego_max	0.004815768269659246
sim_compute_performance-ego_mean	0.004566590073415089
sim_compute_performance-ego_median	0.004560819122849441
sim_compute_performance-ego_min	0.004328953778302228
sim_compute_robot_state-ego_max	0.009144925376743948
sim_compute_robot_state-ego_mean	0.008311719933013722
sim_compute_robot_state-ego_median	0.008287868394357401
sim_compute_robot_state-ego_min	0.007526217566596137
sim_compute_robot_state-parked0_max	0.008351057478525107
sim_compute_robot_state-parked0_mean	0.007963494945572774
sim_compute_robot_state-parked0_median	0.007897627849027502
sim_compute_robot_state-parked0_min	0.007707666605710983
sim_compute_sim_state_max	0.018763557221125632
sim_compute_sim_state_mean	0.016614301766360855
sim_compute_sim_state_median	0.01746610443039638
sim_compute_sim_state_min	0.01276144098352503
sim_render-ego_max	0.006981228161784051
sim_render-ego_mean	0.006690249267414281
sim_render-ego_median	0.006669070208218039
sim_render-ego_min	0.006441628491436994
simulation-passed	1
step_physics_max	0.09333312075312544
step_physics_mean	0.08420169275677146
step_physics_median	0.0817255463487315
step_physics_min	0.0800225575764974
survival_time_max	10.300000000000011
survival_time_mean	7.112499999999994
survival_time_min	3.1999999999999966

No reset possible

36108

9995

Bea Baselines 🐤

straight

LFv-sim

success