Evaluator 4768

LFv-sim

host-error

yes

2020-12-03 13:50:46+00:00

2020-12-03 14:27:41+00:00

0:36:55

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 803, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 45, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 265, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 415, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 272, in copyfile
    _fastcopy_sendfile(fsrc, fdst)
  File "/usr/lib/python3.8/shutil.py", line 163, in _fastcopy_sendfile
    raise err from None
  File "/usr/lib/python3.8/shutil.py", line 149, in _fastcopy_sendfile
    sent = os.sendfile(outfd, infd, offset, blocksize)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/aido5-LF-sim-validation/submission10800/LFv-sim-nogpu-prod-07_a945e4950c7e-job57891-a-wd/docker-compose.yaml' -> '/tmp/tmpvzr9frz1docker-compose.yaml'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57867

10788

exercise_ros_template

LFv-sim

success

yes

2020-12-03 13:33:23+00:00

2020-12-03 13:50:35+00:00

0:17:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2489529500515857
survival_time_median	22.05000000000018
deviation-center-line_median	0.8541327189384941
in-drivable-lane_median	7.774999999999931

other stats

agent_compute-ego0_max	0.013870631756425717
agent_compute-ego0_mean	0.012868106981402568
agent_compute-ego0_median	0.012558516840826168
agent_compute-ego0_min	0.012484762487532218
complete-iteration_max	0.2161251801211818
complete-iteration_mean	0.19122966677983372
complete-iteration_median	0.19515689964235583
complete-iteration_min	0.1584796877134414
deviation-center-line_max	3.027773105450877
deviation-center-line_mean	1.2298512356895066
deviation-center-line_min	0.18336639943016164
deviation-heading_max	16.774315184284156
deviation-heading_mean	6.935937918387797
deviation-heading_median	4.999845796488735
deviation-heading_min	0.9697448962895636
driven_any_max	10.420606691885824
driven_any_mean	4.680545054547105
driven_any_median	3.611842097835567
driven_any_min	1.0778893306314614
driven_lanedir_consec_max	8.434526317664682
driven_lanedir_consec_mean	2.894123938455129
driven_lanedir_consec_min	0.6440635360526623
driven_lanedir_max	8.434526317664682
driven_lanedir_mean	3.2753602349373123
driven_lanedir_median	2.011425543015953
driven_lanedir_min	0.6440635360526623
get_duckie_state_max	2.5479971957044537e-06
get_duckie_state_mean	2.079955563311458e-06
get_duckie_state_median	1.951666308604519e-06
get_duckie_state_min	1.86849244033234e-06
get_robot_state_max	0.004122330217945332
get_robot_state_mean	0.003765797066228135
get_robot_state_median	0.003662003541168251
get_robot_state_min	0.0036168509646307065
get_state_dump_max	0.004966816934598547
get_state_dump_mean	0.004688148762694553
get_state_dump_median	0.004611382641925965
get_state_dump_min	0.0045630128323277345
get_ui_image_max	0.03501851649224004
get_ui_image_mean	0.03057441131127257
get_ui_image_median	0.030608167302437185
get_ui_image_min	0.02606279414797586
in-drivable-lane_max	9.550000000000136
in-drivable-lane_mean	6.899999999999998
in-drivable-lane_min	2.499999999999991
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 10.420606691885824, "get_ui_image": 0.027664275093936205, "step_physics": 0.1146215935928637, "survival_time": 59.99999999999873, "driven_lanedir": 8.434526317664682, "get_state_dump": 0.004586795486081748, "get_robot_state": 0.003641974618293959, "sim_render-ego0": 0.0038143681249054743, "get_duckie_state": 1.9817924023071595e-06, "in-drivable-lane": 7.249999999999812, "deviation-heading": 16.774315184284156, "agent_compute-ego0": 0.012567929483075424, "complete-iteration": 0.18033945828452896, "set_robot_commands": 0.0022001468966545215, "deviation-center-line": 3.027773105450877, "driven_lanedir_consec": 8.434526317664682, "sim_compute_sim_state": 0.009147646425169374, "sim_compute_performance-ego0": 0.002005725577907896}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.238307208667432, "get_ui_image": 0.03501851649224004, "step_physics": 0.13559965808180313, "survival_time": 31.550000000000313, "driven_lanedir": 3.33731148527317, "get_state_dump": 0.0045630128323277345, "get_robot_state": 0.0036168509646307065, "sim_render-ego0": 0.003792714469040497, "get_duckie_state": 1.86849244033234e-06, "in-drivable-lane": 9.550000000000136, "deviation-heading": 8.669290208889757, "agent_compute-ego0": 0.012484762487532218, "complete-iteration": 0.20997434100018272, "set_robot_commands": 0.0021850357327280164, "deviation-center-line": 1.4777571217170136, "driven_lanedir_consec": 1.8240572436002216, "sim_compute_sim_state": 0.010675329573546784, "sim_compute_performance-ego0": 0.0019524082352843464}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0778893306314614, "get_ui_image": 0.03355205951093816, "step_physics": 0.14088867472953537, "survival_time": 7.299999999999982, "driven_lanedir": 0.685539600758736, "get_state_dump": 0.004966816934598547, "get_robot_state": 0.004122330217945332, "sim_render-ego0": 0.004332516469112059, "get_duckie_state": 2.5479971957044537e-06, "in-drivable-lane": 2.499999999999991, "deviation-heading": 1.3304013840877136, "agent_compute-ego0": 0.013870631756425717, "complete-iteration": 0.2161251801211818, "set_robot_commands": 0.002520583924793062, "deviation-center-line": 0.23050831615997464, "driven_lanedir_consec": 0.6738486565029498, "sim_compute_sim_state": 0.00951948457834672, "sim_compute_performance-ego0": 0.002250123186176326}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.985376987003703, "get_ui_image": 0.02606279414797586, "step_physics": 0.09843826104724218, "survival_time": 12.550000000000043, "driven_lanedir": 0.6440635360526623, "get_state_dump": 0.004635969797770183, "get_robot_state": 0.0036820324640425423, "sim_render-ego0": 0.003879202736748589, "get_duckie_state": 1.921540214901879e-06, "in-drivable-lane": 8.30000000000005, "deviation-heading": 0.9697448962895636, "agent_compute-ego0": 0.012549104198576912, "complete-iteration": 0.1584796877134414, "set_robot_commands": 0.002169391465565515, "deviation-center-line": 0.18336639943016164, "driven_lanedir_consec": 0.6440635360526623, "sim_compute_sim_state": 0.0049655673995850575, "sim_compute_performance-ego0": 0.0020135783013843353}}
set_robot_commands_max	0.002520583924793062
set_robot_commands_mean	0.0022687895049352787
set_robot_commands_median	0.002192591314691269
set_robot_commands_min	0.002169391465565515
sim_compute_performance-ego0_max	0.002250123186176326
sim_compute_performance-ego0_mean	0.002055458825188226
sim_compute_performance-ego0_median	0.0020096519396461156
sim_compute_performance-ego0_min	0.0019524082352843464
sim_compute_sim_state_max	0.010675329573546784
sim_compute_sim_state_mean	0.008577006994161984
sim_compute_sim_state_median	0.009333565501758049
sim_compute_sim_state_min	0.0049655673995850575
sim_render-ego0_max	0.004332516469112059
sim_render-ego0_mean	0.003954700449951654
sim_render-ego0_median	0.003846785430827032
sim_render-ego0_min	0.003792714469040497
simulation-passed	1
step_physics_max	0.14088867472953537
step_physics_mean	0.1223870468628611
step_physics_median	0.1251106258373334
step_physics_min	0.09843826104724218
survival_time_max	59.99999999999873
survival_time_mean	27.849999999999763
survival_time_min	7.299999999999982

No reset possible

57862

10790

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 13:29:51+00:00

2020-12-03 13:33:03+00:00

0:03:12

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 25 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57855

10793

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 13:25:50+00:00

2020-12-03 13:29:18+00:00

0:03:28

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 40 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57842

10797

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 13:20:32+00:00

2020-12-03 13:25:25+00:00

0:04:53

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 57 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57804

10820

Raphael Jean

exercise_ros_template

LFv-sim

success

yes

2020-12-03 12:58:13+00:00

2020-12-03 13:19:55+00:00

0:21:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.913253506281922
survival_time_median	26.700000000000244
deviation-center-line_median	0.8914753952276626
in-drivable-lane_median	7.825000000000111

other stats

agent_compute-ego0_max	0.014102550902107889
agent_compute-ego0_mean	0.013081216601211532
agent_compute-ego0_median	0.013238501288082752
agent_compute-ego0_min	0.011745312926572726
complete-iteration_max	0.22769737243652344
complete-iteration_mean	0.2024480189700389
complete-iteration_median	0.21100973733378295
complete-iteration_min	0.16007522877606625
deviation-center-line_max	2.2436446750772236
deviation-center-line_mean	1.097589651300145
deviation-center-line_min	0.36376313966803103
deviation-heading_max	11.866327851113752
deviation-heading_mean	5.499551765887067
deviation-heading_median	3.91857450272164
deviation-heading_min	2.294730206991235
driven_any_max	9.884343769612396
driven_any_mean	5.4258661034715265
driven_any_median	4.107706072270642
driven_any_min	3.603708499732427
driven_lanedir_consec_max	9.124313755269636
driven_lanedir_consec_mean	4.115463891255434
driven_lanedir_consec_min	1.511034797188256
driven_lanedir_max	9.124313755269636
driven_lanedir_mean	4.115986342753295
driven_lanedir_median	2.913253506281922
driven_lanedir_min	1.5131246031796983
get_duckie_state_max	1.8154003823450369e-06
get_duckie_state_mean	1.5019746669773102e-06
get_duckie_state_median	1.4878946584717451e-06
get_duckie_state_min	1.2167089686207132e-06
get_robot_state_max	0.004205276337704917
get_robot_state_mean	0.00400150924843448
get_robot_state_median	0.004058222997475709
get_robot_state_min	0.0036843146610815855
get_state_dump_max	0.005425241019321262
get_state_dump_mean	0.004989470006272813
get_state_dump_median	0.004995397127921434
get_state_dump_min	0.004541844749927124
get_ui_image_max	0.03587141291039889
get_ui_image_mean	0.031596310730161746
get_ui_image_median	0.032465832382319634
get_ui_image_min	0.025582165245608825
in-drivable-lane_max	14.300000000000203
in-drivable-lane_mean	8.162500000000069
in-drivable-lane_min	2.6999999999998465
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 4.022005453491659, "get_ui_image": 0.030875690685686213, "step_physics": 0.1253502988076025, "survival_time": 25.75000000000023, "driven_lanedir": 2.0860177273609595, "get_state_dump": 0.00510969319084818, "get_robot_state": 0.004205276337704917, "sim_render-ego0": 0.004442318003307018, "get_duckie_state": 1.8154003823450369e-06, "in-drivable-lane": 12.500000000000178, "deviation-heading": 2.294730206991235, "agent_compute-ego0": 0.014102550902107889, "complete-iteration": 0.20085111098696096, "set_robot_commands": 0.0025930483211842616, "deviation-center-line": 0.5351557915556484, "driven_lanedir_consec": 2.0860177273609595, "sim_compute_sim_state": 0.01169814850932868, "sim_compute_performance-ego0": 0.0023615591285764707}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.603708499732427, "get_ui_image": 0.03587141291039889, "step_physics": 0.14392092335419576, "survival_time": 24.35000000000021, "driven_lanedir": 1.5131246031796983, "get_state_dump": 0.004881101064994687, "get_robot_state": 0.003954686590882599, "sim_render-ego0": 0.003976006976893691, "get_duckie_state": 1.4329542879198415e-06, "in-drivable-lane": 14.300000000000203, "deviation-heading": 2.928830638078511, "agent_compute-ego0": 0.013174173284749516, "complete-iteration": 0.22116836368060505, "set_robot_commands": 0.002310351270144103, "deviation-center-line": 0.36376313966803103, "driven_lanedir_consec": 1.511034797188256, "sim_compute_sim_state": 0.010798539783133837, "sim_compute_performance-ego0": 0.0021767396418774713}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.193406691049625, "get_ui_image": 0.03405597407895305, "step_physics": 0.14887710168473556, "survival_time": 27.650000000000254, "driven_lanedir": 3.740489285202883, "get_state_dump": 0.005425241019321262, "get_robot_state": 0.004161759404068819, "sim_render-ego0": 0.004275908108652714, "get_duckie_state": 1.542835029023649e-06, "in-drivable-lane": 3.1500000000000448, "deviation-heading": 4.908318367364769, "agent_compute-ego0": 0.013302829291415987, "complete-iteration": 0.22769737243652344, "set_robot_commands": 0.002484536773461297, "deviation-center-line": 1.2477949988996768, "driven_lanedir_consec": 3.740489285202883, "sim_compute_sim_state": 0.01263691587138262, "sim_compute_performance-ego0": 0.002364810623416832}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.884343769612396, "get_ui_image": 0.025582165245608825, "step_physics": 0.1005298033245001, "survival_time": 59.99999999999873, "driven_lanedir": 9.124313755269636, "get_state_dump": 0.004541844749927124, "get_robot_state": 0.0036843146610815855, "sim_render-ego0": 0.003737583644781184, "get_duckie_state": 1.2167089686207132e-06, "in-drivable-lane": 2.6999999999998465, "deviation-heading": 11.866327851113752, "agent_compute-ego0": 0.011745312926572726, "complete-iteration": 0.16007522877606625, "set_robot_commands": 0.0021558582137566028, "deviation-center-line": 2.2436446750772236, "driven_lanedir_consec": 9.124313755269636, "sim_compute_sim_state": 0.006058427912309506, "sim_compute_performance-ego0": 0.0019533989530717403}}
set_robot_commands_max	0.0025930483211842616
set_robot_commands_mean	0.002385948644636566
set_robot_commands_median	0.0023974440218026997
set_robot_commands_min	0.0021558582137566028
sim_compute_performance-ego0_max	0.002364810623416832
sim_compute_performance-ego0_mean	0.0022141270867356284
sim_compute_performance-ego0_median	0.002269149385226971
sim_compute_performance-ego0_min	0.0019533989530717403
sim_compute_sim_state_max	0.01263691587138262
sim_compute_sim_state_mean	0.01029800801903866
sim_compute_sim_state_median	0.011248344146231257
sim_compute_sim_state_min	0.006058427912309506
sim_render-ego0_max	0.004442318003307018
sim_render-ego0_mean	0.004107954183408652
sim_render-ego0_median	0.004125957542773203
sim_render-ego0_min	0.003737583644781184
simulation-passed	1
step_physics_max	0.14887710168473556
step_physics_mean	0.12966953179275847
step_physics_median	0.13463561108089914
step_physics_min	0.1005298033245001
survival_time_max	59.99999999999873
survival_time_mean	34.43749999999986
survival_time_min	24.35000000000021

No reset possible

57767

10839

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 12:28:03+00:00

2020-12-03 12:57:04+00:00

0:29:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.90490775427406
survival_time_median	55.72499999999897
deviation-center-line_median	1.1775391795451378
in-drivable-lane_median	22.049999999999983

other stats

agent_compute-ego0_max	0.01365934190964988
agent_compute-ego0_mean	0.012781030057865102
agent_compute-ego0_median	0.012655205499341246
agent_compute-ego0_min	0.01215436732312804
complete-iteration_max	0.1929681803159532
complete-iteration_mean	0.17598851229771725
complete-iteration_median	0.1780987291701734
complete-iteration_min	0.15478841053456888
deviation-center-line_max	3.968727544554039
deviation-center-line_mean	1.8316256522075425
deviation-center-line_min	1.0026967051858546
deviation-heading_max	13.958914977187966
deviation-heading_mean	6.8482128326317
deviation-heading_median	4.909261219693025
deviation-heading_min	3.615413913952783
driven_any_max	7.10060827473819
driven_any_mean	5.9557388250748495
driven_any_median	6.665064710508713
driven_any_min	3.3922176045437813
driven_lanedir_consec_max	6.792997252177034
driven_lanedir_consec_mean	3.5390935880494983
driven_lanedir_consec_min	1.553561591472841
driven_lanedir_max	6.792997252177034
driven_lanedir_mean	3.551452129767121
driven_lanedir_median	2.929624837709305
driven_lanedir_min	1.553561591472841
get_duckie_state_max	1.3939843983773289e-06
get_duckie_state_mean	1.3224667849851116e-06
get_duckie_state_median	1.313018016618413e-06
get_duckie_state_min	1.269846708326292e-06
get_robot_state_max	0.003938289201032351
get_robot_state_mean	0.003836990371917832
get_robot_state_median	0.0038772038136928822
get_robot_state_min	0.003655264659253214
get_state_dump_max	0.004999456207301836
get_state_dump_mean	0.00484652395315853
get_state_dump_median	0.004854893915658263
get_state_dump_min	0.00467685177401576
get_ui_image_max	0.03536095397047909
get_ui_image_mean	0.031475260889222506
get_ui_image_median	0.03187879769183542
get_ui_image_min	0.02678249420274009
in-drivable-lane_max	41.1999999999989
in-drivable-lane_mean	21.58749999999972
in-drivable-lane_min	1.050000000000015
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 6.913263593227138, "get_ui_image": 0.029034756684369695, "step_physics": 0.09901752865967534, "survival_time": 53.79999999999908, "driven_lanedir": 3.988441419296376, "get_state_dump": 0.004891280454956168, "get_robot_state": 0.003842070906275162, "sim_render-ego0": 0.004059491604704932, "get_duckie_state": 1.3209319048273198e-06, "in-drivable-lane": 27.89999999999975, "deviation-heading": 3.615413913952783, "agent_compute-ego0": 0.012824806994382385, "complete-iteration": 0.16950133517592067, "set_robot_commands": 0.002300434015144766, "deviation-center-line": 1.0026967051858546, "driven_lanedir_consec": 3.988441419296376, "sim_compute_sim_state": 0.011333858955758749, "sim_compute_performance-ego0": 0.002111826545127366}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.3922176045437813, "get_ui_image": 0.03536095397047909, "step_physics": 0.11194149031615296, "survival_time": 30.00000000000029, "driven_lanedir": 1.553561591472841, "get_state_dump": 0.00467685177401576, "get_robot_state": 0.003655264659253214, "sim_render-ego0": 0.003890574672654544, "get_duckie_state": 1.269846708326292e-06, "in-drivable-lane": 16.200000000000212, "deviation-heading": 4.312309821063672, "agent_compute-ego0": 0.01215436732312804, "complete-iteration": 0.18669612316442608, "set_robot_commands": 0.0021691790436349574, "deviation-center-line": 1.032722689469178, "driven_lanedir_consec": 1.553561591472841, "sim_compute_sim_state": 0.01079453882480818, "sim_compute_performance-ego0": 0.001970042008131792}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.416865827790288, "get_ui_image": 0.03472283869930115, "step_physics": 0.11604777572473166, "survival_time": 57.64999999999886, "driven_lanedir": 1.8708082561222343, "get_state_dump": 0.004999456207301836, "get_robot_state": 0.003938289201032351, "sim_render-ego0": 0.004275737023642819, "get_duckie_state": 1.3051041284095065e-06, "in-drivable-lane": 41.1999999999989, "deviation-heading": 5.506212618322379, "agent_compute-ego0": 0.01365934190964988, "complete-iteration": 0.1929681803159532, "set_robot_commands": 0.002324509248783105, "deviation-center-line": 1.3223556696210974, "driven_lanedir_consec": 1.8213740892517432, "sim_compute_sim_state": 0.0106991029488152, "sim_compute_performance-ego0": 0.002212193437837439}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.10060827473819, "get_ui_image": 0.02678249420274009, "step_physics": 0.09179470044786388, "survival_time": 59.99999999999873, "driven_lanedir": 6.792997252177034, "get_state_dump": 0.0048185073763603575, "get_robot_state": 0.003912336721110602, "sim_render-ego0": 0.003997065443281925, "get_duckie_state": 1.3939843983773289e-06, "in-drivable-lane": 1.050000000000015, "deviation-heading": 13.958914977187966, "agent_compute-ego0": 0.012485604004300108, "complete-iteration": 0.15478841053456888, "set_robot_commands": 0.0023301036828364263, "deviation-center-line": 3.968727544554039, "driven_lanedir_consec": 6.792997252177034, "sim_compute_sim_state": 0.006462333402863946, "sim_compute_performance-ego0": 0.002120969496003595}}
set_robot_commands_max	0.0023301036828364263
set_robot_commands_mean	0.002281056497599814
set_robot_commands_median	0.0023124716319639356
set_robot_commands_min	0.0021691790436349574
sim_compute_performance-ego0_max	0.002212193437837439
sim_compute_performance-ego0_mean	0.002103757871775048
sim_compute_performance-ego0_median	0.00211639802056548
sim_compute_performance-ego0_min	0.001970042008131792
sim_compute_sim_state_max	0.011333858955758749
sim_compute_sim_state_mean	0.009822458533061518
sim_compute_sim_state_median	0.01074682088681169
sim_compute_sim_state_min	0.006462333402863946
sim_render-ego0_max	0.004275737023642819
sim_render-ego0_mean	0.004055717186071056
sim_render-ego0_median	0.004028278523993428
sim_render-ego0_min	0.003890574672654544
simulation-passed	1
step_physics_max	0.11604777572473166
step_physics_mean	0.10470037378710596
step_physics_median	0.10547950948791417
step_physics_min	0.09179470044786388
survival_time_max	59.99999999999873
survival_time_mean	50.36249999999924
survival_time_min	30.00000000000029

No reset possible

57735

10856

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 12:02:45+00:00

2020-12-03 12:27:45+00:00

0:25:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.399332451710581
survival_time_median	55.62499999999898
deviation-center-line_median	1.156283771266252
in-drivable-lane_median	15.399999999999864

other stats

agent_compute-ego0_max	0.013968584597924069
agent_compute-ego0_mean	0.013316202848180253
agent_compute-ego0_median	0.013573301503265136
agent_compute-ego0_min	0.012149623788266657
complete-iteration_max	0.23353859640303112
complete-iteration_mean	0.18660204516782983
complete-iteration_median	0.18369547328966415
complete-iteration_min	0.14547863768895997
deviation-center-line_max	3.809405496269786
deviation-center-line_mean	1.5742589875271291
deviation-center-line_min	0.17506291130622784
deviation-heading_max	11.977052764654688
deviation-heading_mean	5.4051558282693115
deviation-heading_median	3.954649386872524
deviation-heading_min	1.7342717746775131
driven_any_max	8.224120064503042
driven_any_mean	5.387655632462334
driven_any_median	6.519801663078907
driven_any_min	0.2868991391884791
driven_lanedir_consec_max	6.696125083942303
driven_lanedir_consec_mean	2.906636828838148
driven_lanedir_consec_min	0.13175732798912598
driven_lanedir_max	6.696125083942303
driven_lanedir_mean	2.906636828838148
driven_lanedir_median	2.399332451710581
driven_lanedir_min	0.13175732798912598
get_duckie_state_max	2.5772908974809256e-06
get_duckie_state_mean	2.248586547803709e-06
get_duckie_state_median	2.277384978027755e-06
get_duckie_state_min	1.8622853376783995e-06
get_robot_state_max	0.004020556139434755
get_robot_state_mean	0.00382064356159712
get_robot_state_median	0.003849572726478802
get_robot_state_min	0.0035628726539961206
get_state_dump_max	0.004941848054034435
get_state_dump_mean	0.004738632234339048
get_state_dump_median	0.004735646658698845
get_state_dump_min	0.004541387565924067
get_ui_image_max	0.0361968960080828
get_ui_image_mean	0.030948463997660942
get_ui_image_median	0.031188072297781255
get_ui_image_min	0.025220815386998465
in-drivable-lane_max	46.799999999998676
in-drivable-lane_mean	19.787499999999604
in-drivable-lane_min	1.5499999999999945
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 8.224120064503042, "get_ui_image": 0.029301625505077353, "step_physics": 0.10444509476845112, "survival_time": 59.99999999999873, "driven_lanedir": 2.0035469857288297, "get_state_dump": 0.004849333449466143, "get_robot_state": 0.004000963914602821, "sim_render-ego0": 0.004201052488633536, "get_duckie_state": 2.542403615781608e-06, "in-drivable-lane": 46.799999999998676, "deviation-heading": 1.7342717746775131, "agent_compute-ego0": 0.013631485383973132, "complete-iteration": 0.175325967191558, "set_robot_commands": 0.002395776189634147, "deviation-center-line": 0.5492931003245027, "driven_lanedir_consec": 2.0035469857288297, "sim_compute_sim_state": 0.010168584359873344, "sim_compute_performance-ego0": 0.002232659766318697}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2868991391884791, "get_ui_image": 0.0361968960080828, "step_physics": 0.15702711116699947, "survival_time": 4.149999999999993, "driven_lanedir": 0.13175732798912598, "get_state_dump": 0.004621959867931548, "get_robot_state": 0.0036981815383547822, "sim_render-ego0": 0.00392101492200579, "get_duckie_state": 2.0123663402739024e-06, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 1.8352117536456989, "agent_compute-ego0": 0.01351511762255714, "complete-iteration": 0.23353859640303112, "set_robot_commands": 0.002195636431376139, "deviation-center-line": 0.17506291130622784, "driven_lanedir_consec": 0.13175732798912598, "sim_compute_sim_state": 0.010338184379395984, "sim_compute_performance-ego0": 0.0019400488762628463}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.917773769917445, "get_ui_image": 0.03307451909048516, "step_physics": 0.11485468272344876, "survival_time": 51.249999999999226, "driven_lanedir": 2.795117917692333, "get_state_dump": 0.004941848054034435, "get_robot_state": 0.004020556139434755, "sim_render-ego0": 0.004243839321545458, "get_duckie_state": 2.5772908974809256e-06, "in-drivable-lane": 27.999999999999694, "deviation-heading": 6.074087020099348, "agent_compute-ego0": 0.013968584597924069, "complete-iteration": 0.1920649793877704, "set_robot_commands": 0.002362528274863319, "deviation-center-line": 1.7632744422080011, "driven_lanedir_consec": 2.795117917692333, "sim_compute_sim_state": 0.012249107016922204, "sim_compute_performance-ego0": 0.002246140039455124}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.121829556240368, "get_ui_image": 0.025220815386998465, "step_physics": 0.08622783268619635, "survival_time": 59.99999999999873, "driven_lanedir": 6.696125083942303, "get_state_dump": 0.004541387565924067, "get_robot_state": 0.0035628726539961206, "sim_render-ego0": 0.0036994777650856954, "get_duckie_state": 1.8622853376783995e-06, "in-drivable-lane": 2.8000000000000327, "deviation-heading": 11.977052764654688, "agent_compute-ego0": 0.012149623788266657, "complete-iteration": 0.14547863768895997, "set_robot_commands": 0.0021315593703601084, "deviation-center-line": 3.809405496269786, "driven_lanedir_consec": 6.696125083942303, "sim_compute_sim_state": 0.005994485875748278, "sim_compute_performance-ego0": 0.001871176504473404}}
set_robot_commands_max	0.002395776189634147
set_robot_commands_mean	0.0022713750665584284
set_robot_commands_median	0.002279082353119729
set_robot_commands_min	0.0021315593703601084
sim_compute_performance-ego0_max	0.002246140039455124
sim_compute_performance-ego0_mean	0.002072506296627518
sim_compute_performance-ego0_median	0.0020863543212907717
sim_compute_performance-ego0_min	0.001871176504473404
sim_compute_sim_state_max	0.012249107016922204
sim_compute_sim_state_mean	0.009687590407984953
sim_compute_sim_state_median	0.010253384369634664
sim_compute_sim_state_min	0.005994485875748278
sim_render-ego0_max	0.004243839321545458
sim_render-ego0_mean	0.004016346124317619
sim_render-ego0_median	0.004061033705319662
sim_render-ego0_min	0.0036994777650856954
simulation-passed	1
step_physics_max	0.15702711116699947
step_physics_mean	0.11563868033627392
step_physics_median	0.10964988874594994
step_physics_min	0.08622783268619635
survival_time_max	59.99999999999873
survival_time_mean	43.84999999999917
survival_time_min	4.149999999999993

No reset possible

57720

10863

exercise_ros_template

LFv-sim

success

yes

2020-12-03 11:50:15+00:00

2020-12-03 12:02:11+00:00

0:11:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6451624214972336
survival_time_median	10.425000000000011
deviation-center-line_median	0.23174133606194044
in-drivable-lane_median	6.32500000000002

other stats

agent_compute-ego0_max	0.013355372539117708
agent_compute-ego0_mean	0.0130437282729303
agent_compute-ego0_median	0.01305008245005029
agent_compute-ego0_min	0.012719375652502914
complete-iteration_max	0.20160142888021731
complete-iteration_mean	0.18268344616038884
complete-iteration_median	0.18420607414344475
complete-iteration_min	0.16072020747444846
deviation-center-line_max	1.423140985241001
deviation-center-line_mean	0.5139438841867164
deviation-center-line_min	0.16915187938198384
deviation-heading_max	6.924885514492694
deviation-heading_mean	2.5504190735023937
deviation-heading_median	1.2675179045900271
deviation-heading_min	0.7417549703368262
driven_any_max	8.11776030648158
driven_any_mean	3.1694600261425117
driven_any_median	1.5944934370982622
driven_any_min	1.371092923891941
driven_lanedir_consec_max	5.484305128235918
driven_lanedir_consec_mean	1.836339076185556
driven_lanedir_consec_min	0.5707263335118387
driven_lanedir_max	5.484305128235918
driven_lanedir_mean	1.836339076185556
driven_lanedir_median	0.6451624214972336
driven_lanedir_min	0.5707263335118387
get_duckie_state_max	1.4053517250559438e-06
get_duckie_state_mean	1.3214745342393731e-06
get_duckie_state_median	1.329737231290143e-06
get_duckie_state_min	1.221071949321262e-06
get_robot_state_max	0.003882036425850608
get_robot_state_mean	0.0037569681286173376
get_robot_state_median	0.003776815388782688
get_robot_state_min	0.0035922053110533656
get_state_dump_max	0.004841255782237604
get_state_dump_mean	0.004716207243860503
get_state_dump_median	0.004708300617868795
get_state_dump_min	0.004606971957466819
get_ui_image_max	0.03544768970974242
get_ui_image_mean	0.030331342975162115
get_ui_image_median	0.029922731520528205
get_ui_image_min	0.02603221914984963
in-drivable-lane_max	13.9999999999995
in-drivable-lane_mean	7.899999999999884
in-drivable-lane_min	4.949999999999999
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 8.11776030648158, "get_ui_image": 0.028436004142636705, "step_physics": 0.10630881539885444, "survival_time": 45.89999999999953, "driven_lanedir": 5.484305128235918, "get_state_dump": 0.004730465622280316, "get_robot_state": 0.0037420820748844913, "sim_render-ego0": 0.003936674441813903, "get_duckie_state": 1.3871862268292216e-06, "in-drivable-lane": 13.9999999999995, "deviation-heading": 6.924885514492694, "agent_compute-ego0": 0.012801745511242822, "complete-iteration": 0.17437248001679762, "set_robot_commands": 0.0022383605305336504, "deviation-center-line": 1.423140985241001, "driven_lanedir_consec": 5.484305128235918, "sim_compute_sim_state": 0.010046910409439634, "sim_compute_performance-ego0": 0.00203727741884848}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.371092923891941, "get_ui_image": 0.03544768970974242, "step_physics": 0.12755882674159266, "survival_time": 8.999999999999993, "driven_lanedir": 0.5707263335118387, "get_state_dump": 0.004686135613457274, "get_robot_state": 0.0035922053110533656, "sim_render-ego0": 0.003808971268037406, "get_duckie_state": 1.221071949321262e-06, "in-drivable-lane": 4.949999999999999, "deviation-heading": 1.7805912031650248, "agent_compute-ego0": 0.012719375652502914, "complete-iteration": 0.20160142888021731, "set_robot_commands": 0.0021829670964025, "deviation-center-line": 0.2864150674247602, "driven_lanedir_consec": 0.5707263335118387, "sim_compute_sim_state": 0.009603111783443894, "sim_compute_performance-ego0": 0.0019150465232891272}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4791099488456192, "get_ui_image": 0.03140945889841971, "step_physics": 0.12331035149157346, "survival_time": 9.900000000000006, "driven_lanedir": 0.6495051985484711, "get_state_dump": 0.004841255782237604, "get_robot_state": 0.003811548702680885, "sim_render-ego0": 0.004027841079175172, "get_duckie_state": 1.4053517250559438e-06, "in-drivable-lane": 5.750000000000012, "deviation-heading": 0.7544446060150293, "agent_compute-ego0": 0.013355372539117708, "complete-iteration": 0.19403966827009192, "set_robot_commands": 0.0022539385599107597, "deviation-center-line": 0.1770676046991207, "driven_lanedir_consec": 0.6495051985484711, "sim_compute_sim_state": 0.008863372419347716, "sim_compute_performance-ego0": 0.0020675731064686226}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7098769253509052, "get_ui_image": 0.02603221914984963, "step_physics": 0.098989567973397, "survival_time": 10.95000000000002, "driven_lanedir": 0.6408196444459962, "get_state_dump": 0.004606971957466819, "get_robot_state": 0.003882036425850608, "sim_render-ego0": 0.0038553357124328615, "get_duckie_state": 1.2722882357510652e-06, "in-drivable-lane": 6.900000000000027, "deviation-heading": 0.7417549703368262, "agent_compute-ego0": 0.013298419388857756, "complete-iteration": 0.16072020747444846, "set_robot_commands": 0.0022222031246532095, "deviation-center-line": 0.16915187938198384, "driven_lanedir_consec": 0.6408196444459962, "sim_compute_sim_state": 0.00507971698587591, "sim_compute_performance-ego0": 0.002663987333124334}}
set_robot_commands_max	0.0022539385599107597
set_robot_commands_mean	0.0022243673278750297
set_robot_commands_median	0.00223028182759343
set_robot_commands_min	0.0021829670964025
sim_compute_performance-ego0_max	0.002663987333124334
sim_compute_performance-ego0_mean	0.002170971095432641
sim_compute_performance-ego0_median	0.0020524252626585512
sim_compute_performance-ego0_min	0.0019150465232891272
sim_compute_sim_state_max	0.010046910409439634
sim_compute_sim_state_mean	0.008398277899526789
sim_compute_sim_state_median	0.009233242101395804
sim_compute_sim_state_min	0.00507971698587591
sim_render-ego0_max	0.004027841079175172
sim_render-ego0_mean	0.003907205625364836
sim_render-ego0_median	0.0038960050771233825
sim_render-ego0_min	0.003808971268037406
simulation-passed	1
step_physics_max	0.12755882674159266
step_physics_mean	0.1140418904013544
step_physics_median	0.11480958344521396
step_physics_min	0.098989567973397
survival_time_max	45.89999999999953
survival_time_mean	18.937499999999886
survival_time_min	8.999999999999993

No reset possible

57668

10881

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 11:24:52+00:00

2020-12-03 11:49:47+00:00

0:24:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.117472110889487
survival_time_median	56.79999999999891
deviation-center-line_median	1.4417941557499303
in-drivable-lane_median	28.37499999999914

other stats

agent_compute-ego0_max	0.014564788204500046
agent_compute-ego0_mean	0.013559699818387987
agent_compute-ego0_median	0.013578279613047552
agent_compute-ego0_min	0.012517451842956795
complete-iteration_max	0.2272700907170087
complete-iteration_mean	0.1819904364912916
complete-iteration_median	0.18010607625931296
complete-iteration_min	0.14047950272953183
deviation-center-line_max	1.998734616014289
deviation-center-line_mean	1.2623666774422957
deviation-center-line_min	0.1671437822550329
deviation-heading_max	6.3737320523936924
deviation-heading_mean	4.872601093714591
deviation-heading_median	5.633575939830877
deviation-heading_min	1.8495204428029184
driven_any_max	7.501194740926674
driven_any_mean	5.3789392098828746
driven_any_median	6.857002448515324
driven_any_min	0.30055720157417726
driven_lanedir_consec_max	4.0087916025913035
driven_lanedir_consec_mean	2.5952953171257462
driven_lanedir_consec_min	0.13744544413270665
driven_lanedir_max	4.0087916025913035
driven_lanedir_mean	2.5952953171257462
driven_lanedir_median	3.117472110889487
driven_lanedir_min	0.13744544413270665
get_duckie_state_max	1.593604892186772e-06
get_duckie_state_mean	1.435420045617527e-06
get_duckie_state_median	1.4465262974813523e-06
get_duckie_state_min	1.2550226953206313e-06
get_robot_state_max	0.004100479948629845
get_robot_state_mean	0.003871730819792853
get_robot_state_median	0.0038991539179815864
get_robot_state_min	0.003588135494578391
get_state_dump_max	0.005195140838623047
get_state_dump_mean	0.004865763948030898
get_state_dump_median	0.004912132951452344
get_state_dump_min	0.004443649050595857
get_ui_image_max	0.0347792937837798
get_ui_image_mean	0.030468029022920208
get_ui_image_median	0.03070742545435168
get_ui_image_min	0.02567797139919767
in-drivable-lane_max	36.14999999999925
in-drivable-lane_mean	23.624999999999385
in-drivable-lane_min	1.5999999999999943
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 6.896659122312882, "get_ui_image": 0.02834015590280211, "step_physics": 0.1015252895924052, "survival_time": 53.59999999999909, "driven_lanedir": 4.0087916025913035, "get_state_dump": 0.00489609928077776, "get_robot_state": 0.004011774107549975, "sim_render-ego0": 0.00410714087259625, "get_duckie_state": 1.593604892186772e-06, "in-drivable-lane": 26.049999999999834, "deviation-heading": 5.091280483746498, "agent_compute-ego0": 0.013164579590569004, "complete-iteration": 0.1723590583747942, "set_robot_commands": 0.002319269278065023, "deviation-center-line": 1.0553087567759611, "driven_lanedir_consec": 4.0087916025913035, "sim_compute_sim_state": 0.011685966001085778, "sim_compute_performance-ego0": 0.002209676056405927}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.30055720157417726, "get_ui_image": 0.0347792937837798, "step_physics": 0.15015004147058245, "survival_time": 4.299999999999993, "driven_lanedir": 0.13744544413270665, "get_state_dump": 0.005195140838623047, "get_robot_state": 0.003786533728413198, "sim_render-ego0": 0.003982963233158506, "get_duckie_state": 1.397626153353987e-06, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 1.8495204428029184, "agent_compute-ego0": 0.014564788204500046, "complete-iteration": 0.2272700907170087, "set_robot_commands": 0.0022559056336852326, "deviation-center-line": 0.1671437822550329, "driven_lanedir_consec": 0.13744544413270665, "sim_compute_sim_state": 0.010297756085450622, "sim_compute_performance-ego0": 0.0021585650827692844}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.817345774717767, "get_ui_image": 0.03307469500590125, "step_physics": 0.10980194057652, "survival_time": 59.99999999999873, "driven_lanedir": 2.8083142335681694, "get_state_dump": 0.004928166622126927, "get_robot_state": 0.004100479948629845, "sim_render-ego0": 0.00444430574390116, "get_duckie_state": 1.495426441608718e-06, "in-drivable-lane": 36.14999999999925, "deviation-heading": 6.3737320523936924, "agent_compute-ego0": 0.0139919796355261, "complete-iteration": 0.18785309414383175, "set_robot_commands": 0.002565892510966, "deviation-center-line": 1.8282795547238997, "driven_lanedir_consec": 2.8083142335681694, "sim_compute_sim_state": 0.012547357989588347, "sim_compute_performance-ego0": 0.0022964725684960817}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.501194740926674, "get_ui_image": 0.02567797139919767, "step_physics": 0.0805846695895993, "survival_time": 59.99999999999873, "driven_lanedir": 3.426629988210805, "get_state_dump": 0.004443649050595857, "get_robot_state": 0.003588135494578391, "sim_render-ego0": 0.003798272786390573, "get_duckie_state": 1.2550226953206313e-06, "in-drivable-lane": 30.699999999998447, "deviation-heading": 6.175871395915255, "agent_compute-ego0": 0.012517451842956795, "complete-iteration": 0.14047950272953183, "set_robot_commands": 0.0021480062819837433, "deviation-center-line": 1.998734616014289, "driven_lanedir_consec": 3.426629988210805, "sim_compute_sim_state": 0.005717553068060958, "sim_compute_performance-ego0": 0.0019243212167071263}}
set_robot_commands_max	0.002565892510966
set_robot_commands_mean	0.002322268426175
set_robot_commands_median	0.002287587455875128
set_robot_commands_min	0.0021480062819837433
sim_compute_performance-ego0_max	0.0022964725684960817
sim_compute_performance-ego0_mean	0.0021472587310946045
sim_compute_performance-ego0_median	0.0021841205695876057
sim_compute_performance-ego0_min	0.0019243212167071263
sim_compute_sim_state_max	0.012547357989588347
sim_compute_sim_state_mean	0.010062158286046428
sim_compute_sim_state_median	0.0109918610432682
sim_compute_sim_state_min	0.005717553068060958
sim_render-ego0_max	0.00444430574390116
sim_render-ego0_mean	0.004083170659011622
sim_render-ego0_median	0.004045052052877378
sim_render-ego0_min	0.003798272786390573
simulation-passed	1
step_physics_max	0.15015004147058245
step_physics_mean	0.11051548530727671
step_physics_median	0.1056636150844626
step_physics_min	0.0805846695895993
survival_time_max	59.99999999999873
survival_time_mean	44.474999999999135
survival_time_min	4.299999999999993

No reset possible

57637

10897

Dishank Bansal 🇨🇦

sim-exercise-1

LFv-sim

success

yes

2020-12-03 11:07:40+00:00

2020-12-03 11:24:42+00:00

0:17:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.3866570542404792
survival_time_median	21.15000000000017
deviation-center-line_median	0.8654691737087861
in-drivable-lane_median	7.950000000000113

other stats

agent_compute-ego0_max	0.013307085534407627
agent_compute-ego0_mean	0.012534004839076228
agent_compute-ego0_median	0.012386319627633709
agent_compute-ego0_min	0.01205629456662986
complete-iteration_max	0.210127939142583
complete-iteration_mean	0.18444398600487377
complete-iteration_median	0.18840207218569477
complete-iteration_min	0.15084386050552254
deviation-center-line_max	1.1328830544365516
deviation-center-line_mean	0.8479557575069042
deviation-center-line_min	0.5280016281734933
deviation-heading_max	4.026659855187528
deviation-heading_mean	3.1425345233114492
deviation-heading_median	3.1634029519124782
deviation-heading_min	2.2166723342333112
driven_any_max	10.422594649670025
driven_any_mean	5.02652138255407
driven_any_median	3.5088178291402823
driven_any_min	2.665855222265693
driven_lanedir_consec_max	2.5241769030892263
driven_lanedir_consec_mean	2.286817024841488
driven_lanedir_consec_min	1.8497770877957669
driven_lanedir_max	2.5241769030892263
driven_lanedir_mean	2.286817024841488
driven_lanedir_median	2.3866570542404792
driven_lanedir_min	1.8497770877957669
get_duckie_state_max	1.305087482759738e-06
get_duckie_state_mean	1.213416681366712e-06
get_duckie_state_median	1.2081366345879182e-06
get_duckie_state_min	1.1323059735312738e-06
get_robot_state_max	0.003888920020153172
get_robot_state_mean	0.003660802171878385
get_robot_state_median	0.003613317488061986
get_robot_state_min	0.0035276536912363966
get_state_dump_max	0.004867935632642412
get_state_dump_mean	0.004585084240595512
get_state_dump_median	0.004548391581065375
get_state_dump_min	0.0043756181676088855
get_ui_image_max	0.03316863159156356
get_ui_image_mean	0.029432189159177603
get_ui_image_median	0.029586074129086835
get_ui_image_min	0.025387976786973177
in-drivable-lane_max	44.79999999999863
in-drivable-lane_mean	15.699999999999722
in-drivable-lane_min	2.10000000000003
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 3.5306646902512804, "get_ui_image": 0.027102782133039734, "step_physics": 0.10771728905153946, "survival_time": 21.250000000000167, "driven_lanedir": 2.5241769030892263, "get_state_dump": 0.0045967706492249395, "get_robot_state": 0.0035721002050408735, "sim_render-ego0": 0.003694043472898958, "get_duckie_state": 1.239664677722913e-06, "in-drivable-lane": 6.200000000000088, "deviation-heading": 2.2166723342333112, "agent_compute-ego0": 0.01213329834557475, "complete-iteration": 0.17291427610066015, "set_robot_commands": 0.0021505775585980483, "deviation-center-line": 0.8131606410329293, "driven_lanedir_consec": 2.5241769030892263, "sim_compute_sim_state": 0.009925009499133473, "sim_compute_performance-ego0": 0.0019389542055801609}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.665855222265693, "get_ui_image": 0.03316863159156356, "step_physics": 0.1389917211795072, "survival_time": 16.300000000000097, "driven_lanedir": 2.31511581312421, "get_state_dump": 0.0043756181676088855, "get_robot_state": 0.0035276536912363966, "sim_render-ego0": 0.003717044077881979, "get_duckie_state": 1.1323059735312738e-06, "in-drivable-lane": 2.10000000000003, "deviation-heading": 3.840334123534753, "agent_compute-ego0": 0.01205629456662986, "complete-iteration": 0.210127939142583, "set_robot_commands": 0.0021763299947849474, "deviation-center-line": 1.1328830544365516, "driven_lanedir_consec": 2.31511581312421, "sim_compute_sim_state": 0.010106147976096618, "sim_compute_performance-ego0": 0.001928162501857186}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.4869709680292846, "get_ui_image": 0.03206936612513393, "step_physics": 0.13038766666611223, "survival_time": 21.050000000000164, "driven_lanedir": 1.8497770877957669, "get_state_dump": 0.004867935632642412, "get_robot_state": 0.003888920020153172, "sim_render-ego0": 0.004148026778234689, "get_duckie_state": 1.305087482759738e-06, "in-drivable-lane": 9.700000000000138, "deviation-heading": 2.486471780290204, "agent_compute-ego0": 0.013307085534407627, "complete-iteration": 0.2038898682707294, "set_robot_commands": 0.002319464186356531, "deviation-center-line": 0.5280016281734933, "driven_lanedir_consec": 1.8497770877957669, "sim_compute_sim_state": 0.010621681597560504, "sim_compute_performance-ego0": 0.0021874181467209947}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.422594649670025, "get_ui_image": 0.025387976786973177, "step_physics": 0.0904470792320944, "survival_time": 59.99999999999873, "driven_lanedir": 2.4581982953567487, "get_state_dump": 0.00450001251290581, "get_robot_state": 0.003654534771083098, "sim_render-ego0": 0.0038122461796997985, "get_duckie_state": 1.1766085914529234e-06, "in-drivable-lane": 44.79999999999863, "deviation-heading": 4.026659855187528, "agent_compute-ego0": 0.012639340909692667, "complete-iteration": 0.15084386050552254, "set_robot_commands": 0.0022150169899819, "deviation-center-line": 0.9177777063846428, "driven_lanedir_consec": 2.4581982953567487, "sim_compute_sim_state": 0.0061556461153181264, "sim_compute_performance-ego0": 0.0019498050063972568}}
set_robot_commands_max	0.002319464186356531
set_robot_commands_mean	0.0022153471824303567
set_robot_commands_median	0.0021956734923834235
set_robot_commands_min	0.0021505775585980483
sim_compute_performance-ego0_max	0.0021874181467209947
sim_compute_performance-ego0_mean	0.0020010849651388996
sim_compute_performance-ego0_median	0.0019443796059887089
sim_compute_performance-ego0_min	0.001928162501857186
sim_compute_sim_state_max	0.010621681597560504
sim_compute_sim_state_mean	0.00920212129702718
sim_compute_sim_state_median	0.010015578737615046
sim_compute_sim_state_min	0.0061556461153181264
sim_render-ego0_max	0.004148026778234689
sim_render-ego0_mean	0.003842840127178857
sim_render-ego0_median	0.003764645128790889
sim_render-ego0_min	0.003694043472898958
simulation-passed	1
step_physics_max	0.1389917211795072
step_physics_mean	0.11688593903231333
step_physics_median	0.11905247785882583
step_physics_min	0.0904470792320944
survival_time_max	59.99999999999873
survival_time_mean	29.64999999999979
survival_time_min	16.300000000000097

No reset possible

57636

10900

Daniil Lisus

sim-exercise-1

LFv-sim

timeout

yes

aido5-LFV_multi-sim-testing

2020-12-03 11:07:04+00:00

2020-12-03 11:07:15+00:00

0:00:11

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57629

11428

Frank (Chude) Qian 🇨🇦

template-pytorch

LFVmultibodyv-sim

host-error

yes

2020-12-03 11:02:58+00:00

2020-12-03 11:05:48+00:00

0:02:50

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57592

10885

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 10:38:31+00:00

2020-12-03 11:02:49+00:00

0:24:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.9106716056245108
survival_time_median	51.32499999999922
deviation-center-line_median	0.7902756410796339
in-drivable-lane_median	14.799999999999866

other stats

agent_compute-ego0_max	0.01409909429259825
agent_compute-ego0_mean	0.01335356608628472
agent_compute-ego0_median	0.013325888031574576
agent_compute-ego0_min	0.01266339398939147
complete-iteration_max	0.21834294670506527
complete-iteration_mean	0.1819052656101395
complete-iteration_median	0.178456099679344
complete-iteration_min	0.15236591637680472
deviation-center-line_max	3.159627678092464
deviation-center-line_mean	1.231729012627356
deviation-center-line_min	0.18673709025769292
deviation-heading_max	10.62276480620088
deviation-heading_mean	4.871008495952686
deviation-heading_median	3.6055261564662824
deviation-heading_min	1.650216864677298
driven_any_max	8.68500980525041
driven_any_mean	5.425658292087147
driven_any_median	6.359772939468974
driven_any_min	0.29807748416022994
driven_lanedir_consec_max	7.634837172554285
driven_lanedir_consec_mean	2.8952816467939693
driven_lanedir_consec_min	0.1249462033725708
driven_lanedir_max	7.634837172554285
driven_lanedir_mean	2.9014914950342523
driven_lanedir_median	1.9230913021050768
driven_lanedir_min	0.1249462033725708
get_duckie_state_max	1.4394451918590825e-06
get_duckie_state_mean	1.2692810136592198e-06
get_duckie_state_median	1.2378509991571965e-06
get_duckie_state_min	1.1619768644634043e-06
get_robot_state_max	0.004028798824730187
get_robot_state_mean	0.003726130299286395
get_robot_state_median	0.0036712359826233266
get_robot_state_min	0.0035332504071687396
get_state_dump_max	0.004820314168371697
get_state_dump_mean	0.004637318354430407
get_state_dump_median	0.004667343247641532
get_state_dump_min	0.004394272754066869
get_ui_image_max	0.0356350396808825
get_ui_image_mean	0.030721150321807913
get_ui_image_median	0.030524978379400425
get_ui_image_min	0.026199604847548307
in-drivable-lane_max	47.14999999999869
in-drivable-lane_mean	19.18749999999961
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 8.68500980525041, "get_ui_image": 0.028383835269251433, "step_physics": 0.09687833424710314, "survival_time": 59.99999999999873, "driven_lanedir": 2.018223595171256, "get_state_dump": 0.004703877271958731, "get_robot_state": 0.00368677269509194, "sim_render-ego0": 0.003944568292584447, "get_duckie_state": 1.2429131754828334e-06, "in-drivable-lane": 47.14999999999869, "deviation-heading": 1.650216864677298, "agent_compute-ego0": 0.013203073401534487, "complete-iteration": 0.1642112672378578, "set_robot_commands": 0.0022330824084127077, "deviation-center-line": 0.5457965102883393, "driven_lanedir_consec": 2.018223595171256, "sim_compute_sim_state": 0.00906031772953386, "sim_compute_performance-ego0": 0.002024581291395659}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.29807748416022994, "get_ui_image": 0.0356350396808825, "step_physics": 0.14318870494240207, "survival_time": 4.699999999999991, "driven_lanedir": 0.1249462033725708, "get_state_dump": 0.004394272754066869, "get_robot_state": 0.0035332504071687396, "sim_render-ego0": 0.0037537850831684313, "get_duckie_state": 1.1619768644634043e-06, "in-drivable-lane": 2.0499999999999927, "deviation-heading": 1.9338792064456505, "agent_compute-ego0": 0.01344870266161467, "complete-iteration": 0.21834294670506527, "set_robot_commands": 0.0021794795989990234, "deviation-center-line": 0.18673709025769292, "driven_lanedir_consec": 0.1249462033725708, "sim_compute_sim_state": 0.010182601527163855, "sim_compute_performance-ego0": 0.0019407021371941817}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.929595275133148, "get_ui_image": 0.03266612148954941, "step_physics": 0.11756238501859212, "survival_time": 42.649999999999714, "driven_lanedir": 1.8279590090388975, "get_state_dump": 0.004820314168371697, "get_robot_state": 0.004028798824730187, "sim_render-ego0": 0.004241528220701553, "get_duckie_state": 1.4394451918590825e-06, "in-drivable-lane": 27.549999999999734, "deviation-heading": 5.277173106486915, "agent_compute-ego0": 0.01409909429259825, "complete-iteration": 0.19270093212083017, "set_robot_commands": 0.0024197830249330756, "deviation-center-line": 1.0347547718709285, "driven_lanedir_consec": 1.8031196160777656, "sim_compute_sim_state": 0.010477568840813025, "sim_compute_performance-ego0": 0.002275448493153485}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.7899506038048, "get_ui_image": 0.026199604847548307, "step_physics": 0.0908308626710128, "survival_time": 59.99999999999873, "driven_lanedir": 7.634837172554285, "get_state_dump": 0.0046308092233243335, "get_robot_state": 0.003655699270154714, "sim_render-ego0": 0.003855836480781498, "get_duckie_state": 1.2327888228315595e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.62276480620088, "agent_compute-ego0": 0.01266339398939147, "complete-iteration": 0.15236591637680472, "set_robot_commands": 0.002225510583729867, "deviation-center-line": 3.159627678092464, "driven_lanedir_consec": 7.634837172554285, "sim_compute_sim_state": 0.006247698714790694, "sim_compute_performance-ego0": 0.001965773691245658}}
set_robot_commands_max	0.0024197830249330756
set_robot_commands_mean	0.0022644639040186685
set_robot_commands_median	0.0022292964960712873
set_robot_commands_min	0.0021794795989990234
sim_compute_performance-ego0_max	0.002275448493153485
sim_compute_performance-ego0_mean	0.002051626403247246
sim_compute_performance-ego0_median	0.0019951774913206585
sim_compute_performance-ego0_min	0.0019407021371941817
sim_compute_sim_state_max	0.010477568840813025
sim_compute_sim_state_mean	0.008992046703075358
sim_compute_sim_state_median	0.009621459628348858
sim_compute_sim_state_min	0.006247698714790694
sim_render-ego0_max	0.004241528220701553
sim_render-ego0_mean	0.003948929519308982
sim_render-ego0_median	0.003900202386682972
sim_render-ego0_min	0.0037537850831684313
simulation-passed	1
step_physics_max	0.14318870494240207
step_physics_mean	0.11211507171977753
step_physics_median	0.10722035963284764
step_physics_min	0.0908308626710128
survival_time_max	59.99999999999873
survival_time_mean	41.83749999999929
survival_time_min	4.699999999999991

No reset possible

57572

10891

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 10:30:05+00:00

2020-12-03 10:37:28+00:00

0:07:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.31396446050381466
survival_time_median	10.92500000000002
deviation-center-line_median	0.16983225862532342
in-drivable-lane_median	8.650000000000022

other stats

agent_compute-ego0_max	0.0132853140742142
agent_compute-ego0_mean	0.012825287582895254
agent_compute-ego0_median	0.012829594117560262
agent_compute-ego0_min	0.012356648022246288
complete-iteration_max	0.2615161878722055
complete-iteration_mean	0.20731969010041185
complete-iteration_median	0.19578172039853875
complete-iteration_min	0.17619913173236434
deviation-center-line_max	0.4544023611386169
deviation-center-line_mean	0.22010896178363196
deviation-center-line_min	0.08636896874526415
deviation-heading_max	2.3204281113263505
deviation-heading_mean	1.1403424111321792
deviation-heading_median	0.7640005740519966
deviation-heading_min	0.7129403850983725
driven_any_max	3.1884385482857205
driven_any_mean	1.9961757385528924
driven_any_median	2.07216104202442
driven_any_min	0.6519423218770097
driven_lanedir_consec_max	0.5816798998111024
driven_lanedir_consec_mean	0.3393456361570122
driven_lanedir_consec_min	0.14777372380931708
driven_lanedir_max	0.5821314152239325
driven_lanedir_mean	0.34168930277602333
driven_lanedir_median	0.31824663521533625
driven_lanedir_min	0.1481325254494883
get_duckie_state_max	1.572427295503162e-06
get_duckie_state_mean	1.529613839325171e-06
get_duckie_state_median	1.5570291847894816e-06
get_duckie_state_min	1.4319696922185588e-06
get_robot_state_max	0.003809629760173537
get_robot_state_mean	0.003603446487412523
get_robot_state_median	0.003591431650650871
get_robot_state_min	0.0034212928881748117
get_state_dump_max	0.004898023901518828
get_state_dump_mean	0.004640285490066537
get_state_dump_median	0.004641318605059669
get_state_dump_min	0.004380480848627982
get_ui_image_max	0.03701365561712356
get_ui_image_mean	0.030369438159310175
get_ui_image_median	0.02883921286897976
get_ui_image_min	0.026785671282157624
in-drivable-lane_max	13.15000000000007
in-drivable-lane_mean	8.200000000000028
in-drivable-lane_min	2.3499999999999925
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.6854091429586058, "get_ui_image": 0.026785671282157624, "step_physics": 0.11290170734734845, "survival_time": 13.850000000000062, "driven_lanedir": 0.5821314152239325, "get_state_dump": 0.004380480848627982, "get_robot_state": 0.0034212928881748117, "sim_render-ego0": 0.003746091890678131, "get_duckie_state": 1.5591545928296426e-06, "in-drivable-lane": 10.600000000000064, "deviation-heading": 0.7671668680478522, "agent_compute-ego0": 0.012712801103111652, "complete-iteration": 0.17619913173236434, "set_robot_commands": 0.0020962276047082258, "deviation-center-line": 0.4544023611386169, "driven_lanedir_consec": 0.5816798998111024, "sim_compute_sim_state": 0.008195907091922897, "sim_compute_performance-ego0": 0.0018786895189353888}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6519423218770097, "get_ui_image": 0.03701365561712356, "step_physics": 0.18437351215453376, "survival_time": 4.149999999999993, "driven_lanedir": 0.2733195825226038, "get_state_dump": 0.004842170647212437, "get_robot_state": 0.0037060919262114026, "sim_render-ego0": 0.003991969994136265, "get_duckie_state": 1.572427295503162e-06, "in-drivable-lane": 2.3499999999999925, "deviation-heading": 0.7608342800561411, "agent_compute-ego0": 0.012946387132008873, "complete-iteration": 0.2615161878722055, "set_robot_commands": 0.002200850418635777, "deviation-center-line": 0.12536776212871387, "driven_lanedir_consec": 0.2733195825226038, "sim_compute_sim_state": 0.010339078449067616, "sim_compute_performance-ego0": 0.0020166635513305664}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.1884385482857205, "get_ui_image": 0.03064941047528468, "step_physics": 0.12488207467105412, "survival_time": 16.300000000000097, "driven_lanedir": 0.3631736879080687, "get_state_dump": 0.004440466562906901, "get_robot_state": 0.0034767713750903395, "sim_render-ego0": 0.0036889653687083392, "get_duckie_state": 1.4319696922185588e-06, "in-drivable-lane": 13.15000000000007, "deviation-heading": 2.3204281113263505, "agent_compute-ego0": 0.012356648022246288, "complete-iteration": 0.19157151563451924, "set_robot_commands": 0.00204851065936074, "deviation-center-line": 0.21429675512193297, "driven_lanedir_consec": 0.35460933848502557, "sim_compute_sim_state": 0.008095773352760058, "sim_compute_performance-ego0": 0.001850255767868929}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.458912941090234, "get_ui_image": 0.02702901526267484, "step_physics": 0.13638229103562255, "survival_time": 7.99999999999998, "driven_lanedir": 0.1481325254494883, "get_state_dump": 0.004898023901518828, "get_robot_state": 0.003809629760173537, "sim_render-ego0": 0.0040803873761100055, "get_duckie_state": 1.5549037767493206e-06, "in-drivable-lane": 6.699999999999979, "deviation-heading": 0.7129403850983725, "agent_compute-ego0": 0.0132853140742142, "complete-iteration": 0.19999192516255823, "set_robot_commands": 0.002391958829038632, "deviation-center-line": 0.08636896874526415, "driven_lanedir_consec": 0.14777372380931708, "sim_compute_sim_state": 0.005939156372354638, "sim_compute_performance-ego0": 0.002084274469695476}}
set_robot_commands_max	0.002391958829038632
set_robot_commands_mean	0.002184386877935844
set_robot_commands_median	0.0021485390116720016
set_robot_commands_min	0.00204851065936074
sim_compute_performance-ego0_max	0.002084274469695476
sim_compute_performance-ego0_mean	0.00195747082695759
sim_compute_performance-ego0_median	0.0019476765351329776
sim_compute_performance-ego0_min	0.001850255767868929
sim_compute_sim_state_max	0.010339078449067616
sim_compute_sim_state_mean	0.008142478816526301
sim_compute_sim_state_median	0.008145840222341477
sim_compute_sim_state_min	0.005939156372354638
sim_render-ego0_max	0.0040803873761100055
sim_render-ego0_mean	0.0038768536574081856
sim_render-ego0_median	0.003869030942407198
sim_render-ego0_min	0.0036889653687083392
simulation-passed	1
step_physics_max	0.18437351215453376
step_physics_mean	0.1396348963021397
step_physics_median	0.13063218285333833
step_physics_min	0.11290170734734845
survival_time_max	16.300000000000097
survival_time_mean	10.575000000000031
survival_time_min	4.149999999999993

No reset possible

57487

10912

Dishank Bansal 🇨🇦

sim-exercise-1

LFv-sim

success

yes

2020-12-03 09:59:32+00:00

2020-12-03 10:28:47+00:00

0:29:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.604020557551997
survival_time_median	59.199999999998774
deviation-center-line_median	0.9495494604861532
in-drivable-lane_median	13.499999999999272

other stats

agent_compute-ego0_max	0.0563252067565918
agent_compute-ego0_mean	0.03544800227614208
agent_compute-ego0_median	0.036228299637221975
agent_compute-ego0_min	0.013010203073532588
complete-iteration_max	0.2700657812754313
complete-iteration_mean	0.2090442533686959
complete-iteration_median	0.19044237692648577
complete-iteration_min	0.18522647834638076
deviation-center-line_max	2.5570868438807905
deviation-center-line_mean	1.1508648702658923
deviation-center-line_min	0.14727371621047206
deviation-heading_max	7.762328228959136
deviation-heading_mean	4.394284159714041
deviation-heading_median	4.262850402194171
deviation-heading_min	1.2891076055086863
driven_any_max	9.646948778381166
driven_any_mean	6.987834653294605
driven_any_median	8.990983966586008
driven_any_min	0.3224219016252405
driven_lanedir_consec_max	6.129925579110904
driven_lanedir_consec_mean	3.3769752544693534
driven_lanedir_consec_min	0.16993432366251682
driven_lanedir_max	9.445747731537018
driven_lanedir_mean	4.205930792575882
driven_lanedir_median	3.604020557551997
driven_lanedir_min	0.16993432366251682
get_duckie_state_max	1.319342112164017e-06
get_duckie_state_mean	1.2505540913425257e-06
get_duckie_state_median	1.2469801360431473e-06
get_duckie_state_min	1.1889139811197916e-06
get_robot_state_max	0.003781454648503058
get_robot_state_mean	0.003691505439800018
get_robot_state_median	0.003698878556124532
get_robot_state_min	0.0035868099984479487
get_state_dump_max	0.005181368239625486
get_state_dump_mean	0.0049506387460963265
get_state_dump_median	0.005002769518652923
get_state_dump_min	0.0046156477074539735
get_ui_image_max	0.03582388877868652
get_ui_image_mean	0.030534882108073817
get_ui_image_median	0.03047668003089913
get_ui_image_min	0.025362279591810494
in-drivable-lane_max	43.94999999999861
in-drivable-lane_mean	17.849999999999284
in-drivable-lane_min	0.4499999999999744
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 9.646948778381166, "get_ui_image": 0.02886502649464476, "step_physics": 0.11013130919323871, "survival_time": 59.99999999999873, "driven_lanedir": 9.445747731537018, "get_state_dump": 0.005119827367383971, "get_robot_state": 0.003781454648503058, "sim_render-ego0": 0.0039925491879325824, "get_duckie_state": 1.319342112164017e-06, "in-drivable-lane": 0.4499999999999744, "deviation-heading": 7.762328228959136, "agent_compute-ego0": 0.021707576081516543, "complete-iteration": 0.1887596614354854, "set_robot_commands": 0.0023050248672523465, "deviation-center-line": 2.5570868438807905, "driven_lanedir_consec": 6.129925579110904, "sim_compute_sim_state": 0.01069452998838655, "sim_compute_performance-ego0": 0.0020657060148316954}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.3224219016252405, "get_ui_image": 0.03582388877868652, "step_physics": 0.15100943247477214, "survival_time": 3.699999999999995, "driven_lanedir": 0.16993432366251682, "get_state_dump": 0.004885711669921875, "get_robot_state": 0.003675845464070638, "sim_render-ego0": 0.003801107406616211, "get_duckie_state": 1.1889139811197916e-06, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 1.2891076055086863, "agent_compute-ego0": 0.0563252067565918, "complete-iteration": 0.2700657812754313, "set_robot_commands": 0.0022773234049479167, "deviation-center-line": 0.14727371621047206, "driven_lanedir_consec": 0.16993432366251682, "sim_compute_sim_state": 0.01020541508992513, "sim_compute_performance-ego0": 0.001970974604288737}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.872893033946323, "get_ui_image": 0.0320883335671535, "step_physics": 0.11604799461527908, "survival_time": 58.39999999999882, "driven_lanedir": 4.909567882766077, "get_state_dump": 0.005181368239625486, "get_robot_state": 0.003721911648178427, "sim_render-ego0": 0.003988947799003869, "get_duckie_state": 1.3036540270463538e-06, "in-drivable-lane": 25.449999999998553, "deviation-heading": 5.516657827545817, "agent_compute-ego0": 0.013010203073532588, "complete-iteration": 0.1921250924174861, "set_robot_commands": 0.002173749272694845, "deviation-center-line": 1.080934572173674, "driven_lanedir_consec": 4.909567882766077, "sim_compute_sim_state": 0.013740911149285204, "sim_compute_performance-ego0": 0.002075671333854682}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.109074899225693, "get_ui_image": 0.025362279591810494, "step_physics": 0.08700685239056564, "survival_time": 59.99999999999873, "driven_lanedir": 2.298473232337916, "get_state_dump": 0.0046156477074539735, "get_robot_state": 0.0035868099984479487, "sim_render-ego0": 0.0037747634439841593, "get_duckie_state": 1.1903062450399407e-06, "in-drivable-lane": 43.94999999999861, "deviation-heading": 3.009042976842524, "agent_compute-ego0": 0.0507490231929274, "complete-iteration": 0.18522647834638076, "set_robot_commands": 0.0021832173908878424, "deviation-center-line": 0.8181643487986322, "driven_lanedir_consec": 2.298473232337916, "sim_compute_sim_state": 0.005953195986402322, "sim_compute_performance-ego0": 0.0019044498916867376}}
set_robot_commands_max	0.0023050248672523465
set_robot_commands_mean	0.0022348287339457374
set_robot_commands_median	0.0022302703979178795
set_robot_commands_min	0.002173749272694845
sim_compute_performance-ego0_max	0.002075671333854682
sim_compute_performance-ego0_mean	0.002004200461165463
sim_compute_performance-ego0_median	0.0020183403095602164
sim_compute_performance-ego0_min	0.0019044498916867376
sim_compute_sim_state_max	0.013740911149285204
sim_compute_sim_state_mean	0.0101485130534998
sim_compute_sim_state_median	0.01044997253915584
sim_compute_sim_state_min	0.005953195986402322
sim_render-ego0_max	0.0039925491879325824
sim_render-ego0_mean	0.003889341959384205
sim_render-ego0_median	0.00389502760281004
sim_render-ego0_min	0.0037747634439841593
simulation-passed	1
step_physics_max	0.15100943247477214
step_physics_mean	0.11604889716846392
step_physics_median	0.1130896519042589
step_physics_min	0.08700685239056564
survival_time_max	59.99999999999873
survival_time_mean	45.52499999999907
survival_time_min	3.699999999999995

No reset possible

57480

11426

Frank (Chude) Qian 🇨🇦

template-pytorch

aido5-LFP-sim-testing

LFP-sim

host-error

yes

2020-12-03 09:57:58+00:00

2020-12-03 09:58:51+00:00

0:00:53

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57351

10947

exercise_ros_template

LFv-sim

success

yes

2020-12-03 09:32:43+00:00

2020-12-03 09:53:39+00:00

0:20:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6635276503927638
survival_time_median	36.9749999999994
deviation-center-line_median	0.2459255170291532
in-drivable-lane_median	7.299999999999995

other stats

agent_compute-ego0_max	0.034447216136114935
agent_compute-ego0_mean	0.03333358712226722
agent_compute-ego0_median	0.033554815772233404
agent_compute-ego0_min	0.03177750080848713
complete-iteration_max	0.22932356869408843
complete-iteration_mean	0.19331183160721505
complete-iteration_median	0.1851784646865572
complete-iteration_min	0.17356682836165735
deviation-center-line_max	2.1690475373781437
deviation-center-line_mean	0.7171612406016971
deviation-center-line_min	0.2077463909703383
deviation-heading_max	8.80897134271336
deviation-heading_mean	3.089786005879437
deviation-heading_median	1.2756791254603668
deviation-heading_min	0.9988144298836548
driven_any_max	8.324124365198058
driven_any_mean	4.784212977194561
driven_any_median	4.746707224897276
driven_any_min	1.3193130937856332
driven_lanedir_consec_max	7.277566073673901
driven_lanedir_consec_mean	2.3111667166133394
driven_lanedir_consec_min	0.6400454919939287
driven_lanedir_max	7.277566073673901
driven_lanedir_mean	2.3111667166133394
driven_lanedir_median	0.6635276503927638
driven_lanedir_min	0.6400454919939287
get_duckie_state_max	2.1042080100523222e-06
get_duckie_state_mean	1.980811408070498e-06
get_duckie_state_median	1.992272312581305e-06
get_duckie_state_min	1.83449299706706e-06
get_robot_state_max	0.003734543559751741
get_robot_state_mean	0.003564270061350891
get_robot_state_median	0.00356001678956758
get_robot_state_min	0.0034025031065166643
get_state_dump_max	0.004701105383016188
get_state_dump_mean	0.004563397869297627
get_state_dump_median	0.004602611135217809
get_state_dump_min	0.004347263823738702
get_ui_image_max	0.0359488331943477
get_ui_image_mean	0.029605535525210978
get_ui_image_median	0.028705574888472356
get_ui_image_min	0.02506215912955148
in-drivable-lane_max	54.64999999999874
in-drivable-lane_mean	18.64999999999969
in-drivable-lane_min	5.350000000000031
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 8.324124365198058, "get_ui_image": 0.026089130492134953, "step_physics": 0.09054727002444812, "survival_time": 59.99999999999873, "driven_lanedir": 7.277566073673901, "get_state_dump": 0.004347263823738702, "get_robot_state": 0.0034025031065166643, "sim_render-ego0": 0.0035828279515884996, "get_duckie_state": 1.83449299706706e-06, "in-drivable-lane": 5.849999999999916, "deviation-heading": 8.80897134271336, "agent_compute-ego0": 0.03278845136707569, "complete-iteration": 0.17356682836165735, "set_robot_commands": 0.002015742135980941, "deviation-center-line": 2.1690475373781437, "driven_lanedir_consec": 7.277566073673901, "sim_compute_sim_state": 0.008915846591984402, "sim_compute_performance-ego0": 0.0018012503799451182}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3193130937856332, "get_ui_image": 0.0359488331943477, "step_physics": 0.1323409539843918, "survival_time": 10.85000000000002, "driven_lanedir": 0.6711294387889155, "get_state_dump": 0.004633169655406147, "get_robot_state": 0.0036332333853485383, "sim_render-ego0": 0.003914238116063109, "get_duckie_state": 2.1042080100523222e-06, "in-drivable-lane": 5.350000000000031, "deviation-heading": 1.5430868459961558, "agent_compute-ego0": 0.03432118017739112, "complete-iteration": 0.22932356869408843, "set_robot_commands": 0.002370147530092012, "deviation-center-line": 0.2678881248946068, "driven_lanedir_consec": 0.6711294387889155, "sim_compute_sim_state": 0.010087059178483597, "sim_compute_performance-ego0": 0.0019922748618169664}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.750630534147892, "get_ui_image": 0.03132201928480976, "step_physics": 0.10250017545701662, "survival_time": 59.99999999999873, "driven_lanedir": 0.6559258619966121, "get_state_dump": 0.004701105383016188, "get_robot_state": 0.003734543559751741, "sim_render-ego0": 0.003982611440996842, "get_duckie_state": 1.972462116530495e-06, "in-drivable-lane": 54.64999999999874, "deviation-heading": 0.9988144298836548, "agent_compute-ego0": 0.03177750080848713, "complete-iteration": 0.1956171479252951, "set_robot_commands": 0.0022278856377518246, "deviation-center-line": 0.2077463909703383, "driven_lanedir_consec": 0.6559258619966121, "sim_compute_sim_state": 0.013189434707412913, "sim_compute_performance-ego0": 0.0021019652920102796}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.742783915646659, "get_ui_image": 0.02506215912955148, "step_physics": 0.09418772544179645, "survival_time": 13.950000000000063, "driven_lanedir": 0.6400454919939287, "get_state_dump": 0.004572052615029471, "get_robot_state": 0.0034868001937866213, "sim_render-ego0": 0.0038288797651018416, "get_duckie_state": 2.012082508632115e-06, "in-drivable-lane": 8.750000000000075, "deviation-heading": 1.0082714049245776, "agent_compute-ego0": 0.034447216136114935, "complete-iteration": 0.1747397814478193, "set_robot_commands": 0.0021395300115857807, "deviation-center-line": 0.22396290916369965, "driven_lanedir_consec": 0.6400454919939287, "sim_compute_sim_state": 0.005037803309304373, "sim_compute_performance-ego0": 0.0018983006477355955}}
set_robot_commands_max	0.002370147530092012
set_robot_commands_mean	0.0021883263288526396
set_robot_commands_median	0.002183707824668803
set_robot_commands_min	0.002015742135980941
sim_compute_performance-ego0_max	0.0021019652920102796
sim_compute_performance-ego0_mean	0.00194844779537699
sim_compute_performance-ego0_median	0.001945287754776281
sim_compute_performance-ego0_min	0.0018012503799451182
sim_compute_sim_state_max	0.013189434707412913
sim_compute_sim_state_mean	0.00930753594679632
sim_compute_sim_state_median	0.009501452885233998
sim_compute_sim_state_min	0.005037803309304373
sim_render-ego0_max	0.003982611440996842
sim_render-ego0_mean	0.003827139318437573
sim_render-ego0_median	0.0038715589405824754
sim_render-ego0_min	0.0035828279515884996
simulation-passed	1
step_physics_max	0.1323409539843918
step_physics_mean	0.10489403122691324
step_physics_median	0.09834395044940653
step_physics_min	0.09054727002444812
survival_time_max	59.99999999999873
survival_time_mean	36.199999999999385
survival_time_min	10.85000000000002

No reset possible

57272

10973

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 09:13:04+00:00

2020-12-03 09:31:22+00:00

0:18:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.4210264677470112
survival_time_median	25.424999999999876
deviation-center-line_median	0.7538164843051756
in-drivable-lane_median	17.649999999999913

other stats

agent_compute-ego0_max	0.012845634755508676
agent_compute-ego0_mean	0.012421568287007889
agent_compute-ego0_median	0.01241828286317733
agent_compute-ego0_min	0.012004072666168214
complete-iteration_max	0.23075875759124756
complete-iteration_mean	0.19902416632934183
complete-iteration_median	0.19911927310557703
complete-iteration_min	0.16709936151496577
deviation-center-line_max	1.7857220375701073
deviation-center-line_mean	0.8588159515006792
deviation-center-line_min	0.14190879982225874
deviation-heading_max	11.96763258431313
deviation-heading_mean	5.009593331886197
deviation-heading_median	3.5763655224223556
deviation-heading_min	0.9180096983869492
driven_any_max	11.752950382102384
driven_any_mean	5.519259206205342
driven_any_median	4.826417731540104
driven_any_min	0.6712509796387744
driven_lanedir_consec_max	3.650215997531058
driven_lanedir_consec_mean	1.6943355729773304
driven_lanedir_consec_min	0.2850733588842411
driven_lanedir_max	4.505535089011568
driven_lanedir_mean	2.054785141416629
driven_lanedir_median	1.714266058885353
driven_lanedir_min	0.2850733588842411
get_duckie_state_max	1.4729033222061925e-06
get_duckie_state_mean	1.373763155191146e-06
get_duckie_state_median	1.3784018669339176e-06
get_duckie_state_min	1.2653455646905573e-06
get_robot_state_max	0.003834957575929758
get_robot_state_mean	0.003700945146955344
get_robot_state_median	0.0036961450127257936
get_robot_state_min	0.003576532986440031
get_state_dump_max	0.004664481674110033
get_state_dump_mean	0.004610116206834356
get_state_dump_median	0.0046406148726160605
get_state_dump_min	0.00449475340799527
get_ui_image_max	0.03563255786895752
get_ui_image_mean	0.02987828138050313
get_ui_image_median	0.029023202443877676
get_ui_image_min	0.025834162765299647
in-drivable-lane_max	36.04999999999909
in-drivable-lane_mean	18.499999999999726
in-drivable-lane_min	2.6499999999999906
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 7.686718515548966, "get_ui_image": 0.02749820512348257, "step_physics": 0.12369320017056704, "survival_time": 41.84999999999976, "driven_lanedir": 1.8761643609853844, "get_state_dump": 0.0046208140958180575, "get_robot_state": 0.0037637428338317142, "sim_render-ego0": 0.0038884835482212695, "get_duckie_state": 1.4729033222061925e-06, "in-drivable-lane": 32.64999999999982, "deviation-heading": 5.592217147777675, "agent_compute-ego0": 0.012728976463645625, "complete-iteration": 0.19118838606131103, "set_robot_commands": 0.002212159104449652, "deviation-center-line": 0.896768571848211, "driven_lanedir_consec": 1.2896851787087005, "sim_compute_sim_state": 0.010532061638297216, "sim_compute_performance-ego0": 0.002151022662979891}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6712509796387744, "get_ui_image": 0.03563255786895752, "step_physics": 0.1566799259185791, "survival_time": 4.94999999999999, "driven_lanedir": 0.2850733588842411, "get_state_dump": 0.004660415649414063, "get_robot_state": 0.003628547191619873, "sim_render-ego0": 0.0037510514259338377, "get_duckie_state": 1.3065338134765626e-06, "in-drivable-lane": 2.6499999999999906, "deviation-heading": 0.9180096983869492, "agent_compute-ego0": 0.012004072666168214, "complete-iteration": 0.23075875759124756, "set_robot_commands": 0.002179560661315918, "deviation-center-line": 0.14190879982225874, "driven_lanedir_consec": 0.2850733588842411, "sim_compute_sim_state": 0.010201995372772216, "sim_compute_performance-ego0": 0.0019377565383911133}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.9661169475312417, "get_ui_image": 0.030548199764272786, "step_physics": 0.13701926805696435, "survival_time": 8.999999999999993, "driven_lanedir": 1.5523677567853218, "get_state_dump": 0.004664481674110033, "get_robot_state": 0.003834957575929758, "sim_render-ego0": 0.003973938483559624, "get_duckie_state": 1.4502699203912723e-06, "in-drivable-lane": 2.6500000000000075, "deviation-heading": 1.5605138970670358, "agent_compute-ego0": 0.012845634755508676, "complete-iteration": 0.20705016014984295, "set_robot_commands": 0.0021832766453864167, "deviation-center-line": 0.6108643967621402, "driven_lanedir_consec": 1.5523677567853218, "sim_compute_sim_state": 0.009741029686690694, "sim_compute_performance-ego0": 0.002139158670414877}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.752950382102384, "get_ui_image": 0.025834162765299647, "step_physics": 0.1070363672448634, "survival_time": 59.99999999999873, "driven_lanedir": 4.505535089011568, "get_state_dump": 0.00449475340799527, "get_robot_state": 0.003576532986440031, "sim_render-ego0": 0.0037140365841982262, "get_duckie_state": 1.2653455646905573e-06, "in-drivable-lane": 36.04999999999909, "deviation-heading": 11.96763258431313, "agent_compute-ego0": 0.012107589262709034, "complete-iteration": 0.16709936151496577, "set_robot_commands": 0.002110616650609152, "deviation-center-line": 1.7857220375701073, "driven_lanedir_consec": 3.650215997531058, "sim_compute_sim_state": 0.006250974836198615, "sim_compute_performance-ego0": 0.001890345080309764}}
set_robot_commands_max	0.002212159104449652
set_robot_commands_mean	0.002171403265440285
set_robot_commands_median	0.0021814186533511675
set_robot_commands_min	0.002110616650609152
sim_compute_performance-ego0_max	0.002151022662979891
sim_compute_performance-ego0_mean	0.0020295707380239116
sim_compute_performance-ego0_median	0.002038457604402995
sim_compute_performance-ego0_min	0.001890345080309764
sim_compute_sim_state_max	0.010532061638297216
sim_compute_sim_state_mean	0.009181515383489686
sim_compute_sim_state_median	0.009971512529731457
sim_compute_sim_state_min	0.006250974836198615
sim_render-ego0_max	0.003973938483559624
sim_render-ego0_mean	0.00383187751047824
sim_render-ego0_median	0.0038197674870775536
sim_render-ego0_min	0.0037140365841982262
simulation-passed	1
step_physics_max	0.1566799259185791
step_physics_mean	0.13110719034774346
step_physics_median	0.13035623411376568
step_physics_min	0.1070363672448634
survival_time_max	59.99999999999873
survival_time_mean	28.94999999999962
survival_time_min	4.94999999999999

No reset possible

57241

11312

aido5-LFP-sim-validation

template-pytorch

LFP-sim

host-error

2020-12-03 09:08:20+00:00

2020-12-03 09:10:54+00:00

0:02:34

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57107

11018

Olga (Ge Ya) Xu 🇨🇦

exercise_ros_template

LFv-sim

success

yes

aido5-LFP-sim-validation

2020-12-03 08:31:14+00:00

2020-12-03 09:06:26+00:00

0:35:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	6.135973644363152
survival_time_median	59.99999999999873
deviation-center-line_median	4.53133004822749
in-drivable-lane_median	6.449999999999758

other stats

agent_compute-ego0_max	0.022889284964505083
agent_compute-ego0_mean	0.015156710028747637
agent_compute-ego0_median	0.012625960882855496
agent_compute-ego0_min	0.012485633384774469
complete-iteration_max	0.19704543442452185
complete-iteration_mean	0.17738175109264556
complete-iteration_median	0.175621946288783
complete-iteration_min	0.1612376773684944
deviation-center-line_max	4.63729035842144
deviation-center-line_mean	4.477154932403478
deviation-center-line_min	4.208669274737491
deviation-heading_max	15.82274140537251
deviation-heading_mean	14.78505634544521
deviation-heading_median	14.707085445664015
deviation-heading_min	13.903313085080294
driven_any_max	9.33020056436231
driven_any_mean	7.5887469522546995
driven_any_median	7.053750792947845
driven_any_min	6.9172856587608
driven_lanedir_consec_max	8.88334044660533
driven_lanedir_consec_mean	6.6302233816441145
driven_lanedir_consec_min	5.365605791244825
driven_lanedir_max	8.88334044660533
driven_lanedir_mean	6.630576415849154
driven_lanedir_median	6.135973644363152
driven_lanedir_min	5.3670179280649855
get_duckie_state_max	1.4499661130373127e-06
get_duckie_state_mean	1.3472337111346825e-06
get_duckie_state_median	1.3650009574540747e-06
get_duckie_state_min	1.2089668165932683e-06
get_robot_state_max	0.003777162518529074
get_robot_state_mean	0.003729064944979551
get_robot_state_median	0.0037277439651044577
get_robot_state_min	0.0036836093311802135
get_state_dump_max	0.004711363535935833
get_state_dump_mean	0.004641081024268386
get_state_dump_median	0.004650970680529033
get_state_dump_min	0.0045510192000796455
get_ui_image_max	0.03547432758131194
get_ui_image_mean	0.030256057262023624
get_ui_image_median	0.030038020592942825
get_ui_image_min	0.0254738602808969
in-drivable-lane_max	11.44999999999935
in-drivable-lane_mean	6.462499999999695
in-drivable-lane_min	1.4999999999999147
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 9.33020056436231, "get_ui_image": 0.0284575915753494, "step_physics": 0.10050651731340216, "survival_time": 59.99999999999873, "driven_lanedir": 8.88334044660533, "get_state_dump": 0.004648517708695004, "get_robot_state": 0.0036836093311802135, "sim_render-ego0": 0.0038830568947264, "get_duckie_state": 1.4499661130373127e-06, "in-drivable-lane": 1.4999999999999147, "deviation-heading": 14.757610691134229, "agent_compute-ego0": 0.012485633384774469, "complete-iteration": 0.1672074195248797, "set_robot_commands": 0.002219951718574162, "deviation-center-line": 4.208669274737491, "driven_lanedir_consec": 8.88334044660533, "sim_compute_sim_state": 0.009238397350517735, "sim_compute_performance-ego0": 0.001995942078462548}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.045684985613738, "get_ui_image": 0.03547432758131194, "step_physics": 0.12004612844055836, "survival_time": 59.99999999999873, "driven_lanedir": 6.023670432342982, "get_state_dump": 0.004711363535935833, "get_robot_state": 0.003777162518529074, "sim_render-ego0": 0.00401506197641136, "get_duckie_state": 1.3858452129125794e-06, "in-drivable-lane": 7.799999999999557, "deviation-heading": 15.82274140537251, "agent_compute-ego0": 0.012657274910055728, "complete-iteration": 0.19704543442452185, "set_robot_commands": 0.0022985297972514768, "deviation-center-line": 4.515731107096844, "driven_lanedir_consec": 6.023670432342982, "sim_compute_sim_state": 0.01188471096937702, "sim_compute_performance-ego0": 0.00209059405584915}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.061816600281953, "get_ui_image": 0.031618449610536246, "step_physics": 0.1103319794212551, "survival_time": 59.99999999999873, "driven_lanedir": 5.3670179280649855, "get_state_dump": 0.0045510192000796455, "get_robot_state": 0.003695722821352384, "sim_render-ego0": 0.0038979021734639463, "get_duckie_state": 1.2089668165932683e-06, "in-drivable-lane": 11.44999999999935, "deviation-heading": 14.656560200193804, "agent_compute-ego0": 0.01259464685565526, "complete-iteration": 0.1840364730526863, "set_robot_commands": 0.0022852811884820513, "deviation-center-line": 4.546928989358136, "driven_lanedir_consec": 5.365605791244825, "sim_compute_sim_state": 0.012977831965183637, "sim_compute_performance-ego0": 0.0019975377558470765}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.9172856587608, "get_ui_image": 0.0254738602808969, "step_physics": 0.08990166506898294, "survival_time": 59.99999999999873, "driven_lanedir": 6.248276856383322, "get_state_dump": 0.004653423652363061, "get_robot_state": 0.0037597651088565314, "sim_render-ego0": 0.003957725186629855, "get_duckie_state": 1.34415670199557e-06, "in-drivable-lane": 5.099999999999959, "deviation-heading": 13.903313085080294, "agent_compute-ego0": 0.022889284964505083, "complete-iteration": 0.1612376773684944, "set_robot_commands": 0.002261598540980254, "deviation-center-line": 4.63729035842144, "driven_lanedir_consec": 6.248276856383322, "sim_compute_sim_state": 0.006186630406248679, "sim_compute_performance-ego0": 0.002062426320122839}}
set_robot_commands_max	0.0022985297972514768
set_robot_commands_mean	0.002266340311321986
set_robot_commands_median	0.0022734398647311525
set_robot_commands_min	0.002219951718574162
sim_compute_performance-ego0_max	0.00209059405584915
sim_compute_performance-ego0_mean	0.002036625052570403
sim_compute_performance-ego0_median	0.0020299820379849577
sim_compute_performance-ego0_min	0.001995942078462548
sim_compute_sim_state_max	0.012977831965183637
sim_compute_sim_state_mean	0.010071892672831768
sim_compute_sim_state_median	0.01056155415994738
sim_compute_sim_state_min	0.006186630406248679
sim_render-ego0_max	0.00401506197641136
sim_render-ego0_mean	0.00393843655780789
sim_render-ego0_median	0.003927813680046901
sim_render-ego0_min	0.0038830568947264
simulation-passed	1
step_physics_max	0.12004612844055836
step_physics_mean	0.10519657256104964
step_physics_median	0.10541924836732865
step_physics_min	0.08990166506898294
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

57086

11425

Frank (Chude) Qian 🇨🇦

template-pytorch

LFP-sim

host-error

2020-12-03 08:27:51+00:00

2020-12-03 08:28:41+00:00

0:00:50

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57076

11313

aido5-LFV_multi-sim-validation

template-pytorch

LFVmultibodyv-sim

host-error

yes

2020-12-03 08:26:16+00:00

2020-12-03 08:27:13+00:00

0:00:57

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57010

11040

Fernanda Custodio Pereira do Carmo 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 08:14:28+00:00

2020-12-03 08:24:45+00:00

0:10:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.4419155316708503
survival_time_median	16.075000000000095
deviation-center-line_median	0.36890160398364336
in-drivable-lane_median	7.475000000000069

other stats

agent_compute-ego0_max	0.013407789014872148
agent_compute-ego0_mean	0.013027607911459169
agent_compute-ego0_median	0.013052771014354297
agent_compute-ego0_min	0.012597100602255927
complete-iteration_max	0.218436762877588
complete-iteration_mean	0.17947388773677644
complete-iteration_median	0.17107492901064084
complete-iteration_min	0.15730893004823615
deviation-center-line_max	0.6961955457973529
deviation-center-line_mean	0.40559481463553254
deviation-center-line_min	0.18838050477749063
deviation-heading_max	2.1193080533279143
deviation-heading_mean	1.5133305133338064
deviation-heading_median	1.6323696532411305
deviation-heading_min	0.6692746935250502
driven_any_max	4.4007330339506066
driven_any_mean	3.0433021746985873
driven_any_median	3.1403418538317664
driven_any_min	1.4917919571802096
driven_lanedir_consec_max	2.2423891747657456
driven_lanedir_consec_mean	1.464783418797714
driven_lanedir_consec_min	0.7329134370834103
driven_lanedir_max	2.2423891747657456
driven_lanedir_mean	1.464783418797714
driven_lanedir_median	1.4419155316708503
driven_lanedir_min	0.7329134370834103
get_duckie_state_max	1.3712004487737646e-06
get_duckie_state_mean	1.3448023836710511e-06
get_duckie_state_median	1.3540894622662326e-06
get_duckie_state_min	1.2998301613779743e-06
get_robot_state_max	0.0037959280373162305
get_robot_state_mean	0.003719417551934152
get_robot_state_median	0.003733716204580543
get_robot_state_min	0.003614309761259291
get_state_dump_max	0.004889381930158644
get_state_dump_mean	0.004738920219776349
get_state_dump_median	0.004704865389676472
get_state_dump_min	0.004656568169593811
get_ui_image_max	0.036484267422344896
get_ui_image_mean	0.030655537301024095
get_ui_image_median	0.02964680713119352
get_ui_image_min	0.026844267519364445
in-drivable-lane_max	14.500000000000137
in-drivable-lane_mean	7.912500000000076
in-drivable-lane_min	2.2000000000000313
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 4.4007330339506066, "get_ui_image": 0.028166678768617136, "step_physics": 0.08970388052640138, "survival_time": 21.55000000000017, "driven_lanedir": 2.2423891747657456, "get_state_dump": 0.004656568169593811, "get_robot_state": 0.003614309761259291, "sim_render-ego0": 0.0038667944846329863, "get_duckie_state": 1.362076512089482e-06, "in-drivable-lane": 10.800000000000152, "deviation-heading": 1.3466996835616158, "agent_compute-ego0": 0.012597100602255927, "complete-iteration": 0.15730893004823615, "set_robot_commands": 0.0021798202285060178, "deviation-center-line": 0.4466692392582318, "driven_lanedir_consec": 2.2423891747657456, "sim_compute_sim_state": 0.0105190255023815, "sim_compute_performance-ego0": 0.0019216703044043649}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.236585254177939, "get_ui_image": 0.036484267422344896, "step_physics": 0.1401926543423321, "survival_time": 11.900000000000034, "driven_lanedir": 1.8735978367163049, "get_state_dump": 0.004701428832369369, "get_robot_state": 0.0037959280373162305, "sim_render-ego0": 0.004106168467629405, "get_duckie_state": 1.2998301613779743e-06, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 2.1193080533279143, "agent_compute-ego0": 0.013407789014872148, "complete-iteration": 0.218436762877588, "set_robot_commands": 0.0023298453087587235, "deviation-center-line": 0.6961955457973529, "driven_lanedir_consec": 1.8735978367163049, "sim_compute_sim_state": 0.011202520905179458, "sim_compute_performance-ego0": 0.0021286070596224092}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.044098453485594, "get_ui_image": 0.031126935493769905, "step_physics": 0.1107843303915315, "survival_time": 20.250000000000153, "driven_lanedir": 1.0102332266253955, "get_state_dump": 0.004889381930158644, "get_robot_state": 0.0036773781471064527, "sim_render-ego0": 0.004073403738989618, "get_duckie_state": 1.3712004487737646e-06, "in-drivable-lane": 14.500000000000137, "deviation-heading": 1.9180396229206444, "agent_compute-ego0": 0.01327506544554762, "complete-iteration": 0.18345842807750984, "set_robot_commands": 0.0021247617129621834, "deviation-center-line": 0.29113396870905484, "driven_lanedir_consec": 1.0102332266253955, "sim_compute_sim_state": 0.01131796132167572, "sim_compute_performance-ego0": 0.0020993108232620315}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.4917919571802096, "get_ui_image": 0.026844267519364445, "step_physics": 0.09698846029198688, "survival_time": 7.99999999999998, "driven_lanedir": 0.7329134370834103, "get_state_dump": 0.004708301946983575, "get_robot_state": 0.003790054262054633, "sim_render-ego0": 0.0039034926373025646, "get_duckie_state": 1.3461024124429834e-06, "in-drivable-lane": 4.149999999999985, "deviation-heading": 0.6692746935250502, "agent_compute-ego0": 0.01283047658316097, "complete-iteration": 0.15869142994377183, "set_robot_commands": 0.002215683090020411, "deviation-center-line": 0.18838050477749063, "driven_lanedir_consec": 0.7329134370834103, "sim_compute_sim_state": 0.005344313864382158, "sim_compute_performance-ego0": 0.001982625226796784}}
set_robot_commands_max	0.0023298453087587235
set_robot_commands_mean	0.0022125275850618338
set_robot_commands_median	0.0021977516592632143
set_robot_commands_min	0.0021247617129621834
sim_compute_performance-ego0_max	0.0021286070596224092
sim_compute_performance-ego0_mean	0.0020330533535213974
sim_compute_performance-ego0_median	0.002040968025029408
sim_compute_performance-ego0_min	0.0019216703044043649
sim_compute_sim_state_max	0.01131796132167572
sim_compute_sim_state_mean	0.00959595539840471
sim_compute_sim_state_median	0.01086077320378048
sim_compute_sim_state_min	0.005344313864382158
sim_render-ego0_max	0.004106168467629405
sim_render-ego0_mean	0.003987464832138644
sim_render-ego0_median	0.003988448188146091
sim_render-ego0_min	0.0038667944846329863
simulation-passed	1
step_physics_max	0.1401926543423321
step_physics_mean	0.10941733138806298
step_physics_median	0.1038863953417592
step_physics_min	0.08970388052640138
survival_time_max	21.55000000000017
survival_time_mean	15.425000000000084
survival_time_min	7.99999999999998

No reset possible

56920

11056

Bhavya Patwa 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 07:53:02+00:00

2020-12-03 08:14:05+00:00

0:21:03

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 1770 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

56880

11068

Étienne Boucher 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 07:45:20+00:00

2020-12-03 07:51:39+00:00

0:06:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6686410004768379
survival_time_median	5.774999999999988
deviation-center-line_median	0.13170054806002218
in-drivable-lane_median	2.7749999999999915

other stats

agent_compute-ego0_max	0.013889285496303014
agent_compute-ego0_mean	0.012690456899388242
agent_compute-ego0_median	0.012442727857880722
agent_compute-ego0_min	0.01198708638548851
complete-iteration_max	0.20154266130356563
complete-iteration_mean	0.17898527319754637
complete-iteration_median	0.18287329752332632
complete-iteration_min	0.14865183643996716
deviation-center-line_max	0.5208601028005717
deviation-center-line_mean	0.21931563450431088
deviation-center-line_min	0.0930013390966274
deviation-heading_max	1.3772308129971225
deviation-heading_mean	0.7875702992885585
deviation-heading_median	0.6973321406794115
deviation-heading_min	0.37838610279828855
driven_any_max	2.4842546828207253
driven_any_mean	1.7592469706031826
driven_any_median	1.6456924558182862
driven_any_min	1.2613482879554334
driven_lanedir_consec_max	2.029530283703435
driven_lanedir_consec_mean	0.9337523468445322
driven_lanedir_consec_min	0.368197102721018
driven_lanedir_max	2.029530283703435
driven_lanedir_mean	0.9337523468445322
driven_lanedir_median	0.6686410004768379
driven_lanedir_min	0.368197102721018
get_duckie_state_max	1.784733363560268e-06
get_duckie_state_mean	1.6996480742163844e-06
get_duckie_state_median	1.7067054059447311e-06
get_duckie_state_min	1.6004481214158078e-06
get_robot_state_max	0.004316604705083938
get_robot_state_mean	0.003846268744391136
get_robot_state_median	0.0037174064010675545
get_robot_state_min	0.003633657470345497
get_state_dump_max	0.005403109959193638
get_state_dump_mean	0.004988440970736741
get_state_dump_median	0.004910215588511738
get_state_dump_min	0.004730222746729851
get_ui_image_max	0.03342911284020607
get_ui_image_mean	0.02985358367581466
get_ui_image_median	0.030332145728300675
get_ui_image_min	0.025320930406451225
in-drivable-lane_max	3.999999999999986
in-drivable-lane_mean	2.862499999999991
in-drivable-lane_min	1.899999999999995
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.4842546828207253, "get_ui_image": 0.027458864014323164, "step_physics": 0.10595222071903508, "survival_time": 8.14999999999998, "driven_lanedir": 2.029530283703435, "get_state_dump": 0.005042068841980725, "get_robot_state": 0.0037951731100315, "sim_render-ego0": 0.003929535063301645, "get_duckie_state": 1.731442242133908e-06, "in-drivable-lane": 1.899999999999995, "deviation-heading": 0.9941553388382084, "agent_compute-ego0": 0.012432876156597602, "complete-iteration": 0.17252010543171953, "set_robot_commands": 0.002244378008493563, "deviation-center-line": 0.5208601028005717, "driven_lanedir_consec": 2.029530283703435, "sim_compute_sim_state": 0.009430049396142727, "sim_compute_performance-ego0": 0.002140324290205793}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2613482879554334, "get_ui_image": 0.03342911284020607, "step_physics": 0.12141540202688664, "survival_time": 4.6499999999999915, "driven_lanedir": 0.368197102721018, "get_state_dump": 0.004778362335042751, "get_robot_state": 0.0036396396921036097, "sim_render-ego0": 0.003809878166685713, "get_duckie_state": 1.6004481214158078e-06, "in-drivable-lane": 2.699999999999993, "deviation-heading": 1.3772308129971225, "agent_compute-ego0": 0.012452579559163844, "complete-iteration": 0.1932264896149331, "set_robot_commands": 0.002211892858464667, "deviation-center-line": 0.15461501015929013, "driven_lanedir_consec": 0.368197102721018, "sim_compute_sim_state": 0.009341298265660065, "sim_compute_performance-ego0": 0.002052096610373639}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4360525949292078, "get_ui_image": 0.03320542744227818, "step_physics": 0.1265028749193464, "survival_time": 5.1999999999999895, "driven_lanedir": 0.659635841451105, "get_state_dump": 0.005403109959193638, "get_robot_state": 0.004316604705083938, "sim_render-ego0": 0.004331270853678386, "get_duckie_state": 1.784733363560268e-06, "in-drivable-lane": 2.84999999999999, "deviation-heading": 0.4005089425206144, "agent_compute-ego0": 0.013889285496303014, "complete-iteration": 0.20154266130356563, "set_robot_commands": 0.0023638543628510976, "deviation-center-line": 0.0930013390966274, "driven_lanedir_consec": 0.659635841451105, "sim_compute_sim_state": 0.009121792657034736, "sim_compute_performance-ego0": 0.002299983160836356}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.8553323167073643, "get_ui_image": 0.025320930406451225, "step_physics": 0.0899541899561882, "survival_time": 6.349999999999985, "driven_lanedir": 0.6776461595025709, "get_state_dump": 0.004730222746729851, "get_robot_state": 0.003633657470345497, "sim_render-ego0": 0.003708623349666595, "get_duckie_state": 1.6819685697555542e-06, "in-drivable-lane": 3.999999999999986, "deviation-heading": 0.37838610279828855, "agent_compute-ego0": 0.01198708638548851, "complete-iteration": 0.14865183643996716, "set_robot_commands": 0.0022688787430524826, "deviation-center-line": 0.10878608596075424, "driven_lanedir_consec": 0.6776461595025709, "sim_compute_sim_state": 0.004979047924280167, "sim_compute_performance-ego0": 0.001965725794434547}}
set_robot_commands_max	0.0023638543628510976
set_robot_commands_mean	0.002272250993215453
set_robot_commands_median	0.002256628375773023
set_robot_commands_min	0.002211892858464667
sim_compute_performance-ego0_max	0.002299983160836356
sim_compute_performance-ego0_mean	0.002114532463962584
sim_compute_performance-ego0_median	0.002096210450289716
sim_compute_performance-ego0_min	0.001965725794434547
sim_compute_sim_state_max	0.009430049396142727
sim_compute_sim_state_mean	0.008218047060779424
sim_compute_sim_state_median	0.0092315454613474
sim_compute_sim_state_min	0.004979047924280167
sim_render-ego0_max	0.004331270853678386
sim_render-ego0_mean	0.0039448268583330845
sim_render-ego0_median	0.003869706614993679
sim_render-ego0_min	0.003708623349666595
simulation-passed	1
step_physics_max	0.1265028749193464
step_physics_mean	0.11095617190536408
step_physics_median	0.11368381137296084
step_physics_min	0.0899541899561882
survival_time_max	8.14999999999998
survival_time_mean	6.087499999999986
survival_time_min	4.6499999999999915

No reset possible

56710

11092

exercise_ros_template

LFv-sim

success

yes

2020-12-03 07:14:22+00:00

2020-12-03 07:44:01+00:00

0:29:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	4.068216087273205
survival_time_median	59.99999999999873
deviation-center-line_median	3.090005496450313
in-drivable-lane_median	10.074999999999855

other stats

agent_compute-ego0_max	0.012854845696543774
agent_compute-ego0_mean	0.012561220216853797
agent_compute-ego0_median	0.012580572324715218
agent_compute-ego0_min	0.012228890521440976
complete-iteration_max	0.22109589390115475
complete-iteration_mean	0.19341898054006168
complete-iteration_median	0.1938629671536232
complete-iteration_min	0.16485409395184544
deviation-center-line_max	3.448469020511213
deviation-center-line_mean	2.5711045172098346
deviation-center-line_min	0.6559380554275002
deviation-heading_max	19.117196603119453
deviation-heading_mean	13.916685222865922
deviation-heading_median	15.974706426053247
deviation-heading_min	4.600131436237738
driven_any_max	10.78531059349442
driven_any_mean	8.374415744569289
driven_any_median	10.010992747802952
driven_any_min	2.6903668891768353
driven_lanedir_consec_max	9.873808038154769
driven_lanedir_consec_mean	4.7520439350953545
driven_lanedir_consec_min	0.9979355276802409
driven_lanedir_max	9.873808038154769
driven_lanedir_mean	6.083525679599213
driven_lanedir_median	6.311641659184013
driven_lanedir_min	1.837011361874063
get_duckie_state_max	1.3247020635676323e-06
get_duckie_state_mean	1.2529154916406498e-06
get_duckie_state_median	1.2476320204622295e-06
get_duckie_state_min	1.1916958620705076e-06
get_robot_state_max	0.00367311503749488
get_robot_state_mean	0.003617177620724384
get_robot_state_median	0.003624376905252296
get_robot_state_min	0.0035468416348980627
get_state_dump_max	0.004606995539099975
get_state_dump_mean	0.004550954281190583
get_state_dump_median	0.004553341944946238
get_state_dump_min	0.004490137695769883
get_ui_image_max	0.03555084088759855
get_ui_image_mean	0.03031288845084152
get_ui_image_median	0.02962573442133539
get_ui_image_min	0.02644924407309674
in-drivable-lane_max	16.849999999999635
in-drivable-lane_mean	10.012499999999813
in-drivable-lane_min	3.049999999999905
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 10.78531059349442, "get_ui_image": 0.027282152644402775, "step_physics": 0.10091100961937692, "survival_time": 59.99999999999873, "driven_lanedir": 9.873808038154769, "get_state_dump": 0.004490137695769883, "get_robot_state": 0.0035468416348980627, "sim_render-ego0": 0.003674544065222951, "get_duckie_state": 1.2379502575165227e-06, "in-drivable-lane": 3.049999999999905, "deviation-heading": 12.847519461565406, "agent_compute-ego0": 0.012228890521440976, "complete-iteration": 0.16485409395184544, "set_robot_commands": 0.002093737568089011, "deviation-center-line": 2.8391697111874445, "driven_lanedir_consec": 9.873808038154769, "sim_compute_sim_state": 0.008652900478226458, "sim_compute_performance-ego0": 0.0018932587101894256}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.004486852043897, "get_ui_image": 0.03555084088759855, "step_physics": 0.14518315428798145, "survival_time": 59.99999999999873, "driven_lanedir": 6.437197448176239, "get_state_dump": 0.004563788390973525, "get_robot_state": 0.0035758228921374115, "sim_render-ego0": 0.0037957212510057337, "get_duckie_state": 1.3247020635676323e-06, "in-drivable-lane": 15.849999999999696, "deviation-heading": 19.117196603119453, "agent_compute-ego0": 0.01263436727182355, "complete-iteration": 0.22109589390115475, "set_robot_commands": 0.0021343808884823155, "deviation-center-line": 3.3408412817131814, "driven_lanedir_consec": 4.245345090840749, "sim_compute_sim_state": 0.011634567992871846, "sim_compute_performance-ego0": 0.0019388623678316976}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.017498643562009, "get_ui_image": 0.031969316198268004, "step_physics": 0.14099663163501952, "survival_time": 59.99999999999873, "driven_lanedir": 6.186085870191787, "get_state_dump": 0.004542895498918951, "get_robot_state": 0.003672930918367181, "sim_render-ego0": 0.0038253329973435223, "get_duckie_state": 1.1916958620705076e-06, "in-drivable-lane": 16.849999999999635, "deviation-heading": 19.101893390541093, "agent_compute-ego0": 0.012854845696543774, "complete-iteration": 0.21400773693977249, "set_robot_commands": 0.0022333269810100877, "deviation-center-line": 3.448469020511213, "driven_lanedir_consec": 3.8910870837056626, "sim_compute_sim_state": 0.01182876995064436, "sim_compute_performance-ego0": 0.0019980209455402764}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6903668891768353, "get_ui_image": 0.02644924407309674, "step_physics": 0.11274794532172948, "survival_time": 16.400000000000098, "driven_lanedir": 1.837011361874063, "get_state_dump": 0.004606995539099975, "get_robot_state": 0.00367311503749488, "sim_render-ego0": 0.0038081940184248255, "get_duckie_state": 1.257313783407936e-06, "in-drivable-lane": 4.300000000000015, "deviation-heading": 4.600131436237738, "agent_compute-ego0": 0.012526777377606888, "complete-iteration": 0.17371819736747393, "set_robot_commands": 0.0021724961811285977, "deviation-center-line": 0.6559380554275002, "driven_lanedir_consec": 0.9979355276802409, "sim_compute_sim_state": 0.005715196980531455, "sim_compute_performance-ego0": 0.0019345399456545936}}
set_robot_commands_max	0.0022333269810100877
set_robot_commands_mean	0.0021584854046775032
set_robot_commands_median	0.002153438534805457
set_robot_commands_min	0.002093737568089011
sim_compute_performance-ego0_max	0.0019980209455402764
sim_compute_performance-ego0_mean	0.0019411704923039984
sim_compute_performance-ego0_median	0.0019367011567431457
sim_compute_performance-ego0_min	0.0018932587101894256
sim_compute_sim_state_max	0.01182876995064436
sim_compute_sim_state_mean	0.00945785885056853
sim_compute_sim_state_median	0.010143734235549153
sim_compute_sim_state_min	0.005715196980531455
sim_render-ego0_max	0.0038253329973435223
sim_render-ego0_mean	0.003775948082999258
sim_render-ego0_median	0.0038019576347152794
sim_render-ego0_min	0.003674544065222951
simulation-passed	1
step_physics_max	0.14518315428798145
step_physics_mean	0.12495968521602684
step_physics_median	0.1268722884783745
step_physics_min	0.10091100961937692
survival_time_max	59.99999999999873
survival_time_mean	49.09999999999907
survival_time_min	16.400000000000098

No reset possible

56650

11093

Étienne Boucher 🇨🇦

exercise_ros_template

LFv-sim

success

yes

aido5-LFV_multi-sim-validation

2020-12-03 07:05:27+00:00

2020-12-03 07:13:28+00:00

0:08:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6531735829195671
survival_time_median	5.07499999999999
deviation-center-line_median	0.09372641978625572
in-drivable-lane_median	2.7749999999999924

other stats

agent_compute-ego0_max	0.08492757269173615
agent_compute-ego0_mean	0.03096522132501636
agent_compute-ego0_median	0.013239361088851404
agent_compute-ego0_min	0.012454590430626505
complete-iteration_max	0.24184673819048652
complete-iteration_mean	0.2106375578391707
complete-iteration_median	0.21127531927010057
complete-iteration_min	0.17815285462599534
deviation-center-line_max	0.25211078410553667
deviation-center-line_mean	0.12403235879106642
deviation-center-line_min	0.05656581148621745
deviation-heading_max	0.974426685470986
deviation-heading_mean	0.5567417066190413
deviation-heading_median	0.45140663497877864
deviation-heading_min	0.34972687104762223
driven_any_max	1.8902633483115143
driven_any_mean	1.33122692309733
driven_any_median	1.4011120506996404
driven_any_min	0.6324202426785251
driven_lanedir_consec_max	0.7131499048913401
driven_lanedir_consec_mean	0.5538612805503353
driven_lanedir_consec_min	0.1959480514708671
driven_lanedir_max	0.7131499048913401
driven_lanedir_mean	0.5538612805503353
driven_lanedir_median	0.6531735829195671
driven_lanedir_min	0.1959480514708671
get_duckie_state_max	1.5112069936899038e-06
get_duckie_state_mean	1.419374696129676e-06
get_duckie_state_median	1.4005307969152842e-06
get_duckie_state_min	1.365230196998233e-06
get_robot_state_max	0.003942237412633975
get_robot_state_mean	0.0038381435408391023
get_robot_state_median	0.003882576630424787
get_robot_state_min	0.003645183489872859
get_state_dump_max	0.005195954750324118
get_state_dump_mean	0.004990991484821116
get_state_dump_median	0.004975994451456021
get_state_dump_min	0.004816022286048302
get_ui_image_max	0.036649777971465014
get_ui_image_mean	0.03108517846691597
get_ui_image_median	0.02990509520520221
get_ui_image_min	0.027880745485794445
in-drivable-lane_max	3.89999999999999
in-drivable-lane_mean	2.824999999999992
in-drivable-lane_min	1.8499999999999936
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 1.8902633483115143, "get_ui_image": 0.028543756558344915, "step_physics": 0.11177215576171876, "survival_time": 6.449999999999985, "driven_lanedir": 0.7131499048913401, "get_state_dump": 0.004816022286048302, "get_robot_state": 0.003645183489872859, "sim_render-ego0": 0.0038947270466731143, "get_duckie_state": 1.5112069936899038e-06, "in-drivable-lane": 3.89999999999999, "deviation-heading": 0.974426685470986, "agent_compute-ego0": 0.012454590430626505, "complete-iteration": 0.17815285462599534, "set_robot_commands": 0.002278261918288011, "deviation-center-line": 0.25211078410553667, "driven_lanedir_consec": 0.7131499048913401, "sim_compute_sim_state": 0.008592796325683594, "sim_compute_performance-ego0": 0.002057191041799692}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6324202426785251, "get_ui_image": 0.036649777971465014, "step_physics": 0.16429441139615816, "survival_time": 2.849999999999998, "driven_lanedir": 0.1959480514708671, "get_state_dump": 0.005195954750324118, "get_robot_state": 0.003935637145206846, "sim_render-ego0": 0.0041461073119064855, "get_duckie_state": 1.4099581488247575e-06, "in-drivable-lane": 1.8499999999999976, "deviation-heading": 0.5223828256471623, "agent_compute-ego0": 0.01338417776699724, "complete-iteration": 0.24184673819048652, "set_robot_commands": 0.002184058057850805, "deviation-center-line": 0.05656581148621745, "driven_lanedir_consec": 0.1959480514708671, "sim_compute_sim_state": 0.009863475273395409, "sim_compute_performance-ego0": 0.0020896319685311153}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0691768887865982, "get_ui_image": 0.0312664338520595, "step_physics": 0.1199101550238473, "survival_time": 4.149999999999993, "driven_lanedir": 0.6451307621460519, "get_state_dump": 0.004849019504728771, "get_robot_state": 0.003829516115642729, "sim_render-ego0": 0.004052275703066871, "get_duckie_state": 1.365230196998233e-06, "in-drivable-lane": 1.8499999999999936, "deviation-heading": 0.3804304443103949, "agent_compute-ego0": 0.013094544410705566, "complete-iteration": 0.1891031577473595, "set_robot_commands": 0.002226877780187698, "deviation-center-line": 0.08870435297046002, "driven_lanedir_consec": 0.6451307621460519, "sim_compute_sim_state": 0.007650750023978097, "sim_compute_performance-ego0": 0.0021258677755083355}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7330472126126824, "get_ui_image": 0.027880745485794445, "step_physics": 0.09781178561123936, "survival_time": 5.999999999999987, "driven_lanedir": 0.6612164036930823, "get_state_dump": 0.005102969398183271, "get_robot_state": 0.003942237412633975, "sim_render-ego0": 0.00402024954803719, "get_duckie_state": 1.3911034450058109e-06, "in-drivable-lane": 3.699999999999987, "deviation-heading": 0.34972687104762223, "agent_compute-ego0": 0.08492757269173615, "complete-iteration": 0.23344748079284164, "set_robot_commands": 0.0023756046925694487, "deviation-center-line": 0.09874848660205146, "driven_lanedir_consec": 0.6612164036930823, "sim_compute_sim_state": 0.0052814523050607725, "sim_compute_performance-ego0": 0.002000241240194021}}
set_robot_commands_max	0.0023756046925694487
set_robot_commands_mean	0.0022662006122239906
set_robot_commands_median	0.0022525698492378544
set_robot_commands_min	0.002184058057850805
sim_compute_performance-ego0_max	0.0021258677755083355
sim_compute_performance-ego0_mean	0.002068233006508291
sim_compute_performance-ego0_median	0.0020734115051654037
sim_compute_performance-ego0_min	0.002000241240194021
sim_compute_sim_state_max	0.009863475273395409
sim_compute_sim_state_mean	0.007847118482029469
sim_compute_sim_state_median	0.008121773174830847
sim_compute_sim_state_min	0.0052814523050607725
sim_render-ego0_max	0.0041461073119064855
sim_render-ego0_mean	0.004028339902420915
sim_render-ego0_median	0.004036262625552031
sim_render-ego0_min	0.0038947270466731143
simulation-passed	1
step_physics_max	0.16429441139615816
step_physics_mean	0.12344712694824088
step_physics_median	0.11584115539278304
step_physics_min	0.09781178561123936
survival_time_max	6.449999999999985
survival_time_mean	4.862499999999991
survival_time_min	2.849999999999998

No reset possible

56614

11427

Frank (Chude) Qian 🇨🇦

template-pytorch

LFVmultibodyv-sim

host-error

yes

aido5-LFV_multi-sim-validation

2020-12-03 06:58:38+00:00

2020-12-03 07:04:08+00:00

0:05:30

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

56593

11427

Frank (Chude) Qian 🇨🇦

template-pytorch

LFVmultibodyv-sim

host-error

yes

2020-12-03 06:56:15+00:00

2020-12-03 06:57:19+00:00

0:01:04

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

56565

11112

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 06:52:51+00:00

2020-12-03 06:56:05+00:00

0:03:14

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 37 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

56504

11280

template-pytorch

LFv-sim

host-error

yes

2020-12-03 06:46:38+00:00

2020-12-03 06:47:13+00:00

0:00:35

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

56417

11134

Himanshu Arora 🇨🇦

real-exercise-1

LFv-sim

failed

yes

2020-12-03 06:40:31+00:00

2020-12-03 06:46:13+00:00

0:05:42

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

56337

11450

Cliff Chandler 🇺🇸

template-pytorch

aido5-LF-sim-testing

LFt-sim

host-error

yes

2020-12-03 06:35:19+00:00

2020-12-03 06:39:13+00:00

0:03:54

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

56292

11128

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 06:32:09+00:00

2020-12-03 06:34:49+00:00

0:02:40

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

56263

11286

template-pytorch

LFv-sim

host-error

yes

2020-12-03 06:29:24+00:00

2020-12-03 06:31:45+00:00

0:02:21

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

56233

11310

template-pytorch

LFv-sim

host-error

yes

2020-12-03 06:27:08+00:00

2020-12-03 06:29:15+00:00

0:02:07

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

56196

11310

template-pytorch

LFv-sim

host-error

yes