AI Driving Olympics Home Challenges Submissions Jobs

Submission 3062

Submission3062
Competingyes
Challengeaido2-LFVI-sim-testing
UserAndrea Censi
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 23300
Next
User labelrotation
Admin priority70
Blessing70
User priority

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
233003062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationerroryes-1:02:17
Waited 3600 seconds [...]
Waited 3600 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
232993062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationerroryes-0:09:17
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
222373062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationerroryes-0:06:54
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
217483062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationerrorno-1:02:18
Waited 3600 seconds [...]
Waited 3600 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
217133062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationhost-errorno-1:00:45
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 491, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1032, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1187, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1234, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission3062/step1-simulation-idsc-rudolf-11810-job21713/tmp/tmpfimlv1v6/attempts/udem1-10-0.attempt10/drawing.html']' returned non-zero exit status 1.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
216603062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationtimeoutno-1:05:11
I can see how the jo [...]
I can see how the job 21660 is timeout because passed 3911 seconds and the timeout is 3600.0.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
216593062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:31:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 484, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission3062/step1-simulation-ip-172-31-25-98-2470-job21659/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
208483062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationerrorno-1:02:44
Waited 3602 seconds [...]
Waited 3602 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
208153062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:51:05
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 697, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/d73933f0ccba14aa073c0a4fb2d2781ecfff57c5d24c1d09c92c01c3ed1e2daf/json
Hidden. If you are the author, please login using the top-right link or use the dashboard.
207903062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:47:28
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission3062/step1-simulation-ip-172-31-42-167-7227-job20790/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
207373062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationtimeoutno-1:05:27
I can see how the jo [...]
I can see how the job 20737 is timeout because passed 3927 seconds and the timeout is 3600.0.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
207303062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationtimeoutno-1:05:31
I can see how the jo [...]
I can see how the job 20730 is timeout because passed 3931 seconds and the timeout is 3600.0.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
207233062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:00:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 996, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20723-563478', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 579, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 905, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 591, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1004, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20723-563478', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20723-563478', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
201613062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationsuccessno-0:27:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0004615556694189671
survival_time_median14.950000000000076
deviation-center-line_median0.4893543511348479
in-drivable-lane_median7.600000000000043


other stats
agent_compute-ego_max0.1424181397755941
agent_compute-ego_mean0.13616706307729087
agent_compute-ego_median0.1347883399327596
agent_compute-ego_min0.1312003262837728
deviation-center-line_max0.6110634223668668
deviation-center-line_mean0.420093337748217
deviation-center-line_min0.01675128614096042
deviation-heading_max5.828528410212022
deviation-heading_mean5.666366635305937
deviation-heading_median5.656741799274124
deviation-heading_min5.45365698365684
driven_any_max0.02699486662998817
driven_any_mean0.025026630137878515
driven_any_median0.025845567204838143
driven_any_min0.022110630442247207
driven_lanedir_consec_max0.0024811319357622708
driven_lanedir_consec_mean-0.0002839237876270495
driven_lanedir_consec_min-0.003723902623983477
driven_lanedir_max0.0024811319357622708
driven_lanedir_mean-0.0002839237876270495
driven_lanedir_median0.0004615556694189671
driven_lanedir_min-0.003723902623983477
in-drivable-lane_max7.650000000000045
in-drivable-lane_mean7.610000000000044
in-drivable-lane_min7.550000000000044
per-episodes
details{"udem1-0-0": {"driven_any": 0.02699486662998817, "sim_physics": 0.11984671115875244, "survival_time": 14.950000000000076, "driven_lanedir": 0.0024811319357622708, "sim_render-ego": 0.05932760238647461, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.13874953667322795, "deviation-heading": 5.656741799274124, "set_robot_commands": 0.07760597864786783, "deviation-center-line": 0.5615811912624447, "driven_lanedir_consec": 0.0024811319357622708, "sim_compute_sim_state": 0.035702586968739826, "sim_compute_performance-ego": 0.061384281317392986, "sim_compute_robot_state-ego": 0.05997208595275879, "sim_compute_robot_state-npc0": 0.06738674243291219, "sim_compute_robot_state-npc1": 0.06409741481145223, "sim_compute_robot_state-npc2": 0.06313371658325195, "sim_compute_robot_state-npc3": 0.06325407187143961}, "udem1-1-0": {"driven_any": 0.025845567204838143, "sim_physics": 0.12174828370412193, "survival_time": 14.950000000000076, "driven_lanedir": -0.003723902623983477, "sim_render-ego": 0.056629227797190346, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.1347883399327596, "deviation-heading": 5.792980334963804, "set_robot_commands": 0.07751003503799439, "deviation-center-line": 0.6110634223668668, "driven_lanedir_consec": -0.003723902623983477, "sim_compute_sim_state": 0.033843337694803875, "sim_compute_performance-ego": 0.05904416561126709, "sim_compute_robot_state-ego": 0.059574710528055824, "sim_compute_robot_state-npc0": 0.06565749088923137, "sim_compute_robot_state-npc1": 0.0615556804339091, "sim_compute_robot_state-npc2": 0.05983970483144124, "sim_compute_robot_state-npc3": 0.06078670660654704}, "udem1-2-0": {"driven_any": 0.024318396942412283, "sim_physics": 0.11765707969665529, "survival_time": 14.950000000000076, "driven_lanedir": 0.0019934477256953187, "sim_render-ego": 0.054988181591033934, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.1312003262837728, "deviation-heading": 5.599925648422895, "set_robot_commands": 0.07565530856450399, "deviation-center-line": 0.4893543511348479, "driven_lanedir_consec": 0.0019934477256953187, "sim_compute_sim_state": 0.03291491985321045, "sim_compute_performance-ego": 0.057570873896280926, "sim_compute_robot_state-ego": 0.058316370646158855, "sim_compute_robot_state-npc0": 0.06316309611002605, "sim_compute_robot_state-npc1": 0.060237277348836264, "sim_compute_robot_state-npc2": 0.05887430906295776, "sim_compute_robot_state-npc3": 0.05884188969930013}, "udem1-3-0": {"driven_any": 0.022110630442247207, "sim_physics": 0.12021816809972127, "survival_time": 14.950000000000076, "driven_lanedir": -0.002631851645028327, "sim_render-ego": 0.057168588638305665, "in-drivable-lane": 7.650000000000045, "agent_compute-ego": 0.13367897272109985, "deviation-heading": 5.45365698365684, "set_robot_commands": 0.07498635450998942, "deviation-center-line": 0.4217164378359653, "driven_lanedir_consec": -0.002631851645028327, "sim_compute_sim_state": 0.0337495756149292, "sim_compute_performance-ego": 0.058852222760518394, "sim_compute_robot_state-ego": 0.058032429218292235, "sim_compute_robot_state-npc0": 0.0649532437324524, "sim_compute_robot_state-npc1": 0.06061633110046387, "sim_compute_robot_state-npc2": 0.05990167220433553, "sim_compute_robot_state-npc3": 0.059684417247772216}, "udem1-4-0": {"driven_any": 0.025863689469906782, "sim_physics": 0.12385265350341795, "survival_time": 14.950000000000076, "driven_lanedir": 0.0004615556694189671, "sim_render-ego": 0.059542296727498376, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.1424181397755941, "deviation-heading": 5.828528410212022, "set_robot_commands": 0.07723698218663534, "deviation-center-line": 0.01675128614096042, "driven_lanedir_consec": 0.0004615556694189671, "sim_compute_sim_state": 0.03618050972620646, "sim_compute_performance-ego": 0.06197673718134562, "sim_compute_robot_state-ego": 0.062147802511850994, "sim_compute_robot_state-npc0": 0.06884153127670288, "sim_compute_robot_state-npc1": 0.06577580531438192, "sim_compute_robot_state-npc2": 0.06478825330734253, "sim_compute_robot_state-npc3": 0.06540382862091064}}
set_robot_commands_max0.07760597864786783
set_robot_commands_mean0.0765989317893982
set_robot_commands_median0.07723698218663534
set_robot_commands_min0.07498635450998942
sim_compute_performance-ego_max0.06197673718134562
sim_compute_performance-ego_mean0.059765656153361005
sim_compute_performance-ego_median0.05904416561126709
sim_compute_performance-ego_min0.057570873896280926
sim_compute_robot_state-ego_max0.062147802511850994
sim_compute_robot_state-ego_mean0.05960867977142335
sim_compute_robot_state-ego_median0.059574710528055824
sim_compute_robot_state-ego_min0.058032429218292235
sim_compute_robot_state-npc0_max0.06884153127670288
sim_compute_robot_state-npc0_mean0.06600042088826498
sim_compute_robot_state-npc0_median0.06565749088923137
sim_compute_robot_state-npc0_min0.06316309611002605
sim_compute_robot_state-npc1_max0.06577580531438192
sim_compute_robot_state-npc1_mean0.062456501801808686
sim_compute_robot_state-npc1_median0.0615556804339091
sim_compute_robot_state-npc1_min0.060237277348836264
sim_compute_robot_state-npc2_max0.06478825330734253
sim_compute_robot_state-npc2_mean0.061307531197865806
sim_compute_robot_state-npc2_median0.05990167220433553
sim_compute_robot_state-npc2_min0.05887430906295776
sim_compute_robot_state-npc3_max0.06540382862091064
sim_compute_robot_state-npc3_mean0.06159418280919392
sim_compute_robot_state-npc3_median0.06078670660654704
sim_compute_robot_state-npc3_min0.05884188969930013
sim_compute_sim_state_max0.03618050972620646
sim_compute_sim_state_mean0.034478185971577965
sim_compute_sim_state_median0.033843337694803875
sim_compute_sim_state_min0.03291491985321045
sim_physics_max0.12385265350341795
sim_physics_mean0.12066457923253378
sim_physics_median0.12021816809972127
sim_physics_min0.11765707969665529
sim_render-ego_max0.059542296727498376
sim_render-ego_mean0.057531179428100584
sim_render-ego_median0.057168588638305665
sim_render-ego_min0.054988181591033934
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
200923062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationsuccessno-0:27:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.00030327325308765474
survival_time_median14.950000000000076
deviation-center-line_median0.4782429075334328
in-drivable-lane_median7.650000000000043


other stats
agent_compute-ego_max0.14447980721791584
agent_compute-ego_mean0.13175144894917806
agent_compute-ego_median0.13079040129979452
agent_compute-ego_min0.11746873140335085
deviation-center-line_max0.6209554143640683
deviation-center-line_mean0.41722590967444423
deviation-center-line_min0.025329293139968057
deviation-heading_max5.820018247123898
deviation-heading_mean5.664655239940049
deviation-heading_median5.766106818286449
deviation-heading_min5.484319536528106
driven_any_max0.028934981635122085
driven_any_mean0.026549538326380497
driven_any_median0.02595836365425521
driven_any_min0.024158897917015212
driven_lanedir_consec_max0.002757206308041882
driven_lanedir_consec_mean-0.0001911202930098277
driven_lanedir_consec_min-0.004297677691446733
driven_lanedir_max0.002757206308041882
driven_lanedir_mean-0.0001911202930098277
driven_lanedir_median0.00030327325308765474
driven_lanedir_min-0.004297677691446733
in-drivable-lane_max7.650000000000044
in-drivable-lane_mean7.630000000000043
in-drivable-lane_min7.550000000000042
per-episodes
details{"udem1-0-0": {"driven_any": 0.028934981635122085, "sim_physics": 0.06909845511118572, "survival_time": 14.950000000000076, "driven_lanedir": 0.002757206308041882, "sim_render-ego": 0.058928941090901694, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.14447980721791584, "deviation-heading": 5.767844541062103, "set_robot_commands": 0.09123621543248496, "deviation-center-line": 0.5560677639275999, "driven_lanedir_consec": 0.002757206308041882, "sim_compute_sim_state": 0.03635127305984497, "sim_compute_performance-ego": 0.06354430754979451, "sim_compute_robot_state-ego": 0.06773256858189901, "sim_compute_robot_state-npc0": 0.06517114798227946, "sim_compute_robot_state-npc1": 0.06554095824559529, "sim_compute_robot_state-npc2": 0.06550049463907878, "sim_compute_robot_state-npc3": 0.06557834625244141}, "udem1-1-0": {"driven_any": 0.02595836365425521, "sim_physics": 0.06395464022954304, "survival_time": 14.950000000000076, "driven_lanedir": -0.004297677691446733, "sim_render-ego": 0.05804637749989827, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.1373865803082784, "deviation-heading": 5.820018247123898, "set_robot_commands": 0.09963823397954304, "deviation-center-line": 0.6209554143640683, "driven_lanedir_consec": -0.004297677691446733, "sim_compute_sim_state": 0.03293710231781006, "sim_compute_performance-ego": 0.06152043342590332, "sim_compute_robot_state-ego": 0.061008760134379066, "sim_compute_robot_state-npc0": 0.06054830074310303, "sim_compute_robot_state-npc1": 0.059715065956115726, "sim_compute_robot_state-npc2": 0.06020377318064372, "sim_compute_robot_state-npc3": 0.05916471560796102}, "udem1-2-0": {"driven_any": 0.025754651142354812, "sim_physics": 0.0586093020439148, "survival_time": 14.950000000000076, "driven_lanedir": 0.0025028109383136155, "sim_render-ego": 0.05224877198537191, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.13079040129979452, "deviation-heading": 5.4849870566996906, "set_robot_commands": 0.07972285270690918, "deviation-center-line": 0.4782429075334328, "driven_lanedir_consec": 0.0025028109383136155, "sim_compute_sim_state": 0.03211690982182821, "sim_compute_performance-ego": 0.05490031480789184, "sim_compute_robot_state-ego": 0.058490370909372966, "sim_compute_robot_state-npc0": 0.06164598782857259, "sim_compute_robot_state-npc1": 0.05687286933263143, "sim_compute_robot_state-npc2": 0.05534925142923991, "sim_compute_robot_state-npc3": 0.0561303162574768}, "udem1-3-0": {"driven_any": 0.024158897917015212, "sim_physics": 0.05872981866200765, "survival_time": 14.950000000000076, "driven_lanedir": -0.0022212142730455575, "sim_render-ego": 0.04893547773361206, "in-drivable-lane": 7.650000000000044, "agent_compute-ego": 0.11746873140335085, "deviation-heading": 5.484319536528106, "set_robot_commands": 0.0759913182258606, "deviation-center-line": 0.40553416940715226, "driven_lanedir_consec": -0.0022212142730455575, "sim_compute_sim_state": 0.02978681723276774, "sim_compute_performance-ego": 0.05127435286839803, "sim_compute_robot_state-ego": 0.056844263076782225, "sim_compute_robot_state-npc0": 0.05532518068949382, "sim_compute_robot_state-npc1": 0.0541141668955485, "sim_compute_robot_state-npc2": 0.051650959650675454, "sim_compute_robot_state-npc3": 0.05155390501022339}, "udem1-4-0": {"driven_any": 0.027940797283155145, "sim_physics": 0.05858226617177328, "survival_time": 14.950000000000076, "driven_lanedir": 0.00030327325308765474, "sim_render-ego": 0.04964618285497029, "in-drivable-lane": 7.650000000000042, "agent_compute-ego": 0.1286317245165507, "deviation-heading": 5.766106818286449, "set_robot_commands": 0.07642287651697795, "deviation-center-line": 0.025329293139968057, "driven_lanedir_consec": 0.00030327325308765474, "sim_compute_sim_state": 0.03655681610107422, "sim_compute_performance-ego": 0.0512359348932902, "sim_compute_robot_state-ego": 0.07437355200449626, "sim_compute_robot_state-npc0": 0.054724233945210775, "sim_compute_robot_state-npc1": 0.05833744764328003, "sim_compute_robot_state-npc2": 0.05316697438557943, "sim_compute_robot_state-npc3": 0.05333433707555135}}
set_robot_commands_max0.09963823397954304
set_robot_commands_mean0.08460229937235514
set_robot_commands_median0.07972285270690918
set_robot_commands_min0.0759913182258606
sim_compute_performance-ego_max0.06354430754979451
sim_compute_performance-ego_mean0.05649506870905559
sim_compute_performance-ego_median0.05490031480789184
sim_compute_performance-ego_min0.0512359348932902
sim_compute_robot_state-ego_max0.07437355200449626
sim_compute_robot_state-ego_mean0.0636899029413859
sim_compute_robot_state-ego_median0.061008760134379066
sim_compute_robot_state-ego_min0.056844263076782225
sim_compute_robot_state-npc0_max0.06517114798227946
sim_compute_robot_state-npc0_mean0.059482970237731934
sim_compute_robot_state-npc0_median0.06054830074310303
sim_compute_robot_state-npc0_min0.054724233945210775
sim_compute_robot_state-npc1_max0.06554095824559529
sim_compute_robot_state-npc1_mean0.05891610161463419
sim_compute_robot_state-npc1_median0.05833744764328003
sim_compute_robot_state-npc1_min0.0541141668955485
sim_compute_robot_state-npc2_max0.06550049463907878
sim_compute_robot_state-npc2_mean0.05717429065704346
sim_compute_robot_state-npc2_median0.05534925142923991
sim_compute_robot_state-npc2_min0.051650959650675454
sim_compute_robot_state-npc3_max0.06557834625244141
sim_compute_robot_state-npc3_mean0.0571523240407308
sim_compute_robot_state-npc3_median0.0561303162574768
sim_compute_robot_state-npc3_min0.05155390501022339
sim_compute_sim_state_max0.03655681610107422
sim_compute_sim_state_mean0.033549783706665046
sim_compute_sim_state_median0.03293710231781006
sim_compute_sim_state_min0.02978681723276774
sim_physics_max0.06909845511118572
sim_physics_mean0.06179489644368489
sim_physics_median0.05872981866200765
sim_physics_min0.05858226617177328
sim_render-ego_max0.058928941090901694
sim_render-ego_mean0.05356115023295085
sim_render-ego_median0.05224877198537191
sim_render-ego_min0.04893547773361206
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
200823062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationsuccessno-0:35:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0004615556694189671
survival_time_median14.950000000000076
deviation-center-line_median0.4893543511348479
in-drivable-lane_median7.600000000000043


other stats
agent_compute-ego_max0.16103732109069824
agent_compute-ego_mean0.14596489906311036
agent_compute-ego_median0.14446020285288494
agent_compute-ego_min0.1374941110610962
deviation-center-line_max0.6110634223668668
deviation-center-line_mean0.420093337748217
deviation-center-line_min0.01675128614096042
deviation-heading_max5.828528410212022
deviation-heading_mean5.666366635305937
deviation-heading_median5.656741799274124
deviation-heading_min5.45365698365684
driven_any_max0.02699486662998817
driven_any_mean0.025026630137878515
driven_any_median0.025845567204838143
driven_any_min0.022110630442247207
driven_lanedir_consec_max0.0024811319357622708
driven_lanedir_consec_mean-0.0002839237876270495
driven_lanedir_consec_min-0.003723902623983477
driven_lanedir_max0.0024811319357622708
driven_lanedir_mean-0.0002839237876270495
driven_lanedir_median0.0004615556694189671
driven_lanedir_min-0.003723902623983477
in-drivable-lane_max7.650000000000045
in-drivable-lane_mean7.610000000000044
in-drivable-lane_min7.550000000000044
per-episodes
details{"udem1-0-0": {"driven_any": 0.02699486662998817, "sim_physics": 0.22390522082646688, "survival_time": 14.950000000000076, "driven_lanedir": 0.0024811319357622708, "sim_render-ego": 0.06542349418004353, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.16103732109069824, "deviation-heading": 5.656741799274124, "set_robot_commands": 0.09998620907465616, "deviation-center-line": 0.5615811912624447, "driven_lanedir_consec": 0.0024811319357622708, "sim_compute_sim_state": 0.04123018582661946, "sim_compute_performance-ego": 0.072381272315979, "sim_compute_robot_state-ego": 0.0773886775970459, "sim_compute_robot_state-npc0": 0.07266901652018229, "sim_compute_robot_state-npc1": 0.0725654109319051, "sim_compute_robot_state-npc2": 0.07227930625279745, "sim_compute_robot_state-npc3": 0.07198638359705607}, "udem1-1-0": {"driven_any": 0.025845567204838143, "sim_physics": 0.2096066721280416, "survival_time": 14.950000000000076, "driven_lanedir": -0.003723902623983477, "sim_render-ego": 0.05980729103088379, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.14446020285288494, "deviation-heading": 5.792980334963804, "set_robot_commands": 0.08816522121429443, "deviation-center-line": 0.6110634223668668, "driven_lanedir_consec": -0.003723902623983477, "sim_compute_sim_state": 0.03778418223063151, "sim_compute_performance-ego": 0.06455643574396769, "sim_compute_robot_state-ego": 0.0687049126625061, "sim_compute_robot_state-npc0": 0.064991668065389, "sim_compute_robot_state-npc1": 0.06589174509048462, "sim_compute_robot_state-npc2": 0.06515753030776977, "sim_compute_robot_state-npc3": 0.0650699774424235}, "udem1-2-0": {"driven_any": 0.024318396942412283, "sim_physics": 0.19486528317133583, "survival_time": 14.950000000000076, "driven_lanedir": 0.0019934477256953187, "sim_render-ego": 0.05996107737223307, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.14868297656377158, "deviation-heading": 5.599925648422895, "set_robot_commands": 0.09147826353708904, "deviation-center-line": 0.4893543511348479, "driven_lanedir_consec": 0.0019934477256953187, "sim_compute_sim_state": 0.03830707629521688, "sim_compute_performance-ego": 0.06595314900080362, "sim_compute_robot_state-ego": 0.07019559383392333, "sim_compute_robot_state-npc0": 0.06802011648813884, "sim_compute_robot_state-npc1": 0.06802461544672649, "sim_compute_robot_state-npc2": 0.06744101047515869, "sim_compute_robot_state-npc3": 0.0680962332089742}, "udem1-3-0": {"driven_any": 0.022110630442247207, "sim_physics": 0.187325013478597, "survival_time": 14.950000000000076, "driven_lanedir": -0.002631851645028327, "sim_render-ego": 0.0562375013033549, "in-drivable-lane": 7.650000000000045, "agent_compute-ego": 0.1374941110610962, "deviation-heading": 5.45365698365684, "set_robot_commands": 0.08328045845031738, "deviation-center-line": 0.4217164378359653, "driven_lanedir_consec": -0.002631851645028327, "sim_compute_sim_state": 0.03455947001775106, "sim_compute_performance-ego": 0.06063616037368774, "sim_compute_robot_state-ego": 0.06530216932296753, "sim_compute_robot_state-npc0": 0.062270208199818926, "sim_compute_robot_state-npc1": 0.06150432904561361, "sim_compute_robot_state-npc2": 0.06059768756230672, "sim_compute_robot_state-npc3": 0.059804217020670576}, "udem1-4-0": {"driven_any": 0.025863689469906782, "sim_physics": 0.1894346841176351, "survival_time": 14.950000000000076, "driven_lanedir": 0.0004615556694189671, "sim_render-ego": 0.05724972486495972, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.13814988374710083, "deviation-heading": 5.828528410212022, "set_robot_commands": 0.08427951892217, "deviation-center-line": 0.01675128614096042, "driven_lanedir_consec": 0.0004615556694189671, "sim_compute_sim_state": 0.036272288958231605, "sim_compute_performance-ego": 0.062457648118337, "sim_compute_robot_state-ego": 0.06772436062494913, "sim_compute_robot_state-npc0": 0.06300768454869589, "sim_compute_robot_state-npc1": 0.06284603754679362, "sim_compute_robot_state-npc2": 0.0644355050722758, "sim_compute_robot_state-npc3": 0.06378551483154297}}
set_robot_commands_max0.09998620907465616
set_robot_commands_mean0.0894379342397054
set_robot_commands_median0.08816522121429443
set_robot_commands_min0.08328045845031738
sim_compute_performance-ego_max0.072381272315979
sim_compute_performance-ego_mean0.06519693311055501
sim_compute_performance-ego_median0.06455643574396769
sim_compute_performance-ego_min0.06063616037368774
sim_compute_robot_state-ego_max0.0773886775970459
sim_compute_robot_state-ego_mean0.06986314280827839
sim_compute_robot_state-ego_median0.0687049126625061
sim_compute_robot_state-ego_min0.06530216932296753
sim_compute_robot_state-npc0_max0.07266901652018229
sim_compute_robot_state-npc0_mean0.06619173876444498
sim_compute_robot_state-npc0_median0.064991668065389
sim_compute_robot_state-npc0_min0.062270208199818926
sim_compute_robot_state-npc1_max0.0725654109319051
sim_compute_robot_state-npc1_mean0.06616642761230469
sim_compute_robot_state-npc1_median0.06589174509048462
sim_compute_robot_state-npc1_min0.06150432904561361
sim_compute_robot_state-npc2_max0.07227930625279745
sim_compute_robot_state-npc2_mean0.06598220793406169
sim_compute_robot_state-npc2_median0.06515753030776977
sim_compute_robot_state-npc2_min0.06059768756230672
sim_compute_robot_state-npc3_max0.07198638359705607
sim_compute_robot_state-npc3_mean0.06574846522013347
sim_compute_robot_state-npc3_median0.0650699774424235
sim_compute_robot_state-npc3_min0.059804217020670576
sim_compute_sim_state_max0.04123018582661946
sim_compute_sim_state_mean0.03763064066569011
sim_compute_sim_state_median0.03778418223063151
sim_compute_sim_state_min0.03455947001775106
sim_physics_max0.22390522082646688
sim_physics_mean0.2010273747444153
sim_physics_median0.19486528317133583
sim_physics_min0.187325013478597
sim_render-ego_max0.06542349418004353
sim_render-ego_mean0.05973581775029499
sim_render-ego_median0.05980729103088379
sim_render-ego_min0.0562375013033549
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076