Duckietown Challenges Home Challenges Submissions

Evaluator 915

ID915
evaluatorip-172-31-38-104-5317
ownerI don't have one 😀
machineip-172-31-38-104
processip-172-31-38-104-5317
versiond-c:4.0.25;d-c-r:4.0.32;d-s:4.0.21
first heard
last heard
statusinactive
# evaluating
# success5 21725
# timeout
# failed1 21839
# error
# aborted
# host-error5 21738
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
219143348Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LF-sim-testingstep1-simulationhost-errornoip-172-31-38-104-53170:36:43
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3348/step1-simulation-ip-172-31-38-104-5317-job21914/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
219063343Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LFV-sim-testingstep1-simulationhost-errornoip-172-31-38-104-53171:00:20
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3343/step1-simulation-ip-172-31-38-104-5317-job21906/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
219023346Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LFVI-sim-validationstep1-simulationhost-errornoip-172-31-38-104-53170:25:45
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission3346/step1-simulation-ip-172-31-38-104-5317-job21902/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
218423311Ashwin Ram 🇸🇬challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-38-104-53170:03:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7681925494540844
survival_time_median2.4499999999999993
deviation-center-line_median0.08989091090390484
in-drivable-lane_median0.6999999999999984


other stats
agent_compute-ego_max0.15492873289147202
agent_compute-ego_mean0.1523779794588454
agent_compute-ego_median0.15198769961317923
agent_compute-ego_min0.15058967200192538
deviation-center-line_max0.26403822153669076
deviation-center-line_mean0.13080828752160506
deviation-center-line_min0.06827265080193234
deviation-heading_max0.920367515259888
deviation-heading_mean0.5047222430706978
deviation-heading_median0.42636453090282417
deviation-heading_min0.2935925142977528
driven_any_max1.6759823328717256
driven_any_mean1.1560011520868732
driven_any_median1.0991827086754695
driven_any_min0.3696306712684361
driven_lanedir_consec_max1.2314413213081212
driven_lanedir_consec_mean0.7624994905022828
driven_lanedir_consec_min0.33928966986086895
driven_lanedir_max1.2314413213081212
driven_lanedir_mean0.7624994905022828
driven_lanedir_median0.7681925494540844
driven_lanedir_min0.33928966986086895
in-drivable-lane_max1.4499999999999968
in-drivable-lane_mean0.6899999999999983
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0991827086754695, "sim_physics": 0.061468499047415595, "survival_time": 2.4499999999999993, "driven_lanedir": 0.6970171826370575, "sim_render-ego": 0.03668610417113012, "in-drivable-lane": 0.6999999999999984, "agent_compute-ego": 0.15492873289147202, "deviation-heading": 0.4814020442849295, "set_robot_commands": 0.05515128739026128, "deviation-center-line": 0.08989091090390484, "driven_lanedir_consec": 0.6970171826370575, "sim_compute_sim_state": 0.023491849704664582, "sim_compute_performance-ego": 0.04131132729199468, "sim_compute_robot_state-ego": 0.04259597525304677}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9962181374154752, "sim_physics": 0.06164371967315674, "survival_time": 2.2, "driven_lanedir": 0.7765567292512823, "sim_render-ego": 0.03640061075037176, "in-drivable-lane": 0.3999999999999993, "agent_compute-ego": 0.15058967200192538, "deviation-heading": 0.2935925142977528, "set_robot_commands": 0.05493811043826016, "deviation-center-line": 0.06991242922314926, "driven_lanedir_consec": 0.7765567292512823, "sim_compute_sim_state": 0.02419580654664473, "sim_compute_performance-ego": 0.039491084488955414, "sim_compute_robot_state-ego": 0.0426724986596541}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6389919102032584, "sim_physics": 0.055767485793207734, "survival_time": 3.5499999999999954, "driven_lanedir": 0.7681925494540844, "sim_render-ego": 0.03699072649781133, "in-drivable-lane": 1.4499999999999968, "agent_compute-ego": 0.15132176708167708, "deviation-heading": 0.920367515259888, "set_robot_commands": 0.055019529772476414, "deviation-center-line": 0.16192722514234809, "driven_lanedir_consec": 0.7681925494540844, "sim_compute_sim_state": 0.024149975306551223, "sim_compute_performance-ego": 0.040051581154406914, "sim_compute_robot_state-ego": 0.04265875883505378}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3696306712684361, "sim_physics": 0.06148474557059152, "survival_time": 1.0500000000000005, "driven_lanedir": 0.33928966986086895, "sim_render-ego": 0.03625556400844029, "in-drivable-lane": 0, "agent_compute-ego": 0.1530620257059733, "deviation-heading": 0.40188461060809455, "set_robot_commands": 0.05637264251708984, "deviation-center-line": 0.06827265080193234, "driven_lanedir_consec": 0.33928966986086895, "sim_compute_sim_state": 0.023673295974731445, "sim_compute_performance-ego": 0.04038055737813314, "sim_compute_robot_state-ego": 0.043218805676414854}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6759823328717256, "sim_physics": 0.05828051697717954, "survival_time": 3.649999999999995, "driven_lanedir": 1.2314413213081212, "sim_render-ego": 0.03676985387932765, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.15198769961317923, "deviation-heading": 0.42636453090282417, "set_robot_commands": 0.05711187728463787, "deviation-center-line": 0.26403822153669076, "driven_lanedir_consec": 1.2314413213081212, "sim_compute_sim_state": 0.023997368877881193, "sim_compute_performance-ego": 0.04002386249908029, "sim_compute_robot_state-ego": 0.04240888438812674}}
set_robot_commands_max0.05711187728463787
set_robot_commands_mean0.05571868948054511
set_robot_commands_median0.05515128739026128
set_robot_commands_min0.05493811043826016
sim_compute_performance-ego_max0.04131132729199468
sim_compute_performance-ego_mean0.04025168256251409
sim_compute_performance-ego_median0.040051581154406914
sim_compute_performance-ego_min0.039491084488955414
sim_compute_robot_state-ego_max0.043218805676414854
sim_compute_robot_state-ego_mean0.04271098456245924
sim_compute_robot_state-ego_median0.04265875883505378
sim_compute_robot_state-ego_min0.04240888438812674
sim_compute_sim_state_max0.02419580654664473
sim_compute_sim_state_mean0.023901659282094635
sim_compute_sim_state_median0.023997368877881193
sim_compute_sim_state_min0.023491849704664582
sim_physics_max0.06164371967315674
sim_physics_mean0.05972899341231023
sim_physics_median0.061468499047415595
sim_physics_min0.055767485793207734
sim_render-ego_max0.03699072649781133
sim_render-ego_mean0.03662057186141623
sim_render-ego_median0.03668610417113012
sim_render-ego_min0.03625556400844029
simulation-passed1
survival_time_max3.649999999999995
survival_time_mean2.5799999999999983
survival_time_min1.0500000000000005
No reset possible
218393308Nicky EichmannBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationfailednoip-172-31-38-104-53170:02:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 48, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 41, in compute_action
               ||     observation = self.preprocessor.preprocessor(observation)
               || AttributeError: 'DTPytorchWrapper' object has no attribute 'preprocessor'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
218353301jiang pengSecond test - TH-jpaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-38-104-53170:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9498496604042624
survival_time_median14.950000000000076
deviation-center-line_median0.4805627482077715
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09986163486133924
agent_compute-ego_mean0.09948777350927308
agent_compute-ego_median0.09937376658121744
agent_compute-ego_min0.09908476829528808
deviation-center-line_max0.9965362492960408
deviation-center-line_mean0.5498707771987503
deviation-center-line_min0.33180224569628197
deviation-heading_max3.9969207411315097
deviation-heading_mean2.446894496611544
deviation-heading_median2.5787701046576026
deviation-heading_min0.9004655815314591
driven_any_max3.0927559269097955
driven_any_mean1.7110012373424066
driven_any_median1.1797246270615227
driven_any_min1.005120179122018
driven_lanedir_consec_max2.8687620436345833
driven_lanedir_consec_mean1.2757908713216253
driven_lanedir_consec_min0.7609626573088756
driven_lanedir_max2.8687620436345833
driven_lanedir_mean1.433775519133952
driven_lanedir_median0.971155666898364
driven_lanedir_min0.8282243283620417
in-drivable-lane_max3.7499999999999862
in-drivable-lane_mean0.7499999999999973
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.2626086868484045, "sim_physics": 0.05746169964472453, "survival_time": 14.950000000000076, "driven_lanedir": 1.5508858963705092, "sim_render-ego": 0.0367657470703125, "in-drivable-lane": 3.7499999999999862, "agent_compute-ego": 0.09927974224090576, "deviation-heading": 3.9969207411315097, "set_robot_commands": 0.05677163600921631, "deviation-center-line": 0.5488156919730439, "driven_lanedir_consec": 0.7609626573088756, "sim_compute_sim_state": 0.023625776767730713, "sim_compute_performance-ego": 0.03982491095860799, "sim_compute_robot_state-ego": 0.0419300103187561}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1797246270615227, "sim_physics": 0.059237949053446454, "survival_time": 14.950000000000076, "driven_lanedir": 0.8282243283620417, "sim_render-ego": 0.03638670047124227, "in-drivable-lane": 0, "agent_compute-ego": 0.09908476829528808, "deviation-heading": 2.5787701046576026, "set_robot_commands": 0.05589276393254598, "deviation-center-line": 0.4805627482077715, "driven_lanedir_consec": 0.8282243283620417, "sim_compute_sim_state": 0.023812780380249025, "sim_compute_performance-ego": 0.03995922088623047, "sim_compute_robot_state-ego": 0.042251312732696535}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.0927559269097955, "sim_physics": 0.05794169346491496, "survival_time": 14.950000000000076, "driven_lanedir": 2.8687620436345833, "sim_render-ego": 0.036585885683695474, "in-drivable-lane": 0, "agent_compute-ego": 0.09937376658121744, "deviation-heading": 3.5738497612654236, "set_robot_commands": 0.05637597958246867, "deviation-center-line": 0.9965362492960408, "driven_lanedir_consec": 2.8687620436345833, "sim_compute_sim_state": 0.02360726038614909, "sim_compute_performance-ego": 0.040113232135772704, "sim_compute_robot_state-ego": 0.04181870381037394}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.005120179122018, "sim_physics": 0.06024828173897483, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9498496604042624, "sim_render-ego": 0.03683317574587736, "in-drivable-lane": 0, "agent_compute-ego": 0.09986163486133924, "deviation-heading": 1.1844662944717232, "set_robot_commands": 0.057288828763094816, "deviation-center-line": 0.33180224569628197, "driven_lanedir_consec": 0.9498496604042624, "sim_compute_sim_state": 0.0240885084325617, "sim_compute_performance-ego": 0.039777549830350006, "sim_compute_robot_state-ego": 0.04206188808787953}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0147967667702915, "sim_physics": 0.057208689132539355, "survival_time": 5.04999999999999, "driven_lanedir": 0.971155666898364, "sim_render-ego": 0.0367907722397606, "in-drivable-lane": 0, "agent_compute-ego": 0.09983895556761486, "deviation-heading": 0.9004655815314591, "set_robot_commands": 0.056000669403831554, "deviation-center-line": 0.3916369508206132, "driven_lanedir_consec": 0.971155666898364, "sim_compute_sim_state": 0.023619614025153737, "sim_compute_performance-ego": 0.04020442584953686, "sim_compute_robot_state-ego": 0.04189658164978027}}
set_robot_commands_max0.057288828763094816
set_robot_commands_mean0.056465975538231475
set_robot_commands_median0.05637597958246867
set_robot_commands_min0.05589276393254598
sim_compute_performance-ego_max0.04020442584953686
sim_compute_performance-ego_mean0.0399758679320996
sim_compute_performance-ego_median0.03995922088623047
sim_compute_performance-ego_min0.039777549830350006
sim_compute_robot_state-ego_max0.042251312732696535
sim_compute_robot_state-ego_mean0.04199169931989728
sim_compute_robot_state-ego_median0.0419300103187561
sim_compute_robot_state-ego_min0.04181870381037394
sim_compute_sim_state_max0.0240885084325617
sim_compute_sim_state_mean0.023750787998368852
sim_compute_sim_state_median0.023625776767730713
sim_compute_sim_state_min0.02360726038614909
sim_physics_max0.06024828173897483
sim_physics_mean0.05841966260692003
sim_physics_median0.05794169346491496
sim_physics_min0.057208689132539355
sim_render-ego_max0.03683317574587736
sim_render-ego_mean0.03667245624217764
sim_render-ego_median0.0367657470703125
sim_render-ego_min0.03638670047124227
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.080000000000044
survival_time_min5.04999999999999
No reset possible
218273302Artem IoselevskiiSSegmaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-38-104-53170:07:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6872889144490855
survival_time_median4.699999999999991
deviation-center-line_median0.2553474386673472
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06407080314777515
agent_compute-ego_mean0.06130459733916057
agent_compute-ego_median0.06096168894034166
agent_compute-ego_min0.05842189078635358
deviation-center-line_max0.6400157494265439
deviation-center-line_mean0.3291389409356762
deviation-center-line_min0.1176484459277043
deviation-heading_max2.2529351225878345
deviation-heading_mean1.025183885473522
deviation-heading_median0.6726119203131535
deviation-heading_min0.46754181293083513
driven_any_max1.899414034216279
driven_any_mean1.0826419645453456
driven_any_median1.0678206545156816
driven_any_min0.34636122090815885
driven_lanedir_consec_max1.7794098832848186
driven_lanedir_consec_mean0.8757449255670207
driven_lanedir_consec_min0.31872815547631594
driven_lanedir_max1.7794098832848186
driven_lanedir_mean0.8757449255670207
driven_lanedir_median0.6872889144490855
driven_lanedir_min0.31872815547631594
in-drivable-lane_max1.949999999999993
in-drivable-lane_mean0.6399999999999977
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1785001665165584, "sim_physics": 0.06016624432343703, "survival_time": 5.1999999999999895, "driven_lanedir": 0.6844802400094445, "sim_render-ego": 0.038535780631578885, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.06096168894034166, "deviation-heading": 0.46754181293083513, "set_robot_commands": 0.05939943056840163, "deviation-center-line": 0.24227603483825932, "driven_lanedir_consec": 0.6844802400094445, "sim_compute_sim_state": 0.025226123057878937, "sim_compute_performance-ego": 0.042380997767815225, "sim_compute_robot_state-ego": 0.04445344897416922}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0678206545156816, "sim_physics": 0.05971173276292517, "survival_time": 4.699999999999991, "driven_lanedir": 0.6872889144490855, "sim_render-ego": 0.03791262748393607, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.05842189078635358, "deviation-heading": 1.099074397746459, "set_robot_commands": 0.058141239145968825, "deviation-center-line": 0.2553474386673472, "driven_lanedir_consec": 0.6872889144490855, "sim_compute_sim_state": 0.025277089565358263, "sim_compute_performance-ego": 0.04210544139780897, "sim_compute_robot_state-ego": 0.0454823133793283}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9211137465700492, "sim_physics": 0.060679174051052186, "survival_time": 4.099999999999993, "driven_lanedir": 0.9088174346154388, "sim_render-ego": 0.03792326915554884, "in-drivable-lane": 0, "agent_compute-ego": 0.06383189340917075, "deviation-heading": 0.6337561737893284, "set_robot_commands": 0.058223017832128014, "deviation-center-line": 0.39040703581852615, "driven_lanedir_consec": 0.9088174346154388, "sim_compute_sim_state": 0.025661012021506707, "sim_compute_performance-ego": 0.04167694289509843, "sim_compute_robot_state-ego": 0.044824841545849314}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.34636122090815885, "sim_physics": 0.06814545222691128, "survival_time": 1.7500000000000009, "driven_lanedir": 0.31872815547631594, "sim_render-ego": 0.03786912645612444, "in-drivable-lane": 0, "agent_compute-ego": 0.05923671041216169, "deviation-heading": 0.6726119203131535, "set_robot_commands": 0.05880387851170131, "deviation-center-line": 0.1176484459277043, "driven_lanedir_consec": 0.31872815547631594, "sim_compute_sim_state": 0.025601788929530554, "sim_compute_performance-ego": 0.0430553708757673, "sim_compute_robot_state-ego": 0.04461466925484794}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.899414034216279, "sim_physics": 0.06511186670373988, "survival_time": 8.09999999999998, "driven_lanedir": 1.7794098832848186, "sim_render-ego": 0.03896152826003087, "in-drivable-lane": 0, "agent_compute-ego": 0.06407080314777515, "deviation-heading": 2.2529351225878345, "set_robot_commands": 0.05915392328191687, "deviation-center-line": 0.6400157494265439, "driven_lanedir_consec": 1.7794098832848186, "sim_compute_sim_state": 0.025211150263562614, "sim_compute_performance-ego": 0.0422250900739505, "sim_compute_robot_state-ego": 0.04619466228249632}}
set_robot_commands_max0.05939943056840163
set_robot_commands_mean0.058744297868023335
set_robot_commands_median0.05880387851170131
set_robot_commands_min0.058141239145968825
sim_compute_performance-ego_max0.0430553708757673
sim_compute_performance-ego_mean0.042288768602088085
sim_compute_performance-ego_median0.0422250900739505
sim_compute_performance-ego_min0.04167694289509843
sim_compute_robot_state-ego_max0.04619466228249632
sim_compute_robot_state-ego_mean0.04511398708733822
sim_compute_robot_state-ego_median0.044824841545849314
sim_compute_robot_state-ego_min0.04445344897416922
sim_compute_sim_state_max0.025661012021506707
sim_compute_sim_state_mean0.02539543276756741
sim_compute_sim_state_median0.025277089565358263
sim_compute_sim_state_min0.025211150263562614
sim_physics_max0.06814545222691128
sim_physics_mean0.0627628940136131
sim_physics_median0.060679174051052186
sim_physics_min0.05971173276292517
sim_render-ego_max0.03896152826003087
sim_render-ego_mean0.038240466397443815
sim_render-ego_median0.03792326915554884
sim_render-ego_min0.03786912645612444
simulation-passed1
survival_time_max8.09999999999998
survival_time_mean4.769999999999991
survival_time_min1.7500000000000009
No reset possible
217752399Liam Paull 🇨🇦random_agentaido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-38-104-53170:23:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.12152149677276612
agent_compute-ego_mean0.1099151167893473
agent_compute-ego_median0.10896324157714844
agent_compute-ego_min0.10395007408582248
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.16769422156901298, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.05281059349639506, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.116339372683175, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.07634598393983479, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03309551673599436, "sim_compute_performance-ego": 0.05423783652390106, "sim_compute_robot_state-ego": 0.059872814371616026, "sim_compute_robot_state-npc0": 0.05677971960623053, "sim_compute_robot_state-npc1": 0.05466482609133177, "sim_compute_robot_state-npc2": 0.058434670484518704, "sim_compute_robot_state-npc3": 0.05780587015272696}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.15069706099373953, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.05039013283593314, "in-drivable-lane": 0, "agent_compute-ego": 0.11475188391549249, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.0754462480545044, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.032532453536987305, "sim_compute_performance-ego": 0.05447569063731602, "sim_compute_robot_state-ego": 0.054449992520468574, "sim_compute_robot_state-npc0": 0.05486540283475603, "sim_compute_robot_state-npc1": 0.0586850813456944, "sim_compute_robot_state-npc2": 0.05515936442783901, "sim_compute_robot_state-npc3": 0.0572202205657959}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.15239253784846335, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05197235912952608, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.11632703577430505, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.07908616251158483, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.0318044991169161, "sim_compute_performance-ego": 0.056245588561863576, "sim_compute_robot_state-ego": 0.058774709701538086, "sim_compute_robot_state-npc0": 0.05959201090544173, "sim_compute_robot_state-npc1": 0.05723577564202466, "sim_compute_robot_state-npc2": 0.05710281446142104, "sim_compute_robot_state-npc3": 0.0566232528501344}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.16063116987546286, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.04982368648052216, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.10457436243693034, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.06898995240529378, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03080903987089793, "sim_compute_performance-ego": 0.05041449268658956, "sim_compute_robot_state-ego": 0.05603786806265513, "sim_compute_robot_state-npc0": 0.05335870881875356, "sim_compute_robot_state-npc1": 0.050905659794807434, "sim_compute_robot_state-npc2": 0.05368460218111674, "sim_compute_robot_state-npc3": 0.05317389965057373}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.15871409007481166, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.05362402825128464, "in-drivable-lane": 0, "agent_compute-ego": 0.1062643641517276, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.06701069786435082, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03291518347603934, "sim_compute_performance-ego": 0.05135850679306757, "sim_compute_robot_state-ego": 0.055624076298304966, "sim_compute_robot_state-npc0": 0.050625449135189966, "sim_compute_robot_state-npc1": 0.05188249406360444, "sim_compute_robot_state-npc2": 0.05269503593444824, "sim_compute_robot_state-npc3": 0.05456152416410901}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.14678082780209845, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.05015805809797641, "in-drivable-lane": 2, "agent_compute-ego": 0.11006631108815083, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.07327894964617883, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03055228301864898, "sim_compute_performance-ego": 0.05399478980881012, "sim_compute_robot_state-ego": 0.05747205054688597, "sim_compute_robot_state-npc0": 0.055573106525900834, "sim_compute_robot_state-npc1": 0.05599776427902861, "sim_compute_robot_state-npc2": 0.054421597612118296, "sim_compute_robot_state-npc3": 0.054525675174005014}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.16016575433675526, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.04994299342331377, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.10605840775573136, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.07182638622024684, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.02928550497999469, "sim_compute_performance-ego": 0.05346740796728042, "sim_compute_robot_state-ego": 0.05684570432866661, "sim_compute_robot_state-npc0": 0.05251842795066463, "sim_compute_robot_state-npc1": 0.05247028128614704, "sim_compute_robot_state-npc2": 0.05205453715278107, "sim_compute_robot_state-npc3": 0.052919135510342795}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.16384847164154054, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.04939478874206543, "in-drivable-lane": 0, "agent_compute-ego": 0.12152149677276612, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.0748489761352539, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03115565299987793, "sim_compute_performance-ego": 0.056488027572631834, "sim_compute_robot_state-ego": 0.0588086462020874, "sim_compute_robot_state-npc0": 0.0573031759262085, "sim_compute_robot_state-npc1": 0.05620858192443848, "sim_compute_robot_state-npc2": 0.05535426139831543, "sim_compute_robot_state-npc3": 0.05514565467834473}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.14186925154465896, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.0471797172839825, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.10395007408582248, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.0659520305120028, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.030105100228236273, "sim_compute_performance-ego": 0.05142207329089825, "sim_compute_robot_state-ego": 0.05634918121191171, "sim_compute_robot_state-npc0": 0.05534596168077909, "sim_compute_robot_state-npc1": 0.05026136453335102, "sim_compute_robot_state-npc2": 0.05544538681323712, "sim_compute_robot_state-npc3": 0.05110394496184129}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.17381591063279372, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.048358577948350176, "in-drivable-lane": 0, "agent_compute-ego": 0.1051269586269672, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.0732259016770583, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.030927309623131387, "sim_compute_performance-ego": 0.05394768714904785, "sim_compute_robot_state-ego": 0.061056164594796986, "sim_compute_robot_state-npc0": 0.05564960149618296, "sim_compute_robot_state-npc1": 0.05389241071847769, "sim_compute_robot_state-npc2": 0.05355970676128681, "sim_compute_robot_state-npc3": 0.050955900779137246}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.15360876646908847, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.05001742189580744, "in-drivable-lane": 0, "agent_compute-ego": 0.11198302832516756, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.07052226500077681, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.029170751571655273, "sim_compute_performance-ego": 0.050770900466225365, "sim_compute_robot_state-ego": 0.05535345727747137, "sim_compute_robot_state-npc0": 0.05310874635523016, "sim_compute_robot_state-npc1": 0.04847313057292591, "sim_compute_robot_state-npc2": 0.05361132188276811, "sim_compute_robot_state-npc3": 0.04732704162597656}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.14121462821960448, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.04922928810119629, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.10896324157714844, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.0736235523223877, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.027450766563415527, "sim_compute_performance-ego": 0.05270364761352539, "sim_compute_robot_state-ego": 0.05700071811676025, "sim_compute_robot_state-npc0": 0.05301977634429931, "sim_compute_robot_state-npc1": 0.052491436004638674, "sim_compute_robot_state-npc2": 0.05222084045410156, "sim_compute_robot_state-npc3": 0.05256854057312012}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.1548614501953125, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.048789564599382114, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.10953432194730069, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.07517782170721825, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.03014151339835309, "sim_compute_performance-ego": 0.05324815942886028, "sim_compute_robot_state-ego": 0.05750159253465369, "sim_compute_robot_state-npc0": 0.054830885948018826, "sim_compute_robot_state-npc1": 0.05336316595686243, "sim_compute_robot_state-npc2": 0.052770137786865234, "sim_compute_robot_state-npc3": 0.05284250797109401}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.14679749653889582, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.050263395676246055, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.10602894196143516, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.07276517152786255, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.02995110475100004, "sim_compute_performance-ego": 0.05357888570198646, "sim_compute_robot_state-ego": 0.05676892170539269, "sim_compute_robot_state-npc0": 0.05213939685087938, "sim_compute_robot_state-npc1": 0.053962106888110824, "sim_compute_robot_state-npc2": 0.05302165563289936, "sim_compute_robot_state-npc3": 0.05205490038945125}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.14766488302321662, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.0509809448605492, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.10723695073808942, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.07378606342134021, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.02946174031212216, "sim_compute_performance-ego": 0.05141491208757673, "sim_compute_robot_state-ego": 0.05596756708054315, "sim_compute_robot_state-npc0": 0.05370297659011114, "sim_compute_robot_state-npc1": 0.0528926826658703, "sim_compute_robot_state-npc2": 0.05171891621180943, "sim_compute_robot_state-npc3": 0.052203155699230376}}
set_robot_commands_max0.07908616251158483
set_robot_commands_mean0.07279241086305967
set_robot_commands_median0.07327894964617883
set_robot_commands_min0.0659520305120028
sim_compute_performance-ego_max0.056488027572631834
sim_compute_performance-ego_mean0.05318457375263871
sim_compute_performance-ego_median0.05346740796728042
sim_compute_performance-ego_min0.05041449268658956
sim_compute_robot_state-ego_max0.061056164594796986
sim_compute_robot_state-ego_mean0.057192230970250175
sim_compute_robot_state-ego_median0.05684570432866661
sim_compute_robot_state-ego_min0.054449992520468574
sim_compute_robot_state-npc0_max0.05959201090544173
sim_compute_robot_state-npc0_mean0.05456088979790977
sim_compute_robot_state-npc0_median0.054830885948018826
sim_compute_robot_state-npc0_min0.050625449135189966
sim_compute_robot_state-npc1_max0.0586850813456944
sim_compute_robot_state-npc1_mean0.05355911745115425
sim_compute_robot_state-npc1_median0.05336316595686243
sim_compute_robot_state-npc1_min0.04847313057292591
sim_compute_robot_state-npc2_max0.058434670484518704
sim_compute_robot_state-npc2_mean0.054083656613035075
sim_compute_robot_state-npc2_median0.05361132188276811
sim_compute_robot_state-npc2_min0.05171891621180943
sim_compute_robot_state-npc3_max0.05780587015272696
sim_compute_robot_state-npc3_mean0.05340208164972556
sim_compute_robot_state-npc3_median0.052919135510342795
sim_compute_robot_state-npc3_min0.04732704162597656
sim_compute_sim_state_max0.03309551673599436
sim_compute_sim_state_mean0.030623894678884697
sim_compute_sim_state_median0.03055228301864898
sim_compute_sim_state_min0.027450766563415527
sim_physics_max0.17381591063279372
sim_physics_mean0.15471710138436365
sim_physics_median0.15360876646908847
sim_physics_min0.14121462821960448
sim_render-ego_max0.05362402825128464
sim_render-ego_mean0.0501957033881687
sim_render-ego_median0.05001742189580744
sim_render-ego_min0.0471797172839825
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
No reset possible
217552884Andrea Daniele 🇮🇹minimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errornoip-172-31-38-104-53170:59:28
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-38-104-5317-job21755/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217382864Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errornoip-172-31-38-104-53170:29:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2864/step1-simulation-ip-172-31-38-104-5317-job21738/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217252612Konstantin Chaikachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-38-104-53170:28:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2875407694053156
survival_time_median2.849999999999998
deviation-center-line_median0.11031194850197353
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.08224693934122722
agent_compute-ego_mean0.07559936663881764
agent_compute-ego_median0.0758234106976053
agent_compute-ego_min0.07074059889866756
deviation-center-line_max0.2701922695523504
deviation-center-line_mean0.13746050030700233
deviation-center-line_min0.07113819587235681
deviation-heading_max1.4854398920276677
deviation-heading_mean0.7236995121312619
deviation-heading_median0.6953408166028192
deviation-heading_min0.3118646573709166
driven_any_max1.934434121703833
driven_any_mean0.806757806634148
driven_any_median0.8072381933001392
driven_any_min0.20912585880423715
driven_lanedir_consec_max0.7222251056746308
driven_lanedir_consec_mean0.3962831867516217
driven_lanedir_consec_min0.1917983424483971
driven_lanedir_max0.7287863177121016
driven_lanedir_mean0.3975640776898326
driven_lanedir_median0.2875407694053156
driven_lanedir_min0.1917983424483971
in-drivable-lane_max4.04999999999999
in-drivable-lane_mean1.2133333333333305
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.23040771484375, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.06557528369398002, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.0761756466095706, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.10551718631422664, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.04130386444459479, "sim_compute_performance-ego": 0.07221028029200542, "sim_compute_robot_state-ego": 0.08469806234520602, "sim_compute_robot_state-npc0": 0.0751187887536474, "sim_compute_robot_state-npc1": 0.07397313864834337, "sim_compute_robot_state-npc2": 0.07388114929199219, "sim_compute_robot_state-npc3": 0.0737565195704081}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.21764055887858072, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.06810377262256763, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08224693934122722, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.09688764148288304, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.0432568214557789, "sim_compute_performance-ego": 0.06868434835363317, "sim_compute_robot_state-ego": 0.07847092769764087, "sim_compute_robot_state-npc0": 0.07035367577164262, "sim_compute_robot_state-npc1": 0.06973453804298684, "sim_compute_robot_state-npc2": 0.06963486141628689, "sim_compute_robot_state-npc3": 0.07338458520394785}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.23112934980636987, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06750964201413669, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.07584377435537484, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.1031699822499202, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.04256202318729498, "sim_compute_performance-ego": 0.07147658176911183, "sim_compute_robot_state-ego": 0.08429331657214043, "sim_compute_robot_state-npc0": 0.07460276897136982, "sim_compute_robot_state-npc1": 0.07279663513868283, "sim_compute_robot_state-npc2": 0.07589446581326999, "sim_compute_robot_state-npc3": 0.07365222160632794}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.2233295858952037, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.06440388528924239, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.07433317836962249, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.10167087588393896, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.039233734733179995, "sim_compute_performance-ego": 0.07198573413648103, "sim_compute_robot_state-ego": 0.07668991256178471, "sim_compute_robot_state-npc0": 0.07261527630320766, "sim_compute_robot_state-npc1": 0.07216394156740423, "sim_compute_robot_state-npc2": 0.07283839844820793, "sim_compute_robot_state-npc3": 0.07240650946633857}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.2173285587974217, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.06893266802248747, "in-drivable-lane": 0, "agent_compute-ego": 0.0758234106976053, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.10716943118883215, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.04078389250713846, "sim_compute_performance-ego": 0.07198234226392664, "sim_compute_robot_state-ego": 0.07710201843925145, "sim_compute_robot_state-npc0": 0.07396478238313095, "sim_compute_robot_state-npc1": 0.07129157107809315, "sim_compute_robot_state-npc2": 0.0663495685743249, "sim_compute_robot_state-npc3": 0.07178711891174316}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.22651996799543792, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.06678566044452143, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.07260612412994984, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.10033197496451585, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.04065181461035037, "sim_compute_performance-ego": 0.07670920269162047, "sim_compute_robot_state-ego": 0.08071577081493303, "sim_compute_robot_state-npc0": 0.07339858541301653, "sim_compute_robot_state-npc1": 0.0724258165733487, "sim_compute_robot_state-npc2": 0.07265999036676743, "sim_compute_robot_state-npc3": 0.07138275866414986}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.20933289527893068, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.07104189906801496, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.0788645897592817, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.1028720600264413, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.04097365822110857, "sim_compute_performance-ego": 0.07146771465029035, "sim_compute_robot_state-ego": 0.07652076482772827, "sim_compute_robot_state-npc0": 0.07194665500095912, "sim_compute_robot_state-npc1": 0.075239440373012, "sim_compute_robot_state-npc2": 0.07445364849908011, "sim_compute_robot_state-npc3": 0.0739489265850612}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.21156895977177032, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.06861372516579824, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.08067856749443159, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.1024123969143384, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.04196594512625916, "sim_compute_performance-ego": 0.07340832279153066, "sim_compute_robot_state-ego": 0.07758664105036488, "sim_compute_robot_state-npc0": 0.0732637398863492, "sim_compute_robot_state-npc1": 0.0724636822530668, "sim_compute_robot_state-npc2": 0.07330629596971486, "sim_compute_robot_state-npc3": 0.07405842493658196}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.2158317732256512, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06279777926067974, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.07499182501504588, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.10125407230022342, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.04118248750997144, "sim_compute_performance-ego": 0.07085172520127407, "sim_compute_robot_state-ego": 0.08155609008877776, "sim_compute_robot_state-npc0": 0.07362572536912075, "sim_compute_robot_state-npc1": 0.07257945315782414, "sim_compute_robot_state-npc2": 0.07231447585793428, "sim_compute_robot_state-npc3": 0.07348091935002526}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.23406032415536737, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.06874552139869103, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07074059889866756, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.10430872440338136, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.039893737206092246, "sim_compute_performance-ego": 0.06848637874309833, "sim_compute_robot_state-ego": 0.07654908987192008, "sim_compute_robot_state-npc0": 0.08132567772498497, "sim_compute_robot_state-npc1": 0.07461772515223576, "sim_compute_robot_state-npc2": 0.07407579972193791, "sim_compute_robot_state-npc3": 0.06931473658635066}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.2178253682454427, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.06463737487792968, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07329778989156087, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.10053565979003906, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.041666603088378905, "sim_compute_performance-ego": 0.07348272323608399, "sim_compute_robot_state-ego": 0.0831822967529297, "sim_compute_robot_state-npc0": 0.0719841988881429, "sim_compute_robot_state-npc1": 0.07083432833353678, "sim_compute_robot_state-npc2": 0.07076637585957846, "sim_compute_robot_state-npc3": 0.0702580706278483}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.24665569123767672, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.0688319206237793, "in-drivable-lane": 0, "agent_compute-ego": 0.07807871273585729, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.1049536182766869, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.04694864863441104, "sim_compute_performance-ego": 0.07423631350199382, "sim_compute_robot_state-ego": 0.08205951963152204, "sim_compute_robot_state-npc0": 0.07830459730965751, "sim_compute_robot_state-npc1": 0.07791071846371606, "sim_compute_robot_state-npc2": 0.07974281765165783, "sim_compute_robot_state-npc3": 0.08653583980741955}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.2327056374660758, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.0669074391209802, "in-drivable-lane": 1.15, "agent_compute-ego": 0.07237778153530387, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.09717642983724904, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.040400283281193224, "sim_compute_performance-ego": 0.07581840559493663, "sim_compute_robot_state-ego": 0.08211199627366177, "sim_compute_robot_state-npc0": 0.07049647597379463, "sim_compute_robot_state-npc1": 0.07002563809239587, "sim_compute_robot_state-npc2": 0.07103804100391477, "sim_compute_robot_state-npc3": 0.07232353299163109}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.22088357380458287, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.06569826602935791, "in-drivable-lane": 0, "agent_compute-ego": 0.07681456633976527, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.10660466977528164, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.044482920851026266, "sim_compute_performance-ego": 0.07358625105449132, "sim_compute_robot_state-ego": 0.08380627632141113, "sim_compute_robot_state-npc0": 0.07599432979311262, "sim_compute_robot_state-npc1": 0.07323956489562988, "sim_compute_robot_state-npc2": 0.07134429046085902, "sim_compute_robot_state-npc3": 0.07391566038131714}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.2089834540498023, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.06184846747155283, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.07111699440900017, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.0914900910620596, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.03555131426044539, "sim_compute_performance-ego": 0.06674532796822343, "sim_compute_robot_state-ego": 0.07189578168532428, "sim_compute_robot_state-npc0": 0.06593029171812768, "sim_compute_robot_state-npc1": 0.07031402400895662, "sim_compute_robot_state-npc2": 0.0681154166950899, "sim_compute_robot_state-npc3": 0.0672009084738937}}
set_robot_commands_max0.10716943118883215
set_robot_commands_mean0.10175698763133448
set_robot_commands_median0.1024123969143384
set_robot_commands_min0.0914900910620596
sim_compute_performance-ego_max0.07670920269162047
sim_compute_performance-ego_mean0.07207544348324674
sim_compute_performance-ego_median0.07198573413648103
sim_compute_performance-ego_min0.06674532796822343
sim_compute_robot_state-ego_max0.08469806234520602
sim_compute_robot_state-ego_mean0.07981589766230643
sim_compute_robot_state-ego_median0.08071577081493303
sim_compute_robot_state-ego_min0.07189578168532428
sim_compute_robot_state-npc0_max0.08132567772498497
sim_compute_robot_state-npc0_mean0.07352837128401762
sim_compute_robot_state-npc0_median0.07339858541301653
sim_compute_robot_state-npc0_min0.06593029171812768
sim_compute_robot_state-npc1_max0.07791071846371606
sim_compute_robot_state-npc1_mean0.07264068105194886
sim_compute_robot_state-npc1_median0.0724636822530668
sim_compute_robot_state-npc1_min0.06973453804298684
sim_compute_robot_state-npc2_max0.07974281765165783
sim_compute_robot_state-npc2_mean0.07242770637537443
sim_compute_robot_state-npc2_median0.07265999036676743
sim_compute_robot_state-npc2_min0.0663495685743249
sim_compute_robot_state-npc3_max0.08653583980741955
sim_compute_robot_state-npc3_mean0.0731604488775363
sim_compute_robot_state-npc3_median0.07338458520394785
sim_compute_robot_state-npc3_min0.0672009084738937
sim_compute_sim_state_max0.04694864863441104
sim_compute_sim_state_mean0.04139051660781492
sim_compute_sim_state_median0.04118248750997144
sim_compute_sim_state_min0.03555131426044539
sim_physics_max0.24665569123767672
sim_physics_mean0.2229468942301375
sim_physics_median0.22088357380458287
sim_physics_min0.2089834540498023
sim_render-ego_max0.07104189906801496
sim_render-ego_mean0.0666955536735813
sim_render-ego_median0.0669074391209802
sim_render-ego_min0.06184846747155283
simulation-passed1
survival_time_max6.999999999999983
survival_time_mean3.043333333333329
survival_time_min1.0500000000000005
No reset possible