AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 843

evaluator843
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7357
versiond-c:4.0.19;d-c-r:4.0.30;d-s:4.0.21
first heard
last heard
statusinactive
# evaluating
# success31
# timeout
# failed2
# error10
# aborted1
# host-error17
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors100%
RAM total (MB)60.0 GB
RAM free (MB)57.6 GB
Disk (MB)96.9 GB
Disk available (MB)53.5 GB
Docker Hub
P11
P2
PI Camera0
# Duckiebots0
Map 3x3 avaiable0
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
216403260Sean Luchallenge-aido_LF-template-randomaido2-PREDstep1-simulationerroryes8430:00:32
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes/compatibility.py", line 24, in check_compatible_protocol
    raise IncompatibleProtocol(msg)
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type <class 'aido_schemas.schemas.Duckiebot1Observations'> as <class 'float'>: Type <class 'aido_schemas.schemas.Duckiebot1Observations'>
 is not a subclass of <class 'float'>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 75, in <module>
    main(cie)
  File "experiment_manager.py", line 26, in main
    agent_ci._get_node_protocol()
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 84, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/project/src/zuper-nodes/src/zuper_nodes/compatibility.py", line 42, in check_compatible_protocol
    raise IncompatibleProtocol(msg) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
p1: |InteractionProtocol(description='Particularization for Duckiebot1 observations and commands.', inputs={'observations': <class 'aido_schemas.schemas.Duckiebot1Observations'>, 'seed': <class 'int'>, 'get_commands': <class 'NoneType'>, 'episode_start': <class 'aido_schemas.protocol_agent.EpisodeStart'>}, outputs={'commands': <class 'aido_schemas.schemas.Duckiebot1Commands'>}, language='(in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)')
p2: |InteractionProtocol(description='An estimator receives a stream of values and must predict the next value.', inputs={'observations': <class 'float'>, 'seed': <class 'int'>, 'get_prediction': <class 'NoneType'>}, outputs={'prediction': <class 'float'>}, language='(in:seed)? ; ((in:observations | (in:get_prediction ; out:prediction))*)')
(hidden)
216363256JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationsuccessno8430:17:13(hidden)
driven_lanedir_consec_median2.418615133874259
survival_time_median14.950000000000076
deviation-center-line_median1.010751808879406
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.31021003405253095
agent_compute-ego_mean0.27751582076355275
agent_compute-ego_median0.27844630027639455
agent_compute-ego_min0.2468224774419734
deviation-center-line_max1.277314585012814
deviation-center-line_mean0.8610551665204931
deviation-center-line_min0.4136192046414609
deviation-heading_max2.5895447308829618
deviation-heading_mean1.7295417809760374
deviation-heading_median2.0932075450998053
deviation-heading_min0.43381447902135634
driven_any_max2.757711634098175
driven_any_mean2.0596706088029135
driven_any_median2.748647715332554
driven_any_min1.003030631690442
driven_lanedir_consec_max2.698926831809056
driven_lanedir_consec_mean1.9153656247087008
driven_lanedir_consec_min0.9915976238592568
driven_lanedir_max2.698926831809056
driven_lanedir_mean1.9153656247087008
driven_lanedir_median2.418615133874259
driven_lanedir_min0.9915976238592568
in-drivable-lane_max1.3500000000000192
in-drivable-lane_mean0.5200000000000029
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.748647715332554, "sim_physics": 0.07574662526448568, "survival_time": 14.950000000000076, "driven_lanedir": 2.418615133874259, "sim_render-ego": 0.0422228725751241, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.2678349717458089, "deviation-heading": 2.5895447308829618, "set_robot_commands": 0.06533260663350424, "deviation-center-line": 1.010751808879406, "driven_lanedir_consec": 2.418615133874259, "sim_compute_sim_state": 0.028264850775400797, "sim_compute_performance-ego": 0.04566823959350586, "sim_compute_robot_state-ego": 0.050427107016245525}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.757711634098175, "sim_physics": 0.07268771092096965, "survival_time": 14.950000000000076, "driven_lanedir": 2.470310146953941, "sim_render-ego": 0.04211418310801189, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.2842653203010559, "deviation-heading": 2.0932075450998053, "set_robot_commands": 0.06528991222381592, "deviation-center-line": 1.277314585012814, "driven_lanedir_consec": 2.470310146953941, "sim_compute_sim_state": 0.02903992255528768, "sim_compute_performance-ego": 0.04745387633641561, "sim_compute_robot_state-ego": 0.05186001539230347}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.003030631690442, "sim_physics": 0.07592900453415592, "survival_time": 5.649999999999988, "driven_lanedir": 0.9973783870469904, "sim_render-ego": 0.04234101287031595, "in-drivable-lane": 0, "agent_compute-ego": 0.2468224774419734, "deviation-heading": 0.43381447902135634, "set_robot_commands": 0.06690074490234915, "deviation-center-line": 0.5758360507703525, "driven_lanedir_consec": 0.9973783870469904, "sim_compute_sim_state": 0.029858648249533323, "sim_compute_performance-ego": 0.046881260070125615, "sim_compute_robot_state-ego": 0.05141049359752014}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.031318568797858, "sim_physics": 0.07792328760541718, "survival_time": 5.799999999999987, "driven_lanedir": 0.9915976238592568, "sim_render-ego": 0.04240617258795377, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.27844630027639455, "deviation-heading": 1.197864443088784, "set_robot_commands": 0.06533941729315396, "deviation-center-line": 0.4136192046414609, "driven_lanedir_consec": 0.9915976238592568, "sim_compute_sim_state": 0.02904541328035552, "sim_compute_performance-ego": 0.045652757430898736, "sim_compute_robot_state-ego": 0.05015324518598359}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.757644494095537, "sim_physics": 0.0725438412030538, "survival_time": 14.950000000000076, "driven_lanedir": 2.698926831809056, "sim_render-ego": 0.04269337256749471, "in-drivable-lane": 0, "agent_compute-ego": 0.31021003405253095, "deviation-heading": 2.333277706787278, "set_robot_commands": 0.0663847533861796, "deviation-center-line": 1.0277541832984325, "driven_lanedir_consec": 2.698926831809056, "sim_compute_sim_state": 0.028943123817443846, "sim_compute_performance-ego": 0.04610728661219279, "sim_compute_robot_state-ego": 0.05004729509353638}}
set_robot_commands_max0.06690074490234915
set_robot_commands_mean0.06584948688780058
set_robot_commands_median0.06533941729315396
set_robot_commands_min0.06528991222381592
sim_compute_performance-ego_max0.04745387633641561
sim_compute_performance-ego_mean0.04635268400862773
sim_compute_performance-ego_median0.04610728661219279
sim_compute_performance-ego_min0.045652757430898736
sim_compute_robot_state-ego_max0.05186001539230347
sim_compute_robot_state-ego_mean0.05077963125711782
sim_compute_robot_state-ego_median0.050427107016245525
sim_compute_robot_state-ego_min0.05004729509353638
sim_compute_sim_state_max0.029858648249533323
sim_compute_sim_state_mean0.029030391735604233
sim_compute_sim_state_median0.02903992255528768
sim_compute_sim_state_min0.028264850775400797
sim_physics_max0.07792328760541718
sim_physics_mean0.07496609390561644
sim_physics_median0.07574662526448568
sim_physics_min0.0725438412030538
sim_render-ego_max0.04269337256749471
sim_render-ego_mean0.04235552274178008
sim_render-ego_median0.04234101287031595
sim_render-ego_min0.04211418310801189
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.260000000000042
survival_time_min5.649999999999988
216263250WolfChenPredictorLastaido2-PREDstep1-simulationsuccessyes8430:00:29(hidden)
error_L10.10261901947133031
error_L20.016692050490706937


216203244jp18813100494Second test - TH-jpaido2-LF-sim-validationstep1-simulationsuccessno8430:11:27(hidden)
driven_lanedir_consec_median1.1017791781516908
survival_time_median14.950000000000076
deviation-center-line_median0.5600329151300182
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09648509740829468
agent_compute-ego_mean0.09557381320174088
agent_compute-ego_median0.09598321481184524
agent_compute-ego_min0.09401215630016108
deviation-center-line_max1.0058316156344536
deviation-center-line_mean0.585960599552088
deviation-center-line_min0.32037356963980534
deviation-heading_max2.538127033152034
deviation-heading_mean2.1197651033781035
deviation-heading_median2.0998979100231123
deviation-heading_min1.7090764965907583
driven_any_max2.9970783255399027
driven_any_mean1.495753592459728
driven_any_median1.2525846138634489
driven_any_min0.589387252561687
driven_lanedir_consec_max2.8150798375931956
driven_lanedir_consec_mean1.17957651634551
driven_lanedir_consec_min0.274996421594105
driven_lanedir_max2.8150798375931956
driven_lanedir_mean1.17957651634551
driven_lanedir_median1.1017791781516908
driven_lanedir_min0.274996421594105
in-drivable-lane_max9.150000000000093
in-drivable-lane_mean1.860000000000018
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.589387252561687, "sim_physics": 0.05836537751284512, "survival_time": 5.4999999999999885, "driven_lanedir": 0.4718733328879434, "sim_render-ego": 0.03608284863558683, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.09598321481184524, "deviation-heading": 1.8475966887163395, "set_robot_commands": 0.05574651414697821, "deviation-center-line": 0.32037356963980534, "driven_lanedir_consec": 0.4718733328879434, "sim_compute_sim_state": 0.023204562880776144, "sim_compute_performance-ego": 0.039072478901256216, "sim_compute_robot_state-ego": 0.04080962051044811}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9357556450107442, "sim_physics": 0.05743742068608602, "survival_time": 14.950000000000076, "driven_lanedir": 0.274996421594105, "sim_render-ego": 0.03585672537485758, "in-drivable-lane": 0, "agent_compute-ego": 0.0950563144683838, "deviation-heading": 2.0998979100231123, "set_robot_commands": 0.0537367041905721, "deviation-center-line": 0.5600329151300182, "driven_lanedir_consec": 0.274996421594105, "sim_compute_sim_state": 0.022988804976145423, "sim_compute_performance-ego": 0.03838247617085775, "sim_compute_robot_state-ego": 0.04051965872446696}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.9970783255399027, "sim_physics": 0.05582435131072998, "survival_time": 14.950000000000076, "driven_lanedir": 2.8150798375931956, "sim_render-ego": 0.036979688008626305, "in-drivable-lane": 0, "agent_compute-ego": 0.09633228302001952, "deviation-heading": 2.404127388408273, "set_robot_commands": 0.054097998142242434, "deviation-center-line": 1.0058316156344536, "driven_lanedir_consec": 2.8150798375931956, "sim_compute_sim_state": 0.023155426184336345, "sim_compute_performance-ego": 0.03881269057591756, "sim_compute_robot_state-ego": 0.041871798833211266}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2525846138634489, "sim_physics": 0.05826730152656292, "survival_time": 8.699999999999989, "driven_lanedir": 1.1017791781516908, "sim_render-ego": 0.03601327298701495, "in-drivable-lane": 0, "agent_compute-ego": 0.09401215630016108, "deviation-heading": 1.7090764965907583, "set_robot_commands": 0.05599636044995538, "deviation-center-line": 0.617296874178294, "driven_lanedir_consec": 1.1017791781516908, "sim_compute_sim_state": 0.022987334207556713, "sim_compute_performance-ego": 0.038401176189554145, "sim_compute_robot_state-ego": 0.04048961332474632}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7039621253228574, "sim_physics": 0.05381633202234904, "survival_time": 14.950000000000076, "driven_lanedir": 1.234153811500614, "sim_render-ego": 0.03530439853668213, "in-drivable-lane": 9.150000000000093, "agent_compute-ego": 0.09648509740829468, "deviation-heading": 2.538127033152034, "set_robot_commands": 0.05348788738250732, "deviation-center-line": 0.4262680231778686, "driven_lanedir_consec": 1.234153811500614, "sim_compute_sim_state": 0.0232104762395223, "sim_compute_performance-ego": 0.03852075576782227, "sim_compute_robot_state-ego": 0.04061421235402425}}
set_robot_commands_max0.05599636044995538
set_robot_commands_mean0.054613092862451085
set_robot_commands_median0.054097998142242434
set_robot_commands_min0.05348788738250732
sim_compute_performance-ego_max0.039072478901256216
sim_compute_performance-ego_mean0.03863791552108159
sim_compute_performance-ego_median0.03852075576782227
sim_compute_performance-ego_min0.03838247617085775
sim_compute_robot_state-ego_max0.041871798833211266
sim_compute_robot_state-ego_mean0.04086098074937938
sim_compute_robot_state-ego_median0.04061421235402425
sim_compute_robot_state-ego_min0.04048961332474632
sim_compute_sim_state_max0.0232104762395223
sim_compute_sim_state_mean0.023109320897667384
sim_compute_sim_state_median0.023155426184336345
sim_compute_sim_state_min0.022987334207556713
sim_physics_max0.05836537751284512
sim_physics_mean0.056742156611714625
sim_physics_median0.05743742068608602
sim_physics_min0.05381633202234904
sim_render-ego_max0.036979688008626305
sim_render-ego_mean0.03604738670855356
sim_render-ego_median0.03601327298701495
sim_render-ego_min0.03530439853668213
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.81000000000004
survival_time_min5.4999999999999885
216063233jp18813100494First test - TH -hhkaido2-LF-sim-validationstep1-simulationerrorno8430:01:29
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
215513221AmaurXchallenge-aido_LF-template-randomaido2-LFVI-sim-validationstep1-simulationsuccessno8430:06:32(hidden)
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.1159718944912865
agent_compute-ego_mean0.1101103996047799
agent_compute-ego_median0.11183050312573396
agent_compute-ego_min0.09803155490330288
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.13669356213340275, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.04524037506006941, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.11183050312573396, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.06954663312887843, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.02826837044727953, "sim_compute_performance-ego": 0.04776420472543451, "sim_compute_robot_state-ego": 0.048844829390320595, "sim_compute_robot_state-npc0": 0.04904306085803841, "sim_compute_robot_state-npc1": 0.04988354972646206, "sim_compute_robot_state-npc2": 0.050763809228245214, "sim_compute_robot_state-npc3": 0.04965142358707477}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.1338417444910322, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.03856054374149868, "in-drivable-lane": 0, "agent_compute-ego": 0.09803155490330288, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.05854271139417376, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.02575107983180455, "sim_compute_performance-ego": 0.03988763264247349, "sim_compute_robot_state-ego": 0.04492450611931937, "sim_compute_robot_state-npc0": 0.04469449179513114, "sim_compute_robot_state-npc1": 0.04494030135018485, "sim_compute_robot_state-npc2": 0.04435397045952933, "sim_compute_robot_state-npc3": 0.044241692338671}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.13111783231346352, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.04352506619055294, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.11519123744038702, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.0689417135368273, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.030369483151482145, "sim_compute_performance-ego": 0.046523758508626695, "sim_compute_robot_state-ego": 0.047826586417781494, "sim_compute_robot_state-npc0": 0.051551179978453994, "sim_compute_robot_state-npc1": 0.05316088037583434, "sim_compute_robot_state-npc2": 0.05007771149422358, "sim_compute_robot_state-npc3": 0.05220345617498009}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.13347900410493216, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.042379086216290794, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.1095268080631892, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.06652078529198964, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.027715663115183514, "sim_compute_performance-ego": 0.04582904279232025, "sim_compute_robot_state-ego": 0.04705046117305755, "sim_compute_robot_state-npc0": 0.04891756673653921, "sim_compute_robot_state-npc1": 0.048488885164260864, "sim_compute_robot_state-npc2": 0.04783230026563009, "sim_compute_robot_state-npc3": 0.049160162607828774}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.15112883704049246, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.04412417184738886, "in-drivable-lane": 0, "agent_compute-ego": 0.1159718944912865, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.06782811028616768, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.02815608751206171, "sim_compute_performance-ego": 0.049049388794671925, "sim_compute_robot_state-ego": 0.05270880744570777, "sim_compute_robot_state-npc0": 0.052201123464675175, "sim_compute_robot_state-npc1": 0.050673053378150576, "sim_compute_robot_state-npc2": 0.053354683376493905, "sim_compute_robot_state-npc3": 0.0502746445792062}}
set_robot_commands_max0.06954663312887843
set_robot_commands_mean0.06627599072760737
set_robot_commands_median0.06782811028616768
set_robot_commands_min0.05854271139417376
sim_compute_performance-ego_max0.049049388794671925
sim_compute_performance-ego_mean0.04581080549270537
sim_compute_performance-ego_median0.046523758508626695
sim_compute_performance-ego_min0.03988763264247349
sim_compute_robot_state-ego_max0.05270880744570777
sim_compute_robot_state-ego_mean0.04827103810923736
sim_compute_robot_state-ego_median0.047826586417781494
sim_compute_robot_state-ego_min0.04492450611931937
sim_compute_robot_state-npc0_max0.052201123464675175
sim_compute_robot_state-npc0_mean0.049281484566567585
sim_compute_robot_state-npc0_median0.04904306085803841
sim_compute_robot_state-npc0_min0.04469449179513114
sim_compute_robot_state-npc1_max0.05316088037583434
sim_compute_robot_state-npc1_mean0.049429333998978545
sim_compute_robot_state-npc1_median0.04988354972646206
sim_compute_robot_state-npc1_min0.04494030135018485
sim_compute_robot_state-npc2_max0.053354683376493905
sim_compute_robot_state-npc2_mean0.049276494964824426
sim_compute_robot_state-npc2_median0.05007771149422358
sim_compute_robot_state-npc2_min0.04435397045952933
sim_compute_robot_state-npc3_max0.05220345617498009
sim_compute_robot_state-npc3_mean0.04910627585755216
sim_compute_robot_state-npc3_median0.04965142358707477
sim_compute_robot_state-npc3_min0.044241692338671
sim_compute_sim_state_max0.030369483151482145
sim_compute_sim_state_mean0.028052136811562288
sim_compute_sim_state_median0.02815608751206171
sim_compute_sim_state_min0.02575107983180455
sim_physics_max0.15112883704049246
sim_physics_mean0.1372521960166646
sim_physics_median0.1338417444910322
sim_physics_min0.13111783231346352
sim_render-ego_max0.04524037506006941
sim_render-ego_mean0.04276584861116014
sim_render-ego_median0.04352506619055294
sim_render-ego_min0.03856054374149868
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
215163204Masachallenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationabortedno8430:09:16(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.09221146583557129
agent_compute-ego_mean0.08695002049202444
agent_compute-ego_median0.08666832972381075
agent_compute-ego_min0.08543548129853748
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.0562919643190172, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.03576353302708379, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.0873586513378002, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.05565136891824228, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.02324948928974293, "sim_compute_performance-ego": 0.038613712346112286, "sim_compute_robot_state-ego": 0.04044482443067762}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.055216709772745766, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.035276085722680185, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08720516223533481, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.05454588871376187, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.022820528815774357, "sim_compute_performance-ego": 0.03866258789511288, "sim_compute_robot_state-ego": 0.03989192083770154}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.058017702663646024, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.03560301836799173, "in-drivable-lane": 0, "agent_compute-ego": 0.0855247132918414, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0541541716631721, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.02294363695032456, "sim_compute_performance-ego": 0.03885242518256692, "sim_compute_robot_state-ego": 0.041582191691679114}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.06017354011535645, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.03607560157775879, "in-drivable-lane": 0, "agent_compute-ego": 0.09221146583557129, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.05516352653503418, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.023871803283691408, "sim_compute_performance-ego": 0.03847563743591308, "sim_compute_robot_state-ego": 0.040407142639160155}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.05762075472481643, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.03736827645120742, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.08607878564279291, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.055200718626191345, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.0231644050984443, "sim_compute_performance-ego": 0.038485877121551125, "sim_compute_robot_state-ego": 0.041173648230637176}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.057562759944370816, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.03561235933887715, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.08600803783961705, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.05455381529671805, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.022823645144092793, "sim_compute_performance-ego": 0.03837967405513841, "sim_compute_robot_state-ego": 0.04054248576261559}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.06839186378887721, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.035833384309496195, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.08620744092123848, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.05443415471485683, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.02292401875768389, "sim_compute_performance-ego": 0.039478378636496406, "sim_compute_robot_state-ego": 0.04089014870779855}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.06069724900381906, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.03552166620890299, "in-drivable-lane": 0, "agent_compute-ego": 0.08543548129853748, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.05467725935436431, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.02366441772097633, "sim_compute_performance-ego": 0.03834164710271926, "sim_compute_robot_state-ego": 0.04075930232093448}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.06055791499251026, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.036903175257020075, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.08666832972381075, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.05723733821157682, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.02307045257697671, "sim_compute_performance-ego": 0.038906590413239045, "sim_compute_robot_state-ego": 0.040553889032137594}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.05550542311234908, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.03656248612837358, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.08761168826710095, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.05529815066944469, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.023029973290183327, "sim_compute_performance-ego": 0.039250850677490234, "sim_compute_robot_state-ego": 0.04100901863791726}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.05743034783895914, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.03658154413297579, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.0874393048224511, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.05697109172870586, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.023078587148096658, "sim_compute_performance-ego": 0.038688281913856405, "sim_compute_robot_state-ego": 0.04058802282655394}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.059261611529759, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.03650262526103428, "in-drivable-lane": 0, "agent_compute-ego": 0.08748254605701991, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.054662849221910746, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.022883687700544084, "sim_compute_performance-ego": 0.04004863330296108, "sim_compute_robot_state-ego": 0.04097425937652588}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.05595496121574851, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.03541877222996132, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.08636931344574574, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.054521429772470514, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.023319146212409523, "sim_compute_performance-ego": 0.03865527639202043, "sim_compute_robot_state-ego": 0.04051814827264524}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.05888566264399776, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.0354360474480523, "in-drivable-lane": 0, "agent_compute-ego": 0.08594499693976508, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.0545347531636556, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.023346556557549372, "sim_compute_performance-ego": 0.03822974805478697, "sim_compute_robot_state-ego": 0.04038199671992549}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.05812416357152602, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.03642749552633248, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.08670438972173952, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.05463856108048383, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.02318288531957888, "sim_compute_performance-ego": 0.03904271593280867, "sim_compute_robot_state-ego": 0.04076913992563883}}
set_robot_commands_max0.05723733821157682
set_robot_commands_mean0.055083005178039275
set_robot_commands_median0.054662849221910746
set_robot_commands_min0.0541541716631721
sim_compute_performance-ego_max0.04004863330296108
sim_compute_performance-ego_mean0.03880746909751821
sim_compute_performance-ego_median0.03866258789511288
sim_compute_performance-ego_min0.03822974805478697
sim_compute_robot_state-ego_max0.041582191691679114
sim_compute_robot_state-ego_mean0.04069907596083656
sim_compute_robot_state-ego_median0.04058802282655394
sim_compute_robot_state-ego_min0.03989192083770154
sim_compute_sim_state_max0.023871803283691408
sim_compute_sim_state_mean0.02315821559107128
sim_compute_sim_state_median0.023078587148096658
sim_compute_sim_state_min0.022820528815774357
sim_physics_max0.06839186378887721
sim_physics_mean0.058646175282499914
sim_physics_median0.058017702663646024
sim_physics_min0.055216709772745766
sim_render-ego_max0.03736827645120742
sim_render-ego_mean0.036059071399183205
sim_render-ego_median0.035833384309496195
sim_render-ego_min0.035276085722680185
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
214973189jp18813100494First test - THaido2-LF-sim-validationstep1-simulationsuccessno8430:14:43(hidden)
driven_lanedir_consec_median3.014218708590877
survival_time_median14.950000000000076
deviation-center-line_median1.214024682700227
in-drivable-lane_median0.8500000000000121


other stats
agent_compute-ego_max0.12803800106048585
agent_compute-ego_mean0.10375435622533162
agent_compute-ego_median0.09745416720708212
agent_compute-ego_min0.09693927526474
deviation-center-line_max1.9756515234335512
deviation-center-line_mean1.3615817206056693
deviation-center-line_min1.1177610347290754
deviation-heading_max12.182267774911509
deviation-heading_mean6.152146460415496
deviation-heading_median3.6086193485712177
deviation-heading_min3.233089649057491
driven_any_max3.6064495544271553
driven_any_mean2.7931367776812435
driven_any_median3.206619244387382
driven_any_min0.6159262114551919
driven_lanedir_consec_max3.0597781770717978
driven_lanedir_consec_mean2.4453627571253405
driven_lanedir_consec_min0.6089540376857013
driven_lanedir_max3.0597781770717978
driven_lanedir_mean2.4453627571253405
driven_lanedir_median3.014218708590877
driven_lanedir_min0.6089540376857013
in-drivable-lane_max1.8000000000000256
in-drivable-lane_mean0.7100000000000071
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.451037953089127, "sim_physics": 0.07866566419601441, "survival_time": 14.950000000000076, "driven_lanedir": 2.5118982431227024, "sim_render-ego": 0.0471296755472819, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.12803800106048585, "deviation-heading": 3.372200315130104, "set_robot_commands": 0.070015230178833, "deviation-center-line": 1.1536826735788988, "driven_lanedir_consec": 2.5118982431227024, "sim_compute_sim_state": 0.030202271938323973, "sim_compute_performance-ego": 0.050849910577138266, "sim_compute_robot_state-ego": 0.05144738038380941}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6159262114551919, "sim_physics": 0.058075406551361085, "survival_time": 14.950000000000076, "driven_lanedir": 0.6089540376857013, "sim_render-ego": 0.03629557371139527, "in-drivable-lane": 0, "agent_compute-ego": 0.0991200304031372, "deviation-heading": 12.182267774911509, "set_robot_commands": 0.05600629488627116, "deviation-center-line": 1.9756515234335512, "driven_lanedir_consec": 0.6089540376857013, "sim_compute_sim_state": 0.023963724772135417, "sim_compute_performance-ego": 0.03958184083302816, "sim_compute_robot_state-ego": 0.042726693153381345}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.0856509250473607, "sim_physics": 0.05659327189127604, "survival_time": 14.950000000000076, "driven_lanedir": 3.0319646191556227, "sim_render-ego": 0.03599618434906006, "in-drivable-lane": 0, "agent_compute-ego": 0.09693927526474, "deviation-heading": 8.364555214407158, "set_robot_commands": 0.05463001171747844, "deviation-center-line": 1.1177610347290754, "driven_lanedir_consec": 3.0319646191556227, "sim_compute_sim_state": 0.02314199527104696, "sim_compute_performance-ego": 0.03916552941004435, "sim_compute_robot_state-ego": 0.04008853673934937}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.6064495544271553, "sim_physics": 0.056713555653889976, "survival_time": 14.950000000000076, "driven_lanedir": 3.0597781770717978, "sim_render-ego": 0.03603833198547363, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.09722030719121295, "deviation-heading": 3.6086193485712177, "set_robot_commands": 0.054321135679880776, "deviation-center-line": 1.214024682700227, "driven_lanedir_consec": 3.0597781770717978, "sim_compute_sim_state": 0.02305919885635376, "sim_compute_performance-ego": 0.039697093963623045, "sim_compute_robot_state-ego": 0.0397349468866984}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.206619244387382, "sim_physics": 0.05772544463475545, "survival_time": 14.950000000000076, "driven_lanedir": 3.014218708590877, "sim_render-ego": 0.0357776419321696, "in-drivable-lane": 0.8999999999999977, "agent_compute-ego": 0.09745416720708212, "deviation-heading": 3.233089649057491, "set_robot_commands": 0.05408940156300863, "deviation-center-line": 1.346788688586594, "driven_lanedir_consec": 3.014218708590877, "sim_compute_sim_state": 0.02323572079340617, "sim_compute_performance-ego": 0.03867722193400065, "sim_compute_robot_state-ego": 0.039987936814626056}}
set_robot_commands_max0.070015230178833
set_robot_commands_mean0.0578124148050944
set_robot_commands_median0.05463001171747844
set_robot_commands_min0.05408940156300863
sim_compute_performance-ego_max0.050849910577138266
sim_compute_performance-ego_mean0.04159431934356689
sim_compute_performance-ego_median0.03958184083302816
sim_compute_performance-ego_min0.03867722193400065
sim_compute_robot_state-ego_max0.05144738038380941
sim_compute_robot_state-ego_mean0.04279709879557292
sim_compute_robot_state-ego_median0.04008853673934937
sim_compute_robot_state-ego_min0.0397349468866984
sim_compute_sim_state_max0.030202271938323973
sim_compute_sim_state_mean0.024720582326253255
sim_compute_sim_state_median0.02323572079340617
sim_compute_sim_state_min0.02305919885635376
sim_physics_max0.07866566419601441
sim_physics_mean0.06155466858545938
sim_physics_median0.05772544463475545
sim_physics_min0.05659327189127604
sim_render-ego_max0.0471296755472819
sim_render-ego_mean0.03824748150507609
sim_render-ego_median0.03603833198547363
sim_render-ego_min0.0357776419321696
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
214113116almasipBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationhost-errorno8430:09:17
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3116/step1-simulation-ip-172-31-42-167-7357-job21411/logs/challenges-runner/stdout.log'
(hidden)
214032410jp18813100494Baseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessno8430:57:44(hidden)
driven_lanedir_consec_median-1.355676207214709
survival_time_median14.950000000000076
deviation-center-line_median1.002134440312669
in-drivable-lane_median4.050000000000024


other stats
agent_compute-ego_max0.0955276370048523
agent_compute-ego_mean0.09445809634526572
agent_compute-ego_median0.09444457213083902
agent_compute-ego_min0.09346494356791178
deviation-center-line_max1.5296442653166566
deviation-center-line_mean0.8536767524476552
deviation-center-line_min0.2656525762859935
deviation-heading_max8.682256325592228
deviation-heading_mean6.927230740477735
deviation-heading_median7.090641611385013
deviation-heading_min5.52174661383955
driven_any_max4.378506444052824
driven_any_mean4.378506444052809
driven_any_median4.378506444052808
driven_any_min4.378506444052796
driven_lanedir_consec_max-1.2728379671211965
driven_lanedir_consec_mean-1.352643582087815
driven_lanedir_consec_min-1.388190292394527
driven_lanedir_max-1.3477913186786226
driven_lanedir_mean-2.005867861365606
driven_lanedir_median-2.260637650975249
driven_lanedir_min-2.7253255736285684
in-drivable-lane_max7.60000000000004
in-drivable-lane_mean4.9200000000000275
in-drivable-lane_min2.100000000000011
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.09122009913126627, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.03631322940190633, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.0955276370048523, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.05523066600163778, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.022730733553568524, "sim_compute_performance-ego": 0.03872823238372803, "sim_compute_robot_state-ego": 0.04056239366531372, "sim_compute_robot_state-npc0": 0.04059567292531331, "sim_compute_robot_state-npc1": 0.03972894112269083, "sim_compute_robot_state-npc2": 0.03956274429957072, "sim_compute_robot_state-npc3": 0.03956585566202799}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052822, "sim_physics": 0.08879700899124146, "survival_time": 14.950000000000076, "driven_lanedir": -2.686350659544358, "sim_render-ego": 0.03604775746663411, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.09471882979075114, "deviation-heading": 8.558153948461722, "set_robot_commands": 0.054464730421702065, "deviation-center-line": 1.5296442653166566, "driven_lanedir_consec": -1.2728379671211965, "sim_compute_sim_state": 0.02269486824671427, "sim_compute_performance-ego": 0.038694469928741454, "sim_compute_robot_state-ego": 0.04068134228388468, "sim_compute_robot_state-npc0": 0.040321497122446696, "sim_compute_robot_state-npc1": 0.04003631750742594, "sim_compute_robot_state-npc2": 0.039473456541697184, "sim_compute_robot_state-npc3": 0.03964911301930745}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.378506444052811, "sim_physics": 0.09250166336695352, "survival_time": 14.950000000000076, "driven_lanedir": -1.3662544443440128, "sim_render-ego": 0.036136234601338704, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.09472435315450033, "deviation-heading": 5.773684892471282, "set_robot_commands": 0.05455291748046875, "deviation-center-line": 0.2929285686140787, "driven_lanedir_consec": -1.3662544443440128, "sim_compute_sim_state": 0.024064414501190182, "sim_compute_performance-ego": 0.03867609739303589, "sim_compute_robot_state-ego": 0.04064634005228678, "sim_compute_robot_state-npc0": 0.04046774625778198, "sim_compute_robot_state-npc1": 0.03961586316426595, "sim_compute_robot_state-npc2": 0.04046960433324178, "sim_compute_robot_state-npc3": 0.03964637756347656}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052824, "sim_physics": 0.09234817028045654, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670015115194478, "sim_render-ego": 0.036306073665618895, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.09444457213083902, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.054590477148691814, "deviation-center-line": 0.28261955257418875, "driven_lanedir_consec": -1.3670015115194478, "sim_compute_sim_state": 0.0228649894396464, "sim_compute_performance-ego": 0.038926382859547935, "sim_compute_robot_state-ego": 0.04072261571884155, "sim_compute_robot_state-npc0": 0.04191320339838664, "sim_compute_robot_state-npc1": 0.03982582728068034, "sim_compute_robot_state-npc2": 0.03963820139567057, "sim_compute_robot_state-npc3": 0.039785698254903155}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.37850644405281, "sim_physics": 0.09334729115168254, "survival_time": 14.950000000000076, "driven_lanedir": -2.260637650975249, "sim_render-ego": 0.03639143228530884, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.09522622664769492, "deviation-heading": 7.090641611385013, "set_robot_commands": 0.05609631697336832, "deviation-center-line": 1.002134440312669, "driven_lanedir_consec": -1.339793520141566, "sim_compute_sim_state": 0.02270004590352376, "sim_compute_performance-ego": 0.038666296005249026, "sim_compute_robot_state-ego": 0.04057096004486084, "sim_compute_robot_state-npc0": 0.040519961516062415, "sim_compute_robot_state-npc1": 0.03981616655985514, "sim_compute_robot_state-npc2": 0.03971685489018758, "sim_compute_robot_state-npc3": 0.039786758422851565}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 4.378506444052811, "sim_physics": 0.09305345217386882, "survival_time": 14.950000000000076, "driven_lanedir": -2.608509993180694, "sim_render-ego": 0.037444795767466225, "in-drivable-lane": 2.5500000000000136, "agent_compute-ego": 0.09501384973526, "deviation-heading": 8.07296329712472, "set_robot_commands": 0.05465654293696086, "deviation-center-line": 1.3867682469030311, "driven_lanedir_consec": -1.388190292394527, "sim_compute_sim_state": 0.022877385616302492, "sim_compute_performance-ego": 0.039028578599294025, "sim_compute_robot_state-ego": 0.04074295043945313, "sim_compute_robot_state-npc0": 0.04047558148701986, "sim_compute_robot_state-npc1": 0.040196531613667805, "sim_compute_robot_state-npc2": 0.03963710069656372, "sim_compute_robot_state-npc3": 0.03993384758631388}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 4.378506444052805, "sim_physics": 0.0885393738746643, "survival_time": 14.950000000000076, "driven_lanedir": -1.355676207214709, "sim_render-ego": 0.03579576412836711, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.094808988571167, "deviation-heading": 5.863437531793397, "set_robot_commands": 0.05434913953145345, "deviation-center-line": 0.2923561535172491, "driven_lanedir_consec": -1.355676207214709, "sim_compute_sim_state": 0.02414363225301107, "sim_compute_performance-ego": 0.03850113312403361, "sim_compute_robot_state-ego": 0.04038920323053996, "sim_compute_robot_state-npc0": 0.040241539478302, "sim_compute_robot_state-npc1": 0.039686381816864014, "sim_compute_robot_state-npc2": 0.03954297542572022, "sim_compute_robot_state-npc3": 0.03956587870915731}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.378506444052796, "sim_physics": 0.08920387506484985, "survival_time": 14.950000000000076, "driven_lanedir": -1.377653082196022, "sim_render-ego": 0.035627570947011314, "in-drivable-lane": 7.30000000000004, "agent_compute-ego": 0.09380549669265748, "deviation-heading": 5.826000672384985, "set_robot_commands": 0.0552062201499939, "deviation-center-line": 0.28890677730047676, "driven_lanedir_consec": -1.377653082196022, "sim_compute_sim_state": 0.0226928448677063, "sim_compute_performance-ego": 0.03833829323450724, "sim_compute_robot_state-ego": 0.04029395341873169, "sim_compute_robot_state-npc0": 0.04001023292541504, "sim_compute_robot_state-npc1": 0.03974134604136149, "sim_compute_robot_state-npc2": 0.03934278964996338, "sim_compute_robot_state-npc3": 0.03945903380711873}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 4.378506444052807, "sim_physics": 0.08555604060490926, "survival_time": 14.950000000000076, "driven_lanedir": -2.4543552110962836, "sim_render-ego": 0.03568967580795288, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.09368824164072671, "deviation-heading": 7.285030095349859, "set_robot_commands": 0.05529999494552612, "deviation-center-line": 1.16426495230065, "driven_lanedir_consec": -1.3837301815284158, "sim_compute_sim_state": 0.02238229751586914, "sim_compute_performance-ego": 0.03822850624720255, "sim_compute_robot_state-ego": 0.040371359984079994, "sim_compute_robot_state-npc0": 0.03998291810353597, "sim_compute_robot_state-npc1": 0.03932715574900309, "sim_compute_robot_state-npc2": 0.038937740325927735, "sim_compute_robot_state-npc3": 0.03968732515970866}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 4.378506444052819, "sim_physics": 0.09158688386281331, "survival_time": 14.950000000000076, "driven_lanedir": -2.59861542380514, "sim_render-ego": 0.035548725922902424, "in-drivable-lane": 2.250000000000013, "agent_compute-ego": 0.0941602357228597, "deviation-heading": 8.682256325592228, "set_robot_commands": 0.05429823319117228, "deviation-center-line": 1.4641409944409558, "driven_lanedir_consec": -1.339457603752913, "sim_compute_sim_state": 0.02232444763183594, "sim_compute_performance-ego": 0.038147946198781334, "sim_compute_robot_state-ego": 0.041244099934895834, "sim_compute_robot_state-npc0": 0.04013369083404541, "sim_compute_robot_state-npc1": 0.03918069839477539, "sim_compute_robot_state-npc2": 0.03902174393335978, "sim_compute_robot_state-npc3": 0.039298442204793296}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 4.378506444052819, "sim_physics": 0.08755947987238566, "survival_time": 14.950000000000076, "driven_lanedir": -2.487619304575852, "sim_render-ego": 0.035784616470336914, "in-drivable-lane": 3.150000000000018, "agent_compute-ego": 0.0952795656522115, "deviation-heading": 7.680289782334559, "set_robot_commands": 0.05559024890263875, "deviation-center-line": 1.2605671921446628, "driven_lanedir_consec": -1.333456085292506, "sim_compute_sim_state": 0.02234350840250651, "sim_compute_performance-ego": 0.03815324306488037, "sim_compute_robot_state-ego": 0.04015722433725993, "sim_compute_robot_state-npc0": 0.03995945612589518, "sim_compute_robot_state-npc1": 0.03920641819636027, "sim_compute_robot_state-npc2": 0.039130895137786864, "sim_compute_robot_state-npc3": 0.03912423928578695}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 4.378506444052808, "sim_physics": 0.0850731102625529, "survival_time": 14.950000000000076, "driven_lanedir": -1.3477913186786226, "sim_render-ego": 0.03593200922012329, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.09410636266072592, "deviation-heading": 5.52174661383955, "set_robot_commands": 0.05374397198359172, "deviation-center-line": 0.26627156834437943, "driven_lanedir_consec": -1.3477913186786226, "sim_compute_sim_state": 0.022444318930308023, "sim_compute_performance-ego": 0.038118921120961505, "sim_compute_robot_state-ego": 0.03983924547831218, "sim_compute_robot_state-npc0": 0.03983984470367432, "sim_compute_robot_state-npc1": 0.039255345662434896, "sim_compute_robot_state-npc2": 0.03893729368845622, "sim_compute_robot_state-npc3": 0.039294924736022946}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 4.378506444052802, "sim_physics": 0.08833346128463745, "survival_time": 14.950000000000076, "driven_lanedir": -2.7253255736285684, "sim_render-ego": 0.03590248823165894, "in-drivable-lane": 2.100000000000011, "agent_compute-ego": 0.09399883429209392, "deviation-heading": 8.383960965716458, "set_robot_commands": 0.05501988093058268, "deviation-center-line": 1.5198553376845148, "driven_lanedir_consec": -1.3654612749893655, "sim_compute_sim_state": 0.022477326393127443, "sim_compute_performance-ego": 0.03824900468190511, "sim_compute_robot_state-ego": 0.03995508829752604, "sim_compute_robot_state-npc0": 0.04003920555114746, "sim_compute_robot_state-npc1": 0.039584095478057864, "sim_compute_robot_state-npc2": 0.039158971309661866, "sim_compute_robot_state-npc3": 0.039367383321126305}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 4.378506444052804, "sim_physics": 0.09070298671722413, "survival_time": 14.950000000000076, "driven_lanedir": -1.3543489995592757, "sim_render-ego": 0.035790783564249674, "in-drivable-lane": 7.550000000000041, "agent_compute-ego": 0.09346494356791178, "deviation-heading": 5.531556420749436, "set_robot_commands": 0.053761499722798665, "deviation-center-line": 0.2656525762859935, "driven_lanedir_consec": -1.3543489995592757, "sim_compute_sim_state": 0.02229602336883545, "sim_compute_performance-ego": 0.03827395995457967, "sim_compute_robot_state-ego": 0.04010551373163859, "sim_compute_robot_state-npc0": 0.04020915985107422, "sim_compute_robot_state-npc1": 0.03933428525924683, "sim_compute_robot_state-npc2": 0.03902140855789184, "sim_compute_robot_state-npc3": 0.0393457571665446}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 4.378506444052808, "sim_physics": 0.0893623121579488, "survival_time": 14.950000000000076, "driven_lanedir": -1.3871236758121115, "sim_render-ego": 0.03568454424540202, "in-drivable-lane": 7.450000000000041, "agent_compute-ego": 0.09390330791473388, "deviation-heading": 5.569918191698341, "set_robot_commands": 0.055079286893208824, "deviation-center-line": 0.26950853351829485, "driven_lanedir_consec": -1.3871236758121115, "sim_compute_sim_state": 0.022280762195587157, "sim_compute_performance-ego": 0.03823049386342366, "sim_compute_robot_state-ego": 0.040054221153259274, "sim_compute_robot_state-npc0": 0.039991549650828045, "sim_compute_robot_state-npc1": 0.03904835462570191, "sim_compute_robot_state-npc2": 0.0388656489054362, "sim_compute_robot_state-npc3": 0.039098472595214845}}
set_robot_commands_max0.05609631697336832
set_robot_commands_mean0.05479600848091973
set_robot_commands_median0.05465654293696086
set_robot_commands_min0.05374397198359172
sim_compute_performance-ego_max0.039028578599294025
sim_compute_performance-ego_mean0.0384641039106581
sim_compute_performance-ego_median0.03833829323450724
sim_compute_performance-ego_min0.038118921120961505
sim_compute_robot_state-ego_max0.041244099934895834
sim_compute_robot_state-ego_mean0.040422434118058945
sim_compute_robot_state-ego_median0.04038920323053996
sim_compute_robot_state-ego_min0.03983924547831218
sim_compute_robot_state-npc0_max0.04191320339838664
sim_compute_robot_state-npc0_mean0.040313417328728576
sim_compute_robot_state-npc0_median0.04020915985107422
sim_compute_robot_state-npc0_min0.03983984470367432
sim_compute_robot_state-npc1_max0.040196531613667805
sim_compute_robot_state-npc1_mean0.03957224856482612
sim_compute_robot_state-npc1_median0.03961586316426595
sim_compute_robot_state-npc1_min0.03904835462570191
sim_compute_robot_state-npc2_max0.04046960433324178
sim_compute_robot_state-npc2_mean0.0393638286060757
sim_compute_robot_state-npc2_median0.03934278964996338
sim_compute_robot_state-npc2_min0.0388656489054362
sim_compute_robot_state-npc3_max0.03993384758631388
sim_compute_robot_state-npc3_mean0.03950727383295696
sim_compute_robot_state-npc3_median0.03956585566202799
sim_compute_robot_state-npc3_min0.039098472595214845
sim_compute_sim_state_max0.02414363225301107
sim_compute_sim_state_mean0.022754506587982178
sim_compute_sim_state_median0.0226928448677063
sim_compute_sim_state_min0.022280762195587157
sim_physics_max0.09334729115168254
sim_physics_mean0.08981234725316364
sim_physics_median0.0893623121579488
sim_physics_min0.0850731102625529
sim_render-ego_max0.037444795767466225
sim_render-ego_mean0.03602638011508518
sim_render-ego_median0.03590248823165894
sim_render-ego_min0.035548725922902424
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
213982412jp18813100494Baseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationhost-errorno8430:59:30
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2412/step1-simulation-ip-172-31-42-167-7357-job21398/logs/challenges-runner/stdout.log'
(hidden)
213922450enickyBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationhost-errorno8430:59:35
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-42-167-7357-job21392/logs/challenges-runner/stdout.log'
(hidden)
213832373Liam Paullminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationsuccessno8430:42:52(hidden)
driven_lanedir_consec_median0.637258234942822
survival_time_median7.199999999999982
deviation-center-line_median0.41059891008830585
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.15594795530876226
agent_compute-ego_mean0.11089440535044356
agent_compute-ego_median0.1091697613398234
agent_compute-ego_min0.08716986884533519
deviation-center-line_max0.9349599376168654
deviation-center-line_mean0.4387555178222911
deviation-center-line_min0.17941317297639486
deviation-heading_max4.374417856296392
deviation-heading_mean1.5940974384060418
deviation-heading_median1.0234199155419084
deviation-heading_min0.4336566898932428
driven_any_max2.1860208965398997
driven_any_mean1.068337512713888
driven_any_median1.0253513500538094
driven_any_min0.3424596765232271
driven_lanedir_consec_max1.8538963171887557
driven_lanedir_consec_mean0.6976649549765142
driven_lanedir_consec_min0.3024072802283877
driven_lanedir_max1.8539439248016505
driven_lanedir_mean0.7124823821349586
driven_lanedir_median0.637258234942822
driven_lanedir_min0.3024072802283877
in-drivable-lane_max7.600000000000008
in-drivable-lane_mean1.933333333333337
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.641282781235245, "sim_physics": 0.1940201172786476, "survival_time": 11.300000000000026, "driven_lanedir": 1.6348933316601737, "sim_render-ego": 0.06278349973459159, "in-drivable-lane": 0, "agent_compute-ego": 0.15594795530876226, "deviation-heading": 0.9126756427521452, "set_robot_commands": 0.09852542602910404, "deviation-center-line": 0.672225484067654, "driven_lanedir_consec": 1.6346444229536363, "sim_compute_sim_state": 0.039646303759211986, "sim_compute_performance-ego": 0.06992927272762872, "sim_compute_robot_state-ego": 0.0772753553052919, "sim_compute_robot_state-npc0": 0.06922071802932604, "sim_compute_robot_state-npc1": 0.07037916964134283, "sim_compute_robot_state-npc2": 0.06744356176494497, "sim_compute_robot_state-npc3": 0.07067899049910824}, "udem1-1-0": {"driven_any": 1.0253513500538094, "sim_physics": 0.1881727592812644, "survival_time": 7.199999999999982, "driven_lanedir": 0.637258234942822, "sim_render-ego": 0.06078869435522291, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.14544857376151615, "deviation-heading": 2.690528154812385, "set_robot_commands": 0.09348742332723406, "deviation-center-line": 0.41059891008830585, "driven_lanedir_consec": 0.637258234942822, "sim_compute_sim_state": 0.03896930813789368, "sim_compute_performance-ego": 0.06825131674607594, "sim_compute_robot_state-ego": 0.07157871623833974, "sim_compute_robot_state-npc0": 0.07084981600443523, "sim_compute_robot_state-npc1": 0.06599624786112043, "sim_compute_robot_state-npc2": 0.06836369964811537, "sim_compute_robot_state-npc3": 0.06809832817978329}, "udem1-2-0": {"driven_any": 1.784783926987647, "sim_physics": 0.18375609253273636, "survival_time": 12.200000000000038, "driven_lanedir": 0.7320108061087556, "sim_render-ego": 0.061173397986615294, "in-drivable-lane": 6.850000000000049, "agent_compute-ego": 0.1481490057022845, "deviation-heading": 1.0234199155419084, "set_robot_commands": 0.09190369140906413, "deviation-center-line": 0.38174858756852137, "driven_lanedir_consec": 0.7320108061087556, "sim_compute_sim_state": 0.039199261391749146, "sim_compute_performance-ego": 0.0667224790229172, "sim_compute_robot_state-ego": 0.0708276951899294, "sim_compute_robot_state-npc0": 0.06890321950443455, "sim_compute_robot_state-npc1": 0.06871661494989864, "sim_compute_robot_state-npc2": 0.06718037656096161, "sim_compute_robot_state-npc3": 0.06814219521694496}, "udem1-3-0": {"driven_any": 2.1860208965398997, "sim_physics": 0.1829805588722229, "survival_time": 14.950000000000076, "driven_lanedir": 1.8539439248016505, "sim_render-ego": 0.06127752304077149, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.1453256392478943, "deviation-heading": 0.9719131370069356, "set_robot_commands": 0.08863492409388224, "deviation-center-line": 0.9349599376168654, "driven_lanedir_consec": 1.8538963171887557, "sim_compute_sim_state": 0.03821848392486572, "sim_compute_performance-ego": 0.06524295727411906, "sim_compute_robot_state-ego": 0.06874158461888631, "sim_compute_robot_state-npc0": 0.06738770564397176, "sim_compute_robot_state-npc1": 0.06573770999908447, "sim_compute_robot_state-npc2": 0.06607798099517823, "sim_compute_robot_state-npc3": 0.06597061475118002}, "udem1-4-0": {"driven_any": 0.3581279985986457, "sim_physics": 0.13384295834435356, "survival_time": 2.6999999999999984, "driven_lanedir": 0.3433638903020815, "sim_render-ego": 0.046208721620065195, "in-drivable-lane": 0, "agent_compute-ego": 0.11019685533311632, "deviation-heading": 0.7672903262185754, "set_robot_commands": 0.07332876435032597, "deviation-center-line": 0.20044345193716143, "driven_lanedir_consec": 0.3433638903020815, "sim_compute_sim_state": 0.02831758393181695, "sim_compute_performance-ego": 0.05076304629996971, "sim_compute_robot_state-ego": 0.05173458876433196, "sim_compute_robot_state-npc0": 0.04815158579084608, "sim_compute_robot_state-npc1": 0.04697388631326181, "sim_compute_robot_state-npc2": 0.04809123056906241, "sim_compute_robot_state-npc3": 0.04702063843056008}, "udem1-5-0": {"driven_any": 1.1302403061470987, "sim_physics": 0.12972038718545512, "survival_time": 7.84999999999998, "driven_lanedir": 0.39314661474467094, "sim_render-ego": 0.04418772648853861, "in-drivable-lane": 3.999999999999986, "agent_compute-ego": 0.1166175702574906, "deviation-heading": 2.4308255969868253, "set_robot_commands": 0.07032003068620232, "deviation-center-line": 0.38861383599610416, "driven_lanedir_consec": 0.39314661474467094, "sim_compute_sim_state": 0.029305322914366508, "sim_compute_performance-ego": 0.05015160019989986, "sim_compute_robot_state-ego": 0.04958035687732089, "sim_compute_robot_state-npc0": 0.05132257862455526, "sim_compute_robot_state-npc1": 0.05208272690985613, "sim_compute_robot_state-npc2": 0.050062507580799664, "sim_compute_robot_state-npc3": 0.050133916223125095}, "udem1-6-0": {"driven_any": 0.5061578530870738, "sim_physics": 0.1505456066131592, "survival_time": 3.7499999999999942, "driven_lanedir": 0.500515270834164, "sim_render-ego": 0.04774718602498373, "in-drivable-lane": 0, "agent_compute-ego": 0.11660629590352375, "deviation-heading": 0.5159300208401423, "set_robot_commands": 0.0709860070546468, "deviation-center-line": 0.32277039791323286, "driven_lanedir_consec": 0.500515270834164, "sim_compute_sim_state": 0.02923594792683919, "sim_compute_performance-ego": 0.05067595799763997, "sim_compute_robot_state-ego": 0.05261641502380371, "sim_compute_robot_state-npc0": 0.05257994016011556, "sim_compute_robot_state-npc1": 0.05135429064432779, "sim_compute_robot_state-npc2": 0.050542112986246744, "sim_compute_robot_state-npc3": 0.05035897890726725}, "udem1-7-0": {"driven_any": 1.0295382151776031, "sim_physics": 0.12863466143608093, "survival_time": 7.199999999999982, "driven_lanedir": 0.9359161916925074, "sim_render-ego": 0.04140668445163303, "in-drivable-lane": 0, "agent_compute-ego": 0.1091697613398234, "deviation-heading": 2.4651914972100637, "set_robot_commands": 0.06283885571691725, "deviation-center-line": 0.5408967871824802, "driven_lanedir_consec": 0.9268938600486144, "sim_compute_sim_state": 0.025732038749588865, "sim_compute_performance-ego": 0.046039866076575384, "sim_compute_robot_state-ego": 0.0479585329691569, "sim_compute_robot_state-npc0": 0.04648412267367045, "sim_compute_robot_state-npc1": 0.04559829831123352, "sim_compute_robot_state-npc2": 0.045361404617627464, "sim_compute_robot_state-npc3": 0.04521736833784315}, "udem1-8-0": {"driven_any": 1.0117814342566946, "sim_physics": 0.10251536098777823, "survival_time": 7.049999999999983, "driven_lanedir": 0.6909705366951359, "sim_render-ego": 0.03582792079195063, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.08718486711488548, "deviation-heading": 2.329921518550053, "set_robot_commands": 0.0538392591138258, "deviation-center-line": 0.5441337791691367, "driven_lanedir_consec": 0.6909705366951359, "sim_compute_sim_state": 0.022414224367615174, "sim_compute_performance-ego": 0.038087782284892194, "sim_compute_robot_state-ego": 0.04019763960060498, "sim_compute_robot_state-npc0": 0.039734578301720586, "sim_compute_robot_state-npc1": 0.039321606886302325, "sim_compute_robot_state-npc2": 0.039192055979519025, "sim_compute_robot_state-npc3": 0.03905229534663207}, "udem1-9-0": {"driven_any": 1.0121721984179504, "sim_physics": 0.11321299559586533, "survival_time": 7.149999999999983, "driven_lanedir": 0.6896653033503108, "sim_render-ego": 0.03602621938798811, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.08923378524246749, "deviation-heading": 1.7559109248467348, "set_robot_commands": 0.0538178957425631, "deviation-center-line": 0.4657042775355992, "driven_lanedir_consec": 0.6525088666893104, "sim_compute_sim_state": 0.022506148665101377, "sim_compute_performance-ego": 0.03817606305742597, "sim_compute_robot_state-ego": 0.040258222526603646, "sim_compute_robot_state-npc0": 0.04077633944424716, "sim_compute_robot_state-npc1": 0.03933180795682894, "sim_compute_robot_state-npc2": 0.039308016116802506, "sim_compute_robot_state-npc3": 0.0459914224131124}, "udem1-10-0": {"driven_any": 0.3424596765232271, "sim_physics": 0.10189148554435144, "survival_time": 2.5999999999999988, "driven_lanedir": 0.3212520101257572, "sim_render-ego": 0.0361445821248568, "in-drivable-lane": 0, "agent_compute-ego": 0.08784984166805561, "deviation-heading": 0.9083914070419382, "set_robot_commands": 0.05385391070292546, "deviation-center-line": 0.17941317297639486, "driven_lanedir_consec": 0.3212520101257572, "sim_compute_sim_state": 0.022338252801161543, "sim_compute_performance-ego": 0.03818766428874089, "sim_compute_robot_state-ego": 0.04019938523952778, "sim_compute_robot_state-npc0": 0.0398408999809852, "sim_compute_robot_state-npc1": 0.03930220237145057, "sim_compute_robot_state-npc2": 0.03920111747888418, "sim_compute_robot_state-npc3": 0.03909972080817589}, "udem1-11-0": {"driven_any": 0.45910689128684445, "sim_physics": 0.09852244249030724, "survival_time": 3.349999999999996, "driven_lanedir": 0.4553365542784813, "sim_render-ego": 0.03611431904693148, "in-drivable-lane": 0, "agent_compute-ego": 0.0877421009006785, "deviation-heading": 0.4336566898932428, "set_robot_commands": 0.05598116632717759, "deviation-center-line": 0.3396621974449056, "driven_lanedir_consec": 0.4553365542784813, "sim_compute_sim_state": 0.022693687410496953, "sim_compute_performance-ego": 0.03802063927721622, "sim_compute_robot_state-ego": 0.04333748746274123, "sim_compute_robot_state-npc0": 0.04167734331159449, "sim_compute_robot_state-npc1": 0.03913569094529792, "sim_compute_robot_state-npc2": 0.03890737490867501, "sim_compute_robot_state-npc3": 0.039778460317583225}, "udem1-12-0": {"driven_any": 1.447644041392146, "sim_physics": 0.1046207378159708, "survival_time": 10.050000000000008, "driven_lanedir": 0.3024072802283877, "sim_render-ego": 0.035877391473570865, "in-drivable-lane": 7.600000000000008, "agent_compute-ego": 0.08739025082754258, "deviation-heading": 0.5639614932962997, "set_robot_commands": 0.05522114601894398, "deviation-center-line": 0.287042893102722, "driven_lanedir_consec": 0.3024072802283877, "sim_compute_sim_state": 0.022538752105105576, "sim_compute_performance-ego": 0.03836723109382895, "sim_compute_robot_state-ego": 0.040179110285061506, "sim_compute_robot_state-npc0": 0.039939906466659625, "sim_compute_robot_state-npc1": 0.03946944730198799, "sim_compute_robot_state-npc2": 0.03902679177659068, "sim_compute_robot_state-npc3": 0.03924466484221653}, "udem1-13-0": {"driven_any": 1.0071223990792053, "sim_physics": 0.10142744426995937, "survival_time": 7.099999999999983, "driven_lanedir": 0.6504510750495411, "sim_render-ego": 0.03578547188933467, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.08716986884533519, "deviation-heading": 1.767427394796984, "set_robot_commands": 0.05367824057458152, "deviation-center-line": 0.44358814435396954, "driven_lanedir_consec": 0.6504510750495411, "sim_compute_sim_state": 0.022515065233472367, "sim_compute_performance-ego": 0.0419801910158614, "sim_compute_robot_state-ego": 0.040107700186716, "sim_compute_robot_state-npc0": 0.03984877928881578, "sim_compute_robot_state-npc1": 0.03945079823614846, "sim_compute_robot_state-npc2": 0.03935150361396897, "sim_compute_robot_state-npc3": 0.039445014067099125}, "udem1-14-0": {"driven_any": 1.0832727219252307, "sim_physics": 0.10901477462367008, "survival_time": 7.599999999999981, "driven_lanedir": 0.5461047072099379, "sim_render-ego": 0.03605246230175621, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.08938370880327727, "deviation-heading": 4.374417856296392, "set_robot_commands": 0.053840041160583496, "deviation-center-line": 0.4695309103813122, "driven_lanedir_consec": 0.3703185844575955, "sim_compute_sim_state": 0.02283570170402527, "sim_compute_performance-ego": 0.03868487006739566, "sim_compute_robot_state-ego": 0.04049850451318841, "sim_compute_robot_state-npc0": 0.03999933129862735, "sim_compute_robot_state-npc1": 0.0394458017851177, "sim_compute_robot_state-npc2": 0.039258676139931926, "sim_compute_robot_state-npc3": 0.03942956108795969}}
set_robot_commands_max0.09852542602910404
set_robot_commands_mean0.06868378548719851
set_robot_commands_median0.06283885571691725
set_robot_commands_min0.05367824057458152
sim_compute_performance-ego_max0.06992927272762872
sim_compute_performance-ego_mean0.04928539582867914
sim_compute_performance-ego_median0.046039866076575384
sim_compute_performance-ego_min0.03802063927721622
sim_compute_robot_state-ego_max0.0772753553052919
sim_compute_robot_state-ego_mean0.05167275298676696
sim_compute_robot_state-ego_median0.0479585329691569
sim_compute_robot_state-ego_min0.040107700186716
sim_compute_robot_state-npc0_max0.07084981600443523
sim_compute_robot_state-npc0_mean0.050447790968267
sim_compute_robot_state-npc0_median0.04648412267367045
sim_compute_robot_state-npc0_min0.039734578301720586
sim_compute_robot_state-npc1_max0.07037916964134283
sim_compute_robot_state-npc1_mean0.04948642000755064
sim_compute_robot_state-npc1_median0.04559829831123352
sim_compute_robot_state-npc1_min0.03913569094529792
sim_compute_robot_state-npc2_max0.06836369964811537
sim_compute_robot_state-npc2_mean0.04915789404915392
sim_compute_robot_state-npc2_median0.045361404617627464
sim_compute_robot_state-npc2_min0.03890737490867501
sim_compute_robot_state-npc3_max0.07067899049910824
sim_compute_robot_state-npc3_mean0.049844144628572735
sim_compute_robot_state-npc3_median0.0459914224131124
sim_compute_robot_state-npc3_min0.03905229534663207
sim_compute_sim_state_max0.039646303759211986
sim_compute_sim_state_mean0.028431072201554015
sim_compute_sim_state_median0.025732038749588865
sim_compute_sim_state_min0.022338252801161543
sim_physics_max0.1940201172786476
sim_physics_mean0.1348585588581215
sim_physics_median0.12863466143608093
sim_physics_min0.09852244249030724
sim_render-ego_max0.06278349973459159
sim_render-ego_mean0.04516012004792071
sim_render-ego_median0.04140668445163303
sim_render-ego_min0.03578547188933467
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.47
survival_time_min2.5999999999999988
213672770Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationhost-errorno8430:48:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2770/step1-simulation-ip-172-31-42-167-7357-job21367/logs/challenges-runner/stdout.log'
(hidden)
213582378Liam Paullminimal_agent_python2 (Python 2)aido2-LFV-sim-validationstep1-simulationsuccessno8430:10:07(hidden)
driven_lanedir_consec_median0.6707441932890994
survival_time_median3.649999999999995
deviation-center-line_median0.14435558631904788
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.06219185675893511
agent_compute-ego_mean0.06027219575453128
agent_compute-ego_median0.06056504590170724
agent_compute-ego_min0.0581577984062401
deviation-center-line_max0.2085822874042474
deviation-center-line_mean0.1589542518908908
deviation-center-line_min0.10686452122645386
deviation-heading_max0.6191860504142408
deviation-heading_mean0.523857550127959
deviation-heading_median0.5156622477370731
deviation-heading_min0.42218734391092383
driven_any_max1.5798273185720382
driven_any_mean0.9978358087547315
driven_any_median0.9948273195001778
driven_any_min0.3798605253583843
driven_lanedir_consec_max1.2017887891468408
driven_lanedir_consec_mean0.7740609626522831
driven_lanedir_consec_min0.366714522485295
driven_lanedir_max1.2017887891468408
driven_lanedir_mean0.7740609626522831
driven_lanedir_median0.6707441932890994
driven_lanedir_min0.366714522485295
in-drivable-lane_max1.1999999999999955
in-drivable-lane_mean0.6699999999999976
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.16351580946412805, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.056325089441586845, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06080242052470168, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.10302230429975952, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.03503649528712442, "sim_compute_performance-ego": 0.06603397735177655, "sim_compute_robot_state-ego": 0.06674265534910437, "sim_compute_robot_state-npc0": 0.06714316590191567, "sim_compute_robot_state-npc1": 0.06755017907652136, "sim_compute_robot_state-npc2": 0.06554886739547938, "sim_compute_robot_state-npc3": 0.06530614421792226}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4548365617710475, "sim_physics": 0.1706056917035902, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295977528045558, "sim_render-ego": 0.05764518557368098, "in-drivable-lane": 0, "agent_compute-ego": 0.0581577984062401, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.08054590225219727, "deviation-center-line": 0.13177328856984177, "driven_lanedir_consec": 0.4295977528045558, "sim_compute_sim_state": 0.03740371884526433, "sim_compute_performance-ego": 0.06979886261192528, "sim_compute_robot_state-ego": 0.06976554200455949, "sim_compute_robot_state-npc0": 0.06520130183245684, "sim_compute_robot_state-npc1": 0.06766480368536872, "sim_compute_robot_state-npc2": 0.06745257248749605, "sim_compute_robot_state-npc3": 0.06660893801096324}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.57982731857201, "sim_physics": 0.17776921391487122, "survival_time": 5.599999999999988, "driven_lanedir": 1.2014595555356244, "sim_render-ego": 0.062358355947903225, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06219185675893511, "deviation-heading": 0.5156622477370731, "set_robot_commands": 0.0911480699266706, "deviation-center-line": 0.2085822874042474, "driven_lanedir_consec": 1.2014595555356244, "sim_compute_sim_state": 0.03706677258014679, "sim_compute_performance-ego": 0.07163466087409429, "sim_compute_robot_state-ego": 0.07087372243404388, "sim_compute_robot_state-npc0": 0.06558238608496529, "sim_compute_robot_state-npc1": 0.0672340669802257, "sim_compute_robot_state-npc2": 0.06721393551145281, "sim_compute_robot_state-npc3": 0.06713634303637914}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5798273185720382, "sim_physics": 0.173510519521577, "survival_time": 5.599999999999988, "driven_lanedir": 1.2017887891468408, "sim_render-ego": 0.05915150684969766, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06056504590170724, "deviation-heading": 0.5031987685845647, "set_robot_commands": 0.08763863146305084, "deviation-center-line": 0.2031955759348632, "driven_lanedir_consec": 1.2017887891468408, "sim_compute_sim_state": 0.03733578750065395, "sim_compute_performance-ego": 0.06456264427730016, "sim_compute_robot_state-ego": 0.06862541394574302, "sim_compute_robot_state-npc0": 0.06622199501310076, "sim_compute_robot_state-npc1": 0.06480543528284345, "sim_compute_robot_state-npc2": 0.06663393335683006, "sim_compute_robot_state-npc3": 0.06777969215597425}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3798605253583843, "sim_physics": 0.16297951340675354, "survival_time": 1.6000000000000008, "driven_lanedir": 0.366714522485295, "sim_render-ego": 0.05634930729866028, "in-drivable-lane": 0, "agent_compute-ego": 0.059643857181072235, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.08597685396671295, "deviation-center-line": 0.10686452122645386, "driven_lanedir_consec": 0.366714522485295, "sim_compute_sim_state": 0.03752867132425308, "sim_compute_performance-ego": 0.06201153248548508, "sim_compute_robot_state-ego": 0.06985007226467133, "sim_compute_robot_state-npc0": 0.05983927845954895, "sim_compute_robot_state-npc1": 0.06270433962345123, "sim_compute_robot_state-npc2": 0.06699344515800476, "sim_compute_robot_state-npc3": 0.0644388198852539}}
set_robot_commands_max0.10302230429975952
set_robot_commands_mean0.08966635238167824
set_robot_commands_median0.08763863146305084
set_robot_commands_min0.08054590225219727
sim_compute_performance-ego_max0.07163466087409429
sim_compute_performance-ego_mean0.06680833552011627
sim_compute_performance-ego_median0.06603397735177655
sim_compute_performance-ego_min0.06201153248548508
sim_compute_robot_state-ego_max0.07087372243404388
sim_compute_robot_state-ego_mean0.06917148119962442
sim_compute_robot_state-ego_median0.06976554200455949
sim_compute_robot_state-ego_min0.06674265534910437
sim_compute_robot_state-npc0_max0.06714316590191567
sim_compute_robot_state-npc0_mean0.06479762545839751
sim_compute_robot_state-npc0_median0.06558238608496529
sim_compute_robot_state-npc0_min0.05983927845954895
sim_compute_robot_state-npc1_max0.06766480368536872
sim_compute_robot_state-npc1_mean0.06599176492968209
sim_compute_robot_state-npc1_median0.0672340669802257
sim_compute_robot_state-npc1_min0.06270433962345123
sim_compute_robot_state-npc2_max0.06745257248749605
sim_compute_robot_state-npc2_mean0.0667685507818526
sim_compute_robot_state-npc2_median0.06699344515800476
sim_compute_robot_state-npc2_min0.06554886739547938
sim_compute_robot_state-npc3_max0.06777969215597425
sim_compute_robot_state-npc3_mean0.06625398746129856
sim_compute_robot_state-npc3_median0.06660893801096324
sim_compute_robot_state-npc3_min0.0644388198852539
sim_compute_sim_state_max0.03752867132425308
sim_compute_sim_state_mean0.03687428910748851
sim_compute_sim_state_median0.03733578750065395
sim_compute_sim_state_min0.03503649528712442
sim_physics_max0.17776921391487122
sim_physics_mean0.169676149602184
sim_physics_median0.1706056917035902
sim_physics_min0.16297951340675354
sim_render-ego_max0.062358355947903225
sim_render-ego_mean0.05836588902230579
sim_render-ego_median0.05764518557368098
sim_render-ego_min0.056325089441586845
simulation-passed1
survival_time_max5.599999999999988
survival_time_mean3.6599999999999944
survival_time_min1.6000000000000008
213522377Liam Paullminimal_agent_python2 (Python 2)aido2-LFV-sim-testingstep1-simulationhost-errorno8430:04:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2377/step1-simulation-ip-172-31-42-167-7357-job21352/logs/challenges-runner/stdout.log'
(hidden)
213412884Andrea Danieleminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationsuccessno8430:55:13(hidden)
driven_lanedir_consec_median0.637258234942822
survival_time_median7.199999999999982
deviation-center-line_median0.41059891008830585
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.1516653103614921
agent_compute-ego_mean0.14370199066870615
agent_compute-ego_median0.14686969032994024
agent_compute-ego_min0.10960798663692876
deviation-center-line_max0.9349599376168654
deviation-center-line_mean0.4387555178222911
deviation-center-line_min0.17941317297639486
deviation-heading_max4.374417856296392
deviation-heading_mean1.5940974384060418
deviation-heading_median1.0234199155419084
deviation-heading_min0.4336566898932428
driven_any_max2.1860208965398997
driven_any_mean1.068337512713888
driven_any_median1.0253513500538094
driven_any_min0.3424596765232271
driven_lanedir_consec_max1.8538963171887557
driven_lanedir_consec_mean0.6976649549765142
driven_lanedir_consec_min0.3024072802283877
driven_lanedir_max1.8539439248016505
driven_lanedir_mean0.7124823821349586
driven_lanedir_median0.637258234942822
driven_lanedir_min0.3024072802283877
in-drivable-lane_max7.600000000000008
in-drivable-lane_mean1.933333333333337
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.641282781235245, "sim_physics": 0.17796313973654687, "survival_time": 11.300000000000026, "driven_lanedir": 1.6348933316601737, "sim_render-ego": 0.058869485306528815, "in-drivable-lane": 0, "agent_compute-ego": 0.1448918886944256, "deviation-heading": 0.9126756427521452, "set_robot_commands": 0.0885524760305354, "deviation-center-line": 0.672225484067654, "driven_lanedir_consec": 1.6346444229536363, "sim_compute_sim_state": 0.0372228664634502, "sim_compute_performance-ego": 0.06567928010383539, "sim_compute_robot_state-ego": 0.06925658420123885, "sim_compute_robot_state-npc0": 0.06676784975338826, "sim_compute_robot_state-npc1": 0.06500833751881017, "sim_compute_robot_state-npc2": 0.06554978611194982, "sim_compute_robot_state-npc3": 0.06588010766864878}, "udem1-1-0": {"driven_any": 1.0253513500538094, "sim_physics": 0.19867607288890415, "survival_time": 7.199999999999982, "driven_lanedir": 0.637258234942822, "sim_render-ego": 0.06330155332883199, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.14764545857906342, "deviation-heading": 2.690528154812385, "set_robot_commands": 0.09440684484110938, "deviation-center-line": 0.41059891008830585, "driven_lanedir_consec": 0.637258234942822, "sim_compute_sim_state": 0.03881170517868466, "sim_compute_performance-ego": 0.06841495136419933, "sim_compute_robot_state-ego": 0.07423700392246246, "sim_compute_robot_state-npc0": 0.06986112892627716, "sim_compute_robot_state-npc1": 0.06890180210272472, "sim_compute_robot_state-npc2": 0.06900571452246772, "sim_compute_robot_state-npc3": 0.06852361891004774}, "udem1-2-0": {"driven_any": 1.784783926987647, "sim_physics": 0.1931453923710057, "survival_time": 12.200000000000038, "driven_lanedir": 0.7320108061087556, "sim_render-ego": 0.06192477707002984, "in-drivable-lane": 6.850000000000049, "agent_compute-ego": 0.14816732875636365, "deviation-heading": 1.0234199155419084, "set_robot_commands": 0.09301933792770886, "deviation-center-line": 0.38174858756852137, "driven_lanedir_consec": 0.7320108061087556, "sim_compute_sim_state": 0.03913404316198631, "sim_compute_performance-ego": 0.06783002908112573, "sim_compute_robot_state-ego": 0.07289731404820426, "sim_compute_robot_state-npc0": 0.0690416654602426, "sim_compute_robot_state-npc1": 0.06977116573052328, "sim_compute_robot_state-npc2": 0.0697627311847249, "sim_compute_robot_state-npc3": 0.06902957744285708}, "udem1-3-0": {"driven_any": 2.1860208965398997, "sim_physics": 0.19069501241048176, "survival_time": 14.950000000000076, "driven_lanedir": 1.8539439248016505, "sim_render-ego": 0.06171159505844116, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.1470088283220927, "deviation-heading": 0.9719131370069356, "set_robot_commands": 0.09147494157155354, "deviation-center-line": 0.9349599376168654, "driven_lanedir_consec": 1.8538963171887557, "sim_compute_sim_state": 0.03832197268803914, "sim_compute_performance-ego": 0.06633276859919231, "sim_compute_robot_state-ego": 0.07012192169825236, "sim_compute_robot_state-npc0": 0.06825666268666586, "sim_compute_robot_state-npc1": 0.06626783847808838, "sim_compute_robot_state-npc2": 0.06478115876515707, "sim_compute_robot_state-npc3": 0.06519928216934204}, "udem1-4-0": {"driven_any": 0.3581279985986457, "sim_physics": 0.1972368469944707, "survival_time": 2.6999999999999984, "driven_lanedir": 0.3433638903020815, "sim_render-ego": 0.06571556903697827, "in-drivable-lane": 0, "agent_compute-ego": 0.14686969032994024, "deviation-heading": 0.7672903262185754, "set_robot_commands": 0.09257254777131256, "deviation-center-line": 0.20044345193716143, "driven_lanedir_consec": 0.3433638903020815, "sim_compute_sim_state": 0.040650517852218064, "sim_compute_performance-ego": 0.0666630886219166, "sim_compute_robot_state-ego": 0.07200865833847611, "sim_compute_robot_state-npc0": 0.06952027921323423, "sim_compute_robot_state-npc1": 0.07041616793032046, "sim_compute_robot_state-npc2": 0.06954191349170825, "sim_compute_robot_state-npc3": 0.06846422177773935}, "udem1-5-0": {"driven_any": 1.1302403061470987, "sim_physics": 0.17993524575689038, "survival_time": 7.84999999999998, "driven_lanedir": 0.39314661474467094, "sim_render-ego": 0.06546495826381027, "in-drivable-lane": 3.999999999999986, "agent_compute-ego": 0.14942900845958929, "deviation-heading": 2.4308255969868253, "set_robot_commands": 0.0893893378555395, "deviation-center-line": 0.38861383599610416, "driven_lanedir_consec": 0.39314661474467094, "sim_compute_sim_state": 0.0391095945030261, "sim_compute_performance-ego": 0.06727069958000426, "sim_compute_robot_state-ego": 0.07104134711490315, "sim_compute_robot_state-npc0": 0.06531319800455859, "sim_compute_robot_state-npc1": 0.06839748704509371, "sim_compute_robot_state-npc2": 0.06646541121659005, "sim_compute_robot_state-npc3": 0.06679220564046483}, "udem1-6-0": {"driven_any": 0.5061578530870738, "sim_physics": 0.21831342379252117, "survival_time": 3.7499999999999942, "driven_lanedir": 0.500515270834164, "sim_render-ego": 0.06228947003682454, "in-drivable-lane": 0, "agent_compute-ego": 0.14836861610412597, "deviation-heading": 0.5159300208401423, "set_robot_commands": 0.0904753875732422, "deviation-center-line": 0.32277039791323286, "driven_lanedir_consec": 0.500515270834164, "sim_compute_sim_state": 0.03762097358703613, "sim_compute_performance-ego": 0.06881686210632325, "sim_compute_robot_state-ego": 0.07210201899210612, "sim_compute_robot_state-npc0": 0.06569125811258952, "sim_compute_robot_state-npc1": 0.0658716869354248, "sim_compute_robot_state-npc2": 0.06386165301005045, "sim_compute_robot_state-npc3": 0.06603817939758301}, "udem1-7-0": {"driven_any": 1.0295382151776031, "sim_physics": 0.2055157605144713, "survival_time": 7.199999999999982, "driven_lanedir": 0.9359161916925074, "sim_render-ego": 0.06252410345607334, "in-drivable-lane": 0, "agent_compute-ego": 0.15040967696242863, "deviation-heading": 2.4651914972100637, "set_robot_commands": 0.08993937902980381, "deviation-center-line": 0.5408967871824802, "driven_lanedir_consec": 0.9268938600486144, "sim_compute_sim_state": 0.03966323203510709, "sim_compute_performance-ego": 0.06912701328595479, "sim_compute_robot_state-ego": 0.07130391730202569, "sim_compute_robot_state-npc0": 0.06708970334794787, "sim_compute_robot_state-npc1": 0.06846603751182556, "sim_compute_robot_state-npc2": 0.06836433543099298, "sim_compute_robot_state-npc3": 0.06694941222667694}, "udem1-8-0": {"driven_any": 1.0117814342566946, "sim_physics": 0.1753844995025202, "survival_time": 7.049999999999983, "driven_lanedir": 0.6909705366951359, "sim_render-ego": 0.06139033736912071, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.14241777075097917, "deviation-heading": 2.329921518550053, "set_robot_commands": 0.08520481096091845, "deviation-center-line": 0.5441337791691367, "driven_lanedir_consec": 0.6909705366951359, "sim_compute_sim_state": 0.03570111254428295, "sim_compute_performance-ego": 0.06500705590484836, "sim_compute_robot_state-ego": 0.06946099227201855, "sim_compute_robot_state-npc0": 0.06547885245465218, "sim_compute_robot_state-npc1": 0.06460009399035298, "sim_compute_robot_state-npc2": 0.06315670791247212, "sim_compute_robot_state-npc3": 0.06333562837424853}, "udem1-9-0": {"driven_any": 1.0121721984179504, "sim_physics": 0.144118875890345, "survival_time": 7.149999999999983, "driven_lanedir": 0.6896653033503108, "sim_render-ego": 0.04377523168817267, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.10960798663692876, "deviation-heading": 1.7559109248467348, "set_robot_commands": 0.06678609247807857, "deviation-center-line": 0.4657042775355992, "driven_lanedir_consec": 0.6525088666893104, "sim_compute_sim_state": 0.02678497187741153, "sim_compute_performance-ego": 0.04940281381140222, "sim_compute_robot_state-ego": 0.04864892259344354, "sim_compute_robot_state-npc0": 0.04758452868961788, "sim_compute_robot_state-npc1": 0.05981266581928813, "sim_compute_robot_state-npc2": 0.0480343928703895, "sim_compute_robot_state-npc3": 0.047360425228839154}, "udem1-10-0": {"driven_any": 0.3424596765232271, "sim_physics": 0.18849242192048293, "survival_time": 2.5999999999999988, "driven_lanedir": 0.3212520101257572, "sim_render-ego": 0.05526778789666983, "in-drivable-lane": 0, "agent_compute-ego": 0.14025551080703735, "deviation-heading": 0.9083914070419382, "set_robot_commands": 0.08775294285554153, "deviation-center-line": 0.17941317297639486, "driven_lanedir_consec": 0.3212520101257572, "sim_compute_sim_state": 0.035833702637599066, "sim_compute_performance-ego": 0.06342747578254113, "sim_compute_robot_state-ego": 0.06817815853999211, "sim_compute_robot_state-npc0": 0.06317633390426636, "sim_compute_robot_state-npc1": 0.06567739523374118, "sim_compute_robot_state-npc2": 0.06776350736618042, "sim_compute_robot_state-npc3": 0.06011425531827486}, "udem1-11-0": {"driven_any": 0.45910689128684445, "sim_physics": 0.1941764959648474, "survival_time": 3.349999999999996, "driven_lanedir": 0.4553365542784813, "sim_render-ego": 0.06548834914591775, "in-drivable-lane": 0, "agent_compute-ego": 0.1516653103614921, "deviation-heading": 0.4336566898932428, "set_robot_commands": 0.08717106705281272, "deviation-center-line": 0.3396621974449056, "driven_lanedir_consec": 0.4553365542784813, "sim_compute_sim_state": 0.03820260603036454, "sim_compute_performance-ego": 0.06793191183858843, "sim_compute_robot_state-ego": 0.07351326942443848, "sim_compute_robot_state-npc0": 0.06511671507536475, "sim_compute_robot_state-npc1": 0.06670154742340544, "sim_compute_robot_state-npc2": 0.06737004820980243, "sim_compute_robot_state-npc3": 0.06846901552001042}, "udem1-12-0": {"driven_any": 1.447644041392146, "sim_physics": 0.19401329785437132, "survival_time": 10.050000000000008, "driven_lanedir": 0.3024072802283877, "sim_render-ego": 0.05914111398345795, "in-drivable-lane": 7.600000000000008, "agent_compute-ego": 0.14567030128554917, "deviation-heading": 0.5639614932962997, "set_robot_commands": 0.08989717118182586, "deviation-center-line": 0.287042893102722, "driven_lanedir_consec": 0.3024072802283877, "sim_compute_sim_state": 0.03820064411827581, "sim_compute_performance-ego": 0.0659624166156522, "sim_compute_robot_state-ego": 0.07095689204201769, "sim_compute_robot_state-npc0": 0.06624372325726409, "sim_compute_robot_state-npc1": 0.06479158804784367, "sim_compute_robot_state-npc2": 0.06614741875757625, "sim_compute_robot_state-npc3": 0.0673801483799569}, "udem1-13-0": {"driven_any": 1.0071223990792053, "sim_physics": 0.1853433041505411, "survival_time": 7.099999999999983, "driven_lanedir": 0.6504510750495411, "sim_render-ego": 0.058185511911419074, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.14209243277428854, "deviation-heading": 1.767427394796984, "set_robot_commands": 0.08579204955571135, "deviation-center-line": 0.44358814435396954, "driven_lanedir_consec": 0.6504510750495411, "sim_compute_sim_state": 0.03710939682705302, "sim_compute_performance-ego": 0.06606654382087815, "sim_compute_robot_state-ego": 0.06859374550026907, "sim_compute_robot_state-npc0": 0.062437180062414895, "sim_compute_robot_state-npc1": 0.06057772837894063, "sim_compute_robot_state-npc2": 0.06474356080444765, "sim_compute_robot_state-npc3": 0.06472457630533568}, "udem1-14-0": {"driven_any": 1.0832727219252307, "sim_physics": 0.19419152171988235, "survival_time": 7.599999999999981, "driven_lanedir": 0.5461047072099379, "sim_render-ego": 0.06026168873435572, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.1410300512062876, "deviation-heading": 4.374417856296392, "set_robot_commands": 0.08555082427827936, "deviation-center-line": 0.4695309103813122, "driven_lanedir_consec": 0.3703185844575955, "sim_compute_sim_state": 0.03605116825354727, "sim_compute_performance-ego": 0.06736264730754651, "sim_compute_robot_state-ego": 0.06597029535393965, "sim_compute_robot_state-npc0": 0.06362545333410564, "sim_compute_robot_state-npc1": 0.06308718417820178, "sim_compute_robot_state-npc2": 0.06325208670214603, "sim_compute_robot_state-npc3": 0.06512032684526946}}
set_robot_commands_max0.09440684484110938
set_robot_commands_mean0.08786568073093155
set_robot_commands_median0.0893893378555395
set_robot_commands_min0.06678609247807857
sim_compute_performance-ego_max0.06912701328595479
sim_compute_performance-ego_mean0.06568637052160058
sim_compute_performance-ego_median0.0666630886219166
sim_compute_performance-ego_min0.04940281381140222
sim_compute_robot_state-ego_max0.07423700392246246
sim_compute_robot_state-ego_mean0.06921940275625255
sim_compute_robot_state-ego_median0.07095689204201769
sim_compute_robot_state-ego_min0.04864892259344354
sim_compute_robot_state-npc0_max0.06986112892627716
sim_compute_robot_state-npc0_mean0.065013635485506
sim_compute_robot_state-npc0_median0.06569125811258952
sim_compute_robot_state-npc0_min0.04758452868961788
sim_compute_robot_state-npc1_max0.07041616793032046
sim_compute_robot_state-npc1_mean0.06588991508830565
sim_compute_robot_state-npc1_median0.0658716869354248
sim_compute_robot_state-npc1_min0.05981266581928813
sim_compute_robot_state-npc2_max0.0697627311847249
sim_compute_robot_state-npc2_mean0.0651866950904437
sim_compute_robot_state-npc2_median0.06614741875757625
sim_compute_robot_state-npc2_min0.0480343928703895
sim_compute_robot_state-npc3_max0.06902957744285708
sim_compute_robot_state-npc3_mean0.06489206541368632
sim_compute_robot_state-npc3_median0.06603817939758301
sim_compute_robot_state-npc3_min0.047360425228839154
sim_compute_sim_state_max0.040650517852218064
sim_compute_sim_state_mean0.03722790051720546
sim_compute_sim_state_median0.03820064411827581
sim_compute_sim_state_min0.02678497187741153
sim_physics_max0.21831342379252117
sim_physics_mean0.18914675409788553
sim_physics_median0.1931453923710057
sim_physics_min0.144118875890345
sim_render-ego_max0.06571556903697827
sim_render-ego_mean0.06035410215244214
sim_render-ego_median0.06171159505844116
sim_render-ego_min0.04377523168817267
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.47
survival_time_min2.5999999999999988
213192448enickyBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationhost-errorno8430:51:59
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2448/step1-simulation-ip-172-31-42-167-7357-job21319/logs/challenges-runner/stdout.log'
(hidden)
213112407vguerraBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationsuccessno8430:07:19(hidden)
driven_lanedir_consec_median0.09301692002978525
survival_time_median1.2000000000000004
deviation-center-line_median0.06665476741524345
in-drivable-lane_median0.10000000000000007


other stats
agent_compute-ego_max0.19109646479288736
agent_compute-ego_mean0.16378644760597813
agent_compute-ego_median0.1669771671295166
agent_compute-ego_min0.13353707109178817
deviation-center-line_max0.10247730427355416
deviation-center-line_mean0.07338038908256612
deviation-center-line_min0.043315997986445594
deviation-heading_max0.8357936862643188
deviation-heading_mean0.647852917191409
deviation-heading_median0.7457569337136808
deviation-heading_min0.4379212412504937
driven_any_max0.22367625624483492
driven_any_mean0.17098730079397845
driven_any_median0.16566387358860254
driven_any_min0.1327196189481467
driven_lanedir_consec_max0.13668239838882237
driven_lanedir_consec_mean0.09423658100292688
driven_lanedir_consec_min0.05562396297427341
driven_lanedir_max0.13668239838882237
driven_lanedir_mean0.09423658100292688
driven_lanedir_median0.09301692002978525
driven_lanedir_min0.05562396297427341
in-drivable-lane_max0.5000000000000004
in-drivable-lane_mean0.19000000000000017
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.22367625624483492, "sim_physics": 0.187582642691476, "survival_time": 1.7500000000000009, "driven_lanedir": 0.09301692002978525, "sim_render-ego": 0.06706611088344029, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1682372978755406, "deviation-heading": 0.7663430481698092, "set_robot_commands": 0.10754933357238768, "deviation-center-line": 0.06665476741524345, "driven_lanedir_consec": 0.09301692002978525, "sim_compute_sim_state": 0.0378009523664202, "sim_compute_performance-ego": 0.06563538823808943, "sim_compute_robot_state-ego": 0.08030001095363072, "sim_compute_robot_state-npc0": 0.072765166418893, "sim_compute_robot_state-npc1": 0.07235716411045619, "sim_compute_robot_state-npc2": 0.0732344150543213, "sim_compute_robot_state-npc3": 0.07039382117135184}, "udem1-1-0": {"driven_any": 0.1855732408450208, "sim_physics": 0.1708657911845616, "survival_time": 1.4000000000000006, "driven_lanedir": 0.05562396297427341, "sim_render-ego": 0.044564706938607354, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.13353707109178817, "deviation-heading": 0.8357936862643188, "set_robot_commands": 0.07458181892122541, "deviation-center-line": 0.05701050665186216, "driven_lanedir_consec": 0.05562396297427341, "sim_compute_sim_state": 0.030642552035195485, "sim_compute_performance-ego": 0.0471501350402832, "sim_compute_robot_state-ego": 0.05023139715194702, "sim_compute_robot_state-npc0": 0.05538904666900635, "sim_compute_robot_state-npc1": 0.05338685853140695, "sim_compute_robot_state-npc2": 0.05220045362200056, "sim_compute_robot_state-npc3": 0.052193054131099155}, "udem1-2-0": {"driven_any": 0.14730351434328717, "sim_physics": 0.26260152070418646, "survival_time": 1.1500000000000004, "driven_lanedir": 0.11810273916088576, "sim_render-ego": 0.06077635806539784, "in-drivable-lane": 0, "agent_compute-ego": 0.1669771671295166, "deviation-heading": 0.4534496765587428, "set_robot_commands": 0.09613321138464886, "deviation-center-line": 0.10247730427355416, "driven_lanedir_consec": 0.11810273916088576, "sim_compute_sim_state": 0.038836645043414574, "sim_compute_performance-ego": 0.06958570687667183, "sim_compute_robot_state-ego": 0.08677732426187267, "sim_compute_robot_state-npc0": 0.07077133137246837, "sim_compute_robot_state-npc1": 0.06400370597839355, "sim_compute_robot_state-npc2": 0.07015256259752356, "sim_compute_robot_state-npc3": 0.07335431679435399}, "udem1-3-0": {"driven_any": 0.16566387358860254, "sim_physics": 0.24147409200668335, "survival_time": 1.2000000000000004, "driven_lanedir": 0.13668239838882237, "sim_render-ego": 0.07182679573694865, "in-drivable-lane": 0, "agent_compute-ego": 0.19109646479288736, "deviation-heading": 0.4379212412504937, "set_robot_commands": 0.096454918384552, "deviation-center-line": 0.09744336908572523, "driven_lanedir_consec": 0.13668239838882237, "sim_compute_sim_state": 0.04360806941986084, "sim_compute_performance-ego": 0.0761226216952006, "sim_compute_robot_state-ego": 0.07844630877176921, "sim_compute_robot_state-npc0": 0.06873987118403117, "sim_compute_robot_state-npc1": 0.06779366731643677, "sim_compute_robot_state-npc2": 0.06980561216672261, "sim_compute_robot_state-npc3": 0.07111987471580505}, "udem1-4-0": {"driven_any": 0.1327196189481467, "sim_physics": 0.19176571265510892, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06775688446086758, "sim_render-ego": 0.05767907267031462, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.15908423714015796, "deviation-heading": 0.7457569337136808, "set_robot_commands": 0.09143326593481976, "deviation-center-line": 0.043315997986445594, "driven_lanedir_consec": 0.06775688446086758, "sim_compute_sim_state": 0.04075166453485903, "sim_compute_performance-ego": 0.06538261537966521, "sim_compute_robot_state-ego": 0.06709971635237984, "sim_compute_robot_state-npc0": 0.06467170300691025, "sim_compute_robot_state-npc1": 0.06286892683609673, "sim_compute_robot_state-npc2": 0.06376147270202637, "sim_compute_robot_state-npc3": 0.0617770008418871}}
set_robot_commands_max0.10754933357238768
set_robot_commands_mean0.09323050963952675
set_robot_commands_median0.09613321138464886
set_robot_commands_min0.07458181892122541
sim_compute_performance-ego_max0.0761226216952006
sim_compute_performance-ego_mean0.06477529344598207
sim_compute_performance-ego_median0.06563538823808943
sim_compute_performance-ego_min0.0471501350402832
sim_compute_robot_state-ego_max0.08677732426187267
sim_compute_robot_state-ego_mean0.0725709514983199
sim_compute_robot_state-ego_median0.07844630877176921
sim_compute_robot_state-ego_min0.05023139715194702
sim_compute_robot_state-npc0_max0.072765166418893
sim_compute_robot_state-npc0_mean0.06646742373026182
sim_compute_robot_state-npc0_median0.06873987118403117
sim_compute_robot_state-npc0_min0.05538904666900635
sim_compute_robot_state-npc1_max0.07235716411045619
sim_compute_robot_state-npc1_mean0.06408206455455803
sim_compute_robot_state-npc1_median0.06400370597839355
sim_compute_robot_state-npc1_min0.05338685853140695
sim_compute_robot_state-npc2_max0.0732344150543213
sim_compute_robot_state-npc2_mean0.06583090322851888
sim_compute_robot_state-npc2_median0.06980561216672261
sim_compute_robot_state-npc2_min0.05220045362200056
sim_compute_robot_state-npc3_max0.07335431679435399
sim_compute_robot_state-npc3_mean0.06576761353089942
sim_compute_robot_state-npc3_median0.07039382117135184
sim_compute_robot_state-npc3_min0.052193054131099155
sim_compute_sim_state_max0.04360806941986084
sim_compute_sim_state_mean0.03832797667995003
sim_compute_sim_state_median0.038836645043414574
sim_compute_sim_state_min0.030642552035195485
sim_physics_max0.26260152070418646
sim_physics_mean0.21085795184840328
sim_physics_median0.19176571265510892
sim_physics_min0.1708657911845616
sim_render-ego_max0.07182679573694865
sim_render-ego_mean0.060382608858941755
sim_render-ego_median0.06077635806539784
sim_render-ego_min0.044564706938607354
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.3300000000000003
survival_time_min1.1500000000000004
213002413jp18813100494Baseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationhost-errorno8430:08:32
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2413/step1-simulation-ip-172-31-42-167-7357-job21300/logs/challenges-runner/stdout.log'
(hidden)
212982417Andrea Censirandom_agentaido2-LF-sim-validationstep1-simulationsuccessno8430:05:34(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.15129692414227655
agent_compute-ego_mean0.13762950319276115
agent_compute-ego_median0.13777441616299785
agent_compute-ego_min0.12134728166792128
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10943208358905931, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05776831397303829, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.12134728166792128, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08673487327716968, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03694977583708586, "sim_compute_performance-ego": 0.06684895798012062, "sim_compute_robot_state-ego": 0.06854165924919976}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11614818666495529, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06494429999706793, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.13223634981641583, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09147471072627048, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.038889810150744865, "sim_compute_performance-ego": 0.0716566712248559, "sim_compute_robot_state-ego": 0.08130515322965734}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13008256519542022, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0644687624538646, "in-drivable-lane": 0, "agent_compute-ego": 0.15129692414227655, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10925964748158176, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04303497426650103, "sim_compute_performance-ego": 0.07051835340612075, "sim_compute_robot_state-ego": 0.0789803476894603}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13222929000854491, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.0636430835723877, "in-drivable-lane": 0, "agent_compute-ego": 0.14549254417419433, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09886322975158691, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04118350982666016, "sim_compute_performance-ego": 0.0716567325592041, "sim_compute_robot_state-ego": 0.07477333068847657}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.1063744237151327, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05899055094658574, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13777441616299785, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08850713017620618, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.038373400893392445, "sim_compute_performance-ego": 0.06293983700909192, "sim_compute_robot_state-ego": 0.07122542888303346}}
set_robot_commands_max0.10925964748158176
set_robot_commands_mean0.094967918282563
set_robot_commands_median0.09147471072627048
set_robot_commands_min0.08673487327716968
sim_compute_performance-ego_max0.0716567325592041
sim_compute_performance-ego_mean0.06872411043587864
sim_compute_performance-ego_median0.07051835340612075
sim_compute_performance-ego_min0.06293983700909192
sim_compute_robot_state-ego_max0.08130515322965734
sim_compute_robot_state-ego_mean0.07496518394796549
sim_compute_robot_state-ego_median0.07477333068847657
sim_compute_robot_state-ego_min0.06854165924919976
sim_compute_sim_state_max0.04303497426650103
sim_compute_sim_state_mean0.03968629419487687
sim_compute_sim_state_median0.038889810150744865
sim_compute_sim_state_min0.03694977583708586
sim_physics_max0.13222929000854491
sim_physics_mean0.1188533098346225
sim_physics_median0.11614818666495529
sim_physics_min0.1063744237151327
sim_render-ego_max0.06494429999706793
sim_render-ego_mean0.06196300218858884
sim_render-ego_median0.0636430835723877
sim_render-ego_min0.05776831397303829
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
212962421Andrea Censirandom_agentaido2-LFV-sim-validationstep1-simulationsuccessno8430:08:22(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.13900075147026464
agent_compute-ego_mean0.13295298986230647
agent_compute-ego_median0.136737225930902
agent_compute-ego_min0.11883082389831542
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.16139564249250624, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06344397862752278, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.13187741350244592, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09352116231565122, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03642476929558648, "sim_compute_performance-ego": 0.06921726685983164, "sim_compute_robot_state-ego": 0.0739013221528795, "sim_compute_robot_state-npc0": 0.06623973669829192, "sim_compute_robot_state-npc1": 0.06718281463340477, "sim_compute_robot_state-npc2": 0.06741242938571507, "sim_compute_robot_state-npc3": 0.06527856102696171}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.17648414611816407, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.05861088752746582, "in-drivable-lane": 0, "agent_compute-ego": 0.11883082389831542, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.08408056259155273, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.037457876205444336, "sim_compute_performance-ego": 0.06649993896484375, "sim_compute_robot_state-ego": 0.06251300811767578, "sim_compute_robot_state-npc0": 0.06491518974304199, "sim_compute_robot_state-npc1": 0.07033397674560547, "sim_compute_robot_state-npc2": 0.06718070983886719, "sim_compute_robot_state-npc3": 0.06725492477416992}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17686760425567627, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06011889169090673, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.13900075147026464, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09613059696398284, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03902201903493781, "sim_compute_performance-ego": 0.06972013962896247, "sim_compute_robot_state-ego": 0.07301963003058183, "sim_compute_robot_state-npc0": 0.06743674215517546, "sim_compute_robot_state-npc1": 0.06526379522524382, "sim_compute_robot_state-npc2": 0.06502205447146767, "sim_compute_robot_state-npc3": 0.06533173510902807}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.2041508215892164, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06397633311114734, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.136737225930902, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09436224985726271, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03874717181241965, "sim_compute_performance-ego": 0.06849603109721895, "sim_compute_robot_state-ego": 0.0765609228158299, "sim_compute_robot_state-npc0": 0.07046494001074682, "sim_compute_robot_state-npc1": 0.06759144082854066, "sim_compute_robot_state-npc2": 0.0670870135102091, "sim_compute_robot_state-npc3": 0.06914107407195659}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.18171061788286483, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05914433513368879, "in-drivable-lane": 0, "agent_compute-ego": 0.13831873450960433, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0903215834072658, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04162380525044033, "sim_compute_performance-ego": 0.06262746027537755, "sim_compute_robot_state-ego": 0.07299956253596715, "sim_compute_robot_state-npc0": 0.06600402082715716, "sim_compute_robot_state-npc1": 0.06421453612191337, "sim_compute_robot_state-npc2": 0.0673840982573373, "sim_compute_robot_state-npc3": 0.06807705334254674}}
set_robot_commands_max0.09613059696398284
set_robot_commands_mean0.09168323102714308
set_robot_commands_median0.09352116231565122
set_robot_commands_min0.08408056259155273
sim_compute_performance-ego_max0.06972013962896247
sim_compute_performance-ego_mean0.06731216736524688
sim_compute_performance-ego_median0.06849603109721895
sim_compute_performance-ego_min0.06262746027537755
sim_compute_robot_state-ego_max0.0765609228158299
sim_compute_robot_state-ego_mean0.07179888913058682
sim_compute_robot_state-ego_median0.07301963003058183
sim_compute_robot_state-ego_min0.06251300811767578
sim_compute_robot_state-npc0_max0.07046494001074682
sim_compute_robot_state-npc0_mean0.06701212588688268
sim_compute_robot_state-npc0_median0.06623973669829192
sim_compute_robot_state-npc0_min0.06491518974304199
sim_compute_robot_state-npc1_max0.07033397674560547
sim_compute_robot_state-npc1_mean0.06691731271094162
sim_compute_robot_state-npc1_median0.06718281463340477
sim_compute_robot_state-npc1_min0.06421453612191337
sim_compute_robot_state-npc2_max0.06741242938571507
sim_compute_robot_state-npc2_mean0.06681726109271927
sim_compute_robot_state-npc2_median0.06718070983886719
sim_compute_robot_state-npc2_min0.06502205447146767
sim_compute_robot_state-npc3_max0.06914107407195659
sim_compute_robot_state-npc3_mean0.06701666966493261
sim_compute_robot_state-npc3_median0.06725492477416992
sim_compute_robot_state-npc3_min0.06527856102696171
sim_compute_sim_state_max0.04162380525044033
sim_compute_sim_state_mean0.03865512831976572
sim_compute_sim_state_median0.03874717181241965
sim_compute_sim_state_min0.03642476929558648
sim_physics_max0.2041508215892164
sim_physics_mean0.18012176646768557
sim_physics_median0.17686760425567627
sim_physics_min0.16139564249250624
sim_render-ego_max0.06397633311114734
sim_render-ego_mean0.0610588852181463
sim_render-ego_median0.06011889169090673
sim_render-ego_min0.05861088752746582
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
212942425Andrea Censirandom_agentaido2-LFVI-sim-validationstep1-simulationsuccessno8430:09:02(hidden)
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.13616217918766357
agent_compute-ego_mean0.1297929602868869
agent_compute-ego_median0.12910951541948923
agent_compute-ego_min0.12387034722736905
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1935129195828981, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06227180625818952, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.12910951541948923, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.0899544094182268, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03687180748468713, "sim_compute_performance-ego": 0.06760724284980871, "sim_compute_robot_state-ego": 0.07166773759866063, "sim_compute_robot_state-npc0": 0.06439787828469579, "sim_compute_robot_state-npc1": 0.06420716454711141, "sim_compute_robot_state-npc2": 0.06690638880186443, "sim_compute_robot_state-npc3": 0.06595734403103212}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.19821022238050187, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.05648885454450335, "in-drivable-lane": 0, "agent_compute-ego": 0.12387034722736905, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.0875729066984994, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.0363891465323312, "sim_compute_performance-ego": 0.06477670158658709, "sim_compute_robot_state-ego": 0.07077563660485404, "sim_compute_robot_state-npc0": 0.06529634339468819, "sim_compute_robot_state-npc1": 0.06458933012826103, "sim_compute_robot_state-npc2": 0.06228772231510707, "sim_compute_robot_state-npc3": 0.06148659331457955}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.20014904309244988, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06297825378121681, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.13616217918766357, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.09056707493309836, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03720861268274992, "sim_compute_performance-ego": 0.06995449945764634, "sim_compute_robot_state-ego": 0.07518389387038148, "sim_compute_robot_state-npc0": 0.06821316885716706, "sim_compute_robot_state-npc1": 0.06563235255121028, "sim_compute_robot_state-npc2": 0.06440583710531586, "sim_compute_robot_state-npc3": 0.06416711066533061}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2006469219923019, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.05983698864777883, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.12474338710308076, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.08769627908865611, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.034866938988367714, "sim_compute_performance-ego": 0.06640402475992839, "sim_compute_robot_state-ego": 0.06541385253270467, "sim_compute_robot_state-npc0": 0.06294114391009013, "sim_compute_robot_state-npc1": 0.06483520567417145, "sim_compute_robot_state-npc2": 0.06788853804270427, "sim_compute_robot_state-npc3": 0.06664328277111053}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1822422004881359, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06292293185279482, "in-drivable-lane": 0, "agent_compute-ego": 0.135079372496832, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09712851615179152, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.035721994581676665, "sim_compute_performance-ego": 0.06559493428184873, "sim_compute_robot_state-ego": 0.06749341601417178, "sim_compute_robot_state-npc0": 0.06634565762111119, "sim_compute_robot_state-npc1": 0.06395184426080613, "sim_compute_robot_state-npc2": 0.06678432510012672, "sim_compute_robot_state-npc3": 0.067354645047869}}
set_robot_commands_max0.09712851615179152
set_robot_commands_mean0.09058383725805444
set_robot_commands_median0.0899544094182268
set_robot_commands_min0.0875729066984994
sim_compute_performance-ego_max0.06995449945764634
sim_compute_performance-ego_mean0.06686748058716385
sim_compute_performance-ego_median0.06640402475992839
sim_compute_performance-ego_min0.06477670158658709
sim_compute_robot_state-ego_max0.07518389387038148
sim_compute_robot_state-ego_mean0.07010690732415452
sim_compute_robot_state-ego_median0.07077563660485404
sim_compute_robot_state-ego_min0.06541385253270467
sim_compute_robot_state-npc0_max0.06821316885716706
sim_compute_robot_state-npc0_mean0.06543883841355047
sim_compute_robot_state-npc0_median0.06529634339468819
sim_compute_robot_state-npc0_min0.06294114391009013
sim_compute_robot_state-npc1_max0.06563235255121028
sim_compute_robot_state-npc1_mean0.06464317943231206
sim_compute_robot_state-npc1_median0.06458933012826103
sim_compute_robot_state-npc1_min0.06395184426080613
sim_compute_robot_state-npc2_max0.06788853804270427
sim_compute_robot_state-npc2_mean0.06565456227302367
sim_compute_robot_state-npc2_median0.06678432510012672
sim_compute_robot_state-npc2_min0.06228772231510707
sim_compute_robot_state-npc3_max0.067354645047869
sim_compute_robot_state-npc3_mean0.06512179516598438
sim_compute_robot_state-npc3_median0.06595734403103212
sim_compute_robot_state-npc3_min0.06148659331457955
sim_compute_sim_state_max0.03720861268274992
sim_compute_sim_state_mean0.03621170005396252
sim_compute_sim_state_median0.0363891465323312
sim_compute_sim_state_min0.034866938988367714
sim_physics_max0.2006469219923019
sim_physics_mean0.19495226150725756
sim_physics_median0.19821022238050187
sim_physics_min0.1822422004881359
sim_render-ego_max0.06297825378121681
sim_render-ego_mean0.060899767016896665
sim_render-ego_median0.06227180625818952
sim_render-ego_min0.05648885454450335
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
212922444Jacopo Tanirandom_agentaido2-LFVI-sim-validationstep1-simulationsuccessno8430:09:18(hidden)
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.15260306426456996
agent_compute-ego_mean0.144946022419625
agent_compute-ego_median0.1445319773275641
agent_compute-ego_min0.13864552627489404
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.19031669821920277, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.05799838561045973, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1445319773275641, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.08669218232360067, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.034742904614798634, "sim_compute_performance-ego": 0.06478452984290788, "sim_compute_robot_state-ego": 0.06663775444030762, "sim_compute_robot_state-npc0": 0.06390963325017615, "sim_compute_robot_state-npc1": 0.06555891338782975, "sim_compute_robot_state-npc2": 0.06126156034348886, "sim_compute_robot_state-npc3": 0.062448229970811286}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.18485125473567415, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.058072566986083984, "in-drivable-lane": 0, "agent_compute-ego": 0.15260306426456996, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.0872237937791007, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03806166989462716, "sim_compute_performance-ego": 0.06466484069824219, "sim_compute_robot_state-ego": 0.06997741971697126, "sim_compute_robot_state-npc0": 0.060983087335314067, "sim_compute_robot_state-npc1": 0.06341677904129028, "sim_compute_robot_state-npc2": 0.061906635761260986, "sim_compute_robot_state-npc3": 0.06413017851965767}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18037520797507275, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06117229322785313, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.13864552627489404, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.08930068108641985, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.0379324468594153, "sim_compute_performance-ego": 0.06758189432829328, "sim_compute_robot_state-ego": 0.06903930080747142, "sim_compute_robot_state-npc0": 0.06712323485068905, "sim_compute_robot_state-npc1": 0.06579579890353009, "sim_compute_robot_state-npc2": 0.065303610366525, "sim_compute_robot_state-npc3": 0.06982454744357507}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.20597457885742188, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.05934753020604452, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.14512647688388824, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.08965061604976654, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03936577339967092, "sim_compute_performance-ego": 0.07125039398670197, "sim_compute_robot_state-ego": 0.07230402032534282, "sim_compute_robot_state-npc0": 0.06531766057014465, "sim_compute_robot_state-npc1": 0.06924015283584595, "sim_compute_robot_state-npc2": 0.06937479476133983, "sim_compute_robot_state-npc3": 0.06370679040749867}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.188895168758574, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.0577481814793178, "in-drivable-lane": 0, "agent_compute-ego": 0.14382306734720865, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09289967446100145, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03799748420715332, "sim_compute_performance-ego": 0.06419899350120908, "sim_compute_robot_state-ego": 0.06577360062372117, "sim_compute_robot_state-npc0": 0.06971758887881324, "sim_compute_robot_state-npc1": 0.066230989637829, "sim_compute_robot_state-npc2": 0.0688791275024414, "sim_compute_robot_state-npc3": 0.06627154350280762}}
set_robot_commands_max0.09289967446100145
set_robot_commands_mean0.08915338953997784
set_robot_commands_median0.08930068108641985
set_robot_commands_min0.08669218232360067
sim_compute_performance-ego_max0.07125039398670197
sim_compute_performance-ego_mean0.06649613047147088
sim_compute_performance-ego_median0.06478452984290788
sim_compute_performance-ego_min0.06419899350120908
sim_compute_robot_state-ego_max0.07230402032534282
sim_compute_robot_state-ego_mean0.06874641918276285
sim_compute_robot_state-ego_median0.06903930080747142
sim_compute_robot_state-ego_min0.06577360062372117
sim_compute_robot_state-npc0_max0.06971758887881324
sim_compute_robot_state-npc0_mean0.06541024097702744
sim_compute_robot_state-npc0_median0.06531766057014465
sim_compute_robot_state-npc0_min0.060983087335314067
sim_compute_robot_state-npc1_max0.06924015283584595
sim_compute_robot_state-npc1_mean0.06604852676126502
sim_compute_robot_state-npc1_median0.06579579890353009
sim_compute_robot_state-npc1_min0.06341677904129028
sim_compute_robot_state-npc2_max0.06937479476133983
sim_compute_robot_state-npc2_mean0.06534514574701122
sim_compute_robot_state-npc2_median0.065303610366525
sim_compute_robot_state-npc2_min0.06126156034348886
sim_compute_robot_state-npc3_max0.06982454744357507
sim_compute_robot_state-npc3_mean0.06527625796887007
sim_compute_robot_state-npc3_median0.06413017851965767
sim_compute_robot_state-npc3_min0.062448229970811286
sim_compute_sim_state_max0.03936577339967092
sim_compute_sim_state_mean0.03762005579513307
sim_compute_sim_state_median0.03799748420715332
sim_compute_sim_state_min0.034742904614798634
sim_physics_max0.20597457885742188
sim_physics_mean0.19008258170918912
sim_physics_median0.188895168758574
sim_physics_min0.18037520797507275
sim_render-ego_max0.06117229322785313
sim_render-ego_mean0.05886779150195183
sim_render-ego_median0.058072566986083984
sim_render-ego_min0.0577481814793178
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
212762439Jacopo Tanirandom_agentaido2-LF-sim-testingstep1-simulationsuccessno8430:16:35(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.18839548615848317
agent_compute-ego_mean0.14818823475741988
agent_compute-ego_median0.14130424985698625
agent_compute-ego_min0.12211100578308104
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.13821983337402344, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.07074145917539243, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.17540508287924308, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.1109763118955824, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04459614665419967, "sim_compute_performance-ego": 0.07875475177058468, "sim_compute_robot_state-ego": 0.08436755780820493}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.13793298777411966, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.07240140204336129, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.18839548615848317, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.11929893493652344, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04534232382680856, "sim_compute_performance-ego": 0.08113959256340475, "sim_compute_robot_state-ego": 0.08655806616240856}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.1434623634113985, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07371772036832921, "in-drivable-lane": 0, "agent_compute-ego": 0.18051569602068732, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.121689333635218, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04565624629749971, "sim_compute_performance-ego": 0.07872359892901253, "sim_compute_robot_state-ego": 0.08364444620469037}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.09363405227661133, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.0465594482421875, "in-drivable-lane": 0, "agent_compute-ego": 0.12211100578308104, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.07046550750732422, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.032758054733276365, "sim_compute_performance-ego": 0.050793304443359374, "sim_compute_robot_state-ego": 0.05499303817749023}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.08981039554257936, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05477074429958682, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1339273633836191, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08363035962551454, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03565757485884655, "sim_compute_performance-ego": 0.05860485004473336, "sim_compute_robot_state-ego": 0.06184602387343781}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.11945749302299656, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.0626278848064189, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.14968388421194895, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.08943114475328096, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.03793659015577667, "sim_compute_performance-ego": 0.0696492000501983, "sim_compute_robot_state-ego": 0.0695816351442921}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.10359858189310346, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.05711136545453753, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.15166164296013968, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.08910208089011055, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.038481776203428, "sim_compute_performance-ego": 0.0645621759550912, "sim_compute_robot_state-ego": 0.07156723737716675}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.11884127344403948, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.061372075762067525, "in-drivable-lane": 0, "agent_compute-ego": 0.14022610301063174, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.07981994038536436, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.03911005882989792, "sim_compute_performance-ego": 0.06393458729698545, "sim_compute_robot_state-ego": 0.06844325292678106}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.10326078786688336, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.058711912672398454, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1392129235348459, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.0903078499486891, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.036664514218346544, "sim_compute_performance-ego": 0.06319721674515029, "sim_compute_robot_state-ego": 0.06858880236997443}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.08210620880126954, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.04568971720608798, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.12270610115744852, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.06980525797063654, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.02988827878778631, "sim_compute_performance-ego": 0.04945028044960715, "sim_compute_robot_state-ego": 0.051570289785211734}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.12271464025819456, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06271619610972219, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14896915485332538, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.09804501471581398, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.03968281250495415, "sim_compute_performance-ego": 0.07014252922751686, "sim_compute_robot_state-ego": 0.08038894851486404}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.10682567528315952, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.0552982006754194, "in-drivable-lane": 0, "agent_compute-ego": 0.14095960344587052, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.08205887249537877, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.03576014723096575, "sim_compute_performance-ego": 0.06569917712892805, "sim_compute_robot_state-ego": 0.06636097601481847}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.10412022646735695, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.05621024674060298, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.14130424985698625, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.08386080405291389, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.03773352679084329, "sim_compute_performance-ego": 0.059113324857225605, "sim_compute_robot_state-ego": 0.07346551091063257}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.11442622432002315, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.05261479483710395, "in-drivable-lane": 0, "agent_compute-ego": 0.13676574495103624, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.08360143061037417, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.032682436483877676, "sim_compute_performance-ego": 0.06721261695579246, "sim_compute_robot_state-ego": 0.06648619969685872}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.11704026951509364, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06197423560946595, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.15097947915395102, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.09536134962942086, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.040969441918765795, "sim_compute_performance-ego": 0.0685878501218908, "sim_compute_robot_state-ego": 0.0765683417226754}}
set_robot_commands_max0.121689333635218
set_robot_commands_mean0.09116361287014305
set_robot_commands_median0.08910208089011055
set_robot_commands_min0.06980525797063654
sim_compute_performance-ego_max0.08113959256340475
sim_compute_performance-ego_mean0.06597100376929874
sim_compute_performance-ego_median0.06569917712892805
sim_compute_performance-ego_min0.04945028044960715
sim_compute_robot_state-ego_max0.08655806616240856
sim_compute_robot_state-ego_mean0.07096202177930049
sim_compute_robot_state-ego_median0.0695816351442921
sim_compute_robot_state-ego_min0.051570289785211734
sim_compute_sim_state_max0.04565624629749971
sim_compute_sim_state_mean0.03819466196635154
sim_compute_sim_state_median0.03793659015577667
sim_compute_sim_state_min0.02988827878778631
sim_physics_max0.1434623634113985
sim_physics_mean0.11303006755005686
sim_physics_median0.11442622432002315
sim_physics_min0.08210620880126954
sim_render-ego_max0.07371772036832921
sim_render-ego_mean0.05950116026684547
sim_render-ego_median0.058711912672398454
sim_render-ego_min0.04568971720608798
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
212673058Andrea Censirotationaido2-LFV-sim-testingstep1-simulationhost-errorno8430:19:49
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3058/step1-simulation-ip-172-31-42-167-7357-job21267/logs/challenges-runner/stdout.log'
(hidden)
212532467Liam Paullchallenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessno8430:14:35(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.17604724566141763
agent_compute-ego_mean0.14103665622679765
agent_compute-ego_median0.1444349799837385
agent_compute-ego_min0.09189841326545269
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.08636335090354637, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05029099075882523, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.11650794523733632, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.06900646068431714, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.031948729797645854, "sim_compute_performance-ego": 0.054771379188255025, "sim_compute_robot_state-ego": 0.05745542932439734}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11873413067238003, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.060907658408669865, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15385857282900342, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09236850458032944, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0391090897952809, "sim_compute_performance-ego": 0.06920137124903061, "sim_compute_robot_state-ego": 0.07628666653352625}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.07560641625348259, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0428317154155058, "in-drivable-lane": 0, "agent_compute-ego": 0.09189841326545269, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0555116569294649, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.02603307892294491, "sim_compute_performance-ego": 0.04430550687453326, "sim_compute_robot_state-ego": 0.047182588016285616}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.12359095573425292, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.060592327117919925, "in-drivable-lane": 0, "agent_compute-ego": 0.1549161911010742, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08703546524047852, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03752797126770019, "sim_compute_performance-ego": 0.06507064819335938, "sim_compute_robot_state-ego": 0.06791294097900391}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.09870794453198396, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05242327798770953, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13090053992935374, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.07828823524185374, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03517501867270168, "sim_compute_performance-ego": 0.05770087242126465, "sim_compute_robot_state-ego": 0.06343518329572075}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.08993087496076312, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.052456695206311285, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.13062647897370008, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.08783296176365443, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.03415954356290856, "sim_compute_performance-ego": 0.05897953558941277, "sim_compute_robot_state-ego": 0.05961125237601144}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.11070423892566136, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06302550009318761, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.1444349799837385, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.09677886962890624, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.03752193706376212, "sim_compute_performance-ego": 0.06911830391202654, "sim_compute_robot_state-ego": 0.07597804921013969}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.1270173958369664, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.059208892640613374, "in-drivable-lane": 0, "agent_compute-ego": 0.1586033162616548, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10112858953930084, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.0391330151330857, "sim_compute_performance-ego": 0.07456551279340472, "sim_compute_robot_state-ego": 0.0714834871746245}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.10832750595222083, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.05745978678687144, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14621018959304033, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.08737583079580534, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.0372802160554013, "sim_compute_performance-ego": 0.06420618396694378, "sim_compute_robot_state-ego": 0.06722534713098559}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.10647028576244008, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.058718937093561345, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.14746064272793857, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.08690648078918457, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.03648154518821023, "sim_compute_performance-ego": 0.06789287653836337, "sim_compute_robot_state-ego": 0.06954125924543901}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.10937462534223284, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.05424920924298175, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1428874127276532, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.08664470833617371, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.03767554790942699, "sim_compute_performance-ego": 0.06205802768855899, "sim_compute_robot_state-ego": 0.06869715839237361}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.11800294263022286, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06201225519180298, "in-drivable-lane": 0, "agent_compute-ego": 0.13374797786985124, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.0803459712437221, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.033059511865888326, "sim_compute_performance-ego": 0.06865862437656947, "sim_compute_robot_state-ego": 0.06927425520760673}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.10621346679388308, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.060375882130043176, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.13413283404181986, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.08679512435314703, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.037339551776063205, "sim_compute_performance-ego": 0.0646532376607259, "sim_compute_robot_state-ego": 0.06377037366231282}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.14846244564762823, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.06724611035099735, "in-drivable-lane": 0, "agent_compute-ego": 0.17604724566141763, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.10776984250103984, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04369323341934769, "sim_compute_performance-ego": 0.07598464577286332, "sim_compute_robot_state-ego": 0.0943950988628246}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.1055076239155788, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06263116294262457, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.15331710319893033, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.0957775536705466, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.03924457232157389, "sim_compute_performance-ego": 0.06974422931671143, "sim_compute_robot_state-ego": 0.0740193058462704}}
set_robot_commands_max0.10776984250103984
set_robot_commands_mean0.08663775035319496
set_robot_commands_median0.08703546524047852
set_robot_commands_min0.0555116569294649
sim_compute_performance-ego_max0.07598464577286332
sim_compute_performance-ego_mean0.06446073036946821
sim_compute_performance-ego_median0.06507064819335938
sim_compute_performance-ego_min0.04430550687453326
sim_compute_robot_state-ego_max0.0943950988628246
sim_compute_robot_state-ego_mean0.06841789301716815
sim_compute_robot_state-ego_median0.06869715839237361
sim_compute_robot_state-ego_min0.047182588016285616
sim_compute_sim_state_max0.04369323341934769
sim_compute_sim_state_mean0.036358837516796104
sim_compute_sim_state_median0.037339551776063205
sim_compute_sim_state_min0.02603307892294491
sim_physics_max0.14846244564762823
sim_physics_mean0.10886761359088289
sim_physics_median0.10832750595222083
sim_physics_min0.07560641625348259
sim_render-ego_max0.06724611035099735
sim_render-ego_mean0.057628693424508354
sim_render-ego_median0.059208892640613374
sim_render-ego_min0.0428317154155058
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
212402495Liam Paullchallenge-aido_LF-template-pytorchaido2-LFV-sim-testingstep1-simulationsuccessno8430:14:17(hidden)
driven_lanedir_consec_median0.07968660528663696
survival_time_median1.2000000000000004
deviation-center-line_median0.07611691581775067
in-drivable-lane_median0


other stats
agent_compute-ego_max0.17677677196005118
agent_compute-ego_mean0.1519670114959635
agent_compute-ego_median0.15347912094809793
agent_compute-ego_min0.1193694273630778
deviation-center-line_max0.09627104004132828
deviation-center-line_mean0.07427483215300637
deviation-center-line_min0.0459248836603353
deviation-heading_max0.9346314192447778
deviation-heading_mean0.7277730499929109
deviation-heading_median0.7594427517427644
deviation-heading_min0.5227507875290646
driven_any_max0.24239365835143872
driven_any_mean0.16042804536475108
driven_any_median0.1370056416082507
driven_any_min0.10521756458412442
driven_lanedir_consec_max0.15457497851859925
driven_lanedir_consec_mean0.08786745137497634
driven_lanedir_consec_min0.048383450412528894
driven_lanedir_max0.15457497851859925
driven_lanedir_mean0.08786745137497634
driven_lanedir_median0.07968660528663696
driven_lanedir_min0.048383450412528894
in-drivable-lane_max0.6500000000000006
in-drivable-lane_mean0.13333333333333344
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2221876422486047, "sim_physics": 0.17875210898263114, "survival_time": 1.7500000000000009, "driven_lanedir": 0.07578637203144467, "sim_render-ego": 0.06027131080627442, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16297286578587122, "deviation-heading": 0.7676548075802966, "set_robot_commands": 0.09119725908551896, "deviation-center-line": 0.06345830379339204, "driven_lanedir_consec": 0.07578637203144467, "sim_compute_sim_state": 0.03772357531956264, "sim_compute_performance-ego": 0.06719870567321777, "sim_compute_robot_state-ego": 0.06951024191720145, "sim_compute_robot_state-npc0": 0.06665641239711216, "sim_compute_robot_state-npc1": 0.06578297615051269, "sim_compute_robot_state-npc2": 0.06655471665518624, "sim_compute_robot_state-npc3": 0.07032465253557478}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19915254875033747, "sim_physics": 0.15623399705597849, "survival_time": 1.6500000000000008, "driven_lanedir": 0.048383450412528894, "sim_render-ego": 0.05699193116390344, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.14506973642291446, "deviation-heading": 0.7594427517427644, "set_robot_commands": 0.08361090313304555, "deviation-center-line": 0.05279899839029909, "driven_lanedir_consec": 0.048383450412528894, "sim_compute_sim_state": 0.03633515762560295, "sim_compute_performance-ego": 0.06298221241344105, "sim_compute_robot_state-ego": 0.07093801642909195, "sim_compute_robot_state-npc0": 0.06218975963014545, "sim_compute_robot_state-npc1": 0.06522349877790971, "sim_compute_robot_state-npc2": 0.06766947832974521, "sim_compute_robot_state-npc3": 0.06658463044600053}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1129155018825549, "sim_physics": 0.19765512509779495, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07935837137228008, "sim_render-ego": 0.06303747133775191, "in-drivable-lane": 0, "agent_compute-ego": 0.16468007998033005, "deviation-heading": 0.5227507875290646, "set_robot_commands": 0.09025528214194556, "deviation-center-line": 0.09627104004132828, "driven_lanedir_consec": 0.07935837137228008, "sim_compute_sim_state": 0.03770444609902122, "sim_compute_performance-ego": 0.06549950079484419, "sim_compute_robot_state-ego": 0.08226022937081078, "sim_compute_robot_state-npc0": 0.0683451999317516, "sim_compute_robot_state-npc1": 0.06440181081945245, "sim_compute_robot_state-npc2": 0.06437353654341264, "sim_compute_robot_state-npc3": 0.06484370881860907}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.10521756458412442, "sim_physics": 0.1929247812791304, "survival_time": 1.1000000000000003, "driven_lanedir": 0.06818727414579051, "sim_render-ego": 0.05926255746321245, "in-drivable-lane": 0, "agent_compute-ego": 0.15347912094809793, "deviation-heading": 0.5563157019235696, "set_robot_commands": 0.08738555691458962, "deviation-center-line": 0.09069576420228502, "driven_lanedir_consec": 0.06818727414579051, "sim_compute_sim_state": 0.03972762281244451, "sim_compute_performance-ego": 0.06250630725513805, "sim_compute_robot_state-ego": 0.0629228570244529, "sim_compute_robot_state-npc0": 0.06019509922374378, "sim_compute_robot_state-npc1": 0.06242104010148482, "sim_compute_robot_state-npc2": 0.06297945976257324, "sim_compute_robot_state-npc3": 0.06346303766424005}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1208897065678006, "sim_physics": 0.1214630292809528, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05347974691090085, "sim_render-ego": 0.045535129049549934, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1256290518719217, "deviation-heading": 0.8384887994574305, "set_robot_commands": 0.07407934769340184, "deviation-center-line": 0.0459248836603353, "driven_lanedir_consec": 0.05347974691090085, "sim_compute_sim_state": 0.028913829637610394, "sim_compute_performance-ego": 0.054017823675404426, "sim_compute_robot_state-ego": 0.05761110264322032, "sim_compute_robot_state-npc0": 0.05362517937369968, "sim_compute_robot_state-npc1": 0.051763814428578254, "sim_compute_robot_state-npc2": 0.049227756002674934, "sim_compute_robot_state-npc3": 0.05226062691730002}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.23907435600747637, "sim_physics": 0.1373373167855399, "survival_time": 1.7500000000000009, "driven_lanedir": 0.1349516251697307, "sim_render-ego": 0.056629269463675365, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.146992894581386, "deviation-heading": 0.8904263547957212, "set_robot_commands": 0.0786275931767055, "deviation-center-line": 0.07169328232555265, "driven_lanedir_consec": 0.1349516251697307, "sim_compute_sim_state": 0.033433049065726146, "sim_compute_performance-ego": 0.06347669873918806, "sim_compute_robot_state-ego": 0.06636513301304409, "sim_compute_robot_state-npc0": 0.06076982361929757, "sim_compute_robot_state-npc1": 0.05914199692862374, "sim_compute_robot_state-npc2": 0.062132317679268974, "sim_compute_robot_state-npc3": 0.05991567202976772}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.12071273636535047, "sim_physics": 0.13477583365006882, "survival_time": 1.1000000000000003, "driven_lanedir": 0.0818806250250339, "sim_render-ego": 0.045809940858320755, "in-drivable-lane": 0, "agent_compute-ego": 0.1459317315708507, "deviation-heading": 0.5764143216303912, "set_robot_commands": 0.07593917846679688, "deviation-center-line": 0.07846041171762767, "driven_lanedir_consec": 0.0818806250250339, "sim_compute_sim_state": 0.026900876652110703, "sim_compute_performance-ego": 0.0498809272592718, "sim_compute_robot_state-ego": 0.05300203236666592, "sim_compute_robot_state-npc0": 0.04833573644811457, "sim_compute_robot_state-npc1": 0.047572786157781426, "sim_compute_robot_state-npc2": 0.04937142675573176, "sim_compute_robot_state-npc3": 0.046356157823042435}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.116853695866203, "sim_physics": 0.21070505181948343, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07968660528663696, "sim_render-ego": 0.06262053052584331, "in-drivable-lane": 0, "agent_compute-ego": 0.17481245597203574, "deviation-heading": 0.6396453122102181, "set_robot_commands": 0.10495501756668092, "deviation-center-line": 0.09349582399489366, "driven_lanedir_consec": 0.07968660528663696, "sim_compute_sim_state": 0.04278994599978129, "sim_compute_performance-ego": 0.0682231883207957, "sim_compute_robot_state-ego": 0.07707331577936809, "sim_compute_robot_state-npc0": 0.06864480177561443, "sim_compute_robot_state-npc1": 0.06633354226748149, "sim_compute_robot_state-npc2": 0.06913075844446818, "sim_compute_robot_state-npc3": 0.0686887005964915}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.2215286862315604, "sim_physics": 0.2105605371536747, "survival_time": 1.5500000000000007, "driven_lanedir": 0.15457497851859925, "sim_render-ego": 0.06258345419360746, "in-drivable-lane": 0, "agent_compute-ego": 0.17259450112619706, "deviation-heading": 0.881768815063205, "set_robot_commands": 0.0896367565278084, "deviation-center-line": 0.07019100232573273, "driven_lanedir_consec": 0.15457497851859925, "sim_compute_sim_state": 0.0378578862836284, "sim_compute_performance-ego": 0.07005939945097893, "sim_compute_robot_state-ego": 0.0785317805505568, "sim_compute_robot_state-npc0": 0.09260972084537628, "sim_compute_robot_state-npc1": 0.06839669904401226, "sim_compute_robot_state-npc2": 0.0714694376914732, "sim_compute_robot_state-npc3": 0.06866033615604523}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1641952391119638, "sim_physics": 0.1252529239654541, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09282464622938448, "sim_render-ego": 0.04668309211730957, "in-drivable-lane": 0, "agent_compute-ego": 0.12061829566955566, "deviation-heading": 0.9201679280918876, "set_robot_commands": 0.06526164054870605, "deviation-center-line": 0.06316699481359707, "driven_lanedir_consec": 0.09282464622938448, "sim_compute_sim_state": 0.02619553565979004, "sim_compute_performance-ego": 0.050743942260742185, "sim_compute_robot_state-ego": 0.05214596748352051, "sim_compute_robot_state-npc0": 0.050286483764648435, "sim_compute_robot_state-npc1": 0.04979669570922852, "sim_compute_robot_state-npc2": 0.05052759170532226, "sim_compute_robot_state-npc3": 0.0478201961517334}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.13542019998890562, "sim_physics": 0.14321855703989664, "survival_time": 1.2000000000000004, "driven_lanedir": 0.05385463455625672, "sim_render-ego": 0.04181179404258728, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1193694273630778, "deviation-heading": 0.9346314192447778, "set_robot_commands": 0.06220475832621256, "deviation-center-line": 0.047299844807480354, "driven_lanedir_consec": 0.05385463455625672, "sim_compute_sim_state": 0.02786281704902649, "sim_compute_performance-ego": 0.0448094109694163, "sim_compute_robot_state-ego": 0.04778599739074707, "sim_compute_robot_state-npc0": 0.04685805241266886, "sim_compute_robot_state-npc1": 0.04452162981033325, "sim_compute_robot_state-npc2": 0.04884726802508036, "sim_compute_robot_state-npc3": 0.044694711764653526}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.10750533216448294, "sim_physics": 0.15639687776565553, "survival_time": 1.0000000000000002, "driven_lanedir": 0.07148435863602254, "sim_render-ego": 0.05644594430923462, "in-drivable-lane": 0, "agent_compute-ego": 0.16240862607955933, "deviation-heading": 0.5596174758982276, "set_robot_commands": 0.08955326080322265, "deviation-center-line": 0.08703719411921414, "driven_lanedir_consec": 0.07148435863602254, "sim_compute_sim_state": 0.0364471435546875, "sim_compute_performance-ego": 0.05988873243331909, "sim_compute_robot_state-ego": 0.06679120063781738, "sim_compute_robot_state-npc0": 0.06822129487991332, "sim_compute_robot_state-npc1": 0.06729438304901122, "sim_compute_robot_state-npc2": 0.06431452035903931, "sim_compute_robot_state-npc3": 0.06467206478118896}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.24239365835143872, "sim_physics": 0.17054875900870875, "survival_time": 1.900000000000001, "driven_lanedir": 0.10792325468096686, "sim_render-ego": 0.05752513910594739, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1505509050268876, "deviation-heading": 0.8113096317148016, "set_robot_commands": 0.08779105387235943, "deviation-center-line": 0.07611691581775067, "driven_lanedir_consec": 0.10792325468096686, "sim_compute_sim_state": 0.03624655698475085, "sim_compute_performance-ego": 0.06250870855231035, "sim_compute_robot_state-ego": 0.06694960594177246, "sim_compute_robot_state-npc0": 0.062487508121289705, "sim_compute_robot_state-npc1": 0.06280542047400224, "sim_compute_robot_state-npc2": 0.06319611323507209, "sim_compute_robot_state-npc3": 0.06348768033479389}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.1370056416082507, "sim_physics": 0.1987845690354057, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09804582411851824, "sim_render-ego": 0.06397635003794795, "in-drivable-lane": 0, "agent_compute-ego": 0.17677677196005118, "deviation-heading": 0.5590188259779947, "set_robot_commands": 0.0874500792959462, "deviation-center-line": 0.0916591981793876, "driven_lanedir_consec": 0.09804582411851824, "sim_compute_sim_state": 0.04028159639109736, "sim_compute_performance-ego": 0.07179306901019553, "sim_compute_robot_state-ego": 0.08113788521808127, "sim_compute_robot_state-npc0": 0.06459576150645381, "sim_compute_robot_state-npc1": 0.06541952879532524, "sim_compute_robot_state-npc2": 0.06654328885285751, "sim_compute_robot_state-npc3": 0.06699766283449919}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.16136817074221171, "sim_physics": 0.1631707085503472, "survival_time": 1.3500000000000003, "driven_lanedir": 0.11759000353055038, "sim_render-ego": 0.05612853721336082, "in-drivable-lane": 0, "agent_compute-ego": 0.1576187080807156, "deviation-heading": 0.6989428170333163, "set_robot_commands": 0.0915546417236328, "deviation-center-line": 0.08585282410621915, "driven_lanedir_consec": 0.11759000353055038, "sim_compute_sim_state": 0.03842501287107115, "sim_compute_performance-ego": 0.06627287688078703, "sim_compute_robot_state-ego": 0.06290510848716453, "sim_compute_robot_state-npc0": 0.06620795638472945, "sim_compute_robot_state-npc1": 0.06709177405745895, "sim_compute_robot_state-npc2": 0.065165051707515, "sim_compute_robot_state-npc3": 0.07004019066139504}}
set_robot_commands_max0.10495501756668092
set_robot_commands_mean0.08396682195177153
set_robot_commands_median0.0874500792959462
set_robot_commands_min0.06220475832621256
sim_compute_performance-ego_max0.07179306901019553
sim_compute_performance-ego_mean0.0613241002459367
sim_compute_performance-ego_median0.06298221241344105
sim_compute_performance-ego_min0.0448094109694163
sim_compute_robot_state-ego_max0.08226022937081078
sim_compute_robot_state-ego_mean0.06639536495023438
sim_compute_robot_state-ego_median0.06679120063781738
sim_compute_robot_state-ego_min0.04778599739074707
sim_compute_robot_state-npc0_max0.09260972084537628
sim_compute_robot_state-npc0_mean0.06266858602097061
sim_compute_robot_state-npc0_median0.062487508121289705
sim_compute_robot_state-npc0_min0.04685805241266886
sim_compute_robot_state-npc1_max0.06839669904401226
sim_compute_robot_state-npc1_mean0.06053117310474642
sim_compute_robot_state-npc1_median0.06440181081945245
sim_compute_robot_state-npc1_min0.04452162981033325
sim_compute_robot_state-npc2_max0.0714694376914732
sim_compute_robot_state-npc2_mean0.06143351478329473
sim_compute_robot_state-npc2_median0.06431452035903931
sim_compute_robot_state-npc2_min0.04884726802508036
sim_compute_robot_state-npc3_max0.07032465253557478
sim_compute_robot_state-npc3_mean0.06125400196768902
sim_compute_robot_state-npc3_median0.06467206478118896
sim_compute_robot_state-npc3_min0.044694711764653526
sim_compute_sim_state_max0.04278994599978129
sim_compute_sim_state_mean0.03512300346706078
sim_compute_sim_state_median0.0364471435546875
sim_compute_sim_state_min0.02619553565979004
sim_physics_max0.21070505181948343
sim_physics_mean0.16651867843138152
sim_physics_median0.1631707085503472
sim_physics_min0.1214630292809528
sim_render-ego_max0.06397635003794795
sim_render-ego_mean0.05568749677923512
sim_render-ego_median0.05699193116390344
sim_render-ego_min0.04181179404258728
simulation-passed1
survival_time_max1.900000000000001
survival_time_mean1.3466666666666671
survival_time_min1.0000000000000002
212322503RamiNaimchallenge-aido_LF-template-rosaido2-LF-sim-validationstep1-simulationerrorno8430:00:40
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
212272508RamiNaimchallenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationerrorno8430:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
212252513RamiNaimchallenge-aido_LF-template-rosaido2-LFVI-sim-validationstep1-simulationerrorno8430:00:45
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
212212521Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrorno8430:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
212042538Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrorno8430:05:24
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
211712774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno8430:57:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2774/step1-simulation-ip-172-31-42-167-7357-job21171/logs/challenges-runner/stdout.log'
(hidden)
211562582AlexKaravaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationerrorno8430:02:11
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
211392612Konstantin Chaykachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationhost-errorno8430:23:49
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2612/step1-simulation-ip-172-31-42-167-7357-job21139/logs/challenges-runner/stdout.log'
(hidden)
211362617Andrea Censichallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessno8430:05:30(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.15569708861556708
agent_compute-ego_mean0.1459210335337607
agent_compute-ego_median0.14777557457549662
agent_compute-ego_min0.13371382040136
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10490158310642948, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.059363206227620445, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15493829162032516, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.0888405199404116, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03804092937045627, "sim_compute_performance-ego": 0.07090285530796757, "sim_compute_robot_state-ego": 0.06998932803118671}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12782775654512293, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06112170219421387, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15569708861556708, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.0971838913711847, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0455629217858408, "sim_compute_performance-ego": 0.06557986783046349, "sim_compute_robot_state-ego": 0.07727192429935231}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.12475162393906536, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05607959803412942, "in-drivable-lane": 0, "agent_compute-ego": 0.13371382040136, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.08473521120408002, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03721973475287942, "sim_compute_performance-ego": 0.061429865220013785, "sim_compute_robot_state-ego": 0.06590941373039694}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.11733502388000489, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.05774788856506348, "in-drivable-lane": 0, "agent_compute-ego": 0.1374803924560547, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09564239501953126, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03648118019104004, "sim_compute_performance-ego": 0.06248193740844726, "sim_compute_robot_state-ego": 0.0674617862701416}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10397213621984554, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05634922015516064, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14777557457549662, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.092125614987144, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.037278513365154024, "sim_compute_performance-ego": 0.06345074991636639, "sim_compute_robot_state-ego": 0.067136028144933}}
set_robot_commands_max0.0971838913711847
set_robot_commands_mean0.09170552650447032
set_robot_commands_median0.092125614987144
set_robot_commands_min0.08473521120408002
sim_compute_performance-ego_max0.07090285530796757
sim_compute_performance-ego_mean0.06476905513665171
sim_compute_performance-ego_median0.06345074991636639
sim_compute_performance-ego_min0.061429865220013785
sim_compute_robot_state-ego_max0.07727192429935231
sim_compute_robot_state-ego_mean0.06955369609520212
sim_compute_robot_state-ego_median0.0674617862701416
sim_compute_robot_state-ego_min0.06590941373039694
sim_compute_sim_state_max0.0455629217858408
sim_compute_sim_state_mean0.03891665589307411
sim_compute_sim_state_median0.037278513365154024
sim_compute_sim_state_min0.03648118019104004
sim_physics_max0.12782775654512293
sim_physics_mean0.11575762473809365
sim_physics_median0.11733502388000489
sim_physics_min0.10397213621984554
sim_render-ego_max0.06112170219421387
sim_render-ego_mean0.058132323035237576
sim_render-ego_median0.05774788856506348
sim_render-ego_min0.05607959803412942
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
211322625Andrea Censichallenge-aido_LF-template-randomaido2-LFVI-sim-validationstep1-simulationsuccessno8430:08:52(hidden)
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.15062864124774933
agent_compute-ego_mean0.1395985574907672
agent_compute-ego_median0.14056094386909582
agent_compute-ego_min0.1284192715372358
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.18450969382177423, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.058892500551441046, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14056094386909582, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09203818478161777, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03776932064490982, "sim_compute_performance-ego": 0.06414000293876551, "sim_compute_robot_state-ego": 0.07324021073836315, "sim_compute_robot_state-npc0": 0.0673544678506972, "sim_compute_robot_state-npc1": 0.06566774392429786, "sim_compute_robot_state-npc2": 0.06422750557525249, "sim_compute_robot_state-npc3": 0.0629557265511042}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.16792150906154088, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.055701145103999546, "in-drivable-lane": 0, "agent_compute-ego": 0.1284192715372358, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.08431561504091535, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03185391426086426, "sim_compute_performance-ego": 0.05477502516337803, "sim_compute_robot_state-ego": 0.06418352467673165, "sim_compute_robot_state-npc0": 0.060691731316702704, "sim_compute_robot_state-npc1": 0.06163686513900757, "sim_compute_robot_state-npc2": 0.057966019426073344, "sim_compute_robot_state-npc3": 0.057551486151559014}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.17656945256353582, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05804396138607877, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14322192923536578, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.08481897891146466, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.035549300388225076, "sim_compute_performance-ego": 0.06362841198745284, "sim_compute_robot_state-ego": 0.06610040294313893, "sim_compute_robot_state-npc0": 0.06340469665897702, "sim_compute_robot_state-npc1": 0.0648880768748163, "sim_compute_robot_state-npc2": 0.064028605674077, "sim_compute_robot_state-npc3": 0.06203092649145034}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.21765494346618652, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06111153463522593, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.15062864124774933, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.09126131236553192, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.040860310196876526, "sim_compute_performance-ego": 0.06896886726220448, "sim_compute_robot_state-ego": 0.07593127091725667, "sim_compute_robot_state-npc0": 0.06676909824212392, "sim_compute_robot_state-npc1": 0.06511455277601878, "sim_compute_robot_state-npc2": 0.06423294544219971, "sim_compute_robot_state-npc3": 0.06379542251427968}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.20241892905462355, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.057745263690040224, "in-drivable-lane": 0, "agent_compute-ego": 0.13516200156438918, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09277986344837008, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03996431259881882, "sim_compute_performance-ego": 0.06586305300394694, "sim_compute_robot_state-ego": 0.06924273854210264, "sim_compute_robot_state-npc0": 0.07050742421831403, "sim_compute_robot_state-npc1": 0.0692770140511649, "sim_compute_robot_state-npc2": 0.07258320990062896, "sim_compute_robot_state-npc3": 0.07133159183320545}}
set_robot_commands_max0.09277986344837008
set_robot_commands_mean0.08904279090957995
set_robot_commands_median0.09126131236553192
set_robot_commands_min0.08431561504091535
sim_compute_performance-ego_max0.06896886726220448
sim_compute_performance-ego_mean0.06347507207114957
sim_compute_performance-ego_median0.06414000293876551
sim_compute_performance-ego_min0.05477502516337803
sim_compute_robot_state-ego_max0.07593127091725667
sim_compute_robot_state-ego_mean0.0697396295635186
sim_compute_robot_state-ego_median0.06924273854210264
sim_compute_robot_state-ego_min0.06418352467673165
sim_compute_robot_state-npc0_max0.07050742421831403
sim_compute_robot_state-npc0_mean0.06574548365736296
sim_compute_robot_state-npc0_median0.06676909824212392
sim_compute_robot_state-npc0_min0.060691731316702704
sim_compute_robot_state-npc1_max0.0692770140511649
sim_compute_robot_state-npc1_mean0.06531685055306109
sim_compute_robot_state-npc1_median0.06511455277601878
sim_compute_robot_state-npc1_min0.06163686513900757
sim_compute_robot_state-npc2_max0.07258320990062896
sim_compute_robot_state-npc2_mean0.0646076572036463
sim_compute_robot_state-npc2_median0.06422750557525249
sim_compute_robot_state-npc2_min0.057966019426073344
sim_compute_robot_state-npc3_max0.07133159183320545
sim_compute_robot_state-npc3_mean0.06353303070831973
sim_compute_robot_state-npc3_median0.0629557265511042
sim_compute_robot_state-npc3_min0.057551486151559014
sim_compute_sim_state_max0.040860310196876526
sim_compute_sim_state_mean0.0371994316179389
sim_compute_sim_state_median0.03776932064490982
sim_compute_sim_state_min0.03185391426086426
sim_physics_max0.21765494346618652
sim_physics_mean0.1898149055935322
sim_physics_median0.18450969382177423
sim_physics_min0.16792150906154088
sim_render-ego_max0.06111153463522593
sim_render-ego_mean0.0582988810733571
sim_render-ego_median0.05804396138607877
sim_render-ego_min0.055701145103999546
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
211122632Andrea Censichallenge-aido_LF-template-randomaido2-LFV-sim-testingstep1-simulationsuccessno8430:19:55(hidden)
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.16010649681091307
agent_compute-ego_mean0.1479096446207366
agent_compute-ego_median0.14831720079694474
agent_compute-ego_min0.13312570615248245
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.16746237542894152, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06179645767918339, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14944960011376274, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09406089341198956, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.038417304003680194, "sim_compute_performance-ego": 0.06990239796815095, "sim_compute_robot_state-ego": 0.07379841362988507, "sim_compute_robot_state-npc0": 0.06727198759714763, "sim_compute_robot_state-npc1": 0.06861263734323007, "sim_compute_robot_state-npc2": 0.06854212284088135, "sim_compute_robot_state-npc3": 0.06835284498002794}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.18638998985290528, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06594414710998535, "in-drivable-lane": 0, "agent_compute-ego": 0.15085100173950194, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09401938438415527, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.036677894592285154, "sim_compute_performance-ego": 0.07016482353210449, "sim_compute_robot_state-ego": 0.07272703170776368, "sim_compute_robot_state-npc0": 0.06915338516235352, "sim_compute_robot_state-npc1": 0.07005826950073242, "sim_compute_robot_state-npc2": 0.06722870826721192, "sim_compute_robot_state-npc3": 0.06832658767700195}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.18349834492332057, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.05840394998851575, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14558105719716927, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09319605639106349, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03918871126676861, "sim_compute_performance-ego": 0.06696961741698415, "sim_compute_robot_state-ego": 0.07115533477381657, "sim_compute_robot_state-npc0": 0.06686698449285407, "sim_compute_robot_state-npc1": 0.06783754888333772, "sim_compute_robot_state-npc2": 0.06712560590944792, "sim_compute_robot_state-npc3": 0.06594741971869218}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.15443053728417505, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05733203284348114, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1449237654480753, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.08274368092983583, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.034128705157509334, "sim_compute_performance-ego": 0.060169582125506826, "sim_compute_robot_state-ego": 0.06463716603532622, "sim_compute_robot_state-npc0": 0.06614302079888838, "sim_compute_robot_state-npc1": 0.0690872337244734, "sim_compute_robot_state-npc2": 0.06169649920886076, "sim_compute_robot_state-npc3": 0.06153567531440832}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.16752454212733678, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06047368049621582, "in-drivable-lane": 0, "agent_compute-ego": 0.14831720079694474, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.09385440179279872, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03621666772024972, "sim_compute_performance-ego": 0.06637048721313477, "sim_compute_robot_state-ego": 0.06921889100755964, "sim_compute_robot_state-npc0": 0.06814420223236084, "sim_compute_robot_state-npc1": 0.07796916791370936, "sim_compute_robot_state-npc2": 0.06672132015228271, "sim_compute_robot_state-npc3": 0.06952829871858869}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.11867799582304778, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.04702231177577266, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.14623132899955468, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.07742426130506727, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.03301786051856147, "sim_compute_performance-ego": 0.054932355880737305, "sim_compute_robot_state-ego": 0.06852857271830241, "sim_compute_robot_state-npc0": 0.05258342071815773, "sim_compute_robot_state-npc1": 0.054533671449731896, "sim_compute_robot_state-npc2": 0.05243008666568332, "sim_compute_robot_state-npc3": 0.0595227700692636}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.16777109658276593, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.06200612915886773, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.15208843019273546, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.09562785978670474, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.03931374461562545, "sim_compute_performance-ego": 0.07069108221266004, "sim_compute_robot_state-ego": 0.0760182363015634, "sim_compute_robot_state-npc0": 0.06797550342701099, "sim_compute_robot_state-npc1": 0.06735554889396385, "sim_compute_robot_state-npc2": 0.06905167632632786, "sim_compute_robot_state-npc3": 0.07126956957357901}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.18073465559217664, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.05682352913750543, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.14237291018168133, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.08642801708645291, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.03704829216003418, "sim_compute_performance-ego": 0.05993878576490614, "sim_compute_robot_state-ego": 0.06290380689832899, "sim_compute_robot_state-npc0": 0.06744721200731066, "sim_compute_robot_state-npc1": 0.06368358929951985, "sim_compute_robot_state-npc2": 0.05962945620218913, "sim_compute_robot_state-npc3": 0.06376292440626356}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.14869150908096976, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.056619431661522904, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.13759446662405264, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.08977049330006474, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.03685527262480363, "sim_compute_performance-ego": 0.06187694487364396, "sim_compute_robot_state-ego": 0.06096777190332827, "sim_compute_robot_state-npc0": 0.06531983354817265, "sim_compute_robot_state-npc1": 0.07009552354397981, "sim_compute_robot_state-npc2": 0.06539968822313391, "sim_compute_robot_state-npc3": 0.06626949102982231}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.21119990348815915, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.06484573364257812, "in-drivable-lane": 0, "agent_compute-ego": 0.16010649681091307, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.1021366310119629, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.03883590698242187, "sim_compute_performance-ego": 0.07658060073852539, "sim_compute_robot_state-ego": 0.08064557552337646, "sim_compute_robot_state-npc0": 0.07155804634094239, "sim_compute_robot_state-npc1": 0.06829883575439454, "sim_compute_robot_state-npc2": 0.06763200283050537, "sim_compute_robot_state-npc3": 0.06980051040649414}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.2056452751159668, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.060141122341156, "in-drivable-lane": 0, "agent_compute-ego": 0.14991565942764282, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.08717553615570069, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.03553861379623413, "sim_compute_performance-ego": 0.07049003839492798, "sim_compute_robot_state-ego": 0.06414908170700073, "sim_compute_robot_state-npc0": 0.06585885286331176, "sim_compute_robot_state-npc1": 0.06860874891281128, "sim_compute_robot_state-npc2": 0.06803091764450073, "sim_compute_robot_state-npc3": 0.063837730884552}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.17478892677708677, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.06484404363130268, "in-drivable-lane": 0, "agent_compute-ego": 0.15805836727744654, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.09390508501153244, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.03626051701997456, "sim_compute_performance-ego": 0.06994799563759252, "sim_compute_robot_state-ego": 0.06998953066374126, "sim_compute_robot_state-npc0": 0.06783451532062731, "sim_compute_robot_state-npc1": 0.0692380102057206, "sim_compute_robot_state-npc2": 0.0642645233555844, "sim_compute_robot_state-npc3": 0.06729119702389366}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.1569307088851929, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.05967864513397217, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.15425543785095214, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.08889852046966552, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.033715677261352536, "sim_compute_performance-ego": 0.06555978775024414, "sim_compute_robot_state-ego": 0.06807595729827881, "sim_compute_robot_state-npc0": 0.06524256229400635, "sim_compute_robot_state-npc1": 0.06325708389282227, "sim_compute_robot_state-npc2": 0.0617741060256958, "sim_compute_robot_state-npc3": 0.06146047592163086}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.18569427186792548, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.05770560828122226, "in-drivable-lane": 0, "agent_compute-ego": 0.13312570615248245, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.08887742866169322, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.033732576803727585, "sim_compute_performance-ego": 0.06558267636732622, "sim_compute_robot_state-ego": 0.0720128362829035, "sim_compute_robot_state-npc0": 0.07018631154840643, "sim_compute_robot_state-npc1": 0.06975026564164595, "sim_compute_robot_state-npc2": 0.06501564112576572, "sim_compute_robot_state-npc3": 0.0568559928373857}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.1751908526128652, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.06269092462500747, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.14577324049813406, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.08843311971547652, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.038730538621240734, "sim_compute_performance-ego": 0.06444934436253139, "sim_compute_robot_state-ego": 0.06409407148555833, "sim_compute_robot_state-npc0": 0.06328042186036402, "sim_compute_robot_state-npc1": 0.06499899650106625, "sim_compute_robot_state-npc2": 0.06530019701743613, "sim_compute_robot_state-npc3": 0.06822708188271036}}
set_robot_commands_max0.1021366310119629
set_robot_commands_mean0.09043675796094423
set_robot_commands_median0.08977049330006474
set_robot_commands_min0.07742426130506727
sim_compute_performance-ego_max0.07658060073852539
sim_compute_performance-ego_mean0.06624176801593175
sim_compute_performance-ego_median0.06637048721313477
sim_compute_performance-ego_min0.054932355880737305
sim_compute_robot_state-ego_max0.08064557552337646
sim_compute_robot_state-ego_mean0.06926148519578222
sim_compute_robot_state-ego_median0.06921889100755964
sim_compute_robot_state-ego_min0.06096777190332827
sim_compute_robot_state-npc0_max0.07155804634094239
sim_compute_robot_state-npc0_mean0.06632441734746099
sim_compute_robot_state-npc0_median0.06727198759714763
sim_compute_robot_state-npc0_min0.05258342071815773
sim_compute_robot_state-npc1_max0.07796916791370936
sim_compute_robot_state-npc1_mean0.06755900876407597
sim_compute_robot_state-npc1_median0.06860874891281128
sim_compute_robot_state-npc1_min0.054533671449731896
sim_compute_robot_state-npc2_max0.06905167632632786
sim_compute_robot_state-npc2_mean0.06465617011970047
sim_compute_robot_state-npc2_median0.06539968822313391
sim_compute_robot_state-npc2_min0.05243008666568332
sim_compute_robot_state-npc3_max0.07126956957357901
sim_compute_robot_state-npc3_mean0.06546590469628762
sim_compute_robot_state-npc3_median0.06626949102982231
sim_compute_robot_state-npc3_min0.0568559928373857
sim_compute_sim_state_max0.03931374461562545
sim_compute_sim_state_mean0.03651188554296461
sim_compute_sim_state_median0.036677894592285154
sim_compute_sim_state_min0.03301786051856147
sim_physics_max0.21119990348815915
sim_physics_mean0.1723087323628557
sim_physics_median0.17478892677708677
sim_physics_min0.11867799582304778
sim_render-ego_max0.06594414710998535
sim_render-ego_mean0.059755183167085925
sim_render-ego_median0.060141122341156
sim_render-ego_min0.04702231177577266
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
211102645zamatorychallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationhost-errorno8430:00:19
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission2645/step1-simulation-ip-172-31-42-167-7357-job21110/logs/challenges-runner/stdout.log'
(hidden)
210942681RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationsuccessno8430:35:49(hidden)
driven_lanedir_consec_median0.9957937578101996
survival_time_median13.70000000000006
deviation-center-line_median0.8919033096715387
in-drivable-lane_median3.2500000000000213


other stats
agent_compute-ego_max0.09059424877166748
agent_compute-ego_mean0.08936551493322044
agent_compute-ego_median0.08912953701648084
agent_compute-ego_min0.08839945157368978
deviation-center-line_max1.2581235091803151
deviation-center-line_mean0.8751610563365022
deviation-center-line_min0.36764988746677113
deviation-heading_max5.904874199503731
deviation-heading_mean4.161807181581326
deviation-heading_median4.764497426634542
deviation-heading_min0.9239633058573166
driven_any_max2.3489458661644
driven_any_mean1.9324367141189296
driven_any_median2.1476765385276213
driven_any_min0.6936907434607329
driven_lanedir_consec_max1.3207412666109584
driven_lanedir_consec_mean0.9981694774969612
driven_lanedir_consec_min0.6781641145269627
driven_lanedir_max2.0358244540105064
driven_lanedir_mean1.3642280822487858
driven_lanedir_median1.238397712208239
driven_lanedir_min0.6781641145269627
in-drivable-lane_max3.8000000000000016
in-drivable-lane_mean2.2000000000000104
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1229560319859595, "sim_physics": 0.21011557771172715, "survival_time": 13.65000000000006, "driven_lanedir": 1.2145077467941174, "sim_render-ego": 0.07190062187530183, "in-drivable-lane": 3.8000000000000016, "agent_compute-ego": 0.08912953701648084, "deviation-heading": 4.764497426634542, "set_robot_commands": 0.11433945907341254, "deviation-center-line": 0.8221030822709682, "driven_lanedir_consec": 0.9957937578101996, "sim_compute_sim_state": 0.044265807329953374, "sim_compute_performance-ego": 0.08004131596603672, "sim_compute_robot_state-ego": 0.08986503649980594, "sim_compute_robot_state-npc0": 0.07997728442097758, "sim_compute_robot_state-npc1": 0.07906715861170283, "sim_compute_robot_state-npc2": 0.0803154964586754, "sim_compute_robot_state-npc3": 0.0788285391671317}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3489143904559344, "sim_physics": 0.2255681729316711, "survival_time": 14.950000000000076, "driven_lanedir": 1.6542463837041033, "sim_render-ego": 0.07176458676656088, "in-drivable-lane": 3.2500000000000213, "agent_compute-ego": 0.08839945157368978, "deviation-heading": 4.1894688604145625, "set_robot_commands": 0.11573743343353272, "deviation-center-line": 0.8919033096715387, "driven_lanedir_consec": 1.1677571855209754, "sim_compute_sim_state": 0.04508675575256347, "sim_compute_performance-ego": 0.08008323351542156, "sim_compute_robot_state-ego": 0.08945188363393147, "sim_compute_robot_state-npc0": 0.08048590262730916, "sim_compute_robot_state-npc1": 0.08019828001658122, "sim_compute_robot_state-npc2": 0.0808284584681193, "sim_compute_robot_state-npc3": 0.07900531768798828}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3489458661644, "sim_physics": 0.21248416503270467, "survival_time": 14.950000000000076, "driven_lanedir": 2.0358244540105064, "sim_render-ego": 0.07080610116322836, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.09059424877166748, "deviation-heading": 5.026232115496474, "set_robot_commands": 0.11218767166137696, "deviation-center-line": 1.2581235091803151, "driven_lanedir_consec": 1.3207412666109584, "sim_compute_sim_state": 0.04452215433120728, "sim_compute_performance-ego": 0.0790914527575175, "sim_compute_robot_state-ego": 0.08758938074111938, "sim_compute_robot_state-npc0": 0.08054750204086304, "sim_compute_robot_state-npc1": 0.07888628005981445, "sim_compute_robot_state-npc2": 0.07966272751490275, "sim_compute_robot_state-npc3": 0.0802730123202006}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.1476765385276213, "sim_physics": 0.2251732897584456, "survival_time": 13.70000000000006, "driven_lanedir": 1.238397712208239, "sim_render-ego": 0.07075115973061889, "in-drivable-lane": 3.400000000000021, "agent_compute-ego": 0.08866259477434367, "deviation-heading": 5.904874199503731, "set_robot_commands": 0.11650410098751096, "deviation-center-line": 1.036025493092918, "driven_lanedir_consec": 0.8283910630157103, "sim_compute_sim_state": 0.044406065975662566, "sim_compute_performance-ego": 0.07991726033008882, "sim_compute_robot_state-ego": 0.08882726021926768, "sim_compute_robot_state-npc0": 0.08082061788461505, "sim_compute_robot_state-npc1": 0.07981448451968005, "sim_compute_robot_state-npc2": 0.08024440542624815, "sim_compute_robot_state-npc3": 0.07941135437819209}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6936907434607329, "sim_physics": 0.21167700008679463, "survival_time": 4.6499999999999915, "driven_lanedir": 0.6781641145269627, "sim_render-ego": 0.07015076760322816, "in-drivable-lane": 0, "agent_compute-ego": 0.09004174252992035, "deviation-heading": 0.9239633058573166, "set_robot_commands": 0.11689859308222288, "deviation-center-line": 0.36764988746677113, "driven_lanedir_consec": 0.6781641145269627, "sim_compute_sim_state": 0.04441224631442819, "sim_compute_performance-ego": 0.07967128292206795, "sim_compute_robot_state-ego": 0.09049624012362573, "sim_compute_robot_state-npc0": 0.07915715761082147, "sim_compute_robot_state-npc1": 0.07775285936171009, "sim_compute_robot_state-npc2": 0.07675842315919938, "sim_compute_robot_state-npc3": 0.07786886153682586}}
set_robot_commands_max0.11689859308222288
set_robot_commands_mean0.1151334516476112
set_robot_commands_median0.11573743343353272
set_robot_commands_min0.11218767166137696
sim_compute_performance-ego_max0.08008323351542156
sim_compute_performance-ego_mean0.0797609090982265
sim_compute_performance-ego_median0.07991726033008882
sim_compute_performance-ego_min0.0790914527575175
sim_compute_robot_state-ego_max0.09049624012362573
sim_compute_robot_state-ego_mean0.08924596024355004
sim_compute_robot_state-ego_median0.08945188363393147
sim_compute_robot_state-ego_min0.08758938074111938
sim_compute_robot_state-npc0_max0.08082061788461505
sim_compute_robot_state-npc0_mean0.08019769291691727
sim_compute_robot_state-npc0_median0.08048590262730916
sim_compute_robot_state-npc0_min0.07915715761082147
sim_compute_robot_state-npc1_max0.08019828001658122
sim_compute_robot_state-npc1_mean0.07914381251389772
sim_compute_robot_state-npc1_median0.07906715861170283
sim_compute_robot_state-npc1_min0.07775285936171009
sim_compute_robot_state-npc2_max0.0808284584681193
sim_compute_robot_state-npc2_mean0.079561902205429
sim_compute_robot_state-npc2_median0.08024440542624815
sim_compute_robot_state-npc2_min0.07675842315919938
sim_compute_robot_state-npc3_max0.0802730123202006
sim_compute_robot_state-npc3_mean0.07907741701806771
sim_compute_robot_state-npc3_median0.07900531768798828
sim_compute_robot_state-npc3_min0.07786886153682586
sim_compute_sim_state_max0.04508675575256347
sim_compute_sim_state_mean0.04453860594076298
sim_compute_sim_state_median0.04441224631442819
sim_compute_sim_state_min0.044265807329953374
sim_physics_max0.2255681729316711
sim_physics_mean0.21700364110426865
sim_physics_median0.21248416503270467
sim_physics_min0.21011557771172715
sim_render-ego_max0.07190062187530183
sim_render-ego_mean0.07107464742778762
sim_render-ego_median0.07080610116322836
sim_render-ego_min0.07015076760322816
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.380000000000052
survival_time_min4.6499999999999915
210812699Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationsuccessno8430:21:32(hidden)
driven_lanedir_consec_median0.3787704196622297
survival_time_median4.749999999999991
deviation-center-line_median0.3565112702888225
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.09579787254333497
agent_compute-ego_mean0.08873557041078427
agent_compute-ego_median0.08875322182973226
agent_compute-ego_min0.0772650166561729
deviation-center-line_max0.995955273991036
deviation-center-line_mean0.49241348298819154
deviation-center-line_min0.17794855799105644
deviation-heading_max3.8352425655030986
deviation-heading_mean2.363563454255281
deviation-heading_median2.5814873595331584
deviation-heading_min0.5829145165746271
driven_any_max2.3490720300795833
driven_any_mean1.019701702716889
driven_any_median0.6927327493805732
driven_any_min0.29188406193902433
driven_lanedir_consec_max1.903203149124654
driven_lanedir_consec_mean0.6969957330169633
driven_lanedir_consec_min0.24777766139883556
driven_lanedir_max2.215991172656607
driven_lanedir_mean0.8475257609026878
driven_lanedir_median0.4622392324629913
driven_lanedir_min0.2634693851627814
in-drivable-lane_max1.2500000000000062
in-drivable-lane_mean0.3600000000000011
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.6927327493805732, "sim_physics": 0.19907011232878033, "survival_time": 4.749999999999991, "driven_lanedir": 0.4622392324629913, "sim_render-ego": 0.0592831435956453, "in-drivable-lane": 0.30000000000000004, "agent_compute-ego": 0.0772650166561729, "deviation-heading": 2.5814873595331584, "set_robot_commands": 0.08950410140188117, "deviation-center-line": 0.3565112702888225, "driven_lanedir_consec": 0.24777766139883556, "sim_compute_sim_state": 0.033331090525576944, "sim_compute_performance-ego": 0.062341095271863434, "sim_compute_robot_state-ego": 0.07201837489479467, "sim_compute_robot_state-npc0": 0.06140649193211606, "sim_compute_robot_state-npc1": 0.05985050452382941, "sim_compute_robot_state-npc2": 0.05833724423458702, "sim_compute_robot_state-npc3": 0.05842054015711734}, "udem1-1-0": {"driven_any": 0.4124180421689091, "sim_physics": 0.24245852848579144, "survival_time": 2.8999999999999977, "driven_lanedir": 0.3787704196622297, "sim_render-ego": 0.07977523474857726, "in-drivable-lane": 0, "agent_compute-ego": 0.09331934616483492, "deviation-heading": 1.058953310985765, "set_robot_commands": 0.11420636341489594, "deviation-center-line": 0.24011729880988025, "driven_lanedir_consec": 0.3787704196622297, "sim_compute_sim_state": 0.0460496031004807, "sim_compute_performance-ego": 0.07641519349196861, "sim_compute_robot_state-ego": 0.08465650985980856, "sim_compute_robot_state-npc0": 0.08039469143439984, "sim_compute_robot_state-npc1": 0.07880406955192829, "sim_compute_robot_state-npc2": 0.07852974020201585, "sim_compute_robot_state-npc3": 0.08317642787407184}, "udem1-2-0": {"driven_any": 1.352401630016357, "sim_physics": 0.2391613892146519, "survival_time": 8.74999999999999, "driven_lanedir": 0.9171585945688294, "sim_render-ego": 0.07402229445321219, "in-drivable-lane": 1.2500000000000062, "agent_compute-ego": 0.09579787254333497, "deviation-heading": 3.8352425655030986, "set_robot_commands": 0.10914977482386998, "deviation-center-line": 0.6915350138601626, "driven_lanedir_consec": 0.6917580497363156, "sim_compute_sim_state": 0.04336758204868862, "sim_compute_performance-ego": 0.07931509699140277, "sim_compute_robot_state-ego": 0.08660522597176688, "sim_compute_robot_state-npc0": 0.07682615143912179, "sim_compute_robot_state-npc1": 0.07696375574384416, "sim_compute_robot_state-npc2": 0.07935257502964564, "sim_compute_robot_state-npc3": 0.07764775548662459}, "udem1-3-0": {"driven_any": 0.29188406193902433, "sim_physics": 0.26152580283408944, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2634693851627814, "sim_render-ego": 0.06770732790924781, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.08854239485984625, "deviation-heading": 0.5829145165746271, "set_robot_commands": 0.1109273821808571, "deviation-center-line": 0.17794855799105644, "driven_lanedir_consec": 0.2634693851627814, "sim_compute_sim_state": 0.04564330744188885, "sim_compute_performance-ego": 0.07316308243330134, "sim_compute_robot_state-ego": 0.07928129129631575, "sim_compute_robot_state-npc0": 0.0780912998110749, "sim_compute_robot_state-npc1": 0.08179065238597781, "sim_compute_robot_state-npc2": 0.0827751547791237, "sim_compute_robot_state-npc3": 0.08072426707245582}, "udem1-4-0": {"driven_any": 2.3490720300795833, "sim_physics": 0.2412813369433085, "survival_time": 14.950000000000076, "driven_lanedir": 2.215991172656607, "sim_render-ego": 0.06993374903996785, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.08875322182973226, "deviation-heading": 3.759219518679757, "set_robot_commands": 0.11087623198827108, "deviation-center-line": 0.995955273991036, "driven_lanedir_consec": 1.903203149124654, "sim_compute_sim_state": 0.0437113626797994, "sim_compute_performance-ego": 0.07857139825820923, "sim_compute_robot_state-ego": 0.08950861136118571, "sim_compute_robot_state-npc0": 0.07821232318878174, "sim_compute_robot_state-npc1": 0.07927296082178752, "sim_compute_robot_state-npc2": 0.07894835392634074, "sim_compute_robot_state-npc3": 0.07899722735087077}}
set_robot_commands_max0.11420636341489594
set_robot_commands_mean0.10693277076195506
set_robot_commands_median0.11087623198827108
set_robot_commands_min0.08950410140188117
sim_compute_performance-ego_max0.07931509699140277
sim_compute_performance-ego_mean0.07396117328934908
sim_compute_performance-ego_median0.07641519349196861
sim_compute_performance-ego_min0.062341095271863434
sim_compute_robot_state-ego_max0.08950861136118571
sim_compute_robot_state-ego_mean0.08241400267677432
sim_compute_robot_state-ego_median0.08465650985980856
sim_compute_robot_state-ego_min0.07201837489479467
sim_compute_robot_state-npc0_max0.08039469143439984
sim_compute_robot_state-npc0_mean0.07498619156109886
sim_compute_robot_state-npc0_median0.0780912998110749
sim_compute_robot_state-npc0_min0.06140649193211606
sim_compute_robot_state-npc1_max0.08179065238597781
sim_compute_robot_state-npc1_mean0.07533638860547345
sim_compute_robot_state-npc1_median0.07880406955192829
sim_compute_robot_state-npc1_min0.05985050452382941
sim_compute_robot_state-npc2_max0.0827751547791237
sim_compute_robot_state-npc2_mean0.07558861363434258
sim_compute_robot_state-npc2_median0.07894835392634074
sim_compute_robot_state-npc2_min0.05833724423458702
sim_compute_robot_state-npc3_max0.08317642787407184
sim_compute_robot_state-npc3_mean0.07579324358822807
sim_compute_robot_state-npc3_median0.07899722735087077
sim_compute_robot_state-npc3_min0.05842054015711734
sim_compute_sim_state_max0.0460496031004807
sim_compute_sim_state_mean0.042420589159286905
sim_compute_sim_state_median0.0437113626797994
sim_compute_sim_state_min0.033331090525576944
sim_physics_max0.26152580283408944
sim_physics_mean0.2366994339613243
sim_physics_median0.2412813369433085
sim_physics_min0.19907011232878033
sim_render-ego_max0.07977523474857726
sim_render-ego_mean0.07014434994933008
sim_render-ego_median0.06993374903996785
sim_render-ego_min0.0592831435956453
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.700000000000012
survival_time_min2.1500000000000004
210742704RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationhost-errorno8430:10:34
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission2704/step1-simulation-ip-172-31-42-167-7357-job21074/logs/challenges-runner/stdout.log'
(hidden)
210662719jp18813100494test for ppoaido2-LFV-sim-testingstep1-simulationerrorno8430:01:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
210623110ssviridovBaselineaido2-AMOD-fleet_sizestep2-scoringsuccessyes8430:00:13(hidden)
fleet_size-1000000000


other stats
efficiency-62.9040012273548
service_quality-32.277470306839234
210543110ssviridovBaselineaido2-AMOD-fleet_sizestep1-simulationsuccessyes8430:05:44(hidden)
other stats
passedtrue
210502735Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationfailedno8430:01:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
210392755Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessno8430:05:56(hidden)
driven_lanedir_consec_median0.36592094708219225
survival_time_median2.3999999999999995
deviation-center-line_median0.1166759393545397
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.08042408029238383
agent_compute-ego_mean0.0744516192715539
agent_compute-ego_median0.0769704943117888
agent_compute-ego_min0.06773609174808985
deviation-center-line_max0.16987818035809085
deviation-center-line_mean0.13199870851217008
deviation-center-line_min0.1011892720306074
deviation-heading_max0.5809378480871981
deviation-heading_mean0.4194004386292103
deviation-heading_median0.34882560565471876
deviation-heading_min0.2596285487829774
driven_any_max0.922682252912863
driven_any_mean0.6324710235085378
driven_any_median0.609146202404747
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.6632135184572027
driven_lanedir_consec_mean0.4245071231796042
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.6632135184572027
driven_lanedir_mean0.4245071231796042
driven_lanedir_median0.36592094708219225
driven_lanedir_min0.2221238695940002
in-drivable-lane_max1.8999999999999944
in-drivable-lane_mean0.6299999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.11241280528861032, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.05976748802292515, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.06773609174808985, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09375318674974038, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.03734597689668897, "sim_compute_performance-ego": 0.06827812799265687, "sim_compute_robot_state-ego": 0.07049085388720876}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.11494309504826863, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.06363523006439209, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.06975647211074829, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.09292628367741902, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.0387411912282308, "sim_compute_performance-ego": 0.07086348136266073, "sim_compute_robot_state-ego": 0.07336330811182658}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.1438872922550548, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.07304047454487193, "in-drivable-lane": 0, "agent_compute-ego": 0.07737095789475874, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.10830926895141602, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.040781497955322266, "sim_compute_performance-ego": 0.08281641656702216, "sim_compute_robot_state-ego": 0.09588909149169922}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.14068409303824106, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.07013161977132161, "in-drivable-lane": 0, "agent_compute-ego": 0.08042408029238383, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.10867216189702351, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.04201517502466837, "sim_compute_performance-ego": 0.07646183172861735, "sim_compute_robot_state-ego": 0.08670087158679962}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.12229880560999332, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.06615335008372432, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.0769704943117888, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.09891896144203516, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.041793807693149734, "sim_compute_performance-ego": 0.07557806761368462, "sim_compute_robot_state-ego": 0.07805738760077435}}
set_robot_commands_max0.10867216189702351
set_robot_commands_mean0.10051597254352682
set_robot_commands_median0.09891896144203516
set_robot_commands_min0.09292628367741902
sim_compute_performance-ego_max0.08281641656702216
sim_compute_performance-ego_mean0.07479958505292836
sim_compute_performance-ego_median0.07557806761368462
sim_compute_performance-ego_min0.06827812799265687
sim_compute_robot_state-ego_max0.09588909149169922
sim_compute_robot_state-ego_mean0.0809003025356617
sim_compute_robot_state-ego_median0.07805738760077435
sim_compute_robot_state-ego_min0.07049085388720876
sim_compute_sim_state_max0.04201517502466837
sim_compute_sim_state_mean0.04013552975961203
sim_compute_sim_state_median0.040781497955322266
sim_compute_sim_state_min0.03734597689668897
sim_physics_max0.1438872922550548
sim_physics_mean0.12684521824803363
sim_physics_median0.12229880560999332
sim_physics_min0.11241280528861032
sim_render-ego_max0.07304047454487193
sim_render-ego_mean0.06654563249744702
sim_render-ego_median0.06615335008372432
sim_render-ego_min0.05976748802292515
simulation-passed1
survival_time_max3.5499999999999954
survival_time_mean2.469999999999999
survival_time_min1.1000000000000003
210232771Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationsuccessno8430:26:13(hidden)
driven_lanedir_consec_median0.8051142638844548
survival_time_median5.449999999999989
deviation-center-line_median0.5808189309647263
in-drivable-lane_median0


other stats
agent_compute-ego_max0.11633856659350188
agent_compute-ego_mean0.11359653609567552
agent_compute-ego_median0.11376319002749316
agent_compute-ego_min0.11034358750789536
deviation-center-line_max0.9951497579123628
deviation-center-line_mean0.6043209120988936
deviation-center-line_min0.3255459793589536
deviation-heading_max6.538492724279429
deviation-heading_mean2.7726950621118536
deviation-heading_median0.945155952310194
deviation-heading_min0.5270819532137857
driven_any_max2.348865309166556
driven_any_mean1.336549046098488
driven_any_median0.8222547022109343
driven_any_min0.4847484533683435
driven_lanedir_consec_max1.4848849597959752
driven_lanedir_consec_mean0.8929172821524283
driven_lanedir_consec_min0.4756369339491142
driven_lanedir_max1.9736424934854833
driven_lanedir_mean1.156989535536715
driven_lanedir_median0.8051142638844548
driven_lanedir_min0.4756369339491142
in-drivable-lane_max1.5000000000000109
in-drivable-lane_mean0.3800000000000033
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3412116495840505, "sim_physics": 0.22656658172607425, "survival_time": 14.950000000000076, "driven_lanedir": 1.8540463418166544, "sim_render-ego": 0.07101928075154622, "in-drivable-lane": 1.5000000000000109, "agent_compute-ego": 0.11352686325709026, "deviation-heading": 5.154590354912233, "set_robot_commands": 0.1137361486752828, "deviation-center-line": 0.9951497579123628, "driven_lanedir_consec": 1.022442608584729, "sim_compute_sim_state": 0.04539975563685099, "sim_compute_performance-ego": 0.07992603858311971, "sim_compute_robot_state-ego": 0.09202129999796547, "sim_compute_robot_state-npc0": 0.07884116172790527, "sim_compute_robot_state-npc1": 0.0792393167813619, "sim_compute_robot_state-npc2": 0.08188267389933268, "sim_compute_robot_state-npc3": 0.07984910249710082}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.348865309166556, "sim_physics": 0.2178173311551412, "survival_time": 14.950000000000076, "driven_lanedir": 1.9736424934854833, "sim_render-ego": 0.07175499677658081, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.11401047309239704, "deviation-heading": 6.538492724279429, "set_robot_commands": 0.1142226791381836, "deviation-center-line": 0.7335845588356761, "driven_lanedir_consec": 1.4848849597959752, "sim_compute_sim_state": 0.044372539520263675, "sim_compute_performance-ego": 0.08344502369562785, "sim_compute_robot_state-ego": 0.09173165321350098, "sim_compute_robot_state-npc0": 0.0796126397450765, "sim_compute_robot_state-npc1": 0.08005479256312052, "sim_compute_robot_state-npc2": 0.07984672625859579, "sim_compute_robot_state-npc3": 0.07868810415267945}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8222547022109343, "sim_physics": 0.22658751645219435, "survival_time": 5.449999999999989, "driven_lanedir": 0.8051142638844548, "sim_render-ego": 0.07112643040648294, "in-drivable-lane": 0, "agent_compute-ego": 0.11034358750789536, "deviation-heading": 0.945155952310194, "set_robot_commands": 0.10770459131363334, "deviation-center-line": 0.5808189309647263, "driven_lanedir_consec": 0.8051142638844548, "sim_compute_sim_state": 0.04468498754938808, "sim_compute_performance-ego": 0.07968209642882741, "sim_compute_robot_state-ego": 0.09579328878210223, "sim_compute_robot_state-npc0": 0.07823426789100017, "sim_compute_robot_state-npc1": 0.07875919123308374, "sim_compute_robot_state-npc2": 0.08062128408239522, "sim_compute_robot_state-npc3": 0.07861850239814969}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4847484533683435, "sim_physics": 0.23204700982392723, "survival_time": 3.349999999999996, "driven_lanedir": 0.4756369339491142, "sim_render-ego": 0.072283260857881, "in-drivable-lane": 0, "agent_compute-ego": 0.11376319002749316, "deviation-heading": 0.5270819532137857, "set_robot_commands": 0.11367123162568506, "deviation-center-line": 0.3255459793589536, "driven_lanedir_consec": 0.4756369339491142, "sim_compute_sim_state": 0.04453133113348662, "sim_compute_performance-ego": 0.07882930983358355, "sim_compute_robot_state-ego": 0.08811656396780441, "sim_compute_robot_state-npc0": 0.0798670071274487, "sim_compute_robot_state-npc1": 0.0797706753460329, "sim_compute_robot_state-npc2": 0.07860733857795374, "sim_compute_robot_state-npc3": 0.07964965834546445}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6856651161625565, "sim_physics": 0.20587443268817404, "survival_time": 4.599999999999992, "driven_lanedir": 0.6765076445478682, "sim_render-ego": 0.07231656105622002, "in-drivable-lane": 0, "agent_compute-ego": 0.11633856659350188, "deviation-heading": 0.6981543258436246, "set_robot_commands": 0.115789999132571, "deviation-center-line": 0.3865053334227497, "driven_lanedir_consec": 0.6765076445478682, "sim_compute_sim_state": 0.044847545416458794, "sim_compute_performance-ego": 0.07994494749152142, "sim_compute_robot_state-ego": 0.09214671539223712, "sim_compute_robot_state-npc0": 0.07710345413373865, "sim_compute_robot_state-npc1": 0.07867971192235532, "sim_compute_robot_state-npc2": 0.08196847076001375, "sim_compute_robot_state-npc3": 0.082059093143629}}
set_robot_commands_max0.115789999132571
set_robot_commands_mean0.11302492997707116
set_robot_commands_median0.1137361486752828
set_robot_commands_min0.10770459131363334
sim_compute_performance-ego_max0.08344502369562785
sim_compute_performance-ego_mean0.080365483206536
sim_compute_performance-ego_median0.07992603858311971
sim_compute_performance-ego_min0.07882930983358355
sim_compute_robot_state-ego_max0.09579328878210223
sim_compute_robot_state-ego_mean0.09196190427072204
sim_compute_robot_state-ego_median0.09202129999796547
sim_compute_robot_state-ego_min0.08811656396780441
sim_compute_robot_state-npc0_max0.0798670071274487
sim_compute_robot_state-npc0_mean0.07873170612503386
sim_compute_robot_state-npc0_median0.07884116172790527
sim_compute_robot_state-npc0_min0.07710345413373865
sim_compute_robot_state-npc1_max0.08005479256312052
sim_compute_robot_state-npc1_mean0.07930073756919087
sim_compute_robot_state-npc1_median0.0792393167813619
sim_compute_robot_state-npc1_min0.07867971192235532
sim_compute_robot_state-npc2_max0.08196847076001375
sim_compute_robot_state-npc2_mean0.08058529871565824
sim_compute_robot_state-npc2_median0.08062128408239522
sim_compute_robot_state-npc2_min0.07860733857795374
sim_compute_robot_state-npc3_max0.082059093143629
sim_compute_robot_state-npc3_mean0.07977289210740468
sim_compute_robot_state-npc3_median0.07964965834546445
sim_compute_robot_state-npc3_min0.07861850239814969
sim_compute_sim_state_max0.04539975563685099
sim_compute_sim_state_mean0.044767231851289634
sim_compute_sim_state_median0.04468498754938808
sim_compute_sim_state_min0.044372539520263675
sim_physics_max0.23204700982392723
sim_physics_mean0.22177857436910223
sim_physics_median0.22656658172607425
sim_physics_min0.20587443268817404
sim_render-ego_max0.07231656105622002
sim_render-ego_mean0.0717001059697422
sim_render-ego_median0.07175499677658081
sim_render-ego_min0.07101928075154622
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.660000000000027
survival_time_min3.349999999999996
210182783RamiNaimchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationerrorno8430:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
210032792RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationfailedno8430:03:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
209742856AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessno8430:35:12(hidden)
driven_lanedir_consec_median0.3581949699453477
survival_time_median5.14999999999999
deviation-center-line_median0.2084327403075257
in-drivable-lane_median0.6499999999999977


other stats
agent_compute-ego_max0.11513806819915771
agent_compute-ego_mean0.1001170235276804
agent_compute-ego_median0.10077890555063884
agent_compute-ego_min0.08048064368111747
deviation-center-line_max0.36609129635569554
deviation-center-line_mean0.20295455267023035
deviation-center-line_min0.07972249000428101
deviation-heading_max2.4331134830690715
deviation-heading_mean1.651392143336207
deviation-heading_median1.6898654544228242
deviation-heading_min1.0404799375124676
driven_any_max1.17453677627779
driven_any_mean0.5643544839993915
driven_any_median0.3870265153191234
driven_any_min0.14192336510540687
driven_lanedir_consec_max0.5113036954330585
driven_lanedir_consec_mean0.33094291353871425
driven_lanedir_consec_min0.10623165239140409
driven_lanedir_max0.5113036954330585
driven_lanedir_mean0.33094291353871425
driven_lanedir_median0.3581949699453477
driven_lanedir_min0.10623165239140409
in-drivable-lane_max7.950000000000094
in-drivable-lane_mean2.350000000000024
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1707185139081682, "sim_physics": 0.12689630587895712, "survival_time": 14.950000000000076, "driven_lanedir": 0.5113036954330585, "sim_render-ego": 0.06970129569371541, "in-drivable-lane": 7.700000000000095, "agent_compute-ego": 0.11513806819915771, "deviation-heading": 1.7870491119677296, "set_robot_commands": 0.11045352617899576, "deviation-center-line": 0.2742403391197186, "driven_lanedir_consec": 0.5113036954330585, "sim_compute_sim_state": 0.0433549698193868, "sim_compute_performance-ego": 0.07765308856964111, "sim_compute_robot_state-ego": 0.08617831071217855}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.21021321815663324, "sim_physics": 0.09865514302657824, "survival_time": 2.9499999999999975, "driven_lanedir": 0.11238021629225392, "sim_render-ego": 0.059727398015685, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.09791663137532897, "deviation-heading": 1.330578524267241, "set_robot_commands": 0.0950013176869538, "deviation-center-line": 0.08230261744605692, "driven_lanedir_consec": 0.11238021629225392, "sim_compute_sim_state": 0.03915478415408377, "sim_compute_performance-ego": 0.06893865132735948, "sim_compute_robot_state-ego": 0.0776512016684322}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14192336510540687, "sim_physics": 0.0853828475588844, "survival_time": 2.1000000000000005, "driven_lanedir": 0.11613903153538274, "sim_render-ego": 0.04553328241620745, "in-drivable-lane": 0, "agent_compute-ego": 0.08048064368111747, "deviation-heading": 1.0404799375124676, "set_robot_commands": 0.07462407861437116, "deviation-center-line": 0.20332610629981135, "driven_lanedir_consec": 0.11613903153538274, "sim_compute_sim_state": 0.03344127677735828, "sim_compute_performance-ego": 0.052456078075227286, "sim_compute_robot_state-ego": 0.05604923906780425}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5477429518756478, "sim_physics": 0.1157023289820531, "survival_time": 7.149999999999983, "driven_lanedir": 0.4807143964063374, "sim_render-ego": 0.06113336303017356, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.10175171598687872, "deviation-heading": 2.039336227550392, "set_robot_commands": 0.09579975454957336, "deviation-center-line": 0.22455249635290225, "driven_lanedir_consec": 0.4807143964063374, "sim_compute_sim_state": 0.03869704433254429, "sim_compute_performance-ego": 0.0680650314251026, "sim_compute_robot_state-ego": 0.07445341723782199}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.539700175382884, "sim_physics": 0.09554641466614204, "survival_time": 7.049999999999983, "driven_lanedir": 0.4430532861735075, "sim_render-ego": 0.05552109420722258, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.09275862511168136, "deviation-heading": 1.6898654544228242, "set_robot_commands": 0.08161824645725548, "deviation-center-line": 0.2009608928383967, "driven_lanedir_consec": 0.4430532861735075, "sim_compute_sim_state": 0.03584526447539634, "sim_compute_performance-ego": 0.06055902082023891, "sim_compute_robot_state-ego": 0.06275337131310862}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.358881432506834, "sim_physics": 0.12012283752361934, "survival_time": 4.799999999999991, "driven_lanedir": 0.24996581983127353, "sim_render-ego": 0.0654250979423523, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.1061173900961876, "deviation-heading": 1.726371760301949, "set_robot_commands": 0.10323209315538406, "deviation-center-line": 0.2084327403075257, "driven_lanedir_consec": 0.24996581983127353, "sim_compute_sim_state": 0.03982158501942953, "sim_compute_performance-ego": 0.0717134674390157, "sim_compute_robot_state-ego": 0.07901836186647415}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.17453677627779, "sim_physics": 0.11441794157028198, "survival_time": 14.950000000000076, "driven_lanedir": 0.48088566591954773, "sim_render-ego": 0.061637837092081704, "in-drivable-lane": 7.950000000000094, "agent_compute-ego": 0.10258583068847656, "deviation-heading": 1.9847456966991743, "set_robot_commands": 0.0962846565246582, "deviation-center-line": 0.24382890559608433, "driven_lanedir_consec": 0.48088566591954773, "sim_compute_sim_state": 0.03963606595993042, "sim_compute_performance-ego": 0.07028235912322998, "sim_compute_robot_state-ego": 0.07464788993199667}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.20621359603167877, "sim_physics": 0.11314811377689755, "survival_time": 2.8999999999999977, "driven_lanedir": 0.18543448638799864, "sim_render-ego": 0.06497338722492087, "in-drivable-lane": 0, "agent_compute-ego": 0.10325507871035872, "deviation-heading": 1.0465207616495278, "set_robot_commands": 0.1056834048238294, "deviation-center-line": 0.27193111592444685, "driven_lanedir_consec": 0.18543448638799864, "sim_compute_sim_state": 0.04310392922368543, "sim_compute_performance-ego": 0.07381112822170915, "sim_compute_robot_state-ego": 0.08073200850651183}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.31870047767432663, "sim_physics": 0.11380684652993846, "survival_time": 4.299999999999993, "driven_lanedir": 0.2164196801561724, "sim_render-ego": 0.06417983077293218, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.09849852739378465, "deviation-heading": 1.47345272188792, "set_robot_commands": 0.1008556693099266, "deviation-center-line": 0.07972249000428101, "driven_lanedir_consec": 0.2164196801561724, "sim_compute_sim_state": 0.04041177172993505, "sim_compute_performance-ego": 0.07032502252002094, "sim_compute_robot_state-ego": 0.07460545939068462}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.174532551451532, "sim_physics": 0.1201076078414917, "survival_time": 14.950000000000076, "driven_lanedir": 0.4840820387577538, "sim_render-ego": 0.06145534197489421, "in-drivable-lane": 7.700000000000095, "agent_compute-ego": 0.10077890555063884, "deviation-heading": 2.4331134830690715, "set_robot_commands": 0.09420366764068604, "deviation-center-line": 0.20871812505779327, "driven_lanedir_consec": 0.4840820387577538, "sim_compute_sim_state": 0.038951122760772706, "sim_compute_performance-ego": 0.06773035526275635, "sim_compute_robot_state-ego": 0.07400815407435099}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.5276520830396947, "sim_physics": 0.11486936652142068, "survival_time": 6.8999999999999835, "driven_lanedir": 0.45190314325713365, "sim_render-ego": 0.06603879859482033, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.10702788829803468, "deviation-heading": 1.9731664965566111, "set_robot_commands": 0.10217772532200468, "deviation-center-line": 0.1908756891499077, "driven_lanedir_consec": 0.45190314325713365, "sim_compute_sim_state": 0.04178316005762073, "sim_compute_performance-ego": 0.07514160612355107, "sim_compute_robot_state-ego": 0.08221308735833652}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.174534147585338, "sim_physics": 0.1168354074160258, "survival_time": 14.950000000000076, "driven_lanedir": 0.5108436365186972, "sim_render-ego": 0.06309922695159913, "in-drivable-lane": 7.750000000000095, "agent_compute-ego": 0.10137202819188436, "deviation-heading": 1.7500602038902686, "set_robot_commands": 0.09546299934387208, "deviation-center-line": 0.2962803265156284, "driven_lanedir_consec": 0.5108436365186972, "sim_compute_sim_state": 0.039906546274820966, "sim_compute_performance-ego": 0.07227645715077718, "sim_compute_robot_state-ego": 0.07539681434631347}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.21021421077048788, "sim_physics": 0.10446296708058504, "survival_time": 2.9499999999999975, "driven_lanedir": 0.10623165239140409, "sim_render-ego": 0.05926477707038492, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.0941256830247782, "deviation-heading": 1.3980013240669922, "set_robot_commands": 0.09929977029056872, "deviation-center-line": 0.09253526703526956, "driven_lanedir_consec": 0.10623165239140409, "sim_compute_sim_state": 0.038349551669621874, "sim_compute_performance-ego": 0.06724806559287895, "sim_compute_robot_state-ego": 0.07177103980112884}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3227272449053274, "sim_physics": 0.11657965868368916, "survival_time": 4.3499999999999925, "driven_lanedir": 0.2565919840748454, "sim_render-ego": 0.06023160890601147, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.09937863240296814, "deviation-heading": 1.5457389209302446, "set_robot_commands": 0.0965188536150702, "deviation-center-line": 0.1005198820499375, "driven_lanedir_consec": 0.2565919840748454, "sim_compute_sim_state": 0.03972476104210163, "sim_compute_performance-ego": 0.06982499977637982, "sim_compute_robot_state-ego": 0.07368188068784516}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.3870265153191234, "sim_physics": 0.11398442972053602, "survival_time": 5.14999999999999, "driven_lanedir": 0.3581949699453477, "sim_render-ego": 0.06074175325412195, "in-drivable-lane": 0, "agent_compute-ego": 0.10056970420392972, "deviation-heading": 1.5524015252706942, "set_robot_commands": 0.0991276051234273, "deviation-center-line": 0.36609129635569554, "driven_lanedir_consec": 0.3581949699453477, "sim_compute_sim_state": 0.040602839108809685, "sim_compute_performance-ego": 0.06911040509788735, "sim_compute_robot_state-ego": 0.0729380857597277}}
set_robot_commands_max0.11045352617899576
set_robot_commands_mean0.09668955790910512
set_robot_commands_median0.0965188536150702
set_robot_commands_min0.07462407861437116
sim_compute_performance-ego_max0.07765308856964111
sim_compute_performance-ego_mean0.06900904910171839
sim_compute_performance-ego_median0.06982499977637982
sim_compute_performance-ego_min0.052456078075227286
sim_compute_robot_state-ego_max0.08617831071217855
sim_compute_robot_state-ego_mean0.0744065547815144
sim_compute_robot_state-ego_median0.07460545939068462
sim_compute_robot_state-ego_min0.05604923906780425
sim_compute_sim_state_max0.0433549698193868
sim_compute_sim_state_mean0.03951897816036651
sim_compute_sim_state_median0.03972476104210163
sim_compute_sim_state_min0.03344127677735828
sim_physics_max0.12689630587895712
sim_physics_mean0.11136788111847336
sim_physics_median0.11441794157028198
sim_physics_min0.0853828475588844
sim_render-ego_max0.06970129569371541
sim_render-ego_mean0.06124427287647486
sim_render-ego_median0.06145534197489421
sim_render-ego_min0.04553328241620745
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.3600000000000145
survival_time_min2.1000000000000005
209652868almasipBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessno8430:22:00(hidden)
driven_lanedir_consec_median0.6618321953718848
survival_time_median2.799999999999998
deviation-center-line_median0.1539069600685497
in-drivable-lane_median0.5


other stats
agent_compute-ego_max0.20023295126463236
agent_compute-ego_mean0.18107487261399863
agent_compute-ego_median0.18107648690541583
agent_compute-ego_min0.16275385898702285
deviation-center-line_max0.33876816302538065
deviation-center-line_mean0.16480398817009012
deviation-center-line_min0.08803040147239628
deviation-heading_max3.169028366658603
deviation-heading_mean1.0134985334661182
deviation-heading_median0.8894633572639655
deviation-heading_min0.17109644157637127
driven_any_max2.4991996168646855
driven_any_mean1.3550276410622764
driven_any_median1.2450683356136338
driven_any_min0.6304669082956122
driven_lanedir_consec_max1.178888444815321
driven_lanedir_consec_mean0.729157446337953
driven_lanedir_consec_min0.27748449636054673
driven_lanedir_max1.3336725659515851
driven_lanedir_mean0.8106651393853994
driven_lanedir_median0.7683340572351427
driven_lanedir_min0.34557102311065613
in-drivable-lane_max2.149999999999995
in-drivable-lane_mean0.7366666666666654
in-drivable-lane_min0.10000000000000007
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0468094694549512, "sim_physics": 0.1333758451721885, "survival_time": 2.2, "driven_lanedir": 0.6017107443817986, "sim_render-ego": 0.06812060963023793, "in-drivable-lane": 0.7999999999999996, "agent_compute-ego": 0.18534380197525024, "deviation-heading": 0.17109644157637127, "set_robot_commands": 0.09720329262993552, "deviation-center-line": 0.1260734574240712, "driven_lanedir_consec": 0.6017107443817986, "sim_compute_sim_state": 0.04023149338635531, "sim_compute_performance-ego": 0.07625832340934059, "sim_compute_robot_state-ego": 0.08472749861803922}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5976666553638803, "sim_physics": 0.11669362613133022, "survival_time": 3.4999999999999956, "driven_lanedir": 1.1897082042802245, "sim_render-ego": 0.06417696135384696, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.17467100279671804, "deviation-heading": 1.540831380838597, "set_robot_commands": 0.09502672127314976, "deviation-center-line": 0.27830626591106444, "driven_lanedir_consec": 1.1339592810336134, "sim_compute_sim_state": 0.037985648427690775, "sim_compute_performance-ego": 0.06745916434696743, "sim_compute_robot_state-ego": 0.07078158514840262}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6304669082956122, "sim_physics": 0.12040019697613186, "survival_time": 1.800000000000001, "driven_lanedir": 0.34557102311065613, "sim_render-ego": 0.06326509846581353, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.17002956734763253, "deviation-heading": 0.8957859987902634, "set_robot_commands": 0.09279911385642158, "deviation-center-line": 0.11127868186691012, "driven_lanedir_consec": 0.27748449636054673, "sim_compute_sim_state": 0.03673998514811198, "sim_compute_performance-ego": 0.07063384850819905, "sim_compute_robot_state-ego": 0.0761789149708218}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.4991996168646855, "sim_physics": 0.12256118123845536, "survival_time": 6.449999999999985, "driven_lanedir": 1.3336725659515851, "sim_render-ego": 0.06331055848173393, "in-drivable-lane": 1.449999999999996, "agent_compute-ego": 0.18127059382061625, "deviation-heading": 3.169028366658603, "set_robot_commands": 0.09826406952022582, "deviation-center-line": 0.33876816302538065, "driven_lanedir_consec": 0.8330821733490361, "sim_compute_sim_state": 0.04003985353218493, "sim_compute_performance-ego": 0.07030276919520179, "sim_compute_robot_state-ego": 0.07576379110646803}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5172175051035184, "sim_physics": 0.12048929352914134, "survival_time": 3.099999999999997, "driven_lanedir": 0.992271899317832, "sim_render-ego": 0.06289224086269256, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.17894051151890908, "deviation-heading": 0.17709814710669028, "set_robot_commands": 0.0965479689259683, "deviation-center-line": 0.18988211084516624, "driven_lanedir_consec": 0.992271899317832, "sim_compute_sim_state": 0.04202811948714718, "sim_compute_performance-ego": 0.0725511004847865, "sim_compute_robot_state-ego": 0.07613098236822313}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.9522926396557352, "sim_physics": 0.1301970332860947, "survival_time": 3.999999999999994, "driven_lanedir": 0.5050134566469384, "sim_render-ego": 0.06297040283679962, "in-drivable-lane": 2.149999999999995, "agent_compute-ego": 0.18399904072284695, "deviation-heading": 1.1536021275496569, "set_robot_commands": 0.0979436367750168, "deviation-center-line": 0.12638216128899585, "driven_lanedir_consec": 0.5050134566469384, "sim_compute_sim_state": 0.0405597060918808, "sim_compute_performance-ego": 0.06856100261211395, "sim_compute_robot_state-ego": 0.07814750075340271}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.8066306023723698, "sim_physics": 0.14957662005173533, "survival_time": 1.900000000000001, "driven_lanedir": 0.5184081472354793, "sim_render-ego": 0.06290180432169061, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.20023295126463236, "deviation-heading": 0.6081751472934191, "set_robot_commands": 0.10200647303932592, "deviation-center-line": 0.10688912345154727, "driven_lanedir_consec": 0.4996194744690303, "sim_compute_sim_state": 0.0439510094492059, "sim_compute_performance-ego": 0.07364919938539204, "sim_compute_robot_state-ego": 0.08825407530132093}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.8969432832014648, "sim_physics": 0.12132791110447474, "survival_time": 3.8499999999999943, "driven_lanedir": 0.9358470944577976, "sim_render-ego": 0.05926294141001515, "in-drivable-lane": 1.5999999999999972, "agent_compute-ego": 0.18026429027706, "deviation-heading": 0.8894633572639655, "set_robot_commands": 0.09602312917833204, "deviation-center-line": 0.15894873938907766, "driven_lanedir_consec": 0.9358470944577976, "sim_compute_sim_state": 0.04083569947775308, "sim_compute_performance-ego": 0.06748911312648229, "sim_compute_robot_state-ego": 0.07205264599292309}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2450683356136338, "sim_physics": 0.11958414316177368, "survival_time": 2.799999999999998, "driven_lanedir": 0.9552167561361352, "sim_render-ego": 0.06358319095202855, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.18016423923628672, "deviation-heading": 1.0719702232394532, "set_robot_commands": 0.09852217776434762, "deviation-center-line": 0.17247235932964516, "driven_lanedir_consec": 0.8451894912108902, "sim_compute_sim_state": 0.04299392870494297, "sim_compute_performance-ego": 0.066717015845435, "sim_compute_robot_state-ego": 0.07204238431794303}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.013292588189051, "sim_physics": 0.1184267486844744, "survival_time": 2.1000000000000005, "driven_lanedir": 0.6646171787896209, "sim_render-ego": 0.05788903009323847, "in-drivable-lane": 0.5, "agent_compute-ego": 0.18107648690541583, "deviation-heading": 0.4120201364805494, "set_robot_commands": 0.09629486288343156, "deviation-center-line": 0.09207329369738594, "driven_lanedir_consec": 0.6618321953718848, "sim_compute_sim_state": 0.03741376172928583, "sim_compute_performance-ego": 0.06602245853060767, "sim_compute_robot_state-ego": 0.07130813598632812}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.6527277913110758, "sim_physics": 0.1183324701645795, "survival_time": 3.399999999999996, "driven_lanedir": 1.1907568684718202, "sim_render-ego": 0.05302990885341869, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.16275385898702285, "deviation-heading": 0.4985598628185827, "set_robot_commands": 0.08673663700328153, "deviation-center-line": 0.1539069600685497, "driven_lanedir_consec": 1.178888444815321, "sim_compute_sim_state": 0.03635303763782277, "sim_compute_performance-ego": 0.06119210229200475, "sim_compute_robot_state-ego": 0.06605269628412583}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0064266593015756, "sim_physics": 0.13707490497165256, "survival_time": 2.25, "driven_lanedir": 0.5767937260556738, "sim_render-ego": 0.06266947852240669, "in-drivable-lane": 0.4999999999999995, "agent_compute-ego": 0.1875950601365831, "deviation-heading": 0.7851354650834198, "set_robot_commands": 0.08974924087524414, "deviation-center-line": 0.12242935425238102, "driven_lanedir_consec": 0.5718098333670779, "sim_compute_sim_state": 0.03908514976501465, "sim_compute_performance-ego": 0.06930112308926052, "sim_compute_robot_state-ego": 0.08703225983513727}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.743859854115065, "sim_physics": 0.1278190436186614, "survival_time": 4.049999999999994, "driven_lanedir": 1.2252740218259568, "sim_render-ego": 0.06619475211626218, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.1910247008005778, "deviation-heading": 2.0992789836650534, "set_robot_commands": 0.10287324881847994, "deviation-center-line": 0.23516979219832015, "driven_lanedir_consec": 1.0175542278330163, "sim_compute_sim_state": 0.0419031219717897, "sim_compute_performance-ego": 0.0739074077135251, "sim_compute_robot_state-ego": 0.08166958373269917}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.0462971822798006, "sim_physics": 0.13755502700805664, "survival_time": 2.499999999999999, "driven_lanedir": 0.7683340572351427, "sim_render-ego": 0.06439098834991455, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.18925687789916992, "deviation-heading": 1.2885717860271213, "set_robot_commands": 0.10231482982635498, "deviation-center-line": 0.1714489583304597, "driven_lanedir_consec": 0.529447505368204, "sim_compute_sim_state": 0.040455803871154786, "sim_compute_performance-ego": 0.07295615673065185, "sim_compute_robot_state-ego": 0.08335443019866944}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6705155248117249, "sim_physics": 0.12363819515003878, "survival_time": 1.7000000000000008, "driven_lanedir": 0.3567813468843295, "sim_render-ego": 0.061122494585373825, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1695001055212582, "deviation-heading": 0.4418605776000256, "set_robot_commands": 0.09698684075299432, "deviation-center-line": 0.08803040147239628, "driven_lanedir_consec": 0.3536513770863081, "sim_compute_sim_state": 0.040567755699157715, "sim_compute_performance-ego": 0.06623524778029498, "sim_compute_robot_state-ego": 0.07193930008832146}}
set_robot_commands_max0.10287324881847994
set_robot_commands_mean0.096619482874834
set_robot_commands_median0.09698684075299432
set_robot_commands_min0.08673663700328153
sim_compute_performance-ego_max0.07625832340934059
sim_compute_performance-ego_mean0.06954906887001755
sim_compute_performance-ego_median0.06930112308926052
sim_compute_performance-ego_min0.06119210229200475
sim_compute_robot_state-ego_max0.08825407530132093
sim_compute_robot_state-ego_mean0.07702905231352174
sim_compute_robot_state-ego_median0.07613098236822313
sim_compute_robot_state-ego_min0.06605269628412583
sim_compute_sim_state_max0.0439510094492059
sim_compute_sim_state_mean0.04007627162529989
sim_compute_sim_state_median0.040455803871154786
sim_compute_sim_state_min0.03635303763782277
sim_physics_max0.14957662005173533
sim_physics_mean0.12647014934991926
sim_physics_median0.12256118123845536
sim_physics_min0.11669362613133022
sim_render-ego_max0.06812060963023793
sim_render-ego_mean0.06238536405569821
sim_render-ego_median0.06297040283679962
sim_render-ego_min0.05302990885341869
simulation-passed1
survival_time_max6.449999999999985
survival_time_mean3.039999999999998
survival_time_min1.7000000000000008
209412912duckietown_mumchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationhost-errorno8430:24:36
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2912/step1-simulation-ip-172-31-42-167-7357-job20941/logs/challenges-runner/stdout.log'
(hidden)
209172948Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessno8430:33:51(hidden)
driven_lanedir_consec_median0.06481553712617039
survival_time_median1.6000000000000008
deviation-center-line_median0.08053590386253318
in-drivable-lane_median0.4500000000000004


other stats
agent_compute-ego_max0.18929727615848663
agent_compute-ego_mean0.1644376292033725
agent_compute-ego_median0.16009040439830108
agent_compute-ego_min0.15344068637261024
deviation-center-line_max0.7986806623683785
deviation-center-line_mean0.17971802946020424
deviation-center-line_min0.025758639196128363
deviation-heading_max6.052239721856253
deviation-heading_mean1.732074367672169
deviation-heading_median0.6758109176661168
deviation-heading_min0.6012851139729924
driven_any_max1.757078449678158
driven_any_mean0.4538001271754034
driven_any_median0.15632563756824455
driven_any_min0.09527766237505804
driven_lanedir_consec_max0.6156158615248244
driven_lanedir_consec_mean0.16233288798354242
driven_lanedir_consec_min0.04188700493005726
driven_lanedir_max0.6156158615248244
driven_lanedir_mean0.16233288798354242
driven_lanedir_median0.06481553712617039
driven_lanedir_min0.04188700493005726
in-drivable-lane_max7.650000000000039
in-drivable-lane_mean1.7166666666666734
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.6595498753473366, "sim_physics": 0.16429112593332926, "survival_time": 14.950000000000076, "driven_lanedir": 0.5829868447427584, "sim_render-ego": 0.057361466884613035, "in-drivable-lane": 6.800000000000027, "agent_compute-ego": 0.1556210970878601, "deviation-heading": 6.052239721856253, "set_robot_commands": 0.08798375050226848, "deviation-center-line": 0.6996489108842836, "driven_lanedir_consec": 0.5829868447427584, "sim_compute_sim_state": 0.03631045023600261, "sim_compute_performance-ego": 0.06331748882929485, "sim_compute_robot_state-ego": 0.0684581724802653, "sim_compute_robot_state-npc0": 0.06453133742014568, "sim_compute_robot_state-npc1": 0.063465629418691, "sim_compute_robot_state-npc2": 0.06277633349100749, "sim_compute_robot_state-npc3": 0.0628265905380249}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.757078449678158, "sim_physics": 0.16125000397364295, "survival_time": 14.950000000000076, "driven_lanedir": 0.5118497433661302, "sim_render-ego": 0.06041930516560872, "in-drivable-lane": 7.650000000000039, "agent_compute-ego": 0.1607869855562846, "deviation-heading": 5.93210529647649, "set_robot_commands": 0.09188658714294434, "deviation-center-line": 0.7986806623683785, "driven_lanedir_consec": 0.5118497433661302, "sim_compute_sim_state": 0.0377777361869812, "sim_compute_performance-ego": 0.0678668737411499, "sim_compute_robot_state-ego": 0.0714549700419108, "sim_compute_robot_state-npc0": 0.06824642976125081, "sim_compute_robot_state-npc1": 0.06694263617197672, "sim_compute_robot_state-npc2": 0.06727129936218262, "sim_compute_robot_state-npc3": 0.0683403746287028}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09927131392417624, "sim_physics": 0.18745054801305136, "survival_time": 1.2000000000000004, "driven_lanedir": 0.05817704532029033, "sim_render-ego": 0.05827202399571737, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15966572364171347, "deviation-heading": 0.6459851913949295, "set_robot_commands": 0.08133623003959656, "deviation-center-line": 0.09847253119841116, "driven_lanedir_consec": 0.05817704532029033, "sim_compute_sim_state": 0.03729638457298279, "sim_compute_performance-ego": 0.061439961194992065, "sim_compute_robot_state-ego": 0.07258235414822896, "sim_compute_robot_state-npc0": 0.05641176303227743, "sim_compute_robot_state-npc1": 0.06363168358802795, "sim_compute_robot_state-npc2": 0.063417782386144, "sim_compute_robot_state-npc3": 0.06420780221621196}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.09527766237505804, "sim_physics": 0.20899818340937296, "survival_time": 1.2000000000000004, "driven_lanedir": 0.04739903502737919, "sim_render-ego": 0.06722187995910645, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.18842445810635888, "deviation-heading": 0.6305895418735279, "set_robot_commands": 0.09510867794354756, "deviation-center-line": 0.08695938405747548, "driven_lanedir_consec": 0.04739903502737919, "sim_compute_sim_state": 0.03857185443242391, "sim_compute_performance-ego": 0.07031347354253133, "sim_compute_robot_state-ego": 0.08252933621406555, "sim_compute_robot_state-npc0": 0.10826231042544048, "sim_compute_robot_state-npc1": 0.06777151425679524, "sim_compute_robot_state-npc2": 0.06486206253369649, "sim_compute_robot_state-npc3": 0.0666106641292572}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15632563756824455, "sim_physics": 0.1584007740020752, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06013919488479624, "sim_render-ego": 0.06359090010325114, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1649387836456299, "deviation-heading": 0.7928984796735065, "set_robot_commands": 0.09008013407389324, "deviation-center-line": 0.04252712694956964, "driven_lanedir_consec": 0.06013919488479624, "sim_compute_sim_state": 0.03414951165517171, "sim_compute_performance-ego": 0.06653377215067545, "sim_compute_robot_state-ego": 0.0695821205774943, "sim_compute_robot_state-npc0": 0.07268795172373453, "sim_compute_robot_state-npc1": 0.06445353825887044, "sim_compute_robot_state-npc2": 0.06502546469370524, "sim_compute_robot_state-npc3": 0.06909305254618327}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.693640022206611, "sim_physics": 0.16750123262405395, "survival_time": 14.950000000000076, "driven_lanedir": 0.6156158615248244, "sim_render-ego": 0.05892645438512167, "in-drivable-lane": 6.850000000000033, "agent_compute-ego": 0.16424763917922974, "deviation-heading": 5.904144285652466, "set_robot_commands": 0.09224626302719116, "deviation-center-line": 0.4325592402773382, "driven_lanedir_consec": 0.6156158615248244, "sim_compute_sim_state": 0.03698911190032959, "sim_compute_performance-ego": 0.06665172417958577, "sim_compute_robot_state-ego": 0.07210466066996256, "sim_compute_robot_state-npc0": 0.06670098543167115, "sim_compute_robot_state-npc1": 0.06786844650904338, "sim_compute_robot_state-npc2": 0.0653201691309611, "sim_compute_robot_state-npc3": 0.06491451660792033}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.11942613073422918, "sim_physics": 0.18210075451777533, "survival_time": 1.3000000000000005, "driven_lanedir": 0.06481553712617039, "sim_render-ego": 0.05924355983734131, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15344068637261024, "deviation-heading": 0.6503807351360573, "set_robot_commands": 0.09508889455061692, "deviation-center-line": 0.07502324503973785, "driven_lanedir_consec": 0.06481553712617039, "sim_compute_sim_state": 0.037120929131141074, "sim_compute_performance-ego": 0.06584718594184288, "sim_compute_robot_state-ego": 0.07033398518195519, "sim_compute_robot_state-npc0": 0.06711895649249737, "sim_compute_robot_state-npc1": 0.0680236999805157, "sim_compute_robot_state-npc2": 0.06919794816237229, "sim_compute_robot_state-npc3": 0.06637866680438702}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.14995924614593897, "sim_physics": 0.2080952659729988, "survival_time": 1.5500000000000007, "driven_lanedir": 0.08509676720036063, "sim_render-ego": 0.07166978620713757, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.18929727615848663, "deviation-heading": 0.6258454103811075, "set_robot_commands": 0.0984033461539976, "deviation-center-line": 0.0839074818395644, "driven_lanedir_consec": 0.08509676720036063, "sim_compute_sim_state": 0.03733797227182696, "sim_compute_performance-ego": 0.07414014877811555, "sim_compute_robot_state-ego": 0.07684820698153588, "sim_compute_robot_state-npc0": 0.07384800141857516, "sim_compute_robot_state-npc1": 0.0738211908648091, "sim_compute_robot_state-npc2": 0.07362407253634545, "sim_compute_robot_state-npc3": 0.0715084768110706}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.18707780959653236, "sim_physics": 0.17578075383160566, "survival_time": 1.850000000000001, "driven_lanedir": 0.0732936044711896, "sim_render-ego": 0.06102698558085674, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.15971587799690865, "deviation-heading": 0.6914397861499748, "set_robot_commands": 0.09369566633894635, "deviation-center-line": 0.0292885267833539, "driven_lanedir_consec": 0.0732936044711896, "sim_compute_sim_state": 0.03645200987119932, "sim_compute_performance-ego": 0.06627299978926375, "sim_compute_robot_state-ego": 0.07351957140742121, "sim_compute_robot_state-npc0": 0.0677844898120777, "sim_compute_robot_state-npc1": 0.0649556727022738, "sim_compute_robot_state-npc2": 0.06448165146080223, "sim_compute_robot_state-npc3": 0.06586719848014214}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1735994713764654, "sim_physics": 0.17584635229671702, "survival_time": 1.7000000000000008, "driven_lanedir": 0.04742463041065603, "sim_render-ego": 0.06507856004378375, "in-drivable-lane": 0.7500000000000006, "agent_compute-ego": 0.16962327676660874, "deviation-heading": 0.6430169211583546, "set_robot_commands": 0.0937200153575224, "deviation-center-line": 0.026977474889226676, "driven_lanedir_consec": 0.04742463041065603, "sim_compute_sim_state": 0.036986645530251896, "sim_compute_performance-ego": 0.07344323747298297, "sim_compute_robot_state-ego": 0.07827916566063375, "sim_compute_robot_state-npc0": 0.07122137967277975, "sim_compute_robot_state-npc1": 0.07081244272344253, "sim_compute_robot_state-npc2": 0.06765982683967142, "sim_compute_robot_state-npc3": 0.06750111720141243}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.15208197713548166, "sim_physics": 0.17977002263069153, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04188700493005726, "sim_render-ego": 0.06070402264595032, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.15376143902540207, "deviation-heading": 0.748046304025355, "set_robot_commands": 0.08966068178415298, "deviation-center-line": 0.025758639196128363, "driven_lanedir_consec": 0.04188700493005726, "sim_compute_sim_state": 0.03692294657230377, "sim_compute_performance-ego": 0.06671988219022751, "sim_compute_robot_state-ego": 0.06660931557416916, "sim_compute_robot_state-npc0": 0.06386034935712814, "sim_compute_robot_state-npc1": 0.06154506653547287, "sim_compute_robot_state-npc2": 0.06312277913093567, "sim_compute_robot_state-npc3": 0.06149169057607651}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.09678849122717076, "sim_physics": 0.16304415464401245, "survival_time": 1.2000000000000004, "driven_lanedir": 0.047711499008281866, "sim_render-ego": 0.060817062854766846, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.17243204514185587, "deviation-heading": 0.6012851139729924, "set_robot_commands": 0.09780473510424297, "deviation-center-line": 0.08053590386253318, "driven_lanedir_consec": 0.047711499008281866, "sim_compute_sim_state": 0.03821874658266703, "sim_compute_performance-ego": 0.06685907642046611, "sim_compute_robot_state-ego": 0.07253339886665344, "sim_compute_robot_state-npc0": 0.0696623722712199, "sim_compute_robot_state-npc1": 0.07015801469484965, "sim_compute_robot_state-npc2": 0.06594756245613098, "sim_compute_robot_state-npc3": 0.06452138225237529}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.2038146161237436, "sim_physics": 0.16495829093747022, "survival_time": 2.0500000000000007, "driven_lanedir": 0.06648992496691108, "sim_render-ego": 0.057670587446631456, "in-drivable-lane": 0.8000000000000003, "agent_compute-ego": 0.15501721312360064, "deviation-heading": 0.7148369409772203, "set_robot_commands": 0.08602174898473228, "deviation-center-line": 0.06434703655678954, "driven_lanedir_consec": 0.06648992496691108, "sim_compute_sim_state": 0.03628352793251595, "sim_compute_performance-ego": 0.06219751660416766, "sim_compute_robot_state-ego": 0.06533288374179747, "sim_compute_robot_state-npc0": 0.06436554397024759, "sim_compute_robot_state-npc1": 0.06193810555993057, "sim_compute_robot_state-npc2": 0.06538067794427639, "sim_compute_robot_state-npc3": 0.06349419965976622}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.10142299287014674, "sim_physics": 0.17874651369841202, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05548765935886468, "sim_render-ego": 0.058134939359581986, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15950153184973676, "deviation-heading": 0.6724908686881838, "set_robot_commands": 0.08791869619618291, "deviation-center-line": 0.0830789755667409, "driven_lanedir_consec": 0.05548765935886468, "sim_compute_sim_state": 0.03738846986190132, "sim_compute_performance-ego": 0.06894000716831374, "sim_compute_robot_state-ego": 0.06981244294539742, "sim_compute_robot_state-npc0": 0.06597391418788744, "sim_compute_robot_state-npc1": 0.06148063618203868, "sim_compute_robot_state-npc2": 0.060370497081590736, "sim_compute_robot_state-npc3": 0.0638261256010636}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1616882113217577, "sim_physics": 0.16675789917216582, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07661896741446572, "sim_render-ego": 0.06011756728677189, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.16009040439830108, "deviation-heading": 0.6758109176661168, "set_robot_commands": 0.09075436171363382, "deviation-center-line": 0.0680053024335324, "driven_lanedir_consec": 0.07661896741446572, "sim_compute_sim_state": 0.03646157769595876, "sim_compute_performance-ego": 0.06765529688666849, "sim_compute_robot_state-ego": 0.07033402779523064, "sim_compute_robot_state-npc0": 0.06554879160488353, "sim_compute_robot_state-npc1": 0.06768021864049575, "sim_compute_robot_state-npc2": 0.0776597962659948, "sim_compute_robot_state-npc3": 0.06729046737446505}}
set_robot_commands_max0.0984033461539976
set_robot_commands_mean0.09144731926089798
set_robot_commands_median0.09188658714294434
set_robot_commands_min0.08133623003959656
sim_compute_performance-ego_max0.07414014877811555
sim_compute_performance-ego_mean0.06721324299268519
sim_compute_performance-ego_median0.06671988219022751
sim_compute_performance-ego_min0.061439961194992065
sim_compute_robot_state-ego_max0.08252933621406555
sim_compute_robot_state-ego_mean0.0720209741524481
sim_compute_robot_state-ego_median0.0714549700419108
sim_compute_robot_state-ego_min0.06533288374179747
sim_compute_robot_state-npc0_max0.10826231042544048
sim_compute_robot_state-npc0_mean0.06974830510545445
sim_compute_robot_state-npc0_median0.06711895649249737
sim_compute_robot_state-npc0_min0.05641176303227743
sim_compute_robot_state-npc1_max0.0738211908648091
sim_compute_robot_state-npc1_mean0.06630323307248222
sim_compute_robot_state-npc1_median0.06694263617197672
sim_compute_robot_state-npc1_min0.06148063618203868
sim_compute_robot_state-npc2_max0.0776597962659948
sim_compute_robot_state-npc2_mean0.06640786156505446
sim_compute_robot_state-npc2_median0.0653201691309611
sim_compute_robot_state-npc2_min0.060370497081590736
sim_compute_robot_state-npc3_max0.0715084768110706
sim_compute_robot_state-npc3_mean0.06585815502847062
sim_compute_robot_state-npc3_median0.06586719848014214
sim_compute_robot_state-npc3_min0.06149169057607651
sim_compute_sim_state_max0.03857185443242391
sim_compute_sim_state_mean0.036951191628910536
sim_compute_sim_state_median0.03698911190032959
sim_compute_sim_state_min0.03414951165517171
sim_physics_max0.20899818340937296
sim_physics_mean0.1761994583771583
sim_physics_median0.17578075383160566
sim_physics_min0.1584007740020752
sim_render-ego_max0.07166978620713757
sim_render-ego_mean0.06135034011708269
sim_render-ego_median0.06041930516560872
sim_render-ego_min0.057361466884613035
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean4.190000000000016
survival_time_min1.1500000000000004
209052960Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-testingstep1-simulationhost-errorno8430:03:30
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2960/step1-simulation-ip-172-31-42-167-7357-job20905/logs/challenges-runner/stdout.log'
(hidden)
208603064awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationsuccessno8430:55:40(hidden)
driven_lanedir_consec_median0.6523240082563025
survival_time_median12.650000000000045
deviation-center-line_median0.5953043214119251
in-drivable-lane_median0


other stats
agent_compute-ego_max0.26157378399465964
agent_compute-ego_mean0.20814646252113456
agent_compute-ego_median0.2106568916638692
agent_compute-ego_min0.16425865809122722
deviation-center-line_max1.2171177182330184
deviation-center-line_mean0.6907259034506872
deviation-center-line_min0.4045264267617618
deviation-heading_max3.5560693107984767
deviation-heading_mean1.7270421867244328
deviation-heading_median1.7980735870244908
deviation-heading_min0.16792099924859266
driven_any_max1.219699516636652
driven_any_mean0.8879355368571517
driven_any_median0.9956764758809086
driven_any_min0.271780030825251
driven_lanedir_consec_max1.2170036305209848
driven_lanedir_consec_mean0.7659108050549978
driven_lanedir_consec_min0.26504279849886814
driven_lanedir_max1.2170036305209848
driven_lanedir_mean0.7659108050549978
driven_lanedir_median0.6523240082563025
driven_lanedir_min0.26504279849886814
in-drivable-lane_max4.350000000000062
in-drivable-lane_mean1.113333333333349
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0182088072267623, "sim_physics": 0.1396547283713273, "survival_time": 12.700000000000044, "driven_lanedir": 0.6638163524254224, "sim_render-ego": 0.07195449157023993, "in-drivable-lane": 3.2000000000000455, "agent_compute-ego": 0.26157378399465964, "deviation-heading": 3.5560693107984767, "set_robot_commands": 0.11570402299325296, "deviation-center-line": 0.5485266957093649, "driven_lanedir_consec": 0.6638163524254224, "sim_compute_sim_state": 0.04591660799942617, "sim_compute_performance-ego": 0.08132659262559545, "sim_compute_robot_state-ego": 0.08697716082174947}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9993417829299396, "sim_physics": 0.1170262834057212, "survival_time": 12.800000000000049, "driven_lanedir": 0.8368606887654501, "sim_render-ego": 0.06137991324067116, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.2233696011826396, "deviation-heading": 2.7869759774508465, "set_robot_commands": 0.09760731551796198, "deviation-center-line": 0.8146350958289812, "driven_lanedir_consec": 0.8368606887654501, "sim_compute_sim_state": 0.03939247038215399, "sim_compute_performance-ego": 0.06894868053495884, "sim_compute_robot_state-ego": 0.07409333623945713}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.271780030825251, "sim_physics": 0.10517922607628076, "survival_time": 3.699999999999995, "driven_lanedir": 0.26504279849886814, "sim_render-ego": 0.05754020729580441, "in-drivable-lane": 0, "agent_compute-ego": 0.19839380238507243, "deviation-heading": 0.8179445990514, "set_robot_commands": 0.08908518907186147, "deviation-center-line": 0.4045264267617618, "driven_lanedir_consec": 0.26504279849886814, "sim_compute_sim_state": 0.03735714345364957, "sim_compute_performance-ego": 0.06460251034917058, "sim_compute_robot_state-ego": 0.06899631023406982}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4684384601869749, "sim_physics": 0.10502446387424942, "survival_time": 6.0499999999999865, "driven_lanedir": 0.4477531320405155, "sim_render-ego": 0.05852276628667658, "in-drivable-lane": 0, "agent_compute-ego": 0.2008962434185438, "deviation-heading": 1.7980735870244908, "set_robot_commands": 0.08639988820414898, "deviation-center-line": 0.44966413762168134, "driven_lanedir_consec": 0.4477531320405155, "sim_compute_sim_state": 0.035696096656736266, "sim_compute_performance-ego": 0.06808819455548751, "sim_compute_robot_state-ego": 0.06851027622695796}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2027844297639856, "sim_physics": 0.10803059260050456, "survival_time": 14.950000000000076, "driven_lanedir": 1.177837187361293, "sim_render-ego": 0.06242657820383707, "in-drivable-lane": 0, "agent_compute-ego": 0.2172111988067627, "deviation-heading": 1.8112094121737237, "set_robot_commands": 0.09331000407536824, "deviation-center-line": 0.7353624172432771, "driven_lanedir_consec": 1.177837187361293, "sim_compute_sim_state": 0.0390433939297994, "sim_compute_performance-ego": 0.06800866921742757, "sim_compute_robot_state-ego": 0.07359510024388631}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4810419481852173, "sim_physics": 0.10395874295915876, "survival_time": 6.299999999999986, "driven_lanedir": 0.4578426505439186, "sim_render-ego": 0.05609900800008622, "in-drivable-lane": 0, "agent_compute-ego": 0.19800470367310535, "deviation-heading": 1.9402531210310952, "set_robot_commands": 0.08482909770238967, "deviation-center-line": 0.4934138003227537, "driven_lanedir_consec": 0.4578426505439186, "sim_compute_sim_state": 0.035686137184264166, "sim_compute_performance-ego": 0.06905620060269795, "sim_compute_robot_state-ego": 0.0680582220592196}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9956764758809086, "sim_physics": 0.1026452972954912, "survival_time": 12.650000000000045, "driven_lanedir": 0.6161863728044286, "sim_render-ego": 0.06071881625963294, "in-drivable-lane": 4.350000000000062, "agent_compute-ego": 0.2131653124164687, "deviation-heading": 1.8595594269002296, "set_robot_commands": 0.09066810909467252, "deviation-center-line": 0.5010265689470553, "driven_lanedir_consec": 0.6161863728044286, "sim_compute_sim_state": 0.03869987382247985, "sim_compute_performance-ego": 0.06749280733553317, "sim_compute_robot_state-ego": 0.07230110413472172}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.28025312636431154, "sim_physics": 0.10193746904783613, "survival_time": 3.949999999999994, "driven_lanedir": 0.27249823287446695, "sim_render-ego": 0.05624683899215505, "in-drivable-lane": 0, "agent_compute-ego": 0.1909859814221346, "deviation-heading": 0.9209015091609934, "set_robot_commands": 0.08535062210469306, "deviation-center-line": 0.4220809791841777, "driven_lanedir_consec": 0.27249823287446695, "sim_compute_sim_state": 0.03780096392088299, "sim_compute_performance-ego": 0.06433557558663283, "sim_compute_robot_state-ego": 0.06886532336850709}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.205281109718533, "sim_physics": 0.11394601901372274, "survival_time": 14.950000000000076, "driven_lanedir": 1.2028575181014998, "sim_render-ego": 0.0611337415377299, "in-drivable-lane": 0, "agent_compute-ego": 0.21416296084721884, "deviation-heading": 0.7095458329423281, "set_robot_commands": 0.0939766279856364, "deviation-center-line": 0.9600869493681972, "driven_lanedir_consec": 1.2028575181014998, "sim_compute_sim_state": 0.03886416912078858, "sim_compute_performance-ego": 0.06733304897944133, "sim_compute_robot_state-ego": 0.0733140206336975}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9932857153906, "sim_physics": 0.11293205618858336, "survival_time": 12.40000000000004, "driven_lanedir": 0.6467151093499586, "sim_render-ego": 0.05872334203412456, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.2015536379429602, "deviation-heading": 2.9544895475948003, "set_robot_commands": 0.08622871771935493, "deviation-center-line": 0.6708993268183443, "driven_lanedir_consec": 0.6467151093499586, "sim_compute_sim_state": 0.0385498462184783, "sim_compute_performance-ego": 0.0654356143166942, "sim_compute_robot_state-ego": 0.07039638296250374}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.2062955102460646, "sim_physics": 0.08524036248524984, "survival_time": 14.950000000000076, "driven_lanedir": 1.1813825200561072, "sim_render-ego": 0.04886703650156657, "in-drivable-lane": 0, "agent_compute-ego": 0.16425865809122722, "deviation-heading": 1.2738045958514146, "set_robot_commands": 0.07012849966684977, "deviation-center-line": 1.0526894092074612, "driven_lanedir_consec": 1.1813825200561072, "sim_compute_sim_state": 0.030510245164235433, "sim_compute_performance-ego": 0.05075741688410441, "sim_compute_robot_state-ego": 0.05895324230194092}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.9938254169584152, "sim_physics": 0.0945235759981217, "survival_time": 12.40000000000004, "driven_lanedir": 0.6523240082563025, "sim_render-ego": 0.05494209835606237, "in-drivable-lane": 3.1500000000000448, "agent_compute-ego": 0.1850911234655688, "deviation-heading": 2.9060636747790514, "set_robot_commands": 0.08451469002231475, "deviation-center-line": 0.5953043214119251, "driven_lanedir_consec": 0.6523240082563025, "sim_compute_sim_state": 0.03527496514781829, "sim_compute_performance-ego": 0.06352757253954487, "sim_compute_robot_state-ego": 0.06416554027988065}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7835333983011468, "sim_physics": 0.1110816025853756, "survival_time": 9.950000000000006, "driven_lanedir": 0.6511025943751279, "sim_render-ego": 0.06248449200960859, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.23083465422817212, "deviation-heading": 1.7069568884599495, "set_robot_commands": 0.0959302995672178, "deviation-center-line": 0.49012224054366976, "driven_lanedir_consec": 0.6511025943751279, "sim_compute_sim_state": 0.039972573668513464, "sim_compute_performance-ego": 0.07093000651603967, "sim_compute_robot_state-ego": 0.07887132563183655}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.219699516636652, "sim_physics": 0.1056640068689982, "survival_time": 14.950000000000076, "driven_lanedir": 1.2170036305209848, "sim_render-ego": 0.060714329878489175, "in-drivable-lane": 0, "agent_compute-ego": 0.2106568916638692, "deviation-heading": 0.6958643183991009, "set_robot_commands": 0.09154264052708944, "deviation-center-line": 1.00543246455864, "driven_lanedir_consec": 1.2170036305209848, "sim_compute_sim_state": 0.038620492617289226, "sim_compute_performance-ego": 0.06643505732218424, "sim_compute_robot_state-ego": 0.07066634178161621}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.199587324242512, "sim_physics": 0.1038726274172465, "survival_time": 14.950000000000076, "driven_lanedir": 1.1994392798506217, "sim_render-ego": 0.05982819716135661, "in-drivable-lane": 0, "agent_compute-ego": 0.21203838427861532, "deviation-heading": 0.16792099924859266, "set_robot_commands": 0.08948752482732138, "deviation-center-line": 1.2171177182330184, "driven_lanedir_consec": 1.1994392798506217, "sim_compute_sim_state": 0.038060081799825035, "sim_compute_performance-ego": 0.06710414409637451, "sim_compute_robot_state-ego": 0.07232598622639974}}
set_robot_commands_max0.11570402299325296
set_robot_commands_mean0.09031754993867556
set_robot_commands_median0.08948752482732138
set_robot_commands_min0.07012849966684977
sim_compute_performance-ego_max0.08132659262559545
sim_compute_performance-ego_mean0.06689213943079247
sim_compute_performance-ego_median0.06733304897944133
sim_compute_performance-ego_min0.05075741688410441
sim_compute_robot_state-ego_max0.08697716082174947
sim_compute_robot_state-ego_mean0.07133931154309628
sim_compute_robot_state-ego_median0.07066634178161621
sim_compute_robot_state-ego_min0.05895324230194092
sim_compute_sim_state_max0.04591660799942617
sim_compute_sim_state_mean0.037963004072422715
sim_compute_sim_state_median0.0385498462184783
sim_compute_sim_state_min0.030510245164235433
sim_physics_max0.1396547283713273
sim_physics_mean0.1073811369458578
sim_physics_median0.10517922607628076
sim_physics_min0.08524036248524984
sim_render-ego_max0.07195449157023993
sim_render-ego_mean0.059438790488536064
sim_render-ego_median0.05982819716135661
sim_render-ego_min0.04886703650156657
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.176666666666703
survival_time_min3.699999999999995
208283094awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationhost-errorno8430:35:44
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3094/step1-simulation-ip-172-31-42-167-7357-job20828/logs/challenges-runner/stdout.log'
(hidden)
208113097RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessno8430:22:53(hidden)
driven_lanedir_consec_median1.343427326836246
survival_time_median9.349999999999998
deviation-center-line_median0.5775715240337054
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1483386978108615
agent_compute-ego_mean0.1388748972797151
agent_compute-ego_median0.13884421787430754
agent_compute-ego_min0.12614043553670248
deviation-center-line_max1.177032060148078
deviation-center-line_mean0.6609065253271865
deviation-center-line_min0.23312586433769497
deviation-heading_max5.09896429028419
deviation-heading_mean3.0711717934290963
deviation-heading_median3.0875248732283667
deviation-heading_min1.0206458230028264
driven_any_max2.3490319134002453
driven_any_mean1.500497848136467
driven_any_median1.448931251397255
driven_any_min0.5088497570011956
driven_lanedir_consec_max2.1369788889663743
driven_lanedir_consec_mean1.3177621750801296
driven_lanedir_consec_min0.4778324842405466
driven_lanedir_max2.1369788889663743
driven_lanedir_mean1.3177621750801296
driven_lanedir_median1.343427326836246
driven_lanedir_min0.4778324842405466
in-drivable-lane_max2.0999999999999925
in-drivable-lane_mean0.4199999999999985
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8466654312004788, "sim_physics": 0.13175072079211209, "survival_time": 5.649999999999988, "driven_lanedir": 0.7682364779616835, "sim_render-ego": 0.07133742138347794, "in-drivable-lane": 0, "agent_compute-ego": 0.13884421787430754, "deviation-heading": 1.9456303953280456, "set_robot_commands": 0.10757107439294324, "deviation-center-line": 0.3803518767429933, "driven_lanedir_consec": 0.7682364779616835, "sim_compute_sim_state": 0.0420034227118028, "sim_compute_performance-ego": 0.07403644207304558, "sim_compute_robot_state-ego": 0.08146820448141183}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3490319134002453, "sim_physics": 0.12089053710301716, "survival_time": 14.950000000000076, "driven_lanedir": 1.8623356973957983, "sim_render-ego": 0.06533747831980387, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.12614043553670248, "deviation-heading": 4.203093585302054, "set_robot_commands": 0.10465420643488564, "deviation-center-line": 0.9364513013734608, "driven_lanedir_consec": 1.8623356973957983, "sim_compute_sim_state": 0.04061893383661906, "sim_compute_performance-ego": 0.07320932865142822, "sim_compute_robot_state-ego": 0.07920534133911133}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.34901088768316, "sim_physics": 0.124845867951711, "survival_time": 14.950000000000076, "driven_lanedir": 2.1369788889663743, "sim_render-ego": 0.06808575789133707, "in-drivable-lane": 0, "agent_compute-ego": 0.14221592982610068, "deviation-heading": 5.09896429028419, "set_robot_commands": 0.10413959980010988, "deviation-center-line": 1.177032060148078, "driven_lanedir_consec": 2.1369788889663743, "sim_compute_sim_state": 0.042678682804107665, "sim_compute_performance-ego": 0.07505876382191976, "sim_compute_robot_state-ego": 0.0791965373357137}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5088497570011956, "sim_physics": 0.13344505514417376, "survival_time": 3.4999999999999956, "driven_lanedir": 0.4778324842405466, "sim_render-ego": 0.0691370895930699, "in-drivable-lane": 0, "agent_compute-ego": 0.13883520535060337, "deviation-heading": 1.0206458230028264, "set_robot_commands": 0.11159477574484689, "deviation-center-line": 0.23312586433769497, "driven_lanedir_consec": 0.4778324842405466, "sim_compute_sim_state": 0.04307526520320347, "sim_compute_performance-ego": 0.07528556074414934, "sim_compute_robot_state-ego": 0.0877551691872733}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.448931251397255, "sim_physics": 0.13327209834746498, "survival_time": 9.349999999999998, "driven_lanedir": 1.343427326836246, "sim_render-ego": 0.06813389604741876, "in-drivable-lane": 0, "agent_compute-ego": 0.1483386978108615, "deviation-heading": 3.0875248732283667, "set_robot_commands": 0.1069069546174238, "deviation-center-line": 0.5775715240337054, "driven_lanedir_consec": 1.343427326836246, "sim_compute_sim_state": 0.04437337329680907, "sim_compute_performance-ego": 0.07481668849679876, "sim_compute_robot_state-ego": 0.08257427190076859}}
set_robot_commands_max0.11159477574484689
set_robot_commands_mean0.1069733221980419
set_robot_commands_median0.1069069546174238
set_robot_commands_min0.10413959980010988
sim_compute_performance-ego_max0.07528556074414934
sim_compute_performance-ego_mean0.07448135675746834
sim_compute_performance-ego_median0.07481668849679876
sim_compute_performance-ego_min0.07320932865142822
sim_compute_robot_state-ego_max0.0877551691872733
sim_compute_robot_state-ego_mean0.08203990484885575
sim_compute_robot_state-ego_median0.08146820448141183
sim_compute_robot_state-ego_min0.0791965373357137
sim_compute_sim_state_max0.04437337329680907
sim_compute_sim_state_mean0.042549935570508415
sim_compute_sim_state_median0.042678682804107665
sim_compute_sim_state_min0.04061893383661906
sim_physics_max0.13344505514417376
sim_physics_mean0.12884085586769584
sim_physics_median0.13175072079211209
sim_physics_min0.12089053710301716
sim_render-ego_max0.07133742138347794
sim_render-ego_mean0.06840632864702151
sim_render-ego_median0.06813389604741876
sim_render-ego_min0.06533747831980387
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.680000000000026
survival_time_min3.4999999999999956
207802981Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errorno8430:59:14
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2981/step1-simulation-ip-172-31-42-167-7357-job20780/logs/challenges-runner/stdout.log'
(hidden)
207662970Andrea Censiminimal_agent (Python 3)aido2-LF-sim-testingstep1-simulationhost-errorno8430:26:53
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2970/step1-simulation-ip-172-31-42-167-7357-job20766/logs/challenges-runner/stdout.log'
(hidden)