Duckietown Challenges Home Challenges Submissions

Evaluator 907

ID907
evaluatorip-172-31-40-253-32059
ownerI don't have one πŸ˜€
machineip-172-31-40-253
processip-172-31-40-253-32059
versiond-c:4.0.25;d-c-r:4.0.32;d-s:4.0.21
first heard
last heard
statusinactive
# evaluating
# success12 21729
# timeout
# failed
# error2 21696
# aborted
# host-error7 21707
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
219223353FANG MEIYIΒ πŸ‡ΈπŸ‡¬testaido2-LFV-sim-testingstep1-simulationhost-errornoip-172-31-40-253-320590:21:17
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3353/step1-simulation-ip-172-31-40-253-32059-job21922/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
218923339Anastasiya NikolskayaΒ πŸ‡·πŸ‡ΊSSegmaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-40-253-320590:11:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5452789181043742
survival_time_median6.149999999999986
deviation-center-line_median0.5966806902836215
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1031775991121928
agent_compute-ego_mean0.07324918655171479
agent_compute-ego_median0.0653142356053954
agent_compute-ego_min0.06324119878009082
deviation-center-line_max1.73036662742397
deviation-center-line_mean0.7659584758280703
deviation-center-line_min0.1706875522353031
deviation-heading_max1.8927891298471584
deviation-heading_mean1.1046496699745905
deviation-heading_median1.0472711044217655
deviation-heading_min0.28845120548478637
driven_any_max4.061881822282747
driven_any_mean1.9257702240501569
driven_any_median1.5767974958574549
driven_any_min0.38187129521191215
driven_lanedir_consec_max3.988807046887926
driven_lanedir_consec_mean1.875176570879459
driven_lanedir_consec_min0.3770443797628027
driven_lanedir_max3.988807046887926
driven_lanedir_mean1.875176570879459
driven_lanedir_median1.5452789181043742
driven_lanedir_min0.3770443797628027
in-drivable-lane_max0.15000000000000213
in-drivable-lane_mean0.030000000000000426
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.0307814243356654, "sim_physics": 0.06457249903371917, "survival_time": 11.65000000000003, "driven_lanedir": 2.9041101801231584, "sim_render-ego": 0.03814441247047785, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.0653142356053954, "deviation-heading": 1.7170024796746235, "set_robot_commands": 0.057766693344443655, "deviation-center-line": 1.145240676879527, "driven_lanedir_consec": 2.9041101801231584, "sim_compute_sim_state": 0.0247061221896323, "sim_compute_performance-ego": 0.04095354816944302, "sim_compute_robot_state-ego": 0.04352678147508351}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5767974958574549, "sim_physics": 0.06276624764853377, "survival_time": 6.149999999999986, "driven_lanedir": 1.5452789181043742, "sim_render-ego": 0.03751885987878815, "in-drivable-lane": 0, "agent_compute-ego": 0.06324119878009082, "deviation-heading": 1.0472711044217655, "set_robot_commands": 0.057552368660283286, "deviation-center-line": 0.5966806902836215, "driven_lanedir_consec": 1.5452789181043742, "sim_compute_sim_state": 0.02476734262171799, "sim_compute_performance-ego": 0.04215197446869641, "sim_compute_robot_state-ego": 0.043234005206968726}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.38187129521191215, "sim_physics": 0.06504276219536276, "survival_time": 1.7000000000000008, "driven_lanedir": 0.3770443797628027, "sim_render-ego": 0.0375592778710758, "in-drivable-lane": 0, "agent_compute-ego": 0.06439959301668055, "deviation-heading": 0.28845120548478637, "set_robot_commands": 0.05726491703706629, "deviation-center-line": 0.1706875522353031, "driven_lanedir_consec": 0.3770443797628027, "sim_compute_sim_state": 0.02462281199062572, "sim_compute_performance-ego": 0.04117110196281882, "sim_compute_robot_state-ego": 0.04428148970884435}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5775190825630045, "sim_physics": 0.07692068815231323, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5606423295190344, "sim_render-ego": 0.041118244330088295, "in-drivable-lane": 0, "agent_compute-ego": 0.07011330624421437, "deviation-heading": 0.5777344304446188, "set_robot_commands": 0.06422353287537892, "deviation-center-line": 0.1868168323179305, "driven_lanedir_consec": 0.5606423295190344, "sim_compute_sim_state": 0.02876817186673482, "sim_compute_performance-ego": 0.04454732437928518, "sim_compute_robot_state-ego": 0.048106382290522255}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.061881822282747, "sim_physics": 0.10789209763209023, "survival_time": 14.950000000000076, "driven_lanedir": 3.988807046887926, "sim_render-ego": 0.056422719160715736, "in-drivable-lane": 0, "agent_compute-ego": 0.1031775991121928, "deviation-heading": 1.8927891298471584, "set_robot_commands": 0.09165535926818848, "deviation-center-line": 1.73036662742397, "driven_lanedir_consec": 3.988807046887926, "sim_compute_sim_state": 0.035407063166300455, "sim_compute_performance-ego": 0.06236965815226237, "sim_compute_robot_state-ego": 0.0661840303738912}}
set_robot_commands_max0.09165535926818848
set_robot_commands_mean0.06569257423707212
set_robot_commands_median0.057766693344443655
set_robot_commands_min0.05726491703706629
sim_compute_performance-ego_max0.06236965815226237
sim_compute_performance-ego_mean0.04623872142650117
sim_compute_performance-ego_median0.04215197446869641
sim_compute_performance-ego_min0.04095354816944302
sim_compute_robot_state-ego_max0.0661840303738912
sim_compute_robot_state-ego_mean0.049066537811062
sim_compute_robot_state-ego_median0.04428148970884435
sim_compute_robot_state-ego_min0.043234005206968726
sim_compute_sim_state_max0.035407063166300455
sim_compute_sim_state_mean0.02765430236700226
sim_compute_sim_state_median0.02476734262171799
sim_compute_sim_state_min0.02462281199062572
sim_physics_max0.10789209763209023
sim_physics_mean0.07543885893240383
sim_physics_median0.06504276219536276
sim_physics_min0.06276624764853377
sim_render-ego_max0.056422719160715736
sim_render-ego_mean0.04215270274222917
sim_render-ego_median0.03814441247047785
sim_render-ego_min0.03751885987878815
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.370000000000019
survival_time_min1.7000000000000008
No reset possible
218813330Anastasiya NikolskayaΒ πŸ‡·πŸ‡ΊJetBrains Researchaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-40-253-320590:15:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6272003050971007
survival_time_median14.950000000000076
deviation-center-line_median0.960927415014256
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06953730742136638
agent_compute-ego_mean0.06510303958257038
agent_compute-ego_median0.06531146923700969
agent_compute-ego_min0.06052603085835775
deviation-center-line_max1.4224269616166023
deviation-center-line_mean1.102202546380739
deviation-center-line_min0.838354178153161
deviation-heading_max3.613538095202144
deviation-heading_mean2.3309362335084107
deviation-heading_median2.1665646431565206
deviation-heading_min1.364414472518237
driven_any_max2.9228947376695236
driven_any_mean2.7177553160975356
driven_any_median2.678769635585334
driven_any_min2.542847278628334
driven_lanedir_consec_max2.7315628134578924
driven_lanedir_consec_mean2.609741760590172
driven_lanedir_consec_min2.434874911231563
driven_lanedir_max2.7315628134578924
driven_lanedir_mean2.609741760590172
driven_lanedir_median2.6272003050971007
driven_lanedir_min2.434874911231563
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean0.3799999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.542847278628334, "sim_physics": 0.059964078267415365, "survival_time": 14.950000000000076, "driven_lanedir": 2.434874911231563, "sim_render-ego": 0.03840419371922811, "in-drivable-lane": 0, "agent_compute-ego": 0.06953730742136638, "deviation-heading": 3.613538095202144, "set_robot_commands": 0.0587388277053833, "deviation-center-line": 0.960927415014256, "driven_lanedir_consec": 2.434874911231563, "sim_compute_sim_state": 0.025330577691396076, "sim_compute_performance-ego": 0.04186896085739136, "sim_compute_robot_state-ego": 0.04461102406183878}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.82636245516923, "sim_physics": 0.06118175268173218, "survival_time": 14.950000000000076, "driven_lanedir": 2.7315628134578924, "sim_render-ego": 0.0378719433148702, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.06052603085835775, "deviation-heading": 2.0734449080849955, "set_robot_commands": 0.05853808879852295, "deviation-center-line": 1.4224269616166023, "driven_lanedir_consec": 2.7315628134578924, "sim_compute_sim_state": 0.025142463048299153, "sim_compute_performance-ego": 0.04156002600987752, "sim_compute_robot_state-ego": 0.04477403879165649}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.9228947376695236, "sim_physics": 0.0594937801361084, "survival_time": 14.950000000000076, "driven_lanedir": 2.6869298104021317, "sim_render-ego": 0.03835391918818156, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.06531146923700969, "deviation-heading": 1.364414472518237, "set_robot_commands": 0.05775373856226603, "deviation-center-line": 1.3529483964915885, "driven_lanedir_consec": 2.6869298104021317, "sim_compute_sim_state": 0.025584874947865804, "sim_compute_performance-ego": 0.042325332959493, "sim_compute_robot_state-ego": 0.04490900913874308}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.6179024734352563, "sim_physics": 0.0636501407623291, "survival_time": 14.950000000000076, "driven_lanedir": 2.5681409627621714, "sim_render-ego": 0.03800939162572225, "in-drivable-lane": 0, "agent_compute-ego": 0.06472131093343099, "deviation-heading": 2.436719048580157, "set_robot_commands": 0.05831738948822021, "deviation-center-line": 0.838354178153161, "driven_lanedir_consec": 2.5681409627621714, "sim_compute_sim_state": 0.025530664126078288, "sim_compute_performance-ego": 0.041465974648793535, "sim_compute_robot_state-ego": 0.044580503304799395}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.678769635585334, "sim_physics": 0.06010165452957153, "survival_time": 14.950000000000076, "driven_lanedir": 2.6272003050971007, "sim_render-ego": 0.03807450930277507, "in-drivable-lane": 0, "agent_compute-ego": 0.06541907946268717, "deviation-heading": 2.1665646431565206, "set_robot_commands": 0.057641074657440186, "deviation-center-line": 0.9363557806280876, "driven_lanedir_consec": 2.6272003050971007, "sim_compute_sim_state": 0.025720451672871902, "sim_compute_performance-ego": 0.041836982568105065, "sim_compute_robot_state-ego": 0.04516014575958252}}
set_robot_commands_max0.0587388277053833
set_robot_commands_mean0.05819782384236653
set_robot_commands_median0.05831738948822021
set_robot_commands_min0.057641074657440186
sim_compute_performance-ego_max0.042325332959493
sim_compute_performance-ego_mean0.041811455408732094
sim_compute_performance-ego_median0.041836982568105065
sim_compute_performance-ego_min0.041465974648793535
sim_compute_robot_state-ego_max0.04516014575958252
sim_compute_robot_state-ego_mean0.04480694421132406
sim_compute_robot_state-ego_median0.04477403879165649
sim_compute_robot_state-ego_min0.044580503304799395
sim_compute_sim_state_max0.025720451672871902
sim_compute_sim_state_mean0.02546180629730225
sim_compute_sim_state_median0.025530664126078288
sim_compute_sim_state_min0.025142463048299153
sim_physics_max0.0636501407623291
sim_physics_mean0.06087828127543131
sim_physics_median0.06010165452957153
sim_physics_min0.0594937801361084
sim_render-ego_max0.03840419371922811
sim_render-ego_mean0.038142791430155434
sim_render-ego_median0.03807450930277507
sim_render-ego_min0.0378719433148702
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
218803329Anastasiya NikolskayaΒ πŸ‡·πŸ‡ΊJetBrains Researchaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-40-253-320590:12:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8243543121412151
survival_time_median10.15000000000001
deviation-center-line_median0.7141016430982251
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05800590991973877
agent_compute-ego_mean0.05662337050969557
agent_compute-ego_median0.056424849139058535
agent_compute-ego_min0.05571911715659775
deviation-center-line_max0.8833812092090513
deviation-center-line_mean0.7494585328390408
deviation-center-line_min0.6132312122789928
deviation-heading_max2.5489289767236927
deviation-heading_mean1.852828334836256
deviation-heading_median2.1572442108893677
deviation-heading_min0.5465164803029868
driven_any_max2.625715349099222
driven_any_mean1.93877289618443
driven_any_median1.8566070038682676
driven_any_min1.151312300779794
driven_lanedir_consec_max2.565446610864985
driven_lanedir_consec_mean1.830478946373772
driven_lanedir_consec_min1.1448185876736272
driven_lanedir_max2.565446610864985
driven_lanedir_mean1.830478946373772
driven_lanedir_median1.8243543121412151
driven_lanedir_min1.1448185876736272
in-drivable-lane_max1.4499999999999948
in-drivable-lane_mean0.5400000000000025
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5726451582627616, "sim_physics": 0.06300013224283854, "survival_time": 14.950000000000076, "driven_lanedir": 2.3593013382555195, "sim_render-ego": 0.03865593353907267, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.05800590991973877, "deviation-heading": 2.1572442108893677, "set_robot_commands": 0.07331063906351726, "deviation-center-line": 0.8257556773092203, "driven_lanedir_consec": 2.3593013382555195, "sim_compute_sim_state": 0.02567090113957723, "sim_compute_performance-ego": 0.04179200887680054, "sim_compute_robot_state-ego": 0.044248874187469485}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4875846689121044, "sim_physics": 0.062304196859660904, "survival_time": 9.5, "driven_lanedir": 1.2584738829335138, "sim_render-ego": 0.03788702362462094, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.05604046520433928, "deviation-heading": 2.397423479938128, "set_robot_commands": 0.073407402791475, "deviation-center-line": 0.7141016430982251, "driven_lanedir_consec": 1.2584738829335138, "sim_compute_sim_state": 0.02609423838163677, "sim_compute_performance-ego": 0.04220290184020996, "sim_compute_robot_state-ego": 0.04483090199922261}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.151312300779794, "sim_physics": 0.06448112415666339, "survival_time": 5.949999999999987, "driven_lanedir": 1.1448185876736272, "sim_render-ego": 0.03812775291314646, "in-drivable-lane": 0, "agent_compute-ego": 0.05571911715659775, "deviation-heading": 0.5465164803029868, "set_robot_commands": 0.07491011178794027, "deviation-center-line": 0.6132312122789928, "driven_lanedir_consec": 1.1448185876736272, "sim_compute_sim_state": 0.025691869879971033, "sim_compute_performance-ego": 0.0417436691893249, "sim_compute_robot_state-ego": 0.04473751933634782}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.8566070038682676, "sim_physics": 0.06344946029738252, "survival_time": 10.15000000000001, "driven_lanedir": 1.8243543121412151, "sim_render-ego": 0.03823934869813214, "in-drivable-lane": 0, "agent_compute-ego": 0.056424849139058535, "deviation-heading": 1.614028526327104, "set_robot_commands": 0.07344981837155197, "deviation-center-line": 0.710822922299714, "driven_lanedir_consec": 1.8243543121412151, "sim_compute_sim_state": 0.025799825273711104, "sim_compute_performance-ego": 0.042050849040740815, "sim_compute_robot_state-ego": 0.04438328273190653}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.625715349099222, "sim_physics": 0.062292640209198, "survival_time": 14.950000000000076, "driven_lanedir": 2.565446610864985, "sim_render-ego": 0.03870818376541138, "in-drivable-lane": 0, "agent_compute-ego": 0.05692651112874349, "deviation-heading": 2.5489289767236927, "set_robot_commands": 0.07367751280466715, "deviation-center-line": 0.8833812092090513, "driven_lanedir_consec": 2.565446610864985, "sim_compute_sim_state": 0.02588268995285034, "sim_compute_performance-ego": 0.04211688121159871, "sim_compute_robot_state-ego": 0.04479145050048828}}
set_robot_commands_max0.07491011178794027
set_robot_commands_mean0.07375109696383034
set_robot_commands_median0.07344981837155197
set_robot_commands_min0.07331063906351726
sim_compute_performance-ego_max0.04220290184020996
sim_compute_performance-ego_mean0.04198126203173498
sim_compute_performance-ego_median0.042050849040740815
sim_compute_performance-ego_min0.0417436691893249
sim_compute_robot_state-ego_max0.04483090199922261
sim_compute_robot_state-ego_mean0.04459840575108694
sim_compute_robot_state-ego_median0.04473751933634782
sim_compute_robot_state-ego_min0.044248874187469485
sim_compute_sim_state_max0.02609423838163677
sim_compute_sim_state_mean0.025827904925549296
sim_compute_sim_state_median0.025799825273711104
sim_compute_sim_state_min0.02567090113957723
sim_physics_max0.06448112415666339
sim_physics_mean0.06310551075314867
sim_physics_median0.06300013224283854
sim_physics_min0.062292640209198
sim_render-ego_max0.03870818376541138
sim_render-ego_mean0.03832364850807672
sim_render-ego_median0.03823934869813214
sim_render-ego_min0.03788702362462094
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.100000000000028
survival_time_min5.949999999999987
No reset possible
218703328jiang pengRL - TH -xyzaido2-LFV-sim-validationstep1-simulationhost-errornoip-172-31-40-253-320590:05:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission3328/step1-simulation-ip-172-31-40-253-32059-job21870/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
218653327jiang pengRL - TH -xyzaido2-LFV-sim-validationstep1-simulationsuccessnoip-172-31-40-253-320590:05:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2055561475764345
survival_time_median3.8499999999999943
deviation-center-line_median0.10722396285945332
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.10110037825828376
agent_compute-ego_mean0.0993952721541533
agent_compute-ego_median0.09924079226208972
agent_compute-ego_min0.09694405259757206
deviation-center-line_max0.1591419273019051
deviation-center-line_mean0.1137316987607003
deviation-center-line_min0.08570557570179192
deviation-heading_max0.837355317954609
deviation-heading_mean0.6160125520667027
deviation-heading_median0.6924807922772159
deviation-heading_min0.3731951801352031
driven_any_max1.6127589168043217
driven_any_mean1.2242311624482871
driven_any_median1.58069041008794
driven_any_min0.3259989150652587
driven_lanedir_consec_max1.2447694149322088
driven_lanedir_consec_mean0.9216955080379544
driven_lanedir_consec_min0.2475515570008162
driven_lanedir_max1.2447694149322088
driven_lanedir_mean0.9216955080379544
driven_lanedir_median1.2055561475764345
driven_lanedir_min0.2475515570008162
in-drivable-lane_max1.0499999999999965
in-drivable-lane_mean0.7099999999999979
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.99583517356703, "sim_physics": 0.09136066325875215, "survival_time": 2.1500000000000004, "driven_lanedir": 0.6861327872874248, "sim_render-ego": 0.03614295360653899, "in-drivable-lane": 0.4999999999999995, "agent_compute-ego": 0.10110037825828376, "deviation-heading": 0.3731951801352031, "set_robot_commands": 0.05535680748695551, "deviation-center-line": 0.09762238468713098, "driven_lanedir_consec": 0.6861327872874248, "sim_compute_sim_state": 0.02316304140312727, "sim_compute_performance-ego": 0.03920622204625329, "sim_compute_robot_state-ego": 0.041686740032462186, "sim_compute_robot_state-npc0": 0.041082931119342185, "sim_compute_robot_state-npc1": 0.04054891785909963, "sim_compute_robot_state-npc2": 0.04028395164844602, "sim_compute_robot_state-npc3": 0.04005200363868891}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3259989150652587, "sim_physics": 0.09419393539428712, "survival_time": 1.4500000000000006, "driven_lanedir": 0.2475515570008162, "sim_render-ego": 0.03498592047855772, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09694405259757206, "deviation-heading": 0.6924807922772159, "set_robot_commands": 0.05464585896196037, "deviation-center-line": 0.08570557570179192, "driven_lanedir_consec": 0.2475515570008162, "sim_compute_sim_state": 0.023000256768588363, "sim_compute_performance-ego": 0.03859859499438056, "sim_compute_robot_state-ego": 0.04113373263128873, "sim_compute_robot_state-npc0": 0.0407174537921774, "sim_compute_robot_state-npc1": 0.04066305324949067, "sim_compute_robot_state-npc2": 0.03957477931318612, "sim_compute_robot_state-npc3": 0.04025203606178021}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6127589168043217, "sim_physics": 0.10067501625457367, "survival_time": 3.8499999999999943, "driven_lanedir": 1.2055561475764345, "sim_render-ego": 0.036450952678531795, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.09924079226208972, "deviation-heading": 0.4018255432991754, "set_robot_commands": 0.05555649546833782, "deviation-center-line": 0.1189646432532202, "driven_lanedir_consec": 1.2055561475764345, "sim_compute_sim_state": 0.02297625913248434, "sim_compute_performance-ego": 0.038909534355262655, "sim_compute_robot_state-ego": 0.04126203834236442, "sim_compute_robot_state-npc0": 0.041091962294145065, "sim_compute_robot_state-npc1": 0.04021765969016335, "sim_compute_robot_state-npc2": 0.039861233203442065, "sim_compute_robot_state-npc3": 0.03963547557979435}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.58069041008794, "sim_physics": 0.09833481452044318, "survival_time": 4.249999999999993, "driven_lanedir": 1.224467633392888, "sim_render-ego": 0.0362550090341007, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.1008223617778105, "deviation-heading": 0.7752059266673098, "set_robot_commands": 0.05505424387314741, "deviation-center-line": 0.1591419273019051, "driven_lanedir_consec": 1.224467633392888, "sim_compute_sim_state": 0.02311567699207979, "sim_compute_performance-ego": 0.03878650384790757, "sim_compute_robot_state-ego": 0.04175346598905676, "sim_compute_robot_state-npc0": 0.04051520123201258, "sim_compute_robot_state-npc1": 0.04017159798566033, "sim_compute_robot_state-npc2": 0.040020900614121384, "sim_compute_robot_state-npc3": 0.039863000196569104}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.605872396716886, "sim_physics": 0.08959791508126766, "survival_time": 4.699999999999991, "driven_lanedir": 1.2447694149322088, "sim_render-ego": 0.03622204699414842, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.0988687758750104, "deviation-heading": 0.837355317954609, "set_robot_commands": 0.05480950943967129, "deviation-center-line": 0.10722396285945332, "driven_lanedir_consec": 1.2447694149322088, "sim_compute_sim_state": 0.02313157852659834, "sim_compute_performance-ego": 0.0397123174464449, "sim_compute_robot_state-ego": 0.04137569792727207, "sim_compute_robot_state-npc0": 0.041000447374709106, "sim_compute_robot_state-npc1": 0.04018310536729529, "sim_compute_robot_state-npc2": 0.039678875436174106, "sim_compute_robot_state-npc3": 0.03951370208821398}}
set_robot_commands_max0.05555649546833782
set_robot_commands_mean0.05508458304601448
set_robot_commands_median0.05505424387314741
set_robot_commands_min0.05464585896196037
sim_compute_performance-ego_max0.0397123174464449
sim_compute_performance-ego_mean0.0390426345380498
sim_compute_performance-ego_median0.038909534355262655
sim_compute_performance-ego_min0.03859859499438056
sim_compute_robot_state-ego_max0.04175346598905676
sim_compute_robot_state-ego_mean0.041442334984488835
sim_compute_robot_state-ego_median0.04137569792727207
sim_compute_robot_state-ego_min0.04113373263128873
sim_compute_robot_state-npc0_max0.041091962294145065
sim_compute_robot_state-npc0_mean0.040881599162477265
sim_compute_robot_state-npc0_median0.041000447374709106
sim_compute_robot_state-npc0_min0.04051520123201258
sim_compute_robot_state-npc1_max0.04066305324949067
sim_compute_robot_state-npc1_mean0.040356866830341856
sim_compute_robot_state-npc1_median0.04021765969016335
sim_compute_robot_state-npc1_min0.04017159798566033
sim_compute_robot_state-npc2_max0.04028395164844602
sim_compute_robot_state-npc2_mean0.039883948043073936
sim_compute_robot_state-npc2_median0.039861233203442065
sim_compute_robot_state-npc2_min0.03957477931318612
sim_compute_robot_state-npc3_max0.04025203606178021
sim_compute_robot_state-npc3_mean0.03986324351300931
sim_compute_robot_state-npc3_median0.039863000196569104
sim_compute_robot_state-npc3_min0.03951370208821398
sim_compute_sim_state_max0.02316304140312727
sim_compute_sim_state_mean0.02307736256457562
sim_compute_sim_state_median0.02311567699207979
sim_compute_sim_state_min0.02297625913248434
sim_physics_max0.10067501625457367
sim_physics_mean0.09483246890186474
sim_physics_median0.09419393539428712
sim_physics_min0.08959791508126766
sim_render-ego_max0.036450952678531795
sim_render-ego_mean0.036011376558375524
sim_render-ego_median0.03622204699414842
sim_render-ego_min0.03498592047855772
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2799999999999963
survival_time_min1.4500000000000006
No reset possible
218543320jiang pengRL - TH - shiaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-40-253-320590:09:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2479134785809889
survival_time_median7.7499999999999805
deviation-center-line_median0.47088649158348106
in-drivable-lane_median1.499999999999995


other stats
agent_compute-ego_max0.10236926038726037
agent_compute-ego_mean0.10160753826840992
agent_compute-ego_median0.10164652903874716
agent_compute-ego_min0.10073183139165244
deviation-center-line_max0.978541394887804
deviation-center-line_mean0.49380753654550863
deviation-center-line_min0.13051676065087936
deviation-heading_max2.2675713867933935
deviation-heading_mean1.101324160373758
deviation-heading_median1.069816635199198
deviation-heading_min0.33594692864594
driven_any_max3.4061292932069978
driven_any_mean1.7135671479175325
driven_any_median1.6262803068872898
driven_any_min0.7640090755352797
driven_lanedir_consec_max3.085956908327278
driven_lanedir_consec_mean1.4401141917716929
driven_lanedir_consec_min0.6315074806047392
driven_lanedir_max3.0859599860489486
driven_lanedir_mean1.4401148073160268
driven_lanedir_median1.2479134785809889
driven_lanedir_min0.6315074806047392
in-drivable-lane_max13.000000000000076
in-drivable-lane_mean3.980000000000015
in-drivable-lane_min0.2499999999999991
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7640090755352797, "sim_physics": 0.05885317802429199, "survival_time": 14.950000000000076, "driven_lanedir": 0.6315074806047392, "sim_render-ego": 0.03634937047958374, "in-drivable-lane": 13.000000000000076, "agent_compute-ego": 0.10073183139165244, "deviation-heading": 0.33594692864594, "set_robot_commands": 0.05549832344055176, "deviation-center-line": 0.13051676065087936, "driven_lanedir_consec": 0.6315074806047392, "sim_compute_sim_state": 0.023988468647003172, "sim_compute_performance-ego": 0.03993418137232463, "sim_compute_robot_state-ego": 0.0422970175743103}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0070675398918496, "sim_physics": 0.06265013632567032, "survival_time": 2.3, "driven_lanedir": 0.8807100708369991, "sim_render-ego": 0.03569250003151272, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.10123665436454442, "deviation-heading": 0.6462080980836691, "set_robot_commands": 0.055235479189002, "deviation-center-line": 0.16841061816175132, "driven_lanedir_consec": 0.8807100708369991, "sim_compute_sim_state": 0.02393817901611328, "sim_compute_performance-ego": 0.04014538682025412, "sim_compute_robot_state-ego": 0.04210207254990288}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.4061292932069978, "sim_physics": 0.05811776558558146, "survival_time": 14.950000000000076, "driven_lanedir": 3.0859599860489486, "sim_render-ego": 0.03670175790786743, "in-drivable-lane": 4.35000000000001, "agent_compute-ego": 0.10164652903874716, "deviation-heading": 2.2675713867933935, "set_robot_commands": 0.055733289718627926, "deviation-center-line": 0.978541394887804, "driven_lanedir_consec": 3.085956908327278, "sim_compute_sim_state": 0.023788030942281088, "sim_compute_performance-ego": 0.040303839842478435, "sim_compute_robot_state-ego": 0.04190142790476481}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6262803068872898, "sim_physics": 0.0595072778333135, "survival_time": 5.949999999999987, "driven_lanedir": 1.2479134785809889, "sim_render-ego": 0.0365168006480241, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.10236926038726037, "deviation-heading": 1.1870777531465897, "set_robot_commands": 0.05626132107582413, "deviation-center-line": 0.47088649158348106, "driven_lanedir_consec": 1.2479134785809889, "sim_compute_sim_state": 0.023541111906035608, "sim_compute_performance-ego": 0.040722921115009726, "sim_compute_robot_state-ego": 0.04201588911168715}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7643495240662446, "sim_physics": 0.05751922207493936, "survival_time": 7.7499999999999805, "driven_lanedir": 1.354483020508459, "sim_render-ego": 0.036730206397271925, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.10205341615984516, "deviation-heading": 1.069816635199198, "set_robot_commands": 0.056526319442256806, "deviation-center-line": 0.7206824174436272, "driven_lanedir_consec": 1.354483020508459, "sim_compute_sim_state": 0.023842262452648533, "sim_compute_performance-ego": 0.03992735801204558, "sim_compute_robot_state-ego": 0.04224650629105106}}
set_robot_commands_max0.056526319442256806
set_robot_commands_mean0.05585094657325253
set_robot_commands_median0.055733289718627926
set_robot_commands_min0.055235479189002
sim_compute_performance-ego_max0.040722921115009726
sim_compute_performance-ego_mean0.04020673743242249
sim_compute_performance-ego_median0.04014538682025412
sim_compute_performance-ego_min0.03992735801204558
sim_compute_robot_state-ego_max0.0422970175743103
sim_compute_robot_state-ego_mean0.04211258268634324
sim_compute_robot_state-ego_median0.04210207254990288
sim_compute_robot_state-ego_min0.04190142790476481
sim_compute_sim_state_max0.023988468647003172
sim_compute_sim_state_mean0.023819610592816336
sim_compute_sim_state_median0.023842262452648533
sim_compute_sim_state_min0.023541111906035608
sim_physics_max0.06265013632567032
sim_physics_mean0.05932951596875933
sim_physics_median0.05885317802429199
sim_physics_min0.05751922207493936
sim_render-ego_max0.036730206397271925
sim_render-ego_mean0.03639812709285198
sim_render-ego_median0.0365168006480241
sim_render-ego_min0.03569250003151272
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.180000000000025
survival_time_min2.3
No reset possible
218483315jiang pengRL - TH -hhkaido2-LFV-sim-validationstep1-simulationsuccessnoip-172-31-40-253-320590:15:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2538414623461482
survival_time_median14.950000000000076
deviation-center-line_median0.27954515900842103
in-drivable-lane_median3.650000000000052


other stats
agent_compute-ego_max0.10378916873488316
agent_compute-ego_mean0.10164615761576735
agent_compute-ego_median0.10127334398766089
agent_compute-ego_min0.10062241315841676
deviation-center-line_max0.880408678227055
deviation-center-line_mean0.4008310164380379
deviation-center-line_min0.04588492545812347
deviation-heading_max3.965863447138271
deviation-heading_mean1.5371052082645311
deviation-heading_median0.973819688666778
deviation-heading_min0.3131407185843258
driven_any_max3.06928230803212
driven_any_mean1.867754632823131
driven_any_median1.590389614926163
driven_any_min1.0181573162464244
driven_lanedir_consec_max2.448497564861985
driven_lanedir_consec_mean1.5877856956907153
driven_lanedir_consec_min0.67239844483524
driven_lanedir_max2.448497564861985
driven_lanedir_mean1.5877856956907153
driven_lanedir_median1.2538414623461482
driven_lanedir_min0.67239844483524
in-drivable-lane_max11.000000000000083
in-drivable-lane_mean4.29000000000003
in-drivable-lane_min0.549999999999998
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0181573162464244, "sim_physics": 0.09008214085601098, "survival_time": 2.1500000000000004, "driven_lanedir": 0.67239844483524, "sim_render-ego": 0.03766231758649959, "in-drivable-lane": 0.5999999999999996, "agent_compute-ego": 0.10378916873488316, "deviation-heading": 0.3131407185843258, "set_robot_commands": 0.05476692665454953, "deviation-center-line": 0.08766781204208815, "driven_lanedir_consec": 0.67239844483524, "sim_compute_sim_state": 0.02281788892524187, "sim_compute_performance-ego": 0.03930890282919241, "sim_compute_robot_state-ego": 0.04228693939918696, "sim_compute_robot_state-npc0": 0.04169733579768691, "sim_compute_robot_state-npc1": 0.039975937022719274, "sim_compute_robot_state-npc2": 0.04059940715168798, "sim_compute_robot_state-npc3": 0.040065610131552055}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.354957571562967, "sim_physics": 0.09001100619633992, "survival_time": 14.950000000000076, "driven_lanedir": 2.3405417101823236, "sim_render-ego": 0.03650694767634074, "in-drivable-lane": 3.650000000000052, "agent_compute-ego": 0.10104924996693929, "deviation-heading": 3.965863447138271, "set_robot_commands": 0.056219635804494225, "deviation-center-line": 0.710648507454502, "driven_lanedir_consec": 2.3405417101823236, "sim_compute_sim_state": 0.023187727928161626, "sim_compute_performance-ego": 0.03987587531407674, "sim_compute_robot_state-ego": 0.042031502723693846, "sim_compute_robot_state-npc0": 0.04182349999745687, "sim_compute_robot_state-npc1": 0.040622496604919435, "sim_compute_robot_state-npc2": 0.04060363213221232, "sim_compute_robot_state-npc3": 0.040614030361175536}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.06928230803212, "sim_physics": 0.09435378313064575, "survival_time": 14.950000000000076, "driven_lanedir": 2.448497564861985, "sim_render-ego": 0.036825546423594153, "in-drivable-lane": 5.65000000000002, "agent_compute-ego": 0.10149661223093669, "deviation-heading": 2.0224328807220036, "set_robot_commands": 0.05506343205769857, "deviation-center-line": 0.880408678227055, "driven_lanedir_consec": 2.448497564861985, "sim_compute_sim_state": 0.02295187791188558, "sim_compute_performance-ego": 0.04058294375737508, "sim_compute_robot_state-ego": 0.0416293199857076, "sim_compute_robot_state-npc0": 0.04140212774276733, "sim_compute_robot_state-npc1": 0.04011568387349446, "sim_compute_robot_state-npc2": 0.04024712721506755, "sim_compute_robot_state-npc3": 0.04008457183837891}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.30598635334798, "sim_physics": 0.08775739510854086, "survival_time": 14.950000000000076, "driven_lanedir": 1.2236492962278795, "sim_render-ego": 0.03606517235438029, "in-drivable-lane": 11.000000000000083, "agent_compute-ego": 0.10062241315841676, "deviation-heading": 0.973819688666778, "set_robot_commands": 0.05634642442067464, "deviation-center-line": 0.27954515900842103, "driven_lanedir_consec": 1.2236492962278795, "sim_compute_sim_state": 0.022966350714365643, "sim_compute_performance-ego": 0.03942085822423299, "sim_compute_robot_state-ego": 0.04191094398498535, "sim_compute_robot_state-npc0": 0.04116448640823364, "sim_compute_robot_state-npc1": 0.04023699363072713, "sim_compute_robot_state-npc2": 0.04004765669504801, "sim_compute_robot_state-npc3": 0.04028974612553914}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.590389614926163, "sim_physics": 0.08976609086337155, "survival_time": 3.649999999999995, "driven_lanedir": 1.2538414623461482, "sim_render-ego": 0.03719162940979004, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.10127334398766089, "deviation-heading": 0.4102693062112778, "set_robot_commands": 0.05546137078167641, "deviation-center-line": 0.04588492545812347, "driven_lanedir_consec": 1.2538414623461482, "sim_compute_sim_state": 0.022992418236928443, "sim_compute_performance-ego": 0.039600627063071894, "sim_compute_robot_state-ego": 0.041581862593350345, "sim_compute_robot_state-npc0": 0.044707353800943456, "sim_compute_robot_state-npc1": 0.040180826840335374, "sim_compute_robot_state-npc2": 0.03970070081214382, "sim_compute_robot_state-npc3": 0.04037616024278615}}
set_robot_commands_max0.05634642442067464
set_robot_commands_mean0.05557155794381867
set_robot_commands_median0.05546137078167641
set_robot_commands_min0.05476692665454953
sim_compute_performance-ego_max0.04058294375737508
sim_compute_performance-ego_mean0.03975784143758983
sim_compute_performance-ego_median0.039600627063071894
sim_compute_performance-ego_min0.03930890282919241
sim_compute_robot_state-ego_max0.04228693939918696
sim_compute_robot_state-ego_mean0.04188811373738482
sim_compute_robot_state-ego_median0.04191094398498535
sim_compute_robot_state-ego_min0.041581862593350345
sim_compute_robot_state-npc0_max0.044707353800943456
sim_compute_robot_state-npc0_mean0.04215896074941764
sim_compute_robot_state-npc0_median0.04169733579768691
sim_compute_robot_state-npc0_min0.04116448640823364
sim_compute_robot_state-npc1_max0.040622496604919435
sim_compute_robot_state-npc1_mean0.04022638759443914
sim_compute_robot_state-npc1_median0.040180826840335374
sim_compute_robot_state-npc1_min0.039975937022719274
sim_compute_robot_state-npc2_max0.04060363213221232
sim_compute_robot_state-npc2_mean0.040239704801231936
sim_compute_robot_state-npc2_median0.04024712721506755
sim_compute_robot_state-npc2_min0.03970070081214382
sim_compute_robot_state-npc3_max0.040614030361175536
sim_compute_robot_state-npc3_mean0.04028602373988636
sim_compute_robot_state-npc3_median0.04028974612553914
sim_compute_robot_state-npc3_min0.040065610131552055
sim_compute_sim_state_max0.023187727928161626
sim_compute_sim_state_mean0.022983252743316633
sim_compute_sim_state_median0.022966350714365643
sim_compute_sim_state_min0.02281788892524187
sim_physics_max0.09435378313064575
sim_physics_mean0.09039408323098182
sim_physics_median0.09001100619633992
sim_physics_min0.08775739510854086
sim_render-ego_max0.03766231758649959
sim_render-ego_mean0.036850322690120965
sim_render-ego_median0.036825546423594153
sim_render-ego_min0.03606517235438029
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.130000000000043
survival_time_min2.1500000000000004
No reset possible
218233300Artem IoselevskiiSSegmaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-40-253-320590:05:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5691052758958746
survival_time_median2.7499999999999982
deviation-center-line_median0.1733059238380112
in-drivable-lane_median0


other stats
agent_compute-ego_max0.08415973514591882
agent_compute-ego_mean0.08216412780236132
agent_compute-ego_median0.08267487612637607
agent_compute-ego_min0.0801636012824806
deviation-center-line_max0.34938456093191467
deviation-center-line_mean0.2090617838018885
deviation-center-line_min0.1292272535903628
deviation-heading_max1.119954247221525
deviation-heading_mean0.8241162697466855
deviation-heading_median0.7196727832852934
deviation-heading_min0.5604633186519064
driven_any_max1.2513038793067848
driven_any_mean0.728019992814309
driven_any_median0.5909339814146939
driven_any_min0.3708187759292697
driven_lanedir_consec_max0.7359409125483922
driven_lanedir_consec_mean0.5666469934001085
driven_lanedir_consec_min0.3402447309820964
driven_lanedir_max0.7359409125483922
driven_lanedir_mean0.5666469934001085
driven_lanedir_median0.5691052758958746
driven_lanedir_min0.3402447309820964
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.4799999999999983
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5303848590681168, "sim_physics": 0.0936596019595277, "survival_time": 2.549999999999999, "driven_lanedir": 0.5092346754887824, "sim_render-ego": 0.05189959208170573, "in-drivable-lane": 0, "agent_compute-ego": 0.08325915243111405, "deviation-heading": 0.6178116519124097, "set_robot_commands": 0.08057584014593386, "deviation-center-line": 0.1733059238380112, "driven_lanedir_consec": 0.5092346754887824, "sim_compute_sim_state": 0.03438303984847723, "sim_compute_performance-ego": 0.05888670098547842, "sim_compute_robot_state-ego": 0.061002773397109085}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8966584683526795, "sim_physics": 0.08838767409324647, "survival_time": 3.999999999999994, "driven_lanedir": 0.6787093720853966, "sim_render-ego": 0.05220862627029419, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.08056327402591705, "deviation-heading": 1.1026793476622936, "set_robot_commands": 0.0787724107503891, "deviation-center-line": 0.2455388752340431, "driven_lanedir_consec": 0.6787093720853966, "sim_compute_sim_state": 0.03327541947364807, "sim_compute_performance-ego": 0.05794324576854706, "sim_compute_robot_state-ego": 0.062386003136634824}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2513038793067848, "sim_physics": 0.09089273487756012, "survival_time": 5.449999999999989, "driven_lanedir": 0.7359409125483922, "sim_render-ego": 0.05454274929991556, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.08415973514591882, "deviation-heading": 1.119954247221525, "set_robot_commands": 0.0839071120690862, "deviation-center-line": 0.34938456093191467, "driven_lanedir_consec": 0.7359409125483922, "sim_compute_sim_state": 0.034052892562446244, "sim_compute_performance-ego": 0.06110042169553424, "sim_compute_robot_state-ego": 0.06491341722120933}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3708187759292697, "sim_physics": 0.1030981089617755, "survival_time": 1.850000000000001, "driven_lanedir": 0.3402447309820964, "sim_render-ego": 0.05435803774240855, "in-drivable-lane": 0, "agent_compute-ego": 0.0801636012824806, "deviation-heading": 0.7196727832852934, "set_robot_commands": 0.0819110934798782, "deviation-center-line": 0.1292272535903628, "driven_lanedir_consec": 0.3402447309820964, "sim_compute_sim_state": 0.03553831255113756, "sim_compute_performance-ego": 0.05668727127281395, "sim_compute_robot_state-ego": 0.06254676226023081}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5909339814146939, "sim_physics": 0.09290753711353648, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5691052758958746, "sim_render-ego": 0.051197329434481534, "in-drivable-lane": 0, "agent_compute-ego": 0.08267487612637607, "deviation-heading": 0.5604633186519064, "set_robot_commands": 0.0777117295698686, "deviation-center-line": 0.14785230541511082, "driven_lanedir_consec": 0.5691052758958746, "sim_compute_sim_state": 0.03188366889953613, "sim_compute_performance-ego": 0.05891104611483487, "sim_compute_robot_state-ego": 0.061712672493674535}}
set_robot_commands_max0.0839071120690862
set_robot_commands_mean0.0805756372030312
set_robot_commands_median0.08057584014593386
set_robot_commands_min0.0777117295698686
sim_compute_performance-ego_max0.06110042169553424
sim_compute_performance-ego_mean0.05870573716744171
sim_compute_performance-ego_median0.05888670098547842
sim_compute_performance-ego_min0.05668727127281395
sim_compute_robot_state-ego_max0.06491341722120933
sim_compute_robot_state-ego_mean0.06251232570177172
sim_compute_robot_state-ego_median0.062386003136634824
sim_compute_robot_state-ego_min0.061002773397109085
sim_compute_sim_state_max0.03553831255113756
sim_compute_sim_state_mean0.033826666667049046
sim_compute_sim_state_median0.034052892562446244
sim_compute_sim_state_min0.03188366889953613
sim_physics_max0.1030981089617755
sim_physics_mean0.09378913140112924
sim_physics_median0.09290753711353648
sim_physics_min0.08838767409324647
sim_render-ego_max0.05454274929991556
sim_render-ego_mean0.052841266965761115
sim_render-ego_median0.05220862627029419
sim_render-ego_min0.051197329434481534
simulation-passed1
survival_time_max5.449999999999989
survival_time_mean3.319999999999996
survival_time_min1.850000000000001
No reset possible
218193297Artem IoselevskiiSSegmaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-40-253-320590:10:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6416226851075523
survival_time_median6.649999999999984
deviation-center-line_median0.2945567854099896
in-drivable-lane_median3.2499999999999885


other stats
agent_compute-ego_max0.08840634166330531
agent_compute-ego_mean0.08446788394790383
agent_compute-ego_median0.08757022354337904
agent_compute-ego_min0.07625356141258688
deviation-center-line_max0.42234284332676125
deviation-center-line_mean0.29306139958571076
deviation-center-line_min0.1664719805507219
deviation-heading_max0.6661915357195662
deviation-heading_mean0.4495009807245549
deviation-heading_median0.39702531678041025
deviation-heading_min0.3278499993035452
driven_any_max2.107898053208737
driven_any_mean1.2245086384064017
driven_any_median1.5447707052968318
driven_any_min0.33414036346346543
driven_lanedir_consec_max0.8051353619823667
driven_lanedir_consec_mean0.6038422628480058
driven_lanedir_consec_min0.32854057763789113
driven_lanedir_max0.8051353619823667
driven_lanedir_mean0.6038422628480058
driven_lanedir_median0.6416226851075523
driven_lanedir_min0.32854057763789113
in-drivable-lane_max5.599999999999997
in-drivable-lane_mean2.4999999999999942
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.107898053208737, "sim_physics": 0.0997419105635749, "survival_time": 8.999999999999993, "driven_lanedir": 0.7322784791505539, "sim_render-ego": 0.05562960704167684, "in-drivable-lane": 5.599999999999997, "agent_compute-ego": 0.08757022354337904, "deviation-heading": 0.36257958605803137, "set_robot_commands": 0.08682813776863946, "deviation-center-line": 0.4071711529988654, "driven_lanedir_consec": 0.7322784791505539, "sim_compute_sim_state": 0.035579215155707465, "sim_compute_performance-ego": 0.06231159104241265, "sim_compute_robot_state-ego": 0.06835608349906074}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5447707052968318, "sim_physics": 0.11061429618892812, "survival_time": 6.649999999999984, "driven_lanedir": 0.6416226851075523, "sim_render-ego": 0.05764341892156386, "in-drivable-lane": 3.649999999999987, "agent_compute-ego": 0.08831725801740374, "deviation-heading": 0.49385846576122167, "set_robot_commands": 0.08825499312321942, "deviation-center-line": 0.2945567854099896, "driven_lanedir_consec": 0.6416226851075523, "sim_compute_sim_state": 0.03597980692870635, "sim_compute_performance-ego": 0.06397657107589837, "sim_compute_robot_state-ego": 0.06756016007043365}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.33414036346346543, "sim_physics": 0.09595517551197726, "survival_time": 1.7000000000000008, "driven_lanedir": 0.32854057763789113, "sim_render-ego": 0.05019020333009608, "in-drivable-lane": 0, "agent_compute-ego": 0.07625356141258688, "deviation-heading": 0.3278499993035452, "set_robot_commands": 0.0795602377723245, "deviation-center-line": 0.17476423564221538, "driven_lanedir_consec": 0.32854057763789113, "sim_compute_sim_state": 0.033405850915347826, "sim_compute_performance-ego": 0.058206551215227914, "sim_compute_robot_state-ego": 0.06253495637108297}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5297912328260896, "sim_physics": 0.10305851459503174, "survival_time": 2.499999999999999, "driven_lanedir": 0.5116342103616649, "sim_render-ego": 0.05239514827728271, "in-drivable-lane": 0, "agent_compute-ego": 0.08179203510284423, "deviation-heading": 0.6661915357195662, "set_robot_commands": 0.08620904922485352, "deviation-center-line": 0.1664719805507219, "driven_lanedir_consec": 0.5116342103616649, "sim_compute_sim_state": 0.03429117202758789, "sim_compute_performance-ego": 0.05779962062835693, "sim_compute_robot_state-ego": 0.06204673290252685}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6059428372368838, "sim_physics": 0.10666589287744052, "survival_time": 6.8999999999999835, "driven_lanedir": 0.8051353619823667, "sim_render-ego": 0.0557481707006261, "in-drivable-lane": 3.2499999999999885, "agent_compute-ego": 0.08840634166330531, "deviation-heading": 0.39702531678041025, "set_robot_commands": 0.08902944689211638, "deviation-center-line": 0.42234284332676125, "driven_lanedir_consec": 0.8051353619823667, "sim_compute_sim_state": 0.03653185263923977, "sim_compute_performance-ego": 0.06320043404897054, "sim_compute_robot_state-ego": 0.06767384211222331}}
set_robot_commands_max0.08902944689211638
set_robot_commands_mean0.08597637295623066
set_robot_commands_median0.08682813776863946
set_robot_commands_min0.0795602377723245
sim_compute_performance-ego_max0.06397657107589837
sim_compute_performance-ego_mean0.06109895360217328
sim_compute_performance-ego_median0.06231159104241265
sim_compute_performance-ego_min0.05779962062835693
sim_compute_robot_state-ego_max0.06835608349906074
sim_compute_robot_state-ego_mean0.0656343549910655
sim_compute_robot_state-ego_median0.06756016007043365
sim_compute_robot_state-ego_min0.06204673290252685
sim_compute_sim_state_max0.03653185263923977
sim_compute_sim_state_mean0.03515757953331786
sim_compute_sim_state_median0.035579215155707465
sim_compute_sim_state_min0.033405850915347826
sim_physics_max0.11061429618892812
sim_physics_mean0.10320715794739052
sim_physics_median0.10305851459503174
sim_physics_min0.09595517551197726
sim_render-ego_max0.05764341892156386
sim_render-ego_mean0.05432130965424912
sim_render-ego_median0.05562960704167684
sim_render-ego_min0.05019020333009608
simulation-passed1
survival_time_max8.999999999999993
survival_time_mean5.3499999999999925
survival_time_min1.7000000000000008
No reset possible
218163296jiang pengThird test - THaido2-LF-sim-validationstep1-simulationhost-errornoip-172-31-40-253-320590:00:48
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3296/step1-simulation-ip-172-31-40-253-32059-job21816/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
218133293Artem IoselevskiiSSegmaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-40-253-320590:07:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6720555603150826
survival_time_median4.899999999999991
deviation-center-line_median0.3465183876186594
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06131294886271159
agent_compute-ego_mean0.05944538565179861
agent_compute-ego_median0.05957108371111811
agent_compute-ego_min0.058007336108484
deviation-center-line_max1.1059908387576831
deviation-center-line_mean0.4507202006667233
deviation-center-line_min0.1678354619571783
deviation-heading_max1.4843063777730994
deviation-heading_mean0.7674667953279373
deviation-heading_median0.6516974619898479
deviation-heading_min0.32951020993620106
driven_any_max3.5748021987872276
driven_any_mean1.35169391683787
driven_any_median1.1051354397312998
driven_any_min0.35859218060513987
driven_lanedir_consec_max2.1471767543617526
driven_lanedir_consec_mean0.9694582437481728
driven_lanedir_consec_min0.35324329244369324
driven_lanedir_max2.1471767543617526
driven_lanedir_mean0.9694582437481728
driven_lanedir_median0.6720555603150826
driven_lanedir_min0.35324329244369324
in-drivable-lane_max5.65000000000004
in-drivable-lane_mean1.4800000000000069
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1051354397312998, "sim_physics": 0.06320832700145487, "survival_time": 4.899999999999991, "driven_lanedir": 0.6720555603150826, "sim_render-ego": 0.03756752549385538, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.05957108371111811, "deviation-heading": 0.33124404686285586, "set_robot_commands": 0.05918450501500344, "deviation-center-line": 0.3465183876186594, "driven_lanedir_consec": 0.6720555603150826, "sim_compute_sim_state": 0.024829932621547153, "sim_compute_performance-ego": 0.041700786473799725, "sim_compute_robot_state-ego": 0.04388064510968267}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2268356458836978, "sim_physics": 0.061938867390712846, "survival_time": 5.349999999999989, "driven_lanedir": 1.2001393445633872, "sim_render-ego": 0.03712233650350125, "in-drivable-lane": 0, "agent_compute-ego": 0.058007336108484, "deviation-heading": 1.0405758800776823, "set_robot_commands": 0.05845955153492009, "deviation-center-line": 0.4458112438340142, "driven_lanedir_consec": 1.2001393445633872, "sim_compute_sim_state": 0.024961302213579693, "sim_compute_performance-ego": 0.041243094150151045, "sim_compute_robot_state-ego": 0.04356607321266816}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.35859218060513987, "sim_physics": 0.06781760851542155, "survival_time": 1.800000000000001, "driven_lanedir": 0.35324329244369324, "sim_render-ego": 0.036734561125437416, "in-drivable-lane": 0, "agent_compute-ego": 0.05958820713890923, "deviation-heading": 0.32951020993620106, "set_robot_commands": 0.05760926670498318, "deviation-center-line": 0.1874450711660813, "driven_lanedir_consec": 0.35324329244369324, "sim_compute_sim_state": 0.02458835310406155, "sim_compute_performance-ego": 0.04229828384187487, "sim_compute_robot_state-ego": 0.042573630809783936}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.49310411918198355, "sim_physics": 0.06774046065959524, "survival_time": 2.3499999999999996, "driven_lanedir": 0.47467626705694776, "sim_render-ego": 0.03694812287675574, "in-drivable-lane": 0, "agent_compute-ego": 0.058747352437770115, "deviation-heading": 0.6516974619898479, "set_robot_commands": 0.05763372969120107, "deviation-center-line": 0.1678354619571783, "driven_lanedir_consec": 0.47467626705694776, "sim_compute_sim_state": 0.024442114728562375, "sim_compute_performance-ego": 0.04049821102872808, "sim_compute_robot_state-ego": 0.04310638853844176}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.5748021987872276, "sim_physics": 0.06406570672988891, "survival_time": 14.950000000000076, "driven_lanedir": 2.1471767543617526, "sim_render-ego": 0.03942176739374797, "in-drivable-lane": 5.65000000000004, "agent_compute-ego": 0.06131294886271159, "deviation-heading": 1.4843063777730994, "set_robot_commands": 0.05793241818745931, "deviation-center-line": 1.1059908387576831, "driven_lanedir_consec": 2.1471767543617526, "sim_compute_sim_state": 0.025052554607391357, "sim_compute_performance-ego": 0.04123127301534017, "sim_compute_robot_state-ego": 0.043783535957336424}}
set_robot_commands_max0.05918450501500344
set_robot_commands_mean0.05816389422671342
set_robot_commands_median0.05793241818745931
set_robot_commands_min0.05760926670498318
sim_compute_performance-ego_max0.04229828384187487
sim_compute_performance-ego_mean0.04139432970197878
sim_compute_performance-ego_median0.041243094150151045
sim_compute_performance-ego_min0.04049821102872808
sim_compute_robot_state-ego_max0.04388064510968267
sim_compute_robot_state-ego_mean0.04338205472558258
sim_compute_robot_state-ego_median0.04356607321266816
sim_compute_robot_state-ego_min0.042573630809783936
sim_compute_sim_state_max0.025052554607391357
sim_compute_sim_state_mean0.024774851455028425
sim_compute_sim_state_median0.024829932621547153
sim_compute_sim_state_min0.024442114728562375
sim_physics_max0.06781760851542155
sim_physics_mean0.06495419405941469
sim_physics_median0.06406570672988891
sim_physics_min0.061938867390712846
sim_render-ego_max0.03942176739374797
sim_render-ego_mean0.03755886267865956
sim_render-ego_median0.03712233650350125
sim_render-ego_min0.036734561125437416
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean5.870000000000012
survival_time_min1.800000000000001
No reset possible
218003280Hsiao-Sheng ChenΒ πŸ‡ΉπŸ‡ΌPredictorLastaido2-PREDstep1-simulationsuccessnoip-172-31-40-253-320590:00:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11629533368159864
error_L20.02106046407953057


No reset possible
217943273jiang pengRL - TH -hhkaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-40-253-320590:10:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9672245722771572
survival_time_median14.950000000000076
deviation-center-line_median0.7299479417794719
in-drivable-lane_median0


other stats
agent_compute-ego_max0.10178059180577596
agent_compute-ego_mean0.10144069087541138
agent_compute-ego_median0.10160867849985758
agent_compute-ego_min0.10067020522223578
deviation-center-line_max2.1026509409626843
deviation-center-line_mean0.8639077472104478
deviation-center-line_min0.10357616002176412
deviation-heading_max5.5742019074857065
deviation-heading_mean3.250416195967797
deviation-heading_median4.1557501382551365
deviation-heading_min0.5185948725490829
driven_any_max3.1811841819985154
driven_any_mean1.346082295596869
driven_any_median1.378146040930617
driven_any_min0.16790510048088736
driven_lanedir_consec_max3.025978920944655
driven_lanedir_consec_mean1.1268868315235547
driven_lanedir_consec_min0.14411085837061544
driven_lanedir_max3.025978920944655
driven_lanedir_mean1.235061676724838
driven_lanedir_median1.3512600173850702
driven_lanedir_min0.14411085837061544
in-drivable-lane_max5.500000000000027
in-drivable-lane_mean1.140000000000006
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.378146040930617, "sim_physics": 0.059548176129659014, "survival_time": 14.950000000000076, "driven_lanedir": 1.3512600173850702, "sim_render-ego": 0.03666364669799805, "in-drivable-lane": 0, "agent_compute-ego": 0.10178059180577596, "deviation-heading": 4.975932456656041, "set_robot_commands": 0.05602749745051066, "deviation-center-line": 2.1026509409626843, "driven_lanedir_consec": 1.3512600173850702, "sim_compute_sim_state": 0.023431106408437093, "sim_compute_performance-ego": 0.039705588817596435, "sim_compute_robot_state-ego": 0.04153221289316813}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.790756043624597, "sim_physics": 0.057643142541249595, "survival_time": 14.950000000000076, "driven_lanedir": 1.508098798283572, "sim_render-ego": 0.03628685315450032, "in-drivable-lane": 5.500000000000027, "agent_compute-ego": 0.10167857964833578, "deviation-heading": 4.1557501382551365, "set_robot_commands": 0.05597354729970296, "deviation-center-line": 0.7299479417794719, "driven_lanedir_consec": 0.9672245722771572, "sim_compute_sim_state": 0.023627687295277915, "sim_compute_performance-ego": 0.03984079519907634, "sim_compute_robot_state-ego": 0.04199099858601888}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.16790510048088736, "sim_physics": 0.05823180410597059, "survival_time": 1.3500000000000003, "driven_lanedir": 0.14411085837061544, "sim_render-ego": 0.03520267098038285, "in-drivable-lane": 0, "agent_compute-ego": 0.10067020522223578, "deviation-heading": 0.5185948725490829, "set_robot_commands": 0.056281601941144024, "deviation-center-line": 0.10357616002176412, "driven_lanedir_consec": 0.14411085837061544, "sim_compute_sim_state": 0.025050136778089736, "sim_compute_performance-ego": 0.04026364397119592, "sim_compute_robot_state-ego": 0.041686172838564274}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.21242011094972793, "sim_physics": 0.06393779935063543, "survival_time": 1.850000000000001, "driven_lanedir": 0.14585978864027638, "sim_render-ego": 0.03678095662916029, "in-drivable-lane": 0, "agent_compute-ego": 0.10146539920085185, "deviation-heading": 1.02760160489302, "set_robot_commands": 0.05568327130498113, "deviation-center-line": 0.1176376114712955, "driven_lanedir_consec": 0.14585978864027638, "sim_compute_sim_state": 0.023646225800385345, "sim_compute_performance-ego": 0.03993089779003246, "sim_compute_robot_state-ego": 0.04191164068273596}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.1811841819985154, "sim_physics": 0.05876180171966552, "survival_time": 14.950000000000076, "driven_lanedir": 3.025978920944655, "sim_render-ego": 0.036485633850097655, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.10160867849985758, "deviation-heading": 5.5742019074857065, "set_robot_commands": 0.055640920003255205, "deviation-center-line": 1.2657260818170228, "driven_lanedir_consec": 3.025978920944655, "sim_compute_sim_state": 0.023321787516276043, "sim_compute_performance-ego": 0.03990111112594605, "sim_compute_robot_state-ego": 0.04194394191106161}}
set_robot_commands_max0.056281601941144024
set_robot_commands_mean0.055921367599918795
set_robot_commands_median0.05597354729970296
set_robot_commands_min0.055640920003255205
sim_compute_performance-ego_max0.04026364397119592
sim_compute_performance-ego_mean0.03992840738076944
sim_compute_performance-ego_median0.03990111112594605
sim_compute_performance-ego_min0.039705588817596435
sim_compute_robot_state-ego_max0.04199099858601888
sim_compute_robot_state-ego_mean0.04181299338230977
sim_compute_robot_state-ego_median0.04191164068273596
sim_compute_robot_state-ego_min0.04153221289316813
sim_compute_sim_state_max0.025050136778089736
sim_compute_sim_state_mean0.023815388759693225
sim_compute_sim_state_median0.023627687295277915
sim_compute_sim_state_min0.023321787516276043
sim_physics_max0.06393779935063543
sim_physics_mean0.05962454476943604
sim_physics_median0.05876180171966552
sim_physics_min0.057643142541249595
sim_render-ego_max0.03678095662916029
sim_render-ego_mean0.03628395226242783
sim_render-ego_median0.036485633850097655
sim_render-ego_min0.03520267098038285
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.610000000000047
survival_time_min1.3500000000000003
No reset possible
217903271jiang pengRL - TH -hhkaido2-LF-sim-validationstep1-simulationerrornoip-172-31-40-253-320590:00:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217873269jiang pengFirst test - THaido2-LFVI-sim-validationstep1-simulationhost-errornoip-172-31-40-253-320590:04:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission3269/step1-simulation-ip-172-31-40-253-32059-job21787/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217613078Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errornoip-172-31-40-253-320590:58:53
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission3078/step1-simulation-ip-172-31-40-253-32059-job21761/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217422774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errornoip-172-31-40-253-320590:27:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2774/step1-simulation-ip-172-31-40-253-32059-job21742/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217292555Andrea CensiΒ πŸ‡¨πŸ‡­challenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-40-253-320590:31:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2875407694053156
survival_time_median2.849999999999998
deviation-center-line_median0.11031194850197353
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.08044372664557563
agent_compute-ego_mean0.07755520980889408
agent_compute-ego_median0.0781632473594264
agent_compute-ego_min0.0710597038269043
deviation-center-line_max0.2701922695523504
deviation-center-line_mean0.13746050030700233
deviation-center-line_min0.07113819587235681
deviation-heading_max1.4854398920276677
deviation-heading_mean0.7236995121312619
deviation-heading_median0.6953408166028192
deviation-heading_min0.3118646573709166
driven_any_max1.934434121703833
driven_any_mean0.806757806634148
driven_any_median0.8072381933001392
driven_any_min0.20912585880423715
driven_lanedir_consec_max0.7222251056746308
driven_lanedir_consec_mean0.3962831867516217
driven_lanedir_consec_min0.1917983424483971
driven_lanedir_max0.7287863177121016
driven_lanedir_mean0.3975640776898326
driven_lanedir_median0.2875407694053156
driven_lanedir_min0.1917983424483971
in-drivable-lane_max4.04999999999999
in-drivable-lane_mean1.2133333333333305
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.2195056346525629, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.06558319746729839, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.0782163056982569, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.1038313802466335, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.039867159831954775, "sim_compute_performance-ego": 0.07127471429755888, "sim_compute_robot_state-ego": 0.07988705692521061, "sim_compute_robot_state-npc0": 0.0746260464909565, "sim_compute_robot_state-npc1": 0.0717761688921825, "sim_compute_robot_state-npc2": 0.07237421748149826, "sim_compute_robot_state-npc3": 0.07260315389518278}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.25816183620029026, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.07404196703875507, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08044372664557563, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.10852994742216888, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.04307164086235894, "sim_compute_performance-ego": 0.07583416832817926, "sim_compute_robot_state-ego": 0.08223523917021575, "sim_compute_robot_state-npc0": 0.07250777880350749, "sim_compute_robot_state-npc1": 0.07355119563915112, "sim_compute_robot_state-npc2": 0.07576217474760832, "sim_compute_robot_state-npc3": 0.07612533922548648}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.23489167140080375, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06736068236522186, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.07821435500413944, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.1053914290208083, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.04361065534444956, "sim_compute_performance-ego": 0.07417816687852909, "sim_compute_robot_state-ego": 0.08113434681525597, "sim_compute_robot_state-npc0": 0.07550524136958978, "sim_compute_robot_state-npc1": 0.07492305376590827, "sim_compute_robot_state-npc2": 0.07271870282980111, "sim_compute_robot_state-npc3": 0.07675591798929068}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.24555745877717672, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.06884954268472236, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.0781632473594264, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.10266008711697762, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.04302021495082922, "sim_compute_performance-ego": 0.07657706528379206, "sim_compute_robot_state-ego": 0.08183604792544716, "sim_compute_robot_state-npc0": 0.07390832901000977, "sim_compute_robot_state-npc1": 0.07364746980499803, "sim_compute_robot_state-npc2": 0.07597345218323824, "sim_compute_robot_state-npc3": 0.0752018878334447}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.22617914365685504, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.06809183825617252, "in-drivable-lane": 0, "agent_compute-ego": 0.0710597038269043, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.1065279608187468, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.042956310769786, "sim_compute_performance-ego": 0.0719600138456925, "sim_compute_robot_state-ego": 0.0759639429009479, "sim_compute_robot_state-npc0": 0.072590796843819, "sim_compute_robot_state-npc1": 0.07713211101034413, "sim_compute_robot_state-npc2": 0.07346878881039827, "sim_compute_robot_state-npc3": 0.07310195591138757}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.23560256116530476, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.06719955042296764, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.07836943280463125, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.1071559845232496, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.04131611188252767, "sim_compute_performance-ego": 0.07544852238075406, "sim_compute_robot_state-ego": 0.08191864163267847, "sim_compute_robot_state-npc0": 0.07534823698156021, "sim_compute_robot_state-npc1": 0.07430746976067037, "sim_compute_robot_state-npc2": 0.07434831413568235, "sim_compute_robot_state-npc3": 0.07504367127138026}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.2327690328870501, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.07055409465517316, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.07892493690763201, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.10852578708103724, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.04294885396957397, "sim_compute_performance-ego": 0.07647244930267334, "sim_compute_robot_state-ego": 0.0893042836870466, "sim_compute_robot_state-npc0": 0.07814728362219674, "sim_compute_robot_state-npc1": 0.07706974744796753, "sim_compute_robot_state-npc2": 0.07627772092819214, "sim_compute_robot_state-npc3": 0.07436978135790144}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.2358517875410106, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.067522940570361, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07997829946753097, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.10630413930710048, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.042178235641897543, "sim_compute_performance-ego": 0.07530116708311316, "sim_compute_robot_state-ego": 0.08133644273836318, "sim_compute_robot_state-npc0": 0.07149099323847523, "sim_compute_robot_state-npc1": 0.07464958870247619, "sim_compute_robot_state-npc2": 0.07569086714966657, "sim_compute_robot_state-npc3": 0.07399351956093148}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.21845932339513024, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06651957090510878, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.07751615380131921, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.10490727147390676, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.04290551640266596, "sim_compute_performance-ego": 0.07289280170618101, "sim_compute_robot_state-ego": 0.07735852585282436, "sim_compute_robot_state-npc0": 0.07464293823685757, "sim_compute_robot_state-npc1": 0.07222756119661553, "sim_compute_robot_state-npc2": 0.07552563312441804, "sim_compute_robot_state-npc3": 0.07382704213608143}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.2584447952417227, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.06911823382744423, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07742112416487473, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.10255875037266658, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.0429919774715717, "sim_compute_performance-ego": 0.07421740201803353, "sim_compute_robot_state-ego": 0.08129048347473145, "sim_compute_robot_state-npc0": 0.07252391485067514, "sim_compute_robot_state-npc1": 0.0749424145771907, "sim_compute_robot_state-npc2": 0.07498221214000995, "sim_compute_robot_state-npc3": 0.07645568480858436}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.22591124534606932, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.06544881184895833, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07907247861226399, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.10319508234659833, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.03914891878763835, "sim_compute_performance-ego": 0.07184505462646484, "sim_compute_robot_state-ego": 0.08560241381327312, "sim_compute_robot_state-npc0": 0.07111638069152831, "sim_compute_robot_state-npc1": 0.07192375500996907, "sim_compute_robot_state-npc2": 0.07019520441691081, "sim_compute_robot_state-npc3": 0.07366735140482585}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.23550736336481004, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.06491469201587495, "in-drivable-lane": 0, "agent_compute-ego": 0.07737175623575847, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.10178152720133464, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.03979471751621792, "sim_compute_performance-ego": 0.07706381025768462, "sim_compute_robot_state-ego": 0.07928457714262463, "sim_compute_robot_state-npc0": 0.08175331070309594, "sim_compute_robot_state-npc1": 0.07306471325102307, "sim_compute_robot_state-npc2": 0.0784388610294887, "sim_compute_robot_state-npc3": 0.07897203309195382}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.24970657880916153, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.07044074701708417, "in-drivable-lane": 1.15, "agent_compute-ego": 0.07633450419403785, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.10558614619942598, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.04064113040303075, "sim_compute_performance-ego": 0.07402057425920354, "sim_compute_robot_state-ego": 0.07973450283671535, "sim_compute_robot_state-npc0": 0.07295583569726279, "sim_compute_robot_state-npc1": 0.07369157879851586, "sim_compute_robot_state-npc2": 0.07330566783284032, "sim_compute_robot_state-npc3": 0.07272391541059627}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.23370339189256945, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.06477900913783483, "in-drivable-lane": 0, "agent_compute-ego": 0.07670636687959943, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.1040900434766497, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.0414490955216544, "sim_compute_performance-ego": 0.07465423856462751, "sim_compute_robot_state-ego": 0.07978092772620064, "sim_compute_robot_state-npc0": 0.07347066913332258, "sim_compute_robot_state-npc1": 0.07698073557444982, "sim_compute_robot_state-npc2": 0.07360712971006121, "sim_compute_robot_state-npc3": 0.07616896288735527}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.251220843371223, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.06494777810339834, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.07553575553146064, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.1042493371402516, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.04941017019982431, "sim_compute_performance-ego": 0.07288393319821825, "sim_compute_robot_state-ego": 0.08150235344381894, "sim_compute_robot_state-npc0": 0.07159684218612372, "sim_compute_robot_state-npc1": 0.07215159547095205, "sim_compute_robot_state-npc2": 0.07136722172007841, "sim_compute_robot_state-npc3": 0.0732121935077742}}
set_robot_commands_max0.10852994742216888
set_robot_commands_mean0.10501965824983708
set_robot_commands_median0.10490727147390676
set_robot_commands_min0.10178152720133464
sim_compute_performance-ego_max0.07706381025768462
sim_compute_performance-ego_mean0.07430827213538037
sim_compute_performance-ego_median0.07421740201803353
sim_compute_performance-ego_min0.07127471429755888
sim_compute_robot_state-ego_max0.0893042836870466
sim_compute_robot_state-ego_mean0.08121131907235693
sim_compute_robot_state-ego_median0.08129048347473145
sim_compute_robot_state-ego_min0.0759639429009479
sim_compute_robot_state-npc0_max0.08175331070309594
sim_compute_robot_state-npc0_mean0.07414563985726538
sim_compute_robot_state-npc0_median0.07347066913332258
sim_compute_robot_state-npc0_min0.07111638069152831
sim_compute_robot_state-npc1_max0.07713211101034413
sim_compute_robot_state-npc1_mean0.07413594392682761
sim_compute_robot_state-npc1_median0.07369157879851586
sim_compute_robot_state-npc1_min0.0717761688921825
sim_compute_robot_state-npc2_max0.0784388610294887
sim_compute_robot_state-npc2_mean0.07426907788265953
sim_compute_robot_state-npc2_median0.07434831413568235
sim_compute_robot_state-npc2_min0.07019520441691081
sim_compute_robot_state-npc3_max0.07897203309195382
sim_compute_robot_state-npc3_mean0.07481482735281177
sim_compute_robot_state-npc3_median0.07436978135790144
sim_compute_robot_state-npc3_min0.07260315389518278
sim_compute_sim_state_max0.04941017019982431
sim_compute_sim_state_mean0.042354047303732066
sim_compute_sim_state_median0.04290551640266596
sim_compute_sim_state_min0.03914891878763835
sim_physics_max0.2584447952417227
sim_physics_mean0.237431511180116
sim_physics_median0.23550736336481004
sim_physics_min0.21845932339513024
sim_render-ego_max0.07404196703875507
sim_render-ego_mean0.06769151042109171
sim_render-ego_median0.06736068236522186
sim_render-ego_min0.06477900913783483
simulation-passed1
survival_time_max6.999999999999983
survival_time_mean3.043333333333329
survival_time_min1.0500000000000005
No reset possible
217072568Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationhost-errornoip-172-31-40-253-320590:29:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2568/step1-simulation-ip-172-31-40-253-32059-job21707/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
216962723jiang pengtest for ppoaido2-LFVI-sim-testingstep1-simulationerrornoip-172-31-40-253-320590:02:18
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible