Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 21922
3353
FANG MEIYI Β πΈπ¬test aido2-LFV-sim-testing
step1-simulation host-error no ip-172-31-40-253-32059
2019-05-13 04:40:32+00:00 2019-05-13 05:01:49+00:00 0:21:17 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3353/step1-simulation-ip-172-31-40-253-32059-job21922/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21892
3339
Anastasiya Nikolskaya Β π·πΊSSegm aido2-LF-sim-validation
step1-simulation success no ip-172-31-40-253-32059
2019-05-12 15:28:27+00:00 2019-05-12 15:39:48+00:00 0:11:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.5452789181043742 survival_time_median 6.149999999999986 deviation-center-line_median 0.5966806902836215 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.1031775991121928 agent_compute-ego_mean 0.07324918655171479 agent_compute-ego_median 0.0653142356053954 agent_compute-ego_min 0.06324119878009082 deviation-center-line_max 1.73036662742397 deviation-center-line_mean 0.7659584758280703 deviation-center-line_min 0.1706875522353031 deviation-heading_max 1.8927891298471584 deviation-heading_mean 1.1046496699745905 deviation-heading_median 1.0472711044217655 deviation-heading_min 0.28845120548478637 driven_any_max 4.061881822282747 driven_any_mean 1.9257702240501569 driven_any_median 1.5767974958574549 driven_any_min 0.38187129521191215 driven_lanedir_consec_max 3.988807046887926 driven_lanedir_consec_mean 1.875176570879459 driven_lanedir_consec_min 0.3770443797628027 driven_lanedir_max 3.988807046887926 driven_lanedir_mean 1.875176570879459 driven_lanedir_median 1.5452789181043742 driven_lanedir_min 0.3770443797628027 in-drivable-lane_max 0.15000000000000213 in-drivable-lane_mean 0.030000000000000426 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.0307814243356654, "sim_physics": 0.06457249903371917, "survival_time": 11.65000000000003, "driven_lanedir": 2.9041101801231584, "sim_render-ego": 0.03814441247047785, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.0653142356053954, "deviation-heading": 1.7170024796746235, "set_robot_commands": 0.057766693344443655, "deviation-center-line": 1.145240676879527, "driven_lanedir_consec": 2.9041101801231584, "sim_compute_sim_state": 0.0247061221896323, "sim_compute_performance-ego": 0.04095354816944302, "sim_compute_robot_state-ego": 0.04352678147508351}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5767974958574549, "sim_physics": 0.06276624764853377, "survival_time": 6.149999999999986, "driven_lanedir": 1.5452789181043742, "sim_render-ego": 0.03751885987878815, "in-drivable-lane": 0, "agent_compute-ego": 0.06324119878009082, "deviation-heading": 1.0472711044217655, "set_robot_commands": 0.057552368660283286, "deviation-center-line": 0.5966806902836215, "driven_lanedir_consec": 1.5452789181043742, "sim_compute_sim_state": 0.02476734262171799, "sim_compute_performance-ego": 0.04215197446869641, "sim_compute_robot_state-ego": 0.043234005206968726}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.38187129521191215, "sim_physics": 0.06504276219536276, "survival_time": 1.7000000000000008, "driven_lanedir": 0.3770443797628027, "sim_render-ego": 0.0375592778710758, "in-drivable-lane": 0, "agent_compute-ego": 0.06439959301668055, "deviation-heading": 0.28845120548478637, "set_robot_commands": 0.05726491703706629, "deviation-center-line": 0.1706875522353031, "driven_lanedir_consec": 0.3770443797628027, "sim_compute_sim_state": 0.02462281199062572, "sim_compute_performance-ego": 0.04117110196281882, "sim_compute_robot_state-ego": 0.04428148970884435}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5775190825630045, "sim_physics": 0.07692068815231323, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5606423295190344, "sim_render-ego": 0.041118244330088295, "in-drivable-lane": 0, "agent_compute-ego": 0.07011330624421437, "deviation-heading": 0.5777344304446188, "set_robot_commands": 0.06422353287537892, "deviation-center-line": 0.1868168323179305, "driven_lanedir_consec": 0.5606423295190344, "sim_compute_sim_state": 0.02876817186673482, "sim_compute_performance-ego": 0.04454732437928518, "sim_compute_robot_state-ego": 0.048106382290522255}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.061881822282747, "sim_physics": 0.10789209763209023, "survival_time": 14.950000000000076, "driven_lanedir": 3.988807046887926, "sim_render-ego": 0.056422719160715736, "in-drivable-lane": 0, "agent_compute-ego": 0.1031775991121928, "deviation-heading": 1.8927891298471584, "set_robot_commands": 0.09165535926818848, "deviation-center-line": 1.73036662742397, "driven_lanedir_consec": 3.988807046887926, "sim_compute_sim_state": 0.035407063166300455, "sim_compute_performance-ego": 0.06236965815226237, "sim_compute_robot_state-ego": 0.0661840303738912}}set_robot_commands_max 0.09165535926818848 set_robot_commands_mean 0.06569257423707212 set_robot_commands_median 0.057766693344443655 set_robot_commands_min 0.05726491703706629 sim_compute_performance-ego_max 0.06236965815226237 sim_compute_performance-ego_mean 0.04623872142650117 sim_compute_performance-ego_median 0.04215197446869641 sim_compute_performance-ego_min 0.04095354816944302 sim_compute_robot_state-ego_max 0.0661840303738912 sim_compute_robot_state-ego_mean 0.049066537811062 sim_compute_robot_state-ego_median 0.04428148970884435 sim_compute_robot_state-ego_min 0.043234005206968726 sim_compute_sim_state_max 0.035407063166300455 sim_compute_sim_state_mean 0.02765430236700226 sim_compute_sim_state_median 0.02476734262171799 sim_compute_sim_state_min 0.02462281199062572 sim_physics_max 0.10789209763209023 sim_physics_mean 0.07543885893240383 sim_physics_median 0.06504276219536276 sim_physics_min 0.06276624764853377 sim_render-ego_max 0.056422719160715736 sim_render-ego_mean 0.04215270274222917 sim_render-ego_median 0.03814441247047785 sim_render-ego_min 0.03751885987878815 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 7.370000000000019 survival_time_min 1.7000000000000008
No reset possible 21881
3330
Anastasiya Nikolskaya Β π·πΊJetBrains Research aido2-LF-sim-validation
step1-simulation success no ip-172-31-40-253-32059
2019-05-10 21:32:32+00:00 2019-05-10 21:47:42+00:00 0:15:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.6272003050971007 survival_time_median 14.950000000000076 deviation-center-line_median 0.960927415014256 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06953730742136638 agent_compute-ego_mean 0.06510303958257038 agent_compute-ego_median 0.06531146923700969 agent_compute-ego_min 0.06052603085835775 deviation-center-line_max 1.4224269616166023 deviation-center-line_mean 1.102202546380739 deviation-center-line_min 0.838354178153161 deviation-heading_max 3.613538095202144 deviation-heading_mean 2.3309362335084107 deviation-heading_median 2.1665646431565206 deviation-heading_min 1.364414472518237 driven_any_max 2.9228947376695236 driven_any_mean 2.7177553160975356 driven_any_median 2.678769635585334 driven_any_min 2.542847278628334 driven_lanedir_consec_max 2.7315628134578924 driven_lanedir_consec_mean 2.609741760590172 driven_lanedir_consec_min 2.434874911231563 driven_lanedir_max 2.7315628134578924 driven_lanedir_mean 2.609741760590172 driven_lanedir_median 2.6272003050971007 driven_lanedir_min 2.434874911231563 in-drivable-lane_max 1.5499999999999945 in-drivable-lane_mean 0.3799999999999986 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.542847278628334, "sim_physics": 0.059964078267415365, "survival_time": 14.950000000000076, "driven_lanedir": 2.434874911231563, "sim_render-ego": 0.03840419371922811, "in-drivable-lane": 0, "agent_compute-ego": 0.06953730742136638, "deviation-heading": 3.613538095202144, "set_robot_commands": 0.0587388277053833, "deviation-center-line": 0.960927415014256, "driven_lanedir_consec": 2.434874911231563, "sim_compute_sim_state": 0.025330577691396076, "sim_compute_performance-ego": 0.04186896085739136, "sim_compute_robot_state-ego": 0.04461102406183878}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.82636245516923, "sim_physics": 0.06118175268173218, "survival_time": 14.950000000000076, "driven_lanedir": 2.7315628134578924, "sim_render-ego": 0.0378719433148702, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.06052603085835775, "deviation-heading": 2.0734449080849955, "set_robot_commands": 0.05853808879852295, "deviation-center-line": 1.4224269616166023, "driven_lanedir_consec": 2.7315628134578924, "sim_compute_sim_state": 0.025142463048299153, "sim_compute_performance-ego": 0.04156002600987752, "sim_compute_robot_state-ego": 0.04477403879165649}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.9228947376695236, "sim_physics": 0.0594937801361084, "survival_time": 14.950000000000076, "driven_lanedir": 2.6869298104021317, "sim_render-ego": 0.03835391918818156, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.06531146923700969, "deviation-heading": 1.364414472518237, "set_robot_commands": 0.05775373856226603, "deviation-center-line": 1.3529483964915885, "driven_lanedir_consec": 2.6869298104021317, "sim_compute_sim_state": 0.025584874947865804, "sim_compute_performance-ego": 0.042325332959493, "sim_compute_robot_state-ego": 0.04490900913874308}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.6179024734352563, "sim_physics": 0.0636501407623291, "survival_time": 14.950000000000076, "driven_lanedir": 2.5681409627621714, "sim_render-ego": 0.03800939162572225, "in-drivable-lane": 0, "agent_compute-ego": 0.06472131093343099, "deviation-heading": 2.436719048580157, "set_robot_commands": 0.05831738948822021, "deviation-center-line": 0.838354178153161, "driven_lanedir_consec": 2.5681409627621714, "sim_compute_sim_state": 0.025530664126078288, "sim_compute_performance-ego": 0.041465974648793535, "sim_compute_robot_state-ego": 0.044580503304799395}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.678769635585334, "sim_physics": 0.06010165452957153, "survival_time": 14.950000000000076, "driven_lanedir": 2.6272003050971007, "sim_render-ego": 0.03807450930277507, "in-drivable-lane": 0, "agent_compute-ego": 0.06541907946268717, "deviation-heading": 2.1665646431565206, "set_robot_commands": 0.057641074657440186, "deviation-center-line": 0.9363557806280876, "driven_lanedir_consec": 2.6272003050971007, "sim_compute_sim_state": 0.025720451672871902, "sim_compute_performance-ego": 0.041836982568105065, "sim_compute_robot_state-ego": 0.04516014575958252}}set_robot_commands_max 0.0587388277053833 set_robot_commands_mean 0.05819782384236653 set_robot_commands_median 0.05831738948822021 set_robot_commands_min 0.057641074657440186 sim_compute_performance-ego_max 0.042325332959493 sim_compute_performance-ego_mean 0.041811455408732094 sim_compute_performance-ego_median 0.041836982568105065 sim_compute_performance-ego_min 0.041465974648793535 sim_compute_robot_state-ego_max 0.04516014575958252 sim_compute_robot_state-ego_mean 0.04480694421132406 sim_compute_robot_state-ego_median 0.04477403879165649 sim_compute_robot_state-ego_min 0.044580503304799395 sim_compute_sim_state_max 0.025720451672871902 sim_compute_sim_state_mean 0.02546180629730225 sim_compute_sim_state_median 0.025530664126078288 sim_compute_sim_state_min 0.025142463048299153 sim_physics_max 0.0636501407623291 sim_physics_mean 0.06087828127543131 sim_physics_median 0.06010165452957153 sim_physics_min 0.0594937801361084 sim_render-ego_max 0.03840419371922811 sim_render-ego_mean 0.038142791430155434 sim_render-ego_median 0.03807450930277507 sim_render-ego_min 0.0378719433148702 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 21880
3329
Anastasiya Nikolskaya Β π·πΊJetBrains Research aido2-LF-sim-validation
step1-simulation success no ip-172-31-40-253-32059
2019-05-10 20:45:18+00:00 2019-05-10 20:57:31+00:00 0:12:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.8243543121412151 survival_time_median 10.15000000000001 deviation-center-line_median 0.7141016430982251 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.05800590991973877 agent_compute-ego_mean 0.05662337050969557 agent_compute-ego_median 0.056424849139058535 agent_compute-ego_min 0.05571911715659775 deviation-center-line_max 0.8833812092090513 deviation-center-line_mean 0.7494585328390408 deviation-center-line_min 0.6132312122789928 deviation-heading_max 2.5489289767236927 deviation-heading_mean 1.852828334836256 deviation-heading_median 2.1572442108893677 deviation-heading_min 0.5465164803029868 driven_any_max 2.625715349099222 driven_any_mean 1.93877289618443 driven_any_median 1.8566070038682676 driven_any_min 1.151312300779794 driven_lanedir_consec_max 2.565446610864985 driven_lanedir_consec_mean 1.830478946373772 driven_lanedir_consec_min 1.1448185876736272 driven_lanedir_max 2.565446610864985 driven_lanedir_mean 1.830478946373772 driven_lanedir_median 1.8243543121412151 driven_lanedir_min 1.1448185876736272 in-drivable-lane_max 1.4499999999999948 in-drivable-lane_mean 0.5400000000000025 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5726451582627616, "sim_physics": 0.06300013224283854, "survival_time": 14.950000000000076, "driven_lanedir": 2.3593013382555195, "sim_render-ego": 0.03865593353907267, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.05800590991973877, "deviation-heading": 2.1572442108893677, "set_robot_commands": 0.07331063906351726, "deviation-center-line": 0.8257556773092203, "driven_lanedir_consec": 2.3593013382555195, "sim_compute_sim_state": 0.02567090113957723, "sim_compute_performance-ego": 0.04179200887680054, "sim_compute_robot_state-ego": 0.044248874187469485}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4875846689121044, "sim_physics": 0.062304196859660904, "survival_time": 9.5, "driven_lanedir": 1.2584738829335138, "sim_render-ego": 0.03788702362462094, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.05604046520433928, "deviation-heading": 2.397423479938128, "set_robot_commands": 0.073407402791475, "deviation-center-line": 0.7141016430982251, "driven_lanedir_consec": 1.2584738829335138, "sim_compute_sim_state": 0.02609423838163677, "sim_compute_performance-ego": 0.04220290184020996, "sim_compute_robot_state-ego": 0.04483090199922261}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.151312300779794, "sim_physics": 0.06448112415666339, "survival_time": 5.949999999999987, "driven_lanedir": 1.1448185876736272, "sim_render-ego": 0.03812775291314646, "in-drivable-lane": 0, "agent_compute-ego": 0.05571911715659775, "deviation-heading": 0.5465164803029868, "set_robot_commands": 0.07491011178794027, "deviation-center-line": 0.6132312122789928, "driven_lanedir_consec": 1.1448185876736272, "sim_compute_sim_state": 0.025691869879971033, "sim_compute_performance-ego": 0.0417436691893249, "sim_compute_robot_state-ego": 0.04473751933634782}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.8566070038682676, "sim_physics": 0.06344946029738252, "survival_time": 10.15000000000001, "driven_lanedir": 1.8243543121412151, "sim_render-ego": 0.03823934869813214, "in-drivable-lane": 0, "agent_compute-ego": 0.056424849139058535, "deviation-heading": 1.614028526327104, "set_robot_commands": 0.07344981837155197, "deviation-center-line": 0.710822922299714, "driven_lanedir_consec": 1.8243543121412151, "sim_compute_sim_state": 0.025799825273711104, "sim_compute_performance-ego": 0.042050849040740815, "sim_compute_robot_state-ego": 0.04438328273190653}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.625715349099222, "sim_physics": 0.062292640209198, "survival_time": 14.950000000000076, "driven_lanedir": 2.565446610864985, "sim_render-ego": 0.03870818376541138, "in-drivable-lane": 0, "agent_compute-ego": 0.05692651112874349, "deviation-heading": 2.5489289767236927, "set_robot_commands": 0.07367751280466715, "deviation-center-line": 0.8833812092090513, "driven_lanedir_consec": 2.565446610864985, "sim_compute_sim_state": 0.02588268995285034, "sim_compute_performance-ego": 0.04211688121159871, "sim_compute_robot_state-ego": 0.04479145050048828}}set_robot_commands_max 0.07491011178794027 set_robot_commands_mean 0.07375109696383034 set_robot_commands_median 0.07344981837155197 set_robot_commands_min 0.07331063906351726 sim_compute_performance-ego_max 0.04220290184020996 sim_compute_performance-ego_mean 0.04198126203173498 sim_compute_performance-ego_median 0.042050849040740815 sim_compute_performance-ego_min 0.0417436691893249 sim_compute_robot_state-ego_max 0.04483090199922261 sim_compute_robot_state-ego_mean 0.04459840575108694 sim_compute_robot_state-ego_median 0.04473751933634782 sim_compute_robot_state-ego_min 0.044248874187469485 sim_compute_sim_state_max 0.02609423838163677 sim_compute_sim_state_mean 0.025827904925549296 sim_compute_sim_state_median 0.025799825273711104 sim_compute_sim_state_min 0.02567090113957723 sim_physics_max 0.06448112415666339 sim_physics_mean 0.06310551075314867 sim_physics_median 0.06300013224283854 sim_physics_min 0.062292640209198 sim_render-ego_max 0.03870818376541138 sim_render-ego_mean 0.03832364850807672 sim_render-ego_median 0.03823934869813214 sim_render-ego_min 0.03788702362462094 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.100000000000028 survival_time_min 5.949999999999987
No reset possible 21870
3328
jiang peng RL - TH -xyz aido2-LFV-sim-validation
step1-simulation host-error no ip-172-31-40-253-32059
2019-05-10 09:54:25+00:00 2019-05-10 10:00:07+00:00 0:05:42 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission3328/step1-simulation-ip-172-31-40-253-32059-job21870/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21865
3327
jiang peng RL - TH -xyz aido2-LFV-sim-validation
step1-simulation success no ip-172-31-40-253-32059
2019-05-10 09:35:30+00:00 2019-05-10 09:41:26+00:00 0:05:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2055561475764345 survival_time_median 3.8499999999999943 deviation-center-line_median 0.10722396285945332 in-drivable-lane_median 0.9499999999999966
other stats agent_compute-ego_max 0.10110037825828376 agent_compute-ego_mean 0.0993952721541533 agent_compute-ego_median 0.09924079226208972 agent_compute-ego_min 0.09694405259757206 deviation-center-line_max 0.1591419273019051 deviation-center-line_mean 0.1137316987607003 deviation-center-line_min 0.08570557570179192 deviation-heading_max 0.837355317954609 deviation-heading_mean 0.6160125520667027 deviation-heading_median 0.6924807922772159 deviation-heading_min 0.3731951801352031 driven_any_max 1.6127589168043217 driven_any_mean 1.2242311624482871 driven_any_median 1.58069041008794 driven_any_min 0.3259989150652587 driven_lanedir_consec_max 1.2447694149322088 driven_lanedir_consec_mean 0.9216955080379544 driven_lanedir_consec_min 0.2475515570008162 driven_lanedir_max 1.2447694149322088 driven_lanedir_mean 0.9216955080379544 driven_lanedir_median 1.2055561475764345 driven_lanedir_min 0.2475515570008162 in-drivable-lane_max 1.0499999999999965 in-drivable-lane_mean 0.7099999999999979 in-drivable-lane_min 0.05000000000000005 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.99583517356703, "sim_physics": 0.09136066325875215, "survival_time": 2.1500000000000004, "driven_lanedir": 0.6861327872874248, "sim_render-ego": 0.03614295360653899, "in-drivable-lane": 0.4999999999999995, "agent_compute-ego": 0.10110037825828376, "deviation-heading": 0.3731951801352031, "set_robot_commands": 0.05535680748695551, "deviation-center-line": 0.09762238468713098, "driven_lanedir_consec": 0.6861327872874248, "sim_compute_sim_state": 0.02316304140312727, "sim_compute_performance-ego": 0.03920622204625329, "sim_compute_robot_state-ego": 0.041686740032462186, "sim_compute_robot_state-npc0": 0.041082931119342185, "sim_compute_robot_state-npc1": 0.04054891785909963, "sim_compute_robot_state-npc2": 0.04028395164844602, "sim_compute_robot_state-npc3": 0.04005200363868891}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3259989150652587, "sim_physics": 0.09419393539428712, "survival_time": 1.4500000000000006, "driven_lanedir": 0.2475515570008162, "sim_render-ego": 0.03498592047855772, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09694405259757206, "deviation-heading": 0.6924807922772159, "set_robot_commands": 0.05464585896196037, "deviation-center-line": 0.08570557570179192, "driven_lanedir_consec": 0.2475515570008162, "sim_compute_sim_state": 0.023000256768588363, "sim_compute_performance-ego": 0.03859859499438056, "sim_compute_robot_state-ego": 0.04113373263128873, "sim_compute_robot_state-npc0": 0.0407174537921774, "sim_compute_robot_state-npc1": 0.04066305324949067, "sim_compute_robot_state-npc2": 0.03957477931318612, "sim_compute_robot_state-npc3": 0.04025203606178021}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6127589168043217, "sim_physics": 0.10067501625457367, "survival_time": 3.8499999999999943, "driven_lanedir": 1.2055561475764345, "sim_render-ego": 0.036450952678531795, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.09924079226208972, "deviation-heading": 0.4018255432991754, "set_robot_commands": 0.05555649546833782, "deviation-center-line": 0.1189646432532202, "driven_lanedir_consec": 1.2055561475764345, "sim_compute_sim_state": 0.02297625913248434, "sim_compute_performance-ego": 0.038909534355262655, "sim_compute_robot_state-ego": 0.04126203834236442, "sim_compute_robot_state-npc0": 0.041091962294145065, "sim_compute_robot_state-npc1": 0.04021765969016335, "sim_compute_robot_state-npc2": 0.039861233203442065, "sim_compute_robot_state-npc3": 0.03963547557979435}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.58069041008794, "sim_physics": 0.09833481452044318, "survival_time": 4.249999999999993, "driven_lanedir": 1.224467633392888, "sim_render-ego": 0.0362550090341007, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.1008223617778105, "deviation-heading": 0.7752059266673098, "set_robot_commands": 0.05505424387314741, "deviation-center-line": 0.1591419273019051, "driven_lanedir_consec": 1.224467633392888, "sim_compute_sim_state": 0.02311567699207979, "sim_compute_performance-ego": 0.03878650384790757, "sim_compute_robot_state-ego": 0.04175346598905676, "sim_compute_robot_state-npc0": 0.04051520123201258, "sim_compute_robot_state-npc1": 0.04017159798566033, "sim_compute_robot_state-npc2": 0.040020900614121384, "sim_compute_robot_state-npc3": 0.039863000196569104}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.605872396716886, "sim_physics": 0.08959791508126766, "survival_time": 4.699999999999991, "driven_lanedir": 1.2447694149322088, "sim_render-ego": 0.03622204699414842, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.0988687758750104, "deviation-heading": 0.837355317954609, "set_robot_commands": 0.05480950943967129, "deviation-center-line": 0.10722396285945332, "driven_lanedir_consec": 1.2447694149322088, "sim_compute_sim_state": 0.02313157852659834, "sim_compute_performance-ego": 0.0397123174464449, "sim_compute_robot_state-ego": 0.04137569792727207, "sim_compute_robot_state-npc0": 0.041000447374709106, "sim_compute_robot_state-npc1": 0.04018310536729529, "sim_compute_robot_state-npc2": 0.039678875436174106, "sim_compute_robot_state-npc3": 0.03951370208821398}}set_robot_commands_max 0.05555649546833782 set_robot_commands_mean 0.05508458304601448 set_robot_commands_median 0.05505424387314741 set_robot_commands_min 0.05464585896196037 sim_compute_performance-ego_max 0.0397123174464449 sim_compute_performance-ego_mean 0.0390426345380498 sim_compute_performance-ego_median 0.038909534355262655 sim_compute_performance-ego_min 0.03859859499438056 sim_compute_robot_state-ego_max 0.04175346598905676 sim_compute_robot_state-ego_mean 0.041442334984488835 sim_compute_robot_state-ego_median 0.04137569792727207 sim_compute_robot_state-ego_min 0.04113373263128873 sim_compute_robot_state-npc0_max 0.041091962294145065 sim_compute_robot_state-npc0_mean 0.040881599162477265 sim_compute_robot_state-npc0_median 0.041000447374709106 sim_compute_robot_state-npc0_min 0.04051520123201258 sim_compute_robot_state-npc1_max 0.04066305324949067 sim_compute_robot_state-npc1_mean 0.040356866830341856 sim_compute_robot_state-npc1_median 0.04021765969016335 sim_compute_robot_state-npc1_min 0.04017159798566033 sim_compute_robot_state-npc2_max 0.04028395164844602 sim_compute_robot_state-npc2_mean 0.039883948043073936 sim_compute_robot_state-npc2_median 0.039861233203442065 sim_compute_robot_state-npc2_min 0.03957477931318612 sim_compute_robot_state-npc3_max 0.04025203606178021 sim_compute_robot_state-npc3_mean 0.03986324351300931 sim_compute_robot_state-npc3_median 0.039863000196569104 sim_compute_robot_state-npc3_min 0.03951370208821398 sim_compute_sim_state_max 0.02316304140312727 sim_compute_sim_state_mean 0.02307736256457562 sim_compute_sim_state_median 0.02311567699207979 sim_compute_sim_state_min 0.02297625913248434 sim_physics_max 0.10067501625457367 sim_physics_mean 0.09483246890186474 sim_physics_median 0.09419393539428712 sim_physics_min 0.08959791508126766 sim_render-ego_max 0.036450952678531795 sim_render-ego_mean 0.036011376558375524 sim_render-ego_median 0.03622204699414842 sim_render-ego_min 0.03498592047855772 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2799999999999963 survival_time_min 1.4500000000000006
No reset possible 21854
3320
jiang peng RL - TH - shi aido2-LF-sim-validation
step1-simulation success no ip-172-31-40-253-32059
2019-05-10 04:25:11+00:00 2019-05-10 04:35:02+00:00 0:09:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2479134785809889 survival_time_median 7.7499999999999805 deviation-center-line_median 0.47088649158348106 in-drivable-lane_median 1.499999999999995
other stats agent_compute-ego_max 0.10236926038726037 agent_compute-ego_mean 0.10160753826840992 agent_compute-ego_median 0.10164652903874716 agent_compute-ego_min 0.10073183139165244 deviation-center-line_max 0.978541394887804 deviation-center-line_mean 0.49380753654550863 deviation-center-line_min 0.13051676065087936 deviation-heading_max 2.2675713867933935 deviation-heading_mean 1.101324160373758 deviation-heading_median 1.069816635199198 deviation-heading_min 0.33594692864594 driven_any_max 3.4061292932069978 driven_any_mean 1.7135671479175325 driven_any_median 1.6262803068872898 driven_any_min 0.7640090755352797 driven_lanedir_consec_max 3.085956908327278 driven_lanedir_consec_mean 1.4401141917716929 driven_lanedir_consec_min 0.6315074806047392 driven_lanedir_max 3.0859599860489486 driven_lanedir_mean 1.4401148073160268 driven_lanedir_median 1.2479134785809889 driven_lanedir_min 0.6315074806047392 in-drivable-lane_max 13.000000000000076 in-drivable-lane_mean 3.980000000000015 in-drivable-lane_min 0.2499999999999991 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7640090755352797, "sim_physics": 0.05885317802429199, "survival_time": 14.950000000000076, "driven_lanedir": 0.6315074806047392, "sim_render-ego": 0.03634937047958374, "in-drivable-lane": 13.000000000000076, "agent_compute-ego": 0.10073183139165244, "deviation-heading": 0.33594692864594, "set_robot_commands": 0.05549832344055176, "deviation-center-line": 0.13051676065087936, "driven_lanedir_consec": 0.6315074806047392, "sim_compute_sim_state": 0.023988468647003172, "sim_compute_performance-ego": 0.03993418137232463, "sim_compute_robot_state-ego": 0.0422970175743103}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0070675398918496, "sim_physics": 0.06265013632567032, "survival_time": 2.3, "driven_lanedir": 0.8807100708369991, "sim_render-ego": 0.03569250003151272, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.10123665436454442, "deviation-heading": 0.6462080980836691, "set_robot_commands": 0.055235479189002, "deviation-center-line": 0.16841061816175132, "driven_lanedir_consec": 0.8807100708369991, "sim_compute_sim_state": 0.02393817901611328, "sim_compute_performance-ego": 0.04014538682025412, "sim_compute_robot_state-ego": 0.04210207254990288}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.4061292932069978, "sim_physics": 0.05811776558558146, "survival_time": 14.950000000000076, "driven_lanedir": 3.0859599860489486, "sim_render-ego": 0.03670175790786743, "in-drivable-lane": 4.35000000000001, "agent_compute-ego": 0.10164652903874716, "deviation-heading": 2.2675713867933935, "set_robot_commands": 0.055733289718627926, "deviation-center-line": 0.978541394887804, "driven_lanedir_consec": 3.085956908327278, "sim_compute_sim_state": 0.023788030942281088, "sim_compute_performance-ego": 0.040303839842478435, "sim_compute_robot_state-ego": 0.04190142790476481}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6262803068872898, "sim_physics": 0.0595072778333135, "survival_time": 5.949999999999987, "driven_lanedir": 1.2479134785809889, "sim_render-ego": 0.0365168006480241, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.10236926038726037, "deviation-heading": 1.1870777531465897, "set_robot_commands": 0.05626132107582413, "deviation-center-line": 0.47088649158348106, "driven_lanedir_consec": 1.2479134785809889, "sim_compute_sim_state": 0.023541111906035608, "sim_compute_performance-ego": 0.040722921115009726, "sim_compute_robot_state-ego": 0.04201588911168715}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7643495240662446, "sim_physics": 0.05751922207493936, "survival_time": 7.7499999999999805, "driven_lanedir": 1.354483020508459, "sim_render-ego": 0.036730206397271925, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.10205341615984516, "deviation-heading": 1.069816635199198, "set_robot_commands": 0.056526319442256806, "deviation-center-line": 0.7206824174436272, "driven_lanedir_consec": 1.354483020508459, "sim_compute_sim_state": 0.023842262452648533, "sim_compute_performance-ego": 0.03992735801204558, "sim_compute_robot_state-ego": 0.04224650629105106}}set_robot_commands_max 0.056526319442256806 set_robot_commands_mean 0.05585094657325253 set_robot_commands_median 0.055733289718627926 set_robot_commands_min 0.055235479189002 sim_compute_performance-ego_max 0.040722921115009726 sim_compute_performance-ego_mean 0.04020673743242249 sim_compute_performance-ego_median 0.04014538682025412 sim_compute_performance-ego_min 0.03992735801204558 sim_compute_robot_state-ego_max 0.0422970175743103 sim_compute_robot_state-ego_mean 0.04211258268634324 sim_compute_robot_state-ego_median 0.04210207254990288 sim_compute_robot_state-ego_min 0.04190142790476481 sim_compute_sim_state_max 0.023988468647003172 sim_compute_sim_state_mean 0.023819610592816336 sim_compute_sim_state_median 0.023842262452648533 sim_compute_sim_state_min 0.023541111906035608 sim_physics_max 0.06265013632567032 sim_physics_mean 0.05932951596875933 sim_physics_median 0.05885317802429199 sim_physics_min 0.05751922207493936 sim_render-ego_max 0.036730206397271925 sim_render-ego_mean 0.03639812709285198 sim_render-ego_median 0.0365168006480241 sim_render-ego_min 0.03569250003151272 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.180000000000025 survival_time_min 2.3
No reset possible 21848
3315
jiang peng RL - TH -hhk aido2-LFV-sim-validation
step1-simulation success no ip-172-31-40-253-32059
2019-05-10 02:01:03+00:00 2019-05-10 02:16:25+00:00 0:15:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2538414623461482 survival_time_median 14.950000000000076 deviation-center-line_median 0.27954515900842103 in-drivable-lane_median 3.650000000000052
other stats agent_compute-ego_max 0.10378916873488316 agent_compute-ego_mean 0.10164615761576735 agent_compute-ego_median 0.10127334398766089 agent_compute-ego_min 0.10062241315841676 deviation-center-line_max 0.880408678227055 deviation-center-line_mean 0.4008310164380379 deviation-center-line_min 0.04588492545812347 deviation-heading_max 3.965863447138271 deviation-heading_mean 1.5371052082645311 deviation-heading_median 0.973819688666778 deviation-heading_min 0.3131407185843258 driven_any_max 3.06928230803212 driven_any_mean 1.867754632823131 driven_any_median 1.590389614926163 driven_any_min 1.0181573162464244 driven_lanedir_consec_max 2.448497564861985 driven_lanedir_consec_mean 1.5877856956907153 driven_lanedir_consec_min 0.67239844483524 driven_lanedir_max 2.448497564861985 driven_lanedir_mean 1.5877856956907153 driven_lanedir_median 1.2538414623461482 driven_lanedir_min 0.67239844483524 in-drivable-lane_max 11.000000000000083 in-drivable-lane_mean 4.29000000000003 in-drivable-lane_min 0.549999999999998 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0181573162464244, "sim_physics": 0.09008214085601098, "survival_time": 2.1500000000000004, "driven_lanedir": 0.67239844483524, "sim_render-ego": 0.03766231758649959, "in-drivable-lane": 0.5999999999999996, "agent_compute-ego": 0.10378916873488316, "deviation-heading": 0.3131407185843258, "set_robot_commands": 0.05476692665454953, "deviation-center-line": 0.08766781204208815, "driven_lanedir_consec": 0.67239844483524, "sim_compute_sim_state": 0.02281788892524187, "sim_compute_performance-ego": 0.03930890282919241, "sim_compute_robot_state-ego": 0.04228693939918696, "sim_compute_robot_state-npc0": 0.04169733579768691, "sim_compute_robot_state-npc1": 0.039975937022719274, "sim_compute_robot_state-npc2": 0.04059940715168798, "sim_compute_robot_state-npc3": 0.040065610131552055}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.354957571562967, "sim_physics": 0.09001100619633992, "survival_time": 14.950000000000076, "driven_lanedir": 2.3405417101823236, "sim_render-ego": 0.03650694767634074, "in-drivable-lane": 3.650000000000052, "agent_compute-ego": 0.10104924996693929, "deviation-heading": 3.965863447138271, "set_robot_commands": 0.056219635804494225, "deviation-center-line": 0.710648507454502, "driven_lanedir_consec": 2.3405417101823236, "sim_compute_sim_state": 0.023187727928161626, "sim_compute_performance-ego": 0.03987587531407674, "sim_compute_robot_state-ego": 0.042031502723693846, "sim_compute_robot_state-npc0": 0.04182349999745687, "sim_compute_robot_state-npc1": 0.040622496604919435, "sim_compute_robot_state-npc2": 0.04060363213221232, "sim_compute_robot_state-npc3": 0.040614030361175536}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.06928230803212, "sim_physics": 0.09435378313064575, "survival_time": 14.950000000000076, "driven_lanedir": 2.448497564861985, "sim_render-ego": 0.036825546423594153, "in-drivable-lane": 5.65000000000002, "agent_compute-ego": 0.10149661223093669, "deviation-heading": 2.0224328807220036, "set_robot_commands": 0.05506343205769857, "deviation-center-line": 0.880408678227055, "driven_lanedir_consec": 2.448497564861985, "sim_compute_sim_state": 0.02295187791188558, "sim_compute_performance-ego": 0.04058294375737508, "sim_compute_robot_state-ego": 0.0416293199857076, "sim_compute_robot_state-npc0": 0.04140212774276733, "sim_compute_robot_state-npc1": 0.04011568387349446, "sim_compute_robot_state-npc2": 0.04024712721506755, "sim_compute_robot_state-npc3": 0.04008457183837891}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.30598635334798, "sim_physics": 0.08775739510854086, "survival_time": 14.950000000000076, "driven_lanedir": 1.2236492962278795, "sim_render-ego": 0.03606517235438029, "in-drivable-lane": 11.000000000000083, "agent_compute-ego": 0.10062241315841676, "deviation-heading": 0.973819688666778, "set_robot_commands": 0.05634642442067464, "deviation-center-line": 0.27954515900842103, "driven_lanedir_consec": 1.2236492962278795, "sim_compute_sim_state": 0.022966350714365643, "sim_compute_performance-ego": 0.03942085822423299, "sim_compute_robot_state-ego": 0.04191094398498535, "sim_compute_robot_state-npc0": 0.04116448640823364, "sim_compute_robot_state-npc1": 0.04023699363072713, "sim_compute_robot_state-npc2": 0.04004765669504801, "sim_compute_robot_state-npc3": 0.04028974612553914}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.590389614926163, "sim_physics": 0.08976609086337155, "survival_time": 3.649999999999995, "driven_lanedir": 1.2538414623461482, "sim_render-ego": 0.03719162940979004, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.10127334398766089, "deviation-heading": 0.4102693062112778, "set_robot_commands": 0.05546137078167641, "deviation-center-line": 0.04588492545812347, "driven_lanedir_consec": 1.2538414623461482, "sim_compute_sim_state": 0.022992418236928443, "sim_compute_performance-ego": 0.039600627063071894, "sim_compute_robot_state-ego": 0.041581862593350345, "sim_compute_robot_state-npc0": 0.044707353800943456, "sim_compute_robot_state-npc1": 0.040180826840335374, "sim_compute_robot_state-npc2": 0.03970070081214382, "sim_compute_robot_state-npc3": 0.04037616024278615}}set_robot_commands_max 0.05634642442067464 set_robot_commands_mean 0.05557155794381867 set_robot_commands_median 0.05546137078167641 set_robot_commands_min 0.05476692665454953 sim_compute_performance-ego_max 0.04058294375737508 sim_compute_performance-ego_mean 0.03975784143758983 sim_compute_performance-ego_median 0.039600627063071894 sim_compute_performance-ego_min 0.03930890282919241 sim_compute_robot_state-ego_max 0.04228693939918696 sim_compute_robot_state-ego_mean 0.04188811373738482 sim_compute_robot_state-ego_median 0.04191094398498535 sim_compute_robot_state-ego_min 0.041581862593350345 sim_compute_robot_state-npc0_max 0.044707353800943456 sim_compute_robot_state-npc0_mean 0.04215896074941764 sim_compute_robot_state-npc0_median 0.04169733579768691 sim_compute_robot_state-npc0_min 0.04116448640823364 sim_compute_robot_state-npc1_max 0.040622496604919435 sim_compute_robot_state-npc1_mean 0.04022638759443914 sim_compute_robot_state-npc1_median 0.040180826840335374 sim_compute_robot_state-npc1_min 0.039975937022719274 sim_compute_robot_state-npc2_max 0.04060363213221232 sim_compute_robot_state-npc2_mean 0.040239704801231936 sim_compute_robot_state-npc2_median 0.04024712721506755 sim_compute_robot_state-npc2_min 0.03970070081214382 sim_compute_robot_state-npc3_max 0.040614030361175536 sim_compute_robot_state-npc3_mean 0.04028602373988636 sim_compute_robot_state-npc3_median 0.04028974612553914 sim_compute_robot_state-npc3_min 0.040065610131552055 sim_compute_sim_state_max 0.023187727928161626 sim_compute_sim_state_mean 0.022983252743316633 sim_compute_sim_state_median 0.022966350714365643 sim_compute_sim_state_min 0.02281788892524187 sim_physics_max 0.09435378313064575 sim_physics_mean 0.09039408323098182 sim_physics_median 0.09001100619633992 sim_physics_min 0.08775739510854086 sim_render-ego_max 0.03766231758649959 sim_render-ego_mean 0.036850322690120965 sim_render-ego_median 0.036825546423594153 sim_render-ego_min 0.03606517235438029 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.130000000000043 survival_time_min 2.1500000000000004
No reset possible 21823
3300
Artem Ioselevskii SSegm aido2-LF-sim-validation
step1-simulation success no ip-172-31-40-253-32059
2019-05-08 15:45:49+00:00 2019-05-08 15:51:43+00:00 0:05:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5691052758958746 survival_time_median 2.7499999999999982 deviation-center-line_median 0.1733059238380112 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.08415973514591882 agent_compute-ego_mean 0.08216412780236132 agent_compute-ego_median 0.08267487612637607 agent_compute-ego_min 0.0801636012824806 deviation-center-line_max 0.34938456093191467 deviation-center-line_mean 0.2090617838018885 deviation-center-line_min 0.1292272535903628 deviation-heading_max 1.119954247221525 deviation-heading_mean 0.8241162697466855 deviation-heading_median 0.7196727832852934 deviation-heading_min 0.5604633186519064 driven_any_max 1.2513038793067848 driven_any_mean 0.728019992814309 driven_any_median 0.5909339814146939 driven_any_min 0.3708187759292697 driven_lanedir_consec_max 0.7359409125483922 driven_lanedir_consec_mean 0.5666469934001085 driven_lanedir_consec_min 0.3402447309820964 driven_lanedir_max 0.7359409125483922 driven_lanedir_mean 0.5666469934001085 driven_lanedir_median 0.5691052758958746 driven_lanedir_min 0.3402447309820964 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.4799999999999983 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5303848590681168, "sim_physics": 0.0936596019595277, "survival_time": 2.549999999999999, "driven_lanedir": 0.5092346754887824, "sim_render-ego": 0.05189959208170573, "in-drivable-lane": 0, "agent_compute-ego": 0.08325915243111405, "deviation-heading": 0.6178116519124097, "set_robot_commands": 0.08057584014593386, "deviation-center-line": 0.1733059238380112, "driven_lanedir_consec": 0.5092346754887824, "sim_compute_sim_state": 0.03438303984847723, "sim_compute_performance-ego": 0.05888670098547842, "sim_compute_robot_state-ego": 0.061002773397109085}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8966584683526795, "sim_physics": 0.08838767409324647, "survival_time": 3.999999999999994, "driven_lanedir": 0.6787093720853966, "sim_render-ego": 0.05220862627029419, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.08056327402591705, "deviation-heading": 1.1026793476622936, "set_robot_commands": 0.0787724107503891, "deviation-center-line": 0.2455388752340431, "driven_lanedir_consec": 0.6787093720853966, "sim_compute_sim_state": 0.03327541947364807, "sim_compute_performance-ego": 0.05794324576854706, "sim_compute_robot_state-ego": 0.062386003136634824}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2513038793067848, "sim_physics": 0.09089273487756012, "survival_time": 5.449999999999989, "driven_lanedir": 0.7359409125483922, "sim_render-ego": 0.05454274929991556, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.08415973514591882, "deviation-heading": 1.119954247221525, "set_robot_commands": 0.0839071120690862, "deviation-center-line": 0.34938456093191467, "driven_lanedir_consec": 0.7359409125483922, "sim_compute_sim_state": 0.034052892562446244, "sim_compute_performance-ego": 0.06110042169553424, "sim_compute_robot_state-ego": 0.06491341722120933}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3708187759292697, "sim_physics": 0.1030981089617755, "survival_time": 1.850000000000001, "driven_lanedir": 0.3402447309820964, "sim_render-ego": 0.05435803774240855, "in-drivable-lane": 0, "agent_compute-ego": 0.0801636012824806, "deviation-heading": 0.7196727832852934, "set_robot_commands": 0.0819110934798782, "deviation-center-line": 0.1292272535903628, "driven_lanedir_consec": 0.3402447309820964, "sim_compute_sim_state": 0.03553831255113756, "sim_compute_performance-ego": 0.05668727127281395, "sim_compute_robot_state-ego": 0.06254676226023081}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5909339814146939, "sim_physics": 0.09290753711353648, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5691052758958746, "sim_render-ego": 0.051197329434481534, "in-drivable-lane": 0, "agent_compute-ego": 0.08267487612637607, "deviation-heading": 0.5604633186519064, "set_robot_commands": 0.0777117295698686, "deviation-center-line": 0.14785230541511082, "driven_lanedir_consec": 0.5691052758958746, "sim_compute_sim_state": 0.03188366889953613, "sim_compute_performance-ego": 0.05891104611483487, "sim_compute_robot_state-ego": 0.061712672493674535}}set_robot_commands_max 0.0839071120690862 set_robot_commands_mean 0.0805756372030312 set_robot_commands_median 0.08057584014593386 set_robot_commands_min 0.0777117295698686 sim_compute_performance-ego_max 0.06110042169553424 sim_compute_performance-ego_mean 0.05870573716744171 sim_compute_performance-ego_median 0.05888670098547842 sim_compute_performance-ego_min 0.05668727127281395 sim_compute_robot_state-ego_max 0.06491341722120933 sim_compute_robot_state-ego_mean 0.06251232570177172 sim_compute_robot_state-ego_median 0.062386003136634824 sim_compute_robot_state-ego_min 0.061002773397109085 sim_compute_sim_state_max 0.03553831255113756 sim_compute_sim_state_mean 0.033826666667049046 sim_compute_sim_state_median 0.034052892562446244 sim_compute_sim_state_min 0.03188366889953613 sim_physics_max 0.1030981089617755 sim_physics_mean 0.09378913140112924 sim_physics_median 0.09290753711353648 sim_physics_min 0.08838767409324647 sim_render-ego_max 0.05454274929991556 sim_render-ego_mean 0.052841266965761115 sim_render-ego_median 0.05220862627029419 sim_render-ego_min 0.051197329434481534 simulation-passed 1 survival_time_max 5.449999999999989 survival_time_mean 3.319999999999996 survival_time_min 1.850000000000001
No reset possible 21819
3297
Artem Ioselevskii SSegm aido2-LF-sim-validation
step1-simulation success no ip-172-31-40-253-32059
2019-05-08 15:04:07+00:00 2019-05-08 15:14:16+00:00 0:10:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6416226851075523 survival_time_median 6.649999999999984 deviation-center-line_median 0.2945567854099896 in-drivable-lane_median 3.2499999999999885
other stats agent_compute-ego_max 0.08840634166330531 agent_compute-ego_mean 0.08446788394790383 agent_compute-ego_median 0.08757022354337904 agent_compute-ego_min 0.07625356141258688 deviation-center-line_max 0.42234284332676125 deviation-center-line_mean 0.29306139958571076 deviation-center-line_min 0.1664719805507219 deviation-heading_max 0.6661915357195662 deviation-heading_mean 0.4495009807245549 deviation-heading_median 0.39702531678041025 deviation-heading_min 0.3278499993035452 driven_any_max 2.107898053208737 driven_any_mean 1.2245086384064017 driven_any_median 1.5447707052968318 driven_any_min 0.33414036346346543 driven_lanedir_consec_max 0.8051353619823667 driven_lanedir_consec_mean 0.6038422628480058 driven_lanedir_consec_min 0.32854057763789113 driven_lanedir_max 0.8051353619823667 driven_lanedir_mean 0.6038422628480058 driven_lanedir_median 0.6416226851075523 driven_lanedir_min 0.32854057763789113 in-drivable-lane_max 5.599999999999997 in-drivable-lane_mean 2.4999999999999942 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.107898053208737, "sim_physics": 0.0997419105635749, "survival_time": 8.999999999999993, "driven_lanedir": 0.7322784791505539, "sim_render-ego": 0.05562960704167684, "in-drivable-lane": 5.599999999999997, "agent_compute-ego": 0.08757022354337904, "deviation-heading": 0.36257958605803137, "set_robot_commands": 0.08682813776863946, "deviation-center-line": 0.4071711529988654, "driven_lanedir_consec": 0.7322784791505539, "sim_compute_sim_state": 0.035579215155707465, "sim_compute_performance-ego": 0.06231159104241265, "sim_compute_robot_state-ego": 0.06835608349906074}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5447707052968318, "sim_physics": 0.11061429618892812, "survival_time": 6.649999999999984, "driven_lanedir": 0.6416226851075523, "sim_render-ego": 0.05764341892156386, "in-drivable-lane": 3.649999999999987, "agent_compute-ego": 0.08831725801740374, "deviation-heading": 0.49385846576122167, "set_robot_commands": 0.08825499312321942, "deviation-center-line": 0.2945567854099896, "driven_lanedir_consec": 0.6416226851075523, "sim_compute_sim_state": 0.03597980692870635, "sim_compute_performance-ego": 0.06397657107589837, "sim_compute_robot_state-ego": 0.06756016007043365}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.33414036346346543, "sim_physics": 0.09595517551197726, "survival_time": 1.7000000000000008, "driven_lanedir": 0.32854057763789113, "sim_render-ego": 0.05019020333009608, "in-drivable-lane": 0, "agent_compute-ego": 0.07625356141258688, "deviation-heading": 0.3278499993035452, "set_robot_commands": 0.0795602377723245, "deviation-center-line": 0.17476423564221538, "driven_lanedir_consec": 0.32854057763789113, "sim_compute_sim_state": 0.033405850915347826, "sim_compute_performance-ego": 0.058206551215227914, "sim_compute_robot_state-ego": 0.06253495637108297}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5297912328260896, "sim_physics": 0.10305851459503174, "survival_time": 2.499999999999999, "driven_lanedir": 0.5116342103616649, "sim_render-ego": 0.05239514827728271, "in-drivable-lane": 0, "agent_compute-ego": 0.08179203510284423, "deviation-heading": 0.6661915357195662, "set_robot_commands": 0.08620904922485352, "deviation-center-line": 0.1664719805507219, "driven_lanedir_consec": 0.5116342103616649, "sim_compute_sim_state": 0.03429117202758789, "sim_compute_performance-ego": 0.05779962062835693, "sim_compute_robot_state-ego": 0.06204673290252685}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6059428372368838, "sim_physics": 0.10666589287744052, "survival_time": 6.8999999999999835, "driven_lanedir": 0.8051353619823667, "sim_render-ego": 0.0557481707006261, "in-drivable-lane": 3.2499999999999885, "agent_compute-ego": 0.08840634166330531, "deviation-heading": 0.39702531678041025, "set_robot_commands": 0.08902944689211638, "deviation-center-line": 0.42234284332676125, "driven_lanedir_consec": 0.8051353619823667, "sim_compute_sim_state": 0.03653185263923977, "sim_compute_performance-ego": 0.06320043404897054, "sim_compute_robot_state-ego": 0.06767384211222331}}set_robot_commands_max 0.08902944689211638 set_robot_commands_mean 0.08597637295623066 set_robot_commands_median 0.08682813776863946 set_robot_commands_min 0.0795602377723245 sim_compute_performance-ego_max 0.06397657107589837 sim_compute_performance-ego_mean 0.06109895360217328 sim_compute_performance-ego_median 0.06231159104241265 sim_compute_performance-ego_min 0.05779962062835693 sim_compute_robot_state-ego_max 0.06835608349906074 sim_compute_robot_state-ego_mean 0.0656343549910655 sim_compute_robot_state-ego_median 0.06756016007043365 sim_compute_robot_state-ego_min 0.06204673290252685 sim_compute_sim_state_max 0.03653185263923977 sim_compute_sim_state_mean 0.03515757953331786 sim_compute_sim_state_median 0.035579215155707465 sim_compute_sim_state_min 0.033405850915347826 sim_physics_max 0.11061429618892812 sim_physics_mean 0.10320715794739052 sim_physics_median 0.10305851459503174 sim_physics_min 0.09595517551197726 sim_render-ego_max 0.05764341892156386 sim_render-ego_mean 0.05432130965424912 sim_render-ego_median 0.05562960704167684 sim_render-ego_min 0.05019020333009608 simulation-passed 1 survival_time_max 8.999999999999993 survival_time_mean 5.3499999999999925 survival_time_min 1.7000000000000008
No reset possible 21816
3296
jiang peng Third test - TH aido2-LF-sim-validation
step1-simulation host-error no ip-172-31-40-253-32059
2019-05-08 14:59:27+00:00 2019-05-08 15:00:15+00:00 0:00:48 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3296/step1-simulation-ip-172-31-40-253-32059-job21816/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21813
3293
Artem Ioselevskii SSegm aido2-LF-sim-validation
step1-simulation success no ip-172-31-40-253-32059
2019-05-08 14:49:05+00:00 2019-05-08 14:56:30+00:00 0:07:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6720555603150826 survival_time_median 4.899999999999991 deviation-center-line_median 0.3465183876186594 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06131294886271159 agent_compute-ego_mean 0.05944538565179861 agent_compute-ego_median 0.05957108371111811 agent_compute-ego_min 0.058007336108484 deviation-center-line_max 1.1059908387576831 deviation-center-line_mean 0.4507202006667233 deviation-center-line_min 0.1678354619571783 deviation-heading_max 1.4843063777730994 deviation-heading_mean 0.7674667953279373 deviation-heading_median 0.6516974619898479 deviation-heading_min 0.32951020993620106 driven_any_max 3.5748021987872276 driven_any_mean 1.35169391683787 driven_any_median 1.1051354397312998 driven_any_min 0.35859218060513987 driven_lanedir_consec_max 2.1471767543617526 driven_lanedir_consec_mean 0.9694582437481728 driven_lanedir_consec_min 0.35324329244369324 driven_lanedir_max 2.1471767543617526 driven_lanedir_mean 0.9694582437481728 driven_lanedir_median 0.6720555603150826 driven_lanedir_min 0.35324329244369324 in-drivable-lane_max 5.65000000000004 in-drivable-lane_mean 1.4800000000000069 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1051354397312998, "sim_physics": 0.06320832700145487, "survival_time": 4.899999999999991, "driven_lanedir": 0.6720555603150826, "sim_render-ego": 0.03756752549385538, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.05957108371111811, "deviation-heading": 0.33124404686285586, "set_robot_commands": 0.05918450501500344, "deviation-center-line": 0.3465183876186594, "driven_lanedir_consec": 0.6720555603150826, "sim_compute_sim_state": 0.024829932621547153, "sim_compute_performance-ego": 0.041700786473799725, "sim_compute_robot_state-ego": 0.04388064510968267}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2268356458836978, "sim_physics": 0.061938867390712846, "survival_time": 5.349999999999989, "driven_lanedir": 1.2001393445633872, "sim_render-ego": 0.03712233650350125, "in-drivable-lane": 0, "agent_compute-ego": 0.058007336108484, "deviation-heading": 1.0405758800776823, "set_robot_commands": 0.05845955153492009, "deviation-center-line": 0.4458112438340142, "driven_lanedir_consec": 1.2001393445633872, "sim_compute_sim_state": 0.024961302213579693, "sim_compute_performance-ego": 0.041243094150151045, "sim_compute_robot_state-ego": 0.04356607321266816}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.35859218060513987, "sim_physics": 0.06781760851542155, "survival_time": 1.800000000000001, "driven_lanedir": 0.35324329244369324, "sim_render-ego": 0.036734561125437416, "in-drivable-lane": 0, "agent_compute-ego": 0.05958820713890923, "deviation-heading": 0.32951020993620106, "set_robot_commands": 0.05760926670498318, "deviation-center-line": 0.1874450711660813, "driven_lanedir_consec": 0.35324329244369324, "sim_compute_sim_state": 0.02458835310406155, "sim_compute_performance-ego": 0.04229828384187487, "sim_compute_robot_state-ego": 0.042573630809783936}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.49310411918198355, "sim_physics": 0.06774046065959524, "survival_time": 2.3499999999999996, "driven_lanedir": 0.47467626705694776, "sim_render-ego": 0.03694812287675574, "in-drivable-lane": 0, "agent_compute-ego": 0.058747352437770115, "deviation-heading": 0.6516974619898479, "set_robot_commands": 0.05763372969120107, "deviation-center-line": 0.1678354619571783, "driven_lanedir_consec": 0.47467626705694776, "sim_compute_sim_state": 0.024442114728562375, "sim_compute_performance-ego": 0.04049821102872808, "sim_compute_robot_state-ego": 0.04310638853844176}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.5748021987872276, "sim_physics": 0.06406570672988891, "survival_time": 14.950000000000076, "driven_lanedir": 2.1471767543617526, "sim_render-ego": 0.03942176739374797, "in-drivable-lane": 5.65000000000004, "agent_compute-ego": 0.06131294886271159, "deviation-heading": 1.4843063777730994, "set_robot_commands": 0.05793241818745931, "deviation-center-line": 1.1059908387576831, "driven_lanedir_consec": 2.1471767543617526, "sim_compute_sim_state": 0.025052554607391357, "sim_compute_performance-ego": 0.04123127301534017, "sim_compute_robot_state-ego": 0.043783535957336424}}set_robot_commands_max 0.05918450501500344 set_robot_commands_mean 0.05816389422671342 set_robot_commands_median 0.05793241818745931 set_robot_commands_min 0.05760926670498318 sim_compute_performance-ego_max 0.04229828384187487 sim_compute_performance-ego_mean 0.04139432970197878 sim_compute_performance-ego_median 0.041243094150151045 sim_compute_performance-ego_min 0.04049821102872808 sim_compute_robot_state-ego_max 0.04388064510968267 sim_compute_robot_state-ego_mean 0.04338205472558258 sim_compute_robot_state-ego_median 0.04356607321266816 sim_compute_robot_state-ego_min 0.042573630809783936 sim_compute_sim_state_max 0.025052554607391357 sim_compute_sim_state_mean 0.024774851455028425 sim_compute_sim_state_median 0.024829932621547153 sim_compute_sim_state_min 0.024442114728562375 sim_physics_max 0.06781760851542155 sim_physics_mean 0.06495419405941469 sim_physics_median 0.06406570672988891 sim_physics_min 0.061938867390712846 sim_render-ego_max 0.03942176739374797 sim_render-ego_mean 0.03755886267865956 sim_render-ego_median 0.03712233650350125 sim_render-ego_min 0.036734561125437416 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 5.870000000000012 survival_time_min 1.800000000000001
No reset possible 21800
3280
Hsiao-Sheng Chen Β πΉπΌPredictorLast aido2-PRED
step1-simulation success no ip-172-31-40-253-32059
2019-05-08 07:25:30+00:00 2019-05-08 07:26:02+00:00 0:00:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.11629533368159864 error_L2 0.02106046407953057
No reset possible 21794
3273
jiang peng RL - TH -hhk aido2-LF-sim-validation
step1-simulation success no ip-172-31-40-253-32059
2019-05-08 03:02:06+00:00 2019-05-08 03:12:40+00:00 0:10:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9672245722771572 survival_time_median 14.950000000000076 deviation-center-line_median 0.7299479417794719 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.10178059180577596 agent_compute-ego_mean 0.10144069087541138 agent_compute-ego_median 0.10160867849985758 agent_compute-ego_min 0.10067020522223578 deviation-center-line_max 2.1026509409626843 deviation-center-line_mean 0.8639077472104478 deviation-center-line_min 0.10357616002176412 deviation-heading_max 5.5742019074857065 deviation-heading_mean 3.250416195967797 deviation-heading_median 4.1557501382551365 deviation-heading_min 0.5185948725490829 driven_any_max 3.1811841819985154 driven_any_mean 1.346082295596869 driven_any_median 1.378146040930617 driven_any_min 0.16790510048088736 driven_lanedir_consec_max 3.025978920944655 driven_lanedir_consec_mean 1.1268868315235547 driven_lanedir_consec_min 0.14411085837061544 driven_lanedir_max 3.025978920944655 driven_lanedir_mean 1.235061676724838 driven_lanedir_median 1.3512600173850702 driven_lanedir_min 0.14411085837061544 in-drivable-lane_max 5.500000000000027 in-drivable-lane_mean 1.140000000000006 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.378146040930617, "sim_physics": 0.059548176129659014, "survival_time": 14.950000000000076, "driven_lanedir": 1.3512600173850702, "sim_render-ego": 0.03666364669799805, "in-drivable-lane": 0, "agent_compute-ego": 0.10178059180577596, "deviation-heading": 4.975932456656041, "set_robot_commands": 0.05602749745051066, "deviation-center-line": 2.1026509409626843, "driven_lanedir_consec": 1.3512600173850702, "sim_compute_sim_state": 0.023431106408437093, "sim_compute_performance-ego": 0.039705588817596435, "sim_compute_robot_state-ego": 0.04153221289316813}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.790756043624597, "sim_physics": 0.057643142541249595, "survival_time": 14.950000000000076, "driven_lanedir": 1.508098798283572, "sim_render-ego": 0.03628685315450032, "in-drivable-lane": 5.500000000000027, "agent_compute-ego": 0.10167857964833578, "deviation-heading": 4.1557501382551365, "set_robot_commands": 0.05597354729970296, "deviation-center-line": 0.7299479417794719, "driven_lanedir_consec": 0.9672245722771572, "sim_compute_sim_state": 0.023627687295277915, "sim_compute_performance-ego": 0.03984079519907634, "sim_compute_robot_state-ego": 0.04199099858601888}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.16790510048088736, "sim_physics": 0.05823180410597059, "survival_time": 1.3500000000000003, "driven_lanedir": 0.14411085837061544, "sim_render-ego": 0.03520267098038285, "in-drivable-lane": 0, "agent_compute-ego": 0.10067020522223578, "deviation-heading": 0.5185948725490829, "set_robot_commands": 0.056281601941144024, "deviation-center-line": 0.10357616002176412, "driven_lanedir_consec": 0.14411085837061544, "sim_compute_sim_state": 0.025050136778089736, "sim_compute_performance-ego": 0.04026364397119592, "sim_compute_robot_state-ego": 0.041686172838564274}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.21242011094972793, "sim_physics": 0.06393779935063543, "survival_time": 1.850000000000001, "driven_lanedir": 0.14585978864027638, "sim_render-ego": 0.03678095662916029, "in-drivable-lane": 0, "agent_compute-ego": 0.10146539920085185, "deviation-heading": 1.02760160489302, "set_robot_commands": 0.05568327130498113, "deviation-center-line": 0.1176376114712955, "driven_lanedir_consec": 0.14585978864027638, "sim_compute_sim_state": 0.023646225800385345, "sim_compute_performance-ego": 0.03993089779003246, "sim_compute_robot_state-ego": 0.04191164068273596}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.1811841819985154, "sim_physics": 0.05876180171966552, "survival_time": 14.950000000000076, "driven_lanedir": 3.025978920944655, "sim_render-ego": 0.036485633850097655, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.10160867849985758, "deviation-heading": 5.5742019074857065, "set_robot_commands": 0.055640920003255205, "deviation-center-line": 1.2657260818170228, "driven_lanedir_consec": 3.025978920944655, "sim_compute_sim_state": 0.023321787516276043, "sim_compute_performance-ego": 0.03990111112594605, "sim_compute_robot_state-ego": 0.04194394191106161}}set_robot_commands_max 0.056281601941144024 set_robot_commands_mean 0.055921367599918795 set_robot_commands_median 0.05597354729970296 set_robot_commands_min 0.055640920003255205 sim_compute_performance-ego_max 0.04026364397119592 sim_compute_performance-ego_mean 0.03992840738076944 sim_compute_performance-ego_median 0.03990111112594605 sim_compute_performance-ego_min 0.039705588817596435 sim_compute_robot_state-ego_max 0.04199099858601888 sim_compute_robot_state-ego_mean 0.04181299338230977 sim_compute_robot_state-ego_median 0.04191164068273596 sim_compute_robot_state-ego_min 0.04153221289316813 sim_compute_sim_state_max 0.025050136778089736 sim_compute_sim_state_mean 0.023815388759693225 sim_compute_sim_state_median 0.023627687295277915 sim_compute_sim_state_min 0.023321787516276043 sim_physics_max 0.06393779935063543 sim_physics_mean 0.05962454476943604 sim_physics_median 0.05876180171966552 sim_physics_min 0.057643142541249595 sim_render-ego_max 0.03678095662916029 sim_render-ego_mean 0.03628395226242783 sim_render-ego_median 0.036485633850097655 sim_render-ego_min 0.03520267098038285 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.610000000000047 survival_time_min 1.3500000000000003
No reset possible 21790
3271
jiang peng RL - TH -hhk aido2-LF-sim-validation
step1-simulation error no ip-172-31-40-253-32059
2019-05-08 02:29:36+00:00 2019-05-08 02:30:02+00:00 0:00:26 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21787
3269
jiang peng First test - TH aido2-LFVI-sim-validation
step1-simulation host-error no ip-172-31-40-253-32059
2019-05-08 01:57:10+00:00 2019-05-08 02:01:20+00:00 0:04:10 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission3269/step1-simulation-ip-172-31-40-253-32059-job21787/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21761
3078
Julian Zilly Baseline-IL-logs-tensorflow aido2-LFVI-sim-testing
step1-simulation host-error no ip-172-31-40-253-32059
2019-05-07 21:03:22+00:00 2019-05-07 22:02:15+00:00 0:58:53 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission3078/step1-simulation-ip-172-31-40-253-32059-job21761/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21742
2774
Bhairav Mehta challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-testing
step1-simulation host-error no ip-172-31-40-253-32059
2019-05-07 20:35:56+00:00 2019-05-07 21:02:57+00:00 0:27:01 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2774/step1-simulation-ip-172-31-40-253-32059-job21742/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21729
2555
Andrea Censi Β π¨πchallenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testing
step1-simulation success no ip-172-31-40-253-32059
2019-05-07 20:04:04+00:00 2019-05-07 20:35:36+00:00 0:31:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2875407694053156 survival_time_median 2.849999999999998 deviation-center-line_median 0.11031194850197353 in-drivable-lane_median 0.9499999999999966
other stats agent_compute-ego_max 0.08044372664557563 agent_compute-ego_mean 0.07755520980889408 agent_compute-ego_median 0.0781632473594264 agent_compute-ego_min 0.0710597038269043 deviation-center-line_max 0.2701922695523504 deviation-center-line_mean 0.13746050030700233 deviation-center-line_min 0.07113819587235681 deviation-heading_max 1.4854398920276677 deviation-heading_mean 0.7236995121312619 deviation-heading_median 0.6953408166028192 deviation-heading_min 0.3118646573709166 driven_any_max 1.934434121703833 driven_any_mean 0.806757806634148 driven_any_median 0.8072381933001392 driven_any_min 0.20912585880423715 driven_lanedir_consec_max 0.7222251056746308 driven_lanedir_consec_mean 0.3962831867516217 driven_lanedir_consec_min 0.1917983424483971 driven_lanedir_max 0.7287863177121016 driven_lanedir_mean 0.3975640776898326 driven_lanedir_median 0.2875407694053156 driven_lanedir_min 0.1917983424483971 in-drivable-lane_max 4.04999999999999 in-drivable-lane_mean 1.2133333333333305 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.2195056346525629, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.06558319746729839, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.0782163056982569, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.1038313802466335, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.039867159831954775, "sim_compute_performance-ego": 0.07127471429755888, "sim_compute_robot_state-ego": 0.07988705692521061, "sim_compute_robot_state-npc0": 0.0746260464909565, "sim_compute_robot_state-npc1": 0.0717761688921825, "sim_compute_robot_state-npc2": 0.07237421748149826, "sim_compute_robot_state-npc3": 0.07260315389518278}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.25816183620029026, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.07404196703875507, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08044372664557563, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.10852994742216888, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.04307164086235894, "sim_compute_performance-ego": 0.07583416832817926, "sim_compute_robot_state-ego": 0.08223523917021575, "sim_compute_robot_state-npc0": 0.07250777880350749, "sim_compute_robot_state-npc1": 0.07355119563915112, "sim_compute_robot_state-npc2": 0.07576217474760832, "sim_compute_robot_state-npc3": 0.07612533922548648}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.23489167140080375, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06736068236522186, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.07821435500413944, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.1053914290208083, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.04361065534444956, "sim_compute_performance-ego": 0.07417816687852909, "sim_compute_robot_state-ego": 0.08113434681525597, "sim_compute_robot_state-npc0": 0.07550524136958978, "sim_compute_robot_state-npc1": 0.07492305376590827, "sim_compute_robot_state-npc2": 0.07271870282980111, "sim_compute_robot_state-npc3": 0.07675591798929068}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.24555745877717672, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.06884954268472236, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.0781632473594264, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.10266008711697762, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.04302021495082922, "sim_compute_performance-ego": 0.07657706528379206, "sim_compute_robot_state-ego": 0.08183604792544716, "sim_compute_robot_state-npc0": 0.07390832901000977, "sim_compute_robot_state-npc1": 0.07364746980499803, "sim_compute_robot_state-npc2": 0.07597345218323824, "sim_compute_robot_state-npc3": 0.0752018878334447}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.22617914365685504, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.06809183825617252, "in-drivable-lane": 0, "agent_compute-ego": 0.0710597038269043, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.1065279608187468, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.042956310769786, "sim_compute_performance-ego": 0.0719600138456925, "sim_compute_robot_state-ego": 0.0759639429009479, "sim_compute_robot_state-npc0": 0.072590796843819, "sim_compute_robot_state-npc1": 0.07713211101034413, "sim_compute_robot_state-npc2": 0.07346878881039827, "sim_compute_robot_state-npc3": 0.07310195591138757}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.23560256116530476, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.06719955042296764, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.07836943280463125, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.1071559845232496, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.04131611188252767, "sim_compute_performance-ego": 0.07544852238075406, "sim_compute_robot_state-ego": 0.08191864163267847, "sim_compute_robot_state-npc0": 0.07534823698156021, "sim_compute_robot_state-npc1": 0.07430746976067037, "sim_compute_robot_state-npc2": 0.07434831413568235, "sim_compute_robot_state-npc3": 0.07504367127138026}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.2327690328870501, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.07055409465517316, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.07892493690763201, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.10852578708103724, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.04294885396957397, "sim_compute_performance-ego": 0.07647244930267334, "sim_compute_robot_state-ego": 0.0893042836870466, "sim_compute_robot_state-npc0": 0.07814728362219674, "sim_compute_robot_state-npc1": 0.07706974744796753, "sim_compute_robot_state-npc2": 0.07627772092819214, "sim_compute_robot_state-npc3": 0.07436978135790144}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.2358517875410106, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.067522940570361, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07997829946753097, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.10630413930710048, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.042178235641897543, "sim_compute_performance-ego": 0.07530116708311316, "sim_compute_robot_state-ego": 0.08133644273836318, "sim_compute_robot_state-npc0": 0.07149099323847523, "sim_compute_robot_state-npc1": 0.07464958870247619, "sim_compute_robot_state-npc2": 0.07569086714966657, "sim_compute_robot_state-npc3": 0.07399351956093148}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.21845932339513024, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06651957090510878, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.07751615380131921, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.10490727147390676, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.04290551640266596, "sim_compute_performance-ego": 0.07289280170618101, "sim_compute_robot_state-ego": 0.07735852585282436, "sim_compute_robot_state-npc0": 0.07464293823685757, "sim_compute_robot_state-npc1": 0.07222756119661553, "sim_compute_robot_state-npc2": 0.07552563312441804, "sim_compute_robot_state-npc3": 0.07382704213608143}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.2584447952417227, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.06911823382744423, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07742112416487473, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.10255875037266658, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.0429919774715717, "sim_compute_performance-ego": 0.07421740201803353, "sim_compute_robot_state-ego": 0.08129048347473145, "sim_compute_robot_state-npc0": 0.07252391485067514, "sim_compute_robot_state-npc1": 0.0749424145771907, "sim_compute_robot_state-npc2": 0.07498221214000995, "sim_compute_robot_state-npc3": 0.07645568480858436}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.22591124534606932, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.06544881184895833, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07907247861226399, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.10319508234659833, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.03914891878763835, "sim_compute_performance-ego": 0.07184505462646484, "sim_compute_robot_state-ego": 0.08560241381327312, "sim_compute_robot_state-npc0": 0.07111638069152831, "sim_compute_robot_state-npc1": 0.07192375500996907, "sim_compute_robot_state-npc2": 0.07019520441691081, "sim_compute_robot_state-npc3": 0.07366735140482585}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.23550736336481004, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.06491469201587495, "in-drivable-lane": 0, "agent_compute-ego": 0.07737175623575847, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.10178152720133464, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.03979471751621792, "sim_compute_performance-ego": 0.07706381025768462, "sim_compute_robot_state-ego": 0.07928457714262463, "sim_compute_robot_state-npc0": 0.08175331070309594, "sim_compute_robot_state-npc1": 0.07306471325102307, "sim_compute_robot_state-npc2": 0.0784388610294887, "sim_compute_robot_state-npc3": 0.07897203309195382}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.24970657880916153, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.07044074701708417, "in-drivable-lane": 1.15, "agent_compute-ego": 0.07633450419403785, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.10558614619942598, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.04064113040303075, "sim_compute_performance-ego": 0.07402057425920354, "sim_compute_robot_state-ego": 0.07973450283671535, "sim_compute_robot_state-npc0": 0.07295583569726279, "sim_compute_robot_state-npc1": 0.07369157879851586, "sim_compute_robot_state-npc2": 0.07330566783284032, "sim_compute_robot_state-npc3": 0.07272391541059627}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.23370339189256945, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.06477900913783483, "in-drivable-lane": 0, "agent_compute-ego": 0.07670636687959943, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.1040900434766497, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.0414490955216544, "sim_compute_performance-ego": 0.07465423856462751, "sim_compute_robot_state-ego": 0.07978092772620064, "sim_compute_robot_state-npc0": 0.07347066913332258, "sim_compute_robot_state-npc1": 0.07698073557444982, "sim_compute_robot_state-npc2": 0.07360712971006121, "sim_compute_robot_state-npc3": 0.07616896288735527}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.251220843371223, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.06494777810339834, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.07553575553146064, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.1042493371402516, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.04941017019982431, "sim_compute_performance-ego": 0.07288393319821825, "sim_compute_robot_state-ego": 0.08150235344381894, "sim_compute_robot_state-npc0": 0.07159684218612372, "sim_compute_robot_state-npc1": 0.07215159547095205, "sim_compute_robot_state-npc2": 0.07136722172007841, "sim_compute_robot_state-npc3": 0.0732121935077742}}set_robot_commands_max 0.10852994742216888 set_robot_commands_mean 0.10501965824983708 set_robot_commands_median 0.10490727147390676 set_robot_commands_min 0.10178152720133464 sim_compute_performance-ego_max 0.07706381025768462 sim_compute_performance-ego_mean 0.07430827213538037 sim_compute_performance-ego_median 0.07421740201803353 sim_compute_performance-ego_min 0.07127471429755888 sim_compute_robot_state-ego_max 0.0893042836870466 sim_compute_robot_state-ego_mean 0.08121131907235693 sim_compute_robot_state-ego_median 0.08129048347473145 sim_compute_robot_state-ego_min 0.0759639429009479 sim_compute_robot_state-npc0_max 0.08175331070309594 sim_compute_robot_state-npc0_mean 0.07414563985726538 sim_compute_robot_state-npc0_median 0.07347066913332258 sim_compute_robot_state-npc0_min 0.07111638069152831 sim_compute_robot_state-npc1_max 0.07713211101034413 sim_compute_robot_state-npc1_mean 0.07413594392682761 sim_compute_robot_state-npc1_median 0.07369157879851586 sim_compute_robot_state-npc1_min 0.0717761688921825 sim_compute_robot_state-npc2_max 0.0784388610294887 sim_compute_robot_state-npc2_mean 0.07426907788265953 sim_compute_robot_state-npc2_median 0.07434831413568235 sim_compute_robot_state-npc2_min 0.07019520441691081 sim_compute_robot_state-npc3_max 0.07897203309195382 sim_compute_robot_state-npc3_mean 0.07481482735281177 sim_compute_robot_state-npc3_median 0.07436978135790144 sim_compute_robot_state-npc3_min 0.07260315389518278 sim_compute_sim_state_max 0.04941017019982431 sim_compute_sim_state_mean 0.042354047303732066 sim_compute_sim_state_median 0.04290551640266596 sim_compute_sim_state_min 0.03914891878763835 sim_physics_max 0.2584447952417227 sim_physics_mean 0.237431511180116 sim_physics_median 0.23550736336481004 sim_physics_min 0.21845932339513024 sim_render-ego_max 0.07404196703875507 sim_render-ego_mean 0.06769151042109171 sim_render-ego_median 0.06736068236522186 sim_render-ego_min 0.06477900913783483 simulation-passed 1 survival_time_max 6.999999999999983 survival_time_mean 3.043333333333329 survival_time_min 1.0500000000000005
No reset possible 21707
2568
Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testing
step1-simulation host-error no ip-172-31-40-253-32059
2019-05-07 19:31:40+00:00 2019-05-07 20:00:43+00:00 0:29:03 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2568/step1-simulation-ip-172-31-40-253-32059-job21707/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21696
2723
jiang peng test for ppo aido2-LFVI-sim-testing
step1-simulation error no ip-172-31-40-253-32059
2019-05-07 19:25:29+00:00 2019-05-07 19:27:47+00:00 0:02:18 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible