Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 176262448Nicky Eichmann Baseline solution using reinforcement learning aido2-LFV-sim-testingstep1-simulation timeout no idsc-rudolf-47522019-04-15 13:00:04+00:00 2019-04-15 13:25:08+00:00 0:25:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 176192442Jacopo Tani random_agent aido2-LFV-sim-validationstep1-simulation success no idsc-rudolf-47522019-04-15 12:16:28+00:00 2019-04-15 12:24:04+00:00 0:07:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2342705027983982 survival_time_median 1.7500000000000009 deviation-center-line_median 0.10801953665034704 in-drivable-lane_median 0.7000000000000004
other stats agent_compute-ego_max 0.15142648939102415 agent_compute-ego_mean 0.14127598422890864 agent_compute-ego_median 0.14057683944702148 agent_compute-ego_min 0.13368160384041922 deviation-center-line_max 0.17768774509810673 deviation-center-line_mean 0.08758489727910898 deviation-center-line_min 0.019005533143064354 deviation-heading_max 0.759385645220147 deviation-heading_mean 0.3195081252333424 deviation-heading_median 0.1806788823983304 deviation-heading_min 0.118601117425238 driven_any_max 2.812198352312563 driven_any_mean 1.6891781761410722 driven_any_median 1.608242001486626 driven_any_min 0.3130680825984642 driven_lanedir_consec_max 1.7389031534183392 driven_lanedir_consec_mean 0.9694700664283822 driven_lanedir_consec_min 0.28316071129320397 driven_lanedir_max 1.7389031534183392 driven_lanedir_mean 0.9694700664283822 driven_lanedir_median 1.2342705027983982 driven_lanedir_min 0.28316071129320397 in-drivable-lane_max 1.5999999999999988 in-drivable-lane_mean 0.7299999999999995 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.02373237195222274, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.060102711553158966, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.1380620002746582, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.081070091413415, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.03560483973959218, "sim_compute_performance-ego": 0.061127237651659096, "sim_compute_robot_state-ego": 0.060360690821772034, "sim_compute_robot_state-npc0": 0.06077359033667523, "sim_compute_robot_state-npc1": 0.06483547583870265, "sim_compute_robot_state-npc2": 0.06382047611734142, "sim_compute_robot_state-npc3": 0.06152021366616954}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.756024431431769, "sim_physics": 0.02694212236712056, "survival_time": 3.099999999999997, "driven_lanedir": 1.2342705027983982, "sim_render-ego": 0.06275028951706425, "in-drivable-lane": 1.5999999999999988, "agent_compute-ego": 0.14263298819142003, "deviation-heading": 0.4185133321358317, "set_robot_commands": 0.0779659632713564, "deviation-center-line": 0.11040458544770476, "driven_lanedir_consec": 1.2342705027983982, "sim_compute_sim_state": 0.03538500878118699, "sim_compute_performance-ego": 0.060579795991220785, "sim_compute_robot_state-ego": 0.06402625960688438, "sim_compute_robot_state-npc0": 0.06712928125935216, "sim_compute_robot_state-npc1": 0.06435906887054443, "sim_compute_robot_state-npc2": 0.06450713834454937, "sim_compute_robot_state-npc3": 0.06199541399555822}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3130680825984642, "sim_physics": 0.025546721049717495, "survival_time": 0.35, "driven_lanedir": 0.28316071129320397, "sim_render-ego": 0.058140720639910014, "in-drivable-lane": 0, "agent_compute-ego": 0.13368160384041922, "deviation-heading": 0.1203616489871648, "set_robot_commands": 0.07674976757594518, "deviation-center-line": 0.019005533143064354, "driven_lanedir_consec": 0.28316071129320397, "sim_compute_sim_state": 0.03779854093279157, "sim_compute_performance-ego": 0.05954517636980329, "sim_compute_robot_state-ego": 0.0662179674421038, "sim_compute_robot_state-npc0": 0.07095619610377721, "sim_compute_robot_state-npc1": 0.06578084400721959, "sim_compute_robot_state-npc2": 0.06556476865495954, "sim_compute_robot_state-npc3": 0.06335210800170898}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.608242001486626, "sim_physics": 0.021806676047188896, "survival_time": 1.7500000000000009, "driven_lanedir": 1.2616217533795693, "sim_render-ego": 0.06212891851152692, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.14057683944702148, "deviation-heading": 0.1806788823983304, "set_robot_commands": 0.07561468396868025, "deviation-center-line": 0.10801953665034704, "driven_lanedir_consec": 1.2616217533795693, "sim_compute_sim_state": 0.03619440623692104, "sim_compute_performance-ego": 0.062047270366123744, "sim_compute_robot_state-ego": 0.06348066329956055, "sim_compute_robot_state-npc0": 0.07231197357177735, "sim_compute_robot_state-npc1": 0.06593701498849051, "sim_compute_robot_state-npc2": 0.06475415910993304, "sim_compute_robot_state-npc3": 0.06141878536769322}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.812198352312563, "sim_physics": 0.023227820320734904, "survival_time": 3.149999999999997, "driven_lanedir": 1.7389031534183392, "sim_render-ego": 0.06837584858848936, "in-drivable-lane": 0.9999999999999982, "agent_compute-ego": 0.15142648939102415, "deviation-heading": 0.759385645220147, "set_robot_commands": 0.07816993622552781, "deviation-center-line": 0.17768774509810673, "driven_lanedir_consec": 1.7389031534183392, "sim_compute_sim_state": 0.03823186480809772, "sim_compute_performance-ego": 0.0657874932364812, "sim_compute_robot_state-ego": 0.06515319385225811, "sim_compute_robot_state-npc0": 0.07309030351184663, "sim_compute_robot_state-npc1": 0.0681031280093723, "sim_compute_robot_state-npc2": 0.06570606383066328, "sim_compute_robot_state-npc3": 0.06883126591879224}}set_robot_commands_max 0.081070091413415 set_robot_commands_mean 0.07791408849098493 set_robot_commands_median 0.0779659632713564 set_robot_commands_min 0.07561468396868025 sim_compute_performance-ego_max 0.0657874932364812 sim_compute_performance-ego_mean 0.06181739472305762 sim_compute_performance-ego_median 0.061127237651659096 sim_compute_performance-ego_min 0.05954517636980329 sim_compute_robot_state-ego_max 0.0662179674421038 sim_compute_robot_state-ego_mean 0.06384775500451577 sim_compute_robot_state-ego_median 0.06402625960688438 sim_compute_robot_state-ego_min 0.060360690821772034 sim_compute_robot_state-npc0_max 0.07309030351184663 sim_compute_robot_state-npc0_mean 0.06885226895668572 sim_compute_robot_state-npc0_median 0.07095619610377721 sim_compute_robot_state-npc0_min 0.06077359033667523 sim_compute_robot_state-npc1_max 0.0681031280093723 sim_compute_robot_state-npc1_mean 0.06580310634286589 sim_compute_robot_state-npc1_median 0.06578084400721959 sim_compute_robot_state-npc1_min 0.06435906887054443 sim_compute_robot_state-npc2_max 0.06570606383066328 sim_compute_robot_state-npc2_mean 0.06487052121148933 sim_compute_robot_state-npc2_median 0.06475415910993304 sim_compute_robot_state-npc2_min 0.06382047611734142 sim_compute_robot_state-npc3_max 0.06883126591879224 sim_compute_robot_state-npc3_mean 0.06342355738998444 sim_compute_robot_state-npc3_median 0.06199541399555822 sim_compute_robot_state-npc3_min 0.06141878536769322 sim_compute_sim_state_max 0.03823186480809772 sim_compute_sim_state_mean 0.0366429320997179 sim_compute_sim_state_median 0.03619440623692104 sim_compute_sim_state_min 0.03538500878118699 sim_physics_max 0.02694212236712056 sim_physics_mean 0.024251142347396917 sim_physics_median 0.02373237195222274 sim_physics_min 0.021806676047188896 sim_render-ego_max 0.06837584858848936 sim_render-ego_mean 0.062299697762029906 sim_render-ego_median 0.06212891851152692 sim_render-ego_min 0.058140720639910014 simulation-passed 1 survival_time_max 3.149999999999997 survival_time_mean 1.899999999999999 survival_time_min 0.35
No reset possible 176062424Andrea Censi random_agent aido2-LFVI-sim-testingstep1-simulation success no idsc-rudolf-47522019-04-15 11:55:22+00:00 2019-04-15 12:00:53+00:00 0:05:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6896127428821732 survival_time_median 1.1500000000000004 deviation-center-line_median 0.05610305022565209 in-drivable-lane_median 0.20000000000000007
other stats agent_compute-ego_max 0.12615767121315002 agent_compute-ego_mean 0.11949090043210096 agent_compute-ego_median 0.12144661986309548 agent_compute-ego_min 0.11156471915867018 deviation-center-line_max 0.07504669169058735 deviation-center-line_mean 0.05629372528587068 deviation-center-line_min 0.031337769455374115 deviation-heading_max 0.4695314592890065 deviation-heading_mean 0.28295632700130013 deviation-heading_median 0.28969351082790473 deviation-heading_min 0.13822734158708538 driven_any_max 1.1972535692377095 driven_any_mean 1.069550703128448 driven_any_median 1.0381750331691957 driven_any_min 1.0257183998178268 driven_lanedir_consec_max 0.8123144800841251 driven_lanedir_consec_mean 0.6312226729648216 driven_lanedir_consec_min 0.4373052105850964 driven_lanedir_max 0.9325407987545682 driven_lanedir_mean 0.7224147694584564 driven_lanedir_median 0.8123144800841251 driven_lanedir_min 0.48318684247252186 in-drivable-lane_max 0.6000000000000004 in-drivable-lane_mean 0.3000000000000002 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.1972535692377095, "sim_physics": 0.02508194957460676, "survival_time": 1.4000000000000006, "driven_lanedir": 0.5600308085729072, "sim_render-ego": 0.05796179601124355, "in-drivable-lane": 0.5500000000000003, "agent_compute-ego": 0.11609634331294467, "deviation-heading": 0.4695314592890065, "set_robot_commands": 0.07587889262608119, "deviation-center-line": 0.05610305022565209, "driven_lanedir_consec": 0.4373052105850964, "sim_compute_sim_state": 0.032723375729152133, "sim_compute_performance-ego": 0.05608132907322475, "sim_compute_robot_state-ego": 0.05798964841025216, "sim_compute_robot_state-npc0": 0.0671357342175075, "sim_compute_robot_state-npc1": 0.061003684997558594, "sim_compute_robot_state-npc2": 0.05864178282873971, "sim_compute_robot_state-npc3": 0.06040725537708828}, "udem1-1-0": {"driven_any": 1.036014073841825, "sim_physics": 0.02398259441057841, "survival_time": 1.2000000000000004, "driven_lanedir": 0.48318684247252186, "sim_render-ego": 0.05649897456169128, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.12615767121315002, "deviation-heading": 0.13822734158708538, "set_robot_commands": 0.07499049107233684, "deviation-center-line": 0.031337769455374115, "driven_lanedir_consec": 0.48318684247252186, "sim_compute_sim_state": 0.03293833136558533, "sim_compute_performance-ego": 0.05511782566706339, "sim_compute_robot_state-ego": 0.05794729789098104, "sim_compute_robot_state-npc0": 0.06363330284754436, "sim_compute_robot_state-npc1": 0.055533905824025474, "sim_compute_robot_state-npc2": 0.056493004163106285, "sim_compute_robot_state-npc3": 0.05655478437741598}, "udem1-2-0": {"driven_any": 1.0257183998178268, "sim_physics": 0.026924102202705715, "survival_time": 1.1500000000000004, "driven_lanedir": 0.9325407987545682, "sim_render-ego": 0.06062007986980936, "in-drivable-lane": 0, "agent_compute-ego": 0.12144661986309548, "deviation-heading": 0.28969351082790473, "set_robot_commands": 0.07530553444572118, "deviation-center-line": 0.07504669169058735, "driven_lanedir_consec": 0.6896127428821732, "sim_compute_sim_state": 0.032093784083490784, "sim_compute_performance-ego": 0.057436715001645294, "sim_compute_robot_state-ego": 0.05973357739655868, "sim_compute_robot_state-npc0": 0.06404179075489873, "sim_compute_robot_state-npc1": 0.0589084936224896, "sim_compute_robot_state-npc2": 0.05623967751212742, "sim_compute_robot_state-npc3": 0.059118032455444336}, "udem1-3-0": {"driven_any": 1.0505924395756825, "sim_physics": 0.02675119690273119, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8240009174081598, "sim_render-ego": 0.057716452557107674, "in-drivable-lane": 0.20000000000000007, "agent_compute-ego": 0.11156471915867018, "deviation-heading": 0.19133902257839172, "set_robot_commands": 0.0795532516811205, "deviation-center-line": 0.04393905052607498, "driven_lanedir_consec": 0.7336940888001914, "sim_compute_sim_state": 0.033201165821241295, "sim_compute_performance-ego": 0.059401201165240745, "sim_compute_robot_state-ego": 0.05869822916777238, "sim_compute_robot_state-npc0": 0.06262452706046727, "sim_compute_robot_state-npc1": 0.0558573577715003, "sim_compute_robot_state-npc2": 0.060004659320997154, "sim_compute_robot_state-npc3": 0.05703549799711808}, "udem1-4-0": {"driven_any": 1.0381750331691957, "sim_physics": 0.023625187251878826, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8123144800841251, "sim_render-ego": 0.05822763235672661, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.12218914861264436, "deviation-heading": 0.32599030072411245, "set_robot_commands": 0.07323762644892154, "deviation-center-line": 0.07504206453166483, "driven_lanedir_consec": 0.8123144800841251, "sim_compute_sim_state": 0.032117273496544876, "sim_compute_performance-ego": 0.055823108424311096, "sim_compute_robot_state-ego": 0.05634208347486413, "sim_compute_robot_state-npc0": 0.05845256473707116, "sim_compute_robot_state-npc1": 0.05848863850469175, "sim_compute_robot_state-npc2": 0.056902833606885826, "sim_compute_robot_state-npc3": 0.05544970346533734}}set_robot_commands_max 0.0795532516811205 set_robot_commands_mean 0.07579315925483625 set_robot_commands_median 0.07530553444572118 set_robot_commands_min 0.07323762644892154 sim_compute_performance-ego_max 0.059401201165240745 sim_compute_performance-ego_mean 0.05677203586629707 sim_compute_performance-ego_median 0.05608132907322475 sim_compute_performance-ego_min 0.05511782566706339 sim_compute_robot_state-ego_max 0.05973357739655868 sim_compute_robot_state-ego_mean 0.05814216726808567 sim_compute_robot_state-ego_median 0.05798964841025216 sim_compute_robot_state-ego_min 0.05634208347486413 sim_compute_robot_state-npc0_max 0.0671357342175075 sim_compute_robot_state-npc0_mean 0.0631775839234978 sim_compute_robot_state-npc0_median 0.06363330284754436 sim_compute_robot_state-npc0_min 0.05845256473707116 sim_compute_robot_state-npc1_max 0.061003684997558594 sim_compute_robot_state-npc1_mean 0.05795841614405315 sim_compute_robot_state-npc1_median 0.05848863850469175 sim_compute_robot_state-npc1_min 0.055533905824025474 sim_compute_robot_state-npc2_max 0.060004659320997154 sim_compute_robot_state-npc2_mean 0.057656391486371285 sim_compute_robot_state-npc2_median 0.056902833606885826 sim_compute_robot_state-npc2_min 0.05623967751212742 sim_compute_robot_state-npc3_max 0.06040725537708828 sim_compute_robot_state-npc3_mean 0.05771305473448081 sim_compute_robot_state-npc3_median 0.05703549799711808 sim_compute_robot_state-npc3_min 0.05544970346533734 sim_compute_sim_state_max 0.033201165821241295 sim_compute_sim_state_mean 0.03261478609920289 sim_compute_sim_state_median 0.032723375729152133 sim_compute_sim_state_min 0.032093784083490784 sim_physics_max 0.026924102202705715 sim_physics_mean 0.025273006068500185 sim_physics_median 0.02508194957460676 sim_physics_min 0.023625187251878826 sim_render-ego_max 0.06062007986980936 sim_render-ego_mean 0.058204987071315696 sim_render-ego_median 0.05796179601124355 sim_render-ego_min 0.05649897456169128 simulation-passed 1 survival_time_max 1.4000000000000006 survival_time_mean 1.2100000000000004 survival_time_min 1.1500000000000004
No reset possible 175972428Andrea Censi random_agent aido2-LF-sim-testingstep1-simulation error no idsc-rudolf-47522019-04-15 11:53:13+00:00 2019-04-15 11:53:50+00:00 0:00:37 The result file is n [...] The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2428/step1-simulation-idsc-rudolf-4752-job17597:
File '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2428/step1-simulation-idsc-rudolf-4752-job17597/challenge-results/challenge_results.yaml' does not exist.
This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Andrea Censi 🇨🇭
