Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 17625
2450
Nicky Eichmann Baseline solution using reinforcement learning aido2-LFVI-sim-testing
step1-simulation timeout no idsc-rudolf-5021
2019-04-15 13:00:02+00:00 2019-04-15 13:25:08+00:00 0:25:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17618
2444
Jacopo Tani random_agent aido2-LFVI-sim-validation
step1-simulation success no idsc-rudolf-5021
2019-04-15 12:16:25+00:00 2019-04-15 12:22:27+00:00 0:06:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6896127428821732 survival_time_median 1.1500000000000004 deviation-center-line_median 0.05610305022565209 in-drivable-lane_median 0.20000000000000007
other stats agent_compute-ego_max 0.1491337517897288 agent_compute-ego_mean 0.140398796584542 agent_compute-ego_median 0.13872083595820836 agent_compute-ego_min 0.13720681356347125 deviation-center-line_max 0.07504669169058735 deviation-center-line_mean 0.05629372528587068 deviation-center-line_min 0.031337769455374115 deviation-heading_max 0.4695314592890065 deviation-heading_mean 0.28295632700130013 deviation-heading_median 0.28969351082790473 deviation-heading_min 0.13822734158708538 driven_any_max 1.1972535692377095 driven_any_mean 1.069550703128448 driven_any_median 1.0381750331691957 driven_any_min 1.0257183998178268 driven_lanedir_consec_max 0.8123144800841251 driven_lanedir_consec_mean 0.6312226729648216 driven_lanedir_consec_min 0.4373052105850964 driven_lanedir_max 0.9325407987545682 driven_lanedir_mean 0.7224147694584564 driven_lanedir_median 0.8123144800841251 driven_lanedir_min 0.48318684247252186 in-drivable-lane_max 0.6000000000000004 in-drivable-lane_mean 0.3000000000000002 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.1972535692377095, "sim_physics": 0.027964890003204346, "survival_time": 1.4000000000000006, "driven_lanedir": 0.5600308085729072, "sim_render-ego": 0.06058364255087716, "in-drivable-lane": 0.5500000000000003, "agent_compute-ego": 0.13872083595820836, "deviation-heading": 0.4695314592890065, "set_robot_commands": 0.07894635200500488, "deviation-center-line": 0.05610305022565209, "driven_lanedir_consec": 0.4373052105850964, "sim_compute_sim_state": 0.034638243062155585, "sim_compute_performance-ego": 0.059517272881099155, "sim_compute_robot_state-ego": 0.06305325031280518, "sim_compute_robot_state-npc0": 0.06611052581242152, "sim_compute_robot_state-npc1": 0.0649473752294268, "sim_compute_robot_state-npc2": 0.06746592691966466, "sim_compute_robot_state-npc3": 0.06451576096670968}, "udem1-1-0": {"driven_any": 1.036014073841825, "sim_physics": 0.024486194054285686, "survival_time": 1.2000000000000004, "driven_lanedir": 0.48318684247252186, "sim_render-ego": 0.062169174353281655, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.1491337517897288, "deviation-heading": 0.13822734158708538, "set_robot_commands": 0.08377404014269511, "deviation-center-line": 0.031337769455374115, "driven_lanedir_consec": 0.48318684247252186, "sim_compute_sim_state": 0.03322631120681763, "sim_compute_performance-ego": 0.05961247285207113, "sim_compute_robot_state-ego": 0.05686613917350769, "sim_compute_robot_state-npc0": 0.06667213638623555, "sim_compute_robot_state-npc1": 0.061780979235967, "sim_compute_robot_state-npc2": 0.05942427118619283, "sim_compute_robot_state-npc3": 0.059365431467692055}, "udem1-2-0": {"driven_any": 1.0257183998178268, "sim_physics": 0.02645982866701873, "survival_time": 1.1500000000000004, "driven_lanedir": 0.9325407987545682, "sim_render-ego": 0.05816011843474015, "in-drivable-lane": 0, "agent_compute-ego": 0.1378899968188742, "deviation-heading": 0.28969351082790473, "set_robot_commands": 0.07439240165378737, "deviation-center-line": 0.07504669169058735, "driven_lanedir_consec": 0.6896127428821732, "sim_compute_sim_state": 0.03337424734364385, "sim_compute_performance-ego": 0.054255101991736374, "sim_compute_robot_state-ego": 0.057366702867590866, "sim_compute_robot_state-npc0": 0.06222002402595852, "sim_compute_robot_state-npc1": 0.06176183534705121, "sim_compute_robot_state-npc2": 0.06061404684315557, "sim_compute_robot_state-npc3": 0.06220305484274159}, "udem1-3-0": {"driven_any": 1.0505924395756825, "sim_physics": 0.027325350305308468, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8240009174081598, "sim_render-ego": 0.06764233630636464, "in-drivable-lane": 0.20000000000000007, "agent_compute-ego": 0.13720681356347125, "deviation-heading": 0.19133902257839172, "set_robot_commands": 0.07435040888578995, "deviation-center-line": 0.04393905052607498, "driven_lanedir_consec": 0.7336940888001914, "sim_compute_sim_state": 0.03471330974413001, "sim_compute_performance-ego": 0.06546710885089377, "sim_compute_robot_state-ego": 0.06631255149841309, "sim_compute_robot_state-npc0": 0.06440235220867654, "sim_compute_robot_state-npc1": 0.06674379887788193, "sim_compute_robot_state-npc2": 0.06223084615624469, "sim_compute_robot_state-npc3": 0.06107737707055133}, "udem1-4-0": {"driven_any": 1.0381750331691957, "sim_physics": 0.025186631990515667, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8123144800841251, "sim_render-ego": 0.06296808823295262, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1390425847924274, "deviation-heading": 0.32599030072411245, "set_robot_commands": 0.0778404422428297, "deviation-center-line": 0.07504206453166483, "driven_lanedir_consec": 0.8123144800841251, "sim_compute_sim_state": 0.03371791217638099, "sim_compute_performance-ego": 0.06009860660718835, "sim_compute_robot_state-ego": 0.05993657526762589, "sim_compute_robot_state-npc0": 0.06423719032951024, "sim_compute_robot_state-npc1": 0.06478057736935823, "sim_compute_robot_state-npc2": 0.06109164072119672, "sim_compute_robot_state-npc3": 0.06003988307455312}}set_robot_commands_max 0.08377404014269511 set_robot_commands_mean 0.07786072898602141 set_robot_commands_median 0.0778404422428297 set_robot_commands_min 0.07435040888578995 sim_compute_performance-ego_max 0.06546710885089377 sim_compute_performance-ego_mean 0.059790112636597746 sim_compute_performance-ego_median 0.05961247285207113 sim_compute_performance-ego_min 0.054255101991736374 sim_compute_robot_state-ego_max 0.06631255149841309 sim_compute_robot_state-ego_mean 0.060707043823988546 sim_compute_robot_state-ego_median 0.05993657526762589 sim_compute_robot_state-ego_min 0.05686613917350769 sim_compute_robot_state-npc0_max 0.06667213638623555 sim_compute_robot_state-npc0_mean 0.06472844575256048 sim_compute_robot_state-npc0_median 0.06440235220867654 sim_compute_robot_state-npc0_min 0.06222002402595852 sim_compute_robot_state-npc1_max 0.06674379887788193 sim_compute_robot_state-npc1_mean 0.06400291321193703 sim_compute_robot_state-npc1_median 0.06478057736935823 sim_compute_robot_state-npc1_min 0.06176183534705121 sim_compute_robot_state-npc2_max 0.06746592691966466 sim_compute_robot_state-npc2_mean 0.0621653463652909 sim_compute_robot_state-npc2_median 0.06109164072119672 sim_compute_robot_state-npc2_min 0.05942427118619283 sim_compute_robot_state-npc3_max 0.06451576096670968 sim_compute_robot_state-npc3_mean 0.06144030148444955 sim_compute_robot_state-npc3_median 0.06107737707055133 sim_compute_robot_state-npc3_min 0.059365431467692055 sim_compute_sim_state_max 0.03471330974413001 sim_compute_sim_state_mean 0.03393400470662561 sim_compute_sim_state_median 0.03371791217638099 sim_compute_sim_state_min 0.03322631120681763 sim_physics_max 0.027964890003204346 sim_physics_mean 0.026284579004066576 sim_physics_median 0.02645982866701873 sim_physics_min 0.024486194054285686 sim_render-ego_max 0.06764233630636464 sim_render-ego_mean 0.062304671975643246 sim_render-ego_median 0.062169174353281655 sim_render-ego_min 0.05816011843474015 simulation-passed 1 survival_time_max 1.4000000000000006 survival_time_mean 1.2100000000000004 survival_time_min 1.1500000000000004
No reset possible 17614
2406
Victor Guerra 🇫🇷Baseline solution using reinforcement learning aido2-LFVI-sim-testing
step1-simulation success no idsc-rudolf-5021
2019-04-15 11:59:15+00:00 2019-04-15 12:12:58+00:00 0:13:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.11304706858864444 survival_time_median 1.2500000000000004 deviation-center-line_median 0.03185274085899882 in-drivable-lane_median 0.5500000000000002
other stats agent_compute-ego_max 0.32692435052659774 agent_compute-ego_mean 0.2822232983091958 agent_compute-ego_median 0.27995810031890866 agent_compute-ego_min 0.20940041542053223 deviation-center-line_max 0.6438665186418749 deviation-center-line_mean 0.1468461803065917 deviation-center-line_min 0.006748159431451163 deviation-heading_max 5.722979773031138 deviation-heading_mean 1.5097389607002063 deviation-heading_median 0.5411902950735957 deviation-heading_min 0.20542024470427456 driven_any_max 3.6835282404261833 driven_any_mean 0.9477098313635328 driven_any_median 0.322979869507767 driven_any_min 0.1305700262231435 driven_lanedir_consec_max 1.1544593334715092 driven_lanedir_consec_mean 0.301545742094046 driven_lanedir_consec_min 0.02888616329131932 driven_lanedir_max 1.1544593334715092 driven_lanedir_mean 0.301545742094046 driven_lanedir_median 0.11304706858864444 driven_lanedir_min 0.02888616329131932 in-drivable-lane_max 7.600000000000038 in-drivable-lane_mean 1.8900000000000077 in-drivable-lane_min 0.19999999999999996 per-episodes details {"udem1-0-0": {"driven_any": 3.6835282404261833, "sim_physics": 0.02654119571050008, "survival_time": 14.950000000000076, "driven_lanedir": 1.1544593334715092, "sim_render-ego": 0.060751638412475585, "in-drivable-lane": 7.600000000000038, "agent_compute-ego": 0.27995810031890866, "deviation-heading": 5.722979773031138, "set_robot_commands": 0.0757248862584432, "deviation-center-line": 0.6438665186418749, "driven_lanedir_consec": 1.1544593334715092, "sim_compute_sim_state": 0.03448544979095459, "sim_compute_performance-ego": 0.06028344710667928, "sim_compute_robot_state-ego": 0.061816708246866865, "sim_compute_robot_state-npc0": 0.06808482249577841, "sim_compute_robot_state-npc1": 0.06223679622014363, "sim_compute_robot_state-npc2": 0.060700456301371254, "sim_compute_robot_state-npc3": 0.0610204815864563}, "udem1-1-0": {"driven_any": 0.3457610127790314, "sim_physics": 0.026192215772775505, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11304706858864444, "sim_render-ego": 0.06414901293241061, "in-drivable-lane": 0.6000000000000002, "agent_compute-ego": 0.3166278967490563, "deviation-heading": 0.5411902950735957, "set_robot_commands": 0.07632460043980525, "deviation-center-line": 0.03185274085899882, "driven_lanedir_consec": 0.11304706858864444, "sim_compute_sim_state": 0.03507398642026461, "sim_compute_performance-ego": 0.06170321427858793, "sim_compute_robot_state-ego": 0.06273978490095872, "sim_compute_robot_state-npc0": 0.06802755135756272, "sim_compute_robot_state-npc1": 0.06356990337371826, "sim_compute_robot_state-npc2": 0.06142804255852333, "sim_compute_robot_state-npc3": 0.06269222956437331}, "udem1-2-0": {"driven_any": 0.322979869507767, "sim_physics": 0.027661237716674805, "survival_time": 1.2500000000000004, "driven_lanedir": 0.12490324987272672, "sim_render-ego": 0.061186933517456056, "in-drivable-lane": 0.5500000000000002, "agent_compute-ego": 0.27820572853088377, "deviation-heading": 0.5277771852295926, "set_robot_commands": 0.07761228561401368, "deviation-center-line": 0.019021567408077325, "driven_lanedir_consec": 0.12490324987272672, "sim_compute_sim_state": 0.03223423004150391, "sim_compute_performance-ego": 0.0601457691192627, "sim_compute_robot_state-ego": 0.06305768013000489, "sim_compute_robot_state-npc0": 0.06357167243957519, "sim_compute_robot_state-npc1": 0.059883766174316407, "sim_compute_robot_state-npc2": 0.05771204948425293, "sim_compute_robot_state-npc3": 0.05757341384887695}, "udem1-3-0": {"driven_any": 0.1305700262231435, "sim_physics": 0.03133042653401693, "survival_time": 0.45, "driven_lanedir": 0.02888616329131932, "sim_render-ego": 0.06380550066630046, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.32692435052659774, "deviation-heading": 0.20542024470427456, "set_robot_commands": 0.08142913712395562, "deviation-center-line": 0.006748159431451163, "driven_lanedir_consec": 0.02888616329131932, "sim_compute_sim_state": 0.03740922609965006, "sim_compute_performance-ego": 0.0636919339497884, "sim_compute_robot_state-ego": 0.07603579097323948, "sim_compute_robot_state-npc0": 0.06695710288153754, "sim_compute_robot_state-npc1": 0.05508926179673937, "sim_compute_robot_state-npc2": 0.0585689279768202, "sim_compute_robot_state-npc3": 0.05796498722500271}, "udem1-4-0": {"driven_any": 0.25571000788153936, "sim_physics": 0.026910553375879925, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08643289524603026, "sim_render-ego": 0.0626728634039561, "in-drivable-lane": 0.5000000000000002, "agent_compute-ego": 0.20940041542053223, "deviation-heading": 0.5513273054624308, "set_robot_commands": 0.07745538155237834, "deviation-center-line": 0.03274191519255615, "driven_lanedir_consec": 0.08643289524603026, "sim_compute_sim_state": 0.03420518835385641, "sim_compute_performance-ego": 0.0633466641108195, "sim_compute_robot_state-ego": 0.06519754727681477, "sim_compute_robot_state-npc0": 0.06648043791453044, "sim_compute_robot_state-npc1": 0.061459859212239586, "sim_compute_robot_state-npc2": 0.062280237674713135, "sim_compute_robot_state-npc3": 0.05918233593304952}}set_robot_commands_max 0.08142913712395562 set_robot_commands_mean 0.07770925819771922 set_robot_commands_median 0.07745538155237834 set_robot_commands_min 0.0757248862584432 sim_compute_performance-ego_max 0.0636919339497884 sim_compute_performance-ego_mean 0.06183420571302757 sim_compute_performance-ego_median 0.06170321427858793 sim_compute_performance-ego_min 0.0601457691192627 sim_compute_robot_state-ego_max 0.07603579097323948 sim_compute_robot_state-ego_mean 0.06576950230557695 sim_compute_robot_state-ego_median 0.06305768013000489 sim_compute_robot_state-ego_min 0.061816708246866865 sim_compute_robot_state-npc0_max 0.06808482249577841 sim_compute_robot_state-npc0_mean 0.06662431741779687 sim_compute_robot_state-npc0_median 0.06695710288153754 sim_compute_robot_state-npc0_min 0.06357167243957519 sim_compute_robot_state-npc1_max 0.06356990337371826 sim_compute_robot_state-npc1_mean 0.060447917355431445 sim_compute_robot_state-npc1_median 0.061459859212239586 sim_compute_robot_state-npc1_min 0.05508926179673937 sim_compute_robot_state-npc2_max 0.062280237674713135 sim_compute_robot_state-npc2_mean 0.06013794279913617 sim_compute_robot_state-npc2_median 0.060700456301371254 sim_compute_robot_state-npc2_min 0.05771204948425293 sim_compute_robot_state-npc3_max 0.06269222956437331 sim_compute_robot_state-npc3_mean 0.05968668963155176 sim_compute_robot_state-npc3_median 0.05918233593304952 sim_compute_robot_state-npc3_min 0.05757341384887695 sim_compute_sim_state_max 0.03740922609965006 sim_compute_sim_state_mean 0.034681616141245916 sim_compute_sim_state_median 0.03448544979095459 sim_compute_sim_state_min 0.03223423004150391 sim_physics_max 0.03133042653401693 sim_physics_mean 0.02772712582196945 sim_physics_median 0.026910553375879925 sim_physics_min 0.026192215772775505 sim_render-ego_max 0.06414901293241061 sim_render-ego_mean 0.06251318978651976 sim_render-ego_median 0.0626728634039561 sim_render-ego_min 0.060751638412475585 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 3.830000000000015 survival_time_min 0.45
No reset possible 17607
2417
Andrea Censi 🇨🇭random_agent aido2-LF-sim-validation
step1-simulation success no idsc-rudolf-5021
2019-04-15 11:55:23+00:00 2019-04-15 11:59:02+00:00 0:03:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8171921272237834 survival_time_median 1.1000000000000003 deviation-center-line_median 0.025668493904927793 in-drivable-lane_median 0.04999999999999999
other stats agent_compute-ego_max 0.13553362143667122 agent_compute-ego_mean 0.12776958422789453 agent_compute-ego_median 0.12626214460893112 agent_compute-ego_min 0.12103818810504416 deviation-center-line_max 0.057019386027434615 deviation-center-line_mean 0.03634226830745448 deviation-center-line_min 0.02280708605632212 deviation-heading_max 0.235756116193223 deviation-heading_mean 0.1638165081234764 deviation-heading_median 0.1411032446854075 deviation-heading_min 0.118601117425238 driven_any_max 1.028556309238097 driven_any_mean 0.8412197852214389 driven_any_median 0.956358012875939 driven_any_min 0.39300074524610096 driven_lanedir_consec_max 0.9648079053779924 driven_lanedir_consec_mean 0.6642871273891694 driven_lanedir_consec_min 0.31973792380899546 driven_lanedir_max 0.9648079053779924 driven_lanedir_mean 0.6642871273891694 driven_lanedir_median 0.8171921272237834 driven_lanedir_min 0.31973792380899546 in-drivable-lane_max 0.7000000000000004 in-drivable-lane_mean 0.1700000000000001 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.013552199239316194, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.06412478115247644, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.13112514951954718, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.07599872091542119, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.03722074757451597, "sim_compute_performance-ego": 0.06318720527317213, "sim_compute_robot_state-ego": 0.06429888891137164}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.028556309238097, "sim_physics": 0.012886151023533032, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8903034692826748, "sim_render-ego": 0.0562233302904212, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12103818810504416, "deviation-heading": 0.2040407077275886, "set_robot_commands": 0.07443694446397864, "deviation-center-line": 0.025365426656828987, "driven_lanedir_consec": 0.8903034692826748, "sim_compute_sim_state": 0.035824796427851135, "sim_compute_performance-ego": 0.06272686046102773, "sim_compute_robot_state-ego": 0.06490558126698369}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.976866789982963, "sim_physics": 0.012886643409729004, "survival_time": 1.1000000000000003, "driven_lanedir": 0.9648079053779924, "sim_render-ego": 0.05938374996185303, "in-drivable-lane": 0, "agent_compute-ego": 0.12626214460893112, "deviation-heading": 0.1411032446854075, "set_robot_commands": 0.07450191541151567, "deviation-center-line": 0.050850948891758854, "driven_lanedir_consec": 0.9648079053779924, "sim_compute_sim_state": 0.0377673019062389, "sim_compute_performance-ego": 0.05572201988913796, "sim_compute_robot_state-ego": 0.06203726204958829}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39300074524610096, "sim_physics": 0.012476126352945965, "survival_time": 0.45, "driven_lanedir": 0.31973792380899546, "sim_render-ego": 0.056995789210001625, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.12488881746927898, "deviation-heading": 0.11958135458592496, "set_robot_commands": 0.07912058300442165, "deviation-center-line": 0.025668493904927793, "driven_lanedir_consec": 0.31973792380899546, "sim_compute_sim_state": 0.035708109537760414, "sim_compute_performance-ego": 0.06088211801317003, "sim_compute_robot_state-ego": 0.06236942609151205}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8513170687640946, "sim_physics": 0.014201277180721884, "survival_time": 0.9500000000000004, "driven_lanedir": 0.8171921272237834, "sim_render-ego": 0.06060937831276342, "in-drivable-lane": 0, "agent_compute-ego": 0.13553362143667122, "deviation-heading": 0.235756116193223, "set_robot_commands": 0.08303786578931306, "deviation-center-line": 0.057019386027434615, "driven_lanedir_consec": 0.8171921272237834, "sim_compute_sim_state": 0.036197938417133535, "sim_compute_performance-ego": 0.06162107618231522, "sim_compute_robot_state-ego": 0.061555762039987666}}set_robot_commands_max 0.08303786578931306 set_robot_commands_mean 0.07741920591693005 set_robot_commands_median 0.07599872091542119 set_robot_commands_min 0.07443694446397864 sim_compute_performance-ego_max 0.06318720527317213 sim_compute_performance-ego_mean 0.060827855963764624 sim_compute_performance-ego_median 0.06162107618231522 sim_compute_performance-ego_min 0.05572201988913796 sim_compute_robot_state-ego_max 0.06490558126698369 sim_compute_robot_state-ego_mean 0.06303338407188867 sim_compute_robot_state-ego_median 0.06236942609151205 sim_compute_robot_state-ego_min 0.061555762039987666 sim_compute_sim_state_max 0.0377673019062389 sim_compute_sim_state_mean 0.036543778772699986 sim_compute_sim_state_median 0.036197938417133535 sim_compute_sim_state_min 0.035708109537760414 sim_physics_max 0.014201277180721884 sim_physics_mean 0.013200479441249215 sim_physics_median 0.012886643409729004 sim_physics_min 0.012476126352945965 sim_render-ego_max 0.06412478115247644 sim_render-ego_mean 0.059467405785503136 sim_render-ego_median 0.05938374996185303 sim_render-ego_min 0.0562233302904212 simulation-passed 1 survival_time_max 1.1500000000000004 survival_time_mean 0.9600000000000004 survival_time_min 0.45
No reset possible 17598
2433
Andrea Censi 🇨🇭random_agent aido2-LFV-sim-validation
step1-simulation error no idsc-rudolf-5021
2019-04-15 11:53:13+00:00 2019-04-15 11:53:56+00:00 0:00:43 The result file is n [...] The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission2433/step1-simulation-idsc-rudolf-5021-job17598:
File '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission2433/step1-simulation-idsc-rudolf-5021-job17598/challenge-results/challenge_results.yaml' does not exist.
This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible