Duckietown Challenges Home Challenges Submissions

Job 62075

Job ID62075
submission13609
userAndras Beres
user labelfsf+il
challengeaido-LFV_multi-sim-validation
step356
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg02
date started
date completed
duration1:28:27
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median25.500000000000227
in-drivable-lane_median0.1750000000000016
driven_lanedir_consec_median5.360290638140267
deviation-center-line_median1.6419512001605852


other stats
agent_compute-ego0_max0.1905884283669987
agent_compute-ego0_mean0.13749655981614667
agent_compute-ego0_median0.13020304877697372
agent_compute-ego0_min0.12516921183030552
agent_compute-ego1_max0.199099684353941
agent_compute-ego1_mean0.12487586517596448
agent_compute-ego1_median0.11134529707959136
agent_compute-ego1_min0.10883233615820356
complete-iteration_max1.7643214470377098
complete-iteration_mean1.478999549848004
complete-iteration_median1.6127399824370143
complete-iteration_min1.077682435882758
deviation-center-line_max4.685258885331869
deviation-center-line_mean2.1099678146582512
deviation-center-line_min0.46580390692958307
deviation-heading_max14.88277701798551
deviation-heading_mean5.191134890418641
deviation-heading_median3.4508961524946553
deviation-heading_min1.1525089054371125
driven_any_max22.4584202936406
driven_any_mean7.736861551751716
driven_any_median5.422717717740274
driven_any_min1.0082410328396767
driven_lanedir_consec_max21.08988072347855
driven_lanedir_consec_mean7.364004911170505
driven_lanedir_consec_min0.9961498420037288
driven_lanedir_max21.08988072347855
driven_lanedir_mean7.364004911170505
driven_lanedir_median5.360290638140267
driven_lanedir_min0.9961498420037288
get_duckie_state_max3.5479772005149787e-06
get_duckie_state_mean3.275568963865196e-06
get_duckie_state_median3.3460302144938913e-06
get_duckie_state_min2.8077119625873447e-06
get_robot_state_max0.051953022428553736
get_robot_state_mean0.04931664195184721
get_robot_state_median0.04988546782441104
get_robot_state_min0.04426761443570534
get_state_dump_max0.07501767733082268
get_state_dump_mean0.0389291545641392
get_state_dump_median0.03282281369558871
get_state_dump_min0.031126749258918535
get_ui_image_max0.08891100378422723
get_ui_image_mean0.08305114146087998
get_ui_image_median0.08469485023483604
get_ui_image_min0.07662444085067843
in-drivable-lane_max7.0000000000000995
in-drivable-lane_mean1.07142857142858
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.0082410328396767, "get_ui_image": 0.07876092066867746, "step_physics": 0.4990105414562088, "survival_time": 13.850000000000062, "driven_lanedir": 0.9961498420037288, "get_state_dump": 0.03479363935456859, "get_robot_state": 0.051953022428553736, "sim_render-ego0": 0.010964995665515929, "sim_render-ego1": 0.008975956079771193, "sim_render-ego2": 0.00990116510459845, "sim_render-ego3": 0.010688417249446292, "get_duckie_state": 3.5479772005149787e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.545925571247038, "agent_compute-ego0": 0.13057148456573486, "agent_compute-ego1": 0.10883233615820356, "agent_compute-ego2": 0.11363598854421712, "agent_compute-ego3": 0.10833718021996588, "complete-iteration": 1.2605957770519118, "set_robot_commands": 0.006361283844323467, "deviation-center-line": 1.735239931417952, "driven_lanedir_consec": 0.9961498420037288, "sim_compute_sim_state": 0.038162384959433575, "sim_compute_performance-ego0": 0.006530004439594076, "sim_compute_performance-ego1": 0.006323178895085836, "sim_compute_performance-ego2": 0.005958707212544174, "sim_compute_performance-ego3": 0.005927603879420877}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.258770474720355, "get_ui_image": 0.07876092066867746, "step_physics": 0.4990105414562088, "survival_time": 13.850000000000062, "driven_lanedir": 3.2337016565524217, "get_state_dump": 0.03479363935456859, "get_robot_state": 0.051953022428553736, "sim_render-ego0": 0.010964995665515929, "sim_render-ego1": 0.008975956079771193, "sim_render-ego2": 0.00990116510459845, "sim_render-ego3": 0.010688417249446292, "get_duckie_state": 3.5479772005149787e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.8544960444546943, "agent_compute-ego0": 0.13057148456573486, "agent_compute-ego1": 0.10883233615820356, "agent_compute-ego2": 0.11363598854421712, "agent_compute-ego3": 0.10833718021996588, "complete-iteration": 1.2605957770519118, "set_robot_commands": 0.006361283844323467, "deviation-center-line": 0.6167840099545502, "driven_lanedir_consec": 3.2337016565524217, "sim_compute_sim_state": 0.038162384959433575, "sim_compute_performance-ego0": 0.006530004439594076, "sim_compute_performance-ego1": 0.006323178895085836, "sim_compute_performance-ego2": 0.005958707212544174, "sim_compute_performance-ego3": 0.005927603879420877}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.1187115731218191, "get_ui_image": 0.07876092066867746, "step_physics": 0.4990105414562088, "survival_time": 13.850000000000062, "driven_lanedir": 1.1131295310046354, "get_state_dump": 0.03479363935456859, "get_robot_state": 0.051953022428553736, "sim_render-ego0": 0.010964995665515929, "sim_render-ego1": 0.008975956079771193, "sim_render-ego2": 0.00990116510459845, "sim_render-ego3": 0.010688417249446292, "get_duckie_state": 3.5479772005149787e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.8838969112830357, "agent_compute-ego0": 0.13057148456573486, "agent_compute-ego1": 0.10883233615820356, "agent_compute-ego2": 0.11363598854421712, "agent_compute-ego3": 0.10833718021996588, "complete-iteration": 1.2605957770519118, "set_robot_commands": 0.006361283844323467, "deviation-center-line": 0.7423025763132469, "driven_lanedir_consec": 1.1131295310046354, "sim_compute_sim_state": 0.038162384959433575, "sim_compute_performance-ego0": 0.006530004439594076, "sim_compute_performance-ego1": 0.006323178895085836, "sim_compute_performance-ego2": 0.005958707212544174, "sim_compute_performance-ego3": 0.005927603879420877}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 6.713440324010016, "get_ui_image": 0.07876092066867746, "step_physics": 0.4990105414562088, "survival_time": 13.850000000000062, "driven_lanedir": 6.638092313984866, "get_state_dump": 0.03479363935456859, "get_robot_state": 0.051953022428553736, "sim_render-ego0": 0.010964995665515929, "sim_render-ego1": 0.008975956079771193, "sim_render-ego2": 0.00990116510459845, "sim_render-ego3": 0.010688417249446292, "get_duckie_state": 3.5479772005149787e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.7142911499450282, "agent_compute-ego0": 0.13057148456573486, "agent_compute-ego1": 0.10883233615820356, "agent_compute-ego2": 0.11363598854421712, "agent_compute-ego3": 0.10833718021996588, "complete-iteration": 1.2605957770519118, "set_robot_commands": 0.006361283844323467, "deviation-center-line": 0.8659188623204263, "driven_lanedir_consec": 6.638092313984866, "sim_compute_sim_state": 0.038162384959433575, "sim_compute_performance-ego0": 0.006530004439594076, "sim_compute_performance-ego1": 0.006323178895085836, "sim_compute_performance-ego2": 0.005958707212544174, "sim_compute_performance-ego3": 0.005927603879420877}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 22.4584202936406, "get_ui_image": 0.08891100378422723, "step_physics": 0.9845537465928376, "survival_time": 48.099999999999405, "driven_lanedir": 21.08988072347855, "get_state_dump": 0.03282281369558871, "get_robot_state": 0.04988546782441104, "sim_render-ego0": 0.010189216332519783, "sim_render-ego1": 0.00966342067421411, "sim_render-ego2": 0.009309081149868751, "sim_render-ego3": 0.008682929095449477, "get_duckie_state": 3.3460302144938913e-06, "in-drivable-lane": 2.599999999999987, "deviation-heading": 7.488414182630852, "agent_compute-ego0": 0.12516921183030552, "agent_compute-ego1": 0.11134529707959136, "agent_compute-ego2": 0.1091438382090314, "agent_compute-ego3": 0.1093684874343476, "complete-iteration": 1.7643214470377098, "set_robot_commands": 0.007262798855980608, "deviation-center-line": 3.5117593562722984, "driven_lanedir_consec": 21.08988072347855, "sim_compute_sim_state": 0.06477536442123841, "sim_compute_performance-ego0": 0.007168443527300905, "sim_compute_performance-ego1": 0.005452958718019606, "sim_compute_performance-ego2": 0.005030844441826841, "sim_compute_performance-ego3": 0.005130230328251887}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 11.600709578828434, "get_ui_image": 0.08891100378422723, "step_physics": 0.9845537465928376, "survival_time": 48.099999999999405, "driven_lanedir": 10.92528890466095, "get_state_dump": 0.03282281369558871, "get_robot_state": 0.04988546782441104, "sim_render-ego0": 0.010189216332519783, "sim_render-ego1": 0.00966342067421411, "sim_render-ego2": 0.009309081149868751, "sim_render-ego3": 0.008682929095449477, "get_duckie_state": 3.3460302144938913e-06, "in-drivable-lane": 1.2500000000000044, "deviation-heading": 14.88277701798551, "agent_compute-ego0": 0.12516921183030552, "agent_compute-ego1": 0.11134529707959136, "agent_compute-ego2": 0.1091438382090314, "agent_compute-ego3": 0.1093684874343476, "complete-iteration": 1.7643214470377098, "set_robot_commands": 0.007262798855980608, "deviation-center-line": 4.685258885331869, "driven_lanedir_consec": 10.92528890466095, "sim_compute_sim_state": 0.06477536442123841, "sim_compute_performance-ego0": 0.007168443527300905, "sim_compute_performance-ego1": 0.005452958718019606, "sim_compute_performance-ego2": 0.005030844441826841, "sim_compute_performance-ego3": 0.005130230328251887}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 14.882625929480804, "get_ui_image": 0.08891100378422723, "step_physics": 0.9845537465928376, "survival_time": 48.099999999999405, "driven_lanedir": 14.082195873383895, "get_state_dump": 0.03282281369558871, "get_robot_state": 0.04988546782441104, "sim_render-ego0": 0.010189216332519783, "sim_render-ego1": 0.00966342067421411, "sim_render-ego2": 0.009309081149868751, "sim_render-ego3": 0.008682929095449477, "get_duckie_state": 3.3460302144938913e-06, "in-drivable-lane": 1.4500000000000108, "deviation-heading": 6.631339641284122, "agent_compute-ego0": 0.12516921183030552, "agent_compute-ego1": 0.11134529707959136, "agent_compute-ego2": 0.1091438382090314, "agent_compute-ego3": 0.1093684874343476, "complete-iteration": 1.7643214470377098, "set_robot_commands": 0.007262798855980608, "deviation-center-line": 3.3761229140722087, "driven_lanedir_consec": 14.082195873383895, "sim_compute_sim_state": 0.06477536442123841, "sim_compute_performance-ego0": 0.007168443527300905, "sim_compute_performance-ego1": 0.005452958718019606, "sim_compute_performance-ego2": 0.005030844441826841, "sim_compute_performance-ego3": 0.005130230328251887}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 11.288432337203725, "get_ui_image": 0.08891100378422723, "step_physics": 0.9845537465928376, "survival_time": 48.099999999999405, "driven_lanedir": 10.909233457179283, "get_state_dump": 0.03282281369558871, "get_robot_state": 0.04988546782441104, "sim_render-ego0": 0.010189216332519783, "sim_render-ego1": 0.00966342067421411, "sim_render-ego2": 0.009309081149868751, "sim_render-ego3": 0.008682929095449477, "get_duckie_state": 3.3460302144938913e-06, "in-drivable-lane": 0.3500000000000032, "deviation-heading": 10.291517953394273, "agent_compute-ego0": 0.12516921183030552, "agent_compute-ego1": 0.11134529707959136, "agent_compute-ego2": 0.1091438382090314, "agent_compute-ego3": 0.1093684874343476, "complete-iteration": 1.7643214470377098, "set_robot_commands": 0.007262798855980608, "deviation-center-line": 3.973005565851766, "driven_lanedir_consec": 10.909233457179283, "sim_compute_sim_state": 0.06477536442123841, "sim_compute_performance-ego0": 0.007168443527300905, "sim_compute_performance-ego1": 0.005452958718019606, "sim_compute_performance-ego2": 0.005030844441826841, "sim_compute_performance-ego3": 0.005130230328251887}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 9.289474282206614, "get_ui_image": 0.08469485023483604, "step_physics": 0.8311178642243089, "survival_time": 25.500000000000227, "driven_lanedir": 8.76615241756709, "get_state_dump": 0.031126749258918535, "get_robot_state": 0.04863594936064778, "sim_render-ego0": 0.010688935240654096, "sim_render-ego1": 0.009216306727459753, "sim_render-ego2": 0.007777303632224843, "sim_render-ego3": 0.009375058974771816, "get_duckie_state": 3.1666279772256454e-06, "in-drivable-lane": 7.0000000000000995, "deviation-heading": 3.355866733742272, "agent_compute-ego0": 0.13020304877697372, "agent_compute-ego1": 0.11733805270111024, "agent_compute-ego2": 0.11416787690612434, "agent_compute-ego3": 0.11179864523228834, "complete-iteration": 1.6127399824370143, "set_robot_commands": 0.007825631218180498, "deviation-center-line": 1.1572362815813495, "driven_lanedir_consec": 8.76615241756709, "sim_compute_sim_state": 0.05593560959728263, "sim_compute_performance-ego0": 0.007174836679447421, "sim_compute_performance-ego1": 0.005075638541503428, "sim_compute_performance-ego2": 0.00490181133471823, "sim_compute_performance-ego3": 0.005515518487083002}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.634422435690906, "get_ui_image": 0.08469485023483604, "step_physics": 0.8311178642243089, "survival_time": 25.500000000000227, "driven_lanedir": 3.060634333986818, "get_state_dump": 0.031126749258918535, "get_robot_state": 0.04863594936064778, "sim_render-ego0": 0.010688935240654096, "sim_render-ego1": 0.009216306727459753, "sim_render-ego2": 0.007777303632224843, "sim_render-ego3": 0.009375058974771816, "get_duckie_state": 3.1666279772256454e-06, "in-drivable-lane": 1.3000000000000007, "deviation-heading": 9.103409844428269, "agent_compute-ego0": 0.13020304877697372, "agent_compute-ego1": 0.11733805270111024, "agent_compute-ego2": 0.11416787690612434, "agent_compute-ego3": 0.11179864523228834, "complete-iteration": 1.6127399824370143, "set_robot_commands": 0.007825631218180498, "deviation-center-line": 3.5437718854438516, "driven_lanedir_consec": 3.060634333986818, "sim_compute_sim_state": 0.05593560959728263, "sim_compute_performance-ego0": 0.007174836679447421, "sim_compute_performance-ego1": 0.005075638541503428, "sim_compute_performance-ego2": 0.00490181133471823, "sim_compute_performance-ego3": 0.005515518487083002}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 4.131995111470532, "get_ui_image": 0.08469485023483604, "step_physics": 0.8311178642243089, "survival_time": 25.500000000000227, "driven_lanedir": 4.082488962295669, "get_state_dump": 0.031126749258918535, "get_robot_state": 0.04863594936064778, "sim_render-ego0": 0.010688935240654096, "sim_render-ego1": 0.009216306727459753, "sim_render-ego2": 0.007777303632224843, "sim_render-ego3": 0.009375058974771816, "get_duckie_state": 3.1666279772256454e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.200506294096474, "agent_compute-ego0": 0.13020304877697372, "agent_compute-ego1": 0.11733805270111024, "agent_compute-ego2": 0.11416787690612434, "agent_compute-ego3": 0.11179864523228834, "complete-iteration": 1.6127399824370143, "set_robot_commands": 0.007825631218180498, "deviation-center-line": 2.793224769868812, "driven_lanedir_consec": 4.082488962295669, "sim_compute_sim_state": 0.05593560959728263, "sim_compute_performance-ego0": 0.007174836679447421, "sim_compute_performance-ego1": 0.005075638541503428, "sim_compute_performance-ego2": 0.00490181133471823, "sim_compute_performance-ego3": 0.005515518487083002}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 12.166247135608948, "get_ui_image": 0.08469485023483604, "step_physics": 0.8311178642243089, "survival_time": 25.500000000000227, "driven_lanedir": 11.573623696993607, "get_state_dump": 0.031126749258918535, "get_robot_state": 0.04863594936064778, "sim_render-ego0": 0.010688935240654096, "sim_render-ego1": 0.009216306727459753, "sim_render-ego2": 0.007777303632224843, "sim_render-ego3": 0.009375058974771816, "get_duckie_state": 3.1666279772256454e-06, "in-drivable-lane": 1.050000000000015, "deviation-heading": 3.939493375876067, "agent_compute-ego0": 0.13020304877697372, "agent_compute-ego1": 0.11733805270111024, "agent_compute-ego2": 0.11416787690612434, "agent_compute-ego3": 0.11179864523228834, "complete-iteration": 1.6127399824370143, "set_robot_commands": 0.007825631218180498, "deviation-center-line": 1.548662468903218, "driven_lanedir_consec": 11.573623696993607, "sim_compute_sim_state": 0.05593560959728263, "sim_compute_performance-ego0": 0.007174836679447421, "sim_compute_performance-ego1": 0.005075638541503428, "sim_compute_performance-ego2": 0.00490181133471823, "sim_compute_performance-ego3": 0.005515518487083002}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 3.542051695809606, "get_ui_image": 0.07662444085067843, "step_physics": 0.3555649245007438, "survival_time": 7.99999999999998, "driven_lanedir": 3.485589746288337, "get_state_dump": 0.07501767733082268, "get_robot_state": 0.04426761443570534, "sim_render-ego0": 0.01937699169846055, "sim_render-ego1": 0.014648483406682932, "get_duckie_state": 2.8077119625873447e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.1525089054371125, "agent_compute-ego0": 0.1905884283669987, "agent_compute-ego1": 0.199099684353941, "complete-iteration": 1.077682435882758, "set_robot_commands": 0.0135178047677745, "deviation-center-line": 0.5244579909543857, "driven_lanedir_consec": 3.485589746288337, "sim_compute_sim_state": 0.04736285476210695, "sim_compute_performance-ego0": 0.018840495103634666, "sim_compute_performance-ego1": 0.007579550239610376}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 3.222519519891979, "get_ui_image": 0.07662444085067843, "step_physics": 0.3555649245007438, "survival_time": 7.99999999999998, "driven_lanedir": 3.1399072970072126, "get_state_dump": 0.07501767733082268, "get_robot_state": 0.04426761443570534, "sim_render-ego0": 0.01937699169846055, "sim_render-ego1": 0.014648483406682932, "get_duckie_state": 2.8077119625873447e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.6314448400562316, "agent_compute-ego0": 0.1905884283669987, "agent_compute-ego1": 0.199099684353941, "complete-iteration": 1.077682435882758, "set_robot_commands": 0.0135178047677745, "deviation-center-line": 0.46580390692958307, "driven_lanedir_consec": 3.1399072970072126, "sim_compute_sim_state": 0.04736285476210695, "sim_compute_performance-ego0": 0.018840495103634666, "sim_compute_performance-ego1": 0.007579550239610376}}
set_robot_commands_max0.0135178047677745
set_robot_commands_mean0.008059604657820522
set_robot_commands_median0.007262798855980608
set_robot_commands_min0.006361283844323467
sim_compute_performance-ego0_max0.018840495103634666
sim_compute_performance-ego0_mean0.008655294913759925
sim_compute_performance-ego0_median0.007168443527300905
sim_compute_performance-ego0_min0.006530004439594076
sim_compute_performance-ego1_max0.007579550239610376
sim_compute_performance-ego1_mean0.005897586078404017
sim_compute_performance-ego1_median0.005452958718019606
sim_compute_performance-ego1_min0.005075638541503428
sim_compute_sim_state_max0.06477536442123841
sim_compute_sim_state_mean0.052158510388288025
sim_compute_sim_state_median0.05593560959728263
sim_compute_sim_state_min0.038162384959433575
sim_render-ego0_max0.01937699169846055
sim_render-ego0_mean0.011866183739405735
sim_render-ego0_median0.010688935240654096
sim_render-ego0_min0.010189216332519783
sim_render-ego1_max0.014648483406682932
sim_render-ego1_mean0.010051407195653292
sim_render-ego1_median0.009216306727459753
sim_render-ego1_min0.008975956079771193
simulation-passed1
step_physics_max0.9845537465928376
step_physics_mean0.7121327470067792
step_physics_median0.8311178642243089
step_physics_min0.3555649245007438
survival_time_max48.099999999999405
survival_time_mean26.12857142857134
survival_time_min7.99999999999998

Highlights

62075

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.