Duckietown Challenges Home Challenges Submissions

Submission 11422

Submission11422
Competingyes
Challengeaido5-LFVI_multi-sim-validation
UserFrank (Chude) Qian 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVIv-sim: 55813
Next
User labelchallenge-aido_LF-baseline-behavior-cloning
Admin priority50
Blessingn/a
User priority50

55813

Click the images to see detailed statistics about the episode.

LFVI_multi-norm-4way-000

LFVI_multi-norm-udem1-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
55813LFVIv-simsuccessyes1:20:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.982100312006373
survival_time_median59.99999999999873
deviation-center-line_median4.416433388905102
in-drivable-lane_median0.07499999999999973


other stats
agent_compute-ego0_max0.040627359252091155
agent_compute-ego0_mean0.0405213539050481
agent_compute-ego0_median0.0405213539050481
agent_compute-ego0_min0.04041534855800505
agent_compute-ego1_max0.04034977888286759
agent_compute-ego1_mean0.040028717396757584
agent_compute-ego1_median0.040028717396757584
agent_compute-ego1_min0.03970765591064758
agent_compute-ego2_max0.04027102491837755
agent_compute-ego2_mean0.03975178409277847
agent_compute-ego2_median0.03975178409277847
agent_compute-ego2_min0.03923254326717939
agent_compute-ego3_max0.04101410257528466
agent_compute-ego3_mean0.04000050658290333
agent_compute-ego3_median0.04000050658290333
agent_compute-ego3_min0.038986910590522
complete-iteration_max1.0863832905330228
complete-iteration_mean1.0555721019130266
complete-iteration_median1.0555721019130266
complete-iteration_min1.0247609132930302
deviation-center-line_max6.993703781443878
deviation-center-line_mean4.549008093224059
deviation-center-line_min2.7547936419560757
deviation-heading_max42.18086494270505
deviation-heading_mean23.382515698011055
deviation-heading_median20.824989043063063
deviation-heading_min10.227436318070511
driven_any_max14.590298622055846
driven_any_mean7.967358633328365
driven_any_median8.415174702140996
driven_any_min0.4793285042172145
driven_lanedir_consec_max14.286955591091672
driven_lanedir_consec_mean7.642102407896726
driven_lanedir_consec_min0.4628754568232531
driven_lanedir_max14.286955591091672
driven_lanedir_mean7.708069044375746
driven_lanedir_median7.982127316139571
driven_lanedir_min0.4628754568232531
get_duckie_state_max1.240332458140352e-06
get_duckie_state_mean1.2356673152520198e-06
get_duckie_state_median1.2356673152520198e-06
get_duckie_state_min1.2310021723636878e-06
get_robot_state_max0.013831173549782326
get_robot_state_mean0.013682959677277754
get_robot_state_median0.013682959677277754
get_robot_state_min0.013534745804773185
get_state_dump_max0.00904176078370767
get_state_dump_mean0.009028148194534591
get_state_dump_median0.009028148194534591
get_state_dump_min0.009014535605361518
get_ui_image_max0.04833416101041185
get_ui_image_mean0.04715031261348804
get_ui_image_median0.04715031261348804
get_ui_image_min0.045966464216564216
in-drivable-lane_max0.8999999999999968
in-drivable-lane_mean0.2687499999999944
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 14.590274250259988, "get_ui_image": 0.04833416101041185, "step_physics": 0.8012010201526423, "survival_time": 59.99999999999873, "driven_lanedir": 14.285870115338705, "get_state_dump": 0.009014535605361518, "get_robot_state": 0.013831173549782326, "sim_render-ego0": 0.003765170719105437, "sim_render-ego1": 0.003726561798044883, "sim_render-ego2": 0.0036411487887443657, "sim_render-ego3": 0.0036476823709886536, "get_duckie_state": 1.240332458140352e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.65141140471916, "agent_compute-ego0": 0.04041534855800505, "agent_compute-ego1": 0.03970765591064758, "agent_compute-ego2": 0.03923254326717939, "agent_compute-ego3": 0.038986910590522, "complete-iteration": 1.0863832905330228, "set_robot_commands": 0.0023630735379869395, "deviation-center-line": 2.869488261734872, "driven_lanedir_consec": 14.285870115338705, "sim_compute_sim_state": 0.0242200501256938, "sim_compute_performance-ego0": 0.001971058206296186, "sim_compute_performance-ego1": 0.0018927068337115716, "sim_compute_performance-ego2": 0.0018687043757760256, "sim_compute_performance-ego3": 0.0018376190398356796}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 2.2400890986044524, "get_ui_image": 0.04833416101041185, "step_physics": 0.8012010201526423, "survival_time": 59.99999999999873, "driven_lanedir": 1.900791696912732, "get_state_dump": 0.009014535605361518, "get_robot_state": 0.013831173549782326, "sim_render-ego0": 0.003765170719105437, "sim_render-ego1": 0.003726561798044883, "sim_render-ego2": 0.0036411487887443657, "sim_render-ego3": 0.0036476823709886536, "get_duckie_state": 1.240332458140352e-06, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 38.71500900662983, "agent_compute-ego0": 0.04041534855800505, "agent_compute-ego1": 0.03970765591064758, "agent_compute-ego2": 0.03923254326717939, "agent_compute-ego3": 0.038986910590522, "complete-iteration": 1.0863832905330228, "set_robot_commands": 0.0023630735379869395, "deviation-center-line": 6.000862773390881, "driven_lanedir_consec": 1.900791696912732, "sim_compute_sim_state": 0.0242200501256938, "sim_compute_performance-ego0": 0.001971058206296186, "sim_compute_performance-ego1": 0.0018927068337115716, "sim_compute_performance-ego2": 0.0018687043757760256, "sim_compute_performance-ego3": 0.0018376190398356796}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 14.59026030567754, "get_ui_image": 0.04833416101041185, "step_physics": 0.8012010201526423, "survival_time": 59.99999999999873, "driven_lanedir": 14.286955591091672, "get_state_dump": 0.009014535605361518, "get_robot_state": 0.013831173549782326, "sim_render-ego0": 0.003765170719105437, "sim_render-ego1": 0.003726561798044883, "sim_render-ego2": 0.0036411487887443657, "sim_render-ego3": 0.0036476823709886536, "get_duckie_state": 1.240332458140352e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.77473756366386, "agent_compute-ego0": 0.04041534855800505, "agent_compute-ego1": 0.03970765591064758, "agent_compute-ego2": 0.03923254326717939, "agent_compute-ego3": 0.038986910590522, "complete-iteration": 1.0863832905330228, "set_robot_commands": 0.0023630735379869395, "deviation-center-line": 2.7783831944119246, "driven_lanedir_consec": 14.286955591091672, "sim_compute_sim_state": 0.0242200501256938, "sim_compute_performance-ego0": 0.001971058206296186, "sim_compute_performance-ego1": 0.0018927068337115716, "sim_compute_performance-ego2": 0.0018687043757760256, "sim_compute_performance-ego3": 0.0018376190398356796}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 0.9929039380973048, "get_ui_image": 0.04833416101041185, "step_physics": 0.8012010201526423, "survival_time": 59.99999999999873, "driven_lanedir": 0.8491677542940025, "get_state_dump": 0.009014535605361518, "get_robot_state": 0.013831173549782326, "sim_render-ego0": 0.003765170719105437, "sim_render-ego1": 0.003726561798044883, "sim_render-ego2": 0.0036411487887443657, "sim_render-ego3": 0.0036476823709886536, "get_duckie_state": 1.240332458140352e-06, "in-drivable-lane": 0.14999999999999947, "deviation-heading": 42.18086494270505, "agent_compute-ego0": 0.04041534855800505, "agent_compute-ego1": 0.03970765591064758, "agent_compute-ego2": 0.03923254326717939, "agent_compute-ego3": 0.038986910590522, "complete-iteration": 1.0863832905330228, "set_robot_commands": 0.0023630735379869395, "deviation-center-line": 6.993703781443878, "driven_lanedir_consec": 0.6900128436534608, "sim_compute_sim_state": 0.0242200501256938, "sim_compute_performance-ego0": 0.001971058206296186, "sim_compute_performance-ego1": 0.0018927068337115716, "sim_compute_performance-ego2": 0.0018687043757760256, "sim_compute_performance-ego3": 0.0018376190398356796}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 14.590298622055846, "get_ui_image": 0.045966464216564216, "step_physics": 0.7400444663633018, "survival_time": 59.99999999999873, "driven_lanedir": 14.197477618061928, "get_state_dump": 0.00904176078370767, "get_robot_state": 0.013534745804773185, "sim_render-ego0": 0.003730573820928848, "sim_render-ego1": 0.0037336448745664014, "sim_render-ego2": 0.003631875874299392, "sim_render-ego3": 0.003642914197923341, "get_duckie_state": 1.2310021723636878e-06, "in-drivable-lane": 0.3499999999999801, "deviation-heading": 10.227436318070511, "agent_compute-ego0": 0.040627359252091155, "agent_compute-ego1": 0.04034977888286759, "agent_compute-ego2": 0.04027102491837755, "agent_compute-ego3": 0.04101410257528466, "complete-iteration": 1.0247609132930302, "set_robot_commands": 0.0022827665772068807, "deviation-center-line": 2.7547936419560757, "driven_lanedir_consec": 14.197453553420626, "sim_compute_sim_state": 0.022601126433411407, "sim_compute_performance-ego0": 0.001980852227127622, "sim_compute_performance-ego1": 0.0018457060154034237, "sim_compute_performance-ego2": 0.0018712981952219384, "sim_compute_performance-ego3": 0.0018575755285283708}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 14.590285873013205, "get_ui_image": 0.045966464216564216, "step_physics": 0.7400444663633018, "survival_time": 59.99999999999873, "driven_lanedir": 14.06346293536641, "get_state_dump": 0.00904176078370767, "get_robot_state": 0.013534745804773185, "sim_render-ego0": 0.003730573820928848, "sim_render-ego1": 0.0037336448745664014, "sim_render-ego2": 0.003631875874299392, "sim_render-ego3": 0.003642914197923341, "get_duckie_state": 1.2310021723636878e-06, "in-drivable-lane": 0.7499999999999787, "deviation-heading": 10.772165851951048, "agent_compute-ego0": 0.040627359252091155, "agent_compute-ego1": 0.04034977888286759, "agent_compute-ego2": 0.04027102491837755, "agent_compute-ego3": 0.04101410257528466, "complete-iteration": 1.0247609132930302, "set_robot_commands": 0.0022827665772068807, "deviation-center-line": 3.004721468129042, "driven_lanedir_consec": 14.063408927100014, "sim_compute_sim_state": 0.022601126433411407, "sim_compute_performance-ego0": 0.001980852227127622, "sim_compute_performance-ego1": 0.0018457060154034237, "sim_compute_performance-ego2": 0.0018712981952219384, "sim_compute_performance-ego3": 0.0018575755285283708}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.4793285042172145, "get_ui_image": 0.045966464216564216, "step_physics": 0.7400444663633018, "survival_time": 59.99999999999873, "driven_lanedir": 0.4628754568232531, "get_state_dump": 0.00904176078370767, "get_robot_state": 0.013534745804773185, "sim_render-ego0": 0.003730573820928848, "sim_render-ego1": 0.0037336448745664014, "sim_render-ego2": 0.003631875874299392, "sim_render-ego3": 0.003642914197923341, "get_duckie_state": 1.2310021723636878e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.863259973886734, "agent_compute-ego0": 0.040627359252091155, "agent_compute-ego1": 0.04034977888286759, "agent_compute-ego2": 0.04027102491837755, "agent_compute-ego3": 0.04101410257528466, "complete-iteration": 1.0247609132930302, "set_robot_commands": 0.0022827665772068807, "deviation-center-line": 6.161966315044638, "driven_lanedir_consec": 0.4628754568232531, "sim_compute_sim_state": 0.022601126433411407, "sim_compute_performance-ego0": 0.001980852227127622, "sim_compute_performance-ego1": 0.0018457060154034237, "sim_compute_performance-ego2": 0.0018712981952219384, "sim_compute_performance-ego3": 0.0018575755285283708}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.6654284747013746, "get_ui_image": 0.045966464216564216, "step_physics": 0.7400444663633018, "survival_time": 59.99999999999873, "driven_lanedir": 1.6179511871172645, "get_state_dump": 0.00904176078370767, "get_robot_state": 0.013534745804773185, "sim_render-ego0": 0.003730573820928848, "sim_render-ego1": 0.0037336448745664014, "sim_render-ego2": 0.003631875874299392, "sim_render-ego3": 0.003642914197923341, "get_duckie_state": 1.2310021723636878e-06, "in-drivable-lane": 0.0, "deviation-heading": 30.87524052246227, "agent_compute-ego0": 0.040627359252091155, "agent_compute-ego1": 0.04034977888286759, "agent_compute-ego2": 0.04027102491837755, "agent_compute-ego3": 0.04101410257528466, "complete-iteration": 1.0247609132930302, "set_robot_commands": 0.0022827665772068807, "deviation-center-line": 5.828145309681163, "driven_lanedir_consec": 1.2494510788333448, "sim_compute_sim_state": 0.022601126433411407, "sim_compute_performance-ego0": 0.001980852227127622, "sim_compute_performance-ego1": 0.0018457060154034237, "sim_compute_performance-ego2": 0.0018712981952219384, "sim_compute_performance-ego3": 0.0018575755285283708}}
set_robot_commands_max0.0023630735379869395
set_robot_commands_mean0.00232292005759691
set_robot_commands_median0.00232292005759691
set_robot_commands_min0.0022827665772068807
sim_compute_performance-ego0_max0.001980852227127622
sim_compute_performance-ego0_mean0.0019759552167119034
sim_compute_performance-ego0_median0.0019759552167119034
sim_compute_performance-ego0_min0.001971058206296186
sim_compute_performance-ego1_max0.0018927068337115716
sim_compute_performance-ego1_mean0.0018692064245574977
sim_compute_performance-ego1_median0.0018692064245574977
sim_compute_performance-ego1_min0.0018457060154034237
sim_compute_performance-ego2_max0.0018712981952219384
sim_compute_performance-ego2_mean0.001870001285498982
sim_compute_performance-ego2_median0.001870001285498982
sim_compute_performance-ego2_min0.0018687043757760256
sim_compute_performance-ego3_max0.0018575755285283708
sim_compute_performance-ego3_mean0.0018475972841820252
sim_compute_performance-ego3_median0.0018475972841820252
sim_compute_performance-ego3_min0.0018376190398356796
sim_compute_sim_state_max0.0242200501256938
sim_compute_sim_state_mean0.023410588279552603
sim_compute_sim_state_median0.023410588279552603
sim_compute_sim_state_min0.022601126433411407
sim_render-ego0_max0.003765170719105437
sim_render-ego0_mean0.0037478722700171425
sim_render-ego0_median0.0037478722700171425
sim_render-ego0_min0.003730573820928848
sim_render-ego1_max0.0037336448745664014
sim_render-ego1_mean0.0037301033363056424
sim_render-ego1_median0.0037301033363056424
sim_render-ego1_min0.003726561798044883
sim_render-ego2_max0.0036411487887443657
sim_render-ego2_mean0.0036365123315218783
sim_render-ego2_median0.0036365123315218783
sim_render-ego2_min0.003631875874299392
sim_render-ego3_max0.0036476823709886536
sim_render-ego3_mean0.0036452982844559978
sim_render-ego3_median0.0036452982844559978
sim_render-ego3_min0.003642914197923341
simulation-passed1
step_physics_max0.8012010201526423
step_physics_mean0.770622743257972
step_physics_median0.770622743257972
step_physics_min0.7400444663633018
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
55801LFVIv-simsuccessyes1:21:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55793LFVIv-simsuccessyes1:18:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55789LFVIv-simsuccessyes1:19:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55765LFVIv-simsuccessyes1:19:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible