Duckietown Challenges Home Challenges Submissions

Job 55765

Job ID55765
submission11422
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI_multi-sim-validation
stepLFVIv-sim
statussuccess
up to dateyes
evaluatornogpu-prod-05
date started
date completed
duration1:19:42
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.000352020371926
survival_time_median59.99999999999873
deviation-center-line_median2.831730219295852
in-drivable-lane_median0.27499999999998836


other stats
agent_compute-ego0_max0.0432789077568213
agent_compute-ego0_mean0.04067271456531839
agent_compute-ego0_median0.04067271456531839
agent_compute-ego0_min0.03806652137381548
agent_compute-ego1_max0.04425298542305393
agent_compute-ego1_mean0.040811303751752535
agent_compute-ego1_median0.040811303751752535
agent_compute-ego1_min0.037369622080451144
agent_compute-ego2_max0.04425280695652386
agent_compute-ego2_mean0.04137057041149155
agent_compute-ego2_median0.04137057041149155
agent_compute-ego2_min0.03848833386645925
agent_compute-ego3_max0.04389665029527345
agent_compute-ego3_mean0.04102830982128845
agent_compute-ego3_median0.04102830982128845
agent_compute-ego3_min0.03815996934730346
complete-iteration_max1.1471984386444092
complete-iteration_mean1.0679902574799638
complete-iteration_median1.0679902574799638
complete-iteration_min0.9887820763155184
deviation-center-line_max7.043416442510699
deviation-center-line_mean3.9526180934090713
deviation-center-line_min0.6587453170691515
deviation-heading_max42.18086494270505
deviation-heading_mean20.32178251971962
deviation-heading_median12.696810895244525
deviation-heading_min9.151860401483535
driven_any_max14.590336819016564
driven_any_mean7.930680690316018
driven_any_median8.415174702140996
driven_any_min0.5160104431582505
driven_lanedir_consec_max14.286955591091672
driven_lanedir_consec_mean7.623843702485469
driven_lanedir_consec_min0.49193864375553253
driven_lanedir_max14.286955591091672
driven_lanedir_mean7.64446654546707
driven_lanedir_median8.000352905768596
driven_lanedir_min0.49193864375553253
get_duckie_state_max1.5976625517147168e-06
get_duckie_state_mean1.4205856386767537e-06
get_duckie_state_median1.4205856386767537e-06
get_duckie_state_min1.2435087256387906e-06
get_robot_state_max0.014178455124091945
get_robot_state_mean0.013620668406490484
get_robot_state_median0.013620668406490484
get_robot_state_min0.01306288168888902
get_state_dump_max0.009202071570238404
get_state_dump_mean0.008800285444172298
get_state_dump_median0.008800285444172298
get_state_dump_min0.00839849931810619
get_ui_image_max0.04980301539367879
get_ui_image_mean0.04751958269362247
get_ui_image_median0.04751958269362247
get_ui_image_min0.04523614999356615
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.4187499999999939
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 14.590274250259988, "get_ui_image": 0.04523614999356615, "step_physics": 0.719000908655489, "survival_time": 59.99999999999873, "driven_lanedir": 14.285870115338705, "get_state_dump": 0.00839849931810619, "get_robot_state": 0.01306288168888902, "sim_render-ego0": 0.003420055954779912, "sim_render-ego1": 0.0034042867792337564, "sim_render-ego2": 0.003317348565983832, "sim_render-ego3": 0.003299540226703679, "get_duckie_state": 1.2435087256387906e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.65141140471916, "agent_compute-ego0": 0.03806652137381548, "agent_compute-ego1": 0.037369622080451144, "agent_compute-ego2": 0.03848833386645925, "agent_compute-ego3": 0.03815996934730346, "complete-iteration": 0.9887820763155184, "set_robot_commands": 0.0021399510690909835, "deviation-center-line": 2.869488261734872, "driven_lanedir_consec": 14.285870115338705, "sim_compute_sim_state": 0.02232697623456944, "sim_compute_performance-ego0": 0.0018505938940500835, "sim_compute_performance-ego1": 0.0016977266904019397, "sim_compute_performance-ego2": 0.0016987359493995686, "sim_compute_performance-ego3": 0.0016911172747711258}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 2.2400890986044524, "get_ui_image": 0.04523614999356615, "step_physics": 0.719000908655489, "survival_time": 59.99999999999873, "driven_lanedir": 1.900791696912732, "get_state_dump": 0.00839849931810619, "get_robot_state": 0.01306288168888902, "sim_render-ego0": 0.003420055954779912, "sim_render-ego1": 0.0034042867792337564, "sim_render-ego2": 0.003317348565983832, "sim_render-ego3": 0.003299540226703679, "get_duckie_state": 1.2435087256387906e-06, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 38.71500900662983, "agent_compute-ego0": 0.03806652137381548, "agent_compute-ego1": 0.037369622080451144, "agent_compute-ego2": 0.03848833386645925, "agent_compute-ego3": 0.03815996934730346, "complete-iteration": 0.9887820763155184, "set_robot_commands": 0.0021399510690909835, "deviation-center-line": 6.000862773390881, "driven_lanedir_consec": 1.900791696912732, "sim_compute_sim_state": 0.02232697623456944, "sim_compute_performance-ego0": 0.0018505938940500835, "sim_compute_performance-ego1": 0.0016977266904019397, "sim_compute_performance-ego2": 0.0016987359493995686, "sim_compute_performance-ego3": 0.0016911172747711258}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 14.59026030567754, "get_ui_image": 0.04523614999356615, "step_physics": 0.719000908655489, "survival_time": 59.99999999999873, "driven_lanedir": 14.286955591091672, "get_state_dump": 0.00839849931810619, "get_robot_state": 0.01306288168888902, "sim_render-ego0": 0.003420055954779912, "sim_render-ego1": 0.0034042867792337564, "sim_render-ego2": 0.003317348565983832, "sim_render-ego3": 0.003299540226703679, "get_duckie_state": 1.2435087256387906e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.77473756366386, "agent_compute-ego0": 0.03806652137381548, "agent_compute-ego1": 0.037369622080451144, "agent_compute-ego2": 0.03848833386645925, "agent_compute-ego3": 0.03815996934730346, "complete-iteration": 0.9887820763155184, "set_robot_commands": 0.0021399510690909835, "deviation-center-line": 2.7783831944119246, "driven_lanedir_consec": 14.286955591091672, "sim_compute_sim_state": 0.02232697623456944, "sim_compute_performance-ego0": 0.0018505938940500835, "sim_compute_performance-ego1": 0.0016977266904019397, "sim_compute_performance-ego2": 0.0016987359493995686, "sim_compute_performance-ego3": 0.0016911172747711258}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 0.9929039380973048, "get_ui_image": 0.04523614999356615, "step_physics": 0.719000908655489, "survival_time": 59.99999999999873, "driven_lanedir": 0.8491677542940025, "get_state_dump": 0.00839849931810619, "get_robot_state": 0.01306288168888902, "sim_render-ego0": 0.003420055954779912, "sim_render-ego1": 0.0034042867792337564, "sim_render-ego2": 0.003317348565983832, "sim_render-ego3": 0.003299540226703679, "get_duckie_state": 1.2435087256387906e-06, "in-drivable-lane": 0.14999999999999947, "deviation-heading": 42.18086494270505, "agent_compute-ego0": 0.03806652137381548, "agent_compute-ego1": 0.037369622080451144, "agent_compute-ego2": 0.03848833386645925, "agent_compute-ego3": 0.03815996934730346, "complete-iteration": 0.9887820763155184, "set_robot_commands": 0.0021399510690909835, "deviation-center-line": 6.993703781443878, "driven_lanedir_consec": 0.6900128436534608, "sim_compute_sim_state": 0.02232697623456944, "sim_compute_performance-ego0": 0.0018505938940500835, "sim_compute_performance-ego1": 0.0016977266904019397, "sim_compute_performance-ego2": 0.0016987359493995686, "sim_compute_performance-ego3": 0.0016911172747711258}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 14.590336819016564, "get_ui_image": 0.04980301539367879, "step_physics": 0.8426406363662733, "survival_time": 59.99999999999873, "driven_lanedir": 14.241182307635386, "get_state_dump": 0.009202071570238404, "get_robot_state": 0.014178455124091945, "sim_render-ego0": 0.003731599755330844, "sim_render-ego1": 0.0037072097927604887, "sim_render-ego2": 0.003687480208677218, "sim_render-ego3": 0.00365359757365434, "get_duckie_state": 1.5976625517147168e-06, "in-drivable-lane": 0.39999999999997726, "deviation-heading": 9.151860401483535, "agent_compute-ego0": 0.0432789077568213, "agent_compute-ego1": 0.04425298542305393, "agent_compute-ego2": 0.04425280695652386, "agent_compute-ego3": 0.04389665029527345, "complete-iteration": 1.1471984386444092, "set_robot_commands": 0.0024774596653413415, "deviation-center-line": 2.482372799854332, "driven_lanedir_consec": 14.241177099376143, "sim_compute_sim_state": 0.023289290594121596, "sim_compute_performance-ego0": 0.0020609209678452973, "sim_compute_performance-ego1": 0.00194403571351978, "sim_compute_performance-ego2": 0.0019267834195685724, "sim_compute_performance-ego3": 0.0019906668936977975}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 14.59031805171456, "get_ui_image": 0.04980301539367879, "step_physics": 0.8426406363662733, "survival_time": 59.99999999999873, "driven_lanedir": 14.099914114624458, "get_state_dump": 0.009202071570238404, "get_robot_state": 0.014178455124091945, "sim_render-ego0": 0.003731599755330844, "sim_render-ego1": 0.0037072097927604887, "sim_render-ego2": 0.003687480208677218, "sim_render-ego3": 0.00365359757365434, "get_duckie_state": 1.5976625517147168e-06, "in-drivable-lane": 0.7499999999999822, "deviation-heading": 10.006036868124696, "agent_compute-ego0": 0.0432789077568213, "agent_compute-ego1": 0.04425298542305393, "agent_compute-ego2": 0.04425280695652386, "agent_compute-ego3": 0.04389665029527345, "complete-iteration": 1.1471984386444092, "set_robot_commands": 0.0024774596653413415, "deviation-center-line": 2.793972176856832, "driven_lanedir_consec": 14.099912343831118, "sim_compute_sim_state": 0.023289290594121596, "sim_compute_performance-ego0": 0.0020609209678452973, "sim_compute_performance-ego1": 0.00194403571351978, "sim_compute_performance-ego2": 0.0019267834195685724, "sim_compute_performance-ego3": 0.0019906668936977975}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.5160104431582505, "get_ui_image": 0.04980301539367879, "step_physics": 0.8426406363662733, "survival_time": 59.99999999999873, "driven_lanedir": 0.49193864375553253, "get_state_dump": 0.009202071570238404, "get_robot_state": 0.014178455124091945, "sim_render-ego0": 0.003731599755330844, "sim_render-ego1": 0.0037072097927604887, "sim_render-ego2": 0.003687480208677218, "sim_render-ego3": 0.00365359757365434, "get_duckie_state": 1.5976625517147168e-06, "in-drivable-lane": 0.0, "deviation-heading": 26.47545574360564, "agent_compute-ego0": 0.0432789077568213, "agent_compute-ego1": 0.04425298542305393, "agent_compute-ego2": 0.04425280695652386, "agent_compute-ego3": 0.04389665029527345, "complete-iteration": 1.1471984386444092, "set_robot_commands": 0.0024774596653413415, "deviation-center-line": 7.043416442510699, "driven_lanedir_consec": 0.49193864375553253, "sim_compute_sim_state": 0.023289290594121596, "sim_compute_performance-ego0": 0.0020609209678452973, "sim_compute_performance-ego1": 0.00194403571351978, "sim_compute_performance-ego2": 0.0019267834195685724, "sim_compute_performance-ego3": 0.0019906668936977975}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.335252615999484, "get_ui_image": 0.04980301539367879, "step_physics": 0.8426406363662733, "survival_time": 59.99999999999873, "driven_lanedir": 0.9999121400840676, "get_state_dump": 0.009202071570238404, "get_robot_state": 0.014178455124091945, "sim_render-ego0": 0.003731599755330844, "sim_render-ego1": 0.0037072097927604887, "sim_render-ego2": 0.003687480208677218, "sim_render-ego3": 0.00365359757365434, "get_duckie_state": 1.5976625517147168e-06, "in-drivable-lane": 1.149999999999996, "deviation-heading": 14.618884226825193, "agent_compute-ego0": 0.0432789077568213, "agent_compute-ego1": 0.04425298542305393, "agent_compute-ego2": 0.04425280695652386, "agent_compute-ego3": 0.04389665029527345, "complete-iteration": 1.1471984386444092, "set_robot_commands": 0.0024774596653413415, "deviation-center-line": 0.6587453170691515, "driven_lanedir_consec": 0.9940912859243904, "sim_compute_sim_state": 0.023289290594121596, "sim_compute_performance-ego0": 0.0020609209678452973, "sim_compute_performance-ego1": 0.00194403571351978, "sim_compute_performance-ego2": 0.0019267834195685724, "sim_compute_performance-ego3": 0.0019906668936977975}}
set_robot_commands_max0.0024774596653413415
set_robot_commands_mean0.0023087053672161623
set_robot_commands_median0.0023087053672161623
set_robot_commands_min0.0021399510690909835
sim_compute_performance-ego0_max0.0020609209678452973
sim_compute_performance-ego0_mean0.0019557574309476905
sim_compute_performance-ego0_median0.0019557574309476905
sim_compute_performance-ego0_min0.0018505938940500835
sim_compute_performance-ego1_max0.00194403571351978
sim_compute_performance-ego1_mean0.00182088120196086
sim_compute_performance-ego1_median0.00182088120196086
sim_compute_performance-ego1_min0.0016977266904019397
sim_compute_performance-ego2_max0.0019267834195685724
sim_compute_performance-ego2_mean0.0018127596844840705
sim_compute_performance-ego2_median0.0018127596844840705
sim_compute_performance-ego2_min0.0016987359493995686
sim_compute_performance-ego3_max0.0019906668936977975
sim_compute_performance-ego3_mean0.0018408920842344616
sim_compute_performance-ego3_median0.0018408920842344616
sim_compute_performance-ego3_min0.0016911172747711258
sim_compute_sim_state_max0.023289290594121596
sim_compute_sim_state_mean0.022808133414345517
sim_compute_sim_state_median0.022808133414345517
sim_compute_sim_state_min0.02232697623456944
sim_render-ego0_max0.003731599755330844
sim_render-ego0_mean0.0035758278550553782
sim_render-ego0_median0.0035758278550553782
sim_render-ego0_min0.003420055954779912
sim_render-ego1_max0.0037072097927604887
sim_render-ego1_mean0.0035557482859971228
sim_render-ego1_median0.0035557482859971228
sim_render-ego1_min0.0034042867792337564
sim_render-ego2_max0.003687480208677218
sim_render-ego2_mean0.003502414387330525
sim_render-ego2_median0.003502414387330525
sim_render-ego2_min0.003317348565983832
sim_render-ego3_max0.00365359757365434
sim_render-ego3_mean0.0034765689001790097
sim_render-ego3_median0.0034765689001790097
sim_render-ego3_min0.003299540226703679
simulation-passed1
step_physics_max0.8426406363662733
step_physics_mean0.7808207725108811
step_physics_median0.7808207725108811
step_physics_min0.719000908655489
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873

Highlights

55765

Click the images to see detailed statistics about the episode.

LFVI_multi-norm-4way-000

LFVI_multi-norm-udem1-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.