Duckietown Challenges Home Challenges Submissions

Job 55801

Job ID55801
submission11422
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI_multi-sim-validation
stepLFVIv-sim
statussuccess
up to dateyes
evaluatornogpu-prod-02
date started
date completed
duration1:21:06
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.00627423012839
survival_time_median59.99999999999873
deviation-center-line_median2.851622727852673
in-drivable-lane_median0.29999999999998694


other stats
agent_compute-ego0_max0.04501443858150638
agent_compute-ego0_mean0.04420001292407364
agent_compute-ego0_median0.04420001292407364
agent_compute-ego0_min0.0433855872666409
agent_compute-ego1_max0.04314861984475269
agent_compute-ego1_mean0.04291249314116796
agent_compute-ego1_median0.04291249314116796
agent_compute-ego1_min0.04267636643758324
agent_compute-ego2_max0.04440310714048311
agent_compute-ego2_mean0.0436639401636751
agent_compute-ego2_median0.0436639401636751
agent_compute-ego2_min0.04292477318686709
agent_compute-ego3_max0.0433818154489865
agent_compute-ego3_mean0.042804939363719416
agent_compute-ego3_median0.042804939363719416
agent_compute-ego3_min0.04222806327845234
complete-iteration_max1.1209499421068077
complete-iteration_mean1.120512246986313
complete-iteration_median1.120512246986313
complete-iteration_min1.1200745518658184
deviation-center-line_max6.993703781443878
deviation-center-line_mean3.9920540805709623
deviation-center-line_min1.81559138318626
deviation-heading_max42.18086494270505
deviation-heading_mean21.576090648227545
deviation-heading_median13.045436950124678
deviation-heading_min9.36000672480762
driven_any_max14.590320803977198
driven_any_mean7.924562479268612
driven_any_median8.415174702140996
driven_any_min0.4793280258511935
driven_lanedir_consec_max14.286955591091672
driven_lanedir_consec_mean7.611218517557059
driven_lanedir_consec_min0.4607971690050614
driven_lanedir_max14.286955591091672
driven_lanedir_mean7.63295552871756
driven_lanedir_median8.006275032326903
driven_lanedir_min0.4607971690050614
get_duckie_state_max1.4483779792880933e-06
get_duckie_state_mean1.4256478150023906e-06
get_duckie_state_median1.4256478150023906e-06
get_duckie_state_min1.402917650716688e-06
get_robot_state_max0.01421338533183915
get_robot_state_mean0.014212008419878576
get_robot_state_median0.014212008419878576
get_robot_state_min0.014210631507918002
get_state_dump_max0.009369456698555037
get_state_dump_mean0.009361090112189071
get_state_dump_median0.009361090112189071
get_state_dump_min0.009352723525823106
get_ui_image_max0.04901897500297807
get_ui_image_mean0.04864840225613584
get_ui_image_median0.04864840225613584
get_ui_image_min0.04827782950929361
in-drivable-lane_max1.2999999999999954
in-drivable-lane_mean0.43124999999999425
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 14.590274250259988, "get_ui_image": 0.04901897500297807, "step_physics": 0.8186401894050871, "survival_time": 59.99999999999873, "driven_lanedir": 14.285870115338705, "get_state_dump": 0.009352723525823106, "get_robot_state": 0.01421338533183915, "sim_render-ego0": 0.003749904584924347, "sim_render-ego1": 0.003729821244048437, "sim_render-ego2": 0.003699620101572969, "sim_render-ego3": 0.0036867486745689832, "get_duckie_state": 1.402917650716688e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.65141140471916, "agent_compute-ego0": 0.0433855872666409, "agent_compute-ego1": 0.04267636643758324, "agent_compute-ego2": 0.04292477318686709, "agent_compute-ego3": 0.04222806327845234, "complete-iteration": 1.1200745518658184, "set_robot_commands": 0.0024865564954568704, "deviation-center-line": 2.869488261734872, "driven_lanedir_consec": 14.285870115338705, "sim_compute_sim_state": 0.02520927402200945, "sim_compute_performance-ego0": 0.002074803043463943, "sim_compute_performance-ego1": 0.0019589725084646257, "sim_compute_performance-ego2": 0.0019872115116929333, "sim_compute_performance-ego3": 0.001933575867613984}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 2.2400890986044524, "get_ui_image": 0.04901897500297807, "step_physics": 0.8186401894050871, "survival_time": 59.99999999999873, "driven_lanedir": 1.900791696912732, "get_state_dump": 0.009352723525823106, "get_robot_state": 0.01421338533183915, "sim_render-ego0": 0.003749904584924347, "sim_render-ego1": 0.003729821244048437, "sim_render-ego2": 0.003699620101572969, "sim_render-ego3": 0.0036867486745689832, "get_duckie_state": 1.402917650716688e-06, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 38.71500900662983, "agent_compute-ego0": 0.0433855872666409, "agent_compute-ego1": 0.04267636643758324, "agent_compute-ego2": 0.04292477318686709, "agent_compute-ego3": 0.04222806327845234, "complete-iteration": 1.1200745518658184, "set_robot_commands": 0.0024865564954568704, "deviation-center-line": 6.000862773390881, "driven_lanedir_consec": 1.900791696912732, "sim_compute_sim_state": 0.02520927402200945, "sim_compute_performance-ego0": 0.002074803043463943, "sim_compute_performance-ego1": 0.0019589725084646257, "sim_compute_performance-ego2": 0.0019872115116929333, "sim_compute_performance-ego3": 0.001933575867613984}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 14.59026030567754, "get_ui_image": 0.04901897500297807, "step_physics": 0.8186401894050871, "survival_time": 59.99999999999873, "driven_lanedir": 14.286955591091672, "get_state_dump": 0.009352723525823106, "get_robot_state": 0.01421338533183915, "sim_render-ego0": 0.003749904584924347, "sim_render-ego1": 0.003729821244048437, "sim_render-ego2": 0.003699620101572969, "sim_render-ego3": 0.0036867486745689832, "get_duckie_state": 1.402917650716688e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.77473756366386, "agent_compute-ego0": 0.0433855872666409, "agent_compute-ego1": 0.04267636643758324, "agent_compute-ego2": 0.04292477318686709, "agent_compute-ego3": 0.04222806327845234, "complete-iteration": 1.1200745518658184, "set_robot_commands": 0.0024865564954568704, "deviation-center-line": 2.7783831944119246, "driven_lanedir_consec": 14.286955591091672, "sim_compute_sim_state": 0.02520927402200945, "sim_compute_performance-ego0": 0.002074803043463943, "sim_compute_performance-ego1": 0.0019589725084646257, "sim_compute_performance-ego2": 0.0019872115116929333, "sim_compute_performance-ego3": 0.001933575867613984}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 0.9929039380973048, "get_ui_image": 0.04901897500297807, "step_physics": 0.8186401894050871, "survival_time": 59.99999999999873, "driven_lanedir": 0.8491677542940025, "get_state_dump": 0.009352723525823106, "get_robot_state": 0.01421338533183915, "sim_render-ego0": 0.003749904584924347, "sim_render-ego1": 0.003729821244048437, "sim_render-ego2": 0.003699620101572969, "sim_render-ego3": 0.0036867486745689832, "get_duckie_state": 1.402917650716688e-06, "in-drivable-lane": 0.14999999999999947, "deviation-heading": 42.18086494270505, "agent_compute-ego0": 0.0433855872666409, "agent_compute-ego1": 0.04267636643758324, "agent_compute-ego2": 0.04292477318686709, "agent_compute-ego3": 0.04222806327845234, "complete-iteration": 1.1200745518658184, "set_robot_commands": 0.0024865564954568704, "deviation-center-line": 6.993703781443878, "driven_lanedir_consec": 0.6900128436534608, "sim_compute_sim_state": 0.02520927402200945, "sim_compute_performance-ego0": 0.002074803043463943, "sim_compute_performance-ego1": 0.0019589725084646257, "sim_compute_performance-ego2": 0.0019872115116929333, "sim_compute_performance-ego3": 0.001933575867613984}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 14.590320803977198, "get_ui_image": 0.04827782950929361, "step_physics": 0.8167762226308017, "survival_time": 59.99999999999873, "driven_lanedir": 14.21564614875529, "get_state_dump": 0.009369456698555037, "get_robot_state": 0.014210631507918002, "sim_render-ego0": 0.003774412466425582, "sim_render-ego1": 0.003806877295043844, "sim_render-ego2": 0.003760845039806001, "sim_render-ego3": 0.003721927028214505, "get_duckie_state": 1.4483779792880933e-06, "in-drivable-lane": 0.4499999999999744, "deviation-heading": 9.36000672480762, "agent_compute-ego0": 0.04501443858150638, "agent_compute-ego1": 0.04314861984475269, "agent_compute-ego2": 0.04440310714048311, "agent_compute-ego3": 0.0433818154489865, "complete-iteration": 1.1209499421068077, "set_robot_commands": 0.002496278256202717, "deviation-center-line": 2.518317448732518, "driven_lanedir_consec": 14.21564352094802, "sim_compute_sim_state": 0.023431085527786905, "sim_compute_performance-ego0": 0.0020710443279129778, "sim_compute_performance-ego1": 0.001986162549351574, "sim_compute_performance-ego2": 0.0019680889917353013, "sim_compute_performance-ego3": 0.002001847752325739}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 14.590300851084324, "get_ui_image": 0.04827782950929361, "step_physics": 0.8167762226308017, "survival_time": 59.99999999999873, "driven_lanedir": 14.111758367741071, "get_state_dump": 0.009369456698555037, "get_robot_state": 0.014210631507918002, "sim_render-ego0": 0.003774412466425582, "sim_render-ego1": 0.003806877295043844, "sim_render-ego2": 0.003760845039806001, "sim_render-ego3": 0.003721927028214505, "get_duckie_state": 1.4483779792880933e-06, "in-drivable-lane": 0.6499999999999879, "deviation-heading": 10.218220944182727, "agent_compute-ego0": 0.04501443858150638, "agent_compute-ego1": 0.04314861984475269, "agent_compute-ego2": 0.04440310714048311, "agent_compute-ego3": 0.0433818154489865, "complete-iteration": 1.1209499421068077, "set_robot_commands": 0.002496278256202717, "deviation-center-line": 2.8337571939704747, "driven_lanedir_consec": 14.111756763344047, "sim_compute_sim_state": 0.023431085527786905, "sim_compute_performance-ego0": 0.0020710443279129778, "sim_compute_performance-ego1": 0.001986162549351574, "sim_compute_performance-ego2": 0.0019680889917353013, "sim_compute_performance-ego3": 0.002001847752325739}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.4793280258511935, "get_ui_image": 0.04827782950929361, "step_physics": 0.8167762226308017, "survival_time": 59.99999999999873, "driven_lanedir": 0.4607971690050614, "get_state_dump": 0.009369456698555037, "get_robot_state": 0.014210631507918002, "sim_render-ego0": 0.003774412466425582, "sim_render-ego1": 0.003806877295043844, "sim_render-ego2": 0.003760845039806001, "sim_render-ego3": 0.003721927028214505, "get_duckie_state": 1.4483779792880933e-06, "in-drivable-lane": 0.0, "deviation-heading": 35.39233826252663, "agent_compute-ego0": 0.04501443858150638, "agent_compute-ego1": 0.04314861984475269, "agent_compute-ego2": 0.04440310714048311, "agent_compute-ego3": 0.0433818154489865, "complete-iteration": 1.1209499421068077, "set_robot_commands": 0.002496278256202717, "deviation-center-line": 6.126328607696888, "driven_lanedir_consec": 0.4607971690050614, "sim_compute_sim_state": 0.023431085527786905, "sim_compute_performance-ego0": 0.0020710443279129778, "sim_compute_performance-ego1": 0.001986162549351574, "sim_compute_performance-ego2": 0.0019680889917353013, "sim_compute_performance-ego3": 0.002001847752325739}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.323022560596903, "get_ui_image": 0.04827782950929361, "step_physics": 0.8167762226308017, "survival_time": 59.99999999999873, "driven_lanedir": 0.9526573866019388, "get_state_dump": 0.009369456698555037, "get_robot_state": 0.014210631507918002, "sim_render-ego0": 0.003774412466425582, "sim_render-ego1": 0.003806877295043844, "sim_render-ego2": 0.003760845039806001, "sim_render-ego3": 0.003721927028214505, "get_duckie_state": 1.4483779792880933e-06, "in-drivable-lane": 1.2999999999999954, "deviation-heading": 15.316136336585496, "agent_compute-ego0": 0.04501443858150638, "agent_compute-ego1": 0.04314861984475269, "agent_compute-ego2": 0.04440310714048311, "agent_compute-ego3": 0.0433818154489865, "complete-iteration": 1.1209499421068077, "set_robot_commands": 0.002496278256202717, "deviation-center-line": 1.81559138318626, "driven_lanedir_consec": 0.93792044016277, "sim_compute_sim_state": 0.023431085527786905, "sim_compute_performance-ego0": 0.0020710443279129778, "sim_compute_performance-ego1": 0.001986162549351574, "sim_compute_performance-ego2": 0.0019680889917353013, "sim_compute_performance-ego3": 0.002001847752325739}}
set_robot_commands_max0.002496278256202717
set_robot_commands_mean0.0024914173758297936
set_robot_commands_median0.0024914173758297936
set_robot_commands_min0.0024865564954568704
sim_compute_performance-ego0_max0.002074803043463943
sim_compute_performance-ego0_mean0.0020729236856884604
sim_compute_performance-ego0_median0.0020729236856884604
sim_compute_performance-ego0_min0.0020710443279129778
sim_compute_performance-ego1_max0.001986162549351574
sim_compute_performance-ego1_mean0.0019725675289081
sim_compute_performance-ego1_median0.0019725675289081
sim_compute_performance-ego1_min0.0019589725084646257
sim_compute_performance-ego2_max0.0019872115116929333
sim_compute_performance-ego2_mean0.0019776502517141175
sim_compute_performance-ego2_median0.0019776502517141175
sim_compute_performance-ego2_min0.0019680889917353013
sim_compute_performance-ego3_max0.002001847752325739
sim_compute_performance-ego3_mean0.0019677118099698616
sim_compute_performance-ego3_median0.0019677118099698616
sim_compute_performance-ego3_min0.001933575867613984
sim_compute_sim_state_max0.02520927402200945
sim_compute_sim_state_mean0.024320179774898178
sim_compute_sim_state_median0.024320179774898178
sim_compute_sim_state_min0.023431085527786905
sim_render-ego0_max0.003774412466425582
sim_render-ego0_mean0.003762158525674964
sim_render-ego0_median0.003762158525674964
sim_render-ego0_min0.003749904584924347
sim_render-ego1_max0.003806877295043844
sim_render-ego1_mean0.003768349269546141
sim_render-ego1_median0.003768349269546141
sim_render-ego1_min0.003729821244048437
sim_render-ego2_max0.003760845039806001
sim_render-ego2_mean0.003730232570689485
sim_render-ego2_median0.003730232570689485
sim_render-ego2_min0.003699620101572969
sim_render-ego3_max0.003721927028214505
sim_render-ego3_mean0.003704337851391744
sim_render-ego3_median0.003704337851391744
sim_render-ego3_min0.0036867486745689832
simulation-passed1
step_physics_max0.8186401894050871
step_physics_mean0.8177082060179444
step_physics_median0.8177082060179444
step_physics_min0.8167762226308017
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873

Highlights

55801

Click the images to see detailed statistics about the episode.

LFVI_multi-norm-4way-000

LFVI_multi-norm-udem1-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.