Duckietown Challenges Home Challenges Submissions

Job 56779

Job ID56779
submission11427
userFrank (Chude) Qian 🇨🇦
user labeltemplate-pytorch
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to dateyes
evaluatorgpu-prod-01
date started
date completed
duration2:15:59
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9754652402117122
survival_time_median59.99999999999873
deviation-center-line_median1.316916438808612
in-drivable-lane_median37.47499999999928


other stats
agent_compute-ego0_max0.01256607672654024
agent_compute-ego0_mean0.01212185682943577
agent_compute-ego0_median0.012106106938370855
agent_compute-ego0_min0.011719249865097568
agent_compute-ego1_max0.012186386106810304
agent_compute-ego1_mean0.011637446400213714
agent_compute-ego1_median0.011429081352227534
agent_compute-ego1_min0.01130568733024756
agent_compute-ego2_max0.01254566067164387
agent_compute-ego2_mean0.012097108903408977
agent_compute-ego2_median0.012364589006676464
agent_compute-ego2_min0.0113810770319066
agent_compute-ego3_max0.011745798696983268
agent_compute-ego3_mean0.011475628096627886
agent_compute-ego3_median0.011502060862405414
agent_compute-ego3_min0.011179024730494973
complete-iteration_max1.3297614654236094
complete-iteration_mean1.1143648297434772
complete-iteration_median1.2731762803861442
complete-iteration_min0.40109446761411593
deviation-center-line_max2.183496159508223
deviation-center-line_mean1.305538988637906
deviation-center-line_min0.05360247763801091
deviation-heading_max23.689898144492304
deviation-heading_mean14.88926168149314
deviation-heading_median16.78782017471315
deviation-heading_min0.7560411537985214
driven_any_max9.058913516376691
driven_any_mean5.388662156388226
driven_any_median4.800851657391478
driven_any_min0.16389578063048768
driven_lanedir_consec_max2.366404918456605
driven_lanedir_consec_mean1.0282713941495154
driven_lanedir_consec_min0.08761852645256063
driven_lanedir_max2.366404918456605
driven_lanedir_mean1.0946092214108198
driven_lanedir_median1.0299884650351068
driven_lanedir_min0.08761852645256063
get_duckie_state_max1.252044944540845e-06
get_duckie_state_mean1.206839851750564e-06
get_duckie_state_median1.246486476418577e-06
get_duckie_state_min1.121817977104854e-06
get_robot_state_max0.014036829128154212
get_robot_state_mean0.012931463564422051
get_robot_state_median0.013903685156054342
get_robot_state_min0.006871542267557187
get_state_dump_max0.00941679856858583
get_state_dump_mean0.008799159343905977
get_state_dump_median0.009224360431858545
get_state_dump_min0.005908783826105402
get_ui_image_max0.049055594389484286
get_ui_image_mean0.0433542349540735
get_ui_image_median0.04632227188542324
get_ui_image_min0.02945109688173623
in-drivable-lane_max58.69999999999872
in-drivable-lane_mean40.5392857142848
in-drivable-lane_min29.349999999999376
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 9.058913516376691, "get_ui_image": 0.04163640762348159, "step_physics": 0.9237962706102916, "survival_time": 59.99999999999873, "driven_lanedir": 2.366404918456605, "get_state_dump": 0.009201506790173838, "get_robot_state": 0.013883837057490037, "sim_render-ego0": 0.003635640545351916, "sim_render-ego1": 0.0035739081983860088, "sim_render-ego2": 0.0035837782511206886, "sim_render-ego3": 0.0035887838501815097, "get_duckie_state": 1.252044944540845e-06, "in-drivable-lane": 34.149999999999245, "deviation-heading": 19.605405245794856, "agent_compute-ego0": 0.011719249865097568, "agent_compute-ego1": 0.01130568733024756, "agent_compute-ego2": 0.0113810770319066, "agent_compute-ego3": 0.011179024730494973, "complete-iteration": 1.0967919244853583, "set_robot_commands": 0.0021661993466646446, "deviation-center-line": 2.126588615763215, "driven_lanedir_consec": 2.366404918456605, "sim_compute_sim_state": 0.032090457055491274, "sim_compute_performance-ego0": 0.0018965671898224868, "sim_compute_performance-ego1": 0.0018549273155015471, "sim_compute_performance-ego2": 0.0018502669370144631, "sim_compute_performance-ego3": 0.0018595861058548825}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.076096726492469, "get_ui_image": 0.04163640762348159, "step_physics": 0.9237962706102916, "survival_time": 59.99999999999873, "driven_lanedir": 1.026192024928517, "get_state_dump": 0.009201506790173838, "get_robot_state": 0.013883837057490037, "sim_render-ego0": 0.003635640545351916, "sim_render-ego1": 0.0035739081983860088, "sim_render-ego2": 0.0035837782511206886, "sim_render-ego3": 0.0035887838501815097, "get_duckie_state": 1.252044944540845e-06, "in-drivable-lane": 30.099999999999355, "deviation-heading": 23.42797331821297, "agent_compute-ego0": 0.011719249865097568, "agent_compute-ego1": 0.01130568733024756, "agent_compute-ego2": 0.0113810770319066, "agent_compute-ego3": 0.011179024730494973, "complete-iteration": 1.0967919244853583, "set_robot_commands": 0.0021661993466646446, "deviation-center-line": 1.4626064639613396, "driven_lanedir_consec": 1.026192024928517, "sim_compute_sim_state": 0.032090457055491274, "sim_compute_performance-ego0": 0.0018965671898224868, "sim_compute_performance-ego1": 0.0018549273155015471, "sim_compute_performance-ego2": 0.0018502669370144631, "sim_compute_performance-ego3": 0.0018595861058548825}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 8.131349210683588, "get_ui_image": 0.04163640762348159, "step_physics": 0.9237962706102916, "survival_time": 59.99999999999873, "driven_lanedir": 2.269258765634657, "get_state_dump": 0.009201506790173838, "get_robot_state": 0.013883837057490037, "sim_render-ego0": 0.003635640545351916, "sim_render-ego1": 0.0035739081983860088, "sim_render-ego2": 0.0035837782511206886, "sim_render-ego3": 0.0035887838501815097, "get_duckie_state": 1.252044944540845e-06, "in-drivable-lane": 34.14999999999915, "deviation-heading": 20.105500675733623, "agent_compute-ego0": 0.011719249865097568, "agent_compute-ego1": 0.01130568733024756, "agent_compute-ego2": 0.0113810770319066, "agent_compute-ego3": 0.011179024730494973, "complete-iteration": 1.0967919244853583, "set_robot_commands": 0.0021661993466646446, "deviation-center-line": 2.183496159508223, "driven_lanedir_consec": 1.4548775036208748, "sim_compute_sim_state": 0.032090457055491274, "sim_compute_performance-ego0": 0.0018965671898224868, "sim_compute_performance-ego1": 0.0018549273155015471, "sim_compute_performance-ego2": 0.0018502669370144631, "sim_compute_performance-ego3": 0.0018595861058548825}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 4.73421752253256, "get_ui_image": 0.04163640762348159, "step_physics": 0.9237962706102916, "survival_time": 59.99999999999873, "driven_lanedir": 1.4845629318948892, "get_state_dump": 0.009201506790173838, "get_robot_state": 0.013883837057490037, "sim_render-ego0": 0.003635640545351916, "sim_render-ego1": 0.0035739081983860088, "sim_render-ego2": 0.0035837782511206886, "sim_render-ego3": 0.0035887838501815097, "get_duckie_state": 1.252044944540845e-06, "in-drivable-lane": 29.349999999999376, "deviation-heading": 23.689898144492304, "agent_compute-ego0": 0.011719249865097568, "agent_compute-ego1": 0.01130568733024756, "agent_compute-ego2": 0.0113810770319066, "agent_compute-ego3": 0.011179024730494973, "complete-iteration": 1.0967919244853583, "set_robot_commands": 0.0021661993466646446, "deviation-center-line": 1.171226413655884, "driven_lanedir_consec": 1.4845629318948892, "sim_compute_sim_state": 0.032090457055491274, "sim_compute_performance-ego0": 0.0018965671898224868, "sim_compute_performance-ego1": 0.0018549273155015471, "sim_compute_performance-ego2": 0.0018502669370144631, "sim_compute_performance-ego3": 0.0018595861058548825}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 8.338248145928155, "get_ui_image": 0.049055594389484286, "step_physics": 1.1304889412148609, "survival_time": 59.99999999999873, "driven_lanedir": 1.4126972040667884, "get_state_dump": 0.009224360431858545, "get_robot_state": 0.013903685156054342, "sim_render-ego0": 0.003689694265640348, "sim_render-ego1": 0.003569235511862368, "sim_render-ego2": 0.003580439795463111, "sim_render-ego3": 0.0035539735465323695, "get_duckie_state": 1.246486476418577e-06, "in-drivable-lane": 44.149999999998656, "deviation-heading": 12.09723861055887, "agent_compute-ego0": 0.01256607672654024, "agent_compute-ego1": 0.012186386106810304, "agent_compute-ego2": 0.012364589006676464, "agent_compute-ego3": 0.011745798696983268, "complete-iteration": 1.3297614654236094, "set_robot_commands": 0.0021354772963194327, "deviation-center-line": 1.009847811562925, "driven_lanedir_consec": 1.4126972040667884, "sim_compute_sim_state": 0.04769116039577869, "sim_compute_performance-ego0": 0.001904460810106263, "sim_compute_performance-ego1": 0.001845271660823012, "sim_compute_performance-ego2": 0.0018535557634923776, "sim_compute_performance-ego3": 0.0018444363024709227}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 2.1887522122887435, "get_ui_image": 0.049055594389484286, "step_physics": 1.1304889412148609, "survival_time": 59.99999999999873, "driven_lanedir": 0.6821449671605673, "get_state_dump": 0.009224360431858545, "get_robot_state": 0.013903685156054342, "sim_render-ego0": 0.003689694265640348, "sim_render-ego1": 0.003569235511862368, "sim_render-ego2": 0.003580439795463111, "sim_render-ego3": 0.0035539735465323695, "get_duckie_state": 1.246486476418577e-06, "in-drivable-lane": 37.09999999999894, "deviation-heading": 17.494955319021845, "agent_compute-ego0": 0.01256607672654024, "agent_compute-ego1": 0.012186386106810304, "agent_compute-ego2": 0.012364589006676464, "agent_compute-ego3": 0.011745798696983268, "complete-iteration": 1.3297614654236094, "set_robot_commands": 0.0021354772963194327, "deviation-center-line": 1.1134949234261202, "driven_lanedir_consec": 0.6821449671605673, "sim_compute_sim_state": 0.04769116039577869, "sim_compute_performance-ego0": 0.001904460810106263, "sim_compute_performance-ego1": 0.001845271660823012, "sim_compute_performance-ego2": 0.0018535557634923776, "sim_compute_performance-ego3": 0.0018444363024709227}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 7.53631813482309, "get_ui_image": 0.049055594389484286, "step_physics": 1.1304889412148609, "survival_time": 59.99999999999873, "driven_lanedir": 0.7728980627631876, "get_state_dump": 0.009224360431858545, "get_robot_state": 0.013903685156054342, "sim_render-ego0": 0.003689694265640348, "sim_render-ego1": 0.003569235511862368, "sim_render-ego2": 0.003580439795463111, "sim_render-ego3": 0.0035539735465323695, "get_duckie_state": 1.246486476418577e-06, "in-drivable-lane": 50.54999999999912, "deviation-heading": 6.909867847635114, "agent_compute-ego0": 0.01256607672654024, "agent_compute-ego1": 0.012186386106810304, "agent_compute-ego2": 0.012364589006676464, "agent_compute-ego3": 0.011745798696983268, "complete-iteration": 1.3297614654236094, "set_robot_commands": 0.0021354772963194327, "deviation-center-line": 0.6987506221277281, "driven_lanedir_consec": 0.7728980627631876, "sim_compute_sim_state": 0.04769116039577869, "sim_compute_performance-ego0": 0.001904460810106263, "sim_compute_performance-ego1": 0.001845271660823012, "sim_compute_performance-ego2": 0.0018535557634923776, "sim_compute_performance-ego3": 0.0018444363024709227}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 4.867485792250397, "get_ui_image": 0.049055594389484286, "step_physics": 1.1304889412148609, "survival_time": 59.99999999999873, "driven_lanedir": 1.227594739939163, "get_state_dump": 0.009224360431858545, "get_robot_state": 0.013903685156054342, "sim_render-ego0": 0.003689694265640348, "sim_render-ego1": 0.003569235511862368, "sim_render-ego2": 0.003580439795463111, "sim_render-ego3": 0.0035539735465323695, "get_duckie_state": 1.246486476418577e-06, "in-drivable-lane": 37.84999999999961, "deviation-heading": 15.957473117412226, "agent_compute-ego0": 0.01256607672654024, "agent_compute-ego1": 0.012186386106810304, "agent_compute-ego2": 0.012364589006676464, "agent_compute-ego3": 0.011745798696983268, "complete-iteration": 1.3297614654236094, "set_robot_commands": 0.0021354772963194327, "deviation-center-line": 1.911706599509336, "driven_lanedir_consec": 1.227594739939163, "sim_compute_sim_state": 0.04769116039577869, "sim_compute_performance-ego0": 0.001904460810106263, "sim_compute_performance-ego1": 0.001845271660823012, "sim_compute_performance-ego2": 0.0018535557634923776, "sim_compute_performance-ego3": 0.0018444363024709227}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 8.032946667251625, "get_ui_image": 0.04632227188542324, "step_physics": 1.0914710419660405, "survival_time": 59.99999999999873, "driven_lanedir": 0.293378997726907, "get_state_dump": 0.00941679856858583, "get_robot_state": 0.014036829128154212, "sim_render-ego0": 0.003717655742495979, "sim_render-ego1": 0.0036056817917899226, "sim_render-ego2": 0.003803314515494189, "sim_render-ego3": 0.003642865958360709, "get_duckie_state": 1.1644990716151254e-06, "in-drivable-lane": 56.649999999998734, "deviation-heading": 2.2120554028022745, "agent_compute-ego0": 0.012106106938370855, "agent_compute-ego1": 0.011429081352227534, "agent_compute-ego2": 0.01254566067164387, "agent_compute-ego3": 0.011502060862405414, "complete-iteration": 1.2731762803861442, "set_robot_commands": 0.002140670096645943, "deviation-center-line": 0.2948228640601014, "driven_lanedir_consec": 0.293378997726907, "sim_compute_sim_state": 0.0331068606698245, "sim_compute_performance-ego0": 0.0019376857592402449, "sim_compute_performance-ego1": 0.0018966140397680888, "sim_compute_performance-ego2": 0.0018683591552022892, "sim_compute_performance-ego3": 0.0019572146429209587}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.3400570009519033, "get_ui_image": 0.04632227188542324, "step_physics": 1.0914710419660405, "survival_time": 59.99999999999873, "driven_lanedir": 1.0337849051416967, "get_state_dump": 0.00941679856858583, "get_robot_state": 0.014036829128154212, "sim_render-ego0": 0.003717655742495979, "sim_render-ego1": 0.0036056817917899226, "sim_render-ego2": 0.003803314515494189, "sim_render-ego3": 0.003642865958360709, "get_duckie_state": 1.1644990716151254e-06, "in-drivable-lane": 33.54999999999948, "deviation-heading": 20.571905065944097, "agent_compute-ego0": 0.012106106938370855, "agent_compute-ego1": 0.011429081352227534, "agent_compute-ego2": 0.01254566067164387, "agent_compute-ego3": 0.011502060862405414, "complete-iteration": 1.2731762803861442, "set_robot_commands": 0.002140670096645943, "deviation-center-line": 1.676975114879716, "driven_lanedir_consec": 0.9247384554949074, "sim_compute_sim_state": 0.0331068606698245, "sim_compute_performance-ego0": 0.0019376857592402449, "sim_compute_performance-ego1": 0.0018966140397680888, "sim_compute_performance-ego2": 0.0018683591552022892, "sim_compute_performance-ego3": 0.0019572146429209587}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.16389578063048768, "get_ui_image": 0.04632227188542324, "step_physics": 1.0914710419660405, "survival_time": 59.99999999999873, "driven_lanedir": 0.08761852645256063, "get_state_dump": 0.00941679856858583, "get_robot_state": 0.014036829128154212, "sim_render-ego0": 0.003717655742495979, "sim_render-ego1": 0.0036056817917899226, "sim_render-ego2": 0.003803314515494189, "sim_render-ego3": 0.003642865958360709, "get_duckie_state": 1.1644990716151254e-06, "in-drivable-lane": 58.69999999999872, "deviation-heading": 0.7560411537985214, "agent_compute-ego0": 0.012106106938370855, "agent_compute-ego1": 0.011429081352227534, "agent_compute-ego2": 0.01254566067164387, "agent_compute-ego3": 0.011502060862405414, "complete-iteration": 1.2731762803861442, "set_robot_commands": 0.002140670096645943, "deviation-center-line": 0.05360247763801091, "driven_lanedir_consec": 0.08761852645256063, "sim_compute_sim_state": 0.0331068606698245, "sim_compute_performance-ego0": 0.0019376857592402449, "sim_compute_performance-ego1": 0.0018966140397680888, "sim_compute_performance-ego2": 0.0018683591552022892, "sim_compute_performance-ego3": 0.0019572146429209587}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 4.6705179901034235, "get_ui_image": 0.04632227188542324, "step_physics": 1.0914710419660405, "survival_time": 59.99999999999873, "driven_lanedir": 0.9028134867527084, "get_state_dump": 0.00941679856858583, "get_robot_state": 0.014036829128154212, "sim_render-ego0": 0.003717655742495979, "sim_render-ego1": 0.0036056817917899226, "sim_render-ego2": 0.003803314515494189, "sim_render-ego3": 0.003642865958360709, "get_duckie_state": 1.1644990716151254e-06, "in-drivable-lane": 39.99999999999878, "deviation-heading": 16.080685030404457, "agent_compute-ego0": 0.012106106938370855, "agent_compute-ego1": 0.011429081352227534, "agent_compute-ego2": 0.01254566067164387, "agent_compute-ego3": 0.011502060862405414, "complete-iteration": 1.2731762803861442, "set_robot_commands": 0.002140670096645943, "deviation-center-line": 1.5365504559121754, "driven_lanedir_consec": 0.8975116167550192, "sim_compute_sim_state": 0.0331068606698245, "sim_compute_performance-ego0": 0.0019376857592402449, "sim_compute_performance-ego1": 0.0018966140397680888, "sim_compute_performance-ego2": 0.0018683591552022892, "sim_compute_performance-ego3": 0.0019572146429209587}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 8.338950808667375, "get_ui_image": 0.02945109688173623, "step_physics": 0.31010763154835824, "survival_time": 59.99999999999873, "driven_lanedir": 0.6430309375646427, "get_state_dump": 0.005908783826105402, "get_robot_state": 0.006871542267557187, "sim_render-ego0": 0.003598141928298785, "sim_render-ego1": 0.003556801218672854, "get_duckie_state": 1.121817977104854e-06, "in-drivable-lane": 51.69999999999868, "deviation-heading": 6.013020668647681, "agent_compute-ego0": 0.01207013074603307, "agent_compute-ego1": 0.01161981522292519, "complete-iteration": 0.40109446761411593, "set_robot_commands": 0.002102086784242095, "deviation-center-line": 0.8571133453966416, "driven_lanedir_consec": 0.6430309375646427, "sim_compute_sim_state": 0.009914772397374035, "sim_compute_performance-ego0": 0.0018475152967772216, "sim_compute_performance-ego1": 0.0018390304937052984}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 2.963520680454658, "get_ui_image": 0.02945109688173623, "step_physics": 0.31010763154835824, "survival_time": 59.99999999999873, "driven_lanedir": 1.1221486312685856, "get_state_dump": 0.005908783826105402, "get_robot_state": 0.006871542267557187, "sim_render-ego0": 0.003598141928298785, "sim_render-ego1": 0.003556801218672854, "get_duckie_state": 1.121817977104854e-06, "in-drivable-lane": 29.549999999999375, "deviation-heading": 23.527643940445117, "agent_compute-ego0": 0.01207013074603307, "agent_compute-ego1": 0.01161981522292519, "complete-iteration": 0.40109446761411593, "set_robot_commands": 0.002102086784242095, "deviation-center-line": 2.18076397352927, "driven_lanedir_consec": 1.1221486312685856, "sim_compute_sim_state": 0.009914772397374035, "sim_compute_performance-ego0": 0.0018475152967772216, "sim_compute_performance-ego1": 0.0018390304937052984}}
set_robot_commands_max0.0021661993466646446
set_robot_commands_mean0.0021409686090717336
set_robot_commands_median0.002140670096645943
set_robot_commands_min0.002102086784242095
sim_compute_performance-ego0_max0.0019376857592402449
sim_compute_performance-ego0_mean0.0019035632593021729
sim_compute_performance-ego0_median0.001904460810106263
sim_compute_performance-ego0_min0.0018475152967772216
sim_compute_performance-ego1_max0.0018966140397680888
sim_compute_performance-ego1_mean0.001861808075127228
sim_compute_performance-ego1_median0.0018549273155015471
sim_compute_performance-ego1_min0.0018390304937052984
sim_compute_performance-ego2_max0.0018683591552022892
sim_compute_performance-ego2_mean0.001857393951903043
sim_compute_performance-ego2_median0.0018535557634923776
sim_compute_performance-ego2_min0.0018502669370144631
sim_compute_performance-ego3_max0.0019572146429209587
sim_compute_performance-ego3_mean0.0018870790170822545
sim_compute_performance-ego3_median0.0018595861058548825
sim_compute_performance-ego3_min0.0018444363024709227
sim_compute_sim_state_max0.04769116039577869
sim_compute_sim_state_mean0.033670246948508994
sim_compute_sim_state_median0.0331068606698245
sim_compute_sim_state_min0.009914772397374035
sim_render-ego0_max0.003717655742495979
sim_render-ego0_mean0.003669160433610754
sim_render-ego0_median0.003689694265640348
sim_render-ego0_min0.003598141928298785
sim_render-ego1_max0.0036056817917899226
sim_render-ego1_mean0.00357920746039278
sim_render-ego1_median0.0035739081983860088
sim_render-ego1_min0.003556801218672854
sim_render-ego2_max0.003803314515494189
sim_render-ego2_mean0.00365584418735933
sim_render-ego2_median0.0035837782511206886
sim_render-ego2_min0.003580439795463111
sim_render-ego3_max0.003642865958360709
sim_render-ego3_mean0.003595207785024862
sim_render-ego3_median0.0035887838501815097
sim_render-ego3_min0.0035539735465323695
simulation-passed1
step_physics_max1.1304889412148609
step_physics_mean0.9430885913043918
step_physics_median1.0914710419660405
step_physics_min0.31010763154835824
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873

Highlights

56779

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.