Duckietown Challenges Home Challenges Submissions

Job 60248

Job ID60248
submission13014
userMárton Tim 🇭🇺
user label3626
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to dateyes
evaluatorgpu-prod-01
date started
date completed
duration1:27:51
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.779076616284264
survival_time_median25.200000000000223
deviation-center-line_median2.134720178438911
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.04322838407379013
agent_compute-ego0_mean0.04286269916842272
agent_compute-ego0_median0.042988356505290114
agent_compute-ego0_min0.04186808854515209
agent_compute-ego1_max0.04433158281687144
agent_compute-ego1_mean0.04268178347746846
agent_compute-ego1_median0.04269727322580812
agent_compute-ego1_min0.04122121943522254
agent_compute-ego2_max0.04435333308607045
agent_compute-ego2_mean0.04375319301523838
agent_compute-ego2_median0.04400158787632848
agent_compute-ego2_min0.04290465808331619
agent_compute-ego3_max0.04402123056016527
agent_compute-ego3_mean0.04315001015527139
agent_compute-ego3_median0.042830936507423326
agent_compute-ego3_min0.04259786339822558
complete-iteration_max1.4986603780909702
complete-iteration_mean1.1054619569699629
complete-iteration_median1.2984390051058023
complete-iteration_min0.39513187265515226
deviation-center-line_max3.914369658869023
deviation-center-line_mean2.1190398593375774
deviation-center-line_min0.4327202627982277
deviation-heading_max10.522163248820211
deviation-heading_mean6.493386573496299
deviation-heading_median7.5430724885666125
deviation-heading_min1.6314722728956184
driven_any_max30.895629709039557
driven_any_mean16.48716870993601
driven_any_median11.144973029568696
driven_any_min1.7778192602530336
driven_lanedir_consec_max30.585727393284884
driven_lanedir_consec_mean15.76347479591679
driven_lanedir_consec_min1.693998924285082
driven_lanedir_max30.585727393284884
driven_lanedir_mean15.76347479591679
driven_lanedir_median9.779076616284264
driven_lanedir_min1.693998924285082
get_duckie_state_max1.8541877334182327e-06
get_duckie_state_mean1.7254137912668272e-06
get_duckie_state_median1.7020823457258924e-06
get_duckie_state_min1.5859500653142238e-06
get_robot_state_max0.014404679740871396
get_robot_state_mean0.013257523074240472
get_robot_state_median0.01429066630227679
get_robot_state_min0.007258532942582129
get_state_dump_max0.009723596207730403
get_state_dump_mean0.00912029874962155
get_state_dump_median0.00961199708028598
get_state_dump_min0.006192998227032892
get_ui_image_max0.050400269998086465
get_ui_image_mean0.04440961694312613
get_ui_image_median0.04714972477148075
get_ui_image_min0.0301047393821062
in-drivable-lane_max18.85000000000024
in-drivable-lane_mean2.582142857142887
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 30.81994488768488, "get_ui_image": 0.04283129484032116, "step_physics": 0.5731775871819997, "survival_time": 59.99999999999873, "driven_lanedir": 30.35825160278568, "get_state_dump": 0.00961199708028598, "get_robot_state": 0.01429066630227679, "sim_render-ego0": 0.0037704627777912737, "sim_render-ego1": 0.003742700016171013, "sim_render-ego2": 0.003694720510439909, "sim_render-ego3": 0.003702752695393304, "get_duckie_state": 1.7020823457258924e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.638711107722036, "agent_compute-ego0": 0.042868662237823256, "agent_compute-ego1": 0.04269727322580812, "agent_compute-ego2": 0.04290465808331619, "agent_compute-ego3": 0.04259786339822558, "complete-iteration": 0.8744515298705217, "set_robot_commands": 0.002194613838672241, "deviation-center-line": 3.3783351821686036, "driven_lanedir_consec": 30.35825160278568, "sim_compute_sim_state": 0.031529191927945587, "sim_compute_performance-ego0": 0.002063212049295265, "sim_compute_performance-ego1": 0.0019917718377538167, "sim_compute_performance-ego2": 0.001982681161656566, "sim_compute_performance-ego3": 0.0019608141480635644}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 30.895629709039557, "get_ui_image": 0.04283129484032116, "step_physics": 0.5731775871819997, "survival_time": 59.99999999999873, "driven_lanedir": 30.585727393284884, "get_state_dump": 0.00961199708028598, "get_robot_state": 0.01429066630227679, "sim_render-ego0": 0.0037704627777912737, "sim_render-ego1": 0.003742700016171013, "sim_render-ego2": 0.003694720510439909, "sim_render-ego3": 0.003702752695393304, "get_duckie_state": 1.7020823457258924e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.147328030689936, "agent_compute-ego0": 0.042868662237823256, "agent_compute-ego1": 0.04269727322580812, "agent_compute-ego2": 0.04290465808331619, "agent_compute-ego3": 0.04259786339822558, "complete-iteration": 0.8744515298705217, "set_robot_commands": 0.002194613838672241, "deviation-center-line": 2.8978093118178303, "driven_lanedir_consec": 30.585727393284884, "sim_compute_sim_state": 0.031529191927945587, "sim_compute_performance-ego0": 0.002063212049295265, "sim_compute_performance-ego1": 0.0019917718377538167, "sim_compute_performance-ego2": 0.001982681161656566, "sim_compute_performance-ego3": 0.0019608141480635644}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 30.07208286546752, "get_ui_image": 0.04283129484032116, "step_physics": 0.5731775871819997, "survival_time": 59.99999999999873, "driven_lanedir": 29.68047040086181, "get_state_dump": 0.00961199708028598, "get_robot_state": 0.01429066630227679, "sim_render-ego0": 0.0037704627777912737, "sim_render-ego1": 0.003742700016171013, "sim_render-ego2": 0.003694720510439909, "sim_render-ego3": 0.003702752695393304, "get_duckie_state": 1.7020823457258924e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.59676528755059, "agent_compute-ego0": 0.042868662237823256, "agent_compute-ego1": 0.04269727322580812, "agent_compute-ego2": 0.04290465808331619, "agent_compute-ego3": 0.04259786339822558, "complete-iteration": 0.8744515298705217, "set_robot_commands": 0.002194613838672241, "deviation-center-line": 2.8973808665068175, "driven_lanedir_consec": 29.68047040086181, "sim_compute_sim_state": 0.031529191927945587, "sim_compute_performance-ego0": 0.002063212049295265, "sim_compute_performance-ego1": 0.0019917718377538167, "sim_compute_performance-ego2": 0.001982681161656566, "sim_compute_performance-ego3": 0.0019608141480635644}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 30.79967704614864, "get_ui_image": 0.04283129484032116, "step_physics": 0.5731775871819997, "survival_time": 59.99999999999873, "driven_lanedir": 30.426720278337093, "get_state_dump": 0.00961199708028598, "get_robot_state": 0.01429066630227679, "sim_render-ego0": 0.0037704627777912737, "sim_render-ego1": 0.003742700016171013, "sim_render-ego2": 0.003694720510439909, "sim_render-ego3": 0.003702752695393304, "get_duckie_state": 1.7020823457258924e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.938816946443289, "agent_compute-ego0": 0.042868662237823256, "agent_compute-ego1": 0.04269727322580812, "agent_compute-ego2": 0.04290465808331619, "agent_compute-ego3": 0.04259786339822558, "complete-iteration": 0.8744515298705217, "set_robot_commands": 0.002194613838672241, "deviation-center-line": 2.9857824216219933, "driven_lanedir_consec": 30.426720278337093, "sim_compute_sim_state": 0.031529191927945587, "sim_compute_performance-ego0": 0.002063212049295265, "sim_compute_performance-ego1": 0.0019917718377538167, "sim_compute_performance-ego2": 0.001982681161656566, "sim_compute_performance-ego3": 0.0019608141480635644}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.8114285288676053, "get_ui_image": 0.050400269998086465, "step_physics": 1.1915955199851649, "survival_time": 22.15000000000018, "driven_lanedir": 1.7788527402627232, "get_state_dump": 0.009723596207730403, "get_robot_state": 0.014404679740871396, "sim_render-ego0": 0.0038400394422513943, "sim_render-ego1": 0.0038007605183231936, "sim_render-ego2": 0.0038250271264497226, "sim_render-ego3": 0.00384708782574078, "get_duckie_state": 1.8541877334182327e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.30751467126884, "agent_compute-ego0": 0.04322838407379013, "agent_compute-ego1": 0.04433158281687144, "agent_compute-ego2": 0.04400158787632848, "agent_compute-ego3": 0.04402123056016527, "complete-iteration": 1.4986603780909702, "set_robot_commands": 0.0024560598639754563, "deviation-center-line": 0.9361675615354392, "driven_lanedir_consec": 1.7788527402627232, "sim_compute_sim_state": 0.023628736938442196, "sim_compute_performance-ego0": 0.0020575893891824257, "sim_compute_performance-ego1": 0.002087297740283313, "sim_compute_performance-ego2": 0.002079424557385144, "sim_compute_performance-ego3": 0.0020557513108124606}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 6.764798322652466, "get_ui_image": 0.050400269998086465, "step_physics": 1.1915955199851649, "survival_time": 22.15000000000018, "driven_lanedir": 4.567029325024036, "get_state_dump": 0.009723596207730403, "get_robot_state": 0.014404679740871396, "sim_render-ego0": 0.0038400394422513943, "sim_render-ego1": 0.0038007605183231936, "sim_render-ego2": 0.0038250271264497226, "sim_render-ego3": 0.00384708782574078, "get_duckie_state": 1.8541877334182327e-06, "in-drivable-lane": 10.900000000000109, "deviation-heading": 4.274396692967091, "agent_compute-ego0": 0.04322838407379013, "agent_compute-ego1": 0.04433158281687144, "agent_compute-ego2": 0.04400158787632848, "agent_compute-ego3": 0.04402123056016527, "complete-iteration": 1.4986603780909702, "set_robot_commands": 0.0024560598639754563, "deviation-center-line": 0.9694916183894352, "driven_lanedir_consec": 4.567029325024036, "sim_compute_sim_state": 0.023628736938442196, "sim_compute_performance-ego0": 0.0020575893891824257, "sim_compute_performance-ego1": 0.002087297740283313, "sim_compute_performance-ego2": 0.002079424557385144, "sim_compute_performance-ego3": 0.0020557513108124606}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 10.002201037414864, "get_ui_image": 0.050400269998086465, "step_physics": 1.1915955199851649, "survival_time": 22.15000000000018, "driven_lanedir": 8.001603525769907, "get_state_dump": 0.009723596207730403, "get_robot_state": 0.014404679740871396, "sim_render-ego0": 0.0038400394422513943, "sim_render-ego1": 0.0038007605183231936, "sim_render-ego2": 0.0038250271264497226, "sim_render-ego3": 0.00384708782574078, "get_duckie_state": 1.8541877334182327e-06, "in-drivable-lane": 3.650000000000035, "deviation-heading": 5.696283445448857, "agent_compute-ego0": 0.04322838407379013, "agent_compute-ego1": 0.04433158281687144, "agent_compute-ego2": 0.04400158787632848, "agent_compute-ego3": 0.04402123056016527, "complete-iteration": 1.4986603780909702, "set_robot_commands": 0.0024560598639754563, "deviation-center-line": 1.4985998293206042, "driven_lanedir_consec": 8.001603525769907, "sim_compute_sim_state": 0.023628736938442196, "sim_compute_performance-ego0": 0.0020575893891824257, "sim_compute_performance-ego1": 0.002087297740283313, "sim_compute_performance-ego2": 0.002079424557385144, "sim_compute_performance-ego3": 0.0020557513108124606}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.7778192602530336, "get_ui_image": 0.050400269998086465, "step_physics": 1.1915955199851649, "survival_time": 22.15000000000018, "driven_lanedir": 1.693998924285082, "get_state_dump": 0.009723596207730403, "get_robot_state": 0.014404679740871396, "sim_render-ego0": 0.0038400394422513943, "sim_render-ego1": 0.0038007605183231936, "sim_render-ego2": 0.0038250271264497226, "sim_render-ego3": 0.00384708782574078, "get_duckie_state": 1.8541877334182327e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.6314722728956184, "agent_compute-ego0": 0.04322838407379013, "agent_compute-ego1": 0.04433158281687144, "agent_compute-ego2": 0.04400158787632848, "agent_compute-ego3": 0.04402123056016527, "complete-iteration": 1.4986603780909702, "set_robot_commands": 0.0024560598639754563, "deviation-center-line": 3.2242718405261206, "driven_lanedir_consec": 1.693998924285082, "sim_compute_sim_state": 0.023628736938442196, "sim_compute_performance-ego0": 0.0020575893891824257, "sim_compute_performance-ego1": 0.002087297740283313, "sim_compute_performance-ego2": 0.002079424557385144, "sim_compute_performance-ego3": 0.0020557513108124606}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 9.364597524929852, "get_ui_image": 0.04714972477148075, "step_physics": 0.9935803885507112, "survival_time": 25.200000000000223, "driven_lanedir": 8.346521268104109, "get_state_dump": 0.009488953222142589, "get_robot_state": 0.01407671824540242, "sim_render-ego0": 0.0038552284240722656, "sim_render-ego1": 0.003857006885037564, "sim_render-ego2": 0.003750355881039459, "sim_render-ego3": 0.003679190531815633, "get_duckie_state": 1.6897031576326578e-06, "in-drivable-lane": 1.3000000000000185, "deviation-heading": 8.771737890915846, "agent_compute-ego0": 0.042988356505290114, "agent_compute-ego1": 0.041746776410848785, "agent_compute-ego2": 0.04435333308607045, "agent_compute-ego3": 0.042830936507423326, "complete-iteration": 1.2984390051058023, "set_robot_commands": 0.0021537979050438, "deviation-center-line": 1.6409011810523333, "driven_lanedir_consec": 8.346521268104109, "sim_compute_sim_state": 0.029423630119550345, "sim_compute_performance-ego0": 0.0020788273008743134, "sim_compute_performance-ego1": 0.002070555828585483, "sim_compute_performance-ego2": 0.002029561524343963, "sim_compute_performance-ego3": 0.001996672979675898}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.5716678161763005, "get_ui_image": 0.04714972477148075, "step_physics": 0.9935803885507112, "survival_time": 25.200000000000223, "driven_lanedir": 2.4614321526214336, "get_state_dump": 0.009488953222142589, "get_robot_state": 0.01407671824540242, "sim_render-ego0": 0.0038552284240722656, "sim_render-ego1": 0.003857006885037564, "sim_render-ego2": 0.003750355881039459, "sim_render-ego3": 0.003679190531815633, "get_duckie_state": 1.6897031576326578e-06, "in-drivable-lane": 18.85000000000024, "deviation-heading": 2.497332004273154, "agent_compute-ego0": 0.042988356505290114, "agent_compute-ego1": 0.041746776410848785, "agent_compute-ego2": 0.04435333308607045, "agent_compute-ego3": 0.042830936507423326, "complete-iteration": 1.2984390051058023, "set_robot_commands": 0.0021537979050438, "deviation-center-line": 0.4327202627982277, "driven_lanedir_consec": 2.4614321526214336, "sim_compute_sim_state": 0.029423630119550345, "sim_compute_performance-ego0": 0.0020788273008743134, "sim_compute_performance-ego1": 0.002070555828585483, "sim_compute_performance-ego2": 0.002029561524343963, "sim_compute_performance-ego3": 0.001996672979675898}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.949720694000383, "get_ui_image": 0.04714972477148075, "step_physics": 0.9935803885507112, "survival_time": 25.200000000000223, "driven_lanedir": 3.9026315398568743, "get_state_dump": 0.009488953222142589, "get_robot_state": 0.01407671824540242, "sim_render-ego0": 0.0038552284240722656, "sim_render-ego1": 0.003857006885037564, "sim_render-ego2": 0.003750355881039459, "sim_render-ego3": 0.003679190531815633, "get_duckie_state": 1.6897031576326578e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.9312402208588568, "agent_compute-ego0": 0.042988356505290114, "agent_compute-ego1": 0.041746776410848785, "agent_compute-ego2": 0.04435333308607045, "agent_compute-ego3": 0.042830936507423326, "complete-iteration": 1.2984390051058023, "set_robot_commands": 0.0021537979050438, "deviation-center-line": 0.8723965471468583, "driven_lanedir_consec": 3.9026315398568743, "sim_compute_sim_state": 0.029423630119550345, "sim_compute_performance-ego0": 0.0020788273008743134, "sim_compute_performance-ego1": 0.002070555828585483, "sim_compute_performance-ego2": 0.002029561524343963, "sim_compute_performance-ego3": 0.001996672979675898}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 12.287745021722529, "get_ui_image": 0.04714972477148075, "step_physics": 0.9935803885507112, "survival_time": 25.200000000000223, "driven_lanedir": 11.211631964464416, "get_state_dump": 0.009488953222142589, "get_robot_state": 0.01407671824540242, "sim_render-ego0": 0.0038552284240722656, "sim_render-ego1": 0.003857006885037564, "sim_render-ego2": 0.003750355881039459, "sim_render-ego3": 0.003679190531815633, "get_duckie_state": 1.6897031576326578e-06, "in-drivable-lane": 1.4500000000000206, "deviation-heading": 4.763770997499895, "agent_compute-ego0": 0.042988356505290114, "agent_compute-ego1": 0.041746776410848785, "agent_compute-ego2": 0.04435333308607045, "agent_compute-ego3": 0.042830936507423326, "complete-iteration": 1.2984390051058023, "set_robot_commands": 0.0021537979050438, "deviation-center-line": 1.3897925731473102, "driven_lanedir_consec": 11.211631964464416, "sim_compute_sim_state": 0.029423630119550345, "sim_compute_performance-ego0": 0.0020788273008743134, "sim_compute_performance-ego1": 0.002070555828585483, "sim_compute_performance-ego2": 0.002029561524343963, "sim_compute_performance-ego3": 0.001996672979675898}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 30.271000221626583, "get_ui_image": 0.0301047393821062, "step_physics": 0.2419395716760081, "survival_time": 59.99999999999873, "driven_lanedir": 29.668234915792873, "get_state_dump": 0.006192998227032892, "get_robot_state": 0.007258532942582129, "sim_render-ego0": 0.003703349238132855, "sim_render-ego1": 0.003705005463116572, "get_duckie_state": 1.5859500653142238e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.522163248820211, "agent_compute-ego0": 0.04186808854515209, "agent_compute-ego1": 0.04122121943522254, "complete-iteration": 0.39513187265515226, "set_robot_commands": 0.0022374194031651072, "deviation-center-line": 3.914369658869023, "driven_lanedir_consec": 29.668234915792873, "sim_compute_sim_state": 0.01057760383961699, "sim_compute_performance-ego0": 0.0019817999459424683, "sim_compute_performance-ego1": 0.001992627841844646}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 28.432049003119904, "get_ui_image": 0.0301047393821062, "step_physics": 0.2419395716760081, "survival_time": 59.99999999999873, "driven_lanedir": 28.005541111384105, "get_state_dump": 0.006192998227032892, "get_robot_state": 0.007258532942582129, "sim_render-ego0": 0.003703349238132855, "sim_render-ego1": 0.003705005463116572, "get_duckie_state": 1.5859500653142238e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.18987921159398, "agent_compute-ego0": 0.04186808854515209, "agent_compute-ego1": 0.04122121943522254, "complete-iteration": 0.39513187265515226, "set_robot_commands": 0.0022374194031651072, "deviation-center-line": 2.628539175825489, "driven_lanedir_consec": 28.005541111384105, "sim_compute_sim_state": 0.01057760383961699, "sim_compute_performance-ego0": 0.0019817999459424683, "sim_compute_performance-ego1": 0.001992627841844646}}
set_robot_commands_max0.0024560598639754563
set_robot_commands_mean0.0022637660883640144
set_robot_commands_median0.002194613838672241
set_robot_commands_min0.0021537979050438
sim_compute_performance-ego0_max0.0020788273008743134
sim_compute_performance-ego0_mean0.0020544367749494967
sim_compute_performance-ego0_median0.002063212049295265
sim_compute_performance-ego0_min0.0019817999459424683
sim_compute_performance-ego1_max0.002087297740283313
sim_compute_performance-ego1_mean0.0020416969507271246
sim_compute_performance-ego1_median0.002070555828585483
sim_compute_performance-ego1_min0.0019917718377538167
sim_compute_performance-ego2_max0.002079424557385144
sim_compute_performance-ego2_mean0.0020305557477952245
sim_compute_performance-ego2_median0.002029561524343963
sim_compute_performance-ego2_min0.001982681161656566
sim_compute_performance-ego3_max0.0020557513108124606
sim_compute_performance-ego3_mean0.002004412812850641
sim_compute_performance-ego3_median0.001996672979675898
sim_compute_performance-ego3_min0.0019608141480635644
sim_compute_sim_state_max0.031529191927945587
sim_compute_sim_state_mean0.025677245973070462
sim_compute_sim_state_median0.029423630119550345
sim_compute_sim_state_min0.01057760383961699
sim_render-ego0_max0.0038552284240722656
sim_render-ego0_mean0.003804972932337531
sim_render-ego0_median0.0038400394422513943
sim_render-ego0_min0.003703349238132855
sim_render-ego1_max0.003857006885037564
sim_render-ego1_mean0.003786562900311445
sim_render-ego1_median0.0038007605183231936
sim_render-ego1_min0.003705005463116572
sim_render-ego2_max0.0038250271264497226
sim_render-ego2_mean0.003756701172643031
sim_render-ego2_median0.003750355881039459
sim_render-ego2_min0.003694720510439909
sim_render-ego3_max0.00384708782574078
sim_render-ego3_mean0.0037430103509832383
sim_render-ego3_median0.003702752695393304
sim_render-ego3_min0.003679190531815633
simulation-passed1
step_physics_max1.1915955199851649
step_physics_mean0.8226637947302514
step_physics_median0.9935803885507112
step_physics_min0.2419395716760081
survival_time_max59.99999999999873
survival_time_mean39.24285714285672
survival_time_min22.15000000000018

Highlights

60248

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

challenge-solution-output

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.