Duckietown Challenges Home Challenges Submissions

Submission 13241

Submission13241
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60498
Next
User label212-2
Admin priority50
Blessingn/a
User priority50

60498

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
60498LFVmultibodyv-simsuccessyes0:50:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0931977395296313
survival_time_median24.500000000000213
deviation-center-line_median1.7507786483448533
in-drivable-lane_median1.2249999999999956


other stats
agent_compute-ego0_max0.017341259783494253
agent_compute-ego0_mean0.016520388705293255
agent_compute-ego0_median0.016980445959705215
agent_compute-ego0_min0.015137377712461684
agent_compute-ego1_max0.015766803806714285
agent_compute-ego1_mean0.015409824393308888
agent_compute-ego1_median0.015519841744081818
agent_compute-ego1_min0.014658696121639676
agent_compute-ego2_max0.015214457296843106
agent_compute-ego2_mean0.01468988655874555
agent_compute-ego2_median0.014569654952000528
agent_compute-ego2_min0.014285547427393026
agent_compute-ego3_max0.015104191484940738
agent_compute-ego3_mean0.014476944080838772
agent_compute-ego3_median0.01425354759188464
agent_compute-ego3_min0.014073093165690932
complete-iteration_max1.3798450214866531
complete-iteration_mean1.0939368960666058
complete-iteration_median1.2078495802558853
complete-iteration_min0.35293804936938816
deviation-center-line_max3.4866035676643947
deviation-center-line_mean1.7257100081911774
deviation-center-line_min0.10396622827189386
deviation-heading_max7.002529846898808
deviation-heading_mean3.0069280245201164
deviation-heading_median3.2094735827964382
deviation-heading_min0.35803480692592327
driven_any_max14.631739955305209
driven_any_mean4.631109191571919
driven_any_median3.549605063031956
driven_any_min0.9307512906584264
driven_lanedir_consec_max10.679547891790095
driven_lanedir_consec_mean3.586966009397384
driven_lanedir_consec_min0.91852637195277
driven_lanedir_max10.679547891790095
driven_lanedir_mean3.586966009397384
driven_lanedir_median3.0931977395296313
driven_lanedir_min0.91852637195277
get_duckie_state_max1.2886785242679346e-06
get_duckie_state_mean1.2420225804644969e-06
get_duckie_state_median1.2561891326593528e-06
get_duckie_state_min1.1490450965033638e-06
get_robot_state_max0.013991479455989645
get_robot_state_mean0.012845034217693336
get_robot_state_median0.013813042529448752
get_robot_state_min0.00691820846663581
get_state_dump_max0.009391193842365794
get_state_dump_mean0.008812409356980536
get_state_dump_median0.009278564764589397
get_state_dump_min0.005958510769738091
get_ui_image_max0.049481802743107865
get_ui_image_mean0.04366200703787909
get_ui_image_median0.046455012805107415
get_ui_image_min0.029203467898898657
in-drivable-lane_max24.35000000000032
in-drivable-lane_mean3.835714285714322
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.9307512906584264, "get_ui_image": 0.042278475134912195, "step_physics": 0.8916206951559025, "survival_time": 13.65000000000006, "driven_lanedir": 0.91852637195277, "get_state_dump": 0.009391193842365794, "get_robot_state": 0.013991479455989645, "sim_render-ego0": 0.0036772089282961656, "sim_render-ego1": 0.003605901759906407, "sim_render-ego2": 0.003566978621656877, "sim_render-ego3": 0.0035512090599449883, "get_duckie_state": 1.2886785242679346e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.61006941983907, "agent_compute-ego0": 0.015930965869096075, "agent_compute-ego1": 0.015519841744081818, "agent_compute-ego2": 0.014569654952000528, "agent_compute-ego3": 0.01425354759188464, "complete-iteration": 1.0646155098058885, "set_robot_commands": 0.0021597181793547027, "deviation-center-line": 1.9983322903798648, "driven_lanedir_consec": 0.91852637195277, "sim_compute_sim_state": 0.01606501192942153, "sim_compute_performance-ego0": 0.001921450134611478, "sim_compute_performance-ego1": 0.0019087565206263187, "sim_compute_performance-ego2": 0.0018714535845457203, "sim_compute_performance-ego3": 0.0018705347158612996}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.1364141847015565, "get_ui_image": 0.042278475134912195, "step_physics": 0.8916206951559025, "survival_time": 13.65000000000006, "driven_lanedir": 2.762679363794621, "get_state_dump": 0.009391193842365794, "get_robot_state": 0.013991479455989645, "sim_render-ego0": 0.0036772089282961656, "sim_render-ego1": 0.003605901759906407, "sim_render-ego2": 0.003566978621656877, "sim_render-ego3": 0.0035512090599449883, "get_duckie_state": 1.2886785242679346e-06, "in-drivable-lane": 0.6499999999999977, "deviation-heading": 0.7389560049884449, "agent_compute-ego0": 0.015930965869096075, "agent_compute-ego1": 0.015519841744081818, "agent_compute-ego2": 0.014569654952000528, "agent_compute-ego3": 0.01425354759188464, "complete-iteration": 1.0646155098058885, "set_robot_commands": 0.0021597181793547027, "deviation-center-line": 1.086969599550052, "driven_lanedir_consec": 2.762679363794621, "sim_compute_sim_state": 0.01606501192942153, "sim_compute_performance-ego0": 0.001921450134611478, "sim_compute_performance-ego1": 0.0019087565206263187, "sim_compute_performance-ego2": 0.0018714535845457203, "sim_compute_performance-ego3": 0.0018705347158612996}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.042562831588925, "get_ui_image": 0.042278475134912195, "step_physics": 0.8916206951559025, "survival_time": 13.65000000000006, "driven_lanedir": 1.0336851403022511, "get_state_dump": 0.009391193842365794, "get_robot_state": 0.013991479455989645, "sim_render-ego0": 0.0036772089282961656, "sim_render-ego1": 0.003605901759906407, "sim_render-ego2": 0.003566978621656877, "sim_render-ego3": 0.0035512090599449883, "get_duckie_state": 1.2886785242679346e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.7795051857921805, "agent_compute-ego0": 0.015930965869096075, "agent_compute-ego1": 0.015519841744081818, "agent_compute-ego2": 0.014569654952000528, "agent_compute-ego3": 0.01425354759188464, "complete-iteration": 1.0646155098058885, "set_robot_commands": 0.0021597181793547027, "deviation-center-line": 1.1362772395148288, "driven_lanedir_consec": 1.0336851403022511, "sim_compute_sim_state": 0.01606501192942153, "sim_compute_performance-ego0": 0.001921450134611478, "sim_compute_performance-ego1": 0.0019087565206263187, "sim_compute_performance-ego2": 0.0018714535845457203, "sim_compute_performance-ego3": 0.0018705347158612996}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 6.484051096996488, "get_ui_image": 0.042278475134912195, "step_physics": 0.8916206951559025, "survival_time": 13.65000000000006, "driven_lanedir": 4.942347237468961, "get_state_dump": 0.009391193842365794, "get_robot_state": 0.013991479455989645, "sim_render-ego0": 0.0036772089282961656, "sim_render-ego1": 0.003605901759906407, "sim_render-ego2": 0.003566978621656877, "sim_render-ego3": 0.0035512090599449883, "get_duckie_state": 1.2886785242679346e-06, "in-drivable-lane": 2.900000000000011, "deviation-heading": 1.4997145905318172, "agent_compute-ego0": 0.015930965869096075, "agent_compute-ego1": 0.015519841744081818, "agent_compute-ego2": 0.014569654952000528, "agent_compute-ego3": 0.01425354759188464, "complete-iteration": 1.0646155098058885, "set_robot_commands": 0.0021597181793547027, "deviation-center-line": 1.108770300863438, "driven_lanedir_consec": 4.942347237468961, "sim_compute_sim_state": 0.01606501192942153, "sim_compute_performance-ego0": 0.001921450134611478, "sim_compute_performance-ego1": 0.0019087565206263187, "sim_compute_performance-ego2": 0.0018714535845457203, "sim_compute_performance-ego3": 0.0018705347158612996}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 14.631739955305209, "get_ui_image": 0.049481802743107865, "step_physics": 1.188530171455158, "survival_time": 32.100000000000314, "driven_lanedir": 10.679547891790095, "get_state_dump": 0.009278564764589397, "get_robot_state": 0.013813042529448752, "sim_render-ego0": 0.003625810795215945, "sim_render-ego1": 0.003598298848509603, "sim_render-ego2": 0.003611525332390057, "sim_render-ego3": 0.003560530824201474, "get_duckie_state": 1.2276888264467703e-06, "in-drivable-lane": 8.2500000000001, "deviation-heading": 4.048205018066605, "agent_compute-ego0": 0.016980445959705215, "agent_compute-ego1": 0.015766803806714285, "agent_compute-ego2": 0.015214457296843106, "agent_compute-ego3": 0.015104191484940738, "complete-iteration": 1.3798450214866531, "set_robot_commands": 0.002181403559066274, "deviation-center-line": 2.5317182375285596, "driven_lanedir_consec": 10.679547891790095, "sim_compute_sim_state": 0.02478164128530452, "sim_compute_performance-ego0": 0.0018909181443565923, "sim_compute_performance-ego1": 0.0018641970947408009, "sim_compute_performance-ego2": 0.0019253479377663524, "sim_compute_performance-ego3": 0.0018825215833554187}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 3.962795941362355, "get_ui_image": 0.049481802743107865, "step_physics": 1.188530171455158, "survival_time": 32.100000000000314, "driven_lanedir": 3.423716115264642, "get_state_dump": 0.009278564764589397, "get_robot_state": 0.013813042529448752, "sim_render-ego0": 0.003625810795215945, "sim_render-ego1": 0.003598298848509603, "sim_render-ego2": 0.003611525332390057, "sim_render-ego3": 0.003560530824201474, "get_duckie_state": 1.2276888264467703e-06, "in-drivable-lane": 1.099999999999996, "deviation-heading": 2.8629482960197357, "agent_compute-ego0": 0.016980445959705215, "agent_compute-ego1": 0.015766803806714285, "agent_compute-ego2": 0.015214457296843106, "agent_compute-ego3": 0.015104191484940738, "complete-iteration": 1.3798450214866531, "set_robot_commands": 0.002181403559066274, "deviation-center-line": 3.4866035676643947, "driven_lanedir_consec": 3.423716115264642, "sim_compute_sim_state": 0.02478164128530452, "sim_compute_performance-ego0": 0.0018909181443565923, "sim_compute_performance-ego1": 0.0018641970947408009, "sim_compute_performance-ego2": 0.0019253479377663524, "sim_compute_performance-ego3": 0.0018825215833554187}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 7.127619268367569, "get_ui_image": 0.049481802743107865, "step_physics": 1.188530171455158, "survival_time": 32.100000000000314, "driven_lanedir": 5.240008677295879, "get_state_dump": 0.009278564764589397, "get_robot_state": 0.013813042529448752, "sim_render-ego0": 0.003625810795215945, "sim_render-ego1": 0.003598298848509603, "sim_render-ego2": 0.003611525332390057, "sim_render-ego3": 0.003560530824201474, "get_duckie_state": 1.2276888264467703e-06, "in-drivable-lane": 3.950000000000008, "deviation-heading": 5.6293457842530135, "agent_compute-ego0": 0.016980445959705215, "agent_compute-ego1": 0.015766803806714285, "agent_compute-ego2": 0.015214457296843106, "agent_compute-ego3": 0.015104191484940738, "complete-iteration": 1.3798450214866531, "set_robot_commands": 0.002181403559066274, "deviation-center-line": 3.1758779815622766, "driven_lanedir_consec": 5.240008677295879, "sim_compute_sim_state": 0.02478164128530452, "sim_compute_performance-ego0": 0.0018909181443565923, "sim_compute_performance-ego1": 0.0018641970947408009, "sim_compute_performance-ego2": 0.0019253479377663524, "sim_compute_performance-ego3": 0.0018825215833554187}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 3.982420712074492, "get_ui_image": 0.049481802743107865, "step_physics": 1.188530171455158, "survival_time": 32.100000000000314, "driven_lanedir": 3.5035408145774225, "get_state_dump": 0.009278564764589397, "get_robot_state": 0.013813042529448752, "sim_render-ego0": 0.003625810795215945, "sim_render-ego1": 0.003598298848509603, "sim_render-ego2": 0.003611525332390057, "sim_render-ego3": 0.003560530824201474, "get_duckie_state": 1.2276888264467703e-06, "in-drivable-lane": 24.35000000000032, "deviation-heading": 1.4579562777847803, "agent_compute-ego0": 0.016980445959705215, "agent_compute-ego1": 0.015766803806714285, "agent_compute-ego2": 0.015214457296843106, "agent_compute-ego3": 0.015104191484940738, "complete-iteration": 1.3798450214866531, "set_robot_commands": 0.002181403559066274, "deviation-center-line": 0.6356569079328641, "driven_lanedir_consec": 3.5035408145774225, "sim_compute_sim_state": 0.02478164128530452, "sim_compute_performance-ego0": 0.0018909181443565923, "sim_compute_performance-ego1": 0.0018641970947408009, "sim_compute_performance-ego2": 0.0019253479377663524, "sim_compute_performance-ego3": 0.0018825215833554187}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 11.174428347113636, "get_ui_image": 0.046455012805107415, "step_physics": 1.0260632717925031, "survival_time": 24.500000000000213, "driven_lanedir": 8.216968567992776, "get_state_dump": 0.00919441875760764, "get_robot_state": 0.013693993543170377, "sim_render-ego0": 0.003589261573589504, "sim_render-ego1": 0.003514343269487991, "sim_render-ego2": 0.003508069607488007, "sim_render-ego3": 0.0035052241230205216, "get_duckie_state": 1.2561891326593528e-06, "in-drivable-lane": 6.00000000000007, "deviation-heading": 3.555998869573141, "agent_compute-ego0": 0.017341259783494253, "agent_compute-ego1": 0.015318391764965172, "agent_compute-ego2": 0.014285547427393026, "agent_compute-ego3": 0.014073093165690932, "complete-iteration": 1.2078495802558853, "set_robot_commands": 0.002191939324808218, "deviation-center-line": 1.932624267047982, "driven_lanedir_consec": 8.216968567992776, "sim_compute_sim_state": 0.02105465488861146, "sim_compute_performance-ego0": 0.0018568364277390984, "sim_compute_performance-ego1": 0.0018342327925920973, "sim_compute_performance-ego2": 0.0018309663123851395, "sim_compute_performance-ego3": 0.0018384510048052444}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 5.624550614084515, "get_ui_image": 0.046455012805107415, "step_physics": 1.0260632717925031, "survival_time": 24.500000000000213, "driven_lanedir": 3.833956215750224, "get_state_dump": 0.00919441875760764, "get_robot_state": 0.013693993543170377, "sim_render-ego0": 0.003589261573589504, "sim_render-ego1": 0.003514343269487991, "sim_render-ego2": 0.003508069607488007, "sim_render-ego3": 0.0035052241230205216, "get_duckie_state": 1.2561891326593528e-06, "in-drivable-lane": 3.8500000000000094, "deviation-heading": 4.740165230846292, "agent_compute-ego0": 0.017341259783494253, "agent_compute-ego1": 0.015318391764965172, "agent_compute-ego2": 0.014285547427393026, "agent_compute-ego3": 0.014073093165690932, "complete-iteration": 1.2078495802558853, "set_robot_commands": 0.002191939324808218, "deviation-center-line": 2.313720340889818, "driven_lanedir_consec": 3.833956215750224, "sim_compute_sim_state": 0.02105465488861146, "sim_compute_performance-ego0": 0.0018568364277390984, "sim_compute_performance-ego1": 0.0018342327925920973, "sim_compute_performance-ego2": 0.0018309663123851395, "sim_compute_performance-ego3": 0.0018384510048052444}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 2.287158548616947, "get_ui_image": 0.046455012805107415, "step_physics": 1.0260632717925031, "survival_time": 24.500000000000213, "driven_lanedir": 2.282023809375721, "get_state_dump": 0.00919441875760764, "get_robot_state": 0.013693993543170377, "sim_render-ego0": 0.003589261573589504, "sim_render-ego1": 0.003514343269487991, "sim_render-ego2": 0.003508069607488007, "sim_render-ego3": 0.0035052241230205216, "get_duckie_state": 1.2561891326593528e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.002529846898808, "agent_compute-ego0": 0.017341259783494253, "agent_compute-ego1": 0.015318391764965172, "agent_compute-ego2": 0.014285547427393026, "agent_compute-ego3": 0.014073093165690932, "complete-iteration": 1.2078495802558853, "set_robot_commands": 0.002191939324808218, "deviation-center-line": 1.5689330296417243, "driven_lanedir_consec": 2.282023809375721, "sim_compute_sim_state": 0.02105465488861146, "sim_compute_performance-ego0": 0.0018568364277390984, "sim_compute_performance-ego1": 0.0018342327925920973, "sim_compute_performance-ego2": 0.0018309663123851395, "sim_compute_performance-ego3": 0.0018384510048052444}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 1.9961355415328337, "get_ui_image": 0.046455012805107415, "step_physics": 1.0260632717925031, "survival_time": 24.500000000000213, "driven_lanedir": 1.3724117370804765, "get_state_dump": 0.00919441875760764, "get_robot_state": 0.013693993543170377, "sim_render-ego0": 0.003589261573589504, "sim_render-ego1": 0.003514343269487991, "sim_render-ego2": 0.003508069607488007, "sim_render-ego3": 0.0035052241230205216, "get_duckie_state": 1.2561891326593528e-06, "in-drivable-lane": 1.149999999999996, "deviation-heading": 4.008049292088615, "agent_compute-ego0": 0.017341259783494253, "agent_compute-ego1": 0.015318391764965172, "agent_compute-ego2": 0.014285547427393026, "agent_compute-ego3": 0.014073093165690932, "complete-iteration": 1.2078495802558853, "set_robot_commands": 0.002191939324808218, "deviation-center-line": 2.9077506095536334, "driven_lanedir_consec": 1.3724117370804765, "sim_compute_sim_state": 0.02105465488861146, "sim_compute_performance-ego0": 0.0018568364277390984, "sim_compute_performance-ego1": 0.0018342327925920973, "sim_compute_performance-ego2": 0.0018309663123851395, "sim_compute_performance-ego3": 0.0018384510048052444}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.2788388087145257, "get_ui_image": 0.029203467898898657, "step_physics": 0.2567257881164551, "survival_time": 3.5499999999999954, "driven_lanedir": 0.9486261544231692, "get_state_dump": 0.005958510769738091, "get_robot_state": 0.00691820846663581, "sim_render-ego0": 0.003612094455295139, "sim_render-ego1": 0.0036728911929660374, "get_duckie_state": 1.1490450965033638e-06, "in-drivable-lane": 1.2999999999999954, "deviation-heading": 0.35803480692592327, "agent_compute-ego0": 0.015137377712461684, "agent_compute-ego1": 0.014658696121639676, "complete-iteration": 0.35293804936938816, "set_robot_commands": 0.0022671984301673043, "deviation-center-line": 0.10396622827189386, "driven_lanedir_consec": 0.9486261544231692, "sim_compute_sim_state": 0.008589426676432291, "sim_compute_performance-ego0": 0.0018519692950778536, "sim_compute_performance-ego1": 0.0019035968515608043}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.176061540889392, "get_ui_image": 0.029203467898898657, "step_physics": 0.2567257881164551, "survival_time": 3.5499999999999954, "driven_lanedir": 1.0594860344943808, "get_state_dump": 0.005958510769738091, "get_robot_state": 0.00691820846663581, "sim_render-ego0": 0.003612094455295139, "sim_render-ego1": 0.0036728911929660374, "get_duckie_state": 1.1490450965033638e-06, "in-drivable-lane": 0.19999999999999996, "deviation-heading": 0.8055137196732035, "agent_compute-ego0": 0.015137377712461684, "agent_compute-ego1": 0.014658696121639676, "complete-iteration": 0.35293804936938816, "set_robot_commands": 0.0022671984301673043, "deviation-center-line": 0.1727395142751548, "driven_lanedir_consec": 1.0594860344943808, "sim_compute_sim_state": 0.008589426676432291, "sim_compute_performance-ego0": 0.0018519692950778536, "sim_compute_performance-ego1": 0.0019035968515608043}}
set_robot_commands_max0.0022671984301673043
set_robot_commands_mean0.002190474365232242
set_robot_commands_median0.002181403559066274
set_robot_commands_min0.0021597181793547027
sim_compute_performance-ego0_max0.001921450134611478
sim_compute_performance-ego0_mean0.001884339815498884
sim_compute_performance-ego0_median0.0018909181443565923
sim_compute_performance-ego0_min0.0018519692950778536
sim_compute_performance-ego1_max0.0019087565206263187
sim_compute_performance-ego1_mean0.0018739956667827484
sim_compute_performance-ego1_median0.0018641970947408009
sim_compute_performance-ego1_min0.0018342327925920973
sim_compute_performance-ego2_max0.0019253479377663524
sim_compute_performance-ego2_mean0.001875922611565737
sim_compute_performance-ego2_median0.0018714535845457203
sim_compute_performance-ego2_min0.0018309663123851395
sim_compute_performance-ego3_max0.0018825215833554187
sim_compute_performance-ego3_mean0.001863835768007321
sim_compute_performance-ego3_median0.0018705347158612996
sim_compute_performance-ego3_min0.0018384510048052444
sim_compute_sim_state_max0.02478164128530452
sim_compute_sim_state_mean0.01891314898330105
sim_compute_sim_state_median0.02105465488861146
sim_compute_sim_state_min0.008589426676432291
sim_render-ego0_max0.0036772089282961656
sim_render-ego0_mean0.003628093864214053
sim_render-ego0_median0.003625810795215945
sim_render-ego0_min0.003589261573589504
sim_render-ego1_max0.0036728911929660374
sim_render-ego1_mean0.0035871398498248624
sim_render-ego1_median0.003598298848509603
sim_render-ego1_min0.003514343269487991
sim_render-ego2_max0.003611525332390057
sim_render-ego2_mean0.003562191187178314
sim_render-ego2_median0.003566978621656877
sim_render-ego2_min0.003508069607488007
sim_render-ego3_max0.003560530824201474
sim_render-ego3_mean0.003538988002388994
sim_render-ego3_median0.0035512090599449883
sim_render-ego3_min0.0035052241230205216
simulation-passed1
step_physics_max1.188530171455158
step_physics_mean0.9241648664176548
step_physics_median1.0260632717925031
step_physics_min0.2567257881164551
survival_time_max32.100000000000314
survival_time_mean20.5785714285716
survival_time_min3.5499999999999954
No reset possible