Duckietown Challenges Home Challenges Submissions

Submission 13281

Submission13281
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60500
Next
User label102-1-real
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
60500LFVmultibodyv-simsuccessyes1:18:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.346064171333577
survival_time_median43.94999999999964
deviation-center-line_median2.767557440641088
in-drivable-lane_median0.22499999999999656


other stats
agent_compute-ego0_max0.021099251319919778
agent_compute-ego0_mean0.020327257852459407
agent_compute-ego0_median0.020741531018460733
agent_compute-ego0_min0.018873353023082014
agent_compute-ego1_max0.01965933945029974
agent_compute-ego1_mean0.018157228467444737
agent_compute-ego1_median0.017646966197273947
agent_compute-ego1_min0.01745449256033919
agent_compute-ego2_max0.018103784121824115
agent_compute-ego2_mean0.017594930897010252
agent_compute-ego2_median0.01735333095897328
agent_compute-ego2_min0.01732767761023336
agent_compute-ego3_max0.01714203813102808
agent_compute-ego3_mean0.016777933903649022
agent_compute-ego3_median0.017051132158799606
agent_compute-ego3_min0.016140631421119378
complete-iteration_max1.3967738761143251
complete-iteration_mean1.141560223415887
complete-iteration_median1.2398904602179366
complete-iteration_min0.39205034635961056
deviation-center-line_max5.091772606664965
deviation-center-line_mean2.3899906285601875
deviation-center-line_min0.19314717049640728
deviation-heading_max21.95461729124515
deviation-heading_mean11.60645699661373
deviation-heading_median13.947401980311742
deviation-heading_min1.8212231023040455
driven_any_max17.756633985476693
driven_any_mean9.283154270007346
driven_any_median10.398716664341578
driven_any_min0.9998527755896452
driven_lanedir_consec_max16.017184921953877
driven_lanedir_consec_mean8.288144874665987
driven_lanedir_consec_min0.9024410698914508
driven_lanedir_max16.017184921953877
driven_lanedir_mean8.288144874665987
driven_lanedir_median9.346064171333577
driven_lanedir_min0.9024410698914508
get_duckie_state_max1.5060553389988588e-06
get_duckie_state_mean1.3829831735776862e-06
get_duckie_state_median1.3828277587890625e-06
get_duckie_state_min1.2719253609083356e-06
get_robot_state_max0.01424931220793992
get_robot_state_mean0.013063133628667888
get_robot_state_median0.0141340280121023
get_robot_state_min0.0070694624446332455
get_state_dump_max0.00962076240710998
get_state_dump_mean0.009001990812727775
get_state_dump_median0.00948907732963562
get_state_dump_min0.006166317034512758
get_ui_image_max0.051815597306598314
get_ui_image_mean0.04579495581037789
get_ui_image_median0.04795556336306454
get_ui_image_min0.03083025850355625
in-drivable-lane_max1.550000000000014
in-drivable-lane_mean0.3714285714285715
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.1235125984911525, "get_ui_image": 0.04509605541488164, "step_physics": 0.9752348882580236, "survival_time": 11.00000000000002, "driven_lanedir": 1.0965103635644473, "get_state_dump": 0.00931396959054524, "get_robot_state": 0.013802896257978758, "sim_render-ego0": 0.003645042488477888, "sim_render-ego1": 0.0036116865425627697, "sim_render-ego2": 0.003596818285290472, "sim_render-ego3": 0.0036094145537501543, "get_duckie_state": 1.2719253609083356e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.8212231023040455, "agent_compute-ego0": 0.021099251319919778, "agent_compute-ego1": 0.01745449256033919, "agent_compute-ego2": 0.01732767761023336, "agent_compute-ego3": 0.016140631421119378, "complete-iteration": 1.1627712724435384, "set_robot_commands": 0.002370896921977738, "deviation-center-line": 0.19314717049640728, "driven_lanedir_consec": 1.0965103635644473, "sim_compute_sim_state": 0.015737097727227534, "sim_compute_performance-ego0": 0.0018623090977043049, "sim_compute_performance-ego1": 0.0019356686605047856, "sim_compute_performance-ego2": 0.0018799520725578205, "sim_compute_performance-ego3": 0.0018883463484129755}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.931784474073491, "get_ui_image": 0.04509605541488164, "step_physics": 0.9752348882580236, "survival_time": 11.00000000000002, "driven_lanedir": 3.539815670473835, "get_state_dump": 0.00931396959054524, "get_robot_state": 0.013802896257978758, "sim_render-ego0": 0.003645042488477888, "sim_render-ego1": 0.0036116865425627697, "sim_render-ego2": 0.003596818285290472, "sim_render-ego3": 0.0036094145537501543, "get_duckie_state": 1.2719253609083356e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.302878332539591, "agent_compute-ego0": 0.021099251319919778, "agent_compute-ego1": 0.01745449256033919, "agent_compute-ego2": 0.01732767761023336, "agent_compute-ego3": 0.016140631421119378, "complete-iteration": 1.1627712724435384, "set_robot_commands": 0.002370896921977738, "deviation-center-line": 0.8037554419333871, "driven_lanedir_consec": 3.539815670473835, "sim_compute_sim_state": 0.015737097727227534, "sim_compute_performance-ego0": 0.0018623090977043049, "sim_compute_performance-ego1": 0.0019356686605047856, "sim_compute_performance-ego2": 0.0018799520725578205, "sim_compute_performance-ego3": 0.0018883463484129755}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.1221209266192864, "get_ui_image": 0.04509605541488164, "step_physics": 0.9752348882580236, "survival_time": 11.00000000000002, "driven_lanedir": 3.001167488079, "get_state_dump": 0.00931396959054524, "get_robot_state": 0.013802896257978758, "sim_render-ego0": 0.003645042488477888, "sim_render-ego1": 0.0036116865425627697, "sim_render-ego2": 0.003596818285290472, "sim_render-ego3": 0.0036094145537501543, "get_duckie_state": 1.2719253609083356e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.4981265434442155, "agent_compute-ego0": 0.021099251319919778, "agent_compute-ego1": 0.01745449256033919, "agent_compute-ego2": 0.01732767761023336, "agent_compute-ego3": 0.016140631421119378, "complete-iteration": 1.1627712724435384, "set_robot_commands": 0.002370896921977738, "deviation-center-line": 0.9027631379466564, "driven_lanedir_consec": 3.001167488079, "sim_compute_sim_state": 0.015737097727227534, "sim_compute_performance-ego0": 0.0018623090977043049, "sim_compute_performance-ego1": 0.0019356686605047856, "sim_compute_performance-ego2": 0.0018799520725578205, "sim_compute_performance-ego3": 0.0018883463484129755}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 0.9998527755896452, "get_ui_image": 0.04509605541488164, "step_physics": 0.9752348882580236, "survival_time": 11.00000000000002, "driven_lanedir": 0.9024410698914508, "get_state_dump": 0.00931396959054524, "get_robot_state": 0.013802896257978758, "sim_render-ego0": 0.003645042488477888, "sim_render-ego1": 0.0036116865425627697, "sim_render-ego2": 0.003596818285290472, "sim_render-ego3": 0.0036094145537501543, "get_duckie_state": 1.2719253609083356e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.0576258414322375, "agent_compute-ego0": 0.021099251319919778, "agent_compute-ego1": 0.01745449256033919, "agent_compute-ego2": 0.01732767761023336, "agent_compute-ego3": 0.016140631421119378, "complete-iteration": 1.1627712724435384, "set_robot_commands": 0.002370896921977738, "deviation-center-line": 1.6947762405214586, "driven_lanedir_consec": 0.9024410698914508, "sim_compute_sim_state": 0.015737097727227534, "sim_compute_performance-ego0": 0.0018623090977043049, "sim_compute_performance-ego1": 0.0019356686605047856, "sim_compute_performance-ego2": 0.0018799520725578205, "sim_compute_performance-ego3": 0.0018883463484129755}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 4.910361135413234, "get_ui_image": 0.051815597306598314, "step_physics": 1.1868406653404235, "survival_time": 43.94999999999964, "driven_lanedir": 4.00840237184732, "get_state_dump": 0.00948907732963562, "get_robot_state": 0.0141340280121023, "sim_render-ego0": 0.003769437020475214, "sim_render-ego1": 0.0036971598863601686, "sim_render-ego2": 0.003673701123757796, "sim_render-ego3": 0.003658150813796304, "get_duckie_state": 1.3828277587890625e-06, "in-drivable-lane": 0.6999999999999975, "deviation-heading": 14.37858468173922, "agent_compute-ego0": 0.01986794363368641, "agent_compute-ego1": 0.017646966197273947, "agent_compute-ego2": 0.01735333095897328, "agent_compute-ego3": 0.017051132158799606, "complete-iteration": 1.3967738761143251, "set_robot_commands": 0.0022987845269116488, "deviation-center-line": 2.848860806140135, "driven_lanedir_consec": 4.00840237184732, "sim_compute_sim_state": 0.030339754711497913, "sim_compute_performance-ego0": 0.001950406486337835, "sim_compute_performance-ego1": 0.001986664533615112, "sim_compute_performance-ego2": 0.001973725448955189, "sim_compute_performance-ego3": 0.0019286199049516155}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 5.215683261865313, "get_ui_image": 0.051815597306598314, "step_physics": 1.1868406653404235, "survival_time": 43.94999999999964, "driven_lanedir": 4.4959421284923184, "get_state_dump": 0.00948907732963562, "get_robot_state": 0.0141340280121023, "sim_render-ego0": 0.003769437020475214, "sim_render-ego1": 0.0036971598863601686, "sim_render-ego2": 0.003673701123757796, "sim_render-ego3": 0.003658150813796304, "get_duckie_state": 1.3828277587890625e-06, "in-drivable-lane": 0.6499999999999977, "deviation-heading": 21.95461729124515, "agent_compute-ego0": 0.01986794363368641, "agent_compute-ego1": 0.017646966197273947, "agent_compute-ego2": 0.01735333095897328, "agent_compute-ego3": 0.017051132158799606, "complete-iteration": 1.3967738761143251, "set_robot_commands": 0.0022987845269116488, "deviation-center-line": 5.091772606664965, "driven_lanedir_consec": 4.4959421284923184, "sim_compute_sim_state": 0.030339754711497913, "sim_compute_performance-ego0": 0.001950406486337835, "sim_compute_performance-ego1": 0.001986664533615112, "sim_compute_performance-ego2": 0.001973725448955189, "sim_compute_performance-ego3": 0.0019286199049516155}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 14.396360468444112, "get_ui_image": 0.051815597306598314, "step_physics": 1.1868406653404235, "survival_time": 43.94999999999964, "driven_lanedir": 12.655911459208044, "get_state_dump": 0.00948907732963562, "get_robot_state": 0.0141340280121023, "sim_render-ego0": 0.003769437020475214, "sim_render-ego1": 0.0036971598863601686, "sim_render-ego2": 0.003673701123757796, "sim_render-ego3": 0.003658150813796304, "get_duckie_state": 1.3828277587890625e-06, "in-drivable-lane": 0.3500000000000014, "deviation-heading": 16.305945017356283, "agent_compute-ego0": 0.01986794363368641, "agent_compute-ego1": 0.017646966197273947, "agent_compute-ego2": 0.01735333095897328, "agent_compute-ego3": 0.017051132158799606, "complete-iteration": 1.3967738761143251, "set_robot_commands": 0.0022987845269116488, "deviation-center-line": 3.2687352684473794, "driven_lanedir_consec": 12.655911459208044, "sim_compute_sim_state": 0.030339754711497913, "sim_compute_performance-ego0": 0.001950406486337835, "sim_compute_performance-ego1": 0.001986664533615112, "sim_compute_performance-ego2": 0.001973725448955189, "sim_compute_performance-ego3": 0.0019286199049516155}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 17.367975154684157, "get_ui_image": 0.051815597306598314, "step_physics": 1.1868406653404235, "survival_time": 43.94999999999964, "driven_lanedir": 15.32722400026308, "get_state_dump": 0.00948907732963562, "get_robot_state": 0.0141340280121023, "sim_render-ego0": 0.003769437020475214, "sim_render-ego1": 0.0036971598863601686, "sim_render-ego2": 0.003673701123757796, "sim_render-ego3": 0.003658150813796304, "get_duckie_state": 1.3828277587890625e-06, "in-drivable-lane": 0.6499999999999888, "deviation-heading": 17.527889632049757, "agent_compute-ego0": 0.01986794363368641, "agent_compute-ego1": 0.017646966197273947, "agent_compute-ego2": 0.01735333095897328, "agent_compute-ego3": 0.017051132158799606, "complete-iteration": 1.3967738761143251, "set_robot_commands": 0.0022987845269116488, "deviation-center-line": 3.23080104120846, "driven_lanedir_consec": 15.32722400026308, "sim_compute_sim_state": 0.030339754711497913, "sim_compute_performance-ego0": 0.001950406486337835, "sim_compute_performance-ego1": 0.001986664533615112, "sim_compute_performance-ego2": 0.001973725448955189, "sim_compute_performance-ego3": 0.0019286199049516155}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 13.980582918750509, "get_ui_image": 0.04795556336306454, "step_physics": 1.023984700106503, "survival_time": 44.44999999999961, "driven_lanedir": 12.482941148403748, "get_state_dump": 0.00962076240710998, "get_robot_state": 0.01424931220793992, "sim_render-ego0": 0.003787145989664485, "sim_render-ego1": 0.003749610868732581, "sim_render-ego2": 0.003746861018491595, "sim_render-ego3": 0.003691744268610236, "get_duckie_state": 1.5060553389988588e-06, "in-drivable-lane": 0.8500000000000094, "deviation-heading": 14.640421795494506, "agent_compute-ego0": 0.020741531018460733, "agent_compute-ego1": 0.01861917115329357, "agent_compute-ego2": 0.018103784121824115, "agent_compute-ego3": 0.01714203813102808, "complete-iteration": 1.2398904602179366, "set_robot_commands": 0.0022726281305377404, "deviation-center-line": 2.686254075142042, "driven_lanedir_consec": 12.482941148403748, "sim_compute_sim_state": 0.037224725123201866, "sim_compute_performance-ego0": 0.0020458224114407314, "sim_compute_performance-ego1": 0.001993496230479037, "sim_compute_performance-ego2": 0.0019886247227700908, "sim_compute_performance-ego3": 0.0019615395685260214}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 13.037915453864889, "get_ui_image": 0.04795556336306454, "step_physics": 1.023984700106503, "survival_time": 44.44999999999961, "driven_lanedir": 11.743403973554246, "get_state_dump": 0.00962076240710998, "get_robot_state": 0.01424931220793992, "sim_render-ego0": 0.003787145989664485, "sim_render-ego1": 0.003749610868732581, "sim_render-ego2": 0.003746861018491595, "sim_render-ego3": 0.003691744268610236, "get_duckie_state": 1.5060553389988588e-06, "in-drivable-lane": 0.0, "deviation-heading": 17.186136921465554, "agent_compute-ego0": 0.020741531018460733, "agent_compute-ego1": 0.01861917115329357, "agent_compute-ego2": 0.018103784121824115, "agent_compute-ego3": 0.01714203813102808, "complete-iteration": 1.2398904602179366, "set_robot_commands": 0.0022726281305377404, "deviation-center-line": 3.5609588117717466, "driven_lanedir_consec": 11.743403973554246, "sim_compute_sim_state": 0.037224725123201866, "sim_compute_performance-ego0": 0.0020458224114407314, "sim_compute_performance-ego1": 0.001993496230479037, "sim_compute_performance-ego2": 0.0019886247227700908, "sim_compute_performance-ego3": 0.0019615395685260214}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 17.756633985476693, "get_ui_image": 0.04795556336306454, "step_physics": 1.023984700106503, "survival_time": 44.44999999999961, "driven_lanedir": 16.017184921953877, "get_state_dump": 0.00962076240710998, "get_robot_state": 0.01424931220793992, "sim_render-ego0": 0.003787145989664485, "sim_render-ego1": 0.003749610868732581, "sim_render-ego2": 0.003746861018491595, "sim_render-ego3": 0.003691744268610236, "get_duckie_state": 1.5060553389988588e-06, "in-drivable-lane": 0.2999999999999936, "deviation-heading": 16.273044492059, "agent_compute-ego0": 0.020741531018460733, "agent_compute-ego1": 0.01861917115329357, "agent_compute-ego2": 0.018103784121824115, "agent_compute-ego3": 0.01714203813102808, "complete-iteration": 1.2398904602179366, "set_robot_commands": 0.0022726281305377404, "deviation-center-line": 3.0177861692445775, "driven_lanedir_consec": 16.017184921953877, "sim_compute_sim_state": 0.037224725123201866, "sim_compute_performance-ego0": 0.0020458224114407314, "sim_compute_performance-ego1": 0.001993496230479037, "sim_compute_performance-ego2": 0.0019886247227700908, "sim_compute_performance-ego3": 0.0019615395685260214}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 13.323943298147192, "get_ui_image": 0.04795556336306454, "step_physics": 1.023984700106503, "survival_time": 44.44999999999961, "driven_lanedir": 12.070955306925308, "get_state_dump": 0.00962076240710998, "get_robot_state": 0.01424931220793992, "sim_render-ego0": 0.003787145989664485, "sim_render-ego1": 0.003749610868732581, "sim_render-ego2": 0.003746861018491595, "sim_render-ego3": 0.003691744268610236, "get_duckie_state": 1.5060553389988588e-06, "in-drivable-lane": 0.14999999999999947, "deviation-heading": 13.516219278884265, "agent_compute-ego0": 0.020741531018460733, "agent_compute-ego1": 0.01861917115329357, "agent_compute-ego2": 0.018103784121824115, "agent_compute-ego3": 0.01714203813102808, "complete-iteration": 1.2398904602179366, "set_robot_commands": 0.0022726281305377404, "deviation-center-line": 3.126935587600478, "driven_lanedir_consec": 12.070955306925308, "sim_compute_sim_state": 0.037224725123201866, "sim_compute_performance-ego0": 0.0020458224114407314, "sim_compute_performance-ego1": 0.001993496230479037, "sim_compute_performance-ego2": 0.0019886247227700908, "sim_compute_performance-ego3": 0.0019615395685260214}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 10.19059216054004, "get_ui_image": 0.03083025850355625, "step_physics": 0.28357711201533675, "survival_time": 25.550000000000228, "driven_lanedir": 8.56856847366358, "get_state_dump": 0.006166317034512758, "get_robot_state": 0.0070694624446332455, "sim_render-ego0": 0.003648878075182438, "sim_render-ego1": 0.003606281243264675, "get_duckie_state": 1.3592652976512909e-06, "in-drivable-lane": 1.550000000000014, "deviation-heading": 9.612867212583884, "agent_compute-ego0": 0.018873353023082014, "agent_compute-ego1": 0.01965933945029974, "complete-iteration": 0.39205034635961056, "set_robot_commands": 0.0022427919320762157, "deviation-center-line": 1.6796378316636549, "driven_lanedir_consec": 8.56856847366358, "sim_compute_sim_state": 0.0102559351362288, "sim_compute_performance-ego0": 0.0018944786861538887, "sim_compute_performance-ego1": 0.0019058343023061752}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 10.606841168143117, "get_ui_image": 0.03083025850355625, "step_physics": 0.28357711201533675, "survival_time": 25.550000000000228, "driven_lanedir": 10.123559869003572, "get_state_dump": 0.006166317034512758, "get_robot_state": 0.0070694624446332455, "sim_render-ego0": 0.003648878075182438, "sim_render-ego1": 0.003606281243264675, "get_duckie_state": 1.3592652976512909e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.414817809994491, "agent_compute-ego0": 0.018873353023082014, "agent_compute-ego1": 0.01965933945029974, "complete-iteration": 0.39205034635961056, "set_robot_commands": 0.0022427919320762157, "deviation-center-line": 1.353684611061277, "driven_lanedir_consec": 10.123559869003572, "sim_compute_sim_state": 0.0102559351362288, "sim_compute_performance-ego0": 0.0018944786861538887, "sim_compute_performance-ego1": 0.0019058343023061752}}
set_robot_commands_max0.002370896921977738
set_robot_commands_mean0.002303915870132924
set_robot_commands_median0.0022987845269116488
set_robot_commands_min0.0022427919320762157
sim_compute_performance-ego0_max0.0020458224114407314
sim_compute_performance-ego0_mean0.0019445078110170903
sim_compute_performance-ego0_median0.001950406486337835
sim_compute_performance-ego0_min0.0018623090977043049
sim_compute_performance-ego1_max0.001993496230479037
sim_compute_performance-ego1_mean0.0019624990216434344
sim_compute_performance-ego1_median0.001986664533615112
sim_compute_performance-ego1_min0.0019058343023061752
sim_compute_performance-ego2_max0.0019886247227700908
sim_compute_performance-ego2_mean0.0019474340814277004
sim_compute_performance-ego2_median0.001973725448955189
sim_compute_performance-ego2_min0.0018799520725578205
sim_compute_performance-ego3_max0.0019615395685260214
sim_compute_performance-ego3_mean0.0019261686072968712
sim_compute_performance-ego3_median0.0019286199049516155
sim_compute_performance-ego3_min0.0018883463484129755
sim_compute_sim_state_max0.037224725123201866
sim_compute_sim_state_mean0.025265584322869055
sim_compute_sim_state_median0.030339754711497913
sim_compute_sim_state_min0.0102559351362288
sim_render-ego0_max0.003787145989664485
sim_render-ego0_mean0.003721732724631089
sim_render-ego0_median0.003769437020475214
sim_render-ego0_min0.003645042488477888
sim_render-ego1_max0.003749610868732581
sim_render-ego1_mean0.0036747422626536726
sim_render-ego1_median0.0036971598863601686
sim_render-ego1_min0.003606281243264675
sim_render-ego2_max0.003746861018491595
sim_render-ego2_mean0.003672460142513288
sim_render-ego2_median0.003673701123757796
sim_render-ego2_min0.003596818285290472
sim_render-ego3_max0.003691744268610236
sim_render-ego3_mean0.0036531032120522312
sim_render-ego3_median0.003658150813796304
sim_render-ego3_min0.0036094145537501543
simulation-passed1
step_physics_max1.1868406653404235
step_physics_mean0.9508139456321768
step_physics_median1.023984700106503
step_physics_min0.28357711201533675
survival_time_max44.44999999999961
survival_time_mean32.04999999999982
survival_time_min11.00000000000002
No reset possible