Duckietown Challenges Home Challenges Submissions

Submission 13281

Submission13281
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60500
Next
User label102-1-real
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
60500LFVmultibodyv-simsuccessyes1:18:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.346064171333577
survival_time_median43.94999999999964
deviation-center-line_median2.767557440641088
in-drivable-lane_median0.22499999999999656


other stats
agent_compute-ego0_max0.021099251319919778
agent_compute-ego0_mean0.020327257852459407
agent_compute-ego0_median0.020741531018460733
agent_compute-ego0_min0.018873353023082014
agent_compute-ego1_max0.01965933945029974
agent_compute-ego1_mean0.018157228467444737
agent_compute-ego1_median0.017646966197273947
agent_compute-ego1_min0.01745449256033919
agent_compute-ego2_max0.018103784121824115
agent_compute-ego2_mean0.017594930897010252
agent_compute-ego2_median0.01735333095897328
agent_compute-ego2_min0.01732767761023336
agent_compute-ego3_max0.01714203813102808
agent_compute-ego3_mean0.016777933903649022
agent_compute-ego3_median0.017051132158799606
agent_compute-ego3_min0.016140631421119378
complete-iteration_max1.3967738761143251
complete-iteration_mean1.141560223415887
complete-iteration_median1.2398904602179366
complete-iteration_min0.39205034635961056
deviation-center-line_max5.091772606664965
deviation-center-line_mean2.3899906285601875
deviation-center-line_min0.19314717049640728
deviation-heading_max21.95461729124515
deviation-heading_mean11.60645699661373
deviation-heading_median13.947401980311742
deviation-heading_min1.8212231023040455
driven_any_max17.756633985476693
driven_any_mean9.283154270007346
driven_any_median10.398716664341578
driven_any_min0.9998527755896452
driven_lanedir_consec_max16.017184921953877
driven_lanedir_consec_mean8.288144874665987
driven_lanedir_consec_min0.9024410698914508
driven_lanedir_max16.017184921953877
driven_lanedir_mean8.288144874665987
driven_lanedir_median9.346064171333577
driven_lanedir_min0.9024410698914508
get_duckie_state_max1.5060553389988588e-06
get_duckie_state_mean1.3829831735776862e-06
get_duckie_state_median1.3828277587890625e-06
get_duckie_state_min1.2719253609083356e-06
get_robot_state_max0.01424931220793992
get_robot_state_mean0.013063133628667888
get_robot_state_median0.0141340280121023
get_robot_state_min0.0070694624446332455
get_state_dump_max0.00962076240710998
get_state_dump_mean0.009001990812727775
get_state_dump_median0.00948907732963562
get_state_dump_min0.006166317034512758
get_ui_image_max0.051815597306598314
get_ui_image_mean0.04579495581037789
get_ui_image_median0.04795556336306454
get_ui_image_min0.03083025850355625
in-drivable-lane_max1.550000000000014
in-drivable-lane_mean0.3714285714285715
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.1235125984911525, "get_ui_image": 0.04509605541488164, "step_physics": 0.9752348882580236, "survival_time": 11.00000000000002, "driven_lanedir": 1.0965103635644473, "get_state_dump": 0.00931396959054524, "get_robot_state": 0.013802896257978758, "sim_render-ego0": 0.003645042488477888, "sim_render-ego1": 0.0036116865425627697, "sim_render-ego2": 0.003596818285290472, "sim_render-ego3": 0.0036094145537501543, "get_duckie_state": 1.2719253609083356e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.8212231023040455, "agent_compute-ego0": 0.021099251319919778, "agent_compute-ego1": 0.01745449256033919, "agent_compute-ego2": 0.01732767761023336, "agent_compute-ego3": 0.016140631421119378, "complete-iteration": 1.1627712724435384, "set_robot_commands": 0.002370896921977738, "deviation-center-line": 0.19314717049640728, "driven_lanedir_consec": 1.0965103635644473, "sim_compute_sim_state": 0.015737097727227534, "sim_compute_performance-ego0": 0.0018623090977043049, "sim_compute_performance-ego1": 0.0019356686605047856, "sim_compute_performance-ego2": 0.0018799520725578205, "sim_compute_performance-ego3": 0.0018883463484129755}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.931784474073491, "get_ui_image": 0.04509605541488164, "step_physics": 0.9752348882580236, "survival_time": 11.00000000000002, "driven_lanedir": 3.539815670473835, "get_state_dump": 0.00931396959054524, "get_robot_state": 0.013802896257978758, "sim_render-ego0": 0.003645042488477888, "sim_render-ego1": 0.0036116865425627697, "sim_render-ego2": 0.003596818285290472, "sim_render-ego3": 0.0036094145537501543, "get_duckie_state": 1.2719253609083356e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.302878332539591, "agent_compute-ego0": 0.021099251319919778, "agent_compute-ego1": 0.01745449256033919, "agent_compute-ego2": 0.01732767761023336, "agent_compute-ego3": 0.016140631421119378, "complete-iteration": 1.1627712724435384, "set_robot_commands": 0.002370896921977738, "deviation-center-line": 0.8037554419333871, "driven_lanedir_consec": 3.539815670473835, "sim_compute_sim_state": 0.015737097727227534, "sim_compute_performance-ego0": 0.0018623090977043049, "sim_compute_performance-ego1": 0.0019356686605047856, "sim_compute_performance-ego2": 0.0018799520725578205, "sim_compute_performance-ego3": 0.0018883463484129755}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.1221209266192864, "get_ui_image": 0.04509605541488164, "step_physics": 0.9752348882580236, "survival_time": 11.00000000000002, "driven_lanedir": 3.001167488079, "get_state_dump": 0.00931396959054524, "get_robot_state": 0.013802896257978758, "sim_render-ego0": 0.003645042488477888, "sim_render-ego1": 0.0036116865425627697, "sim_render-ego2": 0.003596818285290472, "sim_render-ego3": 0.0036094145537501543, "get_duckie_state": 1.2719253609083356e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.4981265434442155, "agent_compute-ego0": 0.021099251319919778, "agent_compute-ego1": 0.01745449256033919, "agent_compute-ego2": 0.01732767761023336, "agent_compute-ego3": 0.016140631421119378, "complete-iteration": 1.1627712724435384, "set_robot_commands": 0.002370896921977738, "deviation-center-line": 0.9027631379466564, "driven_lanedir_consec": 3.001167488079, "sim_compute_sim_state": 0.015737097727227534, "sim_compute_performance-ego0": 0.0018623090977043049, "sim_compute_performance-ego1": 0.0019356686605047856, "sim_compute_performance-ego2": 0.0018799520725578205, "sim_compute_performance-ego3": 0.0018883463484129755}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 0.9998527755896452, "get_ui_image": 0.04509605541488164, "step_physics": 0.9752348882580236, "survival_time": 11.00000000000002, "driven_lanedir": 0.9024410698914508, "get_state_dump": 0.00931396959054524, "get_robot_state": 0.013802896257978758, "sim_render-ego0": 0.003645042488477888, "sim_render-ego1": 0.0036116865425627697, "sim_render-ego2": 0.003596818285290472, "sim_render-ego3": 0.0036094145537501543, "get_duckie_state": 1.2719253609083356e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.0576258414322375, "agent_compute-ego0": 0.021099251319919778, "agent_compute-ego1": 0.01745449256033919, "agent_compute-ego2": 0.01732767761023336, "agent_compute-ego3": 0.016140631421119378, "complete-iteration": 1.1627712724435384, "set_robot_commands": 0.002370896921977738, "deviation-center-line": 1.6947762405214586, "driven_lanedir_consec": 0.9024410698914508, "sim_compute_sim_state": 0.015737097727227534, "sim_compute_performance-ego0": 0.0018623090977043049, "sim_compute_performance-ego1": 0.0019356686605047856, "sim_compute_performance-ego2": 0.0018799520725578205, "sim_compute_performance-ego3": 0.0018883463484129755}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 4.910361135413234, "get_ui_image": 0.051815597306598314, "step_physics": 1.1868406653404235, "survival_time": 43.94999999999964, "driven_lanedir": 4.00840237184732, "get_state_dump": 0.00948907732963562, "get_robot_state": 0.0141340280121023, "sim_render-ego0": 0.003769437020475214, "sim_render-ego1": 0.0036971598863601686, "sim_render-ego2": 0.003673701123757796, "sim_render-ego3": 0.003658150813796304, "get_duckie_state": 1.3828277587890625e-06, "in-drivable-lane": 0.6999999999999975, "deviation-heading": 14.37858468173922, "agent_compute-ego0": 0.01986794363368641, "agent_compute-ego1": 0.017646966197273947, "agent_compute-ego2": 0.01735333095897328, "agent_compute-ego3": 0.017051132158799606, "complete-iteration": 1.3967738761143251, "set_robot_commands": 0.0022987845269116488, "deviation-center-line": 2.848860806140135, "driven_lanedir_consec": 4.00840237184732, "sim_compute_sim_state": 0.030339754711497913, "sim_compute_performance-ego0": 0.001950406486337835, "sim_compute_performance-ego1": 0.001986664533615112, "sim_compute_performance-ego2": 0.001973725448955189, "sim_compute_performance-ego3": 0.0019286199049516155}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 5.215683261865313, "get_ui_image": 0.051815597306598314, "step_physics": 1.1868406653404235, "survival_time": 43.94999999999964, "driven_lanedir": 4.4959421284923184, "get_state_dump": 0.00948907732963562, "get_robot_state": 0.0141340280121023, "sim_render-ego0": 0.003769437020475214, "sim_render-ego1": 0.0036971598863601686, "sim_render-ego2": 0.003673701123757796, "sim_render-ego3": 0.003658150813796304, "get_duckie_state": 1.3828277587890625e-06, "in-drivable-lane": 0.6499999999999977, "deviation-heading": 21.95461729124515, "agent_compute-ego0": 0.01986794363368641, "agent_compute-ego1": 0.017646966197273947, "agent_compute-ego2": 0.01735333095897328, "agent_compute-ego3": 0.017051132158799606, "complete-iteration": 1.3967738761143251, "set_robot_commands": 0.0022987845269116488, "deviation-center-line": 5.091772606664965, "driven_lanedir_consec": 4.4959421284923184, "sim_compute_sim_state": 0.030339754711497913, "sim_compute_performance-ego0": 0.001950406486337835, "sim_compute_performance-ego1": 0.001986664533615112, "sim_compute_performance-ego2": 0.001973725448955189, "sim_compute_performance-ego3": 0.0019286199049516155}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 14.396360468444112, "get_ui_image": 0.051815597306598314, "step_physics": 1.1868406653404235, "survival_time": 43.94999999999964, "driven_lanedir": 12.655911459208044, "get_state_dump": 0.00948907732963562, "get_robot_state": 0.0141340280121023, "sim_render-ego0": 0.003769437020475214, "sim_render-ego1": 0.0036971598863601686, "sim_render-ego2": 0.003673701123757796, "sim_render-ego3": 0.003658150813796304, "get_duckie_state": 1.3828277587890625e-06, "in-drivable-lane": 0.3500000000000014, "deviation-heading": 16.305945017356283, "agent_compute-ego0": 0.01986794363368641, "agent_compute-ego1": 0.017646966197273947, "agent_compute-ego2": 0.01735333095897328, "agent_compute-ego3": 0.017051132158799606, "complete-iteration": 1.3967738761143251, "set_robot_commands": 0.0022987845269116488, "deviation-center-line": 3.2687352684473794, "driven_lanedir_consec": 12.655911459208044, "sim_compute_sim_state": 0.030339754711497913, "sim_compute_performance-ego0": 0.001950406486337835, "sim_compute_performance-ego1": 0.001986664533615112, "sim_compute_performance-ego2": 0.001973725448955189, "sim_compute_performance-ego3": 0.0019286199049516155}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 17.367975154684157, "get_ui_image": 0.051815597306598314, "step_physics": 1.1868406653404235, "survival_time": 43.94999999999964, "driven_lanedir": 15.32722400026308, "get_state_dump": 0.00948907732963562, "get_robot_state": 0.0141340280121023, "sim_render-ego0": 0.003769437020475214, "sim_render-ego1": 0.0036971598863601686, "sim_render-ego2": 0.003673701123757796, "sim_render-ego3": 0.003658150813796304, "get_duckie_state": 1.3828277587890625e-06, "in-drivable-lane": 0.6499999999999888, "deviation-heading": 17.527889632049757, "agent_compute-ego0": 0.01986794363368641, "agent_compute-ego1": 0.017646966197273947, "agent_compute-ego2": 0.01735333095897328, "agent_compute-ego3": 0.017051132158799606, "complete-iteration": 1.3967738761143251, "set_robot_commands": 0.0022987845269116488, "deviation-center-line": 3.23080104120846, "driven_lanedir_consec": 15.32722400026308, "sim_compute_sim_state": 0.030339754711497913, "sim_compute_performance-ego0": 0.001950406486337835, "sim_compute_performance-ego1": 0.001986664533615112, "sim_compute_performance-ego2": 0.001973725448955189, "sim_compute_performance-ego3": 0.0019286199049516155}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 13.980582918750509, "get_ui_image": 0.04795556336306454, "step_physics": 1.023984700106503, "survival_time": 44.44999999999961, "driven_lanedir": 12.482941148403748, "get_state_dump": 0.00962076240710998, "get_robot_state": 0.01424931220793992, "sim_render-ego0": 0.003787145989664485, "sim_render-ego1": 0.003749610868732581, "sim_render-ego2": 0.003746861018491595, "sim_render-ego3": 0.003691744268610236, "get_duckie_state": 1.5060553389988588e-06, "in-drivable-lane": 0.8500000000000094, "deviation-heading": 14.640421795494506, "agent_compute-ego0": 0.020741531018460733, "agent_compute-ego1": 0.01861917115329357, "agent_compute-ego2": 0.018103784121824115, "agent_compute-ego3": 0.01714203813102808, "complete-iteration": 1.2398904602179366, "set_robot_commands": 0.0022726281305377404, "deviation-center-line": 2.686254075142042, "driven_lanedir_consec": 12.482941148403748, "sim_compute_sim_state": 0.037224725123201866, "sim_compute_performance-ego0": 0.0020458224114407314, "sim_compute_performance-ego1": 0.001993496230479037, "sim_compute_performance-ego2": 0.0019886247227700908, "sim_compute_performance-ego3": 0.0019615395685260214}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 13.037915453864889, "get_ui_image": 0.04795556336306454, "step_physics": 1.023984700106503, "survival_time": 44.44999999999961, "driven_lanedir": 11.743403973554246, "get_state_dump": 0.00962076240710998, "get_robot_state": 0.01424931220793992, "sim_render-ego0": 0.003787145989664485, "sim_render-ego1": 0.003749610868732581, "sim_render-ego2": 0.003746861018491595, "sim_render-ego3": 0.003691744268610236, "get_duckie_state": 1.5060553389988588e-06, "in-drivable-lane": 0.0, "deviation-heading": 17.186136921465554, "agent_compute-ego0": 0.020741531018460733, "agent_compute-ego1": 0.01861917115329357, "agent_compute-ego2": 0.018103784121824115, "agent_compute-ego3": 0.01714203813102808, "complete-iteration": 1.2398904602179366, "set_robot_commands": 0.0022726281305377404, "deviation-center-line": 3.5609588117717466, "driven_lanedir_consec": 11.743403973554246, "sim_compute_sim_state": 0.037224725123201866, "sim_compute_performance-ego0": 0.0020458224114407314, "sim_compute_performance-ego1": 0.001993496230479037, "sim_compute_performance-ego2": 0.0019886247227700908, "sim_compute_performance-ego3": 0.0019615395685260214}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 17.756633985476693, "get_ui_image": 0.04795556336306454, "step_physics": 1.023984700106503, "survival_time": 44.44999999999961, "driven_lanedir": 16.017184921953877, "get_state_dump": 0.00962076240710998, "get_robot_state": 0.01424931220793992, "sim_render-ego0": 0.003787145989664485, "sim_render-ego1": 0.003749610868732581, "sim_render-ego2": 0.003746861018491595, "sim_render-ego3": 0.003691744268610236, "get_duckie_state": 1.5060553389988588e-06, "in-drivable-lane": 0.2999999999999936, "deviation-heading": 16.273044492059, "agent_compute-ego0": 0.020741531018460733, "agent_compute-ego1": 0.01861917115329357, "agent_compute-ego2": 0.018103784121824115, "agent_compute-ego3": 0.01714203813102808, "complete-iteration": 1.2398904602179366, "set_robot_commands": 0.0022726281305377404, "deviation-center-line": 3.0177861692445775, "driven_lanedir_consec": 16.017184921953877, "sim_compute_sim_state": 0.037224725123201866, "sim_compute_performance-ego0": 0.0020458224114407314, "sim_compute_performance-ego1": 0.001993496230479037, "sim_compute_performance-ego2": 0.0019886247227700908, "sim_compute_performance-ego3": 0.0019615395685260214}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 13.323943298147192, "get_ui_image": 0.04795556336306454, "step_physics": 1.023984700106503, "survival_time": 44.44999999999961, "driven_lanedir": 12.070955306925308, "get_state_dump": 0.00962076240710998, "get_robot_state": 0.01424931220793992, "sim_render-ego0": 0.003787145989664485, "sim_render-ego1": 0.003749610868732581, "sim_render-ego2": 0.003746861018491595, "sim_render-ego3": 0.003691744268610236, "get_duckie_state": 1.5060553389988588e-06, "in-drivable-lane": 0.14999999999999947, "deviation-heading": 13.516219278884265, "agent_compute-ego0": 0.020741531018460733, "agent_compute-ego1": 0.01861917115329357, "agent_compute-ego2": 0.018103784121824115, "agent_compute-ego3": 0.01714203813102808, "complete-iteration": 1.2398904602179366, "set_robot_commands": 0.0022726281305377404, "deviation-center-line": 3.126935587600478, "driven_lanedir_consec": 12.070955306925308, "sim_compute_sim_state": 0.037224725123201866, "sim_compute_performance-ego0": 0.0020458224114407314, "sim_compute_performance-ego1": 0.001993496230479037, "sim_compute_performance-ego2": 0.0019886247227700908, "sim_compute_performance-ego3": 0.0019615395685260214}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 10.19059216054004, "get_ui_image": 0.03083025850355625, "step_physics": 0.28357711201533675, "survival_time": 25.550000000000228, "driven_lanedir": 8.56856847366358, "get_state_dump": 0.006166317034512758, "get_robot_state": 0.0070694624446332455, "sim_render-ego0": 0.003648878075182438, "sim_render-ego1": 0.003606281243264675, "get_duckie_state": 1.3592652976512909e-06, "in-drivable-lane": 1.550000000000014, "deviation-heading": 9.612867212583884, "agent_compute-ego0": 0.018873353023082014, "agent_compute-ego1": 0.01965933945029974, "complete-iteration": 0.39205034635961056, "set_robot_commands": 0.0022427919320762157, "deviation-center-line": 1.6796378316636549, "driven_lanedir_consec": 8.56856847366358, "sim_compute_sim_state": 0.0102559351362288, "sim_compute_performance-ego0": 0.0018944786861538887, "sim_compute_performance-ego1": 0.0019058343023061752}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 10.606841168143117, "get_ui_image": 0.03083025850355625, "step_physics": 0.28357711201533675, "survival_time": 25.550000000000228, "driven_lanedir": 10.123559869003572, "get_state_dump": 0.006166317034512758, "get_robot_state": 0.0070694624446332455, "sim_render-ego0": 0.003648878075182438, "sim_render-ego1": 0.003606281243264675, "get_duckie_state": 1.3592652976512909e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.414817809994491, "agent_compute-ego0": 0.018873353023082014, "agent_compute-ego1": 0.01965933945029974, "complete-iteration": 0.39205034635961056, "set_robot_commands": 0.0022427919320762157, "deviation-center-line": 1.353684611061277, "driven_lanedir_consec": 10.123559869003572, "sim_compute_sim_state": 0.0102559351362288, "sim_compute_performance-ego0": 0.0018944786861538887, "sim_compute_performance-ego1": 0.0019058343023061752}}
set_robot_commands_max0.002370896921977738
set_robot_commands_mean0.002303915870132924
set_robot_commands_median0.0022987845269116488
set_robot_commands_min0.0022427919320762157
sim_compute_performance-ego0_max0.0020458224114407314
sim_compute_performance-ego0_mean0.0019445078110170903
sim_compute_performance-ego0_median0.001950406486337835
sim_compute_performance-ego0_min0.0018623090977043049
sim_compute_performance-ego1_max0.001993496230479037
sim_compute_performance-ego1_mean0.0019624990216434344
sim_compute_performance-ego1_median0.001986664533615112
sim_compute_performance-ego1_min0.0019058343023061752
sim_compute_performance-ego2_max0.0019886247227700908
sim_compute_performance-ego2_mean0.0019474340814277004
sim_compute_performance-ego2_median0.001973725448955189
sim_compute_performance-ego2_min0.0018799520725578205
sim_compute_performance-ego3_max0.0019615395685260214
sim_compute_performance-ego3_mean0.0019261686072968712
sim_compute_performance-ego3_median0.0019286199049516155
sim_compute_performance-ego3_min0.0018883463484129755
sim_compute_sim_state_max0.037224725123201866
sim_compute_sim_state_mean0.025265584322869055
sim_compute_sim_state_median0.030339754711497913
sim_compute_sim_state_min0.0102559351362288
sim_render-ego0_max0.003787145989664485
sim_render-ego0_mean0.003721732724631089
sim_render-ego0_median0.003769437020475214
sim_render-ego0_min0.003645042488477888
sim_render-ego1_max0.003749610868732581
sim_render-ego1_mean0.0036747422626536726
sim_render-ego1_median0.0036971598863601686
sim_render-ego1_min0.003606281243264675
sim_render-ego2_max0.003746861018491595
sim_render-ego2_mean0.003672460142513288
sim_render-ego2_median0.003673701123757796
sim_render-ego2_min0.003596818285290472
sim_render-ego3_max0.003691744268610236
sim_render-ego3_mean0.0036531032120522312
sim_render-ego3_median0.003658150813796304
sim_render-ego3_min0.0036094145537501543
simulation-passed1
step_physics_max1.1868406653404235
step_physics_mean0.9508139456321768
step_physics_median1.023984700106503
step_physics_min0.28357711201533675
survival_time_max44.44999999999961
survival_time_mean32.04999999999982
survival_time_min11.00000000000002
No reset possible