Duckietown Challenges Home Challenges Submissions

Submission 13015

Submission13015
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserMárton Tim 🇭🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60249
Next
User label3626
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
60249LFVmultibodyv-simsuccessyes1:56:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median18.469997161267816
survival_time_median59.99999999999873
deviation-center-line_median2.7175292179595463
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.04223826366300686
agent_compute-ego0_mean0.041613101834647045
agent_compute-ego0_median0.04181723431881818
agent_compute-ego0_min0.04064849161556506
agent_compute-ego1_max0.04141571360960491
agent_compute-ego1_mean0.040850707442868464
agent_compute-ego1_median0.04126220582180856
agent_compute-ego1_min0.03974898193003633
agent_compute-ego2_max0.04237092861426462
agent_compute-ego2_mean0.041658348151818854
agent_compute-ego2_median0.041513541655973235
agent_compute-ego2_min0.041090574185218734
agent_compute-ego3_max0.04135464768326352
agent_compute-ego3_mean0.04034208060661184
agent_compute-ego3_median0.04071195061142381
agent_compute-ego3_min0.03895964352514821
complete-iteration_max1.5772903177958544
complete-iteration_mean1.1094556034792535
complete-iteration_median1.2303379622913448
complete-iteration_min0.39546985491229336
deviation-center-line_max5.636282640149016
deviation-center-line_mean2.4826700188323065
deviation-center-line_min0.03781244332476445
deviation-heading_max14.4369469475546
deviation-heading_mean7.60586601468672
deviation-heading_median8.88699240564122
deviation-heading_min0.4934744865647024
driven_any_max30.84996899636777
driven_any_mean17.37045772904132
driven_any_median19.4391378639129
driven_any_min0.4579791244326487
driven_lanedir_consec_max30.48005730585586
driven_lanedir_consec_mean16.72616291797063
driven_lanedir_consec_min0.13554274835556313
driven_lanedir_max30.48005730585586
driven_lanedir_mean16.72616291797063
driven_lanedir_median18.469997161267816
driven_lanedir_min0.13554274835556313
get_duckie_state_max2.100703916779962e-06
get_duckie_state_mean1.93219736020868e-06
get_duckie_state_median1.9337513563932725e-06
get_duckie_state_min1.8116837975389e-06
get_robot_state_max0.014114673489039388
get_robot_state_mean0.012982184156222817
get_robot_state_median0.013962086988031416
get_robot_state_min0.007105719338448022
get_state_dump_max0.00954898946191945
get_state_dump_mean0.009039126865299618
get_state_dump_median0.009483303257468144
get_state_dump_min0.006280782717054432
get_ui_image_max0.049769980822077994
get_ui_image_mean0.043844852914888995
get_ui_image_median0.04616968150941845
get_ui_image_min0.030385102757208553
in-drivable-lane_max59.29999999999873
in-drivable-lane_mean5.507142857142782
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 29.55207365420709, "get_ui_image": 0.04232477149201075, "step_physics": 0.5836427852970476, "survival_time": 59.99999999999873, "driven_lanedir": 29.10073002242077, "get_state_dump": 0.009483303257468144, "get_robot_state": 0.014114673489039388, "sim_render-ego0": 0.003704107969031545, "sim_render-ego1": 0.0036924369726252498, "sim_render-ego2": 0.003674442424663001, "sim_render-ego3": 0.0036942343429959288, "get_duckie_state": 1.9337513563932725e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.249550114845318, "agent_compute-ego0": 0.04181723431881818, "agent_compute-ego1": 0.04141571360960491, "agent_compute-ego2": 0.041513541655973235, "agent_compute-ego3": 0.04135464768326352, "complete-iteration": 0.8777314046340422, "set_robot_commands": 0.002198912718214659, "deviation-center-line": 2.80886479346159, "driven_lanedir_consec": 29.10073002242077, "sim_compute_sim_state": 0.030546468461582207, "sim_compute_performance-ego0": 0.0019517935483679984, "sim_compute_performance-ego1": 0.001931575017606686, "sim_compute_performance-ego2": 0.001934646071244239, "sim_compute_performance-ego3": 0.001942216109276612}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 30.684960630066527, "get_ui_image": 0.04232477149201075, "step_physics": 0.5836427852970476, "survival_time": 59.99999999999873, "driven_lanedir": 29.405388094292316, "get_state_dump": 0.009483303257468144, "get_robot_state": 0.014114673489039388, "sim_render-ego0": 0.003704107969031545, "sim_render-ego1": 0.0036924369726252498, "sim_render-ego2": 0.003674442424663001, "sim_render-ego3": 0.0036942343429959288, "get_duckie_state": 1.9337513563932725e-06, "in-drivable-lane": 1.5999999999999974, "deviation-heading": 8.85258636143867, "agent_compute-ego0": 0.04181723431881818, "agent_compute-ego1": 0.04141571360960491, "agent_compute-ego2": 0.041513541655973235, "agent_compute-ego3": 0.04135464768326352, "complete-iteration": 0.8777314046340422, "set_robot_commands": 0.002198912718214659, "deviation-center-line": 2.837833411156106, "driven_lanedir_consec": 29.405388094292316, "sim_compute_sim_state": 0.030546468461582207, "sim_compute_performance-ego0": 0.0019517935483679984, "sim_compute_performance-ego1": 0.001931575017606686, "sim_compute_performance-ego2": 0.001934646071244239, "sim_compute_performance-ego3": 0.001942216109276612}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 29.74452339443365, "get_ui_image": 0.04232477149201075, "step_physics": 0.5836427852970476, "survival_time": 59.99999999999873, "driven_lanedir": 29.3382828739519, "get_state_dump": 0.009483303257468144, "get_robot_state": 0.014114673489039388, "sim_render-ego0": 0.003704107969031545, "sim_render-ego1": 0.0036924369726252498, "sim_render-ego2": 0.003674442424663001, "sim_render-ego3": 0.0036942343429959288, "get_duckie_state": 1.9337513563932725e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.92139844984377, "agent_compute-ego0": 0.04181723431881818, "agent_compute-ego1": 0.04141571360960491, "agent_compute-ego2": 0.041513541655973235, "agent_compute-ego3": 0.04135464768326352, "complete-iteration": 0.8777314046340422, "set_robot_commands": 0.002198912718214659, "deviation-center-line": 2.761917282923123, "driven_lanedir_consec": 29.3382828739519, "sim_compute_sim_state": 0.030546468461582207, "sim_compute_performance-ego0": 0.0019517935483679984, "sim_compute_performance-ego1": 0.001931575017606686, "sim_compute_performance-ego2": 0.001934646071244239, "sim_compute_performance-ego3": 0.001942216109276612}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 30.84996899636777, "get_ui_image": 0.04232477149201075, "step_physics": 0.5836427852970476, "survival_time": 59.99999999999873, "driven_lanedir": 30.48005730585586, "get_state_dump": 0.009483303257468144, "get_robot_state": 0.014114673489039388, "sim_render-ego0": 0.003704107969031545, "sim_render-ego1": 0.0036924369726252498, "sim_render-ego2": 0.003674442424663001, "sim_render-ego3": 0.0036942343429959288, "get_duckie_state": 1.9337513563932725e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.937608240339281, "agent_compute-ego0": 0.04181723431881818, "agent_compute-ego1": 0.04141571360960491, "agent_compute-ego2": 0.041513541655973235, "agent_compute-ego3": 0.04135464768326352, "complete-iteration": 0.8777314046340422, "set_robot_commands": 0.002198912718214659, "deviation-center-line": 3.217447507641069, "driven_lanedir_consec": 30.48005730585586, "sim_compute_sim_state": 0.030546468461582207, "sim_compute_performance-ego0": 0.0019517935483679984, "sim_compute_performance-ego1": 0.001931575017606686, "sim_compute_performance-ego2": 0.001934646071244239, "sim_compute_performance-ego3": 0.001942216109276612}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 27.797678011036695, "get_ui_image": 0.049769980822077994, "step_physics": 1.2928618382256196, "survival_time": 59.99999999999873, "driven_lanedir": 26.760971950848873, "get_state_dump": 0.00954898946191945, "get_robot_state": 0.013962086988031416, "sim_render-ego0": 0.0037283492425796297, "sim_render-ego1": 0.0036847059375340495, "sim_render-ego2": 0.0037372030882315273, "sim_render-ego3": 0.0036243246953552902, "get_duckie_state": 2.100703916779962e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.4369469475546, "agent_compute-ego0": 0.04223826366300686, "agent_compute-ego1": 0.03974898193003633, "agent_compute-ego2": 0.04237092861426462, "agent_compute-ego3": 0.03895964352514821, "complete-iteration": 1.5772903177958544, "set_robot_commands": 0.002250242193573023, "deviation-center-line": 4.435426965552297, "driven_lanedir_consec": 26.760971950848873, "sim_compute_sim_state": 0.016123257707695876, "sim_compute_performance-ego0": 0.0019199363794255317, "sim_compute_performance-ego1": 0.0019364523748672576, "sim_compute_performance-ego2": 0.0019576775839088563, "sim_compute_performance-ego3": 0.0019392667463875928}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 4.284618147430335, "get_ui_image": 0.049769980822077994, "step_physics": 1.2928618382256196, "survival_time": 59.99999999999873, "driven_lanedir": 3.0817857009882395, "get_state_dump": 0.00954898946191945, "get_robot_state": 0.013962086988031416, "sim_render-ego0": 0.0037283492425796297, "sim_render-ego1": 0.0036847059375340495, "sim_render-ego2": 0.0037372030882315273, "sim_render-ego3": 0.0036243246953552902, "get_duckie_state": 2.100703916779962e-06, "in-drivable-lane": 2.0000000000000044, "deviation-heading": 8.946088112040698, "agent_compute-ego0": 0.04223826366300686, "agent_compute-ego1": 0.03974898193003633, "agent_compute-ego2": 0.04237092861426462, "agent_compute-ego3": 0.03895964352514821, "complete-iteration": 1.5772903177958544, "set_robot_commands": 0.002250242193573023, "deviation-center-line": 5.636282640149016, "driven_lanedir_consec": 3.0817857009882395, "sim_compute_sim_state": 0.016123257707695876, "sim_compute_performance-ego0": 0.0019199363794255317, "sim_compute_performance-ego1": 0.0019364523748672576, "sim_compute_performance-ego2": 0.0019576775839088563, "sim_compute_performance-ego3": 0.0019392667463875928}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.47255560230286886, "get_ui_image": 0.049769980822077994, "step_physics": 1.2928618382256196, "survival_time": 59.99999999999873, "driven_lanedir": 0.13554274835556313, "get_state_dump": 0.00954898946191945, "get_robot_state": 0.013962086988031416, "sim_render-ego0": 0.0037283492425796297, "sim_render-ego1": 0.0036847059375340495, "sim_render-ego2": 0.0037372030882315273, "sim_render-ego3": 0.0036243246953552902, "get_duckie_state": 2.100703916779962e-06, "in-drivable-lane": 59.29999999999873, "deviation-heading": 0.4934744865647024, "agent_compute-ego0": 0.04223826366300686, "agent_compute-ego1": 0.03974898193003633, "agent_compute-ego2": 0.04237092861426462, "agent_compute-ego3": 0.03895964352514821, "complete-iteration": 1.5772903177958544, "set_robot_commands": 0.002250242193573023, "deviation-center-line": 0.03781244332476445, "driven_lanedir_consec": 0.13554274835556313, "sim_compute_sim_state": 0.016123257707695876, "sim_compute_performance-ego0": 0.0019199363794255317, "sim_compute_performance-ego1": 0.0019364523748672576, "sim_compute_performance-ego2": 0.0019576775839088563, "sim_compute_performance-ego3": 0.0019392667463875928}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.4579791244326487, "get_ui_image": 0.049769980822077994, "step_physics": 1.2928618382256196, "survival_time": 59.99999999999873, "driven_lanedir": 0.4519333951981577, "get_state_dump": 0.00954898946191945, "get_robot_state": 0.013962086988031416, "sim_render-ego0": 0.0037283492425796297, "sim_render-ego1": 0.0036847059375340495, "sim_render-ego2": 0.0037372030882315273, "sim_render-ego3": 0.0036243246953552902, "get_duckie_state": 2.100703916779962e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.9163826926934229, "agent_compute-ego0": 0.04223826366300686, "agent_compute-ego1": 0.03974898193003633, "agent_compute-ego2": 0.04237092861426462, "agent_compute-ego3": 0.03895964352514821, "complete-iteration": 1.5772903177958544, "set_robot_commands": 0.002250242193573023, "deviation-center-line": 0.9306396081224664, "driven_lanedir_consec": 0.4519333951981577, "sim_compute_sim_state": 0.016123257707695876, "sim_compute_performance-ego0": 0.0019199363794255317, "sim_compute_performance-ego1": 0.0019364523748672576, "sim_compute_performance-ego2": 0.0019576775839088563, "sim_compute_performance-ego3": 0.0019392667463875928}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 7.200540271973985, "get_ui_image": 0.04616968150941845, "step_physics": 0.9372401282098338, "survival_time": 24.00000000000021, "driven_lanedir": 7.042998839057937, "get_state_dump": 0.009464259950633852, "get_robot_state": 0.013808024400485033, "sim_render-ego0": 0.003615219231207009, "sim_render-ego1": 0.0036102397030455657, "sim_render-ego2": 0.003588094532861531, "sim_render-ego3": 0.003605958577748891, "get_duckie_state": 1.8116837975389e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.819174528372258, "agent_compute-ego0": 0.04064849161556506, "agent_compute-ego1": 0.04126220582180856, "agent_compute-ego2": 0.041090574185218734, "agent_compute-ego3": 0.04071195061142381, "complete-iteration": 1.2303379622913448, "set_robot_commands": 0.002168521068200252, "deviation-center-line": 2.4939624192695105, "driven_lanedir_consec": 7.042998839057937, "sim_compute_sim_state": 0.02932361902169527, "sim_compute_performance-ego0": 0.001861981691293062, "sim_compute_performance-ego1": 0.0018787369163021476, "sim_compute_performance-ego2": 0.0018819231005567524, "sim_compute_performance-ego3": 0.0018665017308415592}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 6.196349777694406, "get_ui_image": 0.04616968150941845, "step_physics": 0.9372401282098338, "survival_time": 24.00000000000021, "driven_lanedir": 5.301871662332059, "get_state_dump": 0.009464259950633852, "get_robot_state": 0.013808024400485033, "sim_render-ego0": 0.003615219231207009, "sim_render-ego1": 0.0036102397030455657, "sim_render-ego2": 0.003588094532861531, "sim_render-ego3": 0.003605958577748891, "get_duckie_state": 1.8116837975389e-06, "in-drivable-lane": 11.750000000000169, "deviation-heading": 3.2456474592603133, "agent_compute-ego0": 0.04064849161556506, "agent_compute-ego1": 0.04126220582180856, "agent_compute-ego2": 0.041090574185218734, "agent_compute-ego3": 0.04071195061142381, "complete-iteration": 1.2303379622913448, "set_robot_commands": 0.002168521068200252, "deviation-center-line": 0.7595403944639861, "driven_lanedir_consec": 5.301871662332059, "sim_compute_sim_state": 0.02932361902169527, "sim_compute_performance-ego0": 0.001861981691293062, "sim_compute_performance-ego1": 0.0018787369163021476, "sim_compute_performance-ego2": 0.0018819231005567524, "sim_compute_performance-ego3": 0.0018665017308415592}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 11.080597716789104, "get_ui_image": 0.04616968150941845, "step_physics": 0.9372401282098338, "survival_time": 24.00000000000021, "driven_lanedir": 10.17902237168676, "get_state_dump": 0.009464259950633852, "get_robot_state": 0.013808024400485033, "sim_render-ego0": 0.003615219231207009, "sim_render-ego1": 0.0036102397030455657, "sim_render-ego2": 0.003588094532861531, "sim_render-ego3": 0.003605958577748891, "get_duckie_state": 1.8116837975389e-06, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 5.551905805656491, "agent_compute-ego0": 0.04064849161556506, "agent_compute-ego1": 0.04126220582180856, "agent_compute-ego2": 0.041090574185218734, "agent_compute-ego3": 0.04071195061142381, "complete-iteration": 1.2303379622913448, "set_robot_commands": 0.002168521068200252, "deviation-center-line": 1.4106549529102113, "driven_lanedir_consec": 10.17902237168676, "sim_compute_sim_state": 0.02932361902169527, "sim_compute_performance-ego0": 0.001861981691293062, "sim_compute_performance-ego1": 0.0018787369163021476, "sim_compute_performance-ego2": 0.0018819231005567524, "sim_compute_performance-ego3": 0.0018665017308415592}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 6.490121453607303, "get_ui_image": 0.04616968150941845, "step_physics": 0.9372401282098338, "survival_time": 24.00000000000021, "driven_lanedir": 5.526620824849438, "get_state_dump": 0.009464259950633852, "get_robot_state": 0.013808024400485033, "sim_render-ego0": 0.003615219231207009, "sim_render-ego1": 0.0036102397030455657, "sim_render-ego2": 0.003588094532861531, "sim_render-ego3": 0.003605958577748891, "get_duckie_state": 1.8116837975389e-06, "in-drivable-lane": 1.3500000000000192, "deviation-heading": 12.88973426508666, "agent_compute-ego0": 0.04064849161556506, "agent_compute-ego1": 0.04126220582180856, "agent_compute-ego2": 0.041090574185218734, "agent_compute-ego3": 0.04071195061142381, "complete-iteration": 1.2303379622913448, "set_robot_commands": 0.002168521068200252, "deviation-center-line": 1.08621298277986, "driven_lanedir_consec": 5.526620824849438, "sim_compute_sim_state": 0.02932361902169527, "sim_compute_performance-ego0": 0.001861981691293062, "sim_compute_performance-ego1": 0.0018787369163021476, "sim_compute_performance-ego2": 0.0018819231005567524, "sim_compute_performance-ego3": 0.0018665017308415592}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 30.144139934495907, "get_ui_image": 0.030385102757208553, "step_physics": 0.2426618678087398, "survival_time": 59.99999999999873, "driven_lanedir": 29.580297393566564, "get_state_dump": 0.006280782717054432, "get_robot_state": 0.007105719338448022, "sim_render-ego0": 0.003687026200941659, "sim_render-ego1": 0.0036825109381759097, "get_duckie_state": 1.833103380036493e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.89905159247718, "agent_compute-ego0": 0.04188373364774909, "agent_compute-ego1": 0.04110114937717968, "complete-iteration": 0.39546985491229336, "set_robot_commands": 0.002143255975423109, "deviation-center-line": 3.667643708902319, "driven_lanedir_consec": 29.580297393566564, "sim_compute_sim_state": 0.010413613942739468, "sim_compute_performance-ego0": 0.0018980610281303463, "sim_compute_performance-ego1": 0.001944107576571932}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 28.230301491740203, "get_ui_image": 0.030385102757208553, "step_physics": 0.2426618678087398, "survival_time": 59.99999999999873, "driven_lanedir": 27.78077766818439, "get_state_dump": 0.006280782717054432, "get_robot_state": 0.007105719338448022, "sim_render-ego0": 0.003687026200941659, "sim_render-ego1": 0.0036825109381759097, "get_duckie_state": 1.833103380036493e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.322575149440729, "agent_compute-ego0": 0.04188373364774909, "agent_compute-ego1": 0.04110114937717968, "complete-iteration": 0.39546985491229336, "set_robot_commands": 0.002143255975423109, "deviation-center-line": 2.673141152995969, "driven_lanedir_consec": 27.78077766818439, "sim_compute_sim_state": 0.010413613942739468, "sim_compute_performance-ego0": 0.0018980610281303463, "sim_compute_performance-ego1": 0.001944107576571932}}
set_robot_commands_max0.002250242193573023
set_robot_commands_mean0.002196943990771282
set_robot_commands_median0.002198912718214659
set_robot_commands_min0.002143255975423109
sim_compute_performance-ego0_max0.0019517935483679984
sim_compute_performance-ego0_mean0.0019093548951862188
sim_compute_performance-ego0_median0.0019199363794255317
sim_compute_performance-ego0_min0.001861981691293062
sim_compute_performance-ego1_max0.001944107576571932
sim_compute_performance-ego1_mean0.001919662313446302
sim_compute_performance-ego1_median0.001931575017606686
sim_compute_performance-ego1_min0.0018787369163021476
sim_compute_performance-ego2_max0.0019576775839088563
sim_compute_performance-ego2_mean0.0019247489185699488
sim_compute_performance-ego2_median0.001934646071244239
sim_compute_performance-ego2_min0.0018819231005567524
sim_compute_performance-ego3_max0.001942216109276612
sim_compute_performance-ego3_mean0.0019159948621685883
sim_compute_performance-ego3_median0.0019392667463875928
sim_compute_performance-ego3_min0.0018665017308415592
sim_compute_sim_state_max0.030546468461582207
sim_compute_sim_state_mean0.02320004347495517
sim_compute_sim_state_median0.02932361902169527
sim_compute_sim_state_min0.010413613942739468
sim_render-ego0_max0.0037283492425796297
sim_render-ego0_mean0.003683197012368289
sim_render-ego0_median0.003704107969031545
sim_render-ego0_min0.003615219231207009
sim_render-ego1_max0.0036924369726252498
sim_render-ego1_mean0.0036653251663693776
sim_render-ego1_median0.0036847059375340495
sim_render-ego1_min0.0036102397030455657
sim_render-ego2_max0.0037372030882315273
sim_render-ego2_mean0.00366658001525202
sim_render-ego2_median0.003674442424663001
sim_render-ego2_min0.003588094532861531
sim_render-ego3_max0.0036942343429959288
sim_render-ego3_mean0.00364150587203337
sim_render-ego3_median0.0036243246953552902
sim_render-ego3_min0.003605958577748891
simulation-passed1
step_physics_max1.2928618382256196
step_physics_mean0.8385930530391058
step_physics_median0.9372401282098338
step_physics_min0.2426618678087398
survival_time_max59.99999999999873
survival_time_mean49.71428571428487
survival_time_min24.00000000000021
No reset possible