Duckietown Challenges Home Challenges Submissions

Submission 13036

Submission13036
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserMárton Tim 🇭🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60294
Next
User label3625
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
60294LFVmultibodyv-simsuccessyes1:06:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.8997169119435835
survival_time_median21.45000000000017
deviation-center-line_median1.8515368459467496
in-drivable-lane_median0.70000000000001


other stats
agent_compute-ego0_max0.04322532498559287
agent_compute-ego0_mean0.04139626047100181
agent_compute-ego0_median0.04073857397272967
agent_compute-ego0_min0.040554474160038934
agent_compute-ego1_max0.04236259959464849
agent_compute-ego1_mean0.040178004005442136
agent_compute-ego1_median0.03951323075570922
agent_compute-ego1_min0.03902173796660894
agent_compute-ego2_max0.040283544119014296
agent_compute-ego2_mean0.03984943298551647
agent_compute-ego2_median0.03989237590427816
agent_compute-ego2_min0.03937237893325695
agent_compute-ego3_max0.04168380304824474
agent_compute-ego3_mean0.04058872123167943
agent_compute-ego3_median0.04012848570979135
agent_compute-ego3_min0.03995387493700221
complete-iteration_max1.479589673530224
complete-iteration_mean1.165824950188865
complete-iteration_median1.2034135020297507
complete-iteration_min0.4034616957099908
deviation-center-line_max3.776730651701947
deviation-center-line_mean1.803794408668173
deviation-center-line_min0.12910704700716913
deviation-heading_max18.83101077716605
deviation-heading_mean7.542351565138056
deviation-heading_median6.9714151894681216
deviation-heading_min0.8765262842503907
driven_any_max25.879359592779306
driven_any_mean9.042801704830206
driven_any_median8.740068602162193
driven_any_min1.9829257198846792
driven_lanedir_consec_max24.085126392688892
driven_lanedir_consec_mean7.733301374398719
driven_lanedir_consec_min0.541440636613116
driven_lanedir_max24.085126392688892
driven_lanedir_mean7.733301374398719
driven_lanedir_median6.8997169119435835
driven_lanedir_min0.541440636613116
get_duckie_state_max1.447699790777162e-06
get_duckie_state_mean1.303773665016664e-06
get_duckie_state_median1.3372172480044158e-06
get_duckie_state_min1.1781967252021428e-06
get_robot_state_max0.01409846405650294
get_robot_state_mean0.012711437317917632
get_robot_state_median0.013607135364318996
get_robot_state_min0.006826410087121714
get_state_dump_max0.009451338302257448
get_state_dump_mean0.008695629411830602
get_state_dump_median0.0090794685113169
get_state_dump_min0.005813051520735894
get_ui_image_max0.04954759575599848
get_ui_image_mean0.042949686436493106
get_ui_image_median0.04468704306561014
get_ui_image_min0.028873327471235215
in-drivable-lane_max19.70000000000017
in-drivable-lane_mean4.282142857142902
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 8.448138789035353, "get_ui_image": 0.04165259997049967, "step_physics": 0.9241193535844195, "survival_time": 20.500000000000156, "driven_lanedir": 7.866577775937491, "get_state_dump": 0.0090794685113169, "get_robot_state": 0.013607135364318996, "sim_render-ego0": 0.0035837972831262, "sim_render-ego1": 0.0035705380776212743, "sim_render-ego2": 0.003592083924008112, "sim_render-ego3": 0.003518776301919979, "get_duckie_state": 1.1891924261756768e-06, "in-drivable-lane": 0.25000000000000355, "deviation-heading": 5.813102915489861, "agent_compute-ego0": 0.040554474160038934, "agent_compute-ego1": 0.039236314685385305, "agent_compute-ego2": 0.03989237590427816, "agent_compute-ego3": 0.04012848570979135, "complete-iteration": 1.1956533022460567, "set_robot_commands": 0.002086548329559846, "deviation-center-line": 1.2347407862658963, "driven_lanedir_consec": 7.866577775937491, "sim_compute_sim_state": 0.017161785251032697, "sim_compute_performance-ego0": 0.0018664839203920388, "sim_compute_performance-ego1": 0.001853696911294385, "sim_compute_performance-ego2": 0.0018670228275939496, "sim_compute_performance-ego3": 0.0018556332646205188}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 4.997884421030248, "get_ui_image": 0.04165259997049967, "step_physics": 0.9241193535844195, "survival_time": 20.500000000000156, "driven_lanedir": 4.710571950371323, "get_state_dump": 0.0090794685113169, "get_robot_state": 0.013607135364318996, "sim_render-ego0": 0.0035837972831262, "sim_render-ego1": 0.0035705380776212743, "sim_render-ego2": 0.003592083924008112, "sim_render-ego3": 0.003518776301919979, "get_duckie_state": 1.1891924261756768e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.273407883444983, "agent_compute-ego0": 0.040554474160038934, "agent_compute-ego1": 0.039236314685385305, "agent_compute-ego2": 0.03989237590427816, "agent_compute-ego3": 0.04012848570979135, "complete-iteration": 1.1956533022460567, "set_robot_commands": 0.002086548329559846, "deviation-center-line": 1.3265136144722929, "driven_lanedir_consec": 4.710571950371323, "sim_compute_sim_state": 0.017161785251032697, "sim_compute_performance-ego0": 0.0018664839203920388, "sim_compute_performance-ego1": 0.001853696911294385, "sim_compute_performance-ego2": 0.0018670228275939496, "sim_compute_performance-ego3": 0.0018556332646205188}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 2.1671478001814704, "get_ui_image": 0.04165259997049967, "step_physics": 0.9241193535844195, "survival_time": 20.500000000000156, "driven_lanedir": 2.022419653914782, "get_state_dump": 0.0090794685113169, "get_robot_state": 0.013607135364318996, "sim_render-ego0": 0.0035837972831262, "sim_render-ego1": 0.0035705380776212743, "sim_render-ego2": 0.003592083924008112, "sim_render-ego3": 0.003518776301919979, "get_duckie_state": 1.1891924261756768e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.546323757528144, "agent_compute-ego0": 0.040554474160038934, "agent_compute-ego1": 0.039236314685385305, "agent_compute-ego2": 0.03989237590427816, "agent_compute-ego3": 0.04012848570979135, "complete-iteration": 1.1956533022460567, "set_robot_commands": 0.002086548329559846, "deviation-center-line": 1.8245102399526032, "driven_lanedir_consec": 2.022419653914782, "sim_compute_sim_state": 0.017161785251032697, "sim_compute_performance-ego0": 0.0018664839203920388, "sim_compute_performance-ego1": 0.001853696911294385, "sim_compute_performance-ego2": 0.0018670228275939496, "sim_compute_performance-ego3": 0.0018556332646205188}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 2.1882516052398646, "get_ui_image": 0.04165259997049967, "step_physics": 0.9241193535844195, "survival_time": 20.500000000000156, "driven_lanedir": 2.0655342301583923, "get_state_dump": 0.0090794685113169, "get_robot_state": 0.013607135364318996, "sim_render-ego0": 0.0035837972831262, "sim_render-ego1": 0.0035705380776212743, "sim_render-ego2": 0.003592083924008112, "sim_render-ego3": 0.003518776301919979, "get_duckie_state": 1.1891924261756768e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.9509174093513826, "agent_compute-ego0": 0.040554474160038934, "agent_compute-ego1": 0.039236314685385305, "agent_compute-ego2": 0.03989237590427816, "agent_compute-ego3": 0.04012848570979135, "complete-iteration": 1.1956533022460567, "set_robot_commands": 0.002086548329559846, "deviation-center-line": 2.208583574225336, "driven_lanedir_consec": 2.0655342301583923, "sim_compute_sim_state": 0.017161785251032697, "sim_compute_performance-ego0": 0.0018664839203920388, "sim_compute_performance-ego1": 0.001853696911294385, "sim_compute_performance-ego2": 0.0018670228275939496, "sim_compute_performance-ego3": 0.0018556332646205188}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.9829257198846792, "get_ui_image": 0.04954759575599848, "step_physics": 1.1878794952880505, "survival_time": 21.45000000000017, "driven_lanedir": 1.608429787924281, "get_state_dump": 0.009451338302257448, "get_robot_state": 0.01409846405650294, "sim_render-ego0": 0.003758521412694177, "sim_render-ego1": 0.0036924611690432527, "sim_render-ego2": 0.003635575050531432, "sim_render-ego3": 0.003665606920109239, "get_duckie_state": 1.447699790777162e-06, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 1.9834556910693617, "agent_compute-ego0": 0.04322532498559287, "agent_compute-ego1": 0.04236259959464849, "agent_compute-ego2": 0.040283544119014296, "agent_compute-ego3": 0.04168380304824474, "complete-iteration": 1.479589673530224, "set_robot_commands": 0.002255411480748376, "deviation-center-line": 2.575049268711668, "driven_lanedir_consec": 1.608429787924281, "sim_compute_sim_state": 0.019337812689847723, "sim_compute_performance-ego0": 0.0019491068152494209, "sim_compute_performance-ego1": 0.0019817102787106538, "sim_compute_performance-ego2": 0.0019221777139708056, "sim_compute_performance-ego3": 0.001949367412300997}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 9.031998415289031, "get_ui_image": 0.04954759575599848, "step_physics": 1.1878794952880505, "survival_time": 21.45000000000017, "driven_lanedir": 7.178516249365104, "get_state_dump": 0.009451338302257448, "get_robot_state": 0.01409846405650294, "sim_render-ego0": 0.003758521412694177, "sim_render-ego1": 0.0036924611690432527, "sim_render-ego2": 0.003635575050531432, "sim_render-ego3": 0.003665606920109239, "get_duckie_state": 1.447699790777162e-06, "in-drivable-lane": 3.300000000000043, "deviation-heading": 6.66942249549126, "agent_compute-ego0": 0.04322532498559287, "agent_compute-ego1": 0.04236259959464849, "agent_compute-ego2": 0.040283544119014296, "agent_compute-ego3": 0.04168380304824474, "complete-iteration": 1.479589673530224, "set_robot_commands": 0.002255411480748376, "deviation-center-line": 1.2676335253503137, "driven_lanedir_consec": 7.178516249365104, "sim_compute_sim_state": 0.019337812689847723, "sim_compute_performance-ego0": 0.0019491068152494209, "sim_compute_performance-ego1": 0.0019817102787106538, "sim_compute_performance-ego2": 0.0019221777139708056, "sim_compute_performance-ego3": 0.001949367412300997}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 2.057255074021705, "get_ui_image": 0.04954759575599848, "step_physics": 1.1878794952880505, "survival_time": 21.45000000000017, "driven_lanedir": 0.541440636613116, "get_state_dump": 0.009451338302257448, "get_robot_state": 0.01409846405650294, "sim_render-ego0": 0.003758521412694177, "sim_render-ego1": 0.0036924611690432527, "sim_render-ego2": 0.003635575050531432, "sim_render-ego3": 0.003665606920109239, "get_duckie_state": 1.447699790777162e-06, "in-drivable-lane": 19.70000000000017, "deviation-heading": 0.8765262842503907, "agent_compute-ego0": 0.04322532498559287, "agent_compute-ego1": 0.04236259959464849, "agent_compute-ego2": 0.040283544119014296, "agent_compute-ego3": 0.04168380304824474, "complete-iteration": 1.479589673530224, "set_robot_commands": 0.002255411480748376, "deviation-center-line": 0.12910704700716913, "driven_lanedir_consec": 0.541440636613116, "sim_compute_sim_state": 0.019337812689847723, "sim_compute_performance-ego0": 0.0019491068152494209, "sim_compute_performance-ego1": 0.0019817102787106538, "sim_compute_performance-ego2": 0.0019221777139708056, "sim_compute_performance-ego3": 0.001949367412300997}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 2.063377038539836, "get_ui_image": 0.04954759575599848, "step_physics": 1.1878794952880505, "survival_time": 21.45000000000017, "driven_lanedir": 1.0839996966014624, "get_state_dump": 0.009451338302257448, "get_robot_state": 0.01409846405650294, "sim_render-ego0": 0.003758521412694177, "sim_render-ego1": 0.0036924611690432527, "sim_render-ego2": 0.003635575050531432, "sim_render-ego3": 0.003665606920109239, "get_duckie_state": 1.447699790777162e-06, "in-drivable-lane": 18.600000000000172, "deviation-heading": 1.1070962203783687, "agent_compute-ego0": 0.04322532498559287, "agent_compute-ego1": 0.04236259959464849, "agent_compute-ego2": 0.040283544119014296, "agent_compute-ego3": 0.04168380304824474, "complete-iteration": 1.479589673530224, "set_robot_commands": 0.002255411480748376, "deviation-center-line": 0.18741215306051692, "driven_lanedir_consec": 1.0839996966014624, "sim_compute_sim_state": 0.019337812689847723, "sim_compute_performance-ego0": 0.0019491068152494209, "sim_compute_performance-ego1": 0.0019817102787106538, "sim_compute_performance-ego2": 0.0019221777139708056, "sim_compute_performance-ego3": 0.001949367412300997}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 11.4235824621637, "get_ui_image": 0.04468704306561014, "step_physics": 0.9095370890437692, "survival_time": 27.550000000000257, "driven_lanedir": 8.68080982314194, "get_state_dump": 0.008997370367464811, "get_robot_state": 0.01337122614832892, "sim_render-ego0": 0.0034877865210823393, "sim_render-ego1": 0.0034673835920250935, "sim_render-ego2": 0.0034329904162365456, "sim_render-ego3": 0.003427186305972113, "get_duckie_state": 1.3372172480044158e-06, "in-drivable-lane": 3.900000000000055, "deviation-heading": 9.349967537123456, "agent_compute-ego0": 0.04073857397272967, "agent_compute-ego1": 0.03951323075570922, "agent_compute-ego2": 0.03937237893325695, "agent_compute-ego3": 0.03995387493700221, "complete-iteration": 1.2034135020297507, "set_robot_commands": 0.0020012648209281588, "deviation-center-line": 1.892310852345074, "driven_lanedir_consec": 8.68080982314194, "sim_compute_sim_state": 0.03802986205488011, "sim_compute_performance-ego0": 0.0018096281134563944, "sim_compute_performance-ego1": 0.001807436994884325, "sim_compute_performance-ego2": 0.001780681420063627, "sim_compute_performance-ego3": 0.001801933499350064}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 10.15503923745276, "get_ui_image": 0.04468704306561014, "step_physics": 0.9095370890437692, "survival_time": 27.550000000000257, "driven_lanedir": 6.620917574522064, "get_state_dump": 0.008997370367464811, "get_robot_state": 0.01337122614832892, "sim_render-ego0": 0.0034877865210823393, "sim_render-ego1": 0.0034673835920250935, "sim_render-ego2": 0.0034329904162365456, "sim_render-ego3": 0.003427186305972113, "get_duckie_state": 1.3372172480044158e-06, "in-drivable-lane": 5.550000000000079, "deviation-heading": 8.163613799420482, "agent_compute-ego0": 0.04073857397272967, "agent_compute-ego1": 0.03951323075570922, "agent_compute-ego2": 0.03937237893325695, "agent_compute-ego3": 0.03995387493700221, "complete-iteration": 1.2034135020297507, "set_robot_commands": 0.0020012648209281588, "deviation-center-line": 1.8785634519408965, "driven_lanedir_consec": 6.620917574522064, "sim_compute_sim_state": 0.03802986205488011, "sim_compute_performance-ego0": 0.0018096281134563944, "sim_compute_performance-ego1": 0.001807436994884325, "sim_compute_performance-ego2": 0.001780681420063627, "sim_compute_performance-ego3": 0.001801933499350064}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 10.398755337728804, "get_ui_image": 0.04468704306561014, "step_physics": 0.9095370890437692, "survival_time": 27.550000000000257, "driven_lanedir": 9.438307999206875, "get_state_dump": 0.008997370367464811, "get_robot_state": 0.01337122614832892, "sim_render-ego0": 0.0034877865210823393, "sim_render-ego1": 0.0034673835920250935, "sim_render-ego2": 0.0034329904162365456, "sim_render-ego3": 0.003427186305972113, "get_duckie_state": 1.3372172480044158e-06, "in-drivable-lane": 0.6500000000000092, "deviation-heading": 8.703320627011545, "agent_compute-ego0": 0.04073857397272967, "agent_compute-ego1": 0.03951323075570922, "agent_compute-ego2": 0.03937237893325695, "agent_compute-ego3": 0.03995387493700221, "complete-iteration": 1.2034135020297507, "set_robot_commands": 0.0020012648209281588, "deviation-center-line": 1.909453755503824, "driven_lanedir_consec": 9.438307999206875, "sim_compute_sim_state": 0.03802986205488011, "sim_compute_performance-ego0": 0.0018096281134563944, "sim_compute_performance-ego1": 0.001807436994884325, "sim_compute_performance-ego2": 0.001780681420063627, "sim_compute_performance-ego3": 0.001801933499350064}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 10.3042120029093, "get_ui_image": 0.04468704306561014, "step_physics": 0.9095370890437692, "survival_time": 27.550000000000257, "driven_lanedir": 8.545353784072086, "get_state_dump": 0.008997370367464811, "get_robot_state": 0.01337122614832892, "sim_render-ego0": 0.0034877865210823393, "sim_render-ego1": 0.0034673835920250935, "sim_render-ego2": 0.0034329904162365456, "sim_render-ego3": 0.003427186305972113, "get_duckie_state": 1.3372172480044158e-06, "in-drivable-lane": 6.750000000000096, "deviation-heading": 5.758730598097257, "agent_compute-ego0": 0.04073857397272967, "agent_compute-ego1": 0.03951323075570922, "agent_compute-ego2": 0.03937237893325695, "agent_compute-ego3": 0.03995387493700221, "complete-iteration": 1.2034135020297507, "set_robot_commands": 0.0020012648209281588, "deviation-center-line": 1.3755063316780918, "driven_lanedir_consec": 8.545353784072086, "sim_compute_sim_state": 0.03802986205488011, "sim_compute_performance-ego0": 0.0018096281134563944, "sim_compute_performance-ego1": 0.001807436994884325, "sim_compute_performance-ego2": 0.001780681420063627, "sim_compute_performance-ego3": 0.001801933499350064}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 25.879359592779306, "get_ui_image": 0.028873327471235215, "step_physics": 0.25734147084543446, "survival_time": 59.99999999999873, "driven_lanedir": 23.818213687064244, "get_state_dump": 0.005813051520735894, "get_robot_state": 0.006826410087121714, "sim_render-ego0": 0.003531956057266629, "sim_render-ego1": 0.003480206322014878, "get_duckie_state": 1.1781967252021428e-06, "in-drivable-lane": 0.7500000000000107, "deviation-heading": 18.83101077716605, "agent_compute-ego0": 0.04073707706028972, "agent_compute-ego1": 0.03902173796660894, "complete-iteration": 0.4034616957099908, "set_robot_commands": 0.0020319641281623425, "deviation-center-line": 3.6670064691387942, "driven_lanedir_consec": 23.818213687064244, "sim_compute_sim_state": 0.00998649013528816, "sim_compute_performance-ego0": 0.0018331941021769171, "sim_compute_performance-ego1": 0.001838066695036241}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 25.50129637136681, "get_ui_image": 0.028873327471235215, "step_physics": 0.25734147084543446, "survival_time": 59.99999999999873, "driven_lanedir": 24.085126392688892, "get_state_dump": 0.005813051520735894, "get_robot_state": 0.006826410087121714, "sim_render-ego0": 0.003531956057266629, "sim_render-ego1": 0.003480206322014878, "get_duckie_state": 1.1781967252021428e-06, "in-drivable-lane": 0.0, "deviation-heading": 16.566025916110256, "agent_compute-ego0": 0.04073707706028972, "agent_compute-ego1": 0.03902173796660894, "complete-iteration": 0.4034616957099908, "set_robot_commands": 0.0020319641281623425, "deviation-center-line": 3.776730651701947, "driven_lanedir_consec": 24.085126392688892, "sim_compute_sim_state": 0.00998649013528816, "sim_compute_performance-ego0": 0.0018331941021769171, "sim_compute_performance-ego1": 0.001838066695036241}}
set_robot_commands_max0.002255411480748376
set_robot_commands_mean0.0021026304843764433
set_robot_commands_median0.002086548329559846
set_robot_commands_min0.0020012648209281588
sim_compute_performance-ego0_max0.0019491068152494209
sim_compute_performance-ego0_mean0.0018690902571960892
sim_compute_performance-ego0_median0.0018664839203920388
sim_compute_performance-ego0_min0.0018096281134563944
sim_compute_performance-ego1_max0.0019817102787106538
sim_compute_performance-ego1_mean0.001874822152116424
sim_compute_performance-ego1_median0.001853696911294385
sim_compute_performance-ego1_min0.001807436994884325
sim_compute_performance-ego2_max0.0019221777139708056
sim_compute_performance-ego2_mean0.0018566273205427935
sim_compute_performance-ego2_median0.0018670228275939496
sim_compute_performance-ego2_min0.001780681420063627
sim_compute_performance-ego3_max0.001949367412300997
sim_compute_performance-ego3_mean0.001868978058757193
sim_compute_performance-ego3_median0.0018556332646205188
sim_compute_performance-ego3_min0.001801933499350064
sim_compute_sim_state_max0.03802986205488011
sim_compute_sim_state_mean0.022720772875258467
sim_compute_sim_state_median0.019337812689847723
sim_compute_sim_state_min0.00998649013528816
sim_render-ego0_max0.003758521412694177
sim_render-ego0_mean0.0035988809272960087
sim_render-ego0_median0.0035837972831262
sim_render-ego0_min0.0034877865210823393
sim_render-ego1_max0.0036924611690432527
sim_render-ego1_mean0.0035629959999134457
sim_render-ego1_median0.0035705380776212743
sim_render-ego1_min0.0034673835920250935
sim_render-ego2_max0.003635575050531432
sim_render-ego2_mean0.003553549796925362
sim_render-ego2_median0.003592083924008112
sim_render-ego2_min0.0034329904162365456
sim_render-ego3_max0.003665606920109239
sim_render-ego3_mean0.0035371898426671106
sim_render-ego3_median0.003518776301919979
sim_render-ego3_min0.003427186305972113
simulation-passed1
step_physics_max1.1878794952880505
step_physics_mean0.9000590495254164
step_physics_median0.9241193535844195
step_physics_min0.25734147084543446
survival_time_max59.99999999999873
survival_time_mean28.428571428571413
survival_time_min20.500000000000156
No reset possible