Duckietown Challenges Home Challenges Submissions

Submission 12583

Submission12583
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 53641
Next
User labeltemplate-ros
Admin priority50
Blessingn/a
User priority50

53641

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53641LFVmultibodyv-simsuccessyes0:23:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8369148774919418
survival_time_median13.300000000000054
deviation-center-line_median0.2048401911335881
in-drivable-lane_median9.425000000000066


other stats
agent_compute-ego0_max0.012677533796217558
agent_compute-ego0_mean0.012134033358179622
agent_compute-ego0_median0.012241720754566
agent_compute-ego0_min0.01141919964238217
agent_compute-ego1_max0.01372360558099068
agent_compute-ego1_mean0.012484552589679771
agent_compute-ego1_median0.012319600701730786
agent_compute-ego1_min0.011543928949456463
complete-iteration_max1.064120906122615
complete-iteration_mean0.7948122942289999
complete-iteration_median0.8550636872001316
complete-iteration_min0.30210451036691666
deviation-center-line_max0.4470567309724928
deviation-center-line_mean0.2326240099413038
deviation-center-line_min0.08424806728230494
deviation-heading_max2.656336735058711
deviation-heading_mean1.1222289138881685
deviation-heading_median1.092818795567271
deviation-heading_min0.6840718667585405
driven_any_max4.298276896998029
driven_any_mean2.100270685418943
driven_any_median1.962017459343596
driven_any_min0.7623799576283259
driven_lanedir_consec_max1.284175333587667
driven_lanedir_consec_mean0.7998513449248306
driven_lanedir_consec_min0.24495012726670184
driven_lanedir_max1.284175333587667
driven_lanedir_mean0.7998513449248306
driven_lanedir_median0.8369148774919418
driven_lanedir_min0.24495012726670184
get_duckie_state_max1.5867783335710733e-06
get_duckie_state_mean1.4375107373873908e-06
get_duckie_state_median1.45363568462257e-06
get_duckie_state_min1.3188311928196956e-06
get_robot_state_max0.014564985639593577
get_robot_state_mean0.013049667171755472
get_robot_state_median0.013940427614294964
get_robot_state_min0.0069264695048332214
get_state_dump_max0.009763401545835344
get_state_dump_mean0.008899902731199111
get_state_dump_median0.009301842654429153
get_state_dump_min0.005971045792102813
get_ui_image_max0.04898125032916117
get_ui_image_mean0.04254722538841373
get_ui_image_median0.046153618601824015
get_ui_image_min0.02958541363477707
in-drivable-lane_max12.05000000000008
in-drivable-lane_mean8.582142857142895
in-drivable-lane_min4.400000000000009
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.1444821384980934, "get_ui_image": 0.038987713111074344, "step_physics": 0.5527324124386436, "survival_time": 9.45, "driven_lanedir": 1.0552688246209556, "get_state_dump": 0.009098892462880988, "get_robot_state": 0.013705187094838997, "sim_render-ego0": 0.0035581187198036597, "sim_render-ego1": 0.003509387217069927, "sim_render-ego2": 0.0034876459523251182, "sim_render-ego3": 0.003506872528477719, "get_duckie_state": 1.3188311928196956e-06, "in-drivable-lane": 5.050000000000007, "deviation-heading": 1.225662019088012, "agent_compute-ego0": 0.01141919964238217, "agent_compute-ego1": 0.011543928949456463, "agent_compute-ego2": 0.011663607547157688, "agent_compute-ego3": 0.01163410136574193, "complete-iteration": 0.7116061812952945, "set_robot_commands": 0.002090880745335629, "deviation-center-line": 0.4470567309724928, "driven_lanedir_consec": 1.0552688246209556, "sim_compute_sim_state": 0.02080960148259213, "sim_compute_performance-ego0": 0.0019472849996466383, "sim_compute_performance-ego1": 0.0018347589593184625, "sim_compute_performance-ego2": 0.0018214903379741468, "sim_compute_performance-ego3": 0.0018226523148386104}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 2.59576258488388, "get_ui_image": 0.038987713111074344, "step_physics": 0.5527324124386436, "survival_time": 9.45, "driven_lanedir": 0.35946613770605906, "get_state_dump": 0.009098892462880988, "get_robot_state": 0.013705187094838997, "sim_render-ego0": 0.0035581187198036597, "sim_render-ego1": 0.003509387217069927, "sim_render-ego2": 0.0034876459523251182, "sim_render-ego3": 0.003506872528477719, "get_duckie_state": 1.3188311928196956e-06, "in-drivable-lane": 7.300000000000002, "deviation-heading": 1.3977668398961285, "agent_compute-ego0": 0.01141919964238217, "agent_compute-ego1": 0.011543928949456463, "agent_compute-ego2": 0.011663607547157688, "agent_compute-ego3": 0.01163410136574193, "complete-iteration": 0.7116061812952945, "set_robot_commands": 0.002090880745335629, "deviation-center-line": 0.20305885603029755, "driven_lanedir_consec": 0.35946613770605906, "sim_compute_sim_state": 0.02080960148259213, "sim_compute_performance-ego0": 0.0019472849996466383, "sim_compute_performance-ego1": 0.0018347589593184625, "sim_compute_performance-ego2": 0.0018214903379741468, "sim_compute_performance-ego3": 0.0018226523148386104}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.615485162292976, "get_ui_image": 0.038987713111074344, "step_physics": 0.5527324124386436, "survival_time": 9.45, "driven_lanedir": 1.2816334483174558, "get_state_dump": 0.009098892462880988, "get_robot_state": 0.013705187094838997, "sim_render-ego0": 0.0035581187198036597, "sim_render-ego1": 0.003509387217069927, "sim_render-ego2": 0.0034876459523251182, "sim_render-ego3": 0.003506872528477719, "get_duckie_state": 1.3188311928196956e-06, "in-drivable-lane": 4.400000000000009, "deviation-heading": 1.1366843140884673, "agent_compute-ego0": 0.01141919964238217, "agent_compute-ego1": 0.011543928949456463, "agent_compute-ego2": 0.011663607547157688, "agent_compute-ego3": 0.01163410136574193, "complete-iteration": 0.7116061812952945, "set_robot_commands": 0.002090880745335629, "deviation-center-line": 0.2674797034968778, "driven_lanedir_consec": 1.2816334483174558, "sim_compute_sim_state": 0.02080960148259213, "sim_compute_performance-ego0": 0.0019472849996466383, "sim_compute_performance-ego1": 0.0018347589593184625, "sim_compute_performance-ego2": 0.0018214903379741468, "sim_compute_performance-ego3": 0.0018226523148386104}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.1884755815589605, "get_ui_image": 0.038987713111074344, "step_physics": 0.5527324124386436, "survival_time": 9.45, "driven_lanedir": 0.8273553454342821, "get_state_dump": 0.009098892462880988, "get_robot_state": 0.013705187094838997, "sim_render-ego0": 0.0035581187198036597, "sim_render-ego1": 0.003509387217069927, "sim_render-ego2": 0.0034876459523251182, "sim_render-ego3": 0.003506872528477719, "get_duckie_state": 1.3188311928196956e-06, "in-drivable-lane": 6.0000000000000036, "deviation-heading": 1.1288951373968863, "agent_compute-ego0": 0.01141919964238217, "agent_compute-ego1": 0.011543928949456463, "agent_compute-ego2": 0.011663607547157688, "agent_compute-ego3": 0.01163410136574193, "complete-iteration": 0.7116061812952945, "set_robot_commands": 0.002090880745335629, "deviation-center-line": 0.2658642918678029, "driven_lanedir_consec": 0.8273553454342821, "sim_compute_sim_state": 0.02080960148259213, "sim_compute_performance-ego0": 0.0019472849996466383, "sim_compute_performance-ego1": 0.0018347589593184625, "sim_compute_performance-ego2": 0.0018214903379741468, "sim_compute_performance-ego3": 0.0018226523148386104}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 2.8692806037128795, "get_ui_image": 0.04898125032916117, "step_physics": 0.6700825962334572, "survival_time": 14.900000000000077, "driven_lanedir": 0.7749470515626824, "get_state_dump": 0.009301842654429153, "get_robot_state": 0.013940427614294964, "sim_render-ego0": 0.003732245103970021, "sim_render-ego1": 0.0035867627249114888, "sim_render-ego2": 0.003492263647226187, "sim_render-ego3": 0.003657533173577044, "get_duckie_state": 1.45363568462257e-06, "in-drivable-lane": 11.60000000000008, "deviation-heading": 0.9606980798520228, "agent_compute-ego0": 0.012241720754566, "agent_compute-ego1": 0.012319600701730786, "agent_compute-ego2": 0.01187852473561979, "agent_compute-ego3": 0.012555763474276234, "complete-iteration": 0.8550636872001316, "set_robot_commands": 0.002131686162789131, "deviation-center-line": 0.23503341529710797, "driven_lanedir_consec": 0.7749470515626824, "sim_compute_sim_state": 0.032876164618144466, "sim_compute_performance-ego0": 0.0020277747342419064, "sim_compute_performance-ego1": 0.0018757593671613712, "sim_compute_performance-ego2": 0.001865934767451972, "sim_compute_performance-ego3": 0.0018762553415968264}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 4.298276896998029, "get_ui_image": 0.04898125032916117, "step_physics": 0.6700825962334572, "survival_time": 14.900000000000077, "driven_lanedir": 1.067450723119306, "get_state_dump": 0.009301842654429153, "get_robot_state": 0.013940427614294964, "sim_render-ego0": 0.003732245103970021, "sim_render-ego1": 0.0035867627249114888, "sim_render-ego2": 0.003492263647226187, "sim_render-ego3": 0.003657533173577044, "get_duckie_state": 1.45363568462257e-06, "in-drivable-lane": 10.050000000000072, "deviation-heading": 2.656336735058711, "agent_compute-ego0": 0.012241720754566, "agent_compute-ego1": 0.012319600701730786, "agent_compute-ego2": 0.01187852473561979, "agent_compute-ego3": 0.012555763474276234, "complete-iteration": 0.8550636872001316, "set_robot_commands": 0.002131686162789131, "deviation-center-line": 0.4189916839626824, "driven_lanedir_consec": 1.067450723119306, "sim_compute_sim_state": 0.032876164618144466, "sim_compute_performance-ego0": 0.0020277747342419064, "sim_compute_performance-ego1": 0.0018757593671613712, "sim_compute_performance-ego2": 0.001865934767451972, "sim_compute_performance-ego3": 0.0018762553415968264}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 1.9201466171790689, "get_ui_image": 0.04898125032916117, "step_physics": 0.6700825962334572, "survival_time": 14.900000000000077, "driven_lanedir": 0.859257141855911, "get_state_dump": 0.009301842654429153, "get_robot_state": 0.013940427614294964, "sim_render-ego0": 0.003732245103970021, "sim_render-ego1": 0.0035867627249114888, "sim_render-ego2": 0.003492263647226187, "sim_render-ego3": 0.003657533173577044, "get_duckie_state": 1.45363568462257e-06, "in-drivable-lane": 11.65000000000008, "deviation-heading": 0.6840718667585405, "agent_compute-ego0": 0.012241720754566, "agent_compute-ego1": 0.012319600701730786, "agent_compute-ego2": 0.01187852473561979, "agent_compute-ego3": 0.012555763474276234, "complete-iteration": 0.8550636872001316, "set_robot_commands": 0.002131686162789131, "deviation-center-line": 0.16881305364978355, "driven_lanedir_consec": 0.859257141855911, "sim_compute_sim_state": 0.032876164618144466, "sim_compute_performance-ego0": 0.0020277747342419064, "sim_compute_performance-ego1": 0.0018757593671613712, "sim_compute_performance-ego2": 0.001865934767451972, "sim_compute_performance-ego3": 0.0018762553415968264}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 2.64657316742837, "get_ui_image": 0.04898125032916117, "step_physics": 0.6700825962334572, "survival_time": 14.900000000000077, "driven_lanedir": 0.6557541160148739, "get_state_dump": 0.009301842654429153, "get_robot_state": 0.013940427614294964, "sim_render-ego0": 0.003732245103970021, "sim_render-ego1": 0.0035867627249114888, "sim_render-ego2": 0.003492263647226187, "sim_render-ego3": 0.003657533173577044, "get_duckie_state": 1.45363568462257e-06, "in-drivable-lane": 12.05000000000008, "deviation-heading": 0.7290485491734946, "agent_compute-ego0": 0.012241720754566, "agent_compute-ego1": 0.012319600701730786, "agent_compute-ego2": 0.01187852473561979, "agent_compute-ego3": 0.012555763474276234, "complete-iteration": 0.8550636872001316, "set_robot_commands": 0.002131686162789131, "deviation-center-line": 0.09913272537287664, "driven_lanedir_consec": 0.6557541160148739, "sim_compute_sim_state": 0.032876164618144466, "sim_compute_performance-ego0": 0.0020277747342419064, "sim_compute_performance-ego1": 0.0018757593671613712, "sim_compute_performance-ego2": 0.001865934767451972, "sim_compute_performance-ego3": 0.0018762553415968264}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.7623799576283259, "get_ui_image": 0.046153618601824015, "step_physics": 0.8873312080397588, "survival_time": 13.300000000000054, "driven_lanedir": 0.24495012726670184, "get_state_dump": 0.009763401545835344, "get_robot_state": 0.014564985639593577, "sim_render-ego0": 0.003802754012832927, "sim_render-ego1": 0.00382236952192328, "sim_render-ego2": 0.003793055645089024, "sim_render-ego3": 0.003759928856896104, "get_duckie_state": 1.5867783335710733e-06, "in-drivable-lane": 11.950000000000053, "deviation-heading": 0.7410606106994201, "agent_compute-ego0": 0.012677533796217558, "agent_compute-ego1": 0.01372360558099068, "agent_compute-ego2": 0.013559127121828916, "agent_compute-ego3": 0.012700334470370288, "complete-iteration": 1.064120906122615, "set_robot_commands": 0.0021622377388486255, "deviation-center-line": 0.08424806728230494, "driven_lanedir_consec": 0.24495012726670184, "sim_compute_sim_state": 0.021111649966864997, "sim_compute_performance-ego0": 0.0021382708674513, "sim_compute_performance-ego1": 0.0019434194886282588, "sim_compute_performance-ego2": 0.0019672434874688197, "sim_compute_performance-ego3": 0.00198262282525109}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.562649497566128, "get_ui_image": 0.046153618601824015, "step_physics": 0.8873312080397588, "survival_time": 13.300000000000054, "driven_lanedir": 1.284175333587667, "get_state_dump": 0.009763401545835344, "get_robot_state": 0.014564985639593577, "sim_render-ego0": 0.003802754012832927, "sim_render-ego1": 0.00382236952192328, "sim_render-ego2": 0.003793055645089024, "sim_render-ego3": 0.003759928856896104, "get_duckie_state": 1.5867783335710733e-06, "in-drivable-lane": 8.800000000000061, "deviation-heading": 1.1202782105500786, "agent_compute-ego0": 0.012677533796217558, "agent_compute-ego1": 0.01372360558099068, "agent_compute-ego2": 0.013559127121828916, "agent_compute-ego3": 0.012700334470370288, "complete-iteration": 1.064120906122615, "set_robot_commands": 0.0021622377388486255, "deviation-center-line": 0.3270186500188133, "driven_lanedir_consec": 1.284175333587667, "sim_compute_sim_state": 0.021111649966864997, "sim_compute_performance-ego0": 0.0021382708674513, "sim_compute_performance-ego1": 0.0019434194886282588, "sim_compute_performance-ego2": 0.0019672434874688197, "sim_compute_performance-ego3": 0.00198262282525109}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.802168275048214, "get_ui_image": 0.046153618601824015, "step_physics": 0.8873312080397588, "survival_time": 13.300000000000054, "driven_lanedir": 0.6978339346860436, "get_state_dump": 0.009763401545835344, "get_robot_state": 0.014564985639593577, "sim_render-ego0": 0.003802754012832927, "sim_render-ego1": 0.00382236952192328, "sim_render-ego2": 0.003793055645089024, "sim_render-ego3": 0.003759928856896104, "get_duckie_state": 1.5867783335710733e-06, "in-drivable-lane": 10.600000000000056, "deviation-heading": 0.7004773763186914, "agent_compute-ego0": 0.012677533796217558, "agent_compute-ego1": 0.01372360558099068, "agent_compute-ego2": 0.013559127121828916, "agent_compute-ego3": 0.012700334470370288, "complete-iteration": 1.064120906122615, "set_robot_commands": 0.0021622377388486255, "deviation-center-line": 0.1767500596015691, "driven_lanedir_consec": 0.6978339346860436, "sim_compute_sim_state": 0.021111649966864997, "sim_compute_performance-ego0": 0.0021382708674513, "sim_compute_performance-ego1": 0.0019434194886282588, "sim_compute_performance-ego2": 0.0019672434874688197, "sim_compute_performance-ego3": 0.00198262282525109}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 3.5780684405045866, "get_ui_image": 0.046153618601824015, "step_physics": 0.8873312080397588, "survival_time": 13.300000000000054, "driven_lanedir": 0.8464744095496015, "get_state_dump": 0.009763401545835344, "get_robot_state": 0.014564985639593577, "sim_render-ego0": 0.003802754012832927, "sim_render-ego1": 0.00382236952192328, "sim_render-ego2": 0.003793055645089024, "sim_render-ego3": 0.003759928856896104, "get_duckie_state": 1.5867783335710733e-06, "in-drivable-lane": 10.250000000000057, "deviation-heading": 0.7181319019191525, "agent_compute-ego0": 0.012677533796217558, "agent_compute-ego1": 0.01372360558099068, "agent_compute-ego2": 0.013559127121828916, "agent_compute-ego3": 0.012700334470370288, "complete-iteration": 1.064120906122615, "set_robot_commands": 0.0021622377388486255, "deviation-center-line": 0.1895411034952118, "driven_lanedir_consec": 0.8464744095496015, "sim_compute_sim_state": 0.021111649966864997, "sim_compute_performance-ego0": 0.0021382708674513, "sim_compute_performance-ego1": 0.0019434194886282588, "sim_compute_performance-ego2": 0.0019672434874688197, "sim_compute_performance-ego3": 0.00198262282525109}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.4161523710575676, "get_ui_image": 0.02958541363477707, "step_physics": 0.21262244135141373, "survival_time": 7.94999999999998, "driven_lanedir": 0.9133909580336328, "get_state_dump": 0.005971045792102813, "get_robot_state": 0.0069264695048332214, "sim_render-ego0": 0.003598910570144653, "sim_render-ego1": 0.003598615527153015, "get_duckie_state": 1.3440847396850586e-06, "in-drivable-lane": 4.499999999999984, "deviation-heading": 1.0653593805844634, "agent_compute-ego0": 0.012261325120925905, "agent_compute-ego1": 0.012217597663402555, "complete-iteration": 0.30210451036691666, "set_robot_commands": 0.0020465061068534853, "deviation-center-line": 0.2066215262368786, "driven_lanedir_consec": 0.9133909580336328, "sim_compute_sim_state": 0.007325181365013122, "sim_compute_performance-ego0": 0.0018923714756965636, "sim_compute_performance-ego1": 0.0018469080328941344}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 2.0038883015081232, "get_ui_image": 0.02958541363477707, "step_physics": 0.21262244135141373, "survival_time": 7.94999999999998, "driven_lanedir": 0.3299612771924556, "get_state_dump": 0.005971045792102813, "get_robot_state": 0.0069264695048332214, "sim_render-ego0": 0.003598910570144653, "sim_render-ego1": 0.003598615527153015, "get_duckie_state": 1.3440847396850586e-06, "in-drivable-lane": 5.949999999999983, "deviation-heading": 1.446733773050285, "agent_compute-ego0": 0.012261325120925905, "agent_compute-ego1": 0.012217597663402555, "complete-iteration": 0.30210451036691666, "set_robot_commands": 0.0020465061068534853, "deviation-center-line": 0.16712627189355356, "driven_lanedir_consec": 0.3299612771924556, "sim_compute_sim_state": 0.007325181365013122, "sim_compute_performance-ego0": 0.0018923714756965636, "sim_compute_performance-ego1": 0.0018469080328941344}}
set_robot_commands_max0.0021622377388486255
set_robot_commands_mean0.0021165879144000367
set_robot_commands_median0.002131686162789131
set_robot_commands_min0.0020465061068534853
sim_compute_performance-ego0_max0.0021382708674513
sim_compute_performance-ego0_mean0.002017004668339464
sim_compute_performance-ego0_median0.0020277747342419064
sim_compute_performance-ego0_min0.0018923714756965636
sim_compute_performance-ego1_max0.0019434194886282588
sim_compute_performance-ego1_mean0.00187925480901576
sim_compute_performance-ego1_median0.0018757593671613712
sim_compute_performance-ego1_min0.0018347589593184625
sim_compute_sim_state_max0.032876164618144466
sim_compute_sim_state_mean0.022417144785745195
sim_compute_sim_state_median0.021111649966864997
sim_compute_sim_state_min0.007325181365013122
sim_render-ego0_max0.003802754012832927
sim_render-ego0_mean0.003683592320479695
sim_render-ego0_median0.003732245103970021
sim_render-ego0_min0.0035581187198036597
sim_render-ego1_max0.00382236952192328
sim_render-ego1_mean0.0036336649221374866
sim_render-ego1_median0.0035867627249114888
sim_render-ego1_min0.003509387217069927
simulation-passed1
step_physics_max0.8873312080397588
step_physics_mean0.6332735535393048
step_physics_median0.6700825962334572
step_physics_min0.21262244135141373
survival_time_max14.900000000000077
survival_time_mean11.892857142857178
survival_time_min7.94999999999998
No reset possible
53634LFVmultibodyv-simsuccessyes0:16:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible