Duckietown Challenges Home Challenges Submissions

Submission 12773

Submission12773
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserAnastasiya Nikolskaya 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 58954
Next
User labelJetBrains Research
Admin priority50
Blessingn/a
User priority50

58954

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
58954LFVmultibodyv-simsuccessyes1:49:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median15.768092984136178
survival_time_median48.04999999999941
deviation-center-line_median2.4816232051115006
in-drivable-lane_median2.100000000000016


other stats
agent_compute-ego0_max0.015085340537549057
agent_compute-ego0_mean0.014845843709965388
agent_compute-ego0_median0.01482883817845836
agent_compute-ego0_min0.014577040166565866
agent_compute-ego1_max0.015244640180411486
agent_compute-ego1_mean0.014979118026291816
agent_compute-ego1_median0.014991316626820395
agent_compute-ego1_min0.014789103646098955
agent_compute-ego2_max0.015308963285910117
agent_compute-ego2_mean0.015131134840017931
agent_compute-ego2_median0.015206994053439376
agent_compute-ego2_min0.014877447180704313
agent_compute-ego3_max0.015070442462864595
agent_compute-ego3_mean0.01496163601258671
agent_compute-ego3_median0.015012090270583697
agent_compute-ego3_min0.014802375304311836
complete-iteration_max1.2966506761183352
complete-iteration_mean0.9941573113800578
complete-iteration_median1.1472065282710624
complete-iteration_min0.35622453018700406
deviation-center-line_max3.073711907021793
deviation-center-line_mean2.3499380809260466
deviation-center-line_min1.3349227435184876
deviation-heading_max17.00355237881513
deviation-heading_mean11.37826132495267
deviation-heading_median11.845120324531145
deviation-heading_min6.77356244322754
driven_any_max26.702242712665484
driven_any_mean17.47296861035939
driven_any_median17.235219145546615
driven_any_min9.590555664750608
driven_lanedir_consec_max25.522602401278455
driven_lanedir_consec_mean16.15759519480056
driven_lanedir_consec_min8.43897804742926
driven_lanedir_max25.522602401278455
driven_lanedir_mean16.15759519480056
driven_lanedir_median15.768092984136178
driven_lanedir_min8.43897804742926
get_duckie_state_max1.753299659138218e-06
get_duckie_state_mean1.643549647341366e-06
get_duckie_state_median1.6952007079570555e-06
get_duckie_state_min1.4379943088019563e-06
get_robot_state_max0.014428045757820016
get_robot_state_mean0.013269790180628516
get_robot_state_median0.014225117877714352
get_robot_state_min0.007145969640640985
get_state_dump_max0.0097542706210094
get_state_dump_mean0.00919676024025624
get_state_dump_median0.009664024937460564
get_state_dump_min0.00625407076501227
get_ui_image_max0.050297905401058045
get_ui_image_mean0.04431083290103797
get_ui_image_median0.04727399597049008
get_ui_image_min0.029854056897101463
in-drivable-lane_max23.34999999999917
in-drivable-lane_mean5.457142857142712
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 25.839655620699837, "get_ui_image": 0.04258898533353401, "step_physics": 0.667083664003955, "survival_time": 59.99999999999873, "driven_lanedir": 24.654698878288837, "get_state_dump": 0.009664024937460564, "get_robot_state": 0.014218117176344948, "sim_render-ego0": 0.003779083167782037, "sim_render-ego1": 0.003703273206229611, "sim_render-ego2": 0.0036979329079811422, "sim_render-ego3": 0.003711991067929232, "get_duckie_state": 1.753299659138218e-06, "in-drivable-lane": 0.9000000000000128, "deviation-heading": 14.122195721993624, "agent_compute-ego0": 0.01482883817845836, "agent_compute-ego1": 0.015244640180411486, "agent_compute-ego2": 0.014877447180704313, "agent_compute-ego3": 0.014802375304311836, "complete-iteration": 0.8575811203473017, "set_robot_commands": 0.002138064763230349, "deviation-center-line": 2.8449381594705, "driven_lanedir_consec": 24.654698878288837, "sim_compute_sim_state": 0.03269156647363769, "sim_compute_performance-ego0": 0.00205883316751523, "sim_compute_performance-ego1": 0.00195869498209195, "sim_compute_performance-ego2": 0.001946093140791894, "sim_compute_performance-ego3": 0.0019640753807175864}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 26.02818266179944, "get_ui_image": 0.04258898533353401, "step_physics": 0.667083664003955, "survival_time": 59.99999999999873, "driven_lanedir": 24.54396790312344, "get_state_dump": 0.009664024937460564, "get_robot_state": 0.014218117176344948, "sim_render-ego0": 0.003779083167782037, "sim_render-ego1": 0.003703273206229611, "sim_render-ego2": 0.0036979329079811422, "sim_render-ego3": 0.003711991067929232, "get_duckie_state": 1.753299659138218e-06, "in-drivable-lane": 2.0499999999999474, "deviation-heading": 13.616091948191738, "agent_compute-ego0": 0.01482883817845836, "agent_compute-ego1": 0.015244640180411486, "agent_compute-ego2": 0.014877447180704313, "agent_compute-ego3": 0.014802375304311836, "complete-iteration": 0.8575811203473017, "set_robot_commands": 0.002138064763230349, "deviation-center-line": 3.073711907021793, "driven_lanedir_consec": 24.54396790312344, "sim_compute_sim_state": 0.03269156647363769, "sim_compute_performance-ego0": 0.00205883316751523, "sim_compute_performance-ego1": 0.00195869498209195, "sim_compute_performance-ego2": 0.001946093140791894, "sim_compute_performance-ego3": 0.0019640753807175864}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 22.937376707262835, "get_ui_image": 0.04258898533353401, "step_physics": 0.667083664003955, "survival_time": 59.99999999999873, "driven_lanedir": 20.698152306256283, "get_state_dump": 0.009664024937460564, "get_robot_state": 0.014218117176344948, "sim_render-ego0": 0.003779083167782037, "sim_render-ego1": 0.003703273206229611, "sim_render-ego2": 0.0036979329079811422, "sim_render-ego3": 0.003711991067929232, "get_duckie_state": 1.753299659138218e-06, "in-drivable-lane": 3.399999999999938, "deviation-heading": 17.00355237881513, "agent_compute-ego0": 0.01482883817845836, "agent_compute-ego1": 0.015244640180411486, "agent_compute-ego2": 0.014877447180704313, "agent_compute-ego3": 0.014802375304311836, "complete-iteration": 0.8575811203473017, "set_robot_commands": 0.002138064763230349, "deviation-center-line": 2.925449236393598, "driven_lanedir_consec": 20.698152306256283, "sim_compute_sim_state": 0.03269156647363769, "sim_compute_performance-ego0": 0.00205883316751523, "sim_compute_performance-ego1": 0.00195869498209195, "sim_compute_performance-ego2": 0.001946093140791894, "sim_compute_performance-ego3": 0.0019640753807175864}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 26.702242712665484, "get_ui_image": 0.04258898533353401, "step_physics": 0.667083664003955, "survival_time": 59.99999999999873, "driven_lanedir": 25.522602401278455, "get_state_dump": 0.009664024937460564, "get_robot_state": 0.014218117176344948, "sim_render-ego0": 0.003779083167782037, "sim_render-ego1": 0.003703273206229611, "sim_render-ego2": 0.0036979329079811422, "sim_render-ego3": 0.003711991067929232, "get_duckie_state": 1.753299659138218e-06, "in-drivable-lane": 1.2999999999999332, "deviation-heading": 12.633596105686296, "agent_compute-ego0": 0.01482883817845836, "agent_compute-ego1": 0.015244640180411486, "agent_compute-ego2": 0.014877447180704313, "agent_compute-ego3": 0.014802375304311836, "complete-iteration": 0.8575811203473017, "set_robot_commands": 0.002138064763230349, "deviation-center-line": 3.000607712129884, "driven_lanedir_consec": 25.522602401278455, "sim_compute_sim_state": 0.03269156647363769, "sim_compute_performance-ego0": 0.00205883316751523, "sim_compute_performance-ego1": 0.00195869498209195, "sim_compute_performance-ego2": 0.001946093140791894, "sim_compute_performance-ego3": 0.0019640753807175864}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 9.631784876170276, "get_ui_image": 0.050297905401058045, "step_physics": 1.092767895695285, "survival_time": 43.79999999999965, "driven_lanedir": 8.43897804742926, "get_state_dump": 0.0097542706210094, "get_robot_state": 0.014428045757820016, "sim_render-ego0": 0.0037901246561291824, "sim_render-ego1": 0.00372645738051446, "sim_render-ego2": 0.0037056804382950576, "sim_render-ego3": 0.0037565318317478577, "get_duckie_state": 1.5849262441985284e-06, "in-drivable-lane": 21.54999999999945, "deviation-heading": 6.852265012593153, "agent_compute-ego0": 0.014757754185588494, "agent_compute-ego1": 0.014789103646098955, "agent_compute-ego2": 0.015206994053439376, "agent_compute-ego3": 0.015070442462864595, "complete-iteration": 1.2966506761183352, "set_robot_commands": 0.002243510129922064, "deviation-center-line": 1.3349227435184876, "driven_lanedir_consec": 8.43897804742926, "sim_compute_sim_state": 0.037583360106534534, "sim_compute_performance-ego0": 0.0020379316032000795, "sim_compute_performance-ego1": 0.0019743021157067886, "sim_compute_performance-ego2": 0.00195438016371689, "sim_compute_performance-ego3": 0.001963106773054586}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 14.04095573169968, "get_ui_image": 0.050297905401058045, "step_physics": 1.092767895695285, "survival_time": 43.79999999999965, "driven_lanedir": 12.734353737613578, "get_state_dump": 0.0097542706210094, "get_robot_state": 0.014428045757820016, "sim_render-ego0": 0.0037901246561291824, "sim_render-ego1": 0.00372645738051446, "sim_render-ego2": 0.0037056804382950576, "sim_render-ego3": 0.0037565318317478577, "get_duckie_state": 1.5849262441985284e-06, "in-drivable-lane": 2.150000000000003, "deviation-heading": 12.766512847701373, "agent_compute-ego0": 0.014757754185588494, "agent_compute-ego1": 0.014789103646098955, "agent_compute-ego2": 0.015206994053439376, "agent_compute-ego3": 0.015070442462864595, "complete-iteration": 1.2966506761183352, "set_robot_commands": 0.002243510129922064, "deviation-center-line": 1.9659639331008725, "driven_lanedir_consec": 12.734353737613578, "sim_compute_sim_state": 0.037583360106534534, "sim_compute_performance-ego0": 0.0020379316032000795, "sim_compute_performance-ego1": 0.0019743021157067886, "sim_compute_performance-ego2": 0.00195438016371689, "sim_compute_performance-ego3": 0.001963106773054586}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 17.57831484340754, "get_ui_image": 0.050297905401058045, "step_physics": 1.092767895695285, "survival_time": 43.79999999999965, "driven_lanedir": 15.940150120082492, "get_state_dump": 0.0097542706210094, "get_robot_state": 0.014428045757820016, "sim_render-ego0": 0.0037901246561291824, "sim_render-ego1": 0.00372645738051446, "sim_render-ego2": 0.0037056804382950576, "sim_render-ego3": 0.0037565318317478577, "get_duckie_state": 1.5849262441985284e-06, "in-drivable-lane": 2.9500000000000144, "deviation-heading": 11.542244265467234, "agent_compute-ego0": 0.014757754185588494, "agent_compute-ego1": 0.014789103646098955, "agent_compute-ego2": 0.015206994053439376, "agent_compute-ego3": 0.015070442462864595, "complete-iteration": 1.2966506761183352, "set_robot_commands": 0.002243510129922064, "deviation-center-line": 2.23080018606186, "driven_lanedir_consec": 15.940150120082492, "sim_compute_sim_state": 0.037583360106534534, "sim_compute_performance-ego0": 0.0020379316032000795, "sim_compute_performance-ego1": 0.0019743021157067886, "sim_compute_performance-ego2": 0.00195438016371689, "sim_compute_performance-ego3": 0.001963106773054586}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 9.590555664750608, "get_ui_image": 0.050297905401058045, "step_physics": 1.092767895695285, "survival_time": 43.79999999999965, "driven_lanedir": 8.663901152113226, "get_state_dump": 0.0097542706210094, "get_robot_state": 0.014428045757820016, "sim_render-ego0": 0.0037901246561291824, "sim_render-ego1": 0.00372645738051446, "sim_render-ego2": 0.0037056804382950576, "sim_render-ego3": 0.0037565318317478577, "get_duckie_state": 1.5849262441985284e-06, "in-drivable-lane": 1.050000000000006, "deviation-heading": 9.822295454188904, "agent_compute-ego0": 0.014757754185588494, "agent_compute-ego1": 0.014789103646098955, "agent_compute-ego2": 0.015206994053439376, "agent_compute-ego3": 0.015070442462864595, "complete-iteration": 1.2966506761183352, "set_robot_commands": 0.002243510129922064, "deviation-center-line": 1.8628002839736992, "driven_lanedir_consec": 8.663901152113226, "sim_compute_sim_state": 0.037583360106534534, "sim_compute_performance-ego0": 0.0020379316032000795, "sim_compute_performance-ego1": 0.0019743021157067886, "sim_compute_performance-ego2": 0.00195438016371689, "sim_compute_performance-ego3": 0.001963106773054586}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 16.892123447685695, "get_ui_image": 0.04727399597049008, "step_physics": 0.9498865936501358, "survival_time": 48.04999999999941, "driven_lanedir": 15.596035848189866, "get_state_dump": 0.009643329899920745, "get_robot_state": 0.014225117877714352, "sim_render-ego0": 0.003778573876854784, "sim_render-ego1": 0.0037455727305580823, "sim_render-ego2": 0.003755381102373595, "sim_render-ego3": 0.0037112662301489814, "get_duckie_state": 1.6952007079570555e-06, "in-drivable-lane": 2.050000000000029, "deviation-heading": 10.094930711364066, "agent_compute-ego0": 0.015085340537549057, "agent_compute-ego1": 0.014991316626820395, "agent_compute-ego2": 0.015308963285910117, "agent_compute-ego3": 0.015012090270583697, "complete-iteration": 1.1472065282710624, "set_robot_commands": 0.0021179495631037533, "deviation-center-line": 2.6290101760670908, "driven_lanedir_consec": 15.596035848189866, "sim_compute_sim_state": 0.033851051528835496, "sim_compute_performance-ego0": 0.0020263432960748178, "sim_compute_performance-ego1": 0.001955668296734657, "sim_compute_performance-ego2": 0.002001158165089058, "sim_compute_performance-ego3": 0.001975325933365217}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 11.03874421265906, "get_ui_image": 0.04727399597049008, "step_physics": 0.9498865936501358, "survival_time": 48.04999999999941, "driven_lanedir": 9.966828712196367, "get_state_dump": 0.009643329899920745, "get_robot_state": 0.014225117877714352, "sim_render-ego0": 0.003778573876854784, "sim_render-ego1": 0.0037455727305580823, "sim_render-ego2": 0.003755381102373595, "sim_render-ego3": 0.0037112662301489814, "get_duckie_state": 1.6952007079570555e-06, "in-drivable-lane": 23.34999999999917, "deviation-heading": 6.77356244322754, "agent_compute-ego0": 0.015085340537549057, "agent_compute-ego1": 0.014991316626820395, "agent_compute-ego2": 0.015308963285910117, "agent_compute-ego3": 0.015012090270583697, "complete-iteration": 1.1472065282710624, "set_robot_commands": 0.0021179495631037533, "deviation-center-line": 1.3709051248801234, "driven_lanedir_consec": 9.966828712196367, "sim_compute_sim_state": 0.033851051528835496, "sim_compute_performance-ego0": 0.0020263432960748178, "sim_compute_performance-ego1": 0.001955668296734657, "sim_compute_performance-ego2": 0.002001158165089058, "sim_compute_performance-ego3": 0.001975325933365217}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 10.004174549314063, "get_ui_image": 0.04727399597049008, "step_physics": 0.9498865936501358, "survival_time": 48.04999999999941, "driven_lanedir": 8.633051927347433, "get_state_dump": 0.009643329899920745, "get_robot_state": 0.014225117877714352, "sim_render-ego0": 0.003778573876854784, "sim_render-ego1": 0.0037455727305580823, "sim_render-ego2": 0.003755381102373595, "sim_render-ego3": 0.0037112662301489814, "get_duckie_state": 1.6952007079570555e-06, "in-drivable-lane": 2.2000000000000233, "deviation-heading": 10.56318949227458, "agent_compute-ego0": 0.015085340537549057, "agent_compute-ego1": 0.014991316626820395, "agent_compute-ego2": 0.015308963285910117, "agent_compute-ego3": 0.015012090270583697, "complete-iteration": 1.1472065282710624, "set_robot_commands": 0.0021179495631037533, "deviation-center-line": 2.5812250105628136, "driven_lanedir_consec": 8.633051927347433, "sim_compute_sim_state": 0.033851051528835496, "sim_compute_performance-ego0": 0.0020263432960748178, "sim_compute_performance-ego1": 0.001955668296734657, "sim_compute_performance-ego2": 0.002001158165089058, "sim_compute_performance-ego3": 0.001975325933365217}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 19.830112598553107, "get_ui_image": 0.04727399597049008, "step_physics": 0.9498865936501358, "survival_time": 48.04999999999941, "driven_lanedir": 18.78516725861944, "get_state_dump": 0.009643329899920745, "get_robot_state": 0.014225117877714352, "sim_render-ego0": 0.003778573876854784, "sim_render-ego1": 0.0037455727305580823, "sim_render-ego2": 0.003755381102373595, "sim_render-ego3": 0.0037112662301489814, "get_duckie_state": 1.6952007079570555e-06, "in-drivable-lane": 0.6000000000000085, "deviation-heading": 12.238662002694836, "agent_compute-ego0": 0.015085340537549057, "agent_compute-ego1": 0.014991316626820395, "agent_compute-ego2": 0.015308963285910117, "agent_compute-ego3": 0.015012090270583697, "complete-iteration": 1.1472065282710624, "set_robot_commands": 0.0021179495631037533, "deviation-center-line": 2.516928814372856, "driven_lanedir_consec": 18.78516725861944, "sim_compute_sim_state": 0.033851051528835496, "sim_compute_performance-ego0": 0.0020263432960748178, "sim_compute_performance-ego1": 0.001955668296734657, "sim_compute_performance-ego2": 0.002001158165089058, "sim_compute_performance-ego3": 0.001975325933365217}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 21.303511656910267, "get_ui_image": 0.029854056897101463, "step_physics": 0.2568172239637994, "survival_time": 46.149999999999515, "driven_lanedir": 20.71100578690797, "get_state_dump": 0.00625407076501227, "get_robot_state": 0.007145969640640985, "sim_render-ego0": 0.003854104966828317, "sim_render-ego1": 0.003816731048352791, "get_duckie_state": 1.4379943088019563e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.11856378154384, "agent_compute-ego0": 0.014577040166565866, "agent_compute-ego1": 0.014803705277381006, "complete-iteration": 0.35622453018700406, "set_robot_commands": 0.0023183489774728752, "deviation-center-line": 2.4463175958501453, "driven_lanedir_consec": 20.71100578690797, "sim_compute_sim_state": 0.010275390499081962, "sim_compute_performance-ego0": 0.002033826850709461, "sim_compute_performance-ego1": 0.0020268698791404824}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 13.20382526145355, "get_ui_image": 0.029854056897101463, "step_physics": 0.2568172239637994, "survival_time": 46.149999999999515, "driven_lanedir": 11.317438647761206, "get_state_dump": 0.00625407076501227, "get_robot_state": 0.007145969640640985, "sim_render-ego0": 0.003854104966828317, "sim_render-ego1": 0.003816731048352791, "get_duckie_state": 1.4379943088019563e-06, "in-drivable-lane": 12.849999999999426, "deviation-heading": 12.147996383595055, "agent_compute-ego0": 0.014577040166565866, "agent_compute-ego1": 0.014803705277381006, "complete-iteration": 0.35622453018700406, "set_robot_commands": 0.0023183489774728752, "deviation-center-line": 2.115552249560923, "driven_lanedir_consec": 11.317438647761206, "sim_compute_sim_state": 0.010275390499081962, "sim_compute_performance-ego0": 0.002033826850709461, "sim_compute_performance-ego1": 0.0020268698791404824}}
set_robot_commands_max0.0023183489774728752
set_robot_commands_mean0.002188199698569315
set_robot_commands_median0.002138064763230349
set_robot_commands_min0.0021179495631037533
sim_compute_performance-ego0_max0.00205883316751523
sim_compute_performance-ego0_mean0.002040006140612817
sim_compute_performance-ego0_median0.0020379316032000795
sim_compute_performance-ego0_min0.0020263432960748178
sim_compute_performance-ego1_max0.0020268698791404824
sim_compute_performance-ego1_mean0.001972028666886754
sim_compute_performance-ego1_median0.00195869498209195
sim_compute_performance-ego1_min0.001955668296734657
sim_compute_performance-ego2_max0.002001158165089058
sim_compute_performance-ego2_mean0.001967210489865947
sim_compute_performance-ego2_median0.00195438016371689
sim_compute_performance-ego2_min0.001946093140791894
sim_compute_performance-ego3_max0.001975325933365217
sim_compute_performance-ego3_mean0.0019675026957124636
sim_compute_performance-ego3_median0.0019640753807175864
sim_compute_performance-ego3_min0.001963106773054586
sim_compute_sim_state_max0.037583360106534534
sim_compute_sim_state_mean0.03121819238815677
sim_compute_sim_state_median0.033851051528835496
sim_compute_sim_state_min0.010275390499081962
sim_render-ego0_max0.003854104966828317
sim_render-ego0_mean0.003792809766908617
sim_render-ego0_median0.003779083167782037
sim_render-ego0_min0.003778573876854784
sim_render-ego1_max0.003816731048352791
sim_render-ego1_mean0.0037381910975652992
sim_render-ego1_median0.00372645738051446
sim_render-ego1_min0.003703273206229611
sim_render-ego2_max0.003755381102373595
sim_render-ego2_mean0.003719664816216599
sim_render-ego2_median0.0037056804382950576
sim_render-ego2_min0.0036979329079811422
sim_render-ego3_max0.0037565318317478577
sim_render-ego3_mean0.0037265963766086904
sim_render-ego3_median0.003711991067929232
sim_render-ego3_min0.0037112662301489814
simulation-passed1
step_physics_max1.092767895695285
step_physics_mean0.810899075808936
step_physics_median0.9498865936501358
step_physics_min0.2568172239637994
survival_time_max59.99999999999873
survival_time_mean49.97857142857072
survival_time_min43.79999999999965
No reset possible
58953LFVmultibodyv-simsuccessyes2:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible