Duckietown Challenges Home Challenges Submissions

Submission 12807

Submission12807
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserYishu Malhotra 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 58930
Next
User labelexercise_state_estimation
Admin priority50
Blessingn/a
User priority50

58930

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
58930LFVmultibodyv-simsuccessyes1:55:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.016881952848657
survival_time_median59.99999999999873
deviation-center-line_median4.121255478544164
in-drivable-lane_median0.6249999999999645


other stats
agent_compute-ego0_max0.01333337243053935
agent_compute-ego0_mean0.012896114826712862
agent_compute-ego0_median0.012901024258603264
agent_compute-ego0_min0.012408720067299771
agent_compute-ego1_max0.0135444363983942
agent_compute-ego1_mean0.01283460782458216
agent_compute-ego1_median0.012893010337187984
agent_compute-ego1_min0.012354700094853512
complete-iteration_max0.9161993919264564
complete-iteration_mean0.7569613731246337
complete-iteration_median0.8466593871803506
complete-iteration_min0.33261132141037053
deviation-center-line_max4.417432344590009
deviation-center-line_mean3.9116905221736
deviation-center-line_min0.9557129588974606
deviation-heading_max20.81176767698199
deviation-heading_mean17.00867696258994
deviation-heading_median18.23178185112021
deviation-heading_min4.0749169904017775
driven_any_max12.784178404934696
driven_any_mean12.161404688117088
driven_any_median12.176152497518434
driven_any_min10.925991489116916
driven_lanedir_consec_max11.90157601048665
driven_lanedir_consec_mean10.129663624407948
driven_lanedir_consec_min2.341445075665857
driven_lanedir_max11.90157601048665
driven_lanedir_mean10.551903792622651
driven_lanedir_median11.082149622872333
driven_lanedir_min2.343229048079627
get_duckie_state_max1.6157275731120877e-06
get_duckie_state_mean1.559660779858396e-06
get_duckie_state_median1.584163414846352e-06
get_duckie_state_min1.4821258214590056e-06
get_robot_state_max0.015325514303456734
get_robot_state_mean0.013954882249120898
get_robot_state_median0.015184543809723993
get_robot_state_min0.007663434987064206
get_state_dump_max0.01010729351408972
get_state_dump_mean0.009454210320394785
get_state_dump_median0.0099119048233731
get_state_dump_min0.006666496135511565
get_ui_image_max0.05090052877040231
get_ui_image_mean0.044934949878281075
get_ui_image_median0.047864417648633056
get_ui_image_min0.03283089702075764
in-drivable-lane_max46.44999999999867
in-drivable-lane_mean4.260714285714181
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 12.453913272998776, "get_ui_image": 0.04209192964456957, "step_physics": 0.542440710020105, "survival_time": 59.99999999999873, "driven_lanedir": 11.621440705360683, "get_state_dump": 0.009737289716163146, "get_robot_state": 0.014500312265210306, "sim_render-ego0": 0.003908721136113786, "sim_render-ego1": 0.0040777922669219336, "sim_render-ego2": 0.004016049200053219, "sim_render-ego3": 0.004035489346760695, "get_duckie_state": 1.517858830816442e-06, "in-drivable-lane": 0.0, "deviation-heading": 18.44165659749622, "agent_compute-ego0": 0.012408720067299771, "agent_compute-ego1": 0.012354700094853512, "agent_compute-ego2": 0.012291000447205758, "agent_compute-ego3": 0.012026643276611631, "complete-iteration": 0.7202003661242254, "set_robot_commands": 0.002212088669865058, "deviation-center-line": 4.008864378055282, "driven_lanedir_consec": 11.621440705360683, "sim_compute_sim_state": 0.028971628582944085, "sim_compute_performance-ego0": 0.002131986181305211, "sim_compute_performance-ego1": 0.0019769386685361077, "sim_compute_performance-ego2": 0.0020070655657588, "sim_compute_performance-ego3": 0.002032337538110128}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 11.44479947474145, "get_ui_image": 0.04209192964456957, "step_physics": 0.542440710020105, "survival_time": 59.99999999999873, "driven_lanedir": 10.869928439401626, "get_state_dump": 0.009737289716163146, "get_robot_state": 0.014500312265210306, "sim_render-ego0": 0.003908721136113786, "sim_render-ego1": 0.0040777922669219336, "sim_render-ego2": 0.004016049200053219, "sim_render-ego3": 0.004035489346760695, "get_duckie_state": 1.517858830816442e-06, "in-drivable-lane": 0.0, "deviation-heading": 15.113841198895464, "agent_compute-ego0": 0.012408720067299771, "agent_compute-ego1": 0.012354700094853512, "agent_compute-ego2": 0.012291000447205758, "agent_compute-ego3": 0.012026643276611631, "complete-iteration": 0.7202003661242254, "set_robot_commands": 0.002212088669865058, "deviation-center-line": 4.417432344590009, "driven_lanedir_consec": 10.869928439401626, "sim_compute_sim_state": 0.028971628582944085, "sim_compute_performance-ego0": 0.002131986181305211, "sim_compute_performance-ego1": 0.0019769386685361077, "sim_compute_performance-ego2": 0.0020070655657588, "sim_compute_performance-ego3": 0.002032337538110128}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 10.925991489116916, "get_ui_image": 0.04209192964456957, "step_physics": 0.542440710020105, "survival_time": 59.99999999999873, "driven_lanedir": 10.208198872501656, "get_state_dump": 0.009737289716163146, "get_robot_state": 0.014500312265210306, "sim_render-ego0": 0.003908721136113786, "sim_render-ego1": 0.0040777922669219336, "sim_render-ego2": 0.004016049200053219, "sim_render-ego3": 0.004035489346760695, "get_duckie_state": 1.517858830816442e-06, "in-drivable-lane": 0.20000000000000284, "deviation-heading": 18.391507191060853, "agent_compute-ego0": 0.012408720067299771, "agent_compute-ego1": 0.012354700094853512, "agent_compute-ego2": 0.012291000447205758, "agent_compute-ego3": 0.012026643276611631, "complete-iteration": 0.7202003661242254, "set_robot_commands": 0.002212088669865058, "deviation-center-line": 3.894091351439982, "driven_lanedir_consec": 10.208198872501656, "sim_compute_sim_state": 0.028971628582944085, "sim_compute_performance-ego0": 0.002131986181305211, "sim_compute_performance-ego1": 0.0019769386685361077, "sim_compute_performance-ego2": 0.0020070655657588, "sim_compute_performance-ego3": 0.002032337538110128}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 12.660691278983178, "get_ui_image": 0.04209192964456957, "step_physics": 0.542440710020105, "survival_time": 59.99999999999873, "driven_lanedir": 11.621996591712602, "get_state_dump": 0.009737289716163146, "get_robot_state": 0.014500312265210306, "sim_render-ego0": 0.003908721136113786, "sim_render-ego1": 0.0040777922669219336, "sim_render-ego2": 0.004016049200053219, "sim_render-ego3": 0.004035489346760695, "get_duckie_state": 1.517858830816442e-06, "in-drivable-lane": 2.600000000000037, "deviation-heading": 16.29214598710879, "agent_compute-ego0": 0.012408720067299771, "agent_compute-ego1": 0.012354700094853512, "agent_compute-ego2": 0.012291000447205758, "agent_compute-ego3": 0.012026643276611631, "complete-iteration": 0.7202003661242254, "set_robot_commands": 0.002212088669865058, "deviation-center-line": 4.1310780275347785, "driven_lanedir_consec": 11.621996591712602, "sim_compute_sim_state": 0.028971628582944085, "sim_compute_performance-ego0": 0.002131986181305211, "sim_compute_performance-ego1": 0.0019769386685361077, "sim_compute_performance-ego2": 0.0020070655657588, "sim_compute_performance-ego3": 0.002032337538110128}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 12.241954282758831, "get_ui_image": 0.05090052877040231, "step_physics": 0.7032282735584777, "survival_time": 59.99999999999873, "driven_lanedir": 11.029022331882606, "get_state_dump": 0.01010729351408972, "get_robot_state": 0.015184543809723993, "sim_render-ego0": 0.004122693572413613, "sim_render-ego1": 0.0042501726714300175, "sim_render-ego2": 0.004204079074526111, "sim_render-ego3": 0.004207205911361605, "get_duckie_state": 1.584163414846352e-06, "in-drivable-lane": 1.499999999999961, "deviation-heading": 18.842934438296933, "agent_compute-ego0": 0.012901024258603264, "agent_compute-ego1": 0.012893010337187984, "agent_compute-ego2": 0.013015697838166274, "agent_compute-ego3": 0.012670333339808684, "complete-iteration": 0.9161993919264564, "set_robot_commands": 0.0023539866337073433, "deviation-center-line": 4.396232120527394, "driven_lanedir_consec": 11.029022331882606, "sim_compute_sim_state": 0.05007913448133636, "sim_compute_performance-ego0": 0.00234310950565894, "sim_compute_performance-ego1": 0.0021395109575257313, "sim_compute_performance-ego2": 0.002125556224788059, "sim_compute_performance-ego3": 0.0020971014338865765}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 12.066388854576829, "get_ui_image": 0.05090052877040231, "step_physics": 0.7032282735584777, "survival_time": 59.99999999999873, "driven_lanedir": 10.348201004954086, "get_state_dump": 0.01010729351408972, "get_robot_state": 0.015184543809723993, "sim_render-ego0": 0.004122693572413613, "sim_render-ego1": 0.0042501726714300175, "sim_render-ego2": 0.004204079074526111, "sim_render-ego3": 0.004207205911361605, "get_duckie_state": 1.584163414846352e-06, "in-drivable-lane": 3.249999999999904, "deviation-heading": 20.81176767698199, "agent_compute-ego0": 0.012901024258603264, "agent_compute-ego1": 0.012893010337187984, "agent_compute-ego2": 0.013015697838166274, "agent_compute-ego3": 0.012670333339808684, "complete-iteration": 0.9161993919264564, "set_robot_commands": 0.0023539866337073433, "deviation-center-line": 4.309906271508308, "driven_lanedir_consec": 9.571478501464531, "sim_compute_sim_state": 0.05007913448133636, "sim_compute_performance-ego0": 0.00234310950565894, "sim_compute_performance-ego1": 0.0021395109575257313, "sim_compute_performance-ego2": 0.002125556224788059, "sim_compute_performance-ego3": 0.0020971014338865765}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 11.754451413006231, "get_ui_image": 0.05090052877040231, "step_physics": 0.7032282735584777, "survival_time": 59.99999999999873, "driven_lanedir": 10.936814044746573, "get_state_dump": 0.01010729351408972, "get_robot_state": 0.015184543809723993, "sim_render-ego0": 0.004122693572413613, "sim_render-ego1": 0.0042501726714300175, "sim_render-ego2": 0.004204079074526111, "sim_render-ego3": 0.004207205911361605, "get_duckie_state": 1.584163414846352e-06, "in-drivable-lane": 0.0, "deviation-heading": 18.48359092896123, "agent_compute-ego0": 0.012901024258603264, "agent_compute-ego1": 0.012893010337187984, "agent_compute-ego2": 0.013015697838166274, "agent_compute-ego3": 0.012670333339808684, "complete-iteration": 0.9161993919264564, "set_robot_commands": 0.0023539866337073433, "deviation-center-line": 4.353361494933246, "driven_lanedir_consec": 10.936814044746573, "sim_compute_sim_state": 0.05007913448133636, "sim_compute_performance-ego0": 0.00234310950565894, "sim_compute_performance-ego1": 0.0021395109575257313, "sim_compute_performance-ego2": 0.002125556224788059, "sim_compute_performance-ego3": 0.0020971014338865765}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 12.784178404934696, "get_ui_image": 0.05090052877040231, "step_physics": 0.7032282735584777, "survival_time": 59.99999999999873, "driven_lanedir": 11.69553209729032, "get_state_dump": 0.01010729351408972, "get_robot_state": 0.015184543809723993, "sim_render-ego0": 0.004122693572413613, "sim_render-ego1": 0.0042501726714300175, "sim_render-ego2": 0.004204079074526111, "sim_render-ego3": 0.004207205911361605, "get_duckie_state": 1.584163414846352e-06, "in-drivable-lane": 2.600000000000037, "deviation-heading": 15.883937660074649, "agent_compute-ego0": 0.012901024258603264, "agent_compute-ego1": 0.012893010337187984, "agent_compute-ego2": 0.013015697838166274, "agent_compute-ego3": 0.012670333339808684, "complete-iteration": 0.9161993919264564, "set_robot_commands": 0.0023539866337073433, "deviation-center-line": 4.100483482249584, "driven_lanedir_consec": 6.562676218187777, "sim_compute_sim_state": 0.05007913448133636, "sim_compute_performance-ego0": 0.00234310950565894, "sim_compute_performance-ego1": 0.0021395109575257313, "sim_compute_performance-ego2": 0.002125556224788059, "sim_compute_performance-ego3": 0.0020971014338865765}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 12.110350712278036, "get_ui_image": 0.047864417648633056, "step_physics": 0.6397186915741475, "survival_time": 59.99999999999873, "driven_lanedir": 11.004741573814709, "get_state_dump": 0.0099119048233731, "get_robot_state": 0.015325514303456734, "sim_render-ego0": 0.004137110650589027, "sim_render-ego1": 0.004238648974428963, "sim_render-ego2": 0.004239647513523784, "sim_render-ego3": 0.004232419122764212, "get_duckie_state": 1.6157275731120877e-06, "in-drivable-lane": 0.5999999999999659, "deviation-heading": 20.255904242826457, "agent_compute-ego0": 0.01333337243053935, "agent_compute-ego1": 0.01290119875479896, "agent_compute-ego2": 0.013068013743099622, "agent_compute-ego3": 0.01291084468215828, "complete-iteration": 0.8466593871803506, "set_robot_commands": 0.002335937493647465, "deviation-center-line": 4.11143292955355, "driven_lanedir_consec": 11.004741573814709, "sim_compute_sim_state": 0.04623043050773932, "sim_compute_performance-ego0": 0.0022712976708201744, "sim_compute_performance-ego1": 0.00216499653386633, "sim_compute_performance-ego2": 0.0021547260729101276, "sim_compute_performance-ego3": 0.0021764904533595865}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 12.666906056943144, "get_ui_image": 0.047864417648633056, "step_physics": 0.6397186915741475, "survival_time": 59.99999999999873, "driven_lanedir": 11.75057272137553, "get_state_dump": 0.0099119048233731, "get_robot_state": 0.015325514303456734, "sim_render-ego0": 0.004137110650589027, "sim_render-ego1": 0.004238648974428963, "sim_render-ego2": 0.004239647513523784, "sim_render-ego3": 0.004232419122764212, "get_duckie_state": 1.6157275731120877e-06, "in-drivable-lane": 0.4000000000000057, "deviation-heading": 17.86504060097848, "agent_compute-ego0": 0.01333337243053935, "agent_compute-ego1": 0.01290119875479896, "agent_compute-ego2": 0.013068013743099622, "agent_compute-ego3": 0.01291084468215828, "complete-iteration": 0.8466593871803506, "set_robot_commands": 0.002335937493647465, "deviation-center-line": 4.067616282554496, "driven_lanedir_consec": 11.75057272137553, "sim_compute_sim_state": 0.04623043050773932, "sim_compute_performance-ego0": 0.0022712976708201744, "sim_compute_performance-ego1": 0.00216499653386633, "sim_compute_performance-ego2": 0.0021547260729101276, "sim_compute_performance-ego3": 0.0021764904533595865}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 12.62241605871004, "get_ui_image": 0.047864417648633056, "step_physics": 0.6397186915741475, "survival_time": 59.99999999999873, "driven_lanedir": 11.90157601048665, "get_state_dump": 0.0099119048233731, "get_robot_state": 0.015325514303456734, "sim_render-ego0": 0.004137110650589027, "sim_render-ego1": 0.004238648974428963, "sim_render-ego2": 0.004239647513523784, "sim_render-ego3": 0.004232419122764212, "get_duckie_state": 1.6157275731120877e-06, "in-drivable-lane": 0.0, "deviation-heading": 16.96969814169293, "agent_compute-ego0": 0.01333337243053935, "agent_compute-ego1": 0.01290119875479896, "agent_compute-ego2": 0.013068013743099622, "agent_compute-ego3": 0.01291084468215828, "complete-iteration": 0.8466593871803506, "set_robot_commands": 0.002335937493647465, "deviation-center-line": 3.572978879925231, "driven_lanedir_consec": 11.90157601048665, "sim_compute_sim_state": 0.04623043050773932, "sim_compute_performance-ego0": 0.0022712976708201744, "sim_compute_performance-ego1": 0.00216499653386633, "sim_compute_performance-ego2": 0.0021547260729101276, "sim_compute_performance-ego3": 0.0021764904533595865}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 12.108975916779857, "get_ui_image": 0.047864417648633056, "step_physics": 0.6397186915741475, "survival_time": 59.99999999999873, "driven_lanedir": 11.135276913862056, "get_state_dump": 0.0099119048233731, "get_robot_state": 0.015325514303456734, "sim_render-ego0": 0.004137110650589027, "sim_render-ego1": 0.004238648974428963, "sim_render-ego2": 0.004239647513523784, "sim_render-ego3": 0.004232419122764212, "get_duckie_state": 1.6157275731120877e-06, "in-drivable-lane": 0.649999999999963, "deviation-heading": 18.07205651117957, "agent_compute-ego0": 0.01333337243053935, "agent_compute-ego1": 0.01290119875479896, "agent_compute-ego2": 0.013068013743099622, "agent_compute-ego3": 0.01291084468215828, "complete-iteration": 0.8466593871803506, "set_robot_commands": 0.002335937493647465, "deviation-center-line": 4.173149283194181, "driven_lanedir_consec": 11.135276913862056, "sim_compute_sim_state": 0.04623043050773932, "sim_compute_performance-ego0": 0.0022712976708201744, "sim_compute_performance-ego1": 0.00216499653386633, "sim_compute_performance-ego2": 0.0021547260729101276, "sim_compute_performance-ego3": 0.0021764904533595865}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 12.455691928405091, "get_ui_image": 0.03283089702075764, "step_physics": 0.23056031722609543, "survival_time": 59.99999999999873, "driven_lanedir": 11.260122741248416, "get_state_dump": 0.006666496135511565, "get_robot_state": 0.007663434987064206, "sim_render-ego0": 0.004050772553379589, "sim_render-ego1": 0.004309421375728865, "get_duckie_state": 1.4821258214590056e-06, "in-drivable-lane": 1.399999999999995, "deviation-heading": 18.622479310303792, "agent_compute-ego0": 0.012986570274105278, "agent_compute-ego1": 0.0135444363983942, "complete-iteration": 0.33261132141037053, "set_robot_commands": 0.0024257051656883426, "deviation-center-line": 4.271327505466898, "driven_lanedir_consec": 11.260122741248416, "sim_compute_sim_state": 0.010717004463138629, "sim_compute_performance-ego0": 0.002122532418129545, "sim_compute_performance-ego1": 0.002162024738588103}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 11.962956489406176, "get_ui_image": 0.03283089702075764, "step_physics": 0.23056031722609543, "survival_time": 59.99999999999873, "driven_lanedir": 2.343229048079627, "get_state_dump": 0.006666496135511565, "get_robot_state": 0.007663434987064206, "sim_render-ego0": 0.004050772553379589, "sim_render-ego1": 0.004309421375728865, "get_duckie_state": 1.4821258214590056e-06, "in-drivable-lane": 46.44999999999867, "deviation-heading": 4.0749169904017775, "agent_compute-ego0": 0.012986570274105278, "agent_compute-ego1": 0.0135444363983942, "complete-iteration": 0.33261132141037053, "set_robot_commands": 0.0024257051656883426, "deviation-center-line": 0.9557129588974606, "driven_lanedir_consec": 2.341445075665857, "sim_compute_sim_state": 0.010717004463138629, "sim_compute_performance-ego0": 0.002122532418129545, "sim_compute_performance-ego1": 0.002162024738588103}}
set_robot_commands_max0.0024257051656883426
set_robot_commands_mean0.002318532965732582
set_robot_commands_median0.002335937493647465
set_robot_commands_min0.002212088669865058
sim_compute_performance-ego0_max0.00234310950565894
sim_compute_performance-ego0_mean0.002230759876242599
sim_compute_performance-ego0_median0.0022712976708201744
sim_compute_performance-ego0_min0.002122532418129545
sim_compute_performance-ego1_max0.00216499653386633
sim_compute_performance-ego1_mean0.0021035595797777766
sim_compute_performance-ego1_median0.0021395109575257313
sim_compute_performance-ego1_min0.0019769386685361077
sim_compute_sim_state_max0.05007913448133636
sim_compute_sim_state_mean0.037325627372454026
sim_compute_sim_state_median0.04623043050773932
sim_compute_sim_state_min0.010717004463138629
sim_render-ego0_max0.004137110650589027
sim_render-ego0_mean0.0040554033245160616
sim_render-ego0_median0.004122693572413613
sim_render-ego0_min0.003908721136113786
sim_render-ego1_max0.004309421375728865
sim_render-ego1_mean0.004206092743041527
sim_render-ego1_median0.004238648974428963
sim_render-ego1_min0.0040777922669219336
simulation-passed1
step_physics_max0.7032282735584777
step_physics_mean0.5716193810759366
step_physics_median0.6397186915741475
step_physics_min0.23056031722609543
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873
No reset possible
58928LFVmultibodyv-simsuccessyes2:03:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58927LFVmultibodyv-simsuccessyes1:58:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58926LFVmultibodyv-simsuccessyes1:56:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58925LFVmultibodyv-simsuccessyes1:52:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible