Duckietown Challenges Home Challenges Submissions

Submission 12835

Submission12835
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserMelisande Teng
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 58820
Next
User labelexercise_state_estimation
Admin priority50
Blessingn/a
User priority50

58820

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
58820LFVmultibodyv-simsuccessyes1:34:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.29397581602171
survival_time_median59.99999999999873
deviation-center-line_median2.87896821970478
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013368480906299903
agent_compute-ego0_mean0.01309176971079499
agent_compute-ego0_median0.013154668871508748
agent_compute-ego0_min0.012626164820459154
agent_compute-ego1_max0.013742334222140376
agent_compute-ego1_mean0.01329724025065537
agent_compute-ego1_median0.013379689160235022
agent_compute-ego1_min0.012824488718444164
complete-iteration_max1.100497571958436
complete-iteration_mean0.8361808953278052
complete-iteration_median0.8614994602139844
complete-iteration_min0.3371427826685448
deviation-center-line_max3.775105134467053
deviation-center-line_mean2.4428943840513857
deviation-center-line_min0.2964321822302071
deviation-heading_max12.961738892241252
deviation-heading_mean9.160462413138688
deviation-heading_median11.067208228301729
deviation-heading_min0.9234335394188052
driven_any_max11.672939530256269
driven_any_mean7.724174033107213
driven_any_median11.663158387770055
driven_any_min1.0683063516938638
driven_lanedir_consec_max11.39701201584588
driven_lanedir_consec_mean7.512786583079369
driven_lanedir_consec_min1.0399662792552598
driven_lanedir_max11.39701201584588
driven_lanedir_mean7.512786583079369
driven_lanedir_median11.29397581602171
driven_lanedir_min1.0399662792552598
get_duckie_state_max1.8205968267613904e-06
get_duckie_state_mean1.7460836282134324e-06
get_duckie_state_median1.7861525217692056e-06
get_duckie_state_min1.579114835556239e-06
get_robot_state_max0.015808062420950994
get_robot_state_mean0.01429786273468277
get_robot_state_median0.015302907219536597
get_robot_state_min0.007552297147986008
get_state_dump_max0.01046291490395864
get_state_dump_mean0.00966452073113627
get_state_dump_median0.010097380184710372
get_state_dump_min0.006503691411998174
get_ui_image_max0.05077554760725671
get_ui_image_mean0.046214075441735995
get_ui_image_median0.048487395668506225
get_ui_image_min0.03302339984946055
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.0683063516938638, "get_ui_image": 0.04597462084558275, "step_physics": 0.9212461908658346, "survival_time": 35.950000000000095, "driven_lanedir": 1.0446306080001275, "get_state_dump": 0.01046291490395864, "get_robot_state": 0.015808062420950994, "sim_render-ego0": 0.004163967569669088, "sim_render-ego1": 0.004357216424412198, "sim_render-ego2": 0.004381198022100661, "sim_render-ego3": 0.004342116581069098, "get_duckie_state": 1.7861525217692056e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.252936740640803, "agent_compute-ego0": 0.012626164820459154, "agent_compute-ego1": 0.01346499588754442, "agent_compute-ego2": 0.012881007459428577, "agent_compute-ego3": 0.013303818636470371, "complete-iteration": 1.100497571958436, "set_robot_commands": 0.0024955391883850096, "deviation-center-line": 3.775105134467053, "driven_lanedir_consec": 1.0446306080001275, "sim_compute_sim_state": 0.01813551750448015, "sim_compute_performance-ego0": 0.002202968464957343, "sim_compute_performance-ego1": 0.0021854245000415377, "sim_compute_performance-ego2": 0.002182348569234212, "sim_compute_performance-ego3": 0.0021925869915220475}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.3966386691043873, "get_ui_image": 0.04597462084558275, "step_physics": 0.9212461908658346, "survival_time": 35.950000000000095, "driven_lanedir": 3.2849318825103744, "get_state_dump": 0.01046291490395864, "get_robot_state": 0.015808062420950994, "sim_render-ego0": 0.004163967569669088, "sim_render-ego1": 0.004357216424412198, "sim_render-ego2": 0.004381198022100661, "sim_render-ego3": 0.004342116581069098, "get_duckie_state": 1.7861525217692056e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.528856651983268, "agent_compute-ego0": 0.012626164820459154, "agent_compute-ego1": 0.01346499588754442, "agent_compute-ego2": 0.012881007459428577, "agent_compute-ego3": 0.013303818636470371, "complete-iteration": 1.100497571958436, "set_robot_commands": 0.0024955391883850096, "deviation-center-line": 1.7165040192463106, "driven_lanedir_consec": 3.2849318825103744, "sim_compute_sim_state": 0.01813551750448015, "sim_compute_performance-ego0": 0.002202968464957343, "sim_compute_performance-ego1": 0.0021854245000415377, "sim_compute_performance-ego2": 0.002182348569234212, "sim_compute_performance-ego3": 0.0021925869915220475}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.0683154073114738, "get_ui_image": 0.04597462084558275, "step_physics": 0.9212461908658346, "survival_time": 35.950000000000095, "driven_lanedir": 1.0399662792552598, "get_state_dump": 0.01046291490395864, "get_robot_state": 0.015808062420950994, "sim_render-ego0": 0.004163967569669088, "sim_render-ego1": 0.004357216424412198, "sim_render-ego2": 0.004381198022100661, "sim_render-ego3": 0.004342116581069098, "get_duckie_state": 1.7861525217692056e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.565982550496994, "agent_compute-ego0": 0.012626164820459154, "agent_compute-ego1": 0.01346499588754442, "agent_compute-ego2": 0.012881007459428577, "agent_compute-ego3": 0.013303818636470371, "complete-iteration": 1.100497571958436, "set_robot_commands": 0.0024955391883850096, "deviation-center-line": 2.992686238401106, "driven_lanedir_consec": 1.0399662792552598, "sim_compute_sim_state": 0.01813551750448015, "sim_compute_performance-ego0": 0.002202968464957343, "sim_compute_performance-ego1": 0.0021854245000415377, "sim_compute_performance-ego2": 0.002182348569234212, "sim_compute_performance-ego3": 0.0021925869915220475}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 6.830587148011146, "get_ui_image": 0.04597462084558275, "step_physics": 0.9212461908658346, "survival_time": 35.950000000000095, "driven_lanedir": 6.721180697380496, "get_state_dump": 0.01046291490395864, "get_robot_state": 0.015808062420950994, "sim_render-ego0": 0.004163967569669088, "sim_render-ego1": 0.004357216424412198, "sim_render-ego2": 0.004381198022100661, "sim_render-ego3": 0.004342116581069098, "get_duckie_state": 1.7861525217692056e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.232191653620696, "agent_compute-ego0": 0.012626164820459154, "agent_compute-ego1": 0.01346499588754442, "agent_compute-ego2": 0.012881007459428577, "agent_compute-ego3": 0.013303818636470371, "complete-iteration": 1.100497571958436, "set_robot_commands": 0.0024955391883850096, "deviation-center-line": 1.5541312144577075, "driven_lanedir_consec": 6.721180697380496, "sim_compute_sim_state": 0.01813551750448015, "sim_compute_performance-ego0": 0.002202968464957343, "sim_compute_performance-ego1": 0.0021854245000415377, "sim_compute_performance-ego2": 0.002182348569234212, "sim_compute_performance-ego3": 0.0021925869915220475}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 11.672897267232186, "get_ui_image": 0.05077554760725671, "step_physics": 0.649248509283963, "survival_time": 59.99999999999873, "driven_lanedir": 11.294082585341304, "get_state_dump": 0.010013681764308856, "get_robot_state": 0.015155401356909098, "sim_render-ego0": 0.004115230336375876, "sim_render-ego1": 0.004179887430157689, "sim_render-ego2": 0.004220412633103395, "sim_render-ego3": 0.004181234167577028, "get_duckie_state": 1.7149859324383e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.961738892241252, "agent_compute-ego0": 0.013154668871508748, "agent_compute-ego1": 0.012824488718444164, "agent_compute-ego2": 0.012940328782245976, "agent_compute-ego3": 0.01288256478448593, "complete-iteration": 0.8614994602139844, "set_robot_commands": 0.0023029551319436767, "deviation-center-line": 2.9896512769675505, "driven_lanedir_consec": 11.294082585341304, "sim_compute_sim_state": 0.04969833693238321, "sim_compute_performance-ego0": 0.0022669052899032707, "sim_compute_performance-ego1": 0.0020841515927787226, "sim_compute_performance-ego2": 0.002095320341886827, "sim_compute_performance-ego3": 0.00212047816712493}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 11.672895830473438, "get_ui_image": 0.05077554760725671, "step_physics": 0.649248509283963, "survival_time": 59.99999999999873, "driven_lanedir": 11.293869046702117, "get_state_dump": 0.010013681764308856, "get_robot_state": 0.015155401356909098, "sim_render-ego0": 0.004115230336375876, "sim_render-ego1": 0.004179887430157689, "sim_render-ego2": 0.004220412633103395, "sim_render-ego3": 0.004181234167577028, "get_duckie_state": 1.7149859324383e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.627008527916535, "agent_compute-ego0": 0.013154668871508748, "agent_compute-ego1": 0.012824488718444164, "agent_compute-ego2": 0.012940328782245976, "agent_compute-ego3": 0.01288256478448593, "complete-iteration": 0.8614994602139844, "set_robot_commands": 0.0023029551319436767, "deviation-center-line": 3.1185227069036423, "driven_lanedir_consec": 11.293869046702117, "sim_compute_sim_state": 0.04969833693238321, "sim_compute_performance-ego0": 0.0022669052899032707, "sim_compute_performance-ego1": 0.0020841515927787226, "sim_compute_performance-ego2": 0.002095320341886827, "sim_compute_performance-ego3": 0.00212047816712493}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 11.672939530256269, "get_ui_image": 0.05077554760725671, "step_physics": 0.649248509283963, "survival_time": 59.99999999999873, "driven_lanedir": 11.317740281054402, "get_state_dump": 0.010013681764308856, "get_robot_state": 0.015155401356909098, "sim_render-ego0": 0.004115230336375876, "sim_render-ego1": 0.004179887430157689, "sim_render-ego2": 0.004220412633103395, "sim_render-ego3": 0.004181234167577028, "get_duckie_state": 1.7149859324383e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.227536234188545, "agent_compute-ego0": 0.013154668871508748, "agent_compute-ego1": 0.012824488718444164, "agent_compute-ego2": 0.012940328782245976, "agent_compute-ego3": 0.01288256478448593, "complete-iteration": 0.8614994602139844, "set_robot_commands": 0.0023029551319436767, "deviation-center-line": 2.7863627218695584, "driven_lanedir_consec": 11.317740281054402, "sim_compute_sim_state": 0.04969833693238321, "sim_compute_performance-ego0": 0.0022669052899032707, "sim_compute_performance-ego1": 0.0020841515927787226, "sim_compute_performance-ego2": 0.002095320341886827, "sim_compute_performance-ego3": 0.00212047816712493}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 11.67291186351041, "get_ui_image": 0.05077554760725671, "step_physics": 0.649248509283963, "survival_time": 59.99999999999873, "driven_lanedir": 11.39701201584588, "get_state_dump": 0.010013681764308856, "get_robot_state": 0.015155401356909098, "sim_render-ego0": 0.004115230336375876, "sim_render-ego1": 0.004179887430157689, "sim_render-ego2": 0.004220412633103395, "sim_render-ego3": 0.004181234167577028, "get_duckie_state": 1.7149859324383e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.696164750704051, "agent_compute-ego0": 0.013154668871508748, "agent_compute-ego1": 0.012824488718444164, "agent_compute-ego2": 0.012940328782245976, "agent_compute-ego3": 0.01288256478448593, "complete-iteration": 0.8614994602139844, "set_robot_commands": 0.0023029551319436767, "deviation-center-line": 2.8488097126646803, "driven_lanedir_consec": 11.39701201584588, "sim_compute_sim_state": 0.04969833693238321, "sim_compute_performance-ego0": 0.0022669052899032707, "sim_compute_performance-ego1": 0.0020841515927787226, "sim_compute_performance-ego2": 0.002095320341886827, "sim_compute_performance-ego3": 0.00212047816712493}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 11.66325577076787, "get_ui_image": 0.048487395668506225, "step_physics": 0.586479294806297, "survival_time": 59.99999999999873, "driven_lanedir": 11.364887554317807, "get_state_dump": 0.010097380184710372, "get_robot_state": 0.015302907219536597, "sim_render-ego0": 0.004176285542814459, "sim_render-ego1": 0.004235520152426282, "sim_render-ego2": 0.004265750278342673, "sim_render-ego3": 0.004213059772361228, "get_duckie_state": 1.8205968267613904e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.181781282704453, "agent_compute-ego0": 0.013368480906299903, "agent_compute-ego1": 0.013379689160235022, "agent_compute-ego2": 0.013161391441669194, "agent_compute-ego3": 0.013386549699514931, "complete-iteration": 0.7960647101406253, "set_robot_commands": 0.0023555328804289273, "deviation-center-line": 2.8402922072115606, "driven_lanedir_consec": 11.364887554317807, "sim_compute_sim_state": 0.047089168769334576, "sim_compute_performance-ego0": 0.002314863157312042, "sim_compute_performance-ego1": 0.0021127381987813905, "sim_compute_performance-ego2": 0.002148744168626974, "sim_compute_performance-ego3": 0.002112652241042214}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 11.663169469153422, "get_ui_image": 0.048487395668506225, "step_physics": 0.586479294806297, "survival_time": 59.99999999999873, "driven_lanedir": 11.294146408126412, "get_state_dump": 0.010097380184710372, "get_robot_state": 0.015302907219536597, "sim_render-ego0": 0.004176285542814459, "sim_render-ego1": 0.004235520152426282, "sim_render-ego2": 0.004265750278342673, "sim_render-ego3": 0.004213059772361228, "get_duckie_state": 1.8205968267613904e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.431066864900428, "agent_compute-ego0": 0.013368480906299903, "agent_compute-ego1": 0.013379689160235022, "agent_compute-ego2": 0.013161391441669194, "agent_compute-ego3": 0.013386549699514931, "complete-iteration": 0.7960647101406253, "set_robot_commands": 0.0023555328804289273, "deviation-center-line": 3.026088678477868, "driven_lanedir_consec": 11.294146408126412, "sim_compute_sim_state": 0.047089168769334576, "sim_compute_performance-ego0": 0.002314863157312042, "sim_compute_performance-ego1": 0.0021127381987813905, "sim_compute_performance-ego2": 0.002148744168626974, "sim_compute_performance-ego3": 0.002112652241042214}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 11.663147306386692, "get_ui_image": 0.048487395668506225, "step_physics": 0.586479294806297, "survival_time": 59.99999999999873, "driven_lanedir": 11.368521406726446, "get_state_dump": 0.010097380184710372, "get_robot_state": 0.015302907219536597, "sim_render-ego0": 0.004176285542814459, "sim_render-ego1": 0.004235520152426282, "sim_render-ego2": 0.004265750278342673, "sim_render-ego3": 0.004213059772361228, "get_duckie_state": 1.8205968267613904e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.18130046657224, "agent_compute-ego0": 0.013368480906299903, "agent_compute-ego1": 0.013379689160235022, "agent_compute-ego2": 0.013161391441669194, "agent_compute-ego3": 0.013386549699514931, "complete-iteration": 0.7960647101406253, "set_robot_commands": 0.0023555328804289273, "deviation-center-line": 3.0273520653104233, "driven_lanedir_consec": 11.368521406726446, "sim_compute_sim_state": 0.047089168769334576, "sim_compute_performance-ego0": 0.002314863157312042, "sim_compute_performance-ego1": 0.0021127381987813905, "sim_compute_performance-ego2": 0.002148744168626974, "sim_compute_performance-ego3": 0.002112652241042214}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 11.663272524229994, "get_ui_image": 0.048487395668506225, "step_physics": 0.586479294806297, "survival_time": 59.99999999999873, "driven_lanedir": 11.37546947727823, "get_state_dump": 0.010097380184710372, "get_robot_state": 0.015302907219536597, "sim_render-ego0": 0.004176285542814459, "sim_render-ego1": 0.004235520152426282, "sim_render-ego2": 0.004265750278342673, "sim_render-ego3": 0.004213059772361228, "get_duckie_state": 1.8205968267613904e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.953115990031216, "agent_compute-ego0": 0.013368480906299903, "agent_compute-ego1": 0.013379689160235022, "agent_compute-ego2": 0.013161391441669194, "agent_compute-ego3": 0.013386549699514931, "complete-iteration": 0.7960647101406253, "set_robot_commands": 0.0023555328804289273, "deviation-center-line": 2.90912672674488, "driven_lanedir_consec": 11.37546947727823, "sim_compute_sim_state": 0.047089168769334576, "sim_compute_performance-ego0": 0.002314863157312042, "sim_compute_performance-ego1": 0.0021127381987813905, "sim_compute_performance-ego2": 0.002148744168626974, "sim_compute_performance-ego3": 0.002112652241042214}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.215058053778886, "get_ui_image": 0.03302339984946055, "step_physics": 0.23559025215776, "survival_time": 7.249999999999982, "driven_lanedir": 1.2005270649769102, "get_state_dump": 0.006503691411998174, "get_robot_state": 0.007552297147986008, "sim_render-ego0": 0.004155266774843817, "sim_render-ego1": 0.004185310781818547, "get_duckie_state": 1.579114835556239e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.9234335394188052, "agent_compute-ego0": 0.013343758779029324, "agent_compute-ego1": 0.013742334222140376, "complete-iteration": 0.3371427826685448, "set_robot_commands": 0.002356024637614211, "deviation-center-line": 0.31945649176685587, "driven_lanedir_consec": 1.2005270649769102, "sim_compute_sim_state": 0.0101981326325299, "sim_compute_performance-ego0": 0.0020745470099253196, "sim_compute_performance-ego1": 0.0020845360951880884}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.2150412715909291, "get_ui_image": 0.03302339984946055, "step_physics": 0.23559025215776, "survival_time": 7.249999999999982, "driven_lanedir": 1.182046855595405, "get_state_dump": 0.006503691411998174, "get_robot_state": 0.007552297147986008, "sim_render-ego0": 0.004155266774843817, "sim_render-ego1": 0.004185310781818547, "get_duckie_state": 1.579114835556239e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.4833596385223176, "agent_compute-ego0": 0.013343758779029324, "agent_compute-ego1": 0.013742334222140376, "complete-iteration": 0.3371427826685448, "set_robot_commands": 0.002356024637614211, "deviation-center-line": 0.2964321822302071, "driven_lanedir_consec": 1.182046855595405, "sim_compute_sim_state": 0.0101981326325299, "sim_compute_performance-ego0": 0.0020745470099253196, "sim_compute_performance-ego1": 0.0020845360951880884}}
set_robot_commands_max0.0024955391883850096
set_robot_commands_mean0.002380582719875634
set_robot_commands_median0.0023555328804289273
set_robot_commands_min0.0023029551319436767
sim_compute_performance-ego0_max0.002314863157312042
sim_compute_performance-ego0_mean0.0022348601191815192
sim_compute_performance-ego0_median0.0022669052899032707
sim_compute_performance-ego0_min0.0020745470099253196
sim_compute_performance-ego1_max0.0021854245000415377
sim_compute_performance-ego1_mean0.0021213092397701985
sim_compute_performance-ego1_median0.0021127381987813905
sim_compute_performance-ego1_min0.0020841515927787226
sim_compute_sim_state_max0.04969833693238321
sim_compute_sim_state_mean0.034292025577846545
sim_compute_sim_state_median0.047089168769334576
sim_compute_sim_state_min0.0101981326325299
sim_render-ego0_max0.004176285542814459
sim_render-ego0_mean0.00415231909608038
sim_render-ego0_median0.004163967569669088
sim_render-ego0_min0.004115230336375876
sim_render-ego1_max0.004357216424412198
sim_render-ego1_mean0.00424722268511584
sim_render-ego1_median0.004235520152426282
sim_render-ego1_min0.004179887430157689
simulation-passed1
step_physics_max0.9212461908658346
step_physics_mean0.6499340345814212
step_physics_median0.649248509283963
step_physics_min0.23559025215776
survival_time_max59.99999999999873
survival_time_mean45.59285714285643
survival_time_min7.249999999999982
No reset possible