Duckietown Challenges Home Challenges Submissions

Submission 12834

Submission12834
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserMelisande Teng
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 58903
Next
User labelexercise_state_estimation
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
58903LFVmultibodyv-simsuccessyes1:38:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.48557043935601
survival_time_median59.99999999999873
deviation-center-line_median2.8226704507652527
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012762062030263466
agent_compute-ego0_mean0.012596122819175212
agent_compute-ego0_median0.01264990716055966
agent_compute-ego0_min0.012349674247087388
agent_compute-ego1_max0.01368354659195645
agent_compute-ego1_mean0.013116638247900813
agent_compute-ego1_median0.013131244494257918
agent_compute-ego1_min0.012692737107229703
complete-iteration_max0.9656063241533712
complete-iteration_mean0.8388478157765583
complete-iteration_median0.908606570130284
complete-iteration_min0.33109180218571926
deviation-center-line_max3.683022238854437
deviation-center-line_mean2.4631277980179904
deviation-center-line_min0.9580154504811808
deviation-heading_max14.114002048876513
deviation-heading_mean9.525218099459234
deviation-heading_median11.33274197351738
deviation-heading_min1.525072637878252
driven_any_max11.673148563924231
driven_any_mean8.715018580774375
driven_any_median11.262041837607178
driven_any_min1.0878700540345845
driven_lanedir_consec_max11.440264210335805
driven_lanedir_consec_mean8.251716557653554
driven_lanedir_consec_min1.0542746262022595
driven_lanedir_max11.440264210335805
driven_lanedir_mean8.34264293594187
driven_lanedir_median10.662841035279808
driven_lanedir_min1.0542746262022595
get_duckie_state_max1.7511159752330415e-06
get_duckie_state_mean1.709848505079284e-06
get_duckie_state_median1.735616438459642e-06
get_duckie_state_min1.6572175673104444e-06
get_robot_state_max0.015260836960969618
get_robot_state_mean0.014095463654577672
get_robot_state_median0.015110233840497703
get_robot_state_min0.008119320095230599
get_state_dump_max0.010074920201678756
get_state_dump_mean0.009501359773954412
get_state_dump_median0.009922458766203538
get_state_dump_min0.006881773025169659
get_ui_image_max0.05238955443745152
get_ui_image_mean0.04626190036101692
get_ui_image_median0.049023177204878504
get_ui_image_min0.03418354487836014
in-drivable-lane_max3.899999999999987
in-drivable-lane_mean0.5571428571428558
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.0878858619974436, "get_ui_image": 0.04341214718204914, "step_physics": 0.7964374600070538, "survival_time": 20.15000000000015, "driven_lanedir": 1.0655480431654314, "get_state_dump": 0.00981649372837331, "get_robot_state": 0.01490339194193925, "sim_render-ego0": 0.003942293105739178, "sim_render-ego1": 0.004106447248175593, "sim_render-ego2": 0.0041077437967357066, "sim_render-ego3": 0.004094377602681075, "get_duckie_state": 1.735616438459642e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.9371430859400114, "agent_compute-ego0": 0.012762062030263466, "agent_compute-ego1": 0.012692737107229703, "agent_compute-ego2": 0.0116626502263664, "agent_compute-ego3": 0.01250239351008198, "complete-iteration": 0.9656063241533712, "set_robot_commands": 0.00240473463983819, "deviation-center-line": 1.2017108390807003, "driven_lanedir_consec": 1.0655480431654314, "sim_compute_sim_state": 0.017418655428555932, "sim_compute_performance-ego0": 0.0020764959920750985, "sim_compute_performance-ego1": 0.00203789224719057, "sim_compute_performance-ego2": 0.0020507267206022056, "sim_compute_performance-ego3": 0.002027887519043271}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.739039965435137, "get_ui_image": 0.04341214718204914, "step_physics": 0.7964374600070538, "survival_time": 20.15000000000015, "driven_lanedir": 3.525645817837535, "get_state_dump": 0.00981649372837331, "get_robot_state": 0.01490339194193925, "sim_render-ego0": 0.003942293105739178, "sim_render-ego1": 0.004106447248175593, "sim_render-ego2": 0.0041077437967357066, "sim_render-ego3": 0.004094377602681075, "get_duckie_state": 1.735616438459642e-06, "in-drivable-lane": 0.6000000000000005, "deviation-heading": 3.5919204483409337, "agent_compute-ego0": 0.012762062030263466, "agent_compute-ego1": 0.012692737107229703, "agent_compute-ego2": 0.0116626502263664, "agent_compute-ego3": 0.01250239351008198, "complete-iteration": 0.9656063241533712, "set_robot_commands": 0.00240473463983819, "deviation-center-line": 0.9820378495185, "driven_lanedir_consec": 3.525645817837535, "sim_compute_sim_state": 0.017418655428555932, "sim_compute_performance-ego0": 0.0020764959920750985, "sim_compute_performance-ego1": 0.00203789224719057, "sim_compute_performance-ego2": 0.0020507267206022056, "sim_compute_performance-ego3": 0.002027887519043271}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.044466735770954, "get_ui_image": 0.04341214718204914, "step_physics": 0.7964374600070538, "survival_time": 20.15000000000015, "driven_lanedir": 2.974340633297323, "get_state_dump": 0.00981649372837331, "get_robot_state": 0.01490339194193925, "sim_render-ego0": 0.003942293105739178, "sim_render-ego1": 0.004106447248175593, "sim_render-ego2": 0.0041077437967357066, "sim_render-ego3": 0.004094377602681075, "get_duckie_state": 1.735616438459642e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.243027135950815, "agent_compute-ego0": 0.012762062030263466, "agent_compute-ego1": 0.012692737107229703, "agent_compute-ego2": 0.0116626502263664, "agent_compute-ego3": 0.01250239351008198, "complete-iteration": 0.9656063241533712, "set_robot_commands": 0.00240473463983819, "deviation-center-line": 0.9580154504811808, "driven_lanedir_consec": 2.974340633297323, "sim_compute_sim_state": 0.017418655428555932, "sim_compute_performance-ego0": 0.0020764959920750985, "sim_compute_performance-ego1": 0.00203789224719057, "sim_compute_performance-ego2": 0.0020507267206022056, "sim_compute_performance-ego3": 0.002027887519043271}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.0878700540345845, "get_ui_image": 0.04341214718204914, "step_physics": 0.7964374600070538, "survival_time": 20.15000000000015, "driven_lanedir": 1.0542746262022595, "get_state_dump": 0.00981649372837331, "get_robot_state": 0.01490339194193925, "sim_render-ego0": 0.003942293105739178, "sim_render-ego1": 0.004106447248175593, "sim_render-ego2": 0.0041077437967357066, "sim_render-ego3": 0.004094377602681075, "get_duckie_state": 1.735616438459642e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.525072637878252, "agent_compute-ego0": 0.012762062030263466, "agent_compute-ego1": 0.012692737107229703, "agent_compute-ego2": 0.0116626502263664, "agent_compute-ego3": 0.01250239351008198, "complete-iteration": 0.9656063241533712, "set_robot_commands": 0.00240473463983819, "deviation-center-line": 1.9356367406937145, "driven_lanedir_consec": 1.0542746262022595, "sim_compute_sim_state": 0.017418655428555932, "sim_compute_performance-ego0": 0.0020764959920750985, "sim_compute_performance-ego1": 0.00203789224719057, "sim_compute_performance-ego2": 0.0020507267206022056, "sim_compute_performance-ego3": 0.002027887519043271}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 11.672866178328048, "get_ui_image": 0.05238955443745152, "step_physics": 0.6832930106703784, "survival_time": 59.99999999999873, "driven_lanedir": 11.175795706489248, "get_state_dump": 0.010074920201678756, "get_robot_state": 0.015110233840497703, "sim_render-ego0": 0.004088184815660107, "sim_render-ego1": 0.004186929215201728, "sim_render-ego2": 0.004227958253579374, "sim_render-ego3": 0.0042130139149992194, "get_duckie_state": 1.6572175673104444e-06, "in-drivable-lane": 0.7000000000000006, "deviation-heading": 12.031066036260148, "agent_compute-ego0": 0.01264990716055966, "agent_compute-ego1": 0.013242478970186992, "agent_compute-ego2": 0.012429746958139438, "agent_compute-ego3": 0.012618776364290743, "complete-iteration": 0.8962085598414387, "set_robot_commands": 0.0023271815167378623, "deviation-center-line": 3.0565819428065835, "driven_lanedir_consec": 11.175795706489248, "sim_compute_sim_state": 0.04970641993761658, "sim_compute_performance-ego0": 0.00221958227896075, "sim_compute_performance-ego1": 0.002091935830350522, "sim_compute_performance-ego2": 0.002080711099527758, "sim_compute_performance-ego3": 0.0021013246785591883}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 11.672934340366286, "get_ui_image": 0.05238955443745152, "step_physics": 0.6832930106703784, "survival_time": 59.99999999999873, "driven_lanedir": 11.285738582914714, "get_state_dump": 0.010074920201678756, "get_robot_state": 0.015110233840497703, "sim_render-ego0": 0.004088184815660107, "sim_render-ego1": 0.004186929215201728, "sim_render-ego2": 0.004227958253579374, "sim_render-ego3": 0.0042130139149992194, "get_duckie_state": 1.6572175673104444e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.599744229677528, "agent_compute-ego0": 0.01264990716055966, "agent_compute-ego1": 0.013242478970186992, "agent_compute-ego2": 0.012429746958139438, "agent_compute-ego3": 0.012618776364290743, "complete-iteration": 0.8962085598414387, "set_robot_commands": 0.0023271815167378623, "deviation-center-line": 2.973632792452388, "driven_lanedir_consec": 11.285738582914714, "sim_compute_sim_state": 0.04970641993761658, "sim_compute_performance-ego0": 0.00221958227896075, "sim_compute_performance-ego1": 0.002091935830350522, "sim_compute_performance-ego2": 0.002080711099527758, "sim_compute_performance-ego3": 0.0021013246785591883}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 11.672885424550714, "get_ui_image": 0.05238955443745152, "step_physics": 0.6832930106703784, "survival_time": 59.99999999999873, "driven_lanedir": 10.770977196431453, "get_state_dump": 0.010074920201678756, "get_robot_state": 0.015110233840497703, "sim_render-ego0": 0.004088184815660107, "sim_render-ego1": 0.004186929215201728, "sim_render-ego2": 0.004227958253579374, "sim_render-ego3": 0.0042130139149992194, "get_duckie_state": 1.6572175673104444e-06, "in-drivable-lane": 1.9999999999999964, "deviation-heading": 13.332243522878311, "agent_compute-ego0": 0.01264990716055966, "agent_compute-ego1": 0.013242478970186992, "agent_compute-ego2": 0.012429746958139438, "agent_compute-ego3": 0.012618776364290743, "complete-iteration": 0.8962085598414387, "set_robot_commands": 0.0023271815167378623, "deviation-center-line": 3.0027987417396473, "driven_lanedir_consec": 10.416436004583858, "sim_compute_sim_state": 0.04970641993761658, "sim_compute_performance-ego0": 0.00221958227896075, "sim_compute_performance-ego1": 0.002091935830350522, "sim_compute_performance-ego2": 0.002080711099527758, "sim_compute_performance-ego3": 0.0021013246785591883}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 11.672919807056909, "get_ui_image": 0.05238955443745152, "step_physics": 0.6832930106703784, "survival_time": 59.99999999999873, "driven_lanedir": 11.13760767169826, "get_state_dump": 0.010074920201678756, "get_robot_state": 0.015110233840497703, "sim_render-ego0": 0.004088184815660107, "sim_render-ego1": 0.004186929215201728, "sim_render-ego2": 0.004227958253579374, "sim_render-ego3": 0.0042130139149992194, "get_duckie_state": 1.6572175673104444e-06, "in-drivable-lane": 0.5999999999999979, "deviation-heading": 13.057460333753282, "agent_compute-ego0": 0.01264990716055966, "agent_compute-ego1": 0.013242478970186992, "agent_compute-ego2": 0.012429746958139438, "agent_compute-ego3": 0.012618776364290743, "complete-iteration": 0.8962085598414387, "set_robot_commands": 0.0023271815167378623, "deviation-center-line": 3.0455181171931063, "driven_lanedir_consec": 11.13760767169826, "sim_compute_sim_state": 0.04970641993761658, "sim_compute_performance-ego0": 0.00221958227896075, "sim_compute_performance-ego1": 0.002091935830350522, "sim_compute_performance-ego2": 0.002080711099527758, "sim_compute_performance-ego3": 0.0021013246785591883}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 10.860931125230344, "get_ui_image": 0.049023177204878504, "step_physics": 0.7070943612440936, "survival_time": 59.99999999999873, "driven_lanedir": 10.554704874128165, "get_state_dump": 0.009922458766203538, "get_robot_state": 0.015260836960969618, "sim_render-ego0": 0.004050195663795185, "sim_render-ego1": 0.004205178261597289, "sim_render-ego2": 0.00421671287701787, "sim_render-ego3": 0.004201409421693674, "get_duckie_state": 1.7511159752330415e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.443344074021775, "agent_compute-ego0": 0.012349674247087388, "agent_compute-ego1": 0.013131244494257918, "agent_compute-ego2": 0.0123348200350975, "agent_compute-ego3": 0.01245673153422258, "complete-iteration": 0.908606570130284, "set_robot_commands": 0.002330165421535927, "deviation-center-line": 3.2949095774008663, "driven_lanedir_consec": 10.554704874128165, "sim_compute_sim_state": 0.042231959963122775, "sim_compute_performance-ego0": 0.0022595980880063937, "sim_compute_performance-ego1": 0.0020966515950021102, "sim_compute_performance-ego2": 0.002099650785587511, "sim_compute_performance-ego3": 0.0021072827608361036}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 11.663152549984014, "get_ui_image": 0.049023177204878504, "step_physics": 0.7070943612440936, "survival_time": 59.99999999999873, "driven_lanedir": 11.35583400520681, "get_state_dump": 0.009922458766203538, "get_robot_state": 0.015260836960969618, "sim_render-ego0": 0.004050195663795185, "sim_render-ego1": 0.004205178261597289, "sim_render-ego2": 0.00421671287701787, "sim_render-ego3": 0.004201409421693674, "get_duckie_state": 1.7511159752330415e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.537337617375314, "agent_compute-ego0": 0.012349674247087388, "agent_compute-ego1": 0.013131244494257918, "agent_compute-ego2": 0.0123348200350975, "agent_compute-ego3": 0.01245673153422258, "complete-iteration": 0.908606570130284, "set_robot_commands": 0.002330165421535927, "deviation-center-line": 2.6637254959984724, "driven_lanedir_consec": 11.35583400520681, "sim_compute_sim_state": 0.042231959963122775, "sim_compute_performance-ego0": 0.0022595980880063937, "sim_compute_performance-ego1": 0.0020966515950021102, "sim_compute_performance-ego2": 0.002099650785587511, "sim_compute_performance-ego3": 0.0021072827608361036}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 10.24461108839382, "get_ui_image": 0.049023177204878504, "step_physics": 0.7070943612440936, "survival_time": 59.99999999999873, "driven_lanedir": 9.058984794758477, "get_state_dump": 0.009922458766203538, "get_robot_state": 0.015260836960969618, "sim_render-ego0": 0.004050195663795185, "sim_render-ego1": 0.004205178261597289, "sim_render-ego2": 0.00421671287701787, "sim_render-ego3": 0.004201409421693674, "get_duckie_state": 1.7511159752330415e-06, "in-drivable-lane": 3.899999999999987, "deviation-heading": 14.114002048876513, "agent_compute-ego0": 0.012349674247087388, "agent_compute-ego1": 0.013131244494257918, "agent_compute-ego2": 0.0123348200350975, "agent_compute-ego3": 0.01245673153422258, "complete-iteration": 0.908606570130284, "set_robot_commands": 0.002330165421535927, "deviation-center-line": 2.937182440228956, "driven_lanedir_consec": 8.14055669056967, "sim_compute_sim_state": 0.042231959963122775, "sim_compute_performance-ego0": 0.0022595980880063937, "sim_compute_performance-ego1": 0.0020966515950021102, "sim_compute_performance-ego2": 0.002099650785587511, "sim_compute_performance-ego3": 0.0021072827608361036}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 10.244623176841955, "get_ui_image": 0.049023177204878504, "step_physics": 0.7070943612440936, "survival_time": 59.99999999999873, "driven_lanedir": 9.963154729892258, "get_state_dump": 0.009922458766203538, "get_robot_state": 0.015260836960969618, "sim_render-ego0": 0.004050195663795185, "sim_render-ego1": 0.004205178261597289, "sim_render-ego2": 0.00421671287701787, "sim_render-ego3": 0.004201409421693674, "get_duckie_state": 1.7511159752330415e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.128146329659447, "agent_compute-ego0": 0.012349674247087388, "agent_compute-ego1": 0.013131244494257918, "agent_compute-ego2": 0.0123348200350975, "agent_compute-ego3": 0.01245673153422258, "complete-iteration": 0.908606570130284, "set_robot_commands": 0.002330165421535927, "deviation-center-line": 3.683022238854437, "driven_lanedir_consec": 9.963154729892258, "sim_compute_sim_state": 0.042231959963122775, "sim_compute_performance-ego0": 0.0022595980880063937, "sim_compute_performance-ego1": 0.0020966515950021102, "sim_compute_performance-ego2": 0.002099650785587511, "sim_compute_performance-ego3": 0.0021072827608361036}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 11.673148563924231, "get_ui_image": 0.03418354487836014, "step_physics": 0.22605126862919003, "survival_time": 59.99999999999873, "driven_lanedir": 11.434130210828446, "get_state_dump": 0.006881773025169659, "get_robot_state": 0.008119320095230599, "sim_render-ego0": 0.00421622829770764, "sim_render-ego1": 0.004402246999303864, "get_duckie_state": 1.6810395735487354e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.618434796727774, "agent_compute-ego0": 0.01264957285840545, "agent_compute-ego1": 0.01368354659195645, "complete-iteration": 0.33109180218571926, "set_robot_commands": 0.0024763666322884415, "deviation-center-line": 2.7081584613015495, "driven_lanedir_consec": 11.434130210828446, "sim_compute_sim_state": 0.011335764201257151, "sim_compute_performance-ego0": 0.0022345260219907483, "sim_compute_performance-ego1": 0.0022447889393116412}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 11.672925258926828, "get_ui_image": 0.03418354487836014, "step_physics": 0.22605126862919003, "survival_time": 59.99999999999873, "driven_lanedir": 11.440264210335805, "get_state_dump": 0.006881773025169659, "get_robot_state": 0.008119320095230599, "sim_render-ego0": 0.00421622829770764, "sim_render-ego1": 0.004402246999303864, "get_duckie_state": 1.6810395735487354e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.194111095089182, "agent_compute-ego0": 0.01264957285840545, "agent_compute-ego1": 0.01368354659195645, "complete-iteration": 0.33109180218571926, "set_robot_commands": 0.0024763666322884415, "deviation-center-line": 2.040858484501759, "driven_lanedir_consec": 11.440264210335805, "sim_compute_sim_state": 0.011335764201257151, "sim_compute_performance-ego0": 0.0022345260219907483, "sim_compute_performance-ego1": 0.0022447889393116412}}
set_robot_commands_max0.0024763666322884415
set_robot_commands_mean0.002371504255501772
set_robot_commands_median0.002330165421535927
set_robot_commands_min0.0023271815167378623
sim_compute_performance-ego0_max0.0022595980880063937
sim_compute_performance-ego0_mean0.0021922683914393196
sim_compute_performance-ego0_median0.00221958227896075
sim_compute_performance-ego0_min0.0020764959920750985
sim_compute_performance-ego1_max0.0022447889393116412
sim_compute_performance-ego1_mean0.0020996783263425777
sim_compute_performance-ego1_median0.002091935830350522
sim_compute_performance-ego1_min0.00203789224719057
sim_compute_sim_state_max0.04970641993761658
sim_compute_sim_state_mean0.032864262122835386
sim_compute_sim_state_median0.042231959963122775
sim_compute_sim_state_min0.011335764201257151
sim_render-ego0_max0.00421622829770764
sim_render-ego0_mean0.004053939352585226
sim_render-ego0_median0.004050195663795185
sim_render-ego0_min0.003942293105739178
sim_render-ego1_max0.004402246999303864
sim_render-ego1_mean0.004199908064179011
sim_render-ego1_median0.004186929215201728
sim_render-ego1_min0.004106447248175593
simulation-passed1
step_physics_max0.7964374600070538
step_physics_mean0.6571001332103202
step_physics_median0.7070943612440936
step_physics_min0.22605126862919003
survival_time_max59.99999999999873
survival_time_mean48.61428571428486
survival_time_min20.15000000000015
No reset possible
58902LFVmultibodyv-simsuccessyes1:38:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58900LFVmultibodyv-simsuccessyes1:55:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible