Duckietown Challenges Home Challenges Submissions

Submission 12834

Submission12834
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserMelisande Teng
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 58903
Next
User labelexercise_state_estimation
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
58903LFVmultibodyv-simsuccessyes1:38:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.48557043935601
survival_time_median59.99999999999873
deviation-center-line_median2.8226704507652527
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012762062030263466
agent_compute-ego0_mean0.012596122819175212
agent_compute-ego0_median0.01264990716055966
agent_compute-ego0_min0.012349674247087388
agent_compute-ego1_max0.01368354659195645
agent_compute-ego1_mean0.013116638247900813
agent_compute-ego1_median0.013131244494257918
agent_compute-ego1_min0.012692737107229703
complete-iteration_max0.9656063241533712
complete-iteration_mean0.8388478157765583
complete-iteration_median0.908606570130284
complete-iteration_min0.33109180218571926
deviation-center-line_max3.683022238854437
deviation-center-line_mean2.4631277980179904
deviation-center-line_min0.9580154504811808
deviation-heading_max14.114002048876513
deviation-heading_mean9.525218099459234
deviation-heading_median11.33274197351738
deviation-heading_min1.525072637878252
driven_any_max11.673148563924231
driven_any_mean8.715018580774375
driven_any_median11.262041837607178
driven_any_min1.0878700540345845
driven_lanedir_consec_max11.440264210335805
driven_lanedir_consec_mean8.251716557653554
driven_lanedir_consec_min1.0542746262022595
driven_lanedir_max11.440264210335805
driven_lanedir_mean8.34264293594187
driven_lanedir_median10.662841035279808
driven_lanedir_min1.0542746262022595
get_duckie_state_max1.7511159752330415e-06
get_duckie_state_mean1.709848505079284e-06
get_duckie_state_median1.735616438459642e-06
get_duckie_state_min1.6572175673104444e-06
get_robot_state_max0.015260836960969618
get_robot_state_mean0.014095463654577672
get_robot_state_median0.015110233840497703
get_robot_state_min0.008119320095230599
get_state_dump_max0.010074920201678756
get_state_dump_mean0.009501359773954412
get_state_dump_median0.009922458766203538
get_state_dump_min0.006881773025169659
get_ui_image_max0.05238955443745152
get_ui_image_mean0.04626190036101692
get_ui_image_median0.049023177204878504
get_ui_image_min0.03418354487836014
in-drivable-lane_max3.899999999999987
in-drivable-lane_mean0.5571428571428558
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.0878858619974436, "get_ui_image": 0.04341214718204914, "step_physics": 0.7964374600070538, "survival_time": 20.15000000000015, "driven_lanedir": 1.0655480431654314, "get_state_dump": 0.00981649372837331, "get_robot_state": 0.01490339194193925, "sim_render-ego0": 0.003942293105739178, "sim_render-ego1": 0.004106447248175593, "sim_render-ego2": 0.0041077437967357066, "sim_render-ego3": 0.004094377602681075, "get_duckie_state": 1.735616438459642e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.9371430859400114, "agent_compute-ego0": 0.012762062030263466, "agent_compute-ego1": 0.012692737107229703, "agent_compute-ego2": 0.0116626502263664, "agent_compute-ego3": 0.01250239351008198, "complete-iteration": 0.9656063241533712, "set_robot_commands": 0.00240473463983819, "deviation-center-line": 1.2017108390807003, "driven_lanedir_consec": 1.0655480431654314, "sim_compute_sim_state": 0.017418655428555932, "sim_compute_performance-ego0": 0.0020764959920750985, "sim_compute_performance-ego1": 0.00203789224719057, "sim_compute_performance-ego2": 0.0020507267206022056, "sim_compute_performance-ego3": 0.002027887519043271}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.739039965435137, "get_ui_image": 0.04341214718204914, "step_physics": 0.7964374600070538, "survival_time": 20.15000000000015, "driven_lanedir": 3.525645817837535, "get_state_dump": 0.00981649372837331, "get_robot_state": 0.01490339194193925, "sim_render-ego0": 0.003942293105739178, "sim_render-ego1": 0.004106447248175593, "sim_render-ego2": 0.0041077437967357066, "sim_render-ego3": 0.004094377602681075, "get_duckie_state": 1.735616438459642e-06, "in-drivable-lane": 0.6000000000000005, "deviation-heading": 3.5919204483409337, "agent_compute-ego0": 0.012762062030263466, "agent_compute-ego1": 0.012692737107229703, "agent_compute-ego2": 0.0116626502263664, "agent_compute-ego3": 0.01250239351008198, "complete-iteration": 0.9656063241533712, "set_robot_commands": 0.00240473463983819, "deviation-center-line": 0.9820378495185, "driven_lanedir_consec": 3.525645817837535, "sim_compute_sim_state": 0.017418655428555932, "sim_compute_performance-ego0": 0.0020764959920750985, "sim_compute_performance-ego1": 0.00203789224719057, "sim_compute_performance-ego2": 0.0020507267206022056, "sim_compute_performance-ego3": 0.002027887519043271}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.044466735770954, "get_ui_image": 0.04341214718204914, "step_physics": 0.7964374600070538, "survival_time": 20.15000000000015, "driven_lanedir": 2.974340633297323, "get_state_dump": 0.00981649372837331, "get_robot_state": 0.01490339194193925, "sim_render-ego0": 0.003942293105739178, "sim_render-ego1": 0.004106447248175593, "sim_render-ego2": 0.0041077437967357066, "sim_render-ego3": 0.004094377602681075, "get_duckie_state": 1.735616438459642e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.243027135950815, "agent_compute-ego0": 0.012762062030263466, "agent_compute-ego1": 0.012692737107229703, "agent_compute-ego2": 0.0116626502263664, "agent_compute-ego3": 0.01250239351008198, "complete-iteration": 0.9656063241533712, "set_robot_commands": 0.00240473463983819, "deviation-center-line": 0.9580154504811808, "driven_lanedir_consec": 2.974340633297323, "sim_compute_sim_state": 0.017418655428555932, "sim_compute_performance-ego0": 0.0020764959920750985, "sim_compute_performance-ego1": 0.00203789224719057, "sim_compute_performance-ego2": 0.0020507267206022056, "sim_compute_performance-ego3": 0.002027887519043271}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.0878700540345845, "get_ui_image": 0.04341214718204914, "step_physics": 0.7964374600070538, "survival_time": 20.15000000000015, "driven_lanedir": 1.0542746262022595, "get_state_dump": 0.00981649372837331, "get_robot_state": 0.01490339194193925, "sim_render-ego0": 0.003942293105739178, "sim_render-ego1": 0.004106447248175593, "sim_render-ego2": 0.0041077437967357066, "sim_render-ego3": 0.004094377602681075, "get_duckie_state": 1.735616438459642e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.525072637878252, "agent_compute-ego0": 0.012762062030263466, "agent_compute-ego1": 0.012692737107229703, "agent_compute-ego2": 0.0116626502263664, "agent_compute-ego3": 0.01250239351008198, "complete-iteration": 0.9656063241533712, "set_robot_commands": 0.00240473463983819, "deviation-center-line": 1.9356367406937145, "driven_lanedir_consec": 1.0542746262022595, "sim_compute_sim_state": 0.017418655428555932, "sim_compute_performance-ego0": 0.0020764959920750985, "sim_compute_performance-ego1": 0.00203789224719057, "sim_compute_performance-ego2": 0.0020507267206022056, "sim_compute_performance-ego3": 0.002027887519043271}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 11.672866178328048, "get_ui_image": 0.05238955443745152, "step_physics": 0.6832930106703784, "survival_time": 59.99999999999873, "driven_lanedir": 11.175795706489248, "get_state_dump": 0.010074920201678756, "get_robot_state": 0.015110233840497703, "sim_render-ego0": 0.004088184815660107, "sim_render-ego1": 0.004186929215201728, "sim_render-ego2": 0.004227958253579374, "sim_render-ego3": 0.0042130139149992194, "get_duckie_state": 1.6572175673104444e-06, "in-drivable-lane": 0.7000000000000006, "deviation-heading": 12.031066036260148, "agent_compute-ego0": 0.01264990716055966, "agent_compute-ego1": 0.013242478970186992, "agent_compute-ego2": 0.012429746958139438, "agent_compute-ego3": 0.012618776364290743, "complete-iteration": 0.8962085598414387, "set_robot_commands": 0.0023271815167378623, "deviation-center-line": 3.0565819428065835, "driven_lanedir_consec": 11.175795706489248, "sim_compute_sim_state": 0.04970641993761658, "sim_compute_performance-ego0": 0.00221958227896075, "sim_compute_performance-ego1": 0.002091935830350522, "sim_compute_performance-ego2": 0.002080711099527758, "sim_compute_performance-ego3": 0.0021013246785591883}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 11.672934340366286, "get_ui_image": 0.05238955443745152, "step_physics": 0.6832930106703784, "survival_time": 59.99999999999873, "driven_lanedir": 11.285738582914714, "get_state_dump": 0.010074920201678756, "get_robot_state": 0.015110233840497703, "sim_render-ego0": 0.004088184815660107, "sim_render-ego1": 0.004186929215201728, "sim_render-ego2": 0.004227958253579374, "sim_render-ego3": 0.0042130139149992194, "get_duckie_state": 1.6572175673104444e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.599744229677528, "agent_compute-ego0": 0.01264990716055966, "agent_compute-ego1": 0.013242478970186992, "agent_compute-ego2": 0.012429746958139438, "agent_compute-ego3": 0.012618776364290743, "complete-iteration": 0.8962085598414387, "set_robot_commands": 0.0023271815167378623, "deviation-center-line": 2.973632792452388, "driven_lanedir_consec": 11.285738582914714, "sim_compute_sim_state": 0.04970641993761658, "sim_compute_performance-ego0": 0.00221958227896075, "sim_compute_performance-ego1": 0.002091935830350522, "sim_compute_performance-ego2": 0.002080711099527758, "sim_compute_performance-ego3": 0.0021013246785591883}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 11.672885424550714, "get_ui_image": 0.05238955443745152, "step_physics": 0.6832930106703784, "survival_time": 59.99999999999873, "driven_lanedir": 10.770977196431453, "get_state_dump": 0.010074920201678756, "get_robot_state": 0.015110233840497703, "sim_render-ego0": 0.004088184815660107, "sim_render-ego1": 0.004186929215201728, "sim_render-ego2": 0.004227958253579374, "sim_render-ego3": 0.0042130139149992194, "get_duckie_state": 1.6572175673104444e-06, "in-drivable-lane": 1.9999999999999964, "deviation-heading": 13.332243522878311, "agent_compute-ego0": 0.01264990716055966, "agent_compute-ego1": 0.013242478970186992, "agent_compute-ego2": 0.012429746958139438, "agent_compute-ego3": 0.012618776364290743, "complete-iteration": 0.8962085598414387, "set_robot_commands": 0.0023271815167378623, "deviation-center-line": 3.0027987417396473, "driven_lanedir_consec": 10.416436004583858, "sim_compute_sim_state": 0.04970641993761658, "sim_compute_performance-ego0": 0.00221958227896075, "sim_compute_performance-ego1": 0.002091935830350522, "sim_compute_performance-ego2": 0.002080711099527758, "sim_compute_performance-ego3": 0.0021013246785591883}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 11.672919807056909, "get_ui_image": 0.05238955443745152, "step_physics": 0.6832930106703784, "survival_time": 59.99999999999873, "driven_lanedir": 11.13760767169826, "get_state_dump": 0.010074920201678756, "get_robot_state": 0.015110233840497703, "sim_render-ego0": 0.004088184815660107, "sim_render-ego1": 0.004186929215201728, "sim_render-ego2": 0.004227958253579374, "sim_render-ego3": 0.0042130139149992194, "get_duckie_state": 1.6572175673104444e-06, "in-drivable-lane": 0.5999999999999979, "deviation-heading": 13.057460333753282, "agent_compute-ego0": 0.01264990716055966, "agent_compute-ego1": 0.013242478970186992, "agent_compute-ego2": 0.012429746958139438, "agent_compute-ego3": 0.012618776364290743, "complete-iteration": 0.8962085598414387, "set_robot_commands": 0.0023271815167378623, "deviation-center-line": 3.0455181171931063, "driven_lanedir_consec": 11.13760767169826, "sim_compute_sim_state": 0.04970641993761658, "sim_compute_performance-ego0": 0.00221958227896075, "sim_compute_performance-ego1": 0.002091935830350522, "sim_compute_performance-ego2": 0.002080711099527758, "sim_compute_performance-ego3": 0.0021013246785591883}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 10.860931125230344, "get_ui_image": 0.049023177204878504, "step_physics": 0.7070943612440936, "survival_time": 59.99999999999873, "driven_lanedir": 10.554704874128165, "get_state_dump": 0.009922458766203538, "get_robot_state": 0.015260836960969618, "sim_render-ego0": 0.004050195663795185, "sim_render-ego1": 0.004205178261597289, "sim_render-ego2": 0.00421671287701787, "sim_render-ego3": 0.004201409421693674, "get_duckie_state": 1.7511159752330415e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.443344074021775, "agent_compute-ego0": 0.012349674247087388, "agent_compute-ego1": 0.013131244494257918, "agent_compute-ego2": 0.0123348200350975, "agent_compute-ego3": 0.01245673153422258, "complete-iteration": 0.908606570130284, "set_robot_commands": 0.002330165421535927, "deviation-center-line": 3.2949095774008663, "driven_lanedir_consec": 10.554704874128165, "sim_compute_sim_state": 0.042231959963122775, "sim_compute_performance-ego0": 0.0022595980880063937, "sim_compute_performance-ego1": 0.0020966515950021102, "sim_compute_performance-ego2": 0.002099650785587511, "sim_compute_performance-ego3": 0.0021072827608361036}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 11.663152549984014, "get_ui_image": 0.049023177204878504, "step_physics": 0.7070943612440936, "survival_time": 59.99999999999873, "driven_lanedir": 11.35583400520681, "get_state_dump": 0.009922458766203538, "get_robot_state": 0.015260836960969618, "sim_render-ego0": 0.004050195663795185, "sim_render-ego1": 0.004205178261597289, "sim_render-ego2": 0.00421671287701787, "sim_render-ego3": 0.004201409421693674, "get_duckie_state": 1.7511159752330415e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.537337617375314, "agent_compute-ego0": 0.012349674247087388, "agent_compute-ego1": 0.013131244494257918, "agent_compute-ego2": 0.0123348200350975, "agent_compute-ego3": 0.01245673153422258, "complete-iteration": 0.908606570130284, "set_robot_commands": 0.002330165421535927, "deviation-center-line": 2.6637254959984724, "driven_lanedir_consec": 11.35583400520681, "sim_compute_sim_state": 0.042231959963122775, "sim_compute_performance-ego0": 0.0022595980880063937, "sim_compute_performance-ego1": 0.0020966515950021102, "sim_compute_performance-ego2": 0.002099650785587511, "sim_compute_performance-ego3": 0.0021072827608361036}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 10.24461108839382, "get_ui_image": 0.049023177204878504, "step_physics": 0.7070943612440936, "survival_time": 59.99999999999873, "driven_lanedir": 9.058984794758477, "get_state_dump": 0.009922458766203538, "get_robot_state": 0.015260836960969618, "sim_render-ego0": 0.004050195663795185, "sim_render-ego1": 0.004205178261597289, "sim_render-ego2": 0.00421671287701787, "sim_render-ego3": 0.004201409421693674, "get_duckie_state": 1.7511159752330415e-06, "in-drivable-lane": 3.899999999999987, "deviation-heading": 14.114002048876513, "agent_compute-ego0": 0.012349674247087388, "agent_compute-ego1": 0.013131244494257918, "agent_compute-ego2": 0.0123348200350975, "agent_compute-ego3": 0.01245673153422258, "complete-iteration": 0.908606570130284, "set_robot_commands": 0.002330165421535927, "deviation-center-line": 2.937182440228956, "driven_lanedir_consec": 8.14055669056967, "sim_compute_sim_state": 0.042231959963122775, "sim_compute_performance-ego0": 0.0022595980880063937, "sim_compute_performance-ego1": 0.0020966515950021102, "sim_compute_performance-ego2": 0.002099650785587511, "sim_compute_performance-ego3": 0.0021072827608361036}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 10.244623176841955, "get_ui_image": 0.049023177204878504, "step_physics": 0.7070943612440936, "survival_time": 59.99999999999873, "driven_lanedir": 9.963154729892258, "get_state_dump": 0.009922458766203538, "get_robot_state": 0.015260836960969618, "sim_render-ego0": 0.004050195663795185, "sim_render-ego1": 0.004205178261597289, "sim_render-ego2": 0.00421671287701787, "sim_render-ego3": 0.004201409421693674, "get_duckie_state": 1.7511159752330415e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.128146329659447, "agent_compute-ego0": 0.012349674247087388, "agent_compute-ego1": 0.013131244494257918, "agent_compute-ego2": 0.0123348200350975, "agent_compute-ego3": 0.01245673153422258, "complete-iteration": 0.908606570130284, "set_robot_commands": 0.002330165421535927, "deviation-center-line": 3.683022238854437, "driven_lanedir_consec": 9.963154729892258, "sim_compute_sim_state": 0.042231959963122775, "sim_compute_performance-ego0": 0.0022595980880063937, "sim_compute_performance-ego1": 0.0020966515950021102, "sim_compute_performance-ego2": 0.002099650785587511, "sim_compute_performance-ego3": 0.0021072827608361036}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 11.673148563924231, "get_ui_image": 0.03418354487836014, "step_physics": 0.22605126862919003, "survival_time": 59.99999999999873, "driven_lanedir": 11.434130210828446, "get_state_dump": 0.006881773025169659, "get_robot_state": 0.008119320095230599, "sim_render-ego0": 0.00421622829770764, "sim_render-ego1": 0.004402246999303864, "get_duckie_state": 1.6810395735487354e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.618434796727774, "agent_compute-ego0": 0.01264957285840545, "agent_compute-ego1": 0.01368354659195645, "complete-iteration": 0.33109180218571926, "set_robot_commands": 0.0024763666322884415, "deviation-center-line": 2.7081584613015495, "driven_lanedir_consec": 11.434130210828446, "sim_compute_sim_state": 0.011335764201257151, "sim_compute_performance-ego0": 0.0022345260219907483, "sim_compute_performance-ego1": 0.0022447889393116412}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 11.672925258926828, "get_ui_image": 0.03418354487836014, "step_physics": 0.22605126862919003, "survival_time": 59.99999999999873, "driven_lanedir": 11.440264210335805, "get_state_dump": 0.006881773025169659, "get_robot_state": 0.008119320095230599, "sim_render-ego0": 0.00421622829770764, "sim_render-ego1": 0.004402246999303864, "get_duckie_state": 1.6810395735487354e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.194111095089182, "agent_compute-ego0": 0.01264957285840545, "agent_compute-ego1": 0.01368354659195645, "complete-iteration": 0.33109180218571926, "set_robot_commands": 0.0024763666322884415, "deviation-center-line": 2.040858484501759, "driven_lanedir_consec": 11.440264210335805, "sim_compute_sim_state": 0.011335764201257151, "sim_compute_performance-ego0": 0.0022345260219907483, "sim_compute_performance-ego1": 0.0022447889393116412}}
set_robot_commands_max0.0024763666322884415
set_robot_commands_mean0.002371504255501772
set_robot_commands_median0.002330165421535927
set_robot_commands_min0.0023271815167378623
sim_compute_performance-ego0_max0.0022595980880063937
sim_compute_performance-ego0_mean0.0021922683914393196
sim_compute_performance-ego0_median0.00221958227896075
sim_compute_performance-ego0_min0.0020764959920750985
sim_compute_performance-ego1_max0.0022447889393116412
sim_compute_performance-ego1_mean0.0020996783263425777
sim_compute_performance-ego1_median0.002091935830350522
sim_compute_performance-ego1_min0.00203789224719057
sim_compute_sim_state_max0.04970641993761658
sim_compute_sim_state_mean0.032864262122835386
sim_compute_sim_state_median0.042231959963122775
sim_compute_sim_state_min0.011335764201257151
sim_render-ego0_max0.00421622829770764
sim_render-ego0_mean0.004053939352585226
sim_render-ego0_median0.004050195663795185
sim_render-ego0_min0.003942293105739178
sim_render-ego1_max0.004402246999303864
sim_render-ego1_mean0.004199908064179011
sim_render-ego1_median0.004186929215201728
sim_render-ego1_min0.004106447248175593
simulation-passed1
step_physics_max0.7964374600070538
step_physics_mean0.6571001332103202
step_physics_median0.7070943612440936
step_physics_min0.22605126862919003
survival_time_max59.99999999999873
survival_time_mean48.61428571428486
survival_time_min20.15000000000015
No reset possible
58902LFVmultibodyv-simsuccessyes1:38:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58900LFVmultibodyv-simsuccessyes1:55:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible