Duckietown Challenges Home Challenges Submissions

Submission 12719

Submission12719
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 53683
Next
User labeltemplate-random
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53683LFVmultibodyv-simsuccessyes0:12:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3386162956066159
survival_time_median7.199999999999982
deviation-center-line_median0.13150150834523444
in-drivable-lane_median5.1749999999999865


other stats
agent_compute-ego0_max0.011722405751546225
agent_compute-ego0_mean0.010929438489737504
agent_compute-ego0_median0.011222859223683676
agent_compute-ego0_min0.00980748070610894
agent_compute-ego1_max0.011322734753290813
agent_compute-ego1_mean0.011028431262062323
agent_compute-ego1_median0.011310026563447095
agent_compute-ego1_min0.009510649575127495
complete-iteration_max0.7791247523688023
complete-iteration_mean0.6385245849410843
complete-iteration_median0.7153307931176547
complete-iteration_min0.22275862308463665
deviation-center-line_max1.1793353551209578
deviation-center-line_mean0.19682735223382447
deviation-center-line_min0.03781627258124975
deviation-heading_max4.13206271019058
deviation-heading_mean1.0463262829209203
deviation-heading_median0.9402685921450354
deviation-heading_min0.291348286294811
driven_any_max2.951704478527868
driven_any_mean1.9134596982041032
driven_any_median1.760372794839244
driven_any_min0.18489783262536005
driven_lanedir_consec_max0.7960762545928977
driven_lanedir_consec_mean0.3518580104312197
driven_lanedir_consec_min0.10162466951715476
driven_lanedir_max0.7960762545928977
driven_lanedir_mean0.3521650626338418
driven_lanedir_median0.3407656610249702
driven_lanedir_min0.10162466951715476
get_duckie_state_max1.621246337890625e-06
get_duckie_state_mean1.4283424279340927e-06
get_duckie_state_median1.41804514367596e-06
get_duckie_state_min1.1969094324593591e-06
get_robot_state_max0.013855441411336263
get_robot_state_mean0.012603908334645204
get_robot_state_median0.013493496796180462
get_robot_state_min0.006588858787459556
get_state_dump_max0.009104559818903605
get_state_dump_mean0.008536570188728405
get_state_dump_median0.009079020007763032
get_state_dump_min0.005694887854836204
get_ui_image_max0.046942214308113885
get_ui_image_mean0.04225200004815798
get_ui_image_median0.04475971764209224
get_ui_image_min0.027452302701545483
in-drivable-lane_max6.599999999999981
in-drivable-lane_mean4.764285714285701
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.274124355035624, "get_ui_image": 0.042453916867574056, "step_physics": 0.46910995841026304, "survival_time": 5.949999999999987, "driven_lanedir": 0.7960762545928977, "get_state_dump": 0.009104559818903605, "get_robot_state": 0.013855441411336263, "sim_render-ego0": 0.003612061341603597, "sim_render-ego1": 0.003557280699412028, "sim_render-ego2": 0.0035638153553009034, "sim_render-ego3": 0.003508975108464559, "get_duckie_state": 1.621246337890625e-06, "in-drivable-lane": 3.4499999999999877, "deviation-heading": 0.9316977066482196, "agent_compute-ego0": 0.011222859223683676, "agent_compute-ego1": 0.011322734753290813, "agent_compute-ego2": 0.011229141553243002, "agent_compute-ego3": 0.010541401306788128, "complete-iteration": 0.6290011902650198, "set_robot_commands": 0.002067895730336507, "deviation-center-line": 0.23307611918600285, "driven_lanedir_consec": 0.7960762545928977, "sim_compute_sim_state": 0.019801880915959677, "sim_compute_performance-ego0": 0.001980968316396078, "sim_compute_performance-ego1": 0.0018273015817006429, "sim_compute_performance-ego2": 0.0018316030502319336, "sim_compute_performance-ego3": 0.0018568714459737143}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.7771107787938447, "get_ui_image": 0.042453916867574056, "step_physics": 0.46910995841026304, "survival_time": 5.949999999999987, "driven_lanedir": 0.4079052940890945, "get_state_dump": 0.009104559818903605, "get_robot_state": 0.013855441411336263, "sim_render-ego0": 0.003612061341603597, "sim_render-ego1": 0.003557280699412028, "sim_render-ego2": 0.0035638153553009034, "sim_render-ego3": 0.003508975108464559, "get_duckie_state": 1.621246337890625e-06, "in-drivable-lane": 4.64999999999999, "deviation-heading": 0.5815629454748248, "agent_compute-ego0": 0.011222859223683676, "agent_compute-ego1": 0.011322734753290813, "agent_compute-ego2": 0.011229141553243002, "agent_compute-ego3": 0.010541401306788128, "complete-iteration": 0.6290011902650198, "set_robot_commands": 0.002067895730336507, "deviation-center-line": 0.15345155549638095, "driven_lanedir_consec": 0.4079052940890945, "sim_compute_sim_state": 0.019801880915959677, "sim_compute_performance-ego0": 0.001980968316396078, "sim_compute_performance-ego1": 0.0018273015817006429, "sim_compute_performance-ego2": 0.0018316030502319336, "sim_compute_performance-ego3": 0.0018568714459737143}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.615892599054939, "get_ui_image": 0.042453916867574056, "step_physics": 0.46910995841026304, "survival_time": 5.949999999999987, "driven_lanedir": 0.3409414151275487, "get_state_dump": 0.009104559818903605, "get_robot_state": 0.013855441411336263, "sim_render-ego0": 0.003612061341603597, "sim_render-ego1": 0.003557280699412028, "sim_render-ego2": 0.0035638153553009034, "sim_render-ego3": 0.003508975108464559, "get_duckie_state": 1.621246337890625e-06, "in-drivable-lane": 4.599999999999988, "deviation-heading": 0.9488394776418512, "agent_compute-ego0": 0.011222859223683676, "agent_compute-ego1": 0.011322734753290813, "agent_compute-ego2": 0.011229141553243002, "agent_compute-ego3": 0.010541401306788128, "complete-iteration": 0.6290011902650198, "set_robot_commands": 0.002067895730336507, "deviation-center-line": 0.09422141413744677, "driven_lanedir_consec": 0.3409414151275487, "sim_compute_sim_state": 0.019801880915959677, "sim_compute_performance-ego0": 0.001980968316396078, "sim_compute_performance-ego1": 0.0018273015817006429, "sim_compute_performance-ego2": 0.0018316030502319336, "sim_compute_performance-ego3": 0.0018568714459737143}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.6398074009825068, "get_ui_image": 0.042453916867574056, "step_physics": 0.46910995841026304, "survival_time": 5.949999999999987, "driven_lanedir": 0.21369386022737347, "get_state_dump": 0.009104559818903605, "get_robot_state": 0.013855441411336263, "sim_render-ego0": 0.003612061341603597, "sim_render-ego1": 0.003557280699412028, "sim_render-ego2": 0.0035638153553009034, "sim_render-ego3": 0.003508975108464559, "get_duckie_state": 1.621246337890625e-06, "in-drivable-lane": 5.099999999999986, "deviation-heading": 0.36485645822221113, "agent_compute-ego0": 0.011222859223683676, "agent_compute-ego1": 0.011322734753290813, "agent_compute-ego2": 0.011229141553243002, "agent_compute-ego3": 0.010541401306788128, "complete-iteration": 0.6290011902650198, "set_robot_commands": 0.002067895730336507, "deviation-center-line": 0.06914054888435704, "driven_lanedir_consec": 0.21369386022737347, "sim_compute_sim_state": 0.019801880915959677, "sim_compute_performance-ego0": 0.001980968316396078, "sim_compute_performance-ego1": 0.0018273015817006429, "sim_compute_performance-ego2": 0.0018316030502319336, "sim_compute_performance-ego3": 0.0018568714459737143}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.5559095507228855, "get_ui_image": 0.046942214308113885, "step_physics": 0.5423104351964491, "survival_time": 7.199999999999982, "driven_lanedir": 0.16582071872096904, "get_state_dump": 0.008846971906464676, "get_robot_state": 0.013493496796180462, "sim_render-ego0": 0.003445641747836409, "sim_render-ego1": 0.0034881509583571863, "sim_render-ego2": 0.003432181785846578, "sim_render-ego3": 0.003477385948444235, "get_duckie_state": 1.3614522999730603e-06, "in-drivable-lane": 6.449999999999982, "deviation-heading": 0.3586823355775982, "agent_compute-ego0": 0.010404029385796909, "agent_compute-ego1": 0.011310026563447095, "agent_compute-ego2": 0.011426376474314723, "agent_compute-ego3": 0.010820669963442046, "complete-iteration": 0.7153307931176547, "set_robot_commands": 0.001976532771669585, "deviation-center-line": 0.059631431224197985, "driven_lanedir_consec": 0.16582071872096904, "sim_compute_sim_state": 0.03034915759645659, "sim_compute_performance-ego0": 0.0019563428286848397, "sim_compute_performance-ego1": 0.0017634737080541151, "sim_compute_performance-ego2": 0.0017823219299316407, "sim_compute_performance-ego3": 0.0017890223141374258}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.8734985354242055, "get_ui_image": 0.046942214308113885, "step_physics": 0.5423104351964491, "survival_time": 7.199999999999982, "driven_lanedir": 0.19265203980442447, "get_state_dump": 0.008846971906464676, "get_robot_state": 0.013493496796180462, "sim_render-ego0": 0.003445641747836409, "sim_render-ego1": 0.0034881509583571863, "sim_render-ego2": 0.003432181785846578, "sim_render-ego3": 0.003477385948444235, "get_duckie_state": 1.3614522999730603e-06, "in-drivable-lane": 5.949999999999984, "deviation-heading": 1.2444813548952531, "agent_compute-ego0": 0.010404029385796909, "agent_compute-ego1": 0.011310026563447095, "agent_compute-ego2": 0.011426376474314723, "agent_compute-ego3": 0.010820669963442046, "complete-iteration": 0.7153307931176547, "set_robot_commands": 0.001976532771669585, "deviation-center-line": 0.09612169677476312, "driven_lanedir_consec": 0.19265203980442447, "sim_compute_sim_state": 0.03034915759645659, "sim_compute_performance-ego0": 0.0019563428286848397, "sim_compute_performance-ego1": 0.0017634737080541151, "sim_compute_performance-ego2": 0.0017823219299316407, "sim_compute_performance-ego3": 0.0017890223141374258}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 2.3178974013322633, "get_ui_image": 0.046942214308113885, "step_physics": 0.5423104351964491, "survival_time": 7.199999999999982, "driven_lanedir": 0.10162466951715476, "get_state_dump": 0.008846971906464676, "get_robot_state": 0.013493496796180462, "sim_render-ego0": 0.003445641747836409, "sim_render-ego1": 0.0034881509583571863, "sim_render-ego2": 0.003432181785846578, "sim_render-ego3": 0.003477385948444235, "get_duckie_state": 1.3614522999730603e-06, "in-drivable-lane": 6.499999999999982, "deviation-heading": 0.5541987636288823, "agent_compute-ego0": 0.010404029385796909, "agent_compute-ego1": 0.011310026563447095, "agent_compute-ego2": 0.011426376474314723, "agent_compute-ego3": 0.010820669963442046, "complete-iteration": 0.7153307931176547, "set_robot_commands": 0.001976532771669585, "deviation-center-line": 0.03781627258124975, "driven_lanedir_consec": 0.10162466951715476, "sim_compute_sim_state": 0.03034915759645659, "sim_compute_performance-ego0": 0.0019563428286848397, "sim_compute_performance-ego1": 0.0017634737080541151, "sim_compute_performance-ego2": 0.0017823219299316407, "sim_compute_performance-ego3": 0.0017890223141374258}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 2.7765427252108315, "get_ui_image": 0.046942214308113885, "step_physics": 0.5423104351964491, "survival_time": 7.199999999999982, "driven_lanedir": 0.6452515830462522, "get_state_dump": 0.008846971906464676, "get_robot_state": 0.013493496796180462, "sim_render-ego0": 0.003445641747836409, "sim_render-ego1": 0.0034881509583571863, "sim_render-ego2": 0.003432181785846578, "sim_render-ego3": 0.003477385948444235, "get_duckie_state": 1.3614522999730603e-06, "in-drivable-lane": 5.249999999999986, "deviation-heading": 0.9734465477255804, "agent_compute-ego0": 0.010404029385796909, "agent_compute-ego1": 0.011310026563447095, "agent_compute-ego2": 0.011426376474314723, "agent_compute-ego3": 0.010820669963442046, "complete-iteration": 0.7153307931176547, "set_robot_commands": 0.001976532771669585, "deviation-center-line": 0.1436614022182105, "driven_lanedir_consec": 0.6452515830462522, "sim_compute_sim_state": 0.03034915759645659, "sim_compute_performance-ego0": 0.0019563428286848397, "sim_compute_performance-ego1": 0.0017634737080541151, "sim_compute_performance-ego2": 0.0017823219299316407, "sim_compute_performance-ego3": 0.0017890223141374258}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.18489783262536005, "get_ui_image": 0.04475971764209224, "step_physics": 0.6126421682195726, "survival_time": 7.599999999999981, "driven_lanedir": 0.16126759294861004, "get_state_dump": 0.009079020007763032, "get_robot_state": 0.013470311570011712, "sim_render-ego0": 0.003640374327017591, "sim_render-ego1": 0.003532110476026348, "sim_render-ego2": 0.003414015364802741, "sim_render-ego3": 0.0035435421014922896, "get_duckie_state": 1.41804514367596e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.13206271019058, "agent_compute-ego0": 0.011722405751546225, "agent_compute-ego1": 0.011211423312916476, "agent_compute-ego2": 0.011280471203373927, "agent_compute-ego3": 0.011048583423390108, "complete-iteration": 0.7791247523688023, "set_robot_commands": 0.00201468530044057, "deviation-center-line": 1.1793353551209578, "driven_lanedir_consec": 0.16126759294861004, "sim_compute_sim_state": 0.023762199613783095, "sim_compute_performance-ego0": 0.0019215399922888263, "sim_compute_performance-ego1": 0.0018569456985573364, "sim_compute_performance-ego2": 0.001818000880721348, "sim_compute_performance-ego3": 0.0018444450852138543}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.7205864887254294, "get_ui_image": 0.04475971764209224, "step_physics": 0.6126421682195726, "survival_time": 7.599999999999981, "driven_lanedir": 0.34433052196676683, "get_state_dump": 0.009079020007763032, "get_robot_state": 0.013470311570011712, "sim_render-ego0": 0.003640374327017591, "sim_render-ego1": 0.003532110476026348, "sim_render-ego2": 0.003414015364802741, "sim_render-ego3": 0.0035435421014922896, "get_duckie_state": 1.41804514367596e-06, "in-drivable-lane": 6.049999999999983, "deviation-heading": 1.1722790788608328, "agent_compute-ego0": 0.011722405751546225, "agent_compute-ego1": 0.011211423312916476, "agent_compute-ego2": 0.011280471203373927, "agent_compute-ego3": 0.011048583423390108, "complete-iteration": 0.7791247523688023, "set_robot_commands": 0.00201468530044057, "deviation-center-line": 0.1193416144722584, "driven_lanedir_consec": 0.34433052196676683, "sim_compute_sim_state": 0.023762199613783095, "sim_compute_performance-ego0": 0.0019215399922888263, "sim_compute_performance-ego1": 0.0018569456985573364, "sim_compute_performance-ego2": 0.001818000880721348, "sim_compute_performance-ego3": 0.0018444450852138543}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.7436348108846431, "get_ui_image": 0.04475971764209224, "step_physics": 0.6126421682195726, "survival_time": 7.599999999999981, "driven_lanedir": 0.3484125379459806, "get_state_dump": 0.009079020007763032, "get_robot_state": 0.013470311570011712, "sim_render-ego0": 0.003640374327017591, "sim_render-ego1": 0.003532110476026348, "sim_render-ego2": 0.003414015364802741, "sim_render-ego3": 0.0035435421014922896, "get_duckie_state": 1.41804514367596e-06, "in-drivable-lane": 6.049999999999981, "deviation-heading": 0.9782946667514604, "agent_compute-ego0": 0.011722405751546225, "agent_compute-ego1": 0.011211423312916476, "agent_compute-ego2": 0.011280471203373927, "agent_compute-ego3": 0.011048583423390108, "complete-iteration": 0.7791247523688023, "set_robot_commands": 0.00201468530044057, "deviation-center-line": 0.14721758995799067, "driven_lanedir_consec": 0.3484125379459806, "sim_compute_sim_state": 0.023762199613783095, "sim_compute_performance-ego0": 0.0019215399922888263, "sim_compute_performance-ego1": 0.0018569456985573364, "sim_compute_performance-ego2": 0.001818000880721348, "sim_compute_performance-ego3": 0.0018444450852138543}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 2.951704478527868, "get_ui_image": 0.04475971764209224, "step_physics": 0.6126421682195726, "survival_time": 7.599999999999981, "driven_lanedir": 0.2576470504888566, "get_state_dump": 0.009079020007763032, "get_robot_state": 0.013470311570011712, "sim_render-ego0": 0.003640374327017591, "sim_render-ego1": 0.003532110476026348, "sim_render-ego2": 0.003414015364802741, "sim_render-ego3": 0.0035435421014922896, "get_duckie_state": 1.41804514367596e-06, "in-drivable-lane": 6.599999999999981, "deviation-heading": 0.3481560818464254, "agent_compute-ego0": 0.011722405751546225, "agent_compute-ego1": 0.011211423312916476, "agent_compute-ego2": 0.011280471203373927, "agent_compute-ego3": 0.011048583423390108, "complete-iteration": 0.7791247523688023, "set_robot_commands": 0.00201468530044057, "deviation-center-line": 0.086677958791832, "driven_lanedir_consec": 0.2576470504888566, "sim_compute_sim_state": 0.023762199613783095, "sim_compute_performance-ego0": 0.0019215399922888263, "sim_compute_performance-ego1": 0.0018569456985573364, "sim_compute_performance-ego2": 0.001818000880721348, "sim_compute_performance-ego3": 0.0018444450852138543}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.678414408768526, "get_ui_image": 0.027452302701545483, "step_physics": 0.1418391068776449, "survival_time": 4.899999999999991, "driven_lanedir": 0.6140974314754637, "get_state_dump": 0.005694887854836204, "get_robot_state": 0.006588858787459556, "sim_render-ego0": 0.003295166323883365, "sim_render-ego1": 0.0032425938230572324, "get_duckie_state": 1.1969094324593591e-06, "in-drivable-lane": 3.1499999999999897, "deviation-heading": 0.291348286294811, "agent_compute-ego0": 0.00980748070610894, "agent_compute-ego1": 0.009510649575127495, "complete-iteration": 0.22275862308463665, "set_robot_commands": 0.001906031309956252, "deviation-center-line": 0.16192487225063373, "driven_lanedir_consec": 0.6140974314754637, "sim_compute_sim_state": 0.008028813082762438, "sim_compute_performance-ego0": 0.0017115371395843198, "sim_compute_performance-ego1": 0.0016815541970609414}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.6784144087685244, "get_ui_image": 0.027452302701545483, "step_physics": 0.1418391068776449, "survival_time": 4.899999999999991, "driven_lanedir": 0.34058990692239166, "get_state_dump": 0.005694887854836204, "get_robot_state": 0.006588858787459556, "sim_render-ego0": 0.003295166323883365, "sim_render-ego1": 0.0032425938230572324, "get_duckie_state": 1.1969094324593591e-06, "in-drivable-lane": 2.8999999999999924, "deviation-heading": 1.768661547134351, "agent_compute-ego0": 0.00980748070610894, "agent_compute-ego1": 0.009510649575127495, "complete-iteration": 0.22275862308463665, "set_robot_commands": 0.001906031309956252, "deviation-center-line": 0.17396510017726105, "driven_lanedir_consec": 0.33629117608568304, "sim_compute_sim_state": 0.008028813082762438, "sim_compute_performance-ego0": 0.0017115371395843198, "sim_compute_performance-ego1": 0.0016815541970609414}}
set_robot_commands_max0.002067895730336507
set_robot_commands_mean0.002003465559264225
set_robot_commands_median0.00201468530044057
set_robot_commands_min0.001906031309956252
sim_compute_performance-ego0_max0.001980968316396078
sim_compute_performance-ego0_mean0.001918462773474829
sim_compute_performance-ego0_median0.0019563428286848397
sim_compute_performance-ego0_min0.0017115371395843198
sim_compute_performance-ego1_max0.0018569456985573364
sim_compute_performance-ego1_mean0.0017967137390978757
sim_compute_performance-ego1_median0.0018273015817006429
sim_compute_performance-ego1_min0.0016815541970609414
sim_compute_sim_state_max0.03034915759645659
sim_compute_sim_state_mean0.022265041333594453
sim_compute_sim_state_median0.023762199613783095
sim_compute_sim_state_min0.008028813082762438
sim_render-ego0_max0.003640374327017591
sim_render-ego0_mean0.0035273315938283666
sim_render-ego0_median0.003612061341603597
sim_render-ego0_min0.003295166323883365
sim_render-ego1_max0.003557280699412028
sim_render-ego1_mean0.0034853825843783382
sim_render-ego1_median0.003532110476026348
sim_render-ego1_min0.0032425938230572324
simulation-passed1
step_physics_max0.6126421682195726
step_physics_mean0.4842806043614591
step_physics_median0.5423104351964491
step_physics_min0.1418391068776449
survival_time_max7.599999999999981
survival_time_mean6.628571428571413
survival_time_min4.899999999999991
No reset possible
53680LFVmultibodyv-simsuccessyes0:14:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53679LFVmultibodyv-simsuccessyes0:12:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53676LFVmultibodyv-simsuccessyes0:13:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53675LFVmultibodyv-simsuccessyes0:14:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible