Duckietown Challenges Home Challenges Submissions

Submission 12673

Submission12673
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 53502
Next
User labelbaseline-duckietown
Admin priority50
Blessingn/a
User priority50

53502

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53502LFVmultibodyv-simsuccessyes2:05:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.837834171880962
survival_time_median59.99999999999873
deviation-center-line_median4.067827641715926
in-drivable-lane_median12.749999999999623


other stats
agent_compute-ego0_max0.0371153648449519
agent_compute-ego0_mean0.016740795802287343
agent_compute-ego0_median0.012090679013064064
agent_compute-ego0_min0.012040491802904826
agent_compute-ego1_max0.035814319026162486
agent_compute-ego1_mean0.026881802616638938
agent_compute-ego1_median0.02906537492706019
agent_compute-ego1_min0.012621566516771404
complete-iteration_max1.153997488561816
complete-iteration_mean0.973236000862589
complete-iteration_median1.0882330093653771
complete-iteration_min0.3462257268129042
deviation-center-line_max6.624912436184627
deviation-center-line_mean3.5420257402154944
deviation-center-line_min0.6138575095895134
deviation-heading_max30.657094356570052
deviation-heading_mean14.849978884793384
deviation-heading_median13.048573577405111
deviation-heading_min4.145135537216352
driven_any_max7.920797121861448
driven_any_mean6.460743326889097
driven_any_median7.916672926400366
driven_any_min2.0789359174123936
driven_lanedir_consec_max6.438139041756019
driven_lanedir_consec_mean3.0922825696027076
driven_lanedir_consec_min0.7100535687122744
driven_lanedir_max6.438139041756019
driven_lanedir_mean4.11147037947351
driven_lanedir_median4.722564366884017
driven_lanedir_min1.3959826151985122
get_duckie_state_max7.695103565123953e-06
get_duckie_state_mean3.762430649556941e-06
get_duckie_state_median2.220210981408722e-06
get_duckie_state_min2.1467597955073248e-06
get_robot_state_max0.014829099227943388
get_robot_state_mean0.013662402349376535
get_robot_state_median0.014645522480503308
get_robot_state_min0.007476305584427121
get_state_dump_max0.010003990178104246
get_state_dump_mean0.009245706877896175
get_state_dump_median0.009641244151411604
get_state_dump_min0.00636536195613661
get_ui_image_max0.04919221716856182
get_ui_image_mean0.04373870829530827
get_ui_image_median0.04612240862786819
get_ui_image_min0.030997197097981603
in-drivable-lane_max47.39999999999866
in-drivable-lane_mean20.121428571427995
in-drivable-lane_min5.650000000000073
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.8685787753904854, "get_ui_image": 0.04227225468815812, "step_physics": 0.7580363494371196, "survival_time": 59.99999999999873, "driven_lanedir": 1.6896817981177303, "get_state_dump": 0.010003990178104246, "get_robot_state": 0.014829099227943388, "sim_render-ego0": 0.004035261449567682, "sim_render-ego1": 0.004057582272379523, "sim_render-ego2": 0.003869236359290537, "sim_render-ego3": 0.00391339322708727, "get_duckie_state": 2.220210981408722e-06, "in-drivable-lane": 5.650000000000073, "deviation-heading": 25.418698465415805, "agent_compute-ego0": 0.015903932069560867, "agent_compute-ego1": 0.03449220820132342, "agent_compute-ego2": 0.02695519322658161, "agent_compute-ego3": 0.0273421620647675, "complete-iteration": 0.990982641685416, "set_robot_commands": 0.0023425911785065383, "deviation-center-line": 6.624912436184627, "driven_lanedir_consec": 0.8478370951157723, "sim_compute_sim_state": 0.02717632020542167, "sim_compute_performance-ego0": 0.002148994299692476, "sim_compute_performance-ego1": 0.0020719440056819107, "sim_compute_performance-ego2": 0.0020322208102795604, "sim_compute_performance-ego3": 0.002017071403929038}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 7.920103049106978, "get_ui_image": 0.04227225468815812, "step_physics": 0.7580363494371196, "survival_time": 59.99999999999873, "driven_lanedir": 5.782092620902848, "get_state_dump": 0.010003990178104246, "get_robot_state": 0.014829099227943388, "sim_render-ego0": 0.004035261449567682, "sim_render-ego1": 0.004057582272379523, "sim_render-ego2": 0.003869236359290537, "sim_render-ego3": 0.00391339322708727, "get_duckie_state": 2.220210981408722e-06, "in-drivable-lane": 11.449999999999504, "deviation-heading": 15.502096366064146, "agent_compute-ego0": 0.015903932069560867, "agent_compute-ego1": 0.03449220820132342, "agent_compute-ego2": 0.02695519322658161, "agent_compute-ego3": 0.0273421620647675, "complete-iteration": 0.990982641685416, "set_robot_commands": 0.0023425911785065383, "deviation-center-line": 3.3596264977417776, "driven_lanedir_consec": 3.457405983090454, "sim_compute_sim_state": 0.02717632020542167, "sim_compute_performance-ego0": 0.002148994299692476, "sim_compute_performance-ego1": 0.0020719440056819107, "sim_compute_performance-ego2": 0.0020322208102795604, "sim_compute_performance-ego3": 0.002017071403929038}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 7.919895494775049, "get_ui_image": 0.04227225468815812, "step_physics": 0.7580363494371196, "survival_time": 59.99999999999873, "driven_lanedir": 4.66639383993871, "get_state_dump": 0.010003990178104246, "get_robot_state": 0.014829099227943388, "sim_render-ego0": 0.004035261449567682, "sim_render-ego1": 0.004057582272379523, "sim_render-ego2": 0.003869236359290537, "sim_render-ego3": 0.00391339322708727, "get_duckie_state": 2.220210981408722e-06, "in-drivable-lane": 22.69999999999891, "deviation-heading": 7.40456186928011, "agent_compute-ego0": 0.015903932069560867, "agent_compute-ego1": 0.03449220820132342, "agent_compute-ego2": 0.02695519322658161, "agent_compute-ego3": 0.0273421620647675, "complete-iteration": 0.990982641685416, "set_robot_commands": 0.0023425911785065383, "deviation-center-line": 2.6989326836281817, "driven_lanedir_consec": 4.66639383993871, "sim_compute_sim_state": 0.02717632020542167, "sim_compute_performance-ego0": 0.002148994299692476, "sim_compute_performance-ego1": 0.0020719440056819107, "sim_compute_performance-ego2": 0.0020322208102795604, "sim_compute_performance-ego3": 0.002017071403929038}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 6.990349460830376, "get_ui_image": 0.04227225468815812, "step_physics": 0.7580363494371196, "survival_time": 59.99999999999873, "driven_lanedir": 2.7624196215694825, "get_state_dump": 0.010003990178104246, "get_robot_state": 0.014829099227943388, "sim_render-ego0": 0.004035261449567682, "sim_render-ego1": 0.004057582272379523, "sim_render-ego2": 0.003869236359290537, "sim_render-ego3": 0.00391339322708727, "get_duckie_state": 2.220210981408722e-06, "in-drivable-lane": 36.24999999999851, "deviation-heading": 8.037876070264536, "agent_compute-ego0": 0.015903932069560867, "agent_compute-ego1": 0.03449220820132342, "agent_compute-ego2": 0.02695519322658161, "agent_compute-ego3": 0.0273421620647675, "complete-iteration": 0.990982641685416, "set_robot_commands": 0.0023425911785065383, "deviation-center-line": 1.89729263127008, "driven_lanedir_consec": 2.1782611607934586, "sim_compute_sim_state": 0.02717632020542167, "sim_compute_performance-ego0": 0.002148994299692476, "sim_compute_performance-ego1": 0.0020719440056819107, "sim_compute_performance-ego2": 0.0020322208102795604, "sim_compute_performance-ego3": 0.002017071403929038}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 7.919801214303988, "get_ui_image": 0.04919221716856182, "step_physics": 0.942975548284437, "survival_time": 59.99999999999873, "driven_lanedir": 5.504529883555561, "get_state_dump": 0.009641244151411604, "get_robot_state": 0.0146056337221576, "sim_render-ego0": 0.0038189907852160146, "sim_render-ego1": 0.0039654713089916725, "sim_render-ego2": 0.003820070517648765, "sim_render-ego3": 0.003944428933847953, "get_duckie_state": 7.695103565123953e-06, "in-drivable-lane": 10.449999999999786, "deviation-heading": 22.716091283397, "agent_compute-ego0": 0.012090679013064064, "agent_compute-ego1": 0.02906537492706019, "agent_compute-ego2": 0.012205941591731316, "agent_compute-ego3": 0.01182121857318354, "complete-iteration": 1.153997488561816, "set_robot_commands": 0.0021967298283763572, "deviation-center-line": 4.071544353140812, "driven_lanedir_consec": 2.7743266514640075, "sim_compute_sim_state": 0.03930071827573244, "sim_compute_performance-ego0": 0.0021558734995439388, "sim_compute_performance-ego1": 0.0019842448778493913, "sim_compute_performance-ego2": 0.0020270423031567932, "sim_compute_performance-ego3": 0.002008353343712698}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 2.0789359174123936, "get_ui_image": 0.04919221716856182, "step_physics": 0.942975548284437, "survival_time": 59.99999999999873, "driven_lanedir": 1.3959826151985122, "get_state_dump": 0.009641244151411604, "get_robot_state": 0.0146056337221576, "sim_render-ego0": 0.0038189907852160146, "sim_render-ego1": 0.0039654713089916725, "sim_render-ego2": 0.003820070517648765, "sim_render-ego3": 0.003944428933847953, "get_duckie_state": 7.695103565123953e-06, "in-drivable-lane": 47.39999999999866, "deviation-heading": 5.199640010688934, "agent_compute-ego0": 0.012090679013064064, "agent_compute-ego1": 0.02906537492706019, "agent_compute-ego2": 0.012205941591731316, "agent_compute-ego3": 0.01182121857318354, "complete-iteration": 1.153997488561816, "set_robot_commands": 0.0021967298283763572, "deviation-center-line": 0.6138575095895134, "driven_lanedir_consec": 0.7100535687122744, "sim_compute_sim_state": 0.03930071827573244, "sim_compute_performance-ego0": 0.0021558734995439388, "sim_compute_performance-ego1": 0.0019842448778493913, "sim_compute_performance-ego2": 0.0020270423031567932, "sim_compute_performance-ego3": 0.002008353343712698}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 7.920293382874347, "get_ui_image": 0.04919221716856182, "step_physics": 0.942975548284437, "survival_time": 59.99999999999873, "driven_lanedir": 5.319008611548617, "get_state_dump": 0.009641244151411604, "get_robot_state": 0.0146056337221576, "sim_render-ego0": 0.0038189907852160146, "sim_render-ego1": 0.0039654713089916725, "sim_render-ego2": 0.003820070517648765, "sim_render-ego3": 0.003944428933847953, "get_duckie_state": 7.695103565123953e-06, "in-drivable-lane": 12.599999999999582, "deviation-heading": 20.12397755795265, "agent_compute-ego0": 0.012090679013064064, "agent_compute-ego1": 0.02906537492706019, "agent_compute-ego2": 0.012205941591731316, "agent_compute-ego3": 0.01182121857318354, "complete-iteration": 1.153997488561816, "set_robot_commands": 0.0021967298283763572, "deviation-center-line": 4.195699097691002, "driven_lanedir_consec": 3.640975889645896, "sim_compute_sim_state": 0.03930071827573244, "sim_compute_performance-ego0": 0.0021558734995439388, "sim_compute_performance-ego1": 0.0019842448778493913, "sim_compute_performance-ego2": 0.0020270423031567932, "sim_compute_performance-ego3": 0.002008353343712698}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 7.9199867503707315, "get_ui_image": 0.04919221716856182, "step_physics": 0.942975548284437, "survival_time": 59.99999999999873, "driven_lanedir": 5.587326724482758, "get_state_dump": 0.009641244151411604, "get_robot_state": 0.0146056337221576, "sim_render-ego0": 0.0038189907852160146, "sim_render-ego1": 0.0039654713089916725, "sim_render-ego2": 0.003820070517648765, "sim_render-ego3": 0.003944428933847953, "get_duckie_state": 7.695103565123953e-06, "in-drivable-lane": 10.899999999999824, "deviation-heading": 21.020549453564733, "agent_compute-ego0": 0.012090679013064064, "agent_compute-ego1": 0.02906537492706019, "agent_compute-ego2": 0.012205941591731316, "agent_compute-ego3": 0.01182121857318354, "complete-iteration": 1.153997488561816, "set_robot_commands": 0.0021967298283763572, "deviation-center-line": 4.17858475456991, "driven_lanedir_consec": 4.465932962854692, "sim_compute_sim_state": 0.03930071827573244, "sim_compute_performance-ego0": 0.0021558734995439388, "sim_compute_performance-ego1": 0.0019842448778493913, "sim_compute_performance-ego2": 0.0020270423031567932, "sim_compute_performance-ego3": 0.002008353343712698}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 4.235811836729921, "get_ui_image": 0.04612240862786819, "step_physics": 0.9019214539206296, "survival_time": 59.99999999999873, "driven_lanedir": 2.623097010820003, "get_state_dump": 0.009532058765052458, "get_robot_state": 0.014645522480503308, "sim_render-ego0": 0.003783674859484467, "sim_render-ego1": 0.003984396503330964, "sim_render-ego2": 0.0040071175358476095, "sim_render-ego3": 0.00395066077067989, "get_duckie_state": 2.1467597955073248e-06, "in-drivable-lane": 8.250000000000117, "deviation-heading": 30.657094356570052, "agent_compute-ego0": 0.012040491802904826, "agent_compute-ego1": 0.012621566516771404, "agent_compute-ego2": 0.01306519301904429, "agent_compute-ego3": 0.012191977925741304, "complete-iteration": 1.0882330093653771, "set_robot_commands": 0.0022386966597329173, "deviation-center-line": 4.386713579890048, "driven_lanedir_consec": 2.069156452705667, "sim_compute_sim_state": 0.032668578039101025, "sim_compute_performance-ego0": 0.002117466867019691, "sim_compute_performance-ego1": 0.00203064756528424, "sim_compute_performance-ego2": 0.0020106831359228026, "sim_compute_performance-ego3": 0.0020295043075015205}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 7.913544638496745, "get_ui_image": 0.04612240862786819, "step_physics": 0.9019214539206296, "survival_time": 59.99999999999873, "driven_lanedir": 2.8480993919171076, "get_state_dump": 0.009532058765052458, "get_robot_state": 0.014645522480503308, "sim_render-ego0": 0.003783674859484467, "sim_render-ego1": 0.003984396503330964, "sim_render-ego2": 0.0040071175358476095, "sim_render-ego3": 0.00395066077067989, "get_duckie_state": 2.1467597955073248e-06, "in-drivable-lane": 34.34999999999942, "deviation-heading": 10.59505078874608, "agent_compute-ego0": 0.012040491802904826, "agent_compute-ego1": 0.012621566516771404, "agent_compute-ego2": 0.01306519301904429, "agent_compute-ego3": 0.012191977925741304, "complete-iteration": 1.0882330093653771, "set_robot_commands": 0.0022386966597329173, "deviation-center-line": 1.6600749329008038, "driven_lanedir_consec": 2.5264752055012134, "sim_compute_sim_state": 0.032668578039101025, "sim_compute_performance-ego0": 0.002117466867019691, "sim_compute_performance-ego1": 0.00203064756528424, "sim_compute_performance-ego2": 0.0020106831359228026, "sim_compute_performance-ego3": 0.0020295043075015205}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.0084314165840738, "get_ui_image": 0.04612240862786819, "step_physics": 0.9019214539206296, "survival_time": 59.99999999999873, "driven_lanedir": 2.266027252702465, "get_state_dump": 0.009532058765052458, "get_robot_state": 0.014645522480503308, "sim_render-ego0": 0.003783674859484467, "sim_render-ego1": 0.003984396503330964, "sim_render-ego2": 0.0040071175358476095, "sim_render-ego3": 0.00395066077067989, "get_duckie_state": 2.1467597955073248e-06, "in-drivable-lane": 41.5999999999986, "deviation-heading": 4.145135537216352, "agent_compute-ego0": 0.012040491802904826, "agent_compute-ego1": 0.012621566516771404, "agent_compute-ego2": 0.01306519301904429, "agent_compute-ego3": 0.012191977925741304, "complete-iteration": 1.0882330093653771, "set_robot_commands": 0.0022386966597329173, "deviation-center-line": 1.341864669960066, "driven_lanedir_consec": 2.266027252702465, "sim_compute_sim_state": 0.032668578039101025, "sim_compute_performance-ego0": 0.002117466867019691, "sim_compute_performance-ego1": 0.00203064756528424, "sim_compute_performance-ego2": 0.0020106831359228026, "sim_compute_performance-ego3": 0.0020295043075015205}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 7.913148589774042, "get_ui_image": 0.04612240862786819, "step_physics": 0.9019214539206296, "survival_time": 59.99999999999873, "driven_lanedir": 4.7787348938293235, "get_state_dump": 0.009532058765052458, "get_robot_state": 0.014645522480503308, "sim_render-ego0": 0.003783674859484467, "sim_render-ego1": 0.003984396503330964, "sim_render-ego2": 0.0040071175358476095, "sim_render-ego3": 0.00395066077067989, "get_duckie_state": 2.1467597955073248e-06, "in-drivable-lane": 17.44999999999969, "deviation-heading": 18.66859318782395, "agent_compute-ego0": 0.012040491802904826, "agent_compute-ego1": 0.012621566516771404, "agent_compute-ego2": 0.01306519301904429, "agent_compute-ego3": 0.012191977925741304, "complete-iteration": 1.0882330093653771, "set_robot_commands": 0.0022386966597329173, "deviation-center-line": 4.06411093029104, "driven_lanedir_consec": 2.9013416922979163, "sim_compute_sim_state": 0.032668578039101025, "sim_compute_performance-ego0": 0.002117466867019691, "sim_compute_performance-ego1": 0.00203064756528424, "sim_compute_performance-ego2": 0.0020106831359228026, "sim_compute_performance-ego3": 0.0020295043075015205}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 7.92072892793678, "get_ui_image": 0.030997197097981603, "step_physics": 0.20186037743319876, "survival_time": 59.99999999999873, "driven_lanedir": 5.899052006290005, "get_state_dump": 0.00636536195613661, "get_robot_state": 0.007476305584427121, "sim_render-ego0": 0.0038031455777666153, "sim_render-ego1": 0.003812254517401982, "get_duckie_state": 2.212865862818582e-06, "in-drivable-lane": 12.899999999999665, "deviation-heading": 9.378629706690957, "agent_compute-ego0": 0.0371153648449519, "agent_compute-ego1": 0.035814319026162486, "complete-iteration": 0.3462257268129042, "set_robot_commands": 0.002277535264636952, "deviation-center-line": 4.88359788044673, "driven_lanedir_consec": 4.349629177859366, "sim_compute_sim_state": 0.01017969811985038, "sim_compute_performance-ego0": 0.0020348878823946556, "sim_compute_performance-ego1": 0.0020193408470566723}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 7.920797121861448, "get_ui_image": 0.030997197097981603, "step_physics": 0.20186037743319876, "survival_time": 59.99999999999873, "driven_lanedir": 6.438139041756019, "get_state_dump": 0.00636536195613661, "get_robot_state": 0.007476305584427121, "sim_render-ego0": 0.0038031455777666153, "sim_render-ego1": 0.003812254517401982, "get_duckie_state": 2.212865862818582e-06, "in-drivable-lane": 9.749999999999584, "deviation-heading": 9.031709733432049, "agent_compute-ego0": 0.0371153648449519, "agent_compute-ego1": 0.035814319026162486, "complete-iteration": 0.3462257268129042, "set_robot_commands": 0.002277535264636952, "deviation-center-line": 5.611548405712334, "driven_lanedir_consec": 6.438139041756019, "sim_compute_sim_state": 0.01017969811985038, "sim_compute_performance-ego0": 0.0020348878823946556, "sim_compute_performance-ego1": 0.0020193408470566723}}
set_robot_commands_max0.0023425911785065383
set_robot_commands_mean0.002261938656838368
set_robot_commands_median0.0022386966597329173
set_robot_commands_min0.0021967298283763572
sim_compute_performance-ego0_max0.0021558734995439388
sim_compute_performance-ego0_mean0.002125651030700982
sim_compute_performance-ego0_median0.002148994299692476
sim_compute_performance-ego0_min0.0020348878823946556
sim_compute_performance-ego1_max0.0020719440056819107
sim_compute_performance-ego1_mean0.0020275733920982514
sim_compute_performance-ego1_median0.00203064756528424
sim_compute_performance-ego1_min0.0019842448778493913
sim_compute_sim_state_max0.03930071827573244
sim_compute_sim_state_mean0.02978156159433723
sim_compute_sim_state_median0.032668578039101025
sim_compute_sim_state_min0.01017969811985038
sim_render-ego0_max0.004035261449567682
sim_render-ego0_mean0.0038684285380432767
sim_render-ego0_median0.0038189907852160146
sim_render-ego0_min0.003783674859484467
sim_render-ego1_max0.004057582272379523
sim_render-ego1_mean0.003975307812400901
sim_render-ego1_median0.003984396503330964
sim_render-ego1_min0.003812254517401982
simulation-passed1
step_physics_max0.942975548284437
step_physics_mean0.7725324401025102
step_physics_median0.9019214539206296
step_physics_min0.20186037743319876
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873
No reset possible
53501LFVmultibodyv-simsuccessyes2:02:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53500LFVmultibodyv-simsuccessyes2:10:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53499LFVmultibodyv-simsuccessyes1:52:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible