Duckietown Challenges Home Challenges Submissions

Submission 12682

Submission12682
Competingyes
Challengeaido5-LFVI_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVIv-sim: 53475
Next
User labelbaseline-duckietown
Admin priority50
Blessingn/a
User priority50

53475

Click the images to see detailed statistics about the episode.

LFVI_multi-norm-4way-000

LFVI_multi-norm-udem1-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53475LFVIv-simsuccessyes1:05:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7365353587317778
survival_time_median42.89999999999948
deviation-center-line_median2.84830199590988
in-drivable-lane_median0.7249999999999974


other stats
agent_compute-ego0_max0.012656446301272072
agent_compute-ego0_mean0.012257416057058162
agent_compute-ego0_median0.012257416057058162
agent_compute-ego0_min0.011858385812844253
agent_compute-ego1_max0.012617726012332357
agent_compute-ego1_mean0.012357745497980736
agent_compute-ego1_median0.012357745497980736
agent_compute-ego1_min0.01209776498362912
agent_compute-ego2_max0.014793202045259626
agent_compute-ego2_mean0.01361479967344001
agent_compute-ego2_median0.01361479967344001
agent_compute-ego2_min0.012436397301620395
agent_compute-ego3_max0.013080464513176784
agent_compute-ego3_mean0.012621398099718245
agent_compute-ego3_median0.012621398099718245
agent_compute-ego3_min0.0121623316862597
complete-iteration_max1.4608088067727325
complete-iteration_mean1.369431839576368
complete-iteration_median1.369431839576368
complete-iteration_min1.278054872380004
deviation-center-line_max9.217785819036976
deviation-center-line_mean3.614721695540292
deviation-center-line_min1.5716939940819965
deviation-heading_max76.32908276968809
deviation-heading_mean25.79421274820484
deviation-heading_median17.48752394909144
deviation-heading_min5.723422603223774
driven_any_max7.913433911002174
driven_any_mean2.0814198559095938
driven_any_median0.9471972833926864
driven_any_min0.18057900139412988
driven_lanedir_consec_max3.110999281265738
driven_lanedir_consec_mean1.0384999329243336
driven_lanedir_consec_min0.1777749799477597
driven_lanedir_max5.182030822285855
driven_lanedir_mean1.5237997686554534
driven_lanedir_median0.7615755052541318
driven_lanedir_min0.1777749799477597
get_duckie_state_max2.6958570392999323e-06
get_duckie_state_mean2.6013554016577936e-06
get_duckie_state_median2.6013554016577936e-06
get_duckie_state_min2.5068537640156554e-06
get_robot_state_max0.015272566122774478
get_robot_state_mean0.014936552042553466
get_robot_state_median0.014936552042553466
get_robot_state_min0.014600537962332454
get_state_dump_max0.010115239145753782
get_state_dump_mean0.009976564247134504
get_state_dump_median0.009976564247134504
get_state_dump_min0.009837889348515228
get_ui_image_max0.05169866424516079
get_ui_image_mean0.05105299545236338
get_ui_image_median0.05105299545236338
get_ui_image_min0.05040732665956597
in-drivable-lane_max15.249999999999604
in-drivable-lane_mean2.631249999999953
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 3.287057796826924, "get_ui_image": 0.05040732665956597, "step_physics": 1.0948427618126344, "survival_time": 25.80000000000023, "driven_lanedir": 2.798457402704174, "get_state_dump": 0.009837889348515228, "get_robot_state": 0.014600537962332454, "sim_render-ego0": 0.003864775773865572, "sim_render-ego1": 0.0039715771518316215, "sim_render-ego2": 0.003977107817245867, "sim_render-ego3": 0.004022604722810668, "get_duckie_state": 2.5068537640156554e-06, "in-drivable-lane": 1.6000000000000227, "deviation-heading": 7.911413072575346, "agent_compute-ego0": 0.011858385812844253, "agent_compute-ego1": 0.01209776498362912, "agent_compute-ego2": 0.012436397301620395, "agent_compute-ego3": 0.0121623316862597, "complete-iteration": 1.278054872380004, "set_robot_commands": 0.002545644974109052, "deviation-center-line": 1.5716939940819965, "driven_lanedir_consec": 1.710789453866042, "sim_compute_sim_state": 0.025914551902785753, "sim_compute_performance-ego0": 0.002181493106155838, "sim_compute_performance-ego1": 0.0020067207587295623, "sim_compute_performance-ego2": 0.002044212426161628, "sim_compute_performance-ego3": 0.0020285284496137667}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 1.322301353109347, "get_ui_image": 0.05040732665956597, "step_physics": 1.0948427618126344, "survival_time": 25.80000000000023, "driven_lanedir": 1.0721934120968215, "get_state_dump": 0.009837889348515228, "get_robot_state": 0.014600537962332454, "sim_render-ego0": 0.003864775773865572, "sim_render-ego1": 0.0039715771518316215, "sim_render-ego2": 0.003977107817245867, "sim_render-ego3": 0.004022604722810668, "get_duckie_state": 2.5068537640156554e-06, "in-drivable-lane": 0.849999999999997, "deviation-heading": 16.39095413984782, "agent_compute-ego0": 0.011858385812844253, "agent_compute-ego1": 0.01209776498362912, "agent_compute-ego2": 0.012436397301620395, "agent_compute-ego3": 0.0121623316862597, "complete-iteration": 1.278054872380004, "set_robot_commands": 0.002545644974109052, "deviation-center-line": 2.1382629586141153, "driven_lanedir_consec": 1.0721934120968215, "sim_compute_sim_state": 0.025914551902785753, "sim_compute_performance-ego0": 0.002181493106155838, "sim_compute_performance-ego1": 0.0020067207587295623, "sim_compute_performance-ego2": 0.002044212426161628, "sim_compute_performance-ego3": 0.0020285284496137667}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 2.483671692936709, "get_ui_image": 0.05040732665956597, "step_physics": 1.0948427618126344, "survival_time": 25.80000000000023, "driven_lanedir": 1.7458123150428226, "get_state_dump": 0.009837889348515228, "get_robot_state": 0.014600537962332454, "sim_render-ego0": 0.003864775773865572, "sim_render-ego1": 0.0039715771518316215, "sim_render-ego2": 0.003977107817245867, "sim_render-ego3": 0.004022604722810668, "get_duckie_state": 2.5068537640156554e-06, "in-drivable-lane": 2.75, "deviation-heading": 16.906393062854754, "agent_compute-ego0": 0.011858385812844253, "agent_compute-ego1": 0.01209776498362912, "agent_compute-ego2": 0.012436397301620395, "agent_compute-ego3": 0.0121623316862597, "complete-iteration": 1.278054872380004, "set_robot_commands": 0.002545644974109052, "deviation-center-line": 1.7838120509770474, "driven_lanedir_consec": 1.0221131190521136, "sim_compute_sim_state": 0.025914551902785753, "sim_compute_performance-ego0": 0.002181493106155838, "sim_compute_performance-ego1": 0.0020067207587295623, "sim_compute_performance-ego2": 0.002044212426161628, "sim_compute_performance-ego3": 0.0020285284496137667}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 0.4262032183454611, "get_ui_image": 0.05040732665956597, "step_physics": 1.0948427618126344, "survival_time": 25.80000000000023, "driven_lanedir": 0.4195699102322577, "get_state_dump": 0.009837889348515228, "get_robot_state": 0.014600537962332454, "sim_render-ego0": 0.003864775773865572, "sim_render-ego1": 0.0039715771518316215, "sim_render-ego2": 0.003977107817245867, "sim_render-ego3": 0.004022604722810668, "get_duckie_state": 2.5068537640156554e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.723422603223774, "agent_compute-ego0": 0.011858385812844253, "agent_compute-ego1": 0.01209776498362912, "agent_compute-ego2": 0.012436397301620395, "agent_compute-ego3": 0.0121623316862597, "complete-iteration": 1.278054872380004, "set_robot_commands": 0.002545644974109052, "deviation-center-line": 2.9699916527811996, "driven_lanedir_consec": 0.4195699102322577, "sim_compute_sim_state": 0.025914551902785753, "sim_compute_performance-ego0": 0.002181493106155838, "sim_compute_performance-ego1": 0.0020067207587295623, "sim_compute_performance-ego2": 0.002044212426161628, "sim_compute_performance-ego3": 0.0020285284496137667}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 0.18057900139412988, "get_ui_image": 0.05169866424516079, "step_physics": 1.2780584433394409, "survival_time": 59.99999999999873, "driven_lanedir": 0.1777749799477597, "get_state_dump": 0.010115239145753782, "get_robot_state": 0.015272566122774478, "sim_render-ego0": 0.00403626058421266, "sim_render-ego1": 0.004114976234976001, "sim_render-ego2": 0.004264850997607178, "sim_render-ego3": 0.004095710385947501, "get_duckie_state": 2.6958570392999323e-06, "in-drivable-lane": 0.0, "deviation-heading": 20.634179066691075, "agent_compute-ego0": 0.012656446301272072, "agent_compute-ego1": 0.012617726012332357, "agent_compute-ego2": 0.014793202045259626, "agent_compute-ego3": 0.013080464513176784, "complete-iteration": 1.4608088067727325, "set_robot_commands": 0.002574379100688391, "deviation-center-line": 2.72661233903856, "driven_lanedir_consec": 0.1777749799477597, "sim_compute_sim_state": 0.01698633494921072, "sim_compute_performance-ego0": 0.002200744034944228, "sim_compute_performance-ego1": 0.0021425504470050185, "sim_compute_performance-ego2": 0.002139522670012132, "sim_compute_performance-ego3": 0.0021683915667887236}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 7.913433911002174, "get_ui_image": 0.05169866424516079, "step_physics": 1.2780584433394409, "survival_time": 59.99999999999873, "driven_lanedir": 5.182030822285855, "get_state_dump": 0.010115239145753782, "get_robot_state": 0.015272566122774478, "sim_render-ego0": 0.00403626058421266, "sim_render-ego1": 0.004114976234976001, "sim_render-ego2": 0.004264850997607178, "sim_render-ego3": 0.004095710385947501, "get_duckie_state": 2.6958570392999323e-06, "in-drivable-lane": 15.249999999999604, "deviation-heading": 18.06865483532812, "agent_compute-ego0": 0.012656446301272072, "agent_compute-ego1": 0.012617726012332357, "agent_compute-ego2": 0.014793202045259626, "agent_compute-ego3": 0.013080464513176784, "complete-iteration": 1.4608088067727325, "set_robot_commands": 0.002574379100688391, "deviation-center-line": 3.272790562033553, "driven_lanedir_consec": 3.110999281265738, "sim_compute_sim_state": 0.01698633494921072, "sim_compute_performance-ego0": 0.002200744034944228, "sim_compute_performance-ego1": 0.0021425504470050185, "sim_compute_performance-ego2": 0.002139522670012132, "sim_compute_performance-ego3": 0.0021683915667887236}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.5720932136760256, "get_ui_image": 0.05169866424516079, "step_physics": 1.2780584433394409, "survival_time": 59.99999999999873, "driven_lanedir": 0.34360170852249583, "get_state_dump": 0.010115239145753782, "get_robot_state": 0.015272566122774478, "sim_render-ego0": 0.00403626058421266, "sim_render-ego1": 0.004114976234976001, "sim_render-ego2": 0.004264850997607178, "sim_render-ego3": 0.004095710385947501, "get_duckie_state": 2.6958570392999323e-06, "in-drivable-lane": 0.5999999999999979, "deviation-heading": 76.32908276968809, "agent_compute-ego0": 0.012656446301272072, "agent_compute-ego1": 0.012617726012332357, "agent_compute-ego2": 0.014793202045259626, "agent_compute-ego3": 0.013080464513176784, "complete-iteration": 1.4608088067727325, "set_robot_commands": 0.002574379100688391, "deviation-center-line": 9.217785819036976, "driven_lanedir_consec": 0.34360170852249583, "sim_compute_sim_state": 0.01698633494921072, "sim_compute_performance-ego0": 0.002200744034944228, "sim_compute_performance-ego1": 0.0021425504470050185, "sim_compute_performance-ego2": 0.002139522670012132, "sim_compute_performance-ego3": 0.0021683915667887236}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 0.4660186599859807, "get_ui_image": 0.05169866424516079, "step_physics": 1.2780584433394409, "survival_time": 59.99999999999873, "driven_lanedir": 0.450957598411442, "get_state_dump": 0.010115239145753782, "get_robot_state": 0.015272566122774478, "sim_render-ego0": 0.00403626058421266, "sim_render-ego1": 0.004114976234976001, "sim_render-ego2": 0.004264850997607178, "sim_render-ego3": 0.004095710385947501, "get_duckie_state": 2.6958570392999323e-06, "in-drivable-lane": 0.0, "deviation-heading": 44.38960243542978, "agent_compute-ego0": 0.012656446301272072, "agent_compute-ego1": 0.012617726012332357, "agent_compute-ego2": 0.014793202045259626, "agent_compute-ego3": 0.013080464513176784, "complete-iteration": 1.4608088067727325, "set_robot_commands": 0.002574379100688391, "deviation-center-line": 5.2368241877588915, "driven_lanedir_consec": 0.450957598411442, "sim_compute_sim_state": 0.01698633494921072, "sim_compute_performance-ego0": 0.002200744034944228, "sim_compute_performance-ego1": 0.0021425504470050185, "sim_compute_performance-ego2": 0.002139522670012132, "sim_compute_performance-ego3": 0.0021683915667887236}}
set_robot_commands_max0.002574379100688391
set_robot_commands_mean0.0025600120373987217
set_robot_commands_median0.0025600120373987217
set_robot_commands_min0.002545644974109052
sim_compute_performance-ego0_max0.002200744034944228
sim_compute_performance-ego0_mean0.002191118570550033
sim_compute_performance-ego0_median0.002191118570550033
sim_compute_performance-ego0_min0.002181493106155838
sim_compute_performance-ego1_max0.0021425504470050185
sim_compute_performance-ego1_mean0.0020746356028672904
sim_compute_performance-ego1_median0.0020746356028672904
sim_compute_performance-ego1_min0.0020067207587295623
sim_compute_performance-ego2_max0.002139522670012132
sim_compute_performance-ego2_mean0.0020918675480868796
sim_compute_performance-ego2_median0.0020918675480868796
sim_compute_performance-ego2_min0.002044212426161628
sim_compute_performance-ego3_max0.0021683915667887236
sim_compute_performance-ego3_mean0.002098460008201245
sim_compute_performance-ego3_median0.002098460008201245
sim_compute_performance-ego3_min0.0020285284496137667
sim_compute_sim_state_max0.025914551902785753
sim_compute_sim_state_mean0.021450443425998236
sim_compute_sim_state_median0.021450443425998236
sim_compute_sim_state_min0.01698633494921072
sim_render-ego0_max0.00403626058421266
sim_render-ego0_mean0.003950518179039116
sim_render-ego0_median0.003950518179039116
sim_render-ego0_min0.003864775773865572
sim_render-ego1_max0.004114976234976001
sim_render-ego1_mean0.004043276693403811
sim_render-ego1_median0.004043276693403811
sim_render-ego1_min0.0039715771518316215
sim_render-ego2_max0.004264850997607178
sim_render-ego2_mean0.0041209794074265225
sim_render-ego2_median0.0041209794074265225
sim_render-ego2_min0.003977107817245867
sim_render-ego3_max0.004095710385947501
sim_render-ego3_mean0.004059157554379085
sim_render-ego3_median0.004059157554379085
sim_render-ego3_min0.004022604722810668
simulation-passed1
step_physics_max1.2780584433394409
step_physics_mean1.1864506025760375
step_physics_median1.1864506025760375
step_physics_min1.0948427618126344
survival_time_max59.99999999999873
survival_time_mean42.89999999999948
survival_time_min25.80000000000023
No reset possible