Duckietown Challenges Home Challenges Submissions

Submission 12758

Submission12758
Competingyes
Challengeaido5-LFVI_multi-sim-validation
UserRaphael Jean
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVIv-sim: 59024
Next
User labelsim-exercise-1
Admin priority50
Blessingn/a
User priority50

59024

Click the images to see detailed statistics about the episode.

LFVI_multi-norm-4way-000

LFVI_multi-norm-udem1-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
59024LFVIv-simsuccessyes1:23:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.788075980281082
survival_time_median59.99999999999873
deviation-center-line_median2.466904071324895
in-drivable-lane_median0.025000000000000355


other stats
agent_compute-ego0_max0.013496901967146317
agent_compute-ego0_mean0.013437039647670112
agent_compute-ego0_median0.013437039647670112
agent_compute-ego0_min0.013377177328193912
agent_compute-ego1_max0.013142780697812249
agent_compute-ego1_mean0.01309156973693492
agent_compute-ego1_median0.01309156973693492
agent_compute-ego1_min0.01304035877605759
agent_compute-ego2_max0.01333115202104122
agent_compute-ego2_mean0.013246108649870834
agent_compute-ego2_median0.013246108649870834
agent_compute-ego2_min0.013161065278700448
agent_compute-ego3_max0.013363473917622054
agent_compute-ego3_mean0.013279879321464391
agent_compute-ego3_median0.013279879321464391
agent_compute-ego3_min0.01319628472530673
complete-iteration_max1.1526236192669896
complete-iteration_mean1.1476229376638063
complete-iteration_median1.1476229376638063
complete-iteration_min1.1426222560606234
deviation-center-line_max7.229096719519205
deviation-center-line_mean3.638332332014028
deviation-center-line_min0.9894525961426146
deviation-heading_max31.12519286576462
deviation-heading_mean15.277052023504623
deviation-heading_median11.278085129861475
deviation-heading_min5.11970678867343
driven_any_max13.19364326319007
driven_any_mean7.030631220339483
driven_any_median7.039869285723619
driven_any_min0.4380344676835461
driven_lanedir_consec_max12.322081277439644
driven_lanedir_consec_mean6.607959723296558
driven_lanedir_consec_min0.4306051673530793
driven_lanedir_max12.888784468412569
driven_lanedir_mean6.715101114330039
driven_lanedir_median6.788806190509074
driven_lanedir_min0.4306051673530793
get_duckie_state_max1.6732974215212908e-06
get_duckie_state_mean1.6157275731120877e-06
get_duckie_state_median1.6157275731120877e-06
get_duckie_state_min1.5581577247028844e-06
get_robot_state_max0.01602610958108894
get_robot_state_mean0.015940736473648874
get_robot_state_median0.015940736473648874
get_robot_state_min0.015855363366208804
get_state_dump_max0.010534566606113457
get_state_dump_mean0.010463020088869167
get_state_dump_median0.010463020088869167
get_state_dump_min0.010391473571624885
get_ui_image_max0.05604676223615127
get_ui_image_mean0.05535404082638934
get_ui_image_median0.05535404082638934
get_ui_image_min0.0546613194166274
in-drivable-lane_max3.2499999999999885
in-drivable-lane_mean0.7999999999999988
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 13.00993152246535, "get_ui_image": 0.0546613194166274, "step_physics": 0.9539847850402527, "survival_time": 59.99999999999873, "driven_lanedir": 12.281951121563951, "get_state_dump": 0.010534566606113457, "get_robot_state": 0.015855363366208804, "sim_render-ego0": 0.00432825167907664, "sim_render-ego1": 0.004412865063034426, "sim_render-ego2": 0.004416280146145404, "sim_render-ego3": 0.004357608728464398, "get_duckie_state": 1.5581577247028844e-06, "in-drivable-lane": 2.150000000000005, "deviation-heading": 10.874468440074793, "agent_compute-ego0": 0.013377177328193912, "agent_compute-ego1": 0.01304035877605759, "agent_compute-ego2": 0.013161065278700448, "agent_compute-ego3": 0.01319628472530673, "complete-iteration": 1.1526236192669896, "set_robot_commands": 0.0027098494902141486, "deviation-center-line": 2.425484339713722, "driven_lanedir_consec": 12.281337537652536, "sim_compute_sim_state": 0.02750628973224777, "sim_compute_performance-ego0": 0.0023814794125902364, "sim_compute_performance-ego1": 0.0022365711412263055, "sim_compute_performance-ego2": 0.0022719565478093815, "sim_compute_performance-ego3": 0.0022520937590078944}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 1.340155363529753, "get_ui_image": 0.0546613194166274, "step_physics": 0.9539847850402527, "survival_time": 59.99999999999873, "driven_lanedir": 1.3191969196738316, "get_state_dump": 0.010534566606113457, "get_robot_state": 0.015855363366208804, "sim_render-ego0": 0.00432825167907664, "sim_render-ego1": 0.004412865063034426, "sim_render-ego2": 0.004416280146145404, "sim_render-ego3": 0.004357608728464398, "get_duckie_state": 1.5581577247028844e-06, "in-drivable-lane": 0.0, "deviation-heading": 28.84771321107835, "agent_compute-ego0": 0.013377177328193912, "agent_compute-ego1": 0.01304035877605759, "agent_compute-ego2": 0.013161065278700448, "agent_compute-ego3": 0.01319628472530673, "complete-iteration": 1.1526236192669896, "set_robot_commands": 0.0027098494902141486, "deviation-center-line": 5.487847483352405, "driven_lanedir_consec": 1.3191969196738316, "sim_compute_sim_state": 0.02750628973224777, "sim_compute_performance-ego0": 0.0023814794125902364, "sim_compute_performance-ego1": 0.0022365711412263055, "sim_compute_performance-ego2": 0.0022719565478093815, "sim_compute_performance-ego3": 0.0022520937590078944}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 12.380636335823077, "get_ui_image": 0.0546613194166274, "step_physics": 0.9539847850402527, "survival_time": 59.99999999999873, "driven_lanedir": 11.897937267096152, "get_state_dump": 0.010534566606113457, "get_robot_state": 0.015855363366208804, "sim_render-ego0": 0.00432825167907664, "sim_render-ego1": 0.004412865063034426, "sim_render-ego2": 0.004416280146145404, "sim_render-ego3": 0.004357608728464398, "get_duckie_state": 1.5581577247028844e-06, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 11.086405178969384, "agent_compute-ego0": 0.013377177328193912, "agent_compute-ego1": 0.01304035877605759, "agent_compute-ego2": 0.013161065278700448, "agent_compute-ego3": 0.01319628472530673, "complete-iteration": 1.1526236192669896, "set_robot_commands": 0.0027098494902141486, "deviation-center-line": 2.2221247842093383, "driven_lanedir_consec": 11.89668849949877, "sim_compute_sim_state": 0.02750628973224777, "sim_compute_performance-ego0": 0.0023814794125902364, "sim_compute_performance-ego1": 0.0022365711412263055, "sim_compute_performance-ego2": 0.0022719565478093815, "sim_compute_performance-ego3": 0.0022520937590078944}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 1.6991022356241618, "get_ui_image": 0.0546613194166274, "step_physics": 0.9539847850402527, "survival_time": 59.99999999999873, "driven_lanedir": 1.679675113921996, "get_state_dump": 0.010534566606113457, "get_robot_state": 0.015855363366208804, "sim_render-ego0": 0.00432825167907664, "sim_render-ego1": 0.004412865063034426, "sim_render-ego2": 0.004416280146145404, "sim_render-ego3": 0.004357608728464398, "get_duckie_state": 1.5581577247028844e-06, "in-drivable-lane": 0.0, "deviation-heading": 31.12519286576462, "agent_compute-ego0": 0.013377177328193912, "agent_compute-ego1": 0.01304035877605759, "agent_compute-ego2": 0.013161065278700448, "agent_compute-ego3": 0.01319628472530673, "complete-iteration": 1.1526236192669896, "set_robot_commands": 0.0027098494902141486, "deviation-center-line": 5.882612389384665, "driven_lanedir_consec": 1.6794634610633945, "sim_compute_sim_state": 0.02750628973224777, "sim_compute_performance-ego0": 0.0023814794125902364, "sim_compute_performance-ego1": 0.0022365711412263055, "sim_compute_performance-ego2": 0.0022719565478093815, "sim_compute_performance-ego3": 0.0022520937590078944}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 13.19364326319007, "get_ui_image": 0.05604676223615127, "step_physics": 0.9415539682755164, "survival_time": 59.99999999999873, "driven_lanedir": 12.888784468412569, "get_state_dump": 0.010391473571624885, "get_robot_state": 0.01602610958108894, "sim_render-ego0": 0.004363690089623597, "sim_render-ego1": 0.004483885411715924, "sim_render-ego2": 0.0044964539022072465, "sim_render-ego3": 0.004475525475660033, "get_duckie_state": 1.6732974215212908e-06, "in-drivable-lane": 0.05000000000000071, "deviation-heading": 10.430856992651613, "agent_compute-ego0": 0.013496901967146317, "agent_compute-ego1": 0.013142780697812249, "agent_compute-ego2": 0.01333115202104122, "agent_compute-ego3": 0.013363473917622054, "complete-iteration": 1.1426222560606234, "set_robot_commands": 0.0027529558075357736, "deviation-center-line": 2.361716540854208, "driven_lanedir_consec": 12.322081277439644, "sim_compute_sim_state": 0.027361096787909288, "sim_compute_performance-ego0": 0.002428638845756588, "sim_compute_performance-ego1": 0.002251559153484564, "sim_compute_performance-ego2": 0.002275315252172262, "sim_compute_performance-ego3": 0.002338039984214713}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 12.599213701037364, "get_ui_image": 0.05604676223615127, "step_physics": 0.9415539682755164, "survival_time": 59.99999999999873, "driven_lanedir": 12.246023520221527, "get_state_dump": 0.010391473571624885, "get_robot_state": 0.01602610958108894, "sim_render-ego0": 0.004363690089623597, "sim_render-ego1": 0.004483885411715924, "sim_render-ego2": 0.0044964539022072465, "sim_render-ego3": 0.004475525475660033, "get_duckie_state": 1.6732974215212908e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.46976508075357, "agent_compute-ego0": 0.013496901967146317, "agent_compute-ego1": 0.013142780697812249, "agent_compute-ego2": 0.01333115202104122, "agent_compute-ego3": 0.013363473917622054, "complete-iteration": 1.1426222560606234, "set_robot_commands": 0.0027529558075357736, "deviation-center-line": 2.508323802936068, "driven_lanedir_consec": 11.975733176082848, "sim_compute_sim_state": 0.027361096787909288, "sim_compute_performance-ego0": 0.002428638845756588, "sim_compute_performance-ego1": 0.002251559153484564, "sim_compute_performance-ego2": 0.002275315252172262, "sim_compute_performance-ego3": 0.002338039984214713}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.4380344676835461, "get_ui_image": 0.05604676223615127, "step_physics": 0.9415539682755164, "survival_time": 59.99999999999873, "driven_lanedir": 0.4306051673530793, "get_state_dump": 0.010391473571624885, "get_robot_state": 0.01602610958108894, "sim_render-ego0": 0.004363690089623597, "sim_render-ego1": 0.004483885411715924, "sim_render-ego2": 0.0044964539022072465, "sim_render-ego3": 0.004475525475660033, "get_duckie_state": 1.6732974215212908e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.26230763007124, "agent_compute-ego0": 0.013496901967146317, "agent_compute-ego1": 0.013142780697812249, "agent_compute-ego2": 0.01333115202104122, "agent_compute-ego3": 0.013363473917622054, "complete-iteration": 1.1426222560606234, "set_robot_commands": 0.0027529558075357736, "deviation-center-line": 7.229096719519205, "driven_lanedir_consec": 0.4306051673530793, "sim_compute_sim_state": 0.027361096787909288, "sim_compute_performance-ego0": 0.002428638845756588, "sim_compute_performance-ego1": 0.002251559153484564, "sim_compute_performance-ego2": 0.002275315252172262, "sim_compute_performance-ego3": 0.002338039984214713}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.584332873362546, "get_ui_image": 0.05604676223615127, "step_physics": 0.9415539682755164, "survival_time": 59.99999999999873, "driven_lanedir": 0.9766353363972076, "get_state_dump": 0.010391473571624885, "get_robot_state": 0.01602610958108894, "sim_render-ego0": 0.004363690089623597, "sim_render-ego1": 0.004483885411715924, "sim_render-ego2": 0.0044964539022072465, "sim_render-ego3": 0.004475525475660033, "get_duckie_state": 1.6732974215212908e-06, "in-drivable-lane": 3.2499999999999885, "deviation-heading": 5.11970678867343, "agent_compute-ego0": 0.013496901967146317, "agent_compute-ego1": 0.013142780697812249, "agent_compute-ego2": 0.01333115202104122, "agent_compute-ego3": 0.013363473917622054, "complete-iteration": 1.1426222560606234, "set_robot_commands": 0.0027529558075357736, "deviation-center-line": 0.9894525961426146, "driven_lanedir_consec": 0.9585717476083584, "sim_compute_sim_state": 0.027361096787909288, "sim_compute_performance-ego0": 0.002428638845756588, "sim_compute_performance-ego1": 0.002251559153484564, "sim_compute_performance-ego2": 0.002275315252172262, "sim_compute_performance-ego3": 0.002338039984214713}}
set_robot_commands_max0.0027529558075357736
set_robot_commands_mean0.002731402648874961
set_robot_commands_median0.002731402648874961
set_robot_commands_min0.0027098494902141486
sim_compute_performance-ego0_max0.002428638845756588
sim_compute_performance-ego0_mean0.002405059129173412
sim_compute_performance-ego0_median0.002405059129173412
sim_compute_performance-ego0_min0.0023814794125902364
sim_compute_performance-ego1_max0.002251559153484564
sim_compute_performance-ego1_mean0.0022440651473554347
sim_compute_performance-ego1_median0.0022440651473554347
sim_compute_performance-ego1_min0.0022365711412263055
sim_compute_performance-ego2_max0.002275315252172262
sim_compute_performance-ego2_mean0.002273635899990822
sim_compute_performance-ego2_median0.002273635899990822
sim_compute_performance-ego2_min0.0022719565478093815
sim_compute_performance-ego3_max0.002338039984214713
sim_compute_performance-ego3_mean0.0022950668716113037
sim_compute_performance-ego3_median0.0022950668716113037
sim_compute_performance-ego3_min0.0022520937590078944
sim_compute_sim_state_max0.02750628973224777
sim_compute_sim_state_mean0.027433693260078527
sim_compute_sim_state_median0.027433693260078527
sim_compute_sim_state_min0.027361096787909288
sim_render-ego0_max0.004363690089623597
sim_render-ego0_mean0.0043459708843501185
sim_render-ego0_median0.0043459708843501185
sim_render-ego0_min0.00432825167907664
sim_render-ego1_max0.004483885411715924
sim_render-ego1_mean0.004448375237375175
sim_render-ego1_median0.004448375237375175
sim_render-ego1_min0.004412865063034426
sim_render-ego2_max0.0044964539022072465
sim_render-ego2_mean0.004456367024176325
sim_render-ego2_median0.004456367024176325
sim_render-ego2_min0.004416280146145404
sim_render-ego3_max0.004475525475660033
sim_render-ego3_mean0.004416567102062216
sim_render-ego3_median0.004416567102062216
sim_render-ego3_min0.004357608728464398
simulation-passed1
step_physics_max0.9539847850402527
step_physics_mean0.9477693766578844
step_physics_median0.9477693766578844
step_physics_min0.9415539682755164
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible