Duckietown Challenges Home Challenges Submissions

Submission 12727

Submission12727
Competingyes
Challengeaido5-LFVI_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVIv-sim: 53647
Next
User labeltemplate-random
Admin priority50
Blessingn/a
User priority50

53647

Click the images to see detailed statistics about the episode.

LFVI_multi-norm-4way-000

LFVI_multi-norm-udem1-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53647LFVIv-simsuccessyes0:08:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5758601445640131
survival_time_median6.099999999999986
deviation-center-line_median0.17553830655708547
in-drivable-lane_median3.29999999999999


other stats
agent_compute-ego0_max0.012585885901200144
agent_compute-ego0_mean0.011812075691050292
agent_compute-ego0_median0.011812075691050292
agent_compute-ego0_min0.011038265480900445
agent_compute-ego1_max0.012158632278442385
agent_compute-ego1_mean0.011775415464742294
agent_compute-ego1_median0.011775415464742294
agent_compute-ego1_min0.011392198651042204
agent_compute-ego2_max0.012678246749074836
agent_compute-ego2_mean0.011625921156980634
agent_compute-ego2_median0.011625921156980634
agent_compute-ego2_min0.010573595564886434
agent_compute-ego3_max0.013043207871286492
agent_compute-ego3_mean0.01216173410498751
agent_compute-ego3_median0.01216173410498751
agent_compute-ego3_min0.011280260338688527
complete-iteration_max1.029521272056981
complete-iteration_mean0.938607601622498
complete-iteration_median0.938607601622498
complete-iteration_min0.847693931188015
deviation-center-line_max0.47013425987002005
deviation-center-line_mean0.2174177284809568
deviation-center-line_min0.0720091252708566
deviation-heading_max3.0542186889712815
deviation-heading_mean1.2634654122591242
deviation-heading_median1.0697442157871273
deviation-heading_min0.3081468886732283
driven_any_max2.8773005288041658
driven_any_mean1.716787495843618
driven_any_median1.6399654313822998
driven_any_min0.38662204608009304
driven_lanedir_consec_max1.8220023141314807
driven_lanedir_consec_mean0.7121644428869928
driven_lanedir_consec_min0.30949264303267476
driven_lanedir_max1.8220034571617316
driven_lanedir_mean0.7349677350690881
driven_lanedir_median0.5758601445640131
driven_lanedir_min0.30949264303267476
get_duckie_state_max2.105612503854852e-06
get_duckie_state_mean1.8446401421223503e-06
get_duckie_state_median1.8446401421223503e-06
get_duckie_state_min1.583667780389849e-06
get_robot_state_max0.01520905243723016
get_robot_state_mean0.015123727156252513
get_robot_state_median0.015123727156252513
get_robot_state_min0.01503840187527486
get_state_dump_max0.010197466298153528
get_state_dump_mean0.010056983024328585
get_state_dump_median0.010056983024328585
get_state_dump_min0.00991649975050364
get_ui_image_max0.05681052428997115
get_ui_image_mean0.05485486592844248
get_ui_image_median0.05485486592844248
get_ui_image_min0.05289920756691381
in-drivable-lane_max6.049999999999983
in-drivable-lane_mean3.4749999999999894
in-drivable-lane_min0.9999999999999998
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 2.831813082003494, "get_ui_image": 0.05681052428997115, "step_physics": 0.6526446152996543, "survival_time": 7.499999999999981, "driven_lanedir": 1.8220034571617316, "get_state_dump": 0.00991649975050364, "get_robot_state": 0.01503840187527486, "sim_render-ego0": 0.0039482558799895226, "sim_render-ego1": 0.0040215782771836845, "sim_render-ego2": 0.003944922756675064, "sim_render-ego3": 0.003861327834476698, "get_duckie_state": 1.583667780389849e-06, "in-drivable-lane": 3.049999999999989, "deviation-heading": 0.3442852314393885, "agent_compute-ego0": 0.011038265480900445, "agent_compute-ego1": 0.011392198651042204, "agent_compute-ego2": 0.010573595564886434, "agent_compute-ego3": 0.011280260338688527, "complete-iteration": 0.847693931188015, "set_robot_commands": 0.002309254463145275, "deviation-center-line": 0.22968417496144336, "driven_lanedir_consec": 1.8220023141314807, "sim_compute_sim_state": 0.03521407834741454, "sim_compute_performance-ego0": 0.0021824663048548416, "sim_compute_performance-ego1": 0.0020743032164921033, "sim_compute_performance-ego2": 0.0020529355434392464, "sim_compute_performance-ego3": 0.00206490226139296}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 1.3028841294963844, "get_ui_image": 0.05681052428997115, "step_physics": 0.6526446152996543, "survival_time": 7.499999999999981, "driven_lanedir": 0.4284094322301284, "get_state_dump": 0.00991649975050364, "get_robot_state": 0.01503840187527486, "sim_render-ego0": 0.0039482558799895226, "sim_render-ego1": 0.0040215782771836845, "sim_render-ego2": 0.003944922756675064, "sim_render-ego3": 0.003861327834476698, "get_duckie_state": 1.583667780389849e-06, "in-drivable-lane": 5.799999999999981, "deviation-heading": 1.002056979235454, "agent_compute-ego0": 0.011038265480900445, "agent_compute-ego1": 0.011392198651042204, "agent_compute-ego2": 0.010573595564886434, "agent_compute-ego3": 0.011280260338688527, "complete-iteration": 0.847693931188015, "set_robot_commands": 0.002309254463145275, "deviation-center-line": 0.1213924381527276, "driven_lanedir_consec": 0.4284094322301284, "sim_compute_sim_state": 0.03521407834741454, "sim_compute_performance-ego0": 0.0021824663048548416, "sim_compute_performance-ego1": 0.0020743032164921033, "sim_compute_performance-ego2": 0.0020529355434392464, "sim_compute_performance-ego3": 0.00206490226139296}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 1.9654839397698145, "get_ui_image": 0.05681052428997115, "step_physics": 0.6526446152996543, "survival_time": 7.499999999999981, "driven_lanedir": 0.3166075872147196, "get_state_dump": 0.00991649975050364, "get_robot_state": 0.01503840187527486, "sim_render-ego0": 0.0039482558799895226, "sim_render-ego1": 0.0040215782771836845, "sim_render-ego2": 0.003944922756675064, "sim_render-ego3": 0.003861327834476698, "get_duckie_state": 1.583667780389849e-06, "in-drivable-lane": 6.049999999999983, "deviation-heading": 1.1374314523388007, "agent_compute-ego0": 0.011038265480900445, "agent_compute-ego1": 0.011392198651042204, "agent_compute-ego2": 0.010573595564886434, "agent_compute-ego3": 0.011280260338688527, "complete-iteration": 0.847693931188015, "set_robot_commands": 0.002309254463145275, "deviation-center-line": 0.10797637530751922, "driven_lanedir_consec": 0.3166075872147196, "sim_compute_sim_state": 0.03521407834741454, "sim_compute_performance-ego0": 0.0021824663048548416, "sim_compute_performance-ego1": 0.0020743032164921033, "sim_compute_performance-ego2": 0.0020529355434392464, "sim_compute_performance-ego3": 0.00206490226139296}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 2.8773005288041658, "get_ui_image": 0.05681052428997115, "step_physics": 0.6526446152996543, "survival_time": 7.499999999999981, "driven_lanedir": 1.093112188430767, "get_state_dump": 0.00991649975050364, "get_robot_state": 0.01503840187527486, "sim_render-ego0": 0.0039482558799895226, "sim_render-ego1": 0.0040215782771836845, "sim_render-ego2": 0.003944922756675064, "sim_render-ego3": 0.003861327834476698, "get_duckie_state": 1.583667780389849e-06, "in-drivable-lane": 4.199999999999985, "deviation-heading": 1.4050102318329205, "agent_compute-ego0": 0.011038265480900445, "agent_compute-ego1": 0.011392198651042204, "agent_compute-ego2": 0.010573595564886434, "agent_compute-ego3": 0.011280260338688527, "complete-iteration": 0.847693931188015, "set_robot_commands": 0.002309254463145275, "deviation-center-line": 0.2963999319120335, "driven_lanedir_consec": 1.019001024923512, "sim_compute_sim_state": 0.03521407834741454, "sim_compute_performance-ego0": 0.0021824663048548416, "sim_compute_performance-ego1": 0.0020743032164921033, "sim_compute_performance-ego2": 0.0020529355434392464, "sim_compute_performance-ego3": 0.00206490226139296}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 1.6280751458799152, "get_ui_image": 0.05289920756691381, "step_physics": 0.8364373658832751, "survival_time": 4.699999999999991, "driven_lanedir": 0.7583962833546565, "get_state_dump": 0.010197466298153528, "get_robot_state": 0.01520905243723016, "sim_render-ego0": 0.004105914266485917, "sim_render-ego1": 0.0039172197643079255, "sim_render-ego2": 0.004071386236893504, "sim_render-ego3": 0.003996889214766653, "get_duckie_state": 2.105612503854852e-06, "in-drivable-lane": 1.2999999999999958, "deviation-heading": 2.3745112943922093, "agent_compute-ego0": 0.012585885901200144, "agent_compute-ego1": 0.012158632278442385, "agent_compute-ego2": 0.012678246749074836, "agent_compute-ego3": 0.013043207871286492, "complete-iteration": 1.029521272056981, "set_robot_commands": 0.002431781668412058, "deviation-center-line": 0.35315000024132365, "driven_lanedir_consec": 0.6500822524354004, "sim_compute_sim_state": 0.029702675969977128, "sim_compute_performance-ego0": 0.0023413959302400287, "sim_compute_performance-ego1": 0.0020593894155401934, "sim_compute_performance-ego2": 0.002085397118016293, "sim_compute_performance-ego3": 0.002073599162854646}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 1.651855716884684, "get_ui_image": 0.05289920756691381, "step_physics": 0.8364373658832751, "survival_time": 4.699999999999991, "driven_lanedir": 0.6448691596131364, "get_state_dump": 0.010197466298153528, "get_robot_state": 0.01520905243723016, "sim_render-ego0": 0.004105914266485917, "sim_render-ego1": 0.0039172197643079255, "sim_render-ego2": 0.004071386236893504, "sim_render-ego3": 0.003996889214766653, "get_duckie_state": 2.105612503854852e-06, "in-drivable-lane": 2.8499999999999903, "deviation-heading": 0.3081468886732283, "agent_compute-ego0": 0.012585885901200144, "agent_compute-ego1": 0.012158632278442385, "agent_compute-ego2": 0.012678246749074836, "agent_compute-ego3": 0.013043207871286492, "complete-iteration": 1.029521272056981, "set_robot_commands": 0.002431781668412058, "deviation-center-line": 0.08859552213173046, "driven_lanedir_consec": 0.6448691596131364, "sim_compute_sim_state": 0.029702675969977128, "sim_compute_performance-ego0": 0.0023413959302400287, "sim_compute_performance-ego1": 0.0020593894155401934, "sim_compute_performance-ego2": 0.002085397118016293, "sim_compute_performance-ego3": 0.002073599162854646}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 1.0902653778303937, "get_ui_image": 0.05289920756691381, "step_physics": 0.8364373658832751, "survival_time": 4.699999999999991, "driven_lanedir": 0.5068511295148899, "get_state_dump": 0.010197466298153528, "get_robot_state": 0.01520905243723016, "sim_render-ego0": 0.004105914266485917, "sim_render-ego1": 0.0039172197643079255, "sim_render-ego2": 0.004071386236893504, "sim_render-ego3": 0.003996889214766653, "get_duckie_state": 2.105612503854852e-06, "in-drivable-lane": 0.9999999999999998, "deviation-heading": 3.0542186889712815, "agent_compute-ego0": 0.012585885901200144, "agent_compute-ego1": 0.012158632278442385, "agent_compute-ego2": 0.012678246749074836, "agent_compute-ego3": 0.013043207871286492, "complete-iteration": 1.029521272056981, "set_robot_commands": 0.002431781668412058, "deviation-center-line": 0.47013425987002005, "driven_lanedir_consec": 0.5068511295148899, "sim_compute_sim_state": 0.029702675969977128, "sim_compute_performance-ego0": 0.0023413959302400287, "sim_compute_performance-ego1": 0.0020593894155401934, "sim_compute_performance-ego2": 0.002085397118016293, "sim_compute_performance-ego3": 0.002073599162854646}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 0.38662204608009304, "get_ui_image": 0.05289920756691381, "step_physics": 0.8364373658832751, "survival_time": 4.699999999999991, "driven_lanedir": 0.30949264303267476, "get_state_dump": 0.010197466298153528, "get_robot_state": 0.01520905243723016, "sim_render-ego0": 0.004105914266485917, "sim_render-ego1": 0.0039172197643079255, "sim_render-ego2": 0.004071386236893504, "sim_render-ego3": 0.003996889214766653, "get_duckie_state": 2.105612503854852e-06, "in-drivable-lane": 3.549999999999991, "deviation-heading": 0.4820625311897111, "agent_compute-ego0": 0.012585885901200144, "agent_compute-ego1": 0.012158632278442385, "agent_compute-ego2": 0.012678246749074836, "agent_compute-ego3": 0.013043207871286492, "complete-iteration": 1.029521272056981, "set_robot_commands": 0.002431781668412058, "deviation-center-line": 0.0720091252708566, "driven_lanedir_consec": 0.30949264303267476, "sim_compute_sim_state": 0.029702675969977128, "sim_compute_performance-ego0": 0.0023413959302400287, "sim_compute_performance-ego1": 0.0020593894155401934, "sim_compute_performance-ego2": 0.002085397118016293, "sim_compute_performance-ego3": 0.002073599162854646}}
set_robot_commands_max0.002431781668412058
set_robot_commands_mean0.002370518065778666
set_robot_commands_median0.002370518065778666
set_robot_commands_min0.002309254463145275
sim_compute_performance-ego0_max0.0023413959302400287
sim_compute_performance-ego0_mean0.0022619311175474353
sim_compute_performance-ego0_median0.0022619311175474353
sim_compute_performance-ego0_min0.0021824663048548416
sim_compute_performance-ego1_max0.0020743032164921033
sim_compute_performance-ego1_mean0.0020668463160161484
sim_compute_performance-ego1_median0.0020668463160161484
sim_compute_performance-ego1_min0.0020593894155401934
sim_compute_performance-ego2_max0.002085397118016293
sim_compute_performance-ego2_mean0.0020691663307277697
sim_compute_performance-ego2_median0.0020691663307277697
sim_compute_performance-ego2_min0.0020529355434392464
sim_compute_performance-ego3_max0.002073599162854646
sim_compute_performance-ego3_mean0.002069250712123803
sim_compute_performance-ego3_median0.002069250712123803
sim_compute_performance-ego3_min0.00206490226139296
sim_compute_sim_state_max0.03521407834741454
sim_compute_sim_state_mean0.03245837715869583
sim_compute_sim_state_median0.03245837715869583
sim_compute_sim_state_min0.029702675969977128
sim_render-ego0_max0.004105914266485917
sim_render-ego0_mean0.004027085073237719
sim_render-ego0_median0.004027085073237719
sim_render-ego0_min0.0039482558799895226
sim_render-ego1_max0.0040215782771836845
sim_render-ego1_mean0.003969399020745805
sim_render-ego1_median0.003969399020745805
sim_render-ego1_min0.0039172197643079255
sim_render-ego2_max0.004071386236893504
sim_render-ego2_mean0.004008154496784284
sim_render-ego2_median0.004008154496784284
sim_render-ego2_min0.003944922756675064
sim_render-ego3_max0.003996889214766653
sim_render-ego3_mean0.003929108524621676
sim_render-ego3_median0.003929108524621676
sim_render-ego3_min0.003861327834476698
simulation-passed1
step_physics_max0.8364373658832751
step_physics_mean0.7445409905914647
step_physics_median0.7445409905914647
step_physics_min0.6526446152996543
survival_time_max7.499999999999981
survival_time_mean6.099999999999986
survival_time_min4.699999999999991
No reset possible
53646LFVIv-simsuccessyes0:08:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53645LFVIv-simsuccessyes0:08:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53644LFVIv-simsuccessyes0:07:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible