Duckietown Challenges Home Challenges Submissions

Job 35953

Job ID35953
submission9824
userBea Baselines 🐤
user labeltemplate-pytorch
challengeaido5-LFVI_multi-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg02-6962852041e5-1
date started
date completed
duration0:22:29
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.18705223012017913
survival_time_median3.724999999999995
deviation-center-line_median0.1045966936780294
in-drivable-lane_median2.224999999999994


other stats
agent_compute-ego0_max2.195269395323361
agent_compute-ego0_mean2.022132416825928
agent_compute-ego0_median2.0221324168259285
agent_compute-ego0_min1.8489954383284957
agent_compute-ego1_max2.12645718981238
agent_compute-ego1_mean1.961184633604928
agent_compute-ego1_median1.961184633604928
agent_compute-ego1_min1.795912077397476
agent_compute-ego2_max2.2026583236806534
agent_compute-ego2_mean2.004560255753275
agent_compute-ego2_median2.0045602557532756
agent_compute-ego2_min1.8064621878258975
complete-iteration_max7.653833522516139
complete-iteration_mean7.085813260762347
complete-iteration_median7.085813260762347
complete-iteration_min6.517792999008556
deviation-center-line_max0.12269978603445648
deviation-center-line_mean0.1028364227643258
deviation-center-line_min0.06759660062659185
deviation-heading_max1.201444129958822
deviation-heading_mean0.8312977800818776
deviation-heading_median0.8370519285913534
deviation-heading_min0.4823514566268971
driven_any_max1.152414683325972
driven_any_mean0.8127672953189439
driven_any_median0.7561382620240875
driven_any_min0.6005278120622
driven_lanedir_consec_max0.37752504792635966
driven_lanedir_consec_mean0.21126265911719036
driven_lanedir_consec_min0.14493690414612592
driven_lanedir_max0.37752504792635966
driven_lanedir_mean0.21126265911719036
driven_lanedir_median0.18705223012017913
driven_lanedir_min0.14493690414612592
get_state_dump_max0.043087745414060706
get_state_dump_mean0.04252170830337396
get_state_dump_median0.04252170830337397
get_state_dump_min0.041955671192687234
get_ui_image_max0.14227092616698322
get_ui_image_mean0.13872417504577944
get_ui_image_median0.13872417504577944
get_ui_image_min0.13517742392457563
in-drivable-lane_max2.4499999999999953
in-drivable-lane_mean2.1999999999999953
in-drivable-lane_min1.9499999999999953
per-episodes
details{"udem1-0-0-ego0": {"driven_any": 0.6005278120622, "get_ui_image": 0.14227092616698322, "step_physics": 0.7661944417392507, "survival_time": 3.399999999999996, "driven_lanedir": 0.1740078086761767, "get_state_dump": 0.043087745414060706, "sim_render-ego0": 0.008631180314456715, "sim_render-ego1": 0.007570785634657916, "sim_render-ego2": 0.007380587213179644, "in-drivable-lane": 1.9499999999999953, "deviation-heading": 0.7378504339431728, "agent_compute-ego0": 2.195269395323361, "agent_compute-ego1": 2.12645718981238, "agent_compute-ego2": 2.2026583236806534, "complete-iteration": 7.653833522516139, "set_robot_commands": 0.005428454455207376, "deviation-center-line": 0.09545172604628116, "driven_lanedir_consec": 0.1740078086761767, "sim_compute_sim_state": 0.049157051479115206, "sim_compute_performance-ego0": 0.0050946964937097884, "sim_compute_performance-ego1": 0.004945060786078958, "sim_compute_performance-ego2": 0.004625509766971364, "sim_compute_robot_state-ego0": 0.008486277916852166, "sim_compute_robot_state-ego1": 0.008015082162969252, "sim_compute_robot_state-ego2": 0.008181252900291891, "sim_compute_robot_state-parked0": 0.008695349973790786, "sim_compute_robot_state-parked1": 0.007967040819280288, "sim_compute_robot_state-parked2": 0.008559125311234417, "sim_compute_robot_state-parked3": 0.007988793008467731, "sim_compute_robot_state-parked4": 0.008495432489058551, "sim_compute_robot_state-parked5": 0.008075878900640151}, "udem1-0-0-ego1": {"driven_any": 0.9454501627482376, "get_ui_image": 0.14227092616698322, "step_physics": 0.7661944417392507, "survival_time": 3.399999999999996, "driven_lanedir": 0.20009665156418155, "get_state_dump": 0.043087745414060706, "sim_render-ego0": 0.008631180314456715, "sim_render-ego1": 0.007570785634657916, "sim_render-ego2": 0.007380587213179644, "in-drivable-lane": 2.099999999999995, "deviation-heading": 0.5482375532294187, "agent_compute-ego0": 2.195269395323361, "agent_compute-ego1": 2.12645718981238, "agent_compute-ego2": 2.2026583236806534, "complete-iteration": 7.653833522516139, "set_robot_commands": 0.005428454455207376, "deviation-center-line": 0.06759660062659185, "driven_lanedir_consec": 0.20009665156418155, "sim_compute_sim_state": 0.049157051479115206, "sim_compute_performance-ego0": 0.0050946964937097884, "sim_compute_performance-ego1": 0.004945060786078958, "sim_compute_performance-ego2": 0.004625509766971364, "sim_compute_robot_state-ego0": 0.008486277916852166, "sim_compute_robot_state-ego1": 0.008015082162969252, "sim_compute_robot_state-ego2": 0.008181252900291891, "sim_compute_robot_state-parked0": 0.008695349973790786, "sim_compute_robot_state-parked1": 0.007967040819280288, "sim_compute_robot_state-parked2": 0.008559125311234417, "sim_compute_robot_state-parked3": 0.007988793008467731, "sim_compute_robot_state-parked4": 0.008495432489058551, "sim_compute_robot_state-parked5": 0.008075878900640151}, "udem1-0-0-ego2": {"driven_any": 0.6659345897290785, "get_ui_image": 0.14227092616698322, "step_physics": 0.7661944417392507, "survival_time": 3.399999999999996, "driven_lanedir": 0.16342048467693493, "get_state_dump": 0.043087745414060706, "sim_render-ego0": 0.008631180314456715, "sim_render-ego1": 0.007570785634657916, "sim_render-ego2": 0.007380587213179644, "in-drivable-lane": 1.949999999999997, "deviation-heading": 0.936253423239534, "agent_compute-ego0": 2.195269395323361, "agent_compute-ego1": 2.12645718981238, "agent_compute-ego2": 2.2026583236806534, "complete-iteration": 7.653833522516139, "set_robot_commands": 0.005428454455207376, "deviation-center-line": 0.1220770365225667, "driven_lanedir_consec": 0.16342048467693493, "sim_compute_sim_state": 0.049157051479115206, "sim_compute_performance-ego0": 0.0050946964937097884, "sim_compute_performance-ego1": 0.004945060786078958, "sim_compute_performance-ego2": 0.004625509766971364, "sim_compute_robot_state-ego0": 0.008486277916852166, "sim_compute_robot_state-ego1": 0.008015082162969252, "sim_compute_robot_state-ego2": 0.008181252900291891, "sim_compute_robot_state-parked0": 0.008695349973790786, "sim_compute_robot_state-parked1": 0.007967040819280288, "sim_compute_robot_state-parked2": 0.008559125311234417, "sim_compute_robot_state-parked3": 0.007988793008467731, "sim_compute_robot_state-parked4": 0.008495432489058551, "sim_compute_robot_state-parked5": 0.008075878900640151}, "udem1-0-1-ego0": {"driven_any": 0.7250442425113607, "get_ui_image": 0.13517742392457563, "step_physics": 0.7115041944715712, "survival_time": 4.049999999999994, "driven_lanedir": 0.14493690414612592, "get_state_dump": 0.041955671192687234, "sim_render-ego0": 0.0076077161011872466, "sim_render-ego1": 0.007357847543410313, "sim_render-ego2": 0.007304135664009753, "in-drivable-lane": 2.399999999999995, "deviation-heading": 1.201444129958822, "agent_compute-ego0": 1.8489954383284957, "agent_compute-ego1": 1.795912077397476, "agent_compute-ego2": 1.8064621878258975, "complete-iteration": 6.517792999008556, "set_robot_commands": 0.005433415189201449, "deviation-center-line": 0.12269978603445648, "driven_lanedir_consec": 0.14493690414612592, "sim_compute_sim_state": 0.04995134436053994, "sim_compute_performance-ego0": 0.005063048115483037, "sim_compute_performance-ego1": 0.004540879049418885, "sim_compute_performance-ego2": 0.004437955809228214, "sim_compute_robot_state-ego0": 0.008714505183843918, "sim_compute_robot_state-ego1": 0.007859748086811584, "sim_compute_robot_state-ego2": 0.007963118729767975, "sim_compute_robot_state-parked0": 0.00823341769936644, "sim_compute_robot_state-parked1": 0.008206014279966001, "sim_compute_robot_state-parked2": 0.008543968200683594, "sim_compute_robot_state-parked3": 0.008783870273166232, "sim_compute_robot_state-parked4": 0.008625589771035277, "sim_compute_robot_state-parked5": 0.00849097157702034}, "udem1-0-1-ego1": {"driven_any": 1.152414683325972, "get_ui_image": 0.13517742392457563, "step_physics": 0.7115041944715712, "survival_time": 4.049999999999994, "driven_lanedir": 0.37752504792635966, "get_state_dump": 0.041955671192687234, "sim_render-ego0": 0.0076077161011872466, "sim_render-ego1": 0.007357847543410313, "sim_render-ego2": 0.007304135664009753, "in-drivable-lane": 2.3499999999999925, "deviation-heading": 0.4823514566268971, "agent_compute-ego0": 1.8489954383284957, "agent_compute-ego1": 1.795912077397476, "agent_compute-ego2": 1.8064621878258975, "complete-iteration": 6.517792999008556, "set_robot_commands": 0.005433415189201449, "deviation-center-line": 0.0970428522158545, "driven_lanedir_consec": 0.37752504792635966, "sim_compute_sim_state": 0.04995134436053994, "sim_compute_performance-ego0": 0.005063048115483037, "sim_compute_performance-ego1": 0.004540879049418885, "sim_compute_performance-ego2": 0.004437955809228214, "sim_compute_robot_state-ego0": 0.008714505183843918, "sim_compute_robot_state-ego1": 0.007859748086811584, "sim_compute_robot_state-ego2": 0.007963118729767975, "sim_compute_robot_state-parked0": 0.00823341769936644, "sim_compute_robot_state-parked1": 0.008206014279966001, "sim_compute_robot_state-parked2": 0.008543968200683594, "sim_compute_robot_state-parked3": 0.008783870273166232, "sim_compute_robot_state-parked4": 0.008625589771035277, "sim_compute_robot_state-parked5": 0.00849097157702034}, "udem1-0-1-ego2": {"driven_any": 0.7872322815368145, "get_ui_image": 0.13517742392457563, "step_physics": 0.7115041944715712, "survival_time": 4.049999999999994, "driven_lanedir": 0.20758905771336345, "get_state_dump": 0.041955671192687234, "sim_render-ego0": 0.0076077161011872466, "sim_render-ego1": 0.007357847543410313, "sim_render-ego2": 0.007304135664009753, "in-drivable-lane": 2.4499999999999953, "deviation-heading": 1.0816496834934213, "agent_compute-ego0": 1.8489954383284957, "agent_compute-ego1": 1.795912077397476, "agent_compute-ego2": 1.8064621878258975, "complete-iteration": 6.517792999008556, "set_robot_commands": 0.005433415189201449, "deviation-center-line": 0.11215053514020427, "driven_lanedir_consec": 0.20758905771336345, "sim_compute_sim_state": 0.04995134436053994, "sim_compute_performance-ego0": 0.005063048115483037, "sim_compute_performance-ego1": 0.004540879049418885, "sim_compute_performance-ego2": 0.004437955809228214, "sim_compute_robot_state-ego0": 0.008714505183843918, "sim_compute_robot_state-ego1": 0.007859748086811584, "sim_compute_robot_state-ego2": 0.007963118729767975, "sim_compute_robot_state-parked0": 0.00823341769936644, "sim_compute_robot_state-parked1": 0.008206014279966001, "sim_compute_robot_state-parked2": 0.008543968200683594, "sim_compute_robot_state-parked3": 0.008783870273166232, "sim_compute_robot_state-parked4": 0.008625589771035277, "sim_compute_robot_state-parked5": 0.00849097157702034}}
set_robot_commands_max0.005433415189201449
set_robot_commands_mean0.005430934822204413
set_robot_commands_median0.005430934822204412
set_robot_commands_min0.005428454455207376
sim_compute_performance-ego0_max0.0050946964937097884
sim_compute_performance-ego0_mean0.005078872304596413
sim_compute_performance-ego0_median0.005078872304596412
sim_compute_performance-ego0_min0.005063048115483037
sim_compute_performance-ego1_max0.004945060786078958
sim_compute_performance-ego1_mean0.004742969917748922
sim_compute_performance-ego1_median0.004742969917748922
sim_compute_performance-ego1_min0.004540879049418885
sim_compute_performance-ego2_max0.004625509766971364
sim_compute_performance-ego2_mean0.004531732788099788
sim_compute_performance-ego2_median0.004531732788099789
sim_compute_performance-ego2_min0.004437955809228214
sim_compute_robot_state-ego0_max0.008714505183843918
sim_compute_robot_state-ego0_mean0.008600391550348042
sim_compute_robot_state-ego0_median0.008600391550348042
sim_compute_robot_state-ego0_min0.008486277916852166
sim_compute_robot_state-ego1_max0.008015082162969252
sim_compute_robot_state-ego1_mean0.007937415124890419
sim_compute_robot_state-ego1_median0.007937415124890417
sim_compute_robot_state-ego1_min0.007859748086811584
sim_compute_robot_state-ego2_max0.008181252900291891
sim_compute_robot_state-ego2_mean0.008072185815029933
sim_compute_robot_state-ego2_median0.008072185815029933
sim_compute_robot_state-ego2_min0.007963118729767975
sim_compute_robot_state-parked0_max0.008695349973790786
sim_compute_robot_state-parked0_mean0.008464383836578613
sim_compute_robot_state-parked0_median0.008464383836578613
sim_compute_robot_state-parked0_min0.00823341769936644
sim_compute_robot_state-parked1_max0.008206014279966001
sim_compute_robot_state-parked1_mean0.008086527549623143
sim_compute_robot_state-parked1_median0.008086527549623145
sim_compute_robot_state-parked1_min0.007967040819280288
sim_compute_robot_state-parked2_max0.008559125311234417
sim_compute_robot_state-parked2_mean0.008551546755959006
sim_compute_robot_state-parked2_median0.008551546755959006
sim_compute_robot_state-parked2_min0.008543968200683594
sim_compute_robot_state-parked3_max0.008783870273166232
sim_compute_robot_state-parked3_mean0.008386331640816981
sim_compute_robot_state-parked3_median0.008386331640816981
sim_compute_robot_state-parked3_min0.007988793008467731
sim_compute_robot_state-parked4_max0.008625589771035277
sim_compute_robot_state-parked4_mean0.008560511130046916
sim_compute_robot_state-parked4_median0.008560511130046914
sim_compute_robot_state-parked4_min0.008495432489058551
sim_compute_robot_state-parked5_max0.00849097157702034
sim_compute_robot_state-parked5_mean0.008283425238830246
sim_compute_robot_state-parked5_median0.008283425238830244
sim_compute_robot_state-parked5_min0.008075878900640151
sim_compute_sim_state_max0.04995134436053994
sim_compute_sim_state_mean0.04955419791982757
sim_compute_sim_state_median0.04955419791982757
sim_compute_sim_state_min0.049157051479115206
sim_render-ego0_max0.008631180314456715
sim_render-ego0_mean0.008119448207821981
sim_render-ego0_median0.00811944820782198
sim_render-ego0_min0.0076077161011872466
sim_render-ego1_max0.007570785634657916
sim_render-ego1_mean0.007464316589034114
sim_render-ego1_median0.007464316589034114
sim_render-ego1_min0.007357847543410313
sim_render-ego2_max0.007380587213179644
sim_render-ego2_mean0.007342361438594698
sim_render-ego2_median0.007342361438594699
sim_render-ego2_min0.007304135664009753
simulation-passed1
step_physics_max0.7661944417392507
step_physics_mean0.7388493181054109
step_physics_median0.738849318105411
step_physics_min0.7115041944715712
survival_time_max4.049999999999994
survival_time_mean3.724999999999995
survival_time_min3.399999999999996

Highlights

35953

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.