Duckietown Challenges Home Challenges Submissions

Job 33222

Job ID33222
submission6707
userBea Baselines 🐤
user labelstraight
challengeaido5-LFVI-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:12:18
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6468539965646568
survival_time_median4.874999999999991
deviation-center-line_median0.3140120407422947
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.03863205471817328
agent_compute-ego_mean0.03781684082056479
agent_compute-ego_median0.037642346273080954
agent_compute-ego_min0.03705322200601751
complete-iteration_max0.48437164754283674
complete-iteration_mean0.4516093142473169
complete-iteration_median0.4541097124607749
complete-iteration_min0.4206728014079007
deviation-center-line_max0.3972243289598026
deviation-center-line_mean0.3057703533784745
deviation-center-line_min0.2063584830749243
deviation-heading_max2.0317977913198466
deviation-heading_mean1.0398021808032112
deviation-heading_median0.7843507289776401
deviation-heading_min0.5442280312830121
driven_any_max0.8306434336578873
driven_any_mean0.6066363606966733
driven_any_median0.7496893214183404
driven_any_min0.3082988362758285
driven_lanedir_consec_max0.8046228150716828
driven_lanedir_consec_mean0.556082354922922
driven_lanedir_consec_min0.29881004532623745
driven_lanedir_max0.8046228150716828
driven_lanedir_mean0.5629220220436338
driven_lanedir_median0.6585446975456014
driven_lanedir_min0.29881004532623745
get_state_dump_max0.03869666969567014
get_state_dump_mean0.03791543163806169
get_state_dump_median0.03815891402951393
get_state_dump_min0.03666867914888048
get_ui_image_max0.08354052204952062
get_ui_image_mean0.08048652430480996
get_ui_image_median0.08011281356478608
get_ui_image_min0.07901130481199785
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego": {"driven_any": 0.7478014487211424, "get_ui_image": 0.07994680797930845, "step_physics": 0.18226757737779128, "survival_time": 4.849999999999991, "driven_lanedir": 0.6766318008772938, "get_state_dump": 0.03666867914888048, "sim_render-ego": 0.007458465615498651, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03719522535186453, "deviation-heading": 1.3516281792896734, "complete-iteration": 0.4652735474183387, "set_robot_commands": 0.0065093753264122405, "deviation-center-line": 0.38492257857602347, "driven_lanedir_consec": 0.6513468578527846, "sim_compute_sim_state": 0.047117319303689544, "sim_compute_performance-ego": 0.005963379574805191, "sim_compute_robot_state-ego": 0.010456989720924612, "sim_compute_robot_state-npc0": 0.01034781613300756, "sim_compute_robot_state-npc1": 0.010166866263163458, "sim_compute_robot_state-npc2": 0.01047876692309822, "sim_compute_robot_state-npc3": 0.010241882088258094, "sim_compute_robot_state-parked0": 0.010120025615102238}, "udem1-0-1-ego": {"driven_any": 0.7515771941155386, "get_ui_image": 0.08134110363162293, "step_physics": 0.18530641769876283, "survival_time": 4.899999999999991, "driven_lanedir": 0.6742302336749346, "get_state_dump": 0.03669787183099864, "sim_render-ego": 0.00820254306403958, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03863205471817328, "deviation-heading": 1.4389736612840751, "complete-iteration": 0.48437164754283674, "set_robot_commands": 0.007720232009887695, "deviation-center-line": 0.3972243289598026, "driven_lanedir_consec": 0.648852613771786, "sim_compute_sim_state": 0.04740936658820327, "sim_compute_performance-ego": 0.0067644824787062045, "sim_compute_robot_state-ego": 0.011983170801279495, "sim_compute_robot_state-npc0": 0.01213289280326999, "sim_compute_robot_state-npc1": 0.011947551552130252, "sim_compute_robot_state-npc2": 0.012028241644100266, "sim_compute_robot_state-npc3": 0.01169758670184077, "sim_compute_robot_state-parked0": 0.012172132122273348}, "udem1-1-0-ego": {"driven_any": 0.8306434336578873, "get_ui_image": 0.08354052204952062, "step_physics": 0.1615885908358565, "survival_time": 5.349999999999989, "driven_lanedir": 0.8046228150716828, "get_state_dump": 0.03785851959870241, "sim_render-ego": 0.008768848169629818, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03840848664257014, "deviation-heading": 0.8687988156679041, "complete-iteration": 0.4631128511696218, "set_robot_commands": 0.00802048121657327, "deviation-center-line": 0.2063584830749243, "driven_lanedir_consec": 0.8046228150716828, "sim_compute_sim_state": 0.041367533050964925, "sim_compute_performance-ego": 0.007465373689883224, "sim_compute_robot_state-ego": 0.01290465960992831, "sim_compute_robot_state-npc0": 0.012440140002241758, "sim_compute_robot_state-npc1": 0.012446748876126013, "sim_compute_robot_state-npc2": 0.012506923942922432, "sim_compute_robot_state-npc3": 0.012737762148135176, "sim_compute_robot_state-parked0": 0.012696504592895508}, "udem1-1-1-ego": {"driven_any": 0.7822537947794993, "get_ui_image": 0.08027881915026372, "step_physics": 0.15449480018993417, "survival_time": 5.04999999999999, "driven_lanedir": 0.7619055397403779, "get_state_dump": 0.038164273347004805, "sim_render-ego": 0.007373632770953792, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03747068773401846, "deviation-heading": 0.6999026422873762, "complete-iteration": 0.4337570997748044, "set_robot_commands": 0.006162083975159296, "deviation-center-line": 0.2514073186364099, "driven_lanedir_consec": 0.7619055397403779, "sim_compute_sim_state": 0.03993618606340767, "sim_compute_performance-ego": 0.006005126650970761, "sim_compute_robot_state-ego": 0.01035802671224764, "sim_compute_robot_state-npc0": 0.010913386203274868, "sim_compute_robot_state-npc1": 0.010502999371821337, "sim_compute_robot_state-npc2": 0.01067508565317286, "sim_compute_robot_state-npc3": 0.01068337128894164, "sim_compute_robot_state-parked0": 0.0104045041716925}, "udem1-2-0-ego": {"driven_any": 0.40175648744283554, "get_ui_image": 0.07930500166756767, "step_physics": 0.1716944362436022, "survival_time": 2.799999999999998, "driven_lanedir": 0.3939393582196631, "get_state_dump": 0.03815355471202305, "sim_render-ego": 0.007744205849511283, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03763778720583234, "deviation-heading": 0.5456015321326615, "complete-iteration": 0.4438537231513432, "set_robot_commands": 0.006229277168001447, "deviation-center-line": 0.30961827938479597, "driven_lanedir_consec": 0.3939393582196631, "sim_compute_sim_state": 0.033676551921027045, "sim_compute_performance-ego": 0.0061969927379063195, "sim_compute_robot_state-ego": 0.010028719902038574, "sim_compute_robot_state-npc0": 0.010585686990192958, "sim_compute_robot_state-npc1": 0.010450069393430437, "sim_compute_robot_state-npc2": 0.01048782467842102, "sim_compute_robot_state-npc3": 0.010774540049689156, "sim_compute_robot_state-parked0": 0.010539731809071131}, "udem1-2-1-ego": {"driven_any": 0.41052442104768067, "get_ui_image": 0.08167295288621333, "step_physics": 0.17314122434248003, "survival_time": 2.849999999999998, "driven_lanedir": 0.4028538643924746, "get_state_dump": 0.03869666969567014, "sim_render-ego": 0.007674819544741982, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0375065803527832, "deviation-heading": 0.5466812998450088, "complete-iteration": 0.44816746209797104, "set_robot_commands": 0.006408737416852985, "deviation-center-line": 0.3184058020997934, "driven_lanedir_consec": 0.4028538643924746, "sim_compute_sim_state": 0.032676199026275096, "sim_compute_performance-ego": 0.006520175097281472, "sim_compute_robot_state-ego": 0.010404871221174271, "sim_compute_robot_state-npc0": 0.011029310393751714, "sim_compute_robot_state-npc1": 0.010570676703202097, "sim_compute_robot_state-npc2": 0.01045955273143032, "sim_compute_robot_state-npc3": 0.01062531220285516, "sim_compute_robot_state-parked0": 0.010422635496708384}, "udem1-3-0-ego": {"driven_any": 0.7634890213450584, "get_ui_image": 0.08084042867024739, "step_physics": 0.17474971154723504, "survival_time": 4.94999999999999, "driven_lanedir": 0.6504246240467327, "get_state_dump": 0.038173714069404986, "sim_render-ego": 0.007831491605199949, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0380198425716824, "deviation-heading": 2.0317977913198466, "complete-iteration": 0.4644709861639774, "set_robot_commands": 0.0065256561895813605, "deviation-center-line": 0.3519081554221302, "driven_lanedir_consec": 0.6448553793575276, "sim_compute_sim_state": 0.04808729585975108, "sim_compute_performance-ego": 0.006204217371314463, "sim_compute_robot_state-ego": 0.01037495064012932, "sim_compute_robot_state-npc0": 0.010811817766440034, "sim_compute_robot_state-npc1": 0.010516999947904336, "sim_compute_robot_state-npc2": 0.010607030656602647, "sim_compute_robot_state-npc3": 0.010666221079200204, "sim_compute_robot_state-parked0": 0.010699840507122}, "udem1-3-1-ego": {"driven_any": 0.7616575664442786, "get_ui_image": 0.0797767855904319, "step_physics": 0.1736454867353343, "survival_time": 4.94999999999999, "driven_lanedir": 0.6666647710444701, "get_state_dump": 0.038375584766118215, "sim_render-ego": 0.007710769923046382, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03764690534032957, "deviation-heading": 1.8200177623839324, "complete-iteration": 0.4600519628235788, "set_robot_commands": 0.006240579817030165, "deviation-center-line": 0.33234357124050284, "driven_lanedir_consec": 0.6544999074542139, "sim_compute_sim_state": 0.04638223696236658, "sim_compute_performance-ego": 0.006146296106203638, "sim_compute_robot_state-ego": 0.010156470115738683, "sim_compute_robot_state-npc0": 0.011063785263986298, "sim_compute_robot_state-npc1": 0.01073099145985613, "sim_compute_robot_state-npc2": 0.010405542874577067, "sim_compute_robot_state-npc3": 0.01068353412127254, "sim_compute_robot_state-parked0": 0.010721799099084104}, "udem1-4-0-ego": {"driven_any": 0.3082988362758285, "get_ui_image": 0.07915151661092584, "step_physics": 0.15132196924903177, "survival_time": 2.2, "driven_lanedir": 0.29881004532623745, "get_state_dump": 0.038132732564752754, "sim_render-ego": 0.008129878477616743, "in-drivable-lane": 0.0, "agent_compute-ego": 0.038597616282376374, "deviation-heading": 0.5503920925386224, "complete-iteration": 0.4323610609227961, "set_robot_commands": 0.0073458118872209025, "deviation-center-line": 0.25234083448948735, "driven_lanedir_consec": 0.29881004532623745, "sim_compute_sim_state": 0.03254538232629949, "sim_compute_performance-ego": 0.007018273526971991, "sim_compute_robot_state-ego": 0.011728655208240856, "sim_compute_robot_state-npc0": 0.011780711737546051, "sim_compute_robot_state-npc1": 0.011727571487426758, "sim_compute_robot_state-npc2": 0.01142728870565241, "sim_compute_robot_state-npc3": 0.011312793601642956, "sim_compute_robot_state-parked0": 0.011800522154027764}, "udem1-4-1-ego": {"driven_any": 0.3083614031369832, "get_ui_image": 0.07901130481199785, "step_physics": 0.1510183648629622, "survival_time": 2.2, "driven_lanedir": 0.29913716804247237, "get_state_dump": 0.03823271664706143, "sim_render-ego": 0.007574135606939142, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03705322200601751, "deviation-heading": 0.5442280312830121, "complete-iteration": 0.4206728014079007, "set_robot_commands": 0.006041239608417858, "deviation-center-line": 0.25317418190087515, "driven_lanedir_consec": 0.29913716804247237, "sim_compute_sim_state": 0.032399334690787575, "sim_compute_performance-ego": 0.006105861880562522, "sim_compute_robot_state-ego": 0.010118040171536532, "sim_compute_robot_state-npc0": 0.010922962968999687, "sim_compute_robot_state-npc1": 0.010528987104242498, "sim_compute_robot_state-npc2": 0.010398648001930933, "sim_compute_robot_state-npc3": 0.010298485105687922, "sim_compute_robot_state-parked0": 0.010632780465212736}}
set_robot_commands_max0.00802048121657327
set_robot_commands_mean0.006720347461513722
set_robot_commands_median0.006459056371632613
set_robot_commands_min0.006041239608417858
sim_compute_performance-ego_max0.007465373689883224
sim_compute_performance-ego_mean0.006439017911460579
sim_compute_performance-ego_median0.006200605054610391
sim_compute_performance-ego_min0.005963379574805191
sim_compute_robot_state-ego_max0.01290465960992831
sim_compute_robot_state-ego_mean0.01085145541032383
sim_compute_robot_state-ego_median0.010389910930651796
sim_compute_robot_state-ego_min0.010028719902038574
sim_compute_robot_state-npc0_max0.012440140002241758
sim_compute_robot_state-npc0_mean0.011202851026271093
sim_compute_robot_state-npc0_median0.010976136681375702
sim_compute_robot_state-npc0_min0.01034781613300756
sim_compute_robot_state-npc1_max0.012446748876126013
sim_compute_robot_state-npc1_mean0.010958946215930332
sim_compute_robot_state-npc1_median0.010549831903722296
sim_compute_robot_state-npc1_min0.010166866263163458
sim_compute_robot_state-npc2_max0.012506923942922432
sim_compute_robot_state-npc2_mean0.010947490581190818
sim_compute_robot_state-npc2_median0.010547427667511834
sim_compute_robot_state-npc2_min0.010398648001930933
sim_compute_robot_state-npc3_max0.012737762148135176
sim_compute_robot_state-npc3_mean0.010972148838752364
sim_compute_robot_state-npc3_median0.01068345270510709
sim_compute_robot_state-npc3_min0.010241882088258094
sim_compute_robot_state-parked0_max0.012696504592895508
sim_compute_robot_state-parked0_mean0.011021047603318974
sim_compute_robot_state-parked0_median0.010666310486167369
sim_compute_robot_state-parked0_min0.010120025615102238
sim_compute_sim_state_max0.04808729585975108
sim_compute_sim_state_mean0.04015974057927723
sim_compute_sim_state_median0.040651859557186296
sim_compute_sim_state_min0.032399334690787575
sim_render-ego_max0.008768848169629818
sim_render-ego_mean0.007846879062717733
sim_render-ego_median0.007727487886278832
sim_render-ego_min0.007373632770953792
simulation-passed1
step_physics_max0.18530641769876283
step_physics_mean0.16792285790829903
step_physics_median0.1724178302930411
step_physics_min0.1510183648629622
survival_time_max5.349999999999989
survival_time_mean4.0099999999999945
survival_time_min2.2

Highlights

33222

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

udem1-1-0

udem1-1-1

udem1-2-0

udem1-2-1

udem1-3-0

udem1-3-1

udem1-4-0

udem1-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.