Duckietown Challenges Home Challenges Submissions

Job 35195

Job ID35195
submission6748
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFV-sim-validation
stepLFVv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg05-983fc92a1e01-1
date started
date completed
duration0:21:09
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.101360865709655
survival_time_median2.849999999999998
deviation-center-line_median0.2160576038784839
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.1301061747209081
agent_compute-ego_mean0.104252461544737
agent_compute-ego_median0.10178754925727844
agent_compute-ego_min0.09736809333165489
complete-iteration_max0.5427223902482253
complete-iteration_mean0.4963221765818257
complete-iteration_median0.4883373716642272
complete-iteration_min0.4600749111175537
deviation-center-line_max0.6925094005039039
deviation-center-line_mean0.3580198979988706
deviation-center-line_min0.11576901366005984
deviation-heading_max3.506002458929027
deviation-heading_mean1.5107865234170414
deviation-heading_median0.5326976917156353
deviation-heading_min0.2700217998368003
driven_any_max4.996225171281709
driven_any_mean2.5657722667356504
driven_any_median1.1283152105187075
driven_any_min1.0571927966040893
driven_lanedir_consec_max2.7131138082525528
driven_lanedir_consec_mean1.6798087796600636
driven_lanedir_consec_min1.048279363517083
driven_lanedir_max2.7131138082525528
driven_lanedir_mean1.6798087796600636
driven_lanedir_median1.101360865709655
driven_lanedir_min1.048279363517083
get_state_dump_max0.03844316382157175
get_state_dump_mean0.0377600434176671
get_state_dump_median0.03785313796578792
get_state_dump_min0.03671629428863525
get_ui_image_max0.0723163412328352
get_ui_image_mean0.07113178488903042
get_ui_image_median0.07100339915767406
get_ui_image_min0.06973567088445028
in-drivable-lane_max6.850000000000031
in-drivable-lane_mean2.400000000000019
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.0611881576956277, "get_ui_image": 0.07165258335617353, "step_physics": 0.17244565711831147, "survival_time": 2.6499999999999986, "driven_lanedir": 1.0527491282036356, "get_state_dump": 0.038239964899027125, "sim_render-ego": 0.009710617785183888, "in-drivable-lane": 0.0, "agent_compute-ego": 0.1301061747209081, "deviation-heading": 0.2700217998368003, "complete-iteration": 0.5338099767576974, "set_robot_commands": 0.008673978301714052, "deviation-center-line": 0.11576901366005984, "driven_lanedir_consec": 1.0527491282036356, "sim_compute_sim_state": 0.021417896702604473, "sim_compute_performance-ego": 0.0067260895135267725, "sim_compute_robot_state-ego": 0.012874693240759507, "sim_compute_robot_state-npc0": 0.012555689181921617, "sim_compute_robot_state-npc1": 0.011969417895910876, "sim_compute_robot_state-npc2": 0.012228700349915704, "sim_compute_robot_state-npc3": 0.012451648712158205, "sim_compute_robot_state-parked0": 0.012388269856290997}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.0571927966040893, "get_ui_image": 0.071052555767995, "step_physics": 0.17070323116374467, "survival_time": 2.6499999999999986, "driven_lanedir": 1.048279363517083, "get_state_dump": 0.038020754760166385, "sim_render-ego": 0.009152844267071416, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10296443723282724, "deviation-heading": 0.2927610584708578, "complete-iteration": 0.4877962166408323, "set_robot_commands": 0.007245824022113152, "deviation-center-line": 0.17929071219722958, "driven_lanedir_consec": 1.048279363517083, "sim_compute_sim_state": 0.02014960432952305, "sim_compute_performance-ego": 0.006188819993217036, "sim_compute_robot_state-ego": 0.01050368794855082, "sim_compute_robot_state-npc0": 0.010468779869799345, "sim_compute_robot_state-npc1": 0.010105758343102796, "sim_compute_robot_state-npc2": 0.010380205118431235, "sim_compute_robot_state-npc3": 0.010414852286284824, "sim_compute_robot_state-parked0": 0.010078839535983104}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.0656197630543995, "get_ui_image": 0.07166836353448722, "step_physics": 0.21068417108975923, "survival_time": 2.5999999999999988, "driven_lanedir": 1.0522616185753133, "get_state_dump": 0.03761040247403658, "sim_render-ego": 0.009658983120551476, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10364574193954468, "deviation-heading": 0.33444797816877664, "complete-iteration": 0.5427223902482253, "set_robot_commands": 0.00848481746820303, "deviation-center-line": 0.2160576038784839, "driven_lanedir_consec": 1.0522616185753133, "sim_compute_sim_state": 0.01995990826533391, "sim_compute_performance-ego": 0.007017277754270113, "sim_compute_robot_state-ego": 0.012590316625741811, "sim_compute_robot_state-npc0": 0.01218428978553185, "sim_compute_robot_state-npc1": 0.012183171052199144, "sim_compute_robot_state-npc2": 0.012202886434701772, "sim_compute_robot_state-npc3": 0.012271711459526649, "sim_compute_robot_state-parked0": 0.012193257992084207}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.0656197630543995, "get_ui_image": 0.07051262488731971, "step_physics": 0.2099263255412762, "survival_time": 2.5999999999999988, "driven_lanedir": 1.0522616185753133, "get_state_dump": 0.03798645734786987, "sim_render-ego": 0.009096833375784067, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09985822897690994, "deviation-heading": 0.33444797816877664, "complete-iteration": 0.5248536054904644, "set_robot_commands": 0.007499483915475698, "deviation-center-line": 0.2160576038784839, "driven_lanedir_consec": 1.0522616185753133, "sim_compute_sim_state": 0.017684684349940374, "sim_compute_performance-ego": 0.0062748377139751725, "sim_compute_robot_state-ego": 0.010628498517549954, "sim_compute_robot_state-npc0": 0.011450515343592716, "sim_compute_robot_state-npc1": 0.011126412795140194, "sim_compute_robot_state-npc2": 0.010811984539031982, "sim_compute_robot_state-npc3": 0.010939593498523418, "sim_compute_robot_state-parked0": 0.010700143300569974}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.1283152105187075, "get_ui_image": 0.07090443895574201, "step_physics": 0.16139821002357885, "survival_time": 2.849999999999998, "driven_lanedir": 1.101360865709655, "get_state_dump": 0.03771981858370597, "sim_render-ego": 0.008696104350842927, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09929811745359186, "deviation-heading": 0.5326976917156353, "complete-iteration": 0.4720831963053921, "set_robot_commands": 0.00682033990558825, "deviation-center-line": 0.1722838309673048, "driven_lanedir_consec": 1.101360865709655, "sim_compute_sim_state": 0.020648274505347536, "sim_compute_performance-ego": 0.005763514000072814, "sim_compute_robot_state-ego": 0.0097047487894694, "sim_compute_robot_state-npc0": 0.010028324629131115, "sim_compute_robot_state-npc1": 0.010235251041880826, "sim_compute_robot_state-npc2": 0.010095755259195965, "sim_compute_robot_state-npc3": 0.01021020872551098, "sim_compute_robot_state-parked0": 0.010206431673284165}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.1283152105187075, "get_ui_image": 0.0723163412328352, "step_physics": 0.1621975731431392, "survival_time": 2.849999999999998, "driven_lanedir": 1.101360865709655, "get_state_dump": 0.03844316382157175, "sim_render-ego": 0.00924086570739746, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10481199047021698, "deviation-heading": 0.5326976917156353, "complete-iteration": 0.4919068687840512, "set_robot_commands": 0.008069067670587907, "deviation-center-line": 0.1722838309673048, "driven_lanedir_consec": 1.101360865709655, "sim_compute_sim_state": 0.021803834982085647, "sim_compute_performance-ego": 0.006520392601950127, "sim_compute_robot_state-ego": 0.01114922239069353, "sim_compute_robot_state-npc0": 0.011680080179582565, "sim_compute_robot_state-npc1": 0.011243188590334172, "sim_compute_robot_state-npc2": 0.01126383898551004, "sim_compute_robot_state-npc3": 0.01125830516480563, "sim_compute_robot_state-parked0": 0.011539434131823088}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 4.996225171281709, "get_ui_image": 0.07092087586720784, "step_physics": 0.15820085843404133, "survival_time": 14.950000000000076, "driven_lanedir": 2.481793359902438, "get_state_dump": 0.03720866282780965, "sim_render-ego": 0.00985046148300171, "in-drivable-lane": 6.850000000000031, "agent_compute-ego": 0.10139795621236164, "deviation-heading": 2.8993930591179393, "complete-iteration": 0.4873334129651388, "set_robot_commands": 0.008313435713450114, "deviation-center-line": 0.5617187917160151, "driven_lanedir_consec": 2.481793359902438, "sim_compute_sim_state": 0.02018522580464681, "sim_compute_performance-ego": 0.006757025718688965, "sim_compute_robot_state-ego": 0.012685224215189616, "sim_compute_robot_state-npc0": 0.01215993881225586, "sim_compute_robot_state-npc1": 0.011968259016672773, "sim_compute_robot_state-npc2": 0.012363922595977784, "sim_compute_robot_state-npc3": 0.012428851922353108, "sim_compute_robot_state-parked0": 0.012529892921447754}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 4.996225171281709, "get_ui_image": 0.07095424254735311, "step_physics": 0.1588476578394572, "survival_time": 14.950000000000076, "driven_lanedir": 2.481793359902438, "get_state_dump": 0.03749647617340088, "sim_render-ego": 0.009092462857564291, "in-drivable-lane": 6.850000000000031, "agent_compute-ego": 0.10217714230219524, "deviation-heading": 2.8993930591179393, "complete-iteration": 0.4737626608212789, "set_robot_commands": 0.007019352118174235, "deviation-center-line": 0.5617187917160151, "driven_lanedir_consec": 2.481793359902438, "sim_compute_sim_state": 0.01948505163192749, "sim_compute_performance-ego": 0.005920469760894775, "sim_compute_robot_state-ego": 0.009945983091990154, "sim_compute_robot_state-npc0": 0.010763691266377768, "sim_compute_robot_state-npc1": 0.010361456076304116, "sim_compute_robot_state-npc2": 0.010388595263163249, "sim_compute_robot_state-npc3": 0.010381344954172773, "sim_compute_robot_state-parked0": 0.01057167371114095}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 4.579510711673576, "get_ui_image": 0.07160015185674032, "step_physics": 0.1568138551712036, "survival_time": 14.950000000000076, "driven_lanedir": 2.7131138082525528, "get_state_dump": 0.03815843900044759, "sim_render-ego": 0.01023677428563436, "in-drivable-lane": 5.150000000000065, "agent_compute-ego": 0.10089673280715944, "deviation-heading": 3.506002458929027, "complete-iteration": 0.4888785266876221, "set_robot_commands": 0.008842641512552898, "deviation-center-line": 0.6925094005039039, "driven_lanedir_consec": 2.7131138082525528, "sim_compute_sim_state": 0.018940354188283284, "sim_compute_performance-ego": 0.006970447699228922, "sim_compute_robot_state-ego": 0.013186078071594238, "sim_compute_robot_state-npc0": 0.012572498321533204, "sim_compute_robot_state-npc1": 0.012355546156565348, "sim_compute_robot_state-npc2": 0.012524290084838867, "sim_compute_robot_state-npc3": 0.012712345918019612, "sim_compute_robot_state-parked0": 0.012689477602640787}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 4.579510711673576, "get_ui_image": 0.06973567088445028, "step_physics": 0.15440346161524454, "survival_time": 14.950000000000076, "driven_lanedir": 2.7131138082525528, "get_state_dump": 0.03671629428863525, "sim_render-ego": 0.008714211781819662, "in-drivable-lane": 5.150000000000065, "agent_compute-ego": 0.09736809333165489, "deviation-heading": 3.506002458929027, "complete-iteration": 0.4600749111175537, "set_robot_commands": 0.00723196029663086, "deviation-center-line": 0.6925094005039039, "driven_lanedir_consec": 2.7131138082525528, "sim_compute_sim_state": 0.017350759506225586, "sim_compute_performance-ego": 0.005805102189381918, "sim_compute_robot_state-ego": 0.009937238693237304, "sim_compute_robot_state-npc0": 0.010551936626434326, "sim_compute_robot_state-npc1": 0.010373589197794596, "sim_compute_robot_state-npc2": 0.010284374554951986, "sim_compute_robot_state-npc3": 0.010546072324117023, "sim_compute_robot_state-parked0": 0.01070576270421346}}
set_robot_commands_max0.008842641512552898
set_robot_commands_mean0.007820090092449019
set_robot_commands_median0.007784275793031803
set_robot_commands_min0.00682033990558825
sim_compute_performance-ego_max0.007017277754270113
sim_compute_performance-ego_mean0.006394397694520661
sim_compute_performance-ego_median0.00639761515796265
sim_compute_performance-ego_min0.005763514000072814
sim_compute_robot_state-ego_max0.013186078071594238
sim_compute_robot_state-ego_mean0.011320569158477631
sim_compute_robot_state-ego_median0.010888860454121742
sim_compute_robot_state-ego_min0.0097047487894694
sim_compute_robot_state-npc0_max0.012572498321533204
sim_compute_robot_state-npc0_mean0.011441574401616037
sim_compute_robot_state-npc0_median0.01156529776158764
sim_compute_robot_state-npc0_min0.010028324629131115
sim_compute_robot_state-npc1_max0.012355546156565348
sim_compute_robot_state-npc1_mean0.011192205016590484
sim_compute_robot_state-npc1_median0.011184800692737184
sim_compute_robot_state-npc1_min0.010105758343102796
sim_compute_robot_state-npc2_max0.012524290084838867
sim_compute_robot_state-npc2_mean0.011254455318571858
sim_compute_robot_state-npc2_median0.011037911762271011
sim_compute_robot_state-npc2_min0.010095755259195965
sim_compute_robot_state-npc3_max0.012712345918019612
sim_compute_robot_state-npc3_mean0.011361493496547224
sim_compute_robot_state-npc3_median0.011098949331664524
sim_compute_robot_state-npc3_min0.01021020872551098
sim_compute_robot_state-parked0_max0.012689477602640787
sim_compute_robot_state-parked0_mean0.011360318342947848
sim_compute_robot_state-parked0_median0.011122598418018274
sim_compute_robot_state-parked0_min0.010078839535983104
sim_compute_sim_state_max0.021803834982085647
sim_compute_sim_state_mean0.019762559426591816
sim_compute_sim_state_median0.02005475629742848
sim_compute_sim_state_min0.017350759506225586
sim_render-ego_max0.01023677428563436
sim_render-ego_mean0.009345015901485124
sim_render-ego_median0.00919685498723444
sim_render-ego_min0.008696104350842927
simulation-passed1
step_physics_max0.21068417108975923
step_physics_mean0.17156210011397563
step_physics_median0.16179789158335903
step_physics_min0.15440346161524454
survival_time_max14.950000000000076
survival_time_mean7.60000000000003
survival_time_min2.5999999999999988

Highlights

35195

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-1-1

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-2-1

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-3-1

ETHZ_autolab_technical_track-4-0

ETHZ_autolab_technical_track-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.