Duckietown Challenges Home Challenges Submissions

Job 33246

Job ID33246
submission6735
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI-sim-validation
stepLFVIv-sim
statusaborted
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:09:27
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7200110913875248
survival_time_median2.2
deviation-center-line_median0.164466466956954
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.10017184235832909
agent_compute-ego_mean0.09636015650088184
agent_compute-ego_median0.09683526245501672
agent_compute-ego_min0.09308245243170322
complete-iteration_max0.5430672057839327
complete-iteration_mean0.5182004780557937
complete-iteration_median0.5170741222592681
complete-iteration_min0.4945843036358173
deviation-center-line_max0.4048269797221258
deviation-center-line_mean0.16404765152555917
deviation-center-line_min0.0783843721277266
deviation-heading_max1.26851336514039
deviation-heading_mean0.6138289094675553
deviation-heading_median0.5596263224679711
deviation-heading_min0.3421159523196871
driven_any_max1.0608010146868274
driven_any_mean0.8019548909106856
driven_any_median0.7646727317791558
driven_any_min0.7407252756937139
driven_lanedir_consec_max0.9675899633361036
driven_lanedir_consec_mean0.7453853063801805
driven_lanedir_consec_min0.621789992494084
driven_lanedir_max0.9784684273986568
driven_lanedir_mean0.7583517878828138
driven_lanedir_median0.7247457277625835
driven_lanedir_min0.7152296955398382
get_state_dump_max0.03906736166580864
get_state_dump_mean0.03666562857886599
get_state_dump_median0.03589876274025765
get_state_dump_min0.035028561567648865
get_ui_image_max0.08127147112137233
get_ui_image_mean0.07967855467187891
get_ui_image_median0.07953476905822754
get_ui_image_min0.0771867175434911
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego": {"driven_any": 0.7929488191097018, "get_ui_image": 0.08099545622771641, "step_physics": 0.1852945066847891, "survival_time": 2.6499999999999986, "driven_lanedir": 0.7255998345315233, "get_state_dump": 0.03568207992697662, "sim_render-ego": 0.007243921171944096, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09849062505758034, "deviation-heading": 0.8423855514028324, "complete-iteration": 0.5326443528229335, "set_robot_commands": 0.006528696923885705, "deviation-center-line": 0.2373922154247701, "driven_lanedir_consec": 0.621789992494084, "sim_compute_sim_state": 0.047595365992132224, "sim_compute_performance-ego": 0.005957306555981906, "sim_compute_robot_state-ego": 0.010535510081165244, "sim_compute_robot_state-npc0": 0.011052019191238115, "sim_compute_robot_state-npc1": 0.010449400487935767, "sim_compute_robot_state-npc2": 0.010735763693755528, "sim_compute_robot_state-npc3": 0.010910627976903377, "sim_compute_robot_state-parked0": 0.010861743171260044}, "udem1-0-1-ego": {"driven_any": 1.0608010146868274, "get_ui_image": 0.08028126991901201, "step_physics": 0.16690460185414738, "survival_time": 4.849999999999991, "driven_lanedir": 0.9784684273986568, "get_state_dump": 0.035909942744933455, "sim_render-ego": 0.007349304317199078, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0938676927507538, "deviation-heading": 1.26851336514039, "complete-iteration": 0.5266470810801712, "set_robot_commands": 0.007072972268173375, "deviation-center-line": 0.4048269797221258, "driven_lanedir_consec": 0.9675899633361036, "sim_compute_sim_state": 0.06208988317509288, "sim_compute_performance-ego": 0.006210152635869291, "sim_compute_robot_state-ego": 0.01183624857479764, "sim_compute_robot_state-npc0": 0.011070300623313668, "sim_compute_robot_state-npc1": 0.010939544009179184, "sim_compute_robot_state-npc2": 0.01077244208031094, "sim_compute_robot_state-npc3": 0.011095654104173798, "sim_compute_robot_state-parked0": 0.010955675361082726}, "udem1-1-0-ego": {"driven_any": 0.7569474200774807, "get_ui_image": 0.07882422055953588, "step_physics": 0.16712364783653846, "survival_time": 1.950000000000001, "driven_lanedir": 0.7247457277625835, "get_state_dump": 0.035125059959216, "sim_render-ego": 0.007273631218152168, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09347138649378069, "deviation-heading": 0.3421159523196871, "complete-iteration": 0.4945843036358173, "set_robot_commands": 0.006429452162522536, "deviation-center-line": 0.08507472167313151, "driven_lanedir_consec": 0.7247457277625835, "sim_compute_sim_state": 0.03640248836615147, "sim_compute_performance-ego": 0.005886083994156275, "sim_compute_robot_state-ego": 0.01136343907087277, "sim_compute_robot_state-npc0": 0.010700048544468025, "sim_compute_robot_state-npc1": 0.010129323372474084, "sim_compute_robot_state-npc2": 0.010660379360883664, "sim_compute_robot_state-npc3": 0.010375096247746397, "sim_compute_robot_state-parked0": 0.010535295193011943}, "udem1-1-1-ego": {"driven_any": 0.7569474200774807, "get_ui_image": 0.08127147112137233, "step_physics": 0.16708010893601638, "survival_time": 1.950000000000001, "driven_lanedir": 0.7247457277625835, "get_state_dump": 0.035028561567648865, "sim_render-ego": 0.007534626202705579, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09308245243170322, "deviation-heading": 0.3421159523196871, "complete-iteration": 0.5011196931203207, "set_robot_commands": 0.006778099598028721, "deviation-center-line": 0.08507472167313151, "driven_lanedir_consec": 0.7247457277625835, "sim_compute_sim_state": 0.03833636259421324, "sim_compute_performance-ego": 0.006329970482068184, "sim_compute_robot_state-ego": 0.011236734879322542, "sim_compute_robot_state-npc0": 0.01104279664846567, "sim_compute_robot_state-npc1": 0.01077410502311511, "sim_compute_robot_state-npc2": 0.01070239605047764, "sim_compute_robot_state-npc3": 0.010670723059238532, "sim_compute_robot_state-parked0": 0.010953615873287886}, "udem1-2-0-ego": {"driven_any": 0.8205541101048129, "get_ui_image": 0.08110821788961237, "step_physics": 0.17498631910844284, "survival_time": 2.2, "driven_lanedir": 0.7844729301340911, "get_state_dump": 0.035351168025623665, "sim_render-ego": 0.007061952894384211, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0972011847929521, "deviation-heading": 0.5596263224679711, "complete-iteration": 0.5111990029161627, "set_robot_commands": 0.0068200772458856754, "deviation-center-line": 0.17120309929653582, "driven_lanedir_consec": 0.7844729301340911, "sim_compute_sim_state": 0.038608420978892936, "sim_compute_performance-ego": 0.006261245770887895, "sim_compute_robot_state-ego": 0.010762610218741676, "sim_compute_robot_state-npc0": 0.010577191006053576, "sim_compute_robot_state-npc1": 0.010276046666232023, "sim_compute_robot_state-npc2": 0.01054736159064553, "sim_compute_robot_state-npc3": 0.01048070192337036, "sim_compute_robot_state-parked0": 0.010860009626908735}, "udem1-2-1-ego": {"driven_any": 0.8205541101048129, "get_ui_image": 0.0794070688160983, "step_physics": 0.1742633581161499, "survival_time": 2.2, "driven_lanedir": 0.7844729301340911, "get_state_dump": 0.03588758273558183, "sim_render-ego": 0.007407172159715133, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10017184235832909, "deviation-heading": 0.5596263224679711, "complete-iteration": 0.5178705995733087, "set_robot_commands": 0.007194584066217596, "deviation-center-line": 0.17120309929653582, "driven_lanedir_consec": 0.7844729301340911, "sim_compute_sim_state": 0.03855535117062656, "sim_compute_performance-ego": 0.006345391273498535, "sim_compute_robot_state-ego": 0.011557150970805776, "sim_compute_robot_state-npc0": 0.011746466159820557, "sim_compute_robot_state-npc1": 0.011064139279452238, "sim_compute_robot_state-npc2": 0.011373660781166773, "sim_compute_robot_state-npc3": 0.011327255855907091, "sim_compute_robot_state-parked0": 0.01126463846726851}, "udem1-3-0-ego": {"driven_any": 0.7646727317791558, "get_ui_image": 0.07864158652549566, "step_physics": 0.19767938103786736, "survival_time": 2.1500000000000004, "driven_lanedir": 0.7152296955398382, "get_state_dump": 0.03757534470669059, "sim_render-ego": 0.007189673046733058, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09584573812262956, "deviation-heading": 0.5474969853197219, "complete-iteration": 0.5397756543270377, "set_robot_commands": 0.006699706232824991, "deviation-center-line": 0.0783843721277266, "driven_lanedir_consec": 0.7077414410766678, "sim_compute_sim_state": 0.046272100404251455, "sim_compute_performance-ego": 0.00589229894238849, "sim_compute_robot_state-ego": 0.009964488273443178, "sim_compute_robot_state-npc0": 0.011212088340936704, "sim_compute_robot_state-npc1": 0.010868139045183047, "sim_compute_robot_state-npc2": 0.010534402936003927, "sim_compute_robot_state-npc3": 0.010710023170293764, "sim_compute_robot_state-parked0": 0.010365580403527547}, "udem1-3-1-ego": {"driven_any": 0.7646727317791558, "get_ui_image": 0.0771867175434911, "step_physics": 0.1973455506701802, "survival_time": 2.1500000000000004, "driven_lanedir": 0.7152296955398382, "get_state_dump": 0.03818206454432288, "sim_render-ego": 0.007469886957212936, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09725890603176383, "deviation-heading": 0.5474969853197219, "complete-iteration": 0.5430672057839327, "set_robot_commands": 0.007125322208848111, "deviation-center-line": 0.0783843721277266, "driven_lanedir_consec": 0.7077414410766678, "sim_compute_sim_state": 0.04682091225025266, "sim_compute_performance-ego": 0.006216221077497615, "sim_compute_robot_state-ego": 0.010833152504854424, "sim_compute_robot_state-npc0": 0.011171906493430916, "sim_compute_robot_state-npc1": 0.010910705078479856, "sim_compute_robot_state-npc2": 0.01052473312200502, "sim_compute_robot_state-npc3": 0.010986505552779796, "sim_compute_robot_state-parked0": 0.010706602140914562}, "udem1-4-0-ego": {"driven_any": 0.7407252756937139, "get_ui_image": 0.07954485001771347, "step_physics": 0.15984881442526114, "survival_time": 2.3, "driven_lanedir": 0.7152764550124661, "get_state_dump": 0.03906736166580864, "sim_render-ego": 0.007720423781353495, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0977423968522445, "deviation-heading": 0.5644558289587853, "complete-iteration": 0.4988192423530247, "set_robot_commands": 0.007139636122662088, "deviation-center-line": 0.164466466956954, "driven_lanedir_consec": 0.7152764550124661, "sim_compute_sim_state": 0.03804507981175962, "sim_compute_performance-ego": 0.006263971328735352, "sim_compute_robot_state-ego": 0.010682163031204887, "sim_compute_robot_state-npc0": 0.010835129281748896, "sim_compute_robot_state-npc1": 0.010447087495223335, "sim_compute_robot_state-npc2": 0.010258052660071333, "sim_compute_robot_state-npc3": 0.010465072548907736, "sim_compute_robot_state-parked0": 0.010424836822178051}, "udem1-4-1-ego": {"driven_any": 0.7407252756937139, "get_ui_image": 0.07952468809874161, "step_physics": 0.15760129949320917, "survival_time": 2.3, "driven_lanedir": 0.7152764550124661, "get_state_dump": 0.03884711991185728, "sim_render-ego": 0.011385021002396294, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09646934011708136, "deviation-heading": 0.5644558289587853, "complete-iteration": 0.5162776449452275, "set_robot_commands": 0.008334097654923149, "deviation-center-line": 0.164466466956954, "driven_lanedir_consec": 0.7152764550124661, "sim_compute_sim_state": 0.039790739183840546, "sim_compute_performance-ego": 0.007251076076341712, "sim_compute_robot_state-ego": 0.013512559559034264, "sim_compute_robot_state-npc0": 0.013198743695798128, "sim_compute_robot_state-npc1": 0.012302362400552502, "sim_compute_robot_state-npc2": 0.012565991152887758, "sim_compute_robot_state-npc3": 0.012223487314970596, "sim_compute_robot_state-parked0": 0.012924665990083116}}
set_robot_commands_max0.008334097654923149
set_robot_commands_mean0.007012264448397194
set_robot_commands_median0.006946524757029525
set_robot_commands_min0.006429452162522536
sim_compute_performance-ego_max0.007251076076341712
sim_compute_performance-ego_mean0.006261371813742525
sim_compute_performance-ego_median0.006238733424192755
sim_compute_performance-ego_min0.005886083994156275
sim_compute_robot_state-ego_max0.013512559559034264
sim_compute_robot_state-ego_mean0.01122840571642424
sim_compute_robot_state-ego_median0.011034943692088482
sim_compute_robot_state-ego_min0.009964488273443178
sim_compute_robot_state-npc0_max0.013198743695798128
sim_compute_robot_state-npc0_mean0.011260668998527424
sim_compute_robot_state-npc0_median0.01106115990727589
sim_compute_robot_state-npc0_min0.010577191006053576
sim_compute_robot_state-npc1_max0.012302362400552502
sim_compute_robot_state-npc1_mean0.010816085285782717
sim_compute_robot_state-npc1_median0.010821122034149078
sim_compute_robot_state-npc1_min0.010129323372474084
sim_compute_robot_state-npc2_max0.012565991152887758
sim_compute_robot_state-npc2_mean0.010867518342820811
sim_compute_robot_state-npc2_median0.010681387705680652
sim_compute_robot_state-npc2_min0.010258052660071333
sim_compute_robot_state-npc3_max0.012223487314970596
sim_compute_robot_state-npc3_mean0.010924514775429144
sim_compute_robot_state-npc3_median0.01081032557359857
sim_compute_robot_state-npc3_min0.010375096247746397
sim_compute_robot_state-parked0_max0.012924665990083116
sim_compute_robot_state-parked0_mean0.010985266304952312
sim_compute_robot_state-parked0_median0.010860876399084387
sim_compute_robot_state-parked0_min0.010365580403527547
sim_compute_sim_state_max0.06208988317509288
sim_compute_sim_state_mean0.04325167039272136
sim_compute_sim_state_median0.039199580081366744
sim_compute_sim_state_min0.03640248836615147
sim_render-ego_max0.011385021002396294
sim_render-ego_mean0.007763561275179606
sim_render-ego_median0.007378238238457105
sim_render-ego_min0.007061952894384211
simulation-passed1
step_physics_max0.19767938103786736
step_physics_mean0.1748127588162602
step_physics_median0.17069350297634417
step_physics_min0.15760129949320917
survival_time_max4.849999999999991
survival_time_mean2.47
survival_time_min1.950000000000001

Highlights

33246

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

udem1-1-0

udem1-1-1

udem1-2-0

udem1-2-1

udem1-3-0

udem1-3-1

udem1-4-0

udem1-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.