Duckietown Challenges Home Challenges Submissions

Job 33255

Job ID33255
submission6751
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI-sim-validation
stepLFVIv-sim
statusaborted
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:09:00
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7200110913875248
survival_time_median2.1750000000000003
deviation-center-line_median0.13122978216185724
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.11124751091003418
agent_compute-ego_mean0.09922326754884642
agent_compute-ego_median0.09852184160895967
agent_compute-ego_min0.0952608964659951
complete-iteration_max0.5494898419047511
complete-iteration_mean0.5235842722039035
complete-iteration_median0.5232816961678591
complete-iteration_min0.5023213313973468
deviation-center-line_max0.4048269797221258
deviation-center-line_mean0.1501077397197582
deviation-center-line_min0.0783843721277266
deviation-heading_max1.26851336514039
deviation-heading_mean0.559106797154317
deviation-heading_median0.5535616538938465
deviation-heading_min0.2951644282704496
driven_any_max1.0608010146868274
driven_any_mean0.7615428137565188
driven_any_median0.7608100759283183
driven_any_min0.38882804756803285
driven_lanedir_consec_max0.9675899633361036
driven_lanedir_consec_mean0.7205627829208796
driven_lanedir_consec_min0.3735647579010743
driven_lanedir_max0.9784684273986568
driven_lanedir_mean0.723148280219769
driven_lanedir_median0.7200110913875248
driven_lanedir_min0.3735647579010743
get_state_dump_max0.03754162788391113
get_state_dump_mean0.03615902942422789
get_state_dump_median0.03597229007182615
get_state_dump_min0.03503112303904998
get_ui_image_max0.0844913504340432
get_ui_image_mean0.08174817073863297
get_ui_image_median0.0817815441446206
get_ui_image_min0.07948195657064748
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego": {"driven_any": 0.38882804756803285, "get_ui_image": 0.08111710548400879, "step_physics": 0.1869485282897949, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3735647579010743, "get_state_dump": 0.03747715950012207, "sim_render-ego": 0.007853517532348633, "in-drivable-lane": 0.0, "agent_compute-ego": 0.11124751091003418, "deviation-heading": 0.2951644282704496, "complete-iteration": 0.5385869693756103, "set_robot_commands": 0.007263507843017578, "deviation-center-line": 0.09799309736676048, "driven_lanedir_consec": 0.3735647579010743, "sim_compute_sim_state": 0.03142429351806641, "sim_compute_performance-ego": 0.006591005325317383, "sim_compute_robot_state-ego": 0.01127976417541504, "sim_compute_robot_state-npc0": 0.011841716766357422, "sim_compute_robot_state-npc1": 0.011459674835205078, "sim_compute_robot_state-npc2": 0.011513662338256837, "sim_compute_robot_state-npc3": 0.011374197006225583, "sim_compute_robot_state-parked0": 0.010877714157104493}, "udem1-0-1-ego": {"driven_any": 1.0608010146868274, "get_ui_image": 0.08244598280523241, "step_physics": 0.16956670259692003, "survival_time": 4.849999999999991, "driven_lanedir": 0.9784684273986568, "get_state_dump": 0.03593811054819638, "sim_render-ego": 0.007775589362862184, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09634825617996688, "deviation-heading": 1.26851336514039, "complete-iteration": 0.5329823862646044, "set_robot_commands": 0.006784667673799181, "deviation-center-line": 0.4048269797221258, "driven_lanedir_consec": 0.9675899633361036, "sim_compute_sim_state": 0.0610441301286835, "sim_compute_performance-ego": 0.006403050471826927, "sim_compute_robot_state-ego": 0.01140824298268741, "sim_compute_robot_state-npc0": 0.011152390352229482, "sim_compute_robot_state-npc1": 0.01085203210103143, "sim_compute_robot_state-npc2": 0.011227666717214682, "sim_compute_robot_state-npc3": 0.011030755092188257, "sim_compute_robot_state-parked0": 0.010670880681460666}, "udem1-1-0-ego": {"driven_any": 0.7569474200774807, "get_ui_image": 0.08249183801504281, "step_physics": 0.1740576854118934, "survival_time": 1.950000000000001, "driven_lanedir": 0.7247457277625835, "get_state_dump": 0.03569890902592586, "sim_render-ego": 0.006903911248231545, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09602842575464492, "deviation-heading": 0.3421159523196871, "complete-iteration": 0.5075195813790346, "set_robot_commands": 0.006554224552252354, "deviation-center-line": 0.08507472167313151, "driven_lanedir_consec": 0.7247457277625835, "sim_compute_sim_state": 0.038478680146046176, "sim_compute_performance-ego": 0.005767076443403195, "sim_compute_robot_state-ego": 0.010181072430732924, "sim_compute_robot_state-npc0": 0.010167910502507135, "sim_compute_robot_state-npc1": 0.010148451878474308, "sim_compute_robot_state-npc2": 0.009964203223204002, "sim_compute_robot_state-npc3": 0.01064743139804938, "sim_compute_robot_state-parked0": 0.010096140396900669}, "udem1-1-1-ego": {"driven_any": 0.7569474200774807, "get_ui_image": 0.0829626107827211, "step_physics": 0.1710084157112317, "survival_time": 1.950000000000001, "driven_lanedir": 0.7247457277625835, "get_state_dump": 0.03503112303904998, "sim_render-ego": 0.007350444793701172, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09606118079943536, "deviation-heading": 0.3421159523196871, "complete-iteration": 0.5074459100380923, "set_robot_commands": 0.006611469464424329, "deviation-center-line": 0.08507472167313151, "driven_lanedir_consec": 0.7247457277625835, "sim_compute_sim_state": 0.03734246278420473, "sim_compute_performance-ego": 0.005984874872060923, "sim_compute_robot_state-ego": 0.0110777219136556, "sim_compute_robot_state-npc0": 0.010994501602955354, "sim_compute_robot_state-npc1": 0.01073324374663524, "sim_compute_robot_state-npc2": 0.010548695539816832, "sim_compute_robot_state-npc3": 0.0106812929495787, "sim_compute_robot_state-parked0": 0.01073616590255346}, "udem1-2-0-ego": {"driven_any": 0.8205541101048129, "get_ui_image": 0.08286314118992198, "step_physics": 0.1799400340427052, "survival_time": 2.2, "driven_lanedir": 0.7844729301340911, "get_state_dump": 0.03552962975068526, "sim_render-ego": 0.007629958066073331, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0952608964659951, "deviation-heading": 0.5596263224679711, "complete-iteration": 0.519487901167436, "set_robot_commands": 0.006979660554365678, "deviation-center-line": 0.17120309929653582, "driven_lanedir_consec": 0.7844729301340911, "sim_compute_sim_state": 0.039411593567241325, "sim_compute_performance-ego": 0.006453443657268177, "sim_compute_robot_state-ego": 0.011027699167078192, "sim_compute_robot_state-npc0": 0.010950700803236528, "sim_compute_robot_state-npc1": 0.01072671196677468, "sim_compute_robot_state-npc2": 0.01076994700865312, "sim_compute_robot_state-npc3": 0.01063251495361328, "sim_compute_robot_state-parked0": 0.010976119474931196}, "udem1-2-1-ego": {"driven_any": 0.8205541101048129, "get_ui_image": 0.0844913504340432, "step_physics": 0.17800226536664096, "survival_time": 2.2, "driven_lanedir": 0.7844729301340911, "get_state_dump": 0.03598977760835127, "sim_render-ego": 0.007448483597148548, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10000019723718816, "deviation-heading": 0.5596263224679711, "complete-iteration": 0.5270754911682822, "set_robot_commands": 0.0071662556041370735, "deviation-center-line": 0.17120309929653582, "driven_lanedir_consec": 0.7844729301340911, "sim_compute_sim_state": 0.03922120549462058, "sim_compute_performance-ego": 0.006208576939322732, "sim_compute_robot_state-ego": 0.011198764497583565, "sim_compute_robot_state-npc0": 0.011582916433160955, "sim_compute_robot_state-npc1": 0.011170154268091375, "sim_compute_robot_state-npc2": 0.011548432436856356, "sim_compute_robot_state-npc3": 0.011200877753171051, "sim_compute_robot_state-parked0": 0.011498678814281117}, "udem1-3-0-ego": {"driven_any": 0.7646727317791558, "get_ui_image": 0.08027693282726199, "step_physics": 0.19944789243298908, "survival_time": 2.1500000000000004, "driven_lanedir": 0.7152296955398382, "get_state_dump": 0.035954802535301034, "sim_render-ego": 0.007795932681061501, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10062594746434413, "deviation-heading": 0.5474969853197219, "complete-iteration": 0.5494898419047511, "set_robot_commands": 0.007002503372902094, "deviation-center-line": 0.0783843721277266, "driven_lanedir_consec": 0.7077414410766678, "sim_compute_sim_state": 0.0462634286215139, "sim_compute_performance-ego": 0.00642860212991404, "sim_compute_robot_state-ego": 0.011166356330694157, "sim_compute_robot_state-npc0": 0.011146961256515148, "sim_compute_robot_state-npc1": 0.010605989500533704, "sim_compute_robot_state-npc2": 0.01082174722538438, "sim_compute_robot_state-npc3": 0.01115744058475938, "sim_compute_robot_state-parked0": 0.010457432547280954}, "udem1-3-1-ego": {"driven_any": 0.7646727317791558, "get_ui_image": 0.07948195657064748, "step_physics": 0.19996058109194736, "survival_time": 2.1500000000000004, "driven_lanedir": 0.7152296955398382, "get_state_dump": 0.036213558773661766, "sim_render-ego": 0.007332690926485284, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09961657745893612, "deviation-heading": 0.5474969853197219, "complete-iteration": 0.5453452287718307, "set_robot_commands": 0.00662019086438556, "deviation-center-line": 0.0783843721277266, "driven_lanedir_consec": 0.7077414410766678, "sim_compute_sim_state": 0.04733798115752464, "sim_compute_performance-ego": 0.006151055180749228, "sim_compute_robot_state-ego": 0.010603849277939907, "sim_compute_robot_state-npc0": 0.01061669061350268, "sim_compute_robot_state-npc1": 0.010612831559292104, "sim_compute_robot_state-npc2": 0.01022514631581861, "sim_compute_robot_state-npc3": 0.009769861088242642, "sim_compute_robot_state-parked0": 0.010437111521876137}, "udem1-4-0-ego": {"driven_any": 0.7407252756937139, "get_ui_image": 0.0810815717863, "step_physics": 0.1644248392270959, "survival_time": 2.3, "driven_lanedir": 0.7152764550124661, "get_state_dump": 0.036215595577074135, "sim_render-ego": 0.007794794828995415, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09760488634524138, "deviation-heading": 0.5644558289587853, "complete-iteration": 0.5055880805720454, "set_robot_commands": 0.007313956385073455, "deviation-center-line": 0.164466466956954, "driven_lanedir_consec": 0.7152764550124661, "sim_compute_sim_state": 0.03722368634265402, "sim_compute_performance-ego": 0.0065914703452068825, "sim_compute_robot_state-ego": 0.011144306348717731, "sim_compute_robot_state-npc0": 0.011261867440265158, "sim_compute_robot_state-npc1": 0.010894666547360628, "sim_compute_robot_state-npc2": 0.011432663254115892, "sim_compute_robot_state-npc3": 0.010900471521460491, "sim_compute_robot_state-parked0": 0.011354347933893618}, "udem1-4-1-ego": {"driven_any": 0.7407252756937139, "get_ui_image": 0.0802692174911499, "step_physics": 0.16299861410389777, "survival_time": 2.3, "driven_lanedir": 0.7152764550124661, "get_state_dump": 0.03754162788391113, "sim_render-ego": 0.007629057635431704, "in-drivable-lane": 0.0, "agent_compute-ego": 0.099438796872678, "deviation-heading": 0.5644558289587853, "complete-iteration": 0.5023213313973468, "set_robot_commands": 0.006736278533935547, "deviation-center-line": 0.164466466956954, "driven_lanedir_consec": 0.7152764550124661, "sim_compute_sim_state": 0.039281124654023544, "sim_compute_performance-ego": 0.0061742430147917375, "sim_compute_robot_state-ego": 0.010196913843569548, "sim_compute_robot_state-npc0": 0.0105785494265349, "sim_compute_robot_state-npc1": 0.010391162789386251, "sim_compute_robot_state-npc2": 0.01020602039668871, "sim_compute_robot_state-npc3": 0.01016019219937532, "sim_compute_robot_state-parked0": 0.01037101641945217}}
set_robot_commands_max0.007313956385073455
set_robot_commands_mean0.006903271484829285
set_robot_commands_median0.006882164114082429
set_robot_commands_min0.006554224552252354
sim_compute_performance-ego_max0.0065914703452068825
sim_compute_performance-ego_mean0.006275339837986121
sim_compute_performance-ego_median0.00630581370557483
sim_compute_performance-ego_min0.005767076443403195
sim_compute_robot_state-ego_max0.01140824298268741
sim_compute_robot_state-ego_mean0.010928469096807407
sim_compute_robot_state-ego_median0.011111014131186665
sim_compute_robot_state-ego_min0.010181072430732924
sim_compute_robot_state-npc0_max0.011841716766357422
sim_compute_robot_state-npc0_mean0.011029420519726475
sim_compute_robot_state-npc0_median0.011070731429735251
sim_compute_robot_state-npc0_min0.010167910502507135
sim_compute_robot_state-npc1_max0.011459674835205078
sim_compute_robot_state-npc1_mean0.01075949191927848
sim_compute_robot_state-npc1_median0.010729977856704962
sim_compute_robot_state-npc1_min0.010148451878474308
sim_compute_robot_state-npc2_max0.011548432436856356
sim_compute_robot_state-npc2_mean0.010825818445600944
sim_compute_robot_state-npc2_median0.01079584711701875
sim_compute_robot_state-npc2_min0.009964203223204002
sim_compute_robot_state-npc3_max0.011374197006225583
sim_compute_robot_state-npc3_mean0.01075550345466641
sim_compute_robot_state-npc3_median0.010790882235519597
sim_compute_robot_state-npc3_min0.009769861088242642
sim_compute_robot_state-parked0_max0.011498678814281117
sim_compute_robot_state-parked0_mean0.010747560784973449
sim_compute_robot_state-parked0_median0.010703523292007064
sim_compute_robot_state-parked0_min0.010096140396900669
sim_compute_sim_state_max0.0610441301286835
sim_compute_sim_state_mean0.04170285864145788
sim_compute_sim_state_median0.03925116507432207
sim_compute_sim_state_min0.03142429351806641
sim_render-ego_max0.007853517532348633
sim_render-ego_mean0.007551438067233932
sim_render-ego_median0.007629507850752518
sim_render-ego_min0.006903911248231545
simulation-passed1
step_physics_max0.19996058109194736
step_physics_mean0.17863555582751162
step_physics_median0.17602997538926718
step_physics_min0.16299861410389777
survival_time_max4.849999999999991
survival_time_mean2.3299999999999996
survival_time_min1.2500000000000004

Highlights

33255

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

udem1-1-0

udem1-1-1

udem1-2-0

udem1-2-1

udem1-3-0

udem1-3-1

udem1-4-0

udem1-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.