Duckietown Challenges Home Challenges Submissions

Job 33258

Job ID33258
submission6751
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI-sim-validation
stepLFVIv-sim
statusaborted
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:09:05
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7200110913875248
survival_time_median2.1750000000000003
deviation-center-line_median0.12477059431504275
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.1117735008398692
agent_compute-ego_mean0.09892763356465416
agent_compute-ego_median0.09751547655098051
agent_compute-ego_min0.09517263143490522
complete-iteration_max0.5564388341681902
complete-iteration_mean0.5257950821285905
complete-iteration_median0.5191684690388766
complete-iteration_min0.5022554397583008
deviation-center-line_max0.4048269797221258
deviation-center-line_mean0.1487125973411275
deviation-center-line_min0.0783843721277266
deviation-heading_max1.26851336514039
deviation-heading_mean0.5616204075299814
deviation-heading_median0.5535616538938465
deviation-heading_min0.3203005320270947
driven_any_max1.0608010146868274
driven_any_mean0.7571993402948107
driven_any_median0.7608100759283183
driven_any_min0.3453933129509525
driven_lanedir_consec_max0.9675899633361036
driven_lanedir_consec_mean0.7158334843363203
driven_lanedir_consec_min0.32627177205548286
driven_lanedir_max0.9784684273986568
driven_lanedir_mean0.7184189816352097
driven_lanedir_median0.7200110913875248
driven_lanedir_min0.32627177205548286
get_state_dump_max0.03708788406017215
get_state_dump_mean0.035995167101513285
get_state_dump_median0.03610796852654039
get_state_dump_min0.03472977077838072
get_ui_image_max0.08374227718873457
get_ui_image_mean0.08118222482055762
get_ui_image_median0.08143766568257259
get_ui_image_min0.07852614962536356
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego": {"driven_any": 0.3453933129509525, "get_ui_image": 0.08122813701629639, "step_physics": 0.20318167408307392, "survival_time": 1.2000000000000004, "driven_lanedir": 0.32627177205548286, "get_state_dump": 0.03650214274724325, "sim_render-ego": 0.007695376873016357, "in-drivable-lane": 0.0, "agent_compute-ego": 0.1117735008398692, "deviation-heading": 0.3203005320270947, "complete-iteration": 0.5512428184350332, "set_robot_commands": 0.006574074427286784, "deviation-center-line": 0.0840416735804532, "driven_lanedir_consec": 0.32627177205548286, "sim_compute_sim_state": 0.033127417167027794, "sim_compute_performance-ego": 0.006040722131729126, "sim_compute_robot_state-ego": 0.010137548049290976, "sim_compute_robot_state-npc0": 0.011164446671803791, "sim_compute_robot_state-npc1": 0.010901192824045816, "sim_compute_robot_state-npc2": 0.010738650957743326, "sim_compute_robot_state-npc3": 0.010988891124725342, "sim_compute_robot_state-parked0": 0.010890503724416098}, "udem1-0-1-ego": {"driven_any": 1.0608010146868274, "get_ui_image": 0.08186151071922067, "step_physics": 0.16891516852624638, "survival_time": 4.849999999999991, "driven_lanedir": 0.9784684273986568, "get_state_dump": 0.03472977077838072, "sim_render-ego": 0.00744846678271736, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09561753518802604, "deviation-heading": 1.26851336514039, "complete-iteration": 0.5265357027348784, "set_robot_commands": 0.006569360949329494, "deviation-center-line": 0.4048269797221258, "driven_lanedir_consec": 0.9675899633361036, "sim_compute_sim_state": 0.06080413110477408, "sim_compute_performance-ego": 0.006248776445683744, "sim_compute_robot_state-ego": 0.01113330949213087, "sim_compute_robot_state-npc0": 0.010532094031265102, "sim_compute_robot_state-npc1": 0.010303964319917343, "sim_compute_robot_state-npc2": 0.010794597802702914, "sim_compute_robot_state-npc3": 0.010752535357917706, "sim_compute_robot_state-parked0": 0.01053642735038836}, "udem1-1-0-ego": {"driven_any": 0.7569474200774807, "get_ui_image": 0.0822609021113469, "step_physics": 0.1717672959352151, "survival_time": 1.950000000000001, "driven_lanedir": 0.7247457277625835, "get_state_dump": 0.035710615989489436, "sim_render-ego": 0.007252699289566431, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09517263143490522, "deviation-heading": 0.3421159523196871, "complete-iteration": 0.5099096542749649, "set_robot_commands": 0.00673982424613757, "deviation-center-line": 0.08507472167313151, "driven_lanedir_consec": 0.7247457277625835, "sim_compute_sim_state": 0.037523495845305614, "sim_compute_performance-ego": 0.0062231895251151845, "sim_compute_robot_state-ego": 0.011093775431315104, "sim_compute_robot_state-npc0": 0.011314123104780149, "sim_compute_robot_state-npc1": 0.011032336797469702, "sim_compute_robot_state-npc2": 0.011366666891635992, "sim_compute_robot_state-npc3": 0.01114493761307154, "sim_compute_robot_state-parked0": 0.011011618834275464}, "udem1-1-1-ego": {"driven_any": 0.7569474200774807, "get_ui_image": 0.08164719434884879, "step_physics": 0.17292173092181867, "survival_time": 1.950000000000001, "driven_lanedir": 0.7247457277625835, "get_state_dump": 0.03617015251746544, "sim_render-ego": 0.0069889716612987025, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09908180970412034, "deviation-heading": 0.3421159523196871, "complete-iteration": 0.5101831387250851, "set_robot_commands": 0.006284670952038887, "deviation-center-line": 0.08507472167313151, "driven_lanedir_consec": 0.7247457277625835, "sim_compute_sim_state": 0.03804159164428711, "sim_compute_performance-ego": 0.0059692676250751205, "sim_compute_robot_state-ego": 0.010297047786223585, "sim_compute_robot_state-npc0": 0.010460370626205051, "sim_compute_robot_state-npc1": 0.010437133984688, "sim_compute_robot_state-npc2": 0.010523203091743665, "sim_compute_robot_state-npc3": 0.01050125024257562, "sim_compute_robot_state-parked0": 0.010551807207938952}, "udem1-2-0-ego": {"driven_any": 0.8205541101048129, "get_ui_image": 0.07926485213366422, "step_physics": 0.17949619076468729, "survival_time": 2.2, "driven_lanedir": 0.7844729301340911, "get_state_dump": 0.034813859245993874, "sim_render-ego": 0.006924916397441517, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09675499525937167, "deviation-heading": 0.5596263224679711, "complete-iteration": 0.5129703120751814, "set_robot_commands": 0.006500888954509388, "deviation-center-line": 0.17120309929653582, "driven_lanedir_consec": 0.7844729301340911, "sim_compute_sim_state": 0.040247792547399346, "sim_compute_performance-ego": 0.005904381925409491, "sim_compute_robot_state-ego": 0.01062431660565463, "sim_compute_robot_state-npc0": 0.010356019843708384, "sim_compute_robot_state-npc1": 0.010216956788843328, "sim_compute_robot_state-npc2": 0.01054657047445124, "sim_compute_robot_state-npc3": 0.010596275329589844, "sim_compute_robot_state-parked0": 0.010433868928389116}, "udem1-2-1-ego": {"driven_any": 0.8205541101048129, "get_ui_image": 0.08374227718873457, "step_physics": 0.177865516055714, "survival_time": 2.2, "driven_lanedir": 0.7844729301340911, "get_state_dump": 0.036652749234979805, "sim_render-ego": 0.007227111946452747, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09795926917682994, "deviation-heading": 0.5596263224679711, "complete-iteration": 0.5253666260025718, "set_robot_commands": 0.0078664476221258, "deviation-center-line": 0.17120309929653582, "driven_lanedir_consec": 0.7844729301340911, "sim_compute_sim_state": 0.03876731070605191, "sim_compute_performance-ego": 0.006487960165197199, "sim_compute_robot_state-ego": 0.01149264790795066, "sim_compute_robot_state-npc0": 0.011539144949479536, "sim_compute_robot_state-npc1": 0.011128604412078856, "sim_compute_robot_state-npc2": 0.011420824310996317, "sim_compute_robot_state-npc3": 0.011394430290568958, "sim_compute_robot_state-parked0": 0.01151418685913086}, "udem1-3-0-ego": {"driven_any": 0.7646727317791558, "get_ui_image": 0.0827515347059383, "step_physics": 0.2002200913983722, "survival_time": 2.1500000000000004, "driven_lanedir": 0.7152296955398382, "get_state_dump": 0.03636594151341638, "sim_render-ego": 0.007612522258314975, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10133806494779364, "deviation-heading": 0.5474969853197219, "complete-iteration": 0.5564388341681902, "set_robot_commands": 0.00762372238691463, "deviation-center-line": 0.0783843721277266, "driven_lanedir_consec": 0.7077414410766678, "sim_compute_sim_state": 0.045465508172678394, "sim_compute_performance-ego": 0.00645989595457565, "sim_compute_robot_state-ego": 0.011745990708816883, "sim_compute_robot_state-npc0": 0.01118990986846214, "sim_compute_robot_state-npc1": 0.011309041533359262, "sim_compute_robot_state-npc2": 0.010934330696283384, "sim_compute_robot_state-npc3": 0.01153425283210222, "sim_compute_robot_state-parked0": 0.0115727657495543}, "udem1-3-1-ego": {"driven_any": 0.7646727317791558, "get_ui_image": 0.08060623878656431, "step_physics": 0.20005966896234556, "survival_time": 2.1500000000000004, "driven_lanedir": 0.7152296955398382, "get_state_dump": 0.03708788406017215, "sim_render-ego": 0.007745227148366529, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09604212295177372, "deviation-heading": 0.5474969853197219, "complete-iteration": 0.5508293273837067, "set_robot_commands": 0.007311915242394736, "deviation-center-line": 0.0783843721277266, "driven_lanedir_consec": 0.7077414410766678, "sim_compute_sim_state": 0.045336745506109194, "sim_compute_performance-ego": 0.006373000699420308, "sim_compute_robot_state-ego": 0.012177145758340524, "sim_compute_robot_state-npc0": 0.011780045753301577, "sim_compute_robot_state-npc1": 0.011704999347065773, "sim_compute_robot_state-npc2": 0.01139039771501408, "sim_compute_robot_state-npc3": 0.01160749723744947, "sim_compute_robot_state-parked0": 0.011291675789411678}, "udem1-4-0-ego": {"driven_any": 0.7407252756937139, "get_ui_image": 0.07993345156959865, "step_physics": 0.16360008198281992, "survival_time": 2.3, "driven_lanedir": 0.7152764550124661, "get_state_dump": 0.03604578453561534, "sim_render-ego": 0.007660684378250786, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0984647222187208, "deviation-heading": 0.5644558289587853, "complete-iteration": 0.5122189677279928, "set_robot_commands": 0.007727032122404679, "deviation-center-line": 0.164466466956954, "driven_lanedir_consec": 0.7152764550124661, "sim_compute_sim_state": 0.03858073379682458, "sim_compute_performance-ego": 0.006652479586393937, "sim_compute_robot_state-ego": 0.011908380881599758, "sim_compute_robot_state-npc0": 0.012361464293106745, "sim_compute_robot_state-npc1": 0.012423867764680284, "sim_compute_robot_state-npc2": 0.012514586034028429, "sim_compute_robot_state-npc3": 0.012255938156791355, "sim_compute_robot_state-parked0": 0.011771186538364576}, "udem1-4-1-ego": {"driven_any": 0.7407252756937139, "get_ui_image": 0.07852614962536356, "step_physics": 0.16426184384719186, "survival_time": 2.3, "driven_lanedir": 0.7152764550124661, "get_state_dump": 0.03587277039237644, "sim_render-ego": 0.007498958836431088, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09707168392513107, "deviation-heading": 0.5644558289587853, "complete-iteration": 0.5022554397583008, "set_robot_commands": 0.007286787033081055, "deviation-center-line": 0.164466466956954, "driven_lanedir_consec": 0.7152764550124661, "sim_compute_sim_state": 0.03729169783384904, "sim_compute_performance-ego": 0.006460080976071565, "sim_compute_robot_state-ego": 0.011481710102247156, "sim_compute_robot_state-npc0": 0.011316797007685122, "sim_compute_robot_state-npc1": 0.011274970096090565, "sim_compute_robot_state-npc2": 0.010994724605394446, "sim_compute_robot_state-npc3": 0.011242534803307575, "sim_compute_robot_state-parked0": 0.011360531267912493}}
set_robot_commands_max0.0078664476221258
set_robot_commands_mean0.007048472393622303
set_robot_commands_median0.007013305639609313
set_robot_commands_min0.006284670952038887
sim_compute_performance-ego_max0.006652479586393937
sim_compute_performance-ego_mean0.006281975503467133
sim_compute_performance-ego_median0.006310888572552026
sim_compute_performance-ego_min0.005904381925409491
sim_compute_robot_state-ego_max0.012177145758340524
sim_compute_robot_state-ego_mean0.011209187272357016
sim_compute_robot_state-ego_median0.011307509797189011
sim_compute_robot_state-ego_min0.010137548049290976
sim_compute_robot_state-npc0_max0.012361464293106745
sim_compute_robot_state-npc0_mean0.01120144161497976
sim_compute_robot_state-npc0_median0.011252016486621145
sim_compute_robot_state-npc0_min0.010356019843708384
sim_compute_robot_state-npc1_max0.012423867764680284
sim_compute_robot_state-npc1_mean0.011073306786823892
sim_compute_robot_state-npc1_median0.01108047060477428
sim_compute_robot_state-npc1_min0.010216956788843328
sim_compute_robot_state-npc2_max0.012514586034028429
sim_compute_robot_state-npc2_mean0.01112245525799938
sim_compute_robot_state-npc2_median0.010964527650838916
sim_compute_robot_state-npc2_min0.010523203091743665
sim_compute_robot_state-npc3_max0.012255938156791355
sim_compute_robot_state-npc3_mean0.011201854298809962
sim_compute_robot_state-npc3_median0.01119373620818956
sim_compute_robot_state-npc3_min0.01050125024257562
sim_compute_robot_state-parked0_max0.011771186538364576
sim_compute_robot_state-parked0_mean0.01109345722497819
sim_compute_robot_state-parked0_median0.011151647311843572
sim_compute_robot_state-parked0_min0.010433868928389116
sim_compute_sim_state_max0.06080413110477408
sim_compute_sim_state_mean0.04151864243243071
sim_compute_sim_state_median0.03867402225143825
sim_compute_sim_state_min0.033127417167027794
sim_render-ego_max0.007745227148366529
sim_render-ego_mean0.007405493557185649
sim_render-ego_median0.007473712809574224
sim_render-ego_min0.006924916397441517
simulation-passed1
step_physics_max0.20318167408307392
step_physics_mean0.18022892624774847
step_physics_median0.17539362348876633
step_physics_min0.16360008198281992
survival_time_max4.849999999999991
survival_time_mean2.3249999999999993
survival_time_min1.2000000000000004

Highlights

33258

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

udem1-1-0

udem1-1-1

udem1-2-0

udem1-2-1

udem1-3-0

udem1-3-1

udem1-4-0

udem1-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.