Duckietown Challenges Home Challenges Submissions

Job 34512

Job ID34512
submission6751
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg04-09ab9b94fef9-1
date started
date completed
duration0:22:18
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7497803127875574
survival_time_median5.949999999999987
deviation-center-line_median0.12711321302406356
in-drivable-lane_median3.2999999999999883


other stats
agent_compute-ego_max0.10585855883221294
agent_compute-ego_mean0.10127033252808844
agent_compute-ego_median0.09998880637008532
agent_compute-ego_min0.09908540691949624
complete-iteration_max0.5621470462444217
complete-iteration_mean0.534209509375652
complete-iteration_median0.5279874714215597
complete-iteration_min0.511506487837935
deviation-center-line_max0.5255131802493351
deviation-center-line_mean0.23303738508923333
deviation-center-line_min0.07887283493597519
deviation-heading_max2.319842707139657
deviation-heading_mean1.0143123818935882
deviation-heading_median0.7465079781545213
deviation-heading_min0.434167871037006
driven_any_max5.199571201657802
driven_any_mean2.2093675283321232
driven_any_median1.8361710832851297
driven_any_min0.7639116041175411
driven_lanedir_consec_max2.7893084428726445
driven_lanedir_consec_mean1.1569820157910098
driven_lanedir_consec_min0.6549083175824881
driven_lanedir_max2.7893084428726445
driven_lanedir_mean1.158075455601572
driven_lanedir_median0.7497803127875574
driven_lanedir_min0.6549083175824881
get_state_dump_max0.03538267294565837
get_state_dump_mean0.03462233206153948
get_state_dump_median0.03455328941345215
get_state_dump_min0.03397420692443848
get_ui_image_max0.09706241637468338
get_ui_image_mean0.08779116153669528
get_ui_image_median0.08697778309144756
get_ui_image_min0.08424763361612955
in-drivable-lane_max6.750000000000074
in-drivable-lane_mean3.1100000000000088
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego": {"driven_any": 0.956979696314298, "get_ui_image": 0.08738262422623173, "step_physics": 0.2136216701999787, "survival_time": 3.099999999999997, "driven_lanedir": 0.777606952340061, "get_state_dump": 0.034306599247840144, "sim_render-ego": 0.00724561752811555, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.104239821434021, "deviation-heading": 0.8050683246345919, "complete-iteration": 0.5415078401565552, "set_robot_commands": 0.006923687073492234, "deviation-center-line": 0.22654592290567868, "driven_lanedir_consec": 0.777606952340061, "sim_compute_sim_state": 0.01944553082989108, "sim_compute_performance-ego": 0.005903597800962387, "sim_compute_robot_state-ego": 0.010662871022378244, "sim_compute_robot_state-npc0": 0.01052574957570722, "sim_compute_robot_state-npc1": 0.010598547997013217, "sim_compute_robot_state-npc2": 0.010351557885446856, "sim_compute_robot_state-npc3": 0.00996446224950975, "sim_compute_robot_state-parked0": 0.010044136355000158}, "udem1-0-1-ego": {"driven_any": 1.8650456423157291, "get_ui_image": 0.09706241637468338, "step_physics": 0.2132714435458183, "survival_time": 7.99999999999998, "driven_lanedir": 0.9785095486897132, "get_state_dump": 0.034250703454017636, "sim_render-ego": 0.007682026922702789, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.10473727732896804, "deviation-heading": 1.2685514345897493, "complete-iteration": 0.5518204808235169, "set_robot_commands": 0.00663880854845047, "deviation-center-line": 0.40487004697496487, "driven_lanedir_consec": 0.9676407418521166, "sim_compute_sim_state": 0.0200081005692482, "sim_compute_performance-ego": 0.005856576561927796, "sim_compute_robot_state-ego": 0.010428071022033691, "sim_compute_robot_state-npc0": 0.010263285040855408, "sim_compute_robot_state-npc1": 0.010344569385051728, "sim_compute_robot_state-npc2": 0.010309024155139923, "sim_compute_robot_state-npc3": 0.010310615599155424, "sim_compute_robot_state-parked0": 0.010338108241558074}, "udem1-1-0-ego": {"driven_any": 1.8229094105992936, "get_ui_image": 0.08865562629699707, "step_physics": 0.18935304450988769, "survival_time": 6.249999999999986, "driven_lanedir": 0.7497803127875574, "get_state_dump": 0.03397420692443848, "sim_render-ego": 0.007203922271728515, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.10003696250915528, "deviation-heading": 0.7465079781545213, "complete-iteration": 0.5128604488372803, "set_robot_commands": 0.006421276092529297, "deviation-center-line": 0.12711321302406356, "driven_lanedir_consec": 0.7497803127875574, "sim_compute_sim_state": 0.019712188720703124, "sim_compute_performance-ego": 0.005608308792114258, "sim_compute_robot_state-ego": 0.010724294662475584, "sim_compute_robot_state-npc0": 0.010218000411987303, "sim_compute_robot_state-npc1": 0.01013950538635254, "sim_compute_robot_state-npc2": 0.010067127227783202, "sim_compute_robot_state-npc3": 0.010256786346435547, "sim_compute_robot_state-parked0": 0.010196640014648437}, "udem1-1-1-ego": {"driven_any": 1.8229094105992936, "get_ui_image": 0.08944661140441895, "step_physics": 0.19715760803222657, "survival_time": 6.249999999999986, "driven_lanedir": 0.7497803127875574, "get_state_dump": 0.03400973892211914, "sim_render-ego": 0.0071050128936767576, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.10005249595642088, "deviation-heading": 0.7465079781545213, "complete-iteration": 0.521983850479126, "set_robot_commands": 0.006501358032226562, "deviation-center-line": 0.12711321302406356, "driven_lanedir_consec": 0.7497803127875574, "sim_compute_sim_state": 0.02078723907470703, "sim_compute_performance-ego": 0.005819442749023437, "sim_compute_robot_state-ego": 0.01017396354675293, "sim_compute_robot_state-npc0": 0.010061582565307618, "sim_compute_robot_state-npc1": 0.010003997802734374, "sim_compute_robot_state-npc2": 0.0103489990234375, "sim_compute_robot_state-npc3": 0.010216188430786134, "sim_compute_robot_state-parked0": 0.01000208282470703}, "udem1-2-0-ego": {"driven_any": 1.8494327559709656, "get_ui_image": 0.08690096424744193, "step_physics": 0.19800907320680872, "survival_time": 5.649999999999988, "driven_lanedir": 0.6549083175824881, "get_state_dump": 0.03497575025642868, "sim_render-ego": 0.00756567347366198, "in-drivable-lane": 3.7499999999999862, "agent_compute-ego": 0.09994065023101537, "deviation-heading": 0.434167871037006, "complete-iteration": 0.5235159165036362, "set_robot_commands": 0.0068056034830819186, "deviation-center-line": 0.11797971229647096, "driven_lanedir_consec": 0.6549083175824881, "sim_compute_sim_state": 0.01870581956036323, "sim_compute_performance-ego": 0.006077068041911167, "sim_compute_robot_state-ego": 0.011032697373786858, "sim_compute_robot_state-npc0": 0.010738794782520397, "sim_compute_robot_state-npc1": 0.010832617768144186, "sim_compute_robot_state-npc2": 0.010546924793614751, "sim_compute_robot_state-npc3": 0.01043886631990956, "sim_compute_robot_state-parked0": 0.01064051780025516}, "udem1-2-1-ego": {"driven_any": 1.8494327559709656, "get_ui_image": 0.0850081992360343, "step_physics": 0.18813168475058223, "survival_time": 5.649999999999988, "driven_lanedir": 0.6549083175824881, "get_state_dump": 0.03517049814747498, "sim_render-ego": 0.0076863238241820205, "in-drivable-lane": 3.7499999999999862, "agent_compute-ego": 0.09908540691949624, "deviation-heading": 0.434167871037006, "complete-iteration": 0.511506487837935, "set_robot_commands": 0.006830044552288224, "deviation-center-line": 0.11797971229647096, "driven_lanedir_consec": 0.6549083175824881, "sim_compute_sim_state": 0.018130045021529748, "sim_compute_performance-ego": 0.006167736728634455, "sim_compute_robot_state-ego": 0.010640074721479835, "sim_compute_robot_state-npc0": 0.011124921056021631, "sim_compute_robot_state-npc1": 0.010599476046266808, "sim_compute_robot_state-npc2": 0.01090279300655939, "sim_compute_robot_state-npc3": 0.010942929613906725, "sim_compute_robot_state-parked0": 0.010779967350242411}, "udem1-3-0-ego": {"driven_any": 0.7639116041175411, "get_ui_image": 0.08678222257037495, "step_physics": 0.22653240381285203, "survival_time": 2.1500000000000004, "driven_lanedir": 0.7183219542502832, "get_state_dump": 0.034362682076387624, "sim_render-ego": 0.00706457537274028, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10585855883221294, "deviation-heading": 0.5342334735245862, "complete-iteration": 0.5607780800309292, "set_robot_commands": 0.006094350371249887, "deviation-center-line": 0.07887283493597519, "driven_lanedir_consec": 0.7182891586162694, "sim_compute_sim_state": 0.028947203658347905, "sim_compute_performance-ego": 0.005964672842691111, "sim_compute_robot_state-ego": 0.00979491721752078, "sim_compute_robot_state-npc0": 0.010094520657561546, "sim_compute_robot_state-npc1": 0.00962147601815157, "sim_compute_robot_state-npc2": 0.00983388479365859, "sim_compute_robot_state-npc3": 0.010000123534091684, "sim_compute_robot_state-parked0": 0.009530389031698538}, "udem1-3-1-ego": {"driven_any": 0.7639116041175411, "get_ui_image": 0.0870546019354532, "step_physics": 0.23019805619882985, "survival_time": 2.1500000000000004, "driven_lanedir": 0.7183219542502832, "get_state_dump": 0.03474389675051667, "sim_render-ego": 0.007130539694497752, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09972120994745298, "deviation-heading": 0.5342334735245862, "complete-iteration": 0.5621470462444217, "set_robot_commands": 0.0068228133889131765, "deviation-center-line": 0.07887283493597519, "driven_lanedir_consec": 0.7182891586162694, "sim_compute_sim_state": 0.027701527573341548, "sim_compute_performance-ego": 0.005953079046205033, "sim_compute_robot_state-ego": 0.010752966237622638, "sim_compute_robot_state-npc0": 0.010370814523031546, "sim_compute_robot_state-npc1": 0.010256955789965253, "sim_compute_robot_state-npc2": 0.010106735451276912, "sim_compute_robot_state-npc3": 0.01040093843327012, "sim_compute_robot_state-parked0": 0.010623150093610896}, "udem1-4-0-ego": {"driven_any": 5.199571201657802, "get_ui_image": 0.08537071545918783, "step_physics": 0.19999024629592896, "survival_time": 14.950000000000076, "driven_lanedir": 2.7893084428726445, "get_state_dump": 0.03538267294565837, "sim_render-ego": 0.007548031012217204, "in-drivable-lane": 6.750000000000074, "agent_compute-ego": 0.09961113452911376, "deviation-heading": 2.319842707139657, "complete-iteration": 0.5291238284111023, "set_robot_commands": 0.006866732438405355, "deviation-center-line": 0.5255131802493351, "driven_lanedir_consec": 2.7893084428726445, "sim_compute_sim_state": 0.023571674823760987, "sim_compute_performance-ego": 0.006037093003590901, "sim_compute_robot_state-ego": 0.011033393541971845, "sim_compute_robot_state-npc0": 0.010656330585479736, "sim_compute_robot_state-npc1": 0.01051083246866862, "sim_compute_robot_state-npc2": 0.010796697934468589, "sim_compute_robot_state-npc3": 0.010697739124298096, "sim_compute_robot_state-parked0": 0.010742003917694093}, "udem1-4-1-ego": {"driven_any": 5.199571201657802, "get_ui_image": 0.08424763361612955, "step_physics": 0.20031636635462444, "survival_time": 14.950000000000076, "driven_lanedir": 2.7893084428726445, "get_state_dump": 0.0350465718905131, "sim_render-ego": 0.007507081031799316, "in-drivable-lane": 6.750000000000074, "agent_compute-ego": 0.09941980759302776, "deviation-heading": 2.319842707139657, "complete-iteration": 0.526851114432017, "set_robot_commands": 0.006819335619608561, "deviation-center-line": 0.5255131802493351, "driven_lanedir_consec": 2.7893084428726445, "sim_compute_sim_state": 0.023034522533416747, "sim_compute_performance-ego": 0.00598413864771525, "sim_compute_robot_state-ego": 0.010874931812286376, "sim_compute_robot_state-npc0": 0.010726211071014404, "sim_compute_robot_state-npc1": 0.010649202664693196, "sim_compute_robot_state-npc2": 0.010683972835540772, "sim_compute_robot_state-npc3": 0.01066025416056315, "sim_compute_robot_state-parked0": 0.010575096607208252}}
set_robot_commands_max0.006923687073492234
set_robot_commands_mean0.006672400960024567
set_robot_commands_median0.00681246955134524
set_robot_commands_min0.006094350371249887
sim_compute_performance-ego_max0.006167736728634455
sim_compute_performance-ego_mean0.005937171421477579
sim_compute_performance-ego_median0.0059588759444480725
sim_compute_performance-ego_min0.005608308792114258
sim_compute_robot_state-ego_max0.011033393541971845
sim_compute_robot_state-ego_mean0.010611818115830878
sim_compute_robot_state-ego_median0.010693582842426917
sim_compute_robot_state-ego_min0.00979491721752078
sim_compute_robot_state-npc0_max0.011124921056021631
sim_compute_robot_state-npc0_mean0.01047802102694868
sim_compute_robot_state-npc0_median0.010448282049369383
sim_compute_robot_state-npc0_min0.010061582565307618
sim_compute_robot_state-npc1_max0.010832617768144186
sim_compute_robot_state-npc1_mean0.01035571813270415
sim_compute_robot_state-npc1_median0.010427700926860172
sim_compute_robot_state-npc1_min0.00962147601815157
sim_compute_robot_state-npc2_max0.01090279300655939
sim_compute_robot_state-npc2_mean0.010394771710692648
sim_compute_robot_state-npc2_median0.010350278454442178
sim_compute_robot_state-npc2_min0.00983388479365859
sim_compute_robot_state-npc3_max0.010942929613906725
sim_compute_robot_state-npc3_mean0.01038889038119262
sim_compute_robot_state-npc3_median0.010355777016212774
sim_compute_robot_state-npc3_min0.00996446224950975
sim_compute_robot_state-parked0_max0.010779967350242411
sim_compute_robot_state-parked0_mean0.010347209223662304
sim_compute_robot_state-parked0_median0.010456602424383165
sim_compute_robot_state-parked0_min0.009530389031698538
sim_compute_sim_state_max0.028947203658347905
sim_compute_sim_state_mean0.02200438523653096
sim_compute_sim_state_median0.020397669821977615
sim_compute_sim_state_min0.018130045021529748
sim_render-ego_max0.0076863238241820205
sim_render-ego_mean0.007373880402532217
sim_render-ego_median0.007376349279957433
sim_render-ego_min0.00706457537274028
simulation-passed1
step_physics_max0.23019805619882985
step_physics_mean0.20565815969075377
step_physics_median0.2001533063252767
step_physics_min0.18813168475058223
survival_time_max14.950000000000076
survival_time_mean6.910000000000008
survival_time_min2.1500000000000004

Highlights

34512

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

udem1-1-0

udem1-1-1

udem1-2-0

udem1-2-1

udem1-3-0

udem1-3-1

udem1-4-0

udem1-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.