Duckietown Challenges Home Challenges Submissions

Job 42325

Job ID42325
submission11418
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFV-sim-validation
stepLFVv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatormont02-abacdf59f1e2-1
date started
date completed
duration0:14:53
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5870816898321993
survival_time_median2.7499999999999982
deviation-center-line_median0.10397744183092504
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.08784810846502131
agent_compute-ego_mean0.056965727390664994
agent_compute-ego_median0.04699611710779594
agent_compute-ego_min0.046022566882046784
agent_compute-npc0_max0.05856549660364787
agent_compute-npc0_mean0.05204936517007423
agent_compute-npc0_median0.050632047653198245
agent_compute-npc0_min0.04836786877025257
agent_compute-npc1_max0.052945002642544835
agent_compute-npc1_mean0.05077525619304542
agent_compute-npc1_median0.050204088976888946
agent_compute-npc1_min0.04974784417585893
agent_compute-npc2_max0.05933073838551839
agent_compute-npc2_mean0.05245708490862991
agent_compute-npc2_median0.05110578753731468
agent_compute-npc2_min0.048286026174371895
agent_compute-npc3_max0.059727248350779215
agent_compute-npc3_mean0.05283052489613042
agent_compute-npc3_median0.05112251151691784
agent_compute-npc3_min0.049349828199906784
complete-iteration_max1.2207909974184905
complete-iteration_mean1.1690659834038126
complete-iteration_median1.179566727334803
complete-iteration_min1.096339481527155
deviation-center-line_max1.0185806999800069
deviation-center-line_mean0.3214531159021442
deviation-center-line_min0.05927687996671987
deviation-heading_max4.936350402712969
deviation-heading_mean1.4137293363652894
deviation-heading_median0.25143641728740596
deviation-heading_min0.2156941081733766
driven_any_max3.5732699916786665
driven_any_mean1.335590821719742
driven_any_median0.5896984558428038
driven_any_min0.5896963835146933
driven_lanedir_consec_max3.1013093436038215
driven_lanedir_consec_mean1.2153180859137571
driven_lanedir_consec_min0.5857996203868086
driven_lanedir_max3.1013093436038215
driven_lanedir_mean1.2153180859137571
driven_lanedir_median0.5870816898321993
driven_lanedir_min0.5857996203868086
get_duckie_state_max4.113804210316051e-06
get_duckie_state_mean4.045547861041445e-06
get_duckie_state_median4.087831034804835e-06
get_duckie_state_min3.892725164240057e-06
get_robot_state_max0.04924798011779785
get_robot_state_mean0.04877597575837915
get_robot_state_median0.04898713166063482
get_robot_state_min0.04788165959444913
get_state_dump_max0.02819959004720052
get_state_dump_mean0.02793183536240549
get_state_dump_median0.027899594740434127
get_state_dump_min0.02772856192155318
get_ui_image_max0.06772926503961736
get_ui_image_mean0.06533846257310924
get_ui_image_median0.06542076952529677
get_ui_image_min0.06278304620222612
in-drivable-lane_max0.7499999999999973
in-drivable-lane_mean0.18749999999999933
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.5896963835146933, "get_ui_image": 0.06552103215997869, "step_physics": 0.5981568119742654, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5857996203868086, "get_state_dump": 0.02772856192155318, "sim_render-ego": 0.006361610239202326, "get_robot_state": 0.04788165959444913, "sim_render-npc0": 0.006718202070756392, "sim_render-npc1": 0.006569949063387784, "sim_render-npc2": 0.006584665992043235, "sim_render-npc3": 0.0067005157470703125, "get_duckie_state": 4.113804210316051e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.08784810846502131, "deviation-heading": 0.26536263531910154, "agent_compute-npc0": 0.05232174613259055, "agent_compute-npc1": 0.052945002642544835, "agent_compute-npc2": 0.05180701342496005, "agent_compute-npc3": 0.052679040215232155, "complete-iteration": 1.1768348086964, "set_robot_commands": 0.004872122677889737, "deviation-center-line": 0.05927687996671987, "driven_lanedir_consec": 0.5857996203868086, "sim_compute_sim_state": 0.06016781980341131, "sim_compute_performance-ego": 0.004272317886352539, "sim_compute_performance-npc0": 0.0046107552268288355, "sim_compute_performance-npc1": 0.004354559291492809, "sim_compute_performance-npc2": 0.004375912926413796, "sim_compute_performance-npc3": 0.004474778608842329}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.5896983387785615, "get_ui_image": 0.06772926503961736, "step_physics": 0.6815957979722457, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5863468527741897, "get_state_dump": 0.02803087667985396, "sim_render-ego": 0.006627173857255415, "get_robot_state": 0.04878226627003063, "sim_render-npc0": 0.00679067698392001, "sim_render-npc1": 0.006906895204023882, "sim_render-npc2": 0.007357471639459784, "sim_render-npc3": 0.006776311180808328, "get_duckie_state": 4.113804210316051e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.047500259226018735, "deviation-heading": 0.23751019925571035, "agent_compute-npc0": 0.04836786877025257, "agent_compute-npc1": 0.04974784417585893, "agent_compute-npc2": 0.0504045616496693, "agent_compute-npc3": 0.04956598281860351, "complete-iteration": 1.2207909974184905, "set_robot_commands": 0.004877372221513228, "deviation-center-line": 0.06546560545597034, "driven_lanedir_consec": 0.5863468527741897, "sim_compute_sim_state": 0.06681174798445268, "sim_compute_performance-ego": 0.004411016811024059, "sim_compute_performance-npc0": 0.004601292176680131, "sim_compute_performance-npc1": 0.004500735889781605, "sim_compute_performance-npc2": 0.004468961195512252, "sim_compute_performance-npc3": 0.00460505485534668}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.5896985729070461, "get_ui_image": 0.06278304620222612, "step_physics": 0.5686044779690829, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5878165268902089, "get_state_dump": 0.027768312801014293, "sim_render-ego": 0.006515884399414062, "get_robot_state": 0.04924798011779785, "sim_render-npc0": 0.006811865893277255, "sim_render-npc1": 0.007510380311445756, "sim_render-npc2": 0.006503152847290039, "sim_render-npc3": 0.006629887494173917, "get_duckie_state": 3.892725164240057e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.046022566882046784, "deviation-heading": 0.2156941081733766, "agent_compute-npc0": 0.04894234917380593, "agent_compute-npc1": 0.04993417479775169, "agent_compute-npc2": 0.048286026174371895, "agent_compute-npc3": 0.049349828199906784, "complete-iteration": 1.096339481527155, "set_robot_commands": 0.004978331652554599, "deviation-center-line": 0.14248927820587973, "driven_lanedir_consec": 0.5878165268902089, "sim_compute_sim_state": 0.06320499940352006, "sim_compute_performance-ego": 0.004594070261174982, "sim_compute_performance-npc0": 0.004788918928666549, "sim_compute_performance-npc1": 0.004543811624700373, "sim_compute_performance-npc2": 0.004553274674849076, "sim_compute_performance-npc3": 0.004551653428511186}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.5732699916786665, "get_ui_image": 0.06532050689061483, "step_physics": 0.6053287180264791, "survival_time": 14.950000000000076, "driven_lanedir": 3.1013093436038215, "get_state_dump": 0.02819959004720052, "sim_render-ego": 0.006542793114980062, "get_robot_state": 0.049191997051239014, "sim_render-npc0": 0.006900126934051514, "sim_render-npc1": 0.0068335167566935225, "sim_render-npc2": 0.006709605852762858, "sim_render-npc3": 0.006677829424540202, "get_duckie_state": 4.0618578592936195e-06, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.04649197498957316, "deviation-heading": 4.936350402712969, "agent_compute-npc0": 0.05856549660364787, "agent_compute-npc1": 0.0504740031560262, "agent_compute-npc2": 0.05933073838551839, "agent_compute-npc3": 0.059727248350779215, "complete-iteration": 1.1822986459732057, "set_robot_commands": 0.004862337112426758, "deviation-center-line": 1.0185806999800069, "driven_lanedir_consec": 3.1013093436038215, "sim_compute_sim_state": 0.07849232276280721, "sim_compute_performance-ego": 0.004437506993611654, "sim_compute_performance-npc0": 0.004517165025075277, "sim_compute_performance-npc1": 0.004619584878285726, "sim_compute_performance-npc2": 0.0044521967569986975, "sim_compute_performance-npc3": 0.004401241938273112}}
set_robot_commands_max0.004978331652554599
set_robot_commands_mean0.004897540916096081
set_robot_commands_median0.004874747449701483
set_robot_commands_min0.004862337112426758
sim_compute_performance-ego_max0.004594070261174982
sim_compute_performance-ego_mean0.004428727988040809
sim_compute_performance-ego_median0.004424261902317856
sim_compute_performance-ego_min0.004272317886352539
sim_compute_performance-npc0_max0.004788918928666549
sim_compute_performance-npc0_mean0.004629532839312698
sim_compute_performance-npc0_median0.004606023701754483
sim_compute_performance-npc0_min0.004517165025075277
sim_compute_performance-npc1_max0.004619584878285726
sim_compute_performance-npc1_mean0.004504672921065128
sim_compute_performance-npc1_median0.004522273757240989
sim_compute_performance-npc1_min0.004354559291492809
sim_compute_performance-npc2_max0.004553274674849076
sim_compute_performance-npc2_mean0.0044625863884434555
sim_compute_performance-npc2_median0.004460578976255475
sim_compute_performance-npc2_min0.004375912926413796
sim_compute_performance-npc3_max0.00460505485534668
sim_compute_performance-npc3_mean0.004508182207743327
sim_compute_performance-npc3_median0.004513216018676758
sim_compute_performance-npc3_min0.004401241938273112
sim_compute_sim_state_max0.07849232276280721
sim_compute_sim_state_mean0.06716922248854781
sim_compute_sim_state_median0.06500837369398638
sim_compute_sim_state_min0.06016781980341131
sim_render-ego_max0.006627173857255415
sim_render-ego_mean0.006511865402712967
sim_render-ego_median0.006529338757197062
sim_render-ego_min0.006361610239202326
sim_render-npc0_max0.006900126934051514
sim_render-npc0_mean0.006805217970501293
sim_render-npc0_median0.0068012714385986325
sim_render-npc0_min0.006718202070756392
sim_render-npc1_max0.007510380311445756
sim_render-npc1_mean0.006955185333887736
sim_render-npc1_median0.006870205980358702
sim_render-npc1_min0.006569949063387784
sim_render-npc2_max0.007357471639459784
sim_render-npc2_mean0.006788724082888979
sim_render-npc2_median0.0066471359224030465
sim_render-npc2_min0.006503152847290039
sim_render-npc3_max0.006776311180808328
sim_render-npc3_mean0.00669613596164819
sim_render-npc3_median0.006689172585805257
sim_render-npc3_min0.006629887494173917
simulation-passed1
step_physics_max0.6815957979722457
step_physics_mean0.6134214514855183
step_physics_median0.6017427650003723
step_physics_min0.5686044779690829
survival_time_max14.950000000000076
survival_time_mean5.8000000000000185
survival_time_min2.7499999999999982

Highlights

42325

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-sc0-0

ETHZ_autolab_technical_track-sc1-0

ETHZ_autolab_technical_track-sc2-0

ETHZ_autolab_technical_track-sc3-0

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.