Duckietown Challenges Home Challenges Submissions

Job 35203

Job ID35203
submission6751
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg02-99e0f784cfda-1
date started
date completed
duration0:19:28
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7276233696897767
survival_time_median5.824999999999987
deviation-center-line_median0.12489755072162814
in-drivable-lane_median3.349999999999988


other stats
agent_compute-ego_max0.10522998765457509
agent_compute-ego_mean0.10108703943998346
agent_compute-ego_median0.10091433837087688
agent_compute-ego_min0.09820165077845255
complete-iteration_max0.5209839288578477
complete-iteration_mean0.4859831250849887
complete-iteration_median0.48025743590909886
complete-iteration_min0.4597310727359327
deviation-center-line_max0.5057022989281345
deviation-center-line_mean0.22595497231929773
deviation-center-line_min0.08724815935068318
deviation-heading_max2.7246351473151647
deviation-heading_mean1.1066689960193463
deviation-heading_median0.6110975704169662
deviation-heading_min0.4605211539628332
driven_any_max5.0657010516335745
driven_any_mean2.189772907407561
driven_any_median1.8478651840408569
driven_any_min0.763243625907263
driven_lanedir_consec_max2.5801328335329337
driven_lanedir_consec_mean1.100790914789711
driven_lanedir_consec_min0.629900405267442
driven_lanedir_max2.5801328335329337
driven_lanedir_mean1.1127166511925533
driven_lanedir_median0.7396362638306058
driven_lanedir_min0.672004809164362
get_state_dump_max0.03809366747736931
get_state_dump_mean0.03747599638559652
get_state_dump_median0.03754013434700344
get_state_dump_min0.036931400650118025
get_ui_image_max0.07864517943803655
get_ui_image_mean0.07749335976288121
get_ui_image_median0.07778992981690427
get_ui_image_min0.0759088261727175
in-drivable-lane_max6.800000000000067
in-drivable-lane_mean3.165000000000007
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego": {"driven_any": 0.9595366128235012, "get_ui_image": 0.07771376147866249, "step_physics": 0.16697901487350464, "survival_time": 3.1999999999999966, "driven_lanedir": 0.7314658607180697, "get_state_dump": 0.03809366747736931, "sim_render-ego": 0.00985484942793846, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.10255339741706848, "deviation-heading": 0.9078494231193748, "complete-iteration": 0.504855964332819, "set_robot_commands": 0.008078087121248245, "deviation-center-line": 0.2472221126297706, "driven_lanedir_consec": 0.629900405267442, "sim_compute_sim_state": 0.02140624076128006, "sim_compute_performance-ego": 0.006798870861530304, "sim_compute_robot_state-ego": 0.012625515460968018, "sim_compute_robot_state-npc0": 0.012087859213352203, "sim_compute_robot_state-npc1": 0.01192237064242363, "sim_compute_robot_state-npc2": 0.012384932488203049, "sim_compute_robot_state-npc3": 0.012041185051202774, "sim_compute_robot_state-parked0": 0.011980738490819933}, "udem1-0-1-ego": {"driven_any": 1.8888423700070112, "get_ui_image": 0.0759088261727175, "step_physics": 0.14775365700750995, "survival_time": 8.14999999999998, "driven_lanedir": 0.9667626035934584, "get_state_dump": 0.036931400650118025, "sim_render-ego": 0.00856969985493853, "in-drivable-lane": 3.2499999999999902, "agent_compute-ego": 0.10021875679858624, "deviation-heading": 1.4766377491797078, "complete-iteration": 0.4597310727359327, "set_robot_commands": 0.006636893091026259, "deviation-center-line": 0.3600439908957817, "driven_lanedir_consec": 0.9632399784759692, "sim_compute_sim_state": 0.018159869258389152, "sim_compute_performance-ego": 0.005646761209686841, "sim_compute_robot_state-ego": 0.00984218515501432, "sim_compute_robot_state-npc0": 0.010284456007319726, "sim_compute_robot_state-npc1": 0.009897100413503822, "sim_compute_robot_state-npc2": 0.009733204461314196, "sim_compute_robot_state-npc3": 0.00984769949883771, "sim_compute_robot_state-parked0": 0.009985657557388025}, "udem1-1-0-ego": {"driven_any": 1.8235519162485037, "get_ui_image": 0.07842999999806033, "step_physics": 0.1489655628042706, "survival_time": 5.899999999999987, "driven_lanedir": 0.7478066669431419, "get_state_dump": 0.037364141415741486, "sim_render-ego": 0.009186221381365245, "in-drivable-lane": 3.349999999999988, "agent_compute-ego": 0.10216661226951468, "deviation-heading": 0.6110975704169662, "complete-iteration": 0.4774020445548882, "set_robot_commands": 0.007351727808936168, "deviation-center-line": 0.10829380083326672, "driven_lanedir_consec": 0.7478066669431419, "sim_compute_sim_state": 0.02030254622637215, "sim_compute_performance-ego": 0.0063557948096323825, "sim_compute_robot_state-ego": 0.01140904426574707, "sim_compute_robot_state-npc0": 0.011391027499053435, "sim_compute_robot_state-npc1": 0.011098825325400142, "sim_compute_robot_state-npc2": 0.010885420492139914, "sim_compute_robot_state-npc3": 0.010946714271933344, "sim_compute_robot_state-parked0": 0.01121756383928202}, "udem1-1-1-ego": {"driven_any": 1.8235519162485037, "get_ui_image": 0.07788271014973269, "step_physics": 0.1488412194332834, "survival_time": 5.899999999999987, "driven_lanedir": 0.7478066669431419, "get_state_dump": 0.03718087026628397, "sim_render-ego": 0.009523167448528744, "in-drivable-lane": 3.349999999999988, "agent_compute-ego": 0.10059995166325972, "deviation-heading": 0.6110975704169662, "complete-iteration": 0.47841385259466657, "set_robot_commands": 0.00764680312851728, "deviation-center-line": 0.10829380083326672, "driven_lanedir_consec": 0.7478066669431419, "sim_compute_sim_state": 0.020832364842043084, "sim_compute_performance-ego": 0.006416128853620109, "sim_compute_robot_state-ego": 0.011573846057309942, "sim_compute_robot_state-npc0": 0.01187564356852386, "sim_compute_robot_state-npc1": 0.011496733810942052, "sim_compute_robot_state-npc2": 0.011197540719630354, "sim_compute_robot_state-npc3": 0.011586237761933923, "sim_compute_robot_state-parked0": 0.011429279537524208}, "udem1-2-0-ego": {"driven_any": 1.87217845183321, "get_ui_image": 0.07786609815514606, "step_physics": 0.15049221411995264, "survival_time": 5.749999999999988, "driven_lanedir": 0.672004809164362, "get_state_dump": 0.03772261661031972, "sim_render-ego": 0.008968237172002378, "in-drivable-lane": 3.7999999999999865, "agent_compute-ego": 0.10155736467112664, "deviation-heading": 0.4605211539628332, "complete-iteration": 0.4683275948400083, "set_robot_commands": 0.007034127608589504, "deviation-center-line": 0.12489755072162814, "driven_lanedir_consec": 0.672004809164362, "sim_compute_sim_state": 0.017643393640932828, "sim_compute_performance-ego": 0.005813886808312458, "sim_compute_robot_state-ego": 0.009898608663807745, "sim_compute_robot_state-npc0": 0.010358372978542162, "sim_compute_robot_state-npc1": 0.010147507294364595, "sim_compute_robot_state-npc2": 0.009949225964753524, "sim_compute_robot_state-npc3": 0.010264991677325704, "sim_compute_robot_state-parked0": 0.010270502256310503}, "udem1-2-1-ego": {"driven_any": 1.87217845183321, "get_ui_image": 0.07722729392673658, "step_physics": 0.14794486294622006, "survival_time": 5.749999999999988, "driven_lanedir": 0.672004809164362, "get_state_dump": 0.037532136751257855, "sim_render-ego": 0.00898465280947478, "in-drivable-lane": 3.7999999999999865, "agent_compute-ego": 0.09947377495143724, "deviation-heading": 0.4605211539628332, "complete-iteration": 0.4623377012169879, "set_robot_commands": 0.006879613710486371, "deviation-center-line": 0.12489755072162814, "driven_lanedir_consec": 0.672004809164362, "sim_compute_sim_state": 0.017625684323518173, "sim_compute_performance-ego": 0.005823446356731913, "sim_compute_robot_state-ego": 0.009879427370817763, "sim_compute_robot_state-npc0": 0.01040769867275072, "sim_compute_robot_state-npc1": 0.00993093614992888, "sim_compute_robot_state-npc2": 0.00996050627335258, "sim_compute_robot_state-npc3": 0.010204835560010828, "sim_compute_robot_state-parked0": 0.010128243073173192}, "udem1-3-0-ego": {"driven_any": 0.763243625907263, "get_ui_image": 0.07864517943803655, "step_physics": 0.19035433059514956, "survival_time": 2.1500000000000004, "driven_lanedir": 0.7145247141665643, "get_state_dump": 0.03767256404078284, "sim_render-ego": 0.008674721385157385, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10522998765457509, "deviation-heading": 0.5448475222522263, "complete-iteration": 0.5209839288578477, "set_robot_commands": 0.006724390872689181, "deviation-center-line": 0.08724815935068318, "driven_lanedir_consec": 0.7074400724364116, "sim_compute_sim_state": 0.026793856953465665, "sim_compute_performance-ego": 0.005992196327032045, "sim_compute_robot_state-ego": 0.009655608687289926, "sim_compute_robot_state-npc0": 0.01069885630940282, "sim_compute_robot_state-npc1": 0.010109391323355742, "sim_compute_robot_state-npc2": 0.009792588477910952, "sim_compute_robot_state-npc3": 0.010346562363380609, "sim_compute_robot_state-parked0": 0.009957064029782315}, "udem1-3-1-ego": {"driven_any": 0.763243625907263, "get_ui_image": 0.07792233311852743, "step_physics": 0.1920902230018793, "survival_time": 2.1500000000000004, "driven_lanedir": 0.7145247141665643, "get_state_dump": 0.037147594052691794, "sim_render-ego": 0.008626422216725904, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10122872507849404, "deviation-heading": 0.5448475222522263, "complete-iteration": 0.5165677902310394, "set_robot_commands": 0.007087846134984216, "deviation-center-line": 0.08724815935068318, "driven_lanedir_consec": 0.7074400724364116, "sim_compute_sim_state": 0.02496138838834541, "sim_compute_performance-ego": 0.006018466727678166, "sim_compute_robot_state-ego": 0.01017614852550418, "sim_compute_robot_state-npc0": 0.01050396298253259, "sim_compute_robot_state-npc1": 0.010178283203479856, "sim_compute_robot_state-npc2": 0.010225318198980288, "sim_compute_robot_state-npc3": 0.00990115764529206, "sim_compute_robot_state-parked0": 0.010167277136514353}, "udem1-4-0-ego": {"driven_any": 5.0657010516335745, "get_ui_image": 0.07623278538386027, "step_physics": 0.16203230778376262, "survival_time": 14.950000000000076, "driven_lanedir": 2.5801328335329337, "get_state_dump": 0.03754813194274902, "sim_render-ego": 0.009368844827016196, "in-drivable-lane": 6.800000000000067, "agent_compute-ego": 0.09820165077845255, "deviation-heading": 2.7246351473151647, "complete-iteration": 0.4891102822621663, "set_robot_commands": 0.007859876155853271, "deviation-center-line": 0.5057022989281345, "driven_lanedir_consec": 2.5801328335329337, "sim_compute_sim_state": 0.02259632428487142, "sim_compute_performance-ego": 0.006268165111541748, "sim_compute_robot_state-ego": 0.01157222270965576, "sim_compute_robot_state-npc0": 0.011484727859497073, "sim_compute_robot_state-npc1": 0.011316508452097574, "sim_compute_robot_state-npc2": 0.011344029108683268, "sim_compute_robot_state-npc3": 0.01148971160252889, "sim_compute_robot_state-parked0": 0.011463540395100912}, "udem1-4-1-ego": {"driven_any": 5.0657010516335745, "get_ui_image": 0.07710460980733236, "step_physics": 0.1625590189297994, "survival_time": 14.950000000000076, "driven_lanedir": 2.5801328335329337, "get_state_dump": 0.03756684064865112, "sim_render-ego": 0.008855048815409343, "in-drivable-lane": 6.800000000000067, "agent_compute-ego": 0.09964017311731976, "deviation-heading": 2.7246351473151647, "complete-iteration": 0.4821010192235311, "set_robot_commands": 0.006964553197224935, "deviation-center-line": 0.5057022989281345, "driven_lanedir_consec": 2.5801328335329337, "sim_compute_sim_state": 0.022227248350779216, "sim_compute_performance-ego": 0.005866312185923259, "sim_compute_robot_state-ego": 0.009826517899831137, "sim_compute_robot_state-npc0": 0.01051290194193522, "sim_compute_robot_state-npc1": 0.010093840758005778, "sim_compute_robot_state-npc2": 0.010035471121470131, "sim_compute_robot_state-npc3": 0.010411054293314617, "sim_compute_robot_state-parked0": 0.010109368165334066}}
set_robot_commands_max0.008078087121248245
set_robot_commands_mean0.007226391882955542
set_robot_commands_median0.00706098687178686
set_robot_commands_min0.006636893091026259
sim_compute_performance-ego_max0.006798870861530304
sim_compute_performance-ego_mean0.006100002925168923
sim_compute_performance-ego_median0.006005331527355105
sim_compute_performance-ego_min0.005646761209686841
sim_compute_robot_state-ego_max0.012625515460968018
sim_compute_robot_state-ego_mean0.010645912479594583
sim_compute_robot_state-ego_median0.010037378594655965
sim_compute_robot_state-ego_min0.009655608687289926
sim_compute_robot_state-npc0_max0.012087859213352203
sim_compute_robot_state-npc0_mean0.01096055070329098
sim_compute_robot_state-npc0_median0.01060587912566902
sim_compute_robot_state-npc0_min0.010284456007319726
sim_compute_robot_state-npc1_max0.01192237064242363
sim_compute_robot_state-npc1_mean0.010619149737350208
sim_compute_robot_state-npc1_median0.010162895248922226
sim_compute_robot_state-npc1_min0.009897100413503822
sim_compute_robot_state-npc2_max0.012384932488203049
sim_compute_robot_state-npc2_mean0.010550823730643824
sim_compute_robot_state-npc2_median0.01013039466022521
sim_compute_robot_state-npc2_min0.009733204461314196
sim_compute_robot_state-npc3_max0.012041185051202774
sim_compute_robot_state-npc3_mean0.010704014972576044
sim_compute_robot_state-npc3_median0.010378808328347613
sim_compute_robot_state-npc3_min0.00984769949883771
sim_compute_robot_state-parked0_max0.011980738490819933
sim_compute_robot_state-parked0_mean0.01067092344812295
sim_compute_robot_state-parked0_median0.01021888969641243
sim_compute_robot_state-parked0_min0.009957064029782315
sim_compute_sim_state_max0.026793856953465665
sim_compute_sim_state_mean0.021254891702999712
sim_compute_sim_state_median0.02111930280166157
sim_compute_sim_state_min0.017625684323518173
sim_render-ego_max0.00985484942793846
sim_render-ego_mean0.009061186533855696
sim_render-ego_median0.008976444990738578
sim_render-ego_min0.00856969985493853
simulation-passed1
step_physics_max0.1920902230018793
step_physics_mean0.16180124114953323
step_physics_median0.15626226095185763
step_physics_min0.14775365700750995
survival_time_max14.950000000000076
survival_time_mean6.885000000000008
survival_time_min2.1500000000000004

Highlights

35203

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

udem1-1-0

udem1-1-1

udem1-2-0

udem1-2-1

udem1-3-0

udem1-3-1

udem1-4-0

udem1-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.