Duckietown Challenges Home Challenges Submissions

Job 34510

Job ID34510
submission6751
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg09-bc9a115e10b3-1
date started
date completed
duration0:25:30
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7497803127875574
survival_time_median6.249999999999986
deviation-center-line_median0.12711321302406356
in-drivable-lane_median3.5249999999999875


other stats
agent_compute-ego_max0.10942797323243808
agent_compute-ego_mean0.10510900523198552
agent_compute-ego_median0.1044247806016789
agent_compute-ego_min0.10268677949905396
complete-iteration_max0.5709540184338887
complete-iteration_mean0.5418544868585611
complete-iteration_median0.5328656633589471
complete-iteration_min0.5242484531402588
deviation-center-line_max0.5870897677808139
deviation-center-line_mean0.26909176957674685
deviation-center-line_min0.07887283493597519
deviation-heading_max2.332537486878259
deviation-heading_mean1.1670592981179548
deviation-heading_median0.7465079781545213
deviation-heading_min0.434167871037006
driven_any_max5.307481897221313
driven_any_mean2.644417748422825
driven_any_median1.8494327559709656
driven_any_min0.7639116041175411
driven_lanedir_consec_max2.8906537334917433
driven_lanedir_consec_mean1.3682866939061775
driven_lanedir_consec_min0.6549083175824881
driven_lanedir_max2.8906537334917433
driven_lanedir_mean1.3693801337167404
driven_lanedir_median0.7497803127875574
driven_lanedir_min0.6549083175824881
get_state_dump_max0.03652451101657564
get_state_dump_mean0.03553570703351057
get_state_dump_median0.03540280430815941
get_state_dump_min0.03491012334823609
get_ui_image_max0.09277604977289836
get_ui_image_mean0.08880941560902067
get_ui_image_median0.08872900747129225
get_ui_image_min0.08657913049062094
in-drivable-lane_max6.750000000000074
in-drivable-lane_mean3.745000000000013
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego": {"driven_any": 5.307481897221313, "get_ui_image": 0.09277604977289836, "step_physics": 0.227295827070872, "survival_time": 14.950000000000076, "driven_lanedir": 2.8906537334917433, "get_state_dump": 0.03491012334823609, "sim_render-ego": 0.0077451586723327635, "in-drivable-lane": 6.7000000000000375, "agent_compute-ego": 0.1078059196472168, "deviation-heading": 2.332537486878259, "complete-iteration": 0.5709540184338887, "set_robot_commands": 0.006625603834788004, "deviation-center-line": 0.5870897677808139, "driven_lanedir_consec": 2.8906537334917433, "sim_compute_sim_state": 0.023787260850270588, "sim_compute_performance-ego": 0.006110084851582845, "sim_compute_robot_state-ego": 0.010912919044494629, "sim_compute_robot_state-npc0": 0.01056067943572998, "sim_compute_robot_state-npc1": 0.01046151558558146, "sim_compute_robot_state-npc2": 0.010675151348114014, "sim_compute_robot_state-npc3": 0.010486523310343424, "sim_compute_robot_state-parked0": 0.010462691783905027}, "udem1-0-1-ego": {"driven_any": 1.8650456423157291, "get_ui_image": 0.08920927792787552, "step_physics": 0.19357280284166337, "survival_time": 7.99999999999998, "driven_lanedir": 0.9785095486897132, "get_state_dump": 0.03511989712715149, "sim_render-ego": 0.007551795244216919, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.10590795278549196, "deviation-heading": 1.2685514345897493, "complete-iteration": 0.5271359741687774, "set_robot_commands": 0.006728054583072662, "deviation-center-line": 0.40487004697496487, "driven_lanedir_consec": 0.9676407418521166, "sim_compute_sim_state": 0.01919454485177994, "sim_compute_performance-ego": 0.006128859519958496, "sim_compute_robot_state-ego": 0.0107602596282959, "sim_compute_robot_state-npc0": 0.010720904171466828, "sim_compute_robot_state-npc1": 0.01063138097524643, "sim_compute_robot_state-npc2": 0.01030668020248413, "sim_compute_robot_state-npc3": 0.010585600137710573, "sim_compute_robot_state-parked0": 0.010385656356811525}, "udem1-1-0-ego": {"driven_any": 1.8229094105992936, "get_ui_image": 0.08896634483337403, "step_physics": 0.1912862129211426, "survival_time": 6.249999999999986, "driven_lanedir": 0.7497803127875574, "get_state_dump": 0.03536855697631836, "sim_render-ego": 0.007857736587524413, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.10416916465759277, "deviation-heading": 0.7465079781545213, "complete-iteration": 0.525852611541748, "set_robot_commands": 0.006891689300537109, "deviation-center-line": 0.12711321302406356, "driven_lanedir_consec": 0.7497803127875574, "sim_compute_sim_state": 0.02159259414672851, "sim_compute_performance-ego": 0.006434406280517578, "sim_compute_robot_state-ego": 0.01117477798461914, "sim_compute_robot_state-npc0": 0.01061676788330078, "sim_compute_robot_state-npc1": 0.010490657806396485, "sim_compute_robot_state-npc2": 0.010258678436279298, "sim_compute_robot_state-npc3": 0.010117673873901369, "sim_compute_robot_state-parked0": 0.010294113159179687}, "udem1-1-1-ego": {"driven_any": 1.8229094105992936, "get_ui_image": 0.0874289665222168, "step_physics": 0.18919101524353027, "survival_time": 6.249999999999986, "driven_lanedir": 0.7497803127875574, "get_state_dump": 0.035835777282714844, "sim_render-ego": 0.008089242935180664, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.10442393684387206, "deviation-heading": 0.7465079781545213, "complete-iteration": 0.5242484531402588, "set_robot_commands": 0.006936639785766602, "deviation-center-line": 0.12711321302406356, "driven_lanedir_consec": 0.7497803127875574, "sim_compute_sim_state": 0.02090989112854004, "sim_compute_performance-ego": 0.0062992115020751955, "sim_compute_robot_state-ego": 0.011240427017211911, "sim_compute_robot_state-npc0": 0.010902223587036132, "sim_compute_robot_state-npc1": 0.010825172424316406, "sim_compute_robot_state-npc2": 0.01068562889099121, "sim_compute_robot_state-npc3": 0.010564517974853516, "sim_compute_robot_state-parked0": 0.010568565368652343}, "udem1-2-0-ego": {"driven_any": 1.8494327559709656, "get_ui_image": 0.088610338953744, "step_physics": 0.19325181868224017, "survival_time": 5.649999999999988, "driven_lanedir": 0.6549083175824881, "get_state_dump": 0.03536554775406829, "sim_render-ego": 0.00781188601941134, "in-drivable-lane": 3.7499999999999862, "agent_compute-ego": 0.10942797323243808, "deviation-heading": 0.434167871037006, "complete-iteration": 0.5294408249644051, "set_robot_commands": 0.00657632498614556, "deviation-center-line": 0.11797971229647096, "driven_lanedir_consec": 0.6549083175824881, "sim_compute_sim_state": 0.01776387628200835, "sim_compute_performance-ego": 0.006077390856447473, "sim_compute_robot_state-ego": 0.011195775681892327, "sim_compute_robot_state-npc0": 0.010928641378352071, "sim_compute_robot_state-npc1": 0.010387036652691596, "sim_compute_robot_state-npc2": 0.01063040927448104, "sim_compute_robot_state-npc3": 0.010422594779360613, "sim_compute_robot_state-parked0": 0.01064529461143291}, "udem1-2-1-ego": {"driven_any": 1.8494327559709656, "get_ui_image": 0.08777958312920764, "step_physics": 0.18795211547243912, "survival_time": 5.649999999999988, "driven_lanedir": 0.6549083175824881, "get_state_dump": 0.03652451101657564, "sim_render-ego": 0.008342426435082359, "in-drivable-lane": 3.7499999999999862, "agent_compute-ego": 0.10590051338735935, "deviation-heading": 0.434167871037006, "complete-iteration": 0.5267575441208561, "set_robot_commands": 0.007318076834214472, "deviation-center-line": 0.11797971229647096, "driven_lanedir_consec": 0.6549083175824881, "sim_compute_sim_state": 0.018740797464826466, "sim_compute_performance-ego": 0.0065680478526427685, "sim_compute_robot_state-ego": 0.011481766152170909, "sim_compute_robot_state-npc0": 0.011523778459667103, "sim_compute_robot_state-npc1": 0.01107478563764454, "sim_compute_robot_state-npc2": 0.01110324817421162, "sim_compute_robot_state-npc3": 0.011117549069159854, "sim_compute_robot_state-parked0": 0.010974012644944992}, "udem1-3-0-ego": {"driven_any": 0.7639116041175411, "get_ui_image": 0.09095276788223622, "step_physics": 0.22581497458524483, "survival_time": 2.1500000000000004, "driven_lanedir": 0.7183219542502832, "get_state_dump": 0.03543705164000045, "sim_render-ego": 0.0076079978499301645, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10442562435948571, "deviation-heading": 0.5342334735245862, "complete-iteration": 0.5705247258031091, "set_robot_commands": 0.006566530050233353, "deviation-center-line": 0.07887283493597519, "driven_lanedir_consec": 0.7182891586162694, "sim_compute_sim_state": 0.02817886929179347, "sim_compute_performance-ego": 0.006597125253012014, "sim_compute_robot_state-ego": 0.011686729830364848, "sim_compute_robot_state-npc0": 0.010434017624965932, "sim_compute_robot_state-npc1": 0.010459062665007837, "sim_compute_robot_state-npc2": 0.010508753532587097, "sim_compute_robot_state-npc3": 0.010526573935220407, "sim_compute_robot_state-parked0": 0.010984842167344204}, "udem1-3-1-ego": {"driven_any": 0.7639116041175411, "get_ui_image": 0.0888476759888405, "step_physics": 0.23393460761669072, "survival_time": 2.1500000000000004, "driven_lanedir": 0.7183219542502832, "get_state_dump": 0.035350511240404704, "sim_render-ego": 0.007409500521282817, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10363239465757858, "deviation-heading": 0.5342334735245862, "complete-iteration": 0.5702327462129815, "set_robot_commands": 0.006414879200070403, "deviation-center-line": 0.07887283493597519, "driven_lanedir_consec": 0.7182891586162694, "sim_compute_sim_state": 0.02581815941389217, "sim_compute_performance-ego": 0.006100632423578307, "sim_compute_robot_state-ego": 0.010790641917738803, "sim_compute_robot_state-npc0": 0.010493040084838867, "sim_compute_robot_state-npc1": 0.010347161182137422, "sim_compute_robot_state-npc2": 0.01026586044666379, "sim_compute_robot_state-npc3": 0.010151791018108989, "sim_compute_robot_state-parked0": 0.010255447653836982}, "udem1-4-0-ego": {"driven_any": 5.199571201657802, "get_ui_image": 0.0869440205891927, "step_physics": 0.2009432784716288, "survival_time": 14.950000000000076, "driven_lanedir": 2.7893084428726445, "get_state_dump": 0.03547355890274048, "sim_render-ego": 0.007865692774454753, "in-drivable-lane": 6.750000000000074, "agent_compute-ego": 0.10268677949905396, "deviation-heading": 2.319842707139657, "complete-iteration": 0.5362905017534891, "set_robot_commands": 0.006795736153920492, "deviation-center-line": 0.5255131802493351, "driven_lanedir_consec": 2.7893084428726445, "sim_compute_sim_state": 0.023826728661855066, "sim_compute_performance-ego": 0.006345557371775309, "sim_compute_robot_state-ego": 0.011176589330037436, "sim_compute_robot_state-npc0": 0.011006579399108887, "sim_compute_robot_state-npc1": 0.010879990259806314, "sim_compute_robot_state-npc2": 0.01083891232808431, "sim_compute_robot_state-npc3": 0.010702486832936604, "sim_compute_robot_state-parked0": 0.010459949175516764}, "udem1-4-1-ego": {"driven_any": 5.199571201657802, "get_ui_image": 0.08657913049062094, "step_physics": 0.19954813957214357, "survival_time": 14.950000000000076, "driven_lanedir": 2.7893084428726445, "get_state_dump": 0.03597153504689535, "sim_render-ego": 0.008061023553212483, "in-drivable-lane": 6.750000000000074, "agent_compute-ego": 0.10270979324976603, "deviation-heading": 2.319842707139657, "complete-iteration": 0.5371074684460958, "set_robot_commands": 0.007080665429433187, "deviation-center-line": 0.5255131802493351, "driven_lanedir_consec": 2.7893084428726445, "sim_compute_sim_state": 0.024185797373453777, "sim_compute_performance-ego": 0.006425189177195231, "sim_compute_robot_state-ego": 0.011496805349985758, "sim_compute_robot_state-npc0": 0.011153806845347086, "sim_compute_robot_state-npc1": 0.011047223409016926, "sim_compute_robot_state-npc2": 0.010868428548177085, "sim_compute_robot_state-npc3": 0.010985046227773031, "sim_compute_robot_state-parked0": 0.01064948876698812}}
set_robot_commands_max0.007318076834214472
set_robot_commands_mean0.006793420015818184
set_robot_commands_median0.006761895368496577
set_robot_commands_min0.006414879200070403
sim_compute_performance-ego_max0.006597125253012014
sim_compute_performance-ego_mean0.006308650508878522
sim_compute_performance-ego_median0.006322384436925252
sim_compute_performance-ego_min0.006077390856447473
sim_compute_robot_state-ego_max0.011686729830364848
sim_compute_robot_state-ego_mean0.011191669193681166
sim_compute_robot_state-ego_median0.01118618250596488
sim_compute_robot_state-ego_min0.0107602596282959
sim_compute_robot_state-npc0_max0.011523778459667103
sim_compute_robot_state-npc0_mean0.010834043886981368
sim_compute_robot_state-npc0_median0.01081156387925148
sim_compute_robot_state-npc0_min0.010434017624965932
sim_compute_robot_state-npc1_max0.01107478563764454
sim_compute_robot_state-npc1_mean0.010660398659784544
sim_compute_robot_state-npc1_median0.010561019390821456
sim_compute_robot_state-npc1_min0.010347161182137422
sim_compute_robot_state-npc2_max0.01110324817421162
sim_compute_robot_state-npc2_mean0.01061417511820736
sim_compute_robot_state-npc2_median0.010652780311297528
sim_compute_robot_state-npc2_min0.010258678436279298
sim_compute_robot_state-npc3_max0.011117549069159854
sim_compute_robot_state-npc3_mean0.01056603571593684
sim_compute_robot_state-npc3_median0.010545545955036964
sim_compute_robot_state-npc3_min0.010117673873901369
sim_compute_robot_state-parked0_max0.010984842167344204
sim_compute_robot_state-parked0_mean0.010568006168861256
sim_compute_robot_state-parked0_median0.010515628576278689
sim_compute_robot_state-parked0_min0.010255447653836982
sim_compute_sim_state_max0.02817886929179347
sim_compute_sim_state_mean0.022399851946514837
sim_compute_sim_state_median0.022689927498499553
sim_compute_sim_state_min0.01776387628200835
sim_render-ego_max0.008342426435082359
sim_render-ego_mean0.007834246059262867
sim_render-ego_median0.007834811303467876
sim_render-ego_min0.007409500521282817
simulation-passed1
step_physics_max0.23393460761669072
step_physics_mean0.2042790792477595
step_physics_median0.19656047120690345
step_physics_min0.18795211547243912
survival_time_max14.950000000000076
survival_time_mean8.095000000000017
survival_time_min2.1500000000000004

Highlights

34510

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

udem1-1-0

udem1-1-1

udem1-2-0

udem1-2-1

udem1-3-0

udem1-3-1

udem1-4-0

udem1-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.