Duckietown Challenges Home Challenges Submissions

Submission 3833

Submission3833
Competingyes
Challengeaido2-LFVI-sim-testing-offseason
UserDonghoon Lee
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 24039
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
24039step1-simulationsuccessyes0:14:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0875803973752296
survival_time_median1.2500000000000004
deviation-center-line_median0.0700468629145065
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.18732131004333497
agent_compute-ego_mean0.15620000858285665
agent_compute-ego_median0.15278907255692917
agent_compute-ego_min0.12169053337790749
deviation-center-line_max0.09508646653274742
deviation-center-line_mean0.06894959871776825
deviation-center-line_min0.039189881310697346
deviation-heading_max0.820892512143236
deviation-heading_mean0.6714219507387233
deviation-heading_median0.6984518885029765
deviation-heading_min0.4866475290309002
driven_any_max0.26828136803138736
driven_any_mean0.16823814545126686
driven_any_median0.15228728099063116
driven_any_min0.1137382727048478
driven_lanedir_consec_max0.12236725100266543
driven_lanedir_consec_mean0.08829116530307837
driven_lanedir_consec_min0.06204846139059139
driven_lanedir_max0.12236725100266543
driven_lanedir_mean0.08829116530307837
driven_lanedir_median0.0875803973752296
driven_lanedir_min0.06204846139059139
in-drivable-lane_max0.6500000000000006
in-drivable-lane_mean0.21333333333333349
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.21964728004749645, "sim_physics": 0.1456470200509736, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07292538366783252, "sim_render-ego": 0.05651362014539314, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.12169053337790749, "deviation-heading": 0.7410483135911415, "set_robot_commands": 0.06602720058325565, "deviation-center-line": 0.0618240182177843, "driven_lanedir_consec": 0.07292538366783252, "sim_compute_sim_state": 0.028396750941421047, "sim_compute_performance-ego": 0.05332561695214474, "sim_compute_robot_state-ego": 0.05436304121306448, "sim_compute_robot_state-npc0": 0.05066625999681877, "sim_compute_robot_state-npc1": 0.048656434723825165, "sim_compute_robot_state-npc2": 0.049198793642448654, "sim_compute_robot_state-npc3": 0.052028742703524505}, "udem1-1-0": {"driven_any": 0.2076793136258609, "sim_physics": 0.1615874543786049, "survival_time": 1.6000000000000008, "driven_lanedir": 0.06204846139059139, "sim_render-ego": 0.04926791042089462, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.135684996843338, "deviation-heading": 0.8023503534686567, "set_robot_commands": 0.09027715772390366, "deviation-center-line": 0.055804997410965826, "driven_lanedir_consec": 0.06204846139059139, "sim_compute_sim_state": 0.029538296163082123, "sim_compute_performance-ego": 0.051372647285461426, "sim_compute_robot_state-ego": 0.0529678538441658, "sim_compute_robot_state-npc0": 0.053115084767341614, "sim_compute_robot_state-npc1": 0.05123989284038544, "sim_compute_robot_state-npc2": 0.05194102227687836, "sim_compute_robot_state-npc3": 0.05168857425451279}, "udem1-2-0": {"driven_any": 0.12714798694228982, "sim_physics": 0.2329187826676802, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09701676997898724, "sim_render-ego": 0.06100183183496648, "in-drivable-lane": 0, "agent_compute-ego": 0.1668626286766746, "deviation-heading": 0.4866475290309002, "set_robot_commands": 0.09903443943370473, "deviation-center-line": 0.09467420699855696, "driven_lanedir_consec": 0.09701676997898724, "sim_compute_sim_state": 0.03814082795923406, "sim_compute_performance-ego": 0.06738100268624046, "sim_compute_robot_state-ego": 0.06784170324152167, "sim_compute_robot_state-npc0": 0.06590196219357577, "sim_compute_robot_state-npc1": 0.06168300455266779, "sim_compute_robot_state-npc2": 0.06296241283416748, "sim_compute_robot_state-npc3": 0.06366568261926825}, "udem1-3-0": {"driven_any": 0.13254063345252473, "sim_physics": 0.19889243789341135, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09377046023372282, "sim_render-ego": 0.061135903648708176, "in-drivable-lane": 0, "agent_compute-ego": 0.1651875350786292, "deviation-heading": 0.5530149740540866, "set_robot_commands": 0.08789715559586235, "deviation-center-line": 0.09383057539989138, "driven_lanedir_consec": 0.09377046023372282, "sim_compute_sim_state": 0.03422159733979598, "sim_compute_performance-ego": 0.06644332927206288, "sim_compute_robot_state-ego": 0.07071801890497623, "sim_compute_robot_state-npc0": 0.0577160586481509, "sim_compute_robot_state-npc1": 0.05770523651786472, "sim_compute_robot_state-npc2": 0.058158833047618035, "sim_compute_robot_state-npc3": 0.0626748333806577}, "udem1-4-0": {"driven_any": 0.14232408895994345, "sim_physics": 0.18279642860094705, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07725314077315204, "sim_render-ego": 0.05389846364657084, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1516252557436625, "deviation-heading": 0.6984518885029765, "set_robot_commands": 0.08974496523539226, "deviation-center-line": 0.043198665313520415, "driven_lanedir_consec": 0.07725314077315204, "sim_compute_sim_state": 0.044597903887430825, "sim_compute_performance-ego": 0.058204869429270424, "sim_compute_robot_state-ego": 0.06511951486269633, "sim_compute_robot_state-npc0": 0.0643464724222819, "sim_compute_robot_state-npc1": 0.06483180324236552, "sim_compute_robot_state-npc2": 0.06584805250167847, "sim_compute_robot_state-npc3": 0.06765297055244446}, "udem1-5-0": {"driven_any": 0.26828136803138736, "sim_physics": 0.1696488857269287, "survival_time": 1.900000000000001, "driven_lanedir": 0.12236725100266543, "sim_render-ego": 0.058410700998808206, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15802847084246183, "deviation-heading": 0.7656040145210071, "set_robot_commands": 0.08777858709034167, "deviation-center-line": 0.0618915661559995, "driven_lanedir_consec": 0.12236725100266543, "sim_compute_sim_state": 0.03586073925620631, "sim_compute_performance-ego": 0.06539743197591681, "sim_compute_robot_state-ego": 0.062855275053727, "sim_compute_robot_state-npc0": 0.06102002294440018, "sim_compute_robot_state-npc1": 0.06452130016527678, "sim_compute_robot_state-npc2": 0.06220970655742444, "sim_compute_robot_state-npc3": 0.06310228297584936}, "udem1-6-0": {"driven_any": 0.12107310443760257, "sim_physics": 0.2010809833353216, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07923656320654837, "sim_render-ego": 0.04924952983856201, "in-drivable-lane": 0, "agent_compute-ego": 0.15046154369007458, "deviation-heading": 0.6256036906134279, "set_robot_commands": 0.101183067668568, "deviation-center-line": 0.08215905224958883, "driven_lanedir_consec": 0.07923656320654837, "sim_compute_sim_state": 0.031745379621332344, "sim_compute_performance-ego": 0.06378112056038597, "sim_compute_robot_state-ego": 0.06399436430497603, "sim_compute_robot_state-npc0": 0.05780153924768621, "sim_compute_robot_state-npc1": 0.06073935465379195, "sim_compute_robot_state-npc2": 0.060646468942815605, "sim_compute_robot_state-npc3": 0.05845153331756592}, "udem1-7-0": {"driven_any": 0.14177101726346522, "sim_physics": 0.1957597827911377, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09802409114952848, "sim_render-ego": 0.05447254180908203, "in-drivable-lane": 0, "agent_compute-ego": 0.15179090499877929, "deviation-heading": 0.6539091444323728, "set_robot_commands": 0.0767740821838379, "deviation-center-line": 0.09508646653274742, "driven_lanedir_consec": 0.09802409114952848, "sim_compute_sim_state": 0.03428807258605957, "sim_compute_performance-ego": 0.06560992240905762, "sim_compute_robot_state-ego": 0.06618973731994629, "sim_compute_robot_state-npc0": 0.06456689834594727, "sim_compute_robot_state-npc1": 0.06326815605163574, "sim_compute_robot_state-npc2": 0.060074567794799805, "sim_compute_robot_state-npc3": 0.06312380790710449}, "udem1-8-0": {"driven_any": 0.17726655883854228, "sim_physics": 0.2159534352166312, "survival_time": 1.4000000000000006, "driven_lanedir": 0.09397084469055894, "sim_render-ego": 0.06370701960154943, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17165340696062362, "deviation-heading": 0.7156416320637832, "set_robot_commands": 0.09805214405059814, "deviation-center-line": 0.043432952085162374, "driven_lanedir_consec": 0.09397084469055894, "sim_compute_sim_state": 0.04001978465488979, "sim_compute_performance-ego": 0.06868041413170951, "sim_compute_robot_state-ego": 0.07522621325084142, "sim_compute_robot_state-npc0": 0.06805912937436785, "sim_compute_robot_state-npc1": 0.06568828650883266, "sim_compute_robot_state-npc2": 0.06505283287593297, "sim_compute_robot_state-npc3": 0.0676182849066598}, "udem1-9-0": {"driven_any": 0.18625075454587595, "sim_physics": 0.20379608677279565, "survival_time": 1.5500000000000007, "driven_lanedir": 0.07941037782272531, "sim_render-ego": 0.06616297075825353, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.16511444122560562, "deviation-heading": 0.7432629932199054, "set_robot_commands": 0.09057555660124748, "deviation-center-line": 0.039189881310697346, "driven_lanedir_consec": 0.07941037782272531, "sim_compute_sim_state": 0.03963921916100287, "sim_compute_performance-ego": 0.06713443417702952, "sim_compute_robot_state-ego": 0.07328319549560547, "sim_compute_robot_state-npc0": 0.06648247472701534, "sim_compute_robot_state-npc1": 0.06921885090489541, "sim_compute_robot_state-npc2": 0.06948541056725287, "sim_compute_robot_state-npc3": 0.06753320078695974}, "udem1-10-0": {"driven_any": 0.15228728099063116, "sim_physics": 0.2053448486328125, "survival_time": 1.2500000000000004, "driven_lanedir": 0.07199054957869522, "sim_render-ego": 0.06352425575256347, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.18732131004333497, "deviation-heading": 0.820892512143236, "set_robot_commands": 0.09475714683532716, "deviation-center-line": 0.04363819196188982, "driven_lanedir_consec": 0.07199054957869522, "sim_compute_sim_state": 0.03637958526611328, "sim_compute_performance-ego": 0.06818182945251465, "sim_compute_robot_state-ego": 0.07114643096923828, "sim_compute_robot_state-npc0": 0.06919716835021973, "sim_compute_robot_state-npc1": 0.06429437637329101, "sim_compute_robot_state-npc2": 0.060930910110473635, "sim_compute_robot_state-npc3": 0.0658583927154541}, "udem1-11-0": {"driven_any": 0.11818738675429058, "sim_physics": 0.18143458366394044, "survival_time": 1.0000000000000002, "driven_lanedir": 0.0875803973752296, "sim_render-ego": 0.06034750938415527, "in-drivable-lane": 0, "agent_compute-ego": 0.14915773868560792, "deviation-heading": 0.501607121056961, "set_robot_commands": 0.08621410131454468, "deviation-center-line": 0.08760017941622678, "driven_lanedir_consec": 0.0875803973752296, "sim_compute_sim_state": 0.049074649810791016, "sim_compute_performance-ego": 0.058039617538452146, "sim_compute_robot_state-ego": 0.06144459247589111, "sim_compute_robot_state-npc0": 0.06478822231292725, "sim_compute_robot_state-npc1": 0.06416499614715576, "sim_compute_robot_state-npc2": 0.06150155067443848, "sim_compute_robot_state-npc3": 0.05852639675140381}, "udem1-12-0": {"driven_any": 0.2551390754805052, "sim_physics": 0.1872230554238344, "survival_time": 1.950000000000001, "driven_lanedir": 0.11422975411350644, "sim_render-ego": 0.05890489847232134, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.15213899734692696, "deviation-heading": 0.6336228034581314, "set_robot_commands": 0.0857234184558575, "deviation-center-line": 0.0700468629145065, "driven_lanedir_consec": 0.11422975411350644, "sim_compute_sim_state": 0.034622284082266, "sim_compute_performance-ego": 0.06533550604795799, "sim_compute_robot_state-ego": 0.0659014628483699, "sim_compute_robot_state-npc0": 0.06601332395504682, "sim_compute_robot_state-npc1": 0.06119062961676182, "sim_compute_robot_state-npc2": 0.06208405127892128, "sim_compute_robot_state-npc3": 0.06059981003785745}, "udem1-13-0": {"driven_any": 0.1137382727048478, "sim_physics": 0.18840281529860065, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07295281791175068, "sim_render-ego": 0.05758299610831521, "in-drivable-lane": 0, "agent_compute-ego": 0.15278907255692917, "deviation-heading": 0.6268488568642862, "set_robot_commands": 0.09064511819319292, "deviation-center-line": 0.08787713103108766, "driven_lanedir_consec": 0.07295281791175068, "sim_compute_sim_state": 0.03610382296822288, "sim_compute_performance-ego": 0.06289913437583229, "sim_compute_robot_state-ego": 0.06486945802515204, "sim_compute_robot_state-npc0": 0.06250698999925093, "sim_compute_robot_state-npc1": 0.06442808021198619, "sim_compute_robot_state-npc2": 0.06497889215295966, "sim_compute_robot_state-npc3": 0.06519170240922408}, "udem1-14-0": {"driven_any": 0.16023805969373994, "sim_physics": 0.18541241543633596, "survival_time": 1.4000000000000006, "driven_lanedir": 0.10159061665068105, "sim_render-ego": 0.059354339327131, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.16349329267229354, "deviation-heading": 0.7028234340599764, "set_robot_commands": 0.08147980485643659, "deviation-center-line": 0.07398923376789888, "driven_lanedir_consec": 0.10159061665068105, "sim_compute_sim_state": 0.03539666959217617, "sim_compute_performance-ego": 0.062476822308131626, "sim_compute_robot_state-ego": 0.06418132781982422, "sim_compute_robot_state-npc0": 0.059438935347965786, "sim_compute_robot_state-npc1": 0.0625983646937779, "sim_compute_robot_state-npc2": 0.060919804232461114, "sim_compute_robot_state-npc3": 0.06104418209620884}}
set_robot_commands_max0.101183067668568
set_robot_commands_mean0.0884109297214714
set_robot_commands_median0.08974496523539226
set_robot_commands_min0.06602720058325565
sim_compute_performance-ego_max0.06868041413170951
sim_compute_performance-ego_mean0.06295091324014454
sim_compute_performance-ego_median0.06533550604795799
sim_compute_performance-ego_min0.051372647285461426
sim_compute_robot_state-ego_max0.07522621325084142
sim_compute_robot_state-ego_mean0.06534014597533308
sim_compute_robot_state-ego_median0.06511951486269633
sim_compute_robot_state-ego_min0.0529678538441658
sim_compute_robot_state-npc0_max0.06919716835021973
sim_compute_robot_state-npc0_mean0.06210803617553308
sim_compute_robot_state-npc0_median0.0643464724222819
sim_compute_robot_state-npc0_min0.05066625999681877
sim_compute_robot_state-npc1_max0.06921885090489541
sim_compute_robot_state-npc1_mean0.061615251146967594
sim_compute_robot_state-npc1_median0.06326815605163574
sim_compute_robot_state-npc1_min0.048656434723825165
sim_compute_robot_state-npc2_max0.06948541056725287
sim_compute_robot_state-npc2_mean0.06106622063268473
sim_compute_robot_state-npc2_median0.06150155067443848
sim_compute_robot_state-npc2_min0.049198793642448654
sim_compute_robot_state-npc3_max0.06765297055244446
sim_compute_robot_state-npc3_mean0.06191735982764635
sim_compute_robot_state-npc3_median0.06310228297584936
sim_compute_robot_state-npc3_min0.05168857425451279
sim_compute_sim_state_max0.049074649810791016
sim_compute_sim_state_mean0.03653503888600162
sim_compute_sim_state_median0.03586073925620631
sim_compute_sim_state_min0.028396750941421047
sim_physics_max0.2329187826676802
sim_physics_mean0.19039326772599707
sim_physics_median0.18840281529860065
sim_physics_min0.1456470200509736
sim_render-ego_max0.06616297075825353
sim_render-ego_mean0.05823563278315165
sim_render-ego_median0.05890489847232134
sim_render-ego_min0.04924952983856201
simulation-passed1
survival_time_max1.950000000000001
survival_time_mean1.3733333333333342
survival_time_min1.0000000000000002
No reset possible