Duckietown Challenges Home Challenges Submissions

Submission 3749

Submission3749
Competingyes
Challengeaido2-LFV-sim-testing
Usersebastian glatz
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23743
Next
User label-
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23743step1-simulationsuccessyes0:12:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.11471105063403096
agent_compute-ego_mean0.09188274060224416
agent_compute-ego_median0.08652210235595703
agent_compute-ego_min0.08603063777641014
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11240424933256926, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.04450094258343732, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.11471105063403096, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.0727119313346015, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.028263679257145635, "sim_compute_performance-ego": 0.05029237711871112, "sim_compute_robot_state-ego": 0.052201284302605525, "sim_compute_robot_state-npc0": 0.05062058236863878, "sim_compute_robot_state-npc1": 0.05248792966206869, "sim_compute_robot_state-npc2": 0.05344392193688287, "sim_compute_robot_state-npc3": 0.05016410792315448}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.123404541015625, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.046174535751342775, "in-drivable-lane": 0, "agent_compute-ego": 0.10784406661987304, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.06869266510009765, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.027157115936279296, "sim_compute_performance-ego": 0.04855607986450195, "sim_compute_robot_state-ego": 0.05171023368835449, "sim_compute_robot_state-npc0": 0.0492319393157959, "sim_compute_robot_state-npc1": 0.04986615180969238, "sim_compute_robot_state-npc2": 0.04786275863647461, "sim_compute_robot_state-npc3": 0.04599470138549805}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.12088166726262946, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.0420559613328231, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.11145182032334178, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.06872682508669402, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.027234889959034166, "sim_compute_performance-ego": 0.047592266609794216, "sim_compute_robot_state-ego": 0.04970563085455643, "sim_compute_robot_state-npc0": 0.05044773377870258, "sim_compute_robot_state-npc1": 0.04916344504607351, "sim_compute_robot_state-npc2": 0.04948840956938894, "sim_compute_robot_state-npc3": 0.05031911950362356}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.13537006136737292, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.03505245945121668, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.08614797531803951, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.05678679671468614, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.022272429888761495, "sim_compute_performance-ego": 0.038283779651303834, "sim_compute_robot_state-ego": 0.04023056694223911, "sim_compute_robot_state-npc0": 0.03992650478701048, "sim_compute_robot_state-npc1": 0.03897002678883227, "sim_compute_robot_state-npc2": 0.03887293912187408, "sim_compute_robot_state-npc3": 0.03881658179850518}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.09103688171931676, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.03561298336301531, "in-drivable-lane": 0, "agent_compute-ego": 0.08717866454805646, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.05519106558391026, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.022425762244633267, "sim_compute_performance-ego": 0.038574159145355225, "sim_compute_robot_state-ego": 0.04051596777779715, "sim_compute_robot_state-npc0": 0.03964836256844657, "sim_compute_robot_state-npc1": 0.03913944108145578, "sim_compute_robot_state-npc2": 0.03916803428104946, "sim_compute_robot_state-npc3": 0.03925152335848127}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.08492616812388103, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.035111166812755445, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.08603063777641014, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.054876614499975135, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.022144330872429743, "sim_compute_performance-ego": 0.03831842652073613, "sim_compute_robot_state-ego": 0.03998624836957013, "sim_compute_robot_state-npc0": 0.04191342548087791, "sim_compute_robot_state-npc1": 0.039616787875140155, "sim_compute_robot_state-npc2": 0.03876676824357775, "sim_compute_robot_state-npc3": 0.03869112332661947}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.0875048107571072, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.035238442597565825, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.08639093240102132, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.05483976999918619, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.022377398278978135, "sim_compute_performance-ego": 0.038319000491389525, "sim_compute_robot_state-ego": 0.04013890248757822, "sim_compute_robot_state-npc0": 0.03943702909681532, "sim_compute_robot_state-npc1": 0.03901992020783601, "sim_compute_robot_state-npc2": 0.03911685060571741, "sim_compute_robot_state-npc3": 0.03904143969217936}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.10398458374871147, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.0352417786916097, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.08676069577534994, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.05499156845940484, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.022236516740587024, "sim_compute_performance-ego": 0.03817938168843587, "sim_compute_robot_state-ego": 0.04123997688293457, "sim_compute_robot_state-npc0": 0.0393116103278266, "sim_compute_robot_state-npc1": 0.03913311428493923, "sim_compute_robot_state-npc2": 0.03889259762234158, "sim_compute_robot_state-npc3": 0.060362460878160266}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.08436141843381136, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.03515476247538691, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.08625316619873047, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.05494280483411706, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.022244183913521145, "sim_compute_performance-ego": 0.0382503893064416, "sim_compute_robot_state-ego": 0.04023222819618557, "sim_compute_robot_state-npc0": 0.039405656897503395, "sim_compute_robot_state-npc1": 0.03914682243181312, "sim_compute_robot_state-npc2": 0.038709531659665314, "sim_compute_robot_state-npc3": 0.03903104947960895}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.1155332899093628, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.034946351051330565, "in-drivable-lane": 0, "agent_compute-ego": 0.08613057136535644, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.05488933563232422, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.02506941795349121, "sim_compute_performance-ego": 0.03887814044952392, "sim_compute_robot_state-ego": 0.04042298793792724, "sim_compute_robot_state-npc0": 0.0394152307510376, "sim_compute_robot_state-npc1": 0.03900943279266358, "sim_compute_robot_state-npc2": 0.03886136531829834, "sim_compute_robot_state-npc3": 0.03890852451324463}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.10702074766159056, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.035391271114349365, "in-drivable-lane": 0, "agent_compute-ego": 0.08699120283126831, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.05529739856719971, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.02228999137878418, "sim_compute_performance-ego": 0.03840994834899902, "sim_compute_robot_state-ego": 0.04062608480453491, "sim_compute_robot_state-npc0": 0.03933863639831543, "sim_compute_robot_state-npc1": 0.03892912864685059, "sim_compute_robot_state-npc2": 0.03873568773269653, "sim_compute_robot_state-npc3": 0.03891223669052124}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.08695874716106214, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.035558688013177166, "in-drivable-lane": 0, "agent_compute-ego": 0.09319181191293816, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.05576434888337787, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.02263262397364566, "sim_compute_performance-ego": 0.03856623800177323, "sim_compute_robot_state-ego": 0.040993100718448035, "sim_compute_robot_state-npc0": 0.03971497636092337, "sim_compute_robot_state-npc1": 0.03945136070251465, "sim_compute_robot_state-npc2": 0.039058409239116465, "sim_compute_robot_state-npc3": 0.03923308221917403}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.08398649215698242, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.034802603721618655, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.08636300086975097, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.054903807640075686, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.02223757266998291, "sim_compute_performance-ego": 0.03818500518798828, "sim_compute_robot_state-ego": 0.04007328987121582, "sim_compute_robot_state-npc0": 0.03943102836608887, "sim_compute_robot_state-npc1": 0.0389306640625, "sim_compute_robot_state-npc2": 0.03975080966949463, "sim_compute_robot_state-npc3": 0.03895270824432373}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.1053216890855269, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.035432956435463646, "in-drivable-lane": 0, "agent_compute-ego": 0.08627341010353783, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.055165583437139336, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.02219245650551536, "sim_compute_performance-ego": 0.03815847093408758, "sim_compute_robot_state-ego": 0.04020809043537487, "sim_compute_robot_state-npc0": 0.039451674981550736, "sim_compute_robot_state-npc1": 0.03896654735911976, "sim_compute_robot_state-npc2": 0.038840651512146, "sim_compute_robot_state-npc3": 0.03888243978673762}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.10094436334103954, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.03557725341952577, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.08652210235595703, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.055469770820773374, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.02233609374688596, "sim_compute_performance-ego": 0.038225339383495094, "sim_compute_robot_state-ego": 0.04037859975075235, "sim_compute_robot_state-npc0": 0.039779205711520445, "sim_compute_robot_state-npc1": 0.039127291465292174, "sim_compute_robot_state-npc2": 0.03901326899625817, "sim_compute_robot_state-npc3": 0.0388533387865339}}
set_robot_commands_max0.0727119313346015
set_robot_commands_mean0.0582166857729042
set_robot_commands_median0.05519106558391026
set_robot_commands_min0.05483976999918619
sim_compute_performance-ego_max0.05029237711871112
sim_compute_performance-ego_mean0.04045260018016909
sim_compute_performance-ego_median0.038319000491389525
sim_compute_performance-ego_min0.03815847093408758
sim_compute_robot_state-ego_max0.052201284302605525
sim_compute_robot_state-ego_mean0.04257754620133829
sim_compute_robot_state-ego_median0.04042298793792724
sim_compute_robot_state-ego_min0.03998624836957013
sim_compute_robot_state-npc0_max0.05062058236863878
sim_compute_robot_state-npc0_mean0.04180490647940361
sim_compute_robot_state-npc0_median0.03964836256844657
sim_compute_robot_state-npc0_min0.0393116103278266
sim_compute_robot_state-npc1_max0.05248792966206869
sim_compute_robot_state-npc1_mean0.041397204281119454
sim_compute_robot_state-npc1_median0.03913311428493923
sim_compute_robot_state-npc1_min0.03892912864685059
sim_compute_robot_state-npc2_max0.05344392193688287
sim_compute_robot_state-npc2_mean0.04123880027633213
sim_compute_robot_state-npc2_median0.03901326899625817
sim_compute_robot_state-npc2_min0.038709531659665314
sim_compute_robot_state-npc3_max0.060362460878160266
sim_compute_robot_state-npc3_mean0.04236096250575771
sim_compute_robot_state-npc3_median0.03903104947960895
sim_compute_robot_state-npc3_min0.03869112332661947
sim_compute_sim_state_max0.028263679257145635
sim_compute_sim_state_mean0.02354096422131168
sim_compute_sim_state_median0.02233609374688596
sim_compute_sim_state_min0.022144330872429743
sim_physics_max0.13537006136737292
sim_physics_mean0.1029093140717726
sim_physics_median0.10398458374871147
sim_physics_min0.08398649215698242
sim_render-ego_max0.046174535751342775
sim_render-ego_mean0.037056810454307886
sim_render-ego_median0.035391271114349365
sim_render-ego_min0.034802603721618655
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
No reset possible
23741step1-simulationsuccessyes0:12:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible