Duckietown Challenges Home Challenges Submissions

Submission 2694

Submission2694
Competingyes
Challengeaido2-LFV-sim-testing
UserKonstantin Chaika
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22823
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22823step1-simulationsuccessyes1:03:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8496886510423824
survival_time_median10.600000000000016
deviation-center-line_median0.7158391049958931
in-drivable-lane_median0.7999999999999987


other stats
agent_compute-ego_max0.056368228865832815
agent_compute-ego_mean0.05455365446959823
agent_compute-ego_median0.05448263996052293
agent_compute-ego_min0.05229093607734232
deviation-center-line_max1.2979980976987588
deviation-center-line_mean0.6983233784460772
deviation-center-line_min0.30468510751400724
deviation-heading_max8.511192605044654
deviation-heading_mean4.370071273419499
deviation-heading_median4.514475795851272
deviation-heading_min0.4260191365252912
driven_any_max2.348886797212572
driven_any_mean1.701077214002253
driven_any_median1.6496999176814275
driven_any_min0.4606529631847675
driven_lanedir_consec_max1.3806316055778978
driven_lanedir_consec_mean0.886010385027158
driven_lanedir_consec_min0.4550856483940704
driven_lanedir_max2.0009739262735553
driven_lanedir_mean1.1650263436861747
driven_lanedir_median1.2896951741179432
driven_lanedir_min0.4550856483940704
in-drivable-lane_max4.600000000000022
in-drivable-lane_mean1.803333333333338
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.5044532055763151, "sim_physics": 0.08478265514179152, "survival_time": 9.800000000000004, "driven_lanedir": 1.3806316055778978, "sim_render-ego": 0.05520607379018044, "in-drivable-lane": 0, "agent_compute-ego": 0.055832749726820965, "deviation-heading": 3.30171790485117, "set_robot_commands": 0.05290765665015395, "deviation-center-line": 0.7158391049958931, "driven_lanedir_consec": 1.3806316055778978, "sim_compute_sim_state": 0.032968311893696686, "sim_compute_performance-ego": 0.05772821757258201, "sim_compute_robot_state-ego": 0.05659823636619412, "sim_compute_robot_state-npc0": 0.06379725008594747, "sim_compute_robot_state-npc1": 0.058122824649421534, "sim_compute_robot_state-npc2": 0.05801866857372984, "sim_compute_robot_state-npc3": 0.05705096405379626}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.348886797212572, "sim_physics": 0.08644755204518637, "survival_time": 14.950000000000076, "driven_lanedir": 2.0009739262735553, "sim_render-ego": 0.05412648359934489, "in-drivable-lane": 0.4500000000000019, "agent_compute-ego": 0.05551364183425903, "deviation-heading": 5.754054389129794, "set_robot_commands": 0.05328003168106079, "deviation-center-line": 0.9000062292556569, "driven_lanedir_consec": 1.0163373711839352, "sim_compute_sim_state": 0.03302592833836873, "sim_compute_performance-ego": 0.05756763458251953, "sim_compute_robot_state-ego": 0.05536910931269328, "sim_compute_robot_state-npc0": 0.06333560228347779, "sim_compute_robot_state-npc1": 0.05796541293462117, "sim_compute_robot_state-npc2": 0.05725080569585164, "sim_compute_robot_state-npc3": 0.05649318297704061}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.175713732041361, "sim_physics": 0.08763416452345506, "survival_time": 7.649999999999981, "driven_lanedir": 0.6664550377983005, "sim_render-ego": 0.05393125652487761, "in-drivable-lane": 2.499999999999991, "agent_compute-ego": 0.05445582414764205, "deviation-heading": 1.9447590702186288, "set_robot_commands": 0.05329710050346025, "deviation-center-line": 0.5328625638576998, "driven_lanedir_consec": 0.5000377451909839, "sim_compute_sim_state": 0.03252043287738476, "sim_compute_performance-ego": 0.05659331527410769, "sim_compute_robot_state-ego": 0.05640819960949467, "sim_compute_robot_state-npc0": 0.0644797047758414, "sim_compute_robot_state-npc1": 0.058914424547182966, "sim_compute_robot_state-npc2": 0.056933142780478486, "sim_compute_robot_state-npc3": 0.05835630535300261}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.348574733712377, "sim_physics": 0.08638741572697957, "survival_time": 14.950000000000076, "driven_lanedir": 1.2541342325042495, "sim_render-ego": 0.05392916917800903, "in-drivable-lane": 4.600000000000022, "agent_compute-ego": 0.05488274653752645, "deviation-heading": 5.797748768980967, "set_robot_commands": 0.052807218233744305, "deviation-center-line": 0.9331920296812152, "driven_lanedir_consec": 0.8265154392513199, "sim_compute_sim_state": 0.03238076368967692, "sim_compute_performance-ego": 0.056861967245737714, "sim_compute_robot_state-ego": 0.055463936328887936, "sim_compute_robot_state-npc0": 0.06326525847117107, "sim_compute_robot_state-npc1": 0.05714671770731608, "sim_compute_robot_state-npc2": 0.05632357517878214, "sim_compute_robot_state-npc3": 0.05647479216257731}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.629419215864214, "sim_physics": 0.08210430145263672, "survival_time": 4.249999999999993, "driven_lanedir": 0.6214683483511103, "sim_render-ego": 0.05132751184351304, "in-drivable-lane": 0, "agent_compute-ego": 0.05229093607734232, "deviation-heading": 0.668735228803154, "set_robot_commands": 0.05106563007130342, "deviation-center-line": 0.3510106905724936, "driven_lanedir_consec": 0.6214683483511103, "sim_compute_sim_state": 0.03108338468215045, "sim_compute_performance-ego": 0.05416064823375029, "sim_compute_robot_state-ego": 0.05304024359759162, "sim_compute_robot_state-npc0": 0.06062632168040556, "sim_compute_robot_state-npc1": 0.05532763705534093, "sim_compute_robot_state-npc2": 0.05492656932157629, "sim_compute_robot_state-npc3": 0.05553211604847628}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.3484884215227972, "sim_physics": 0.08784311294555663, "survival_time": 14.950000000000076, "driven_lanedir": 1.451719704834156, "sim_render-ego": 0.05347213506698609, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.05489833434422811, "deviation-heading": 8.511192605044654, "set_robot_commands": 0.05315951903661092, "deviation-center-line": 1.2979980976987588, "driven_lanedir_consec": 0.7066290778097644, "sim_compute_sim_state": 0.032529513835906985, "sim_compute_performance-ego": 0.05847697973251343, "sim_compute_robot_state-ego": 0.055955464839935305, "sim_compute_robot_state-npc0": 0.06213561455408732, "sim_compute_robot_state-npc1": 0.05706678469975789, "sim_compute_robot_state-npc2": 0.05595875342686971, "sim_compute_robot_state-npc3": 0.055884512265523274}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.7016624465005665, "sim_physics": 0.08310376329624906, "survival_time": 4.699999999999991, "driven_lanedir": 0.5668501167164193, "sim_render-ego": 0.05248590225869037, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.05596178643246914, "deviation-heading": 1.7666488715165596, "set_robot_commands": 0.051710027329465176, "deviation-center-line": 0.30468510751400724, "driven_lanedir_consec": 0.5668501167164193, "sim_compute_sim_state": 0.03259990316756228, "sim_compute_performance-ego": 0.0549703430622182, "sim_compute_robot_state-ego": 0.053206433641149645, "sim_compute_robot_state-npc0": 0.0628569557311687, "sim_compute_robot_state-npc1": 0.05735576913711873, "sim_compute_robot_state-npc2": 0.05717165926669506, "sim_compute_robot_state-npc3": 0.05628368448703847}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.6496999176814275, "sim_physics": 0.0879854807313883, "survival_time": 10.600000000000016, "driven_lanedir": 1.2896951741179432, "sim_render-ego": 0.05392417705283975, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.05448263996052293, "deviation-heading": 4.514475795851272, "set_robot_commands": 0.05310906554168125, "deviation-center-line": 0.634809953512164, "driven_lanedir_consec": 0.8496886510423824, "sim_compute_sim_state": 0.032308207367951015, "sim_compute_performance-ego": 0.05711744528896403, "sim_compute_robot_state-ego": 0.0559237835542211, "sim_compute_robot_state-npc0": 0.061866255301349565, "sim_compute_robot_state-npc1": 0.05767039532931346, "sim_compute_robot_state-npc2": 0.056199726068748616, "sim_compute_robot_state-npc3": 0.056024002579023256}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3486337678292295, "sim_physics": 0.08335928678512573, "survival_time": 14.950000000000076, "driven_lanedir": 1.216398313323213, "sim_render-ego": 0.05418534994125366, "in-drivable-lane": 4.2500000000000195, "agent_compute-ego": 0.05366854906082153, "deviation-heading": 6.893990733123386, "set_robot_commands": 0.05323248545328776, "deviation-center-line": 0.9040208880468492, "driven_lanedir_consec": 0.8569745794369827, "sim_compute_sim_state": 0.03265163342158, "sim_compute_performance-ego": 0.057521350383758545, "sim_compute_robot_state-ego": 0.056050275961558024, "sim_compute_robot_state-npc0": 0.06419832070668538, "sim_compute_robot_state-npc1": 0.058259072303771975, "sim_compute_robot_state-npc2": 0.05727806091308594, "sim_compute_robot_state-npc3": 0.05668689092000326}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.348644888723356, "sim_physics": 0.08699962933858235, "survival_time": 14.950000000000076, "driven_lanedir": 1.420172457585963, "sim_render-ego": 0.05318460782368978, "in-drivable-lane": 3.250000000000014, "agent_compute-ego": 0.05373634497324626, "deviation-heading": 6.701226236543467, "set_robot_commands": 0.0526122784614563, "deviation-center-line": 0.7938090036117907, "driven_lanedir_consec": 1.1897540831340183, "sim_compute_sim_state": 0.03216533581415812, "sim_compute_performance-ego": 0.057215526898701984, "sim_compute_robot_state-ego": 0.05488691012064616, "sim_compute_robot_state-npc0": 0.06201965490976969, "sim_compute_robot_state-npc1": 0.05831339120864868, "sim_compute_robot_state-npc2": 0.056407856146494545, "sim_compute_robot_state-npc3": 0.0558686892191569}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.59354014226088, "sim_physics": 0.08551994881978849, "survival_time": 10.25000000000001, "driven_lanedir": 1.33759762416311, "sim_render-ego": 0.05365192483111126, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.056368228865832815, "deviation-heading": 3.915760181405531, "set_robot_commands": 0.05182978467243474, "deviation-center-line": 0.6459585448559878, "driven_lanedir_consec": 1.33759762416311, "sim_compute_sim_state": 0.032712952683611615, "sim_compute_performance-ego": 0.05680170059204102, "sim_compute_robot_state-ego": 0.05492049193963772, "sim_compute_robot_state-npc0": 0.06274983126942704, "sim_compute_robot_state-npc1": 0.05769940818228373, "sim_compute_robot_state-npc2": 0.05709412970194003, "sim_compute_robot_state-npc3": 0.05694245245398544}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4606529631847675, "sim_physics": 0.08313903585076332, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4550856483940704, "sim_render-ego": 0.05252743139863014, "in-drivable-lane": 0, "agent_compute-ego": 0.05251151695847511, "deviation-heading": 0.4260191365252912, "set_robot_commands": 0.05224892124533653, "deviation-center-line": 0.3511693152642639, "driven_lanedir_consec": 0.4550856483940704, "sim_compute_sim_state": 0.03158457204699516, "sim_compute_performance-ego": 0.055606305599212646, "sim_compute_robot_state-ego": 0.05492980405688286, "sim_compute_robot_state-npc0": 0.061839036643505096, "sim_compute_robot_state-npc1": 0.05559906363487244, "sim_compute_robot_state-npc2": 0.05531591549515724, "sim_compute_robot_state-npc3": 0.05462169647216797}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.13986439853255, "sim_physics": 0.08551966489016355, "survival_time": 13.65000000000006, "driven_lanedir": 1.6756817589221231, "sim_render-ego": 0.05372158249655923, "in-drivable-lane": 0.7999999999999987, "agent_compute-ego": 0.05426192370963184, "deviation-heading": 5.931800005905381, "set_robot_commands": 0.052340219309041786, "deviation-center-line": 0.8430118243498965, "driven_lanedir_consec": 1.1412741958515231, "sim_compute_sim_state": 0.03293369541238079, "sim_compute_performance-ego": 0.0570635131863884, "sim_compute_robot_state-ego": 0.05513743865184295, "sim_compute_robot_state-npc0": 0.06327438965821877, "sim_compute_robot_state-npc1": 0.05802547364007859, "sim_compute_robot_state-npc2": 0.05689828911107102, "sim_compute_robot_state-npc3": 0.05640208153497605}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5692525032150957, "sim_physics": 0.0879959493580431, "survival_time": 10.100000000000009, "driven_lanedir": 0.6818992797102941, "sim_render-ego": 0.05326805374409893, "in-drivable-lane": 4.300000000000009, "agent_compute-ego": 0.05544153180452856, "deviation-heading": 3.0488209370415595, "set_robot_commands": 0.05340906062928757, "deviation-center-line": 0.40798582809083306, "driven_lanedir_consec": 0.6818992797102941, "sim_compute_sim_state": 0.03254434613898249, "sim_compute_performance-ego": 0.056432727539893424, "sim_compute_robot_state-ego": 0.054198785583571635, "sim_compute_robot_state-npc0": 0.06282716930502712, "sim_compute_robot_state-npc1": 0.05750816293282083, "sim_compute_robot_state-npc2": 0.05626734294513665, "sim_compute_robot_state-npc3": 0.05659843199323899}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.3486710761762835, "sim_physics": 0.08758112986882528, "survival_time": 14.950000000000076, "driven_lanedir": 1.4566319270202164, "sim_render-ego": 0.05393584171930949, "in-drivable-lane": 3.250000000000009, "agent_compute-ego": 0.05399806261062622, "deviation-heading": 6.374119236351655, "set_robot_commands": 0.052275270620981855, "deviation-center-line": 0.858491495383649, "driven_lanedir_consec": 1.1594120095935598, "sim_compute_sim_state": 0.03297834873199463, "sim_compute_performance-ego": 0.05829410870869955, "sim_compute_robot_state-ego": 0.05601789077123006, "sim_compute_robot_state-npc0": 0.06391544500986734, "sim_compute_robot_state-npc1": 0.05810862382253011, "sim_compute_robot_state-npc2": 0.05718373298645019, "sim_compute_robot_state-npc3": 0.05702620267868042}}
set_robot_commands_max0.05340906062928757
set_robot_commands_mean0.05261895129595376
set_robot_commands_median0.052807218233744305
set_robot_commands_min0.05106563007130342
sim_compute_performance-ego_max0.05847697973251343
sim_compute_performance-ego_mean0.05682745226007256
sim_compute_performance-ego_median0.0570635131863884
sim_compute_performance-ego_min0.05416064823375029
sim_compute_robot_state-ego_max0.05659823636619412
sim_compute_robot_state-ego_mean0.05520713362236915
sim_compute_robot_state-ego_median0.05536910931269328
sim_compute_robot_state-ego_min0.05304024359759162
sim_compute_robot_state-npc0_max0.0644797047758414
sim_compute_robot_state-npc0_mean0.06287912069239662
sim_compute_robot_state-npc0_median0.0628569557311687
sim_compute_robot_state-npc0_min0.06062632168040556
sim_compute_robot_state-npc1_max0.058914424547182966
sim_compute_robot_state-npc1_mean0.05753887745233859
sim_compute_robot_state-npc1_median0.05769940818228373
sim_compute_robot_state-npc1_min0.05532763705534093
sim_compute_robot_state-npc2_max0.05801866857372984
sim_compute_robot_state-npc2_mean0.05661521517413783
sim_compute_robot_state-npc2_median0.05689828911107102
sim_compute_robot_state-npc2_min0.05492656932157629
sim_compute_robot_state-npc3_max0.05835630535300261
sim_compute_robot_state-npc3_mean0.05641640034657914
sim_compute_robot_state-npc3_median0.05647479216257731
sim_compute_robot_state-npc3_min0.05462169647216797
sim_compute_sim_state_max0.03302592833836873
sim_compute_sim_state_mean0.03246582200682671
sim_compute_sim_state_median0.03254434613898249
sim_compute_sim_state_min0.03108338468215045
sim_physics_max0.0879959493580431
sim_physics_mean0.08576020605163567
sim_physics_median0.08638741572697957
sim_physics_min0.08210430145263672
sim_render-ego_max0.05520607379018044
sim_render-ego_mean0.053525166751272925
sim_render-ego_median0.05372158249655923
sim_render-ego_min0.05132751184351304
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.9266666666667
survival_time_min3.1999999999999966
No reset possible