Duckietown Challenges Home Challenges Submissions

Submission 2406

Submission2406
Competingyes
Challengeaido2-LFVI-sim-testing
UserVictor Guerra 🇫🇷
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23005
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23005step1-simulationsuccessyes0:15:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07491694695314322
survival_time_median1.2000000000000004
deviation-center-line_median0.05640650632522012
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.18514677194448617
agent_compute-ego_mean0.15781646682479547
agent_compute-ego_median0.15999878020513625
agent_compute-ego_min0.118154915896329
deviation-center-line_max0.08992127954448668
deviation-center-line_mean0.06199087358005375
deviation-center-line_min0.029898656059950363
deviation-heading_max0.7793216720398054
deviation-heading_mean0.6351662554476409
deviation-heading_median0.627212219486254
deviation-heading_min0.44897143643374027
driven_any_max0.24030167248186943
driven_any_mean0.1637581090455199
driven_any_median0.15335033954569677
driven_any_min0.10719505692270384
driven_lanedir_consec_max0.1105641789865821
driven_lanedir_consec_mean0.0816277105454037
driven_lanedir_consec_min0.04884938601700406
driven_lanedir_max0.1105641789865821
driven_lanedir_mean0.0816277105454037
driven_lanedir_median0.07491694695314322
driven_lanedir_min0.04884938601700406
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.2400000000000002
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.21834837244228128, "sim_physics": 0.1967623450539329, "survival_time": 1.6500000000000008, "driven_lanedir": 0.08907174895440817, "sim_render-ego": 0.06126224633419153, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16764759294914475, "deviation-heading": 0.627212219486254, "set_robot_commands": 0.09312995997342197, "deviation-center-line": 0.05640650632522012, "driven_lanedir_consec": 0.08907174895440817, "sim_compute_sim_state": 0.03755643873503714, "sim_compute_performance-ego": 0.0652910362590443, "sim_compute_robot_state-ego": 0.06922458879875415, "sim_compute_robot_state-npc0": 0.06928756742766409, "sim_compute_robot_state-npc1": 0.06901670224738843, "sim_compute_robot_state-npc2": 0.06910524946270567, "sim_compute_robot_state-npc3": 0.06384660258437648}, "udem1-1-0": {"driven_any": 0.2045346177376563, "sim_physics": 0.21124045848846432, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06362435804351518, "sim_render-ego": 0.05997539361317952, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15187825361887614, "deviation-heading": 0.7701213375122605, "set_robot_commands": 0.08562199274698894, "deviation-center-line": 0.052454023176684954, "driven_lanedir_consec": 0.06362435804351518, "sim_compute_sim_state": 0.03502531051635742, "sim_compute_performance-ego": 0.06684813499450684, "sim_compute_robot_state-ego": 0.07066365083058675, "sim_compute_robot_state-npc0": 0.06501454512278239, "sim_compute_robot_state-npc1": 0.06799400647481282, "sim_compute_robot_state-npc2": 0.0674485445022583, "sim_compute_robot_state-npc3": 0.0671061118443807}, "udem1-2-0": {"driven_any": 0.13473286612834703, "sim_physics": 0.21655885378519693, "survival_time": 1.0500000000000005, "driven_lanedir": 0.10476909761056152, "sim_render-ego": 0.05189629963466099, "in-drivable-lane": 0, "agent_compute-ego": 0.15094499360947383, "deviation-heading": 0.44897143643374027, "set_robot_commands": 0.0914754413423084, "deviation-center-line": 0.08931524869683488, "driven_lanedir_consec": 0.10476909761056152, "sim_compute_sim_state": 0.0371892565772647, "sim_compute_performance-ego": 0.05950264703659784, "sim_compute_robot_state-ego": 0.06116531008765811, "sim_compute_robot_state-npc0": 0.06933429127647764, "sim_compute_robot_state-npc1": 0.06236848377046131, "sim_compute_robot_state-npc2": 0.06178171294076102, "sim_compute_robot_state-npc3": 0.06307389622642881}, "udem1-3-0": {"driven_any": 0.14291483300418928, "sim_physics": 0.20723029700192536, "survival_time": 1.1000000000000003, "driven_lanedir": 0.10912498173282748, "sim_render-ego": 0.06438488310033624, "in-drivable-lane": 0, "agent_compute-ego": 0.15604416890577835, "deviation-heading": 0.4972118822697814, "set_robot_commands": 0.07843211564150723, "deviation-center-line": 0.08992127954448668, "driven_lanedir_consec": 0.10912498173282748, "sim_compute_sim_state": 0.03280678662386807, "sim_compute_performance-ego": 0.061022400856018066, "sim_compute_robot_state-ego": 0.06718773191625421, "sim_compute_robot_state-npc0": 0.058065143498507416, "sim_compute_robot_state-npc1": 0.06463762846860019, "sim_compute_robot_state-npc2": 0.05942730470137163, "sim_compute_robot_state-npc3": 0.06262124668468129}, "udem1-4-0": {"driven_any": 0.14178276315110397, "sim_physics": 0.14299599329630533, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0693188667294804, "sim_render-ego": 0.04609111944834391, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.1261963744958242, "deviation-heading": 0.680313885491405, "set_robot_commands": 0.0747896134853363, "deviation-center-line": 0.03890204995911767, "driven_lanedir_consec": 0.0693188667294804, "sim_compute_sim_state": 0.029874682426452637, "sim_compute_performance-ego": 0.04906908671061198, "sim_compute_robot_state-ego": 0.04971322417259216, "sim_compute_robot_state-npc0": 0.04903501272201538, "sim_compute_robot_state-npc1": 0.04909228285153707, "sim_compute_robot_state-npc2": 0.04815538724263509, "sim_compute_robot_state-npc3": 0.04800178607304891}, "udem1-5-0": {"driven_any": 0.24030167248186943, "sim_physics": 0.19300576713350084, "survival_time": 1.800000000000001, "driven_lanedir": 0.1105641789865821, "sim_render-ego": 0.062014374468061656, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17956925100750393, "deviation-heading": 0.711522804791074, "set_robot_commands": 0.10417728953891332, "deviation-center-line": 0.05306794922646514, "driven_lanedir_consec": 0.1105641789865821, "sim_compute_sim_state": 0.03960512081782023, "sim_compute_performance-ego": 0.06972606976826985, "sim_compute_robot_state-ego": 0.07638699478573269, "sim_compute_robot_state-npc0": 0.07075058751636082, "sim_compute_robot_state-npc1": 0.07029742002487183, "sim_compute_robot_state-npc2": 0.07434869474834865, "sim_compute_robot_state-npc3": 0.06719831625620525}, "udem1-6-0": {"driven_any": 0.11270150939795494, "sim_physics": 0.19045411348342897, "survival_time": 1.0000000000000002, "driven_lanedir": 0.06620947043494141, "sim_render-ego": 0.058862042427062986, "in-drivable-lane": 0, "agent_compute-ego": 0.15037866830825805, "deviation-heading": 0.574895069984359, "set_robot_commands": 0.08213498592376708, "deviation-center-line": 0.07065463836309144, "driven_lanedir_consec": 0.06620947043494141, "sim_compute_sim_state": 0.03247301578521729, "sim_compute_performance-ego": 0.06199867725372314, "sim_compute_robot_state-ego": 0.06565209627151489, "sim_compute_robot_state-npc0": 0.060965991020202635, "sim_compute_robot_state-npc1": 0.06060079336166382, "sim_compute_robot_state-npc2": 0.05721924304962158, "sim_compute_robot_state-npc3": 0.05729689598083496}, "udem1-7-0": {"driven_any": 0.1336149242666562, "sim_physics": 0.21235532561937967, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0899961456494276, "sim_render-ego": 0.05789129932721456, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16155225038528442, "deviation-heading": 0.60752994107739, "set_robot_commands": 0.09001559019088745, "deviation-center-line": 0.0882865571900123, "driven_lanedir_consec": 0.0899961456494276, "sim_compute_sim_state": 0.04108725984891256, "sim_compute_performance-ego": 0.06840490301450093, "sim_compute_robot_state-ego": 0.06754019856452942, "sim_compute_robot_state-npc0": 0.06690749526023865, "sim_compute_robot_state-npc1": 0.06699289878209432, "sim_compute_robot_state-npc2": 0.06943117578824361, "sim_compute_robot_state-npc3": 0.06530254085858662}, "udem1-8-0": {"driven_any": 0.20575347714638212, "sim_physics": 0.18548818677663803, "survival_time": 1.6000000000000008, "driven_lanedir": 0.09245911790688988, "sim_render-ego": 0.05860523134469986, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.15143319219350815, "deviation-heading": 0.6593124368300722, "set_robot_commands": 0.0878848284482956, "deviation-center-line": 0.033001617047254836, "driven_lanedir_consec": 0.09245911790688988, "sim_compute_sim_state": 0.03576713055372238, "sim_compute_performance-ego": 0.06470448523759842, "sim_compute_robot_state-ego": 0.06826051324605942, "sim_compute_robot_state-npc0": 0.06687108427286148, "sim_compute_robot_state-npc1": 0.06426393985748291, "sim_compute_robot_state-npc2": 0.06699295341968536, "sim_compute_robot_state-npc3": 0.07018020749092102}, "udem1-9-0": {"driven_any": 0.17686662190033278, "sim_physics": 0.2169735176222665, "survival_time": 1.4000000000000006, "driven_lanedir": 0.04884938601700406, "sim_render-ego": 0.0617398875100272, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.1668195469038827, "deviation-heading": 0.6923571091860621, "set_robot_commands": 0.09687695332935878, "deviation-center-line": 0.029898656059950363, "driven_lanedir_consec": 0.04884938601700406, "sim_compute_sim_state": 0.04075289624077933, "sim_compute_performance-ego": 0.06619696957724434, "sim_compute_robot_state-ego": 0.07085728645324707, "sim_compute_robot_state-npc0": 0.06189301184245518, "sim_compute_robot_state-npc1": 0.06631543806621007, "sim_compute_robot_state-npc2": 0.06424848522458758, "sim_compute_robot_state-npc3": 0.06439448254449028}, "udem1-10-0": {"driven_any": 0.15335033954569677, "sim_physics": 0.2030539313952128, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07491694695314322, "sim_render-ego": 0.057423253854115806, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17715569337209067, "deviation-heading": 0.7793216720398054, "set_robot_commands": 0.10232097903887433, "deviation-center-line": 0.04275711231950694, "driven_lanedir_consec": 0.07491694695314322, "sim_compute_sim_state": 0.033921251694361367, "sim_compute_performance-ego": 0.060446312030156456, "sim_compute_robot_state-ego": 0.07092122236887614, "sim_compute_robot_state-npc0": 0.06298848986625671, "sim_compute_robot_state-npc1": 0.061445653438568115, "sim_compute_robot_state-npc2": 0.06188386678695679, "sim_compute_robot_state-npc3": 0.05842725435892741}, "udem1-11-0": {"driven_any": 0.10719505692270384, "sim_physics": 0.21713595163254512, "survival_time": 1.0500000000000005, "driven_lanedir": 0.0674366373970412, "sim_render-ego": 0.05815075692676362, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15999878020513625, "deviation-heading": 0.5780098992841516, "set_robot_commands": 0.09121677989051456, "deviation-center-line": 0.08622719415032296, "driven_lanedir_consec": 0.0674366373970412, "sim_compute_sim_state": 0.04015445709228515, "sim_compute_performance-ego": 0.06592631340026855, "sim_compute_robot_state-ego": 0.07653329485938662, "sim_compute_robot_state-npc0": 0.06967479842049736, "sim_compute_robot_state-npc1": 0.06270709491911389, "sim_compute_robot_state-npc2": 0.0628298010144915, "sim_compute_robot_state-npc3": 0.06476589611598424}, "udem1-12-0": {"driven_any": 0.20919584393940505, "sim_physics": 0.2149935469907873, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07322233861989269, "sim_render-ego": 0.06237471804899328, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.16432654857635498, "deviation-heading": 0.6127680654042019, "set_robot_commands": 0.09123527302461512, "deviation-center-line": 0.05481453918108437, "driven_lanedir_consec": 0.07322233861989269, "sim_compute_sim_state": 0.037078331498538744, "sim_compute_performance-ego": 0.06237503360299503, "sim_compute_robot_state-ego": 0.066009521484375, "sim_compute_robot_state-npc0": 0.06444218579460592, "sim_compute_robot_state-npc1": 0.07045869266285616, "sim_compute_robot_state-npc2": 0.063881516456604, "sim_compute_robot_state-npc3": 0.06285198295817655}, "udem1-13-0": {"driven_any": 0.11094558254280916, "sim_physics": 0.1505636410279707, "survival_time": 1.1000000000000003, "driven_lanedir": 0.05763463362986565, "sim_render-ego": 0.04346928813240745, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.118154915896329, "deviation-heading": 0.591563002444139, "set_robot_commands": 0.0661415620283647, "deviation-center-line": 0.0738916195200361, "driven_lanedir_consec": 0.05763463362986565, "sim_compute_sim_state": 0.025178356604142624, "sim_compute_performance-ego": 0.044275337999517266, "sim_compute_robot_state-ego": 0.04792765053835782, "sim_compute_robot_state-npc0": 0.04482061212713069, "sim_compute_robot_state-npc1": 0.04463608698411421, "sim_compute_robot_state-npc2": 0.04669378020546653, "sim_compute_robot_state-npc3": 0.04427168586037376}, "udem1-14-0": {"driven_any": 0.16413315507541087, "sim_physics": 0.1957005262374878, "survival_time": 1.3000000000000005, "driven_lanedir": 0.10721774951547491, "sim_render-ego": 0.058618820630587064, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18514677194448617, "deviation-heading": 0.6963830694799161, "set_robot_commands": 0.0939657504741962, "deviation-center-line": 0.07026411294073753, "driven_lanedir_consec": 0.10721774951547491, "sim_compute_sim_state": 0.03878279832693247, "sim_compute_performance-ego": 0.06641199038578914, "sim_compute_robot_state-ego": 0.0687640355183528, "sim_compute_robot_state-npc0": 0.06968150689051701, "sim_compute_robot_state-npc1": 0.06584469171670768, "sim_compute_robot_state-npc2": 0.06341825998746432, "sim_compute_robot_state-npc3": 0.06728531764103816}}
set_robot_commands_max0.10417728953891332
set_robot_commands_mean0.08862794100515665
set_robot_commands_median0.09121677989051456
set_robot_commands_min0.0661415620283647
sim_compute_performance-ego_max0.06972606976826985
sim_compute_performance-ego_mean0.06214662654178948
sim_compute_performance-ego_median0.06470448523759842
sim_compute_performance-ego_min0.044275337999517266
sim_compute_robot_state-ego_max0.07653329485938662
sim_compute_robot_state-ego_mean0.06645382132641849
sim_compute_robot_state-ego_median0.06826051324605942
sim_compute_robot_state-ego_min0.04792765053835782
sim_compute_robot_state-npc0_max0.07075058751636082
sim_compute_robot_state-npc0_mean0.0633154882039049
sim_compute_robot_state-npc0_median0.06501454512278239
sim_compute_robot_state-npc0_min0.04482061212713069
sim_compute_robot_state-npc1_max0.07045869266285616
sim_compute_robot_state-npc1_mean0.06311145424176552
sim_compute_robot_state-npc1_median0.06463762846860019
sim_compute_robot_state-npc1_min0.04463608698411421
sim_compute_robot_state-npc2_max0.07434869474834865
sim_compute_robot_state-npc2_mean0.06245773170208012
sim_compute_robot_state-npc2_median0.06341825998746432
sim_compute_robot_state-npc2_min0.04669378020546653
sim_compute_robot_state-npc3_max0.07018020749092102
sim_compute_robot_state-npc3_mean0.06177494823189696
sim_compute_robot_state-npc3_median0.06384660258437648
sim_compute_robot_state-npc3_min0.04427168586037376
sim_compute_sim_state_max0.04108725984891256
sim_compute_sim_state_mean0.03581687288944614
sim_compute_sim_state_median0.037078331498538744
sim_compute_sim_state_min0.025178356604142624
sim_physics_max0.21713595163254512
sim_physics_mean0.19696749703633615
sim_physics_median0.2030539313952128
sim_physics_min0.14299599329630533
sim_render-ego_max0.06438488310033624
sim_render-ego_mean0.05751730765337639
sim_render-ego_median0.058618820630587064
sim_render-ego_min0.04346928813240745
simulation-passed1
survival_time_max1.800000000000001
survival_time_mean1.323333333333334
survival_time_min1.0000000000000002
No reset possible
23004step1-simulationsuccessyes0:17:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible