Duckietown Challenges Home Challenges Submissions

Submission 4334

Submission4334
Competingyes
Challengeaido3-LFVI-sim-testing
UserSoroush Saryazdi 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27577
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
27577step1-simulationsuccessyes0:17:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6510741719617279
survival_time_median2.5999999999999988
deviation-center-line_median0.13998987879563426
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.026630564739829617
agent_compute-ego_mean0.022505570482858055
agent_compute-ego_median0.02279581014926617
agent_compute-ego_min0.01645133454920882
deviation-center-line_max0.3036287511501312
deviation-center-line_mean0.15369769239159572
deviation-center-line_min0.05216491457142899
deviation-heading_max1.2179728408173982
deviation-heading_mean0.5261661462618537
deviation-heading_median0.39731350514028857
deviation-heading_min0.17653006715371072
driven_any_max2.224828697235836
driven_any_mean1.0945516051967747
driven_any_median1.035889090772785
driven_any_min0.28141737741661643
driven_lanedir_consec_max1.5148199711845598
driven_lanedir_consec_mean0.6776353875620368
driven_lanedir_consec_min0.2574360490463805
driven_lanedir_max1.5148389893669991
driven_lanedir_mean0.6987447229996103
driven_lanedir_median0.6625717078190373
driven_lanedir_min0.2574360490463805
in-drivable-lane_max2.449999999999994
in-drivable-lane_mean0.7399999999999982
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.120585162571246, "sim_physics": 0.25827586023431076, "survival_time": 2.849999999999998, "driven_lanedir": 1.0834331015849266, "sim_render-ego": 0.013110671127051636, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.024027155156721148, "deviation-heading": 0.41432780267306696, "set_robot_commands": 0.009673181333039935, "deviation-center-line": 0.13998987879563426, "driven_lanedir_consec": 1.0834331015849266, "sim_compute_sim_state": 0.004728392550819798, "sim_compute_performance-ego": 0.007313339333785207, "sim_compute_robot_state-ego": 0.009122024502670556, "sim_compute_robot_state-npc0": 0.008486183066117136, "sim_compute_robot_state-npc1": 0.00795929055464895, "sim_compute_robot_state-npc2": 0.008056469130934331, "sim_compute_robot_state-npc3": 0.007931696741204513}, "udem1-1-0": {"driven_any": 0.625093593968239, "sim_physics": 0.22716403007507324, "survival_time": 1.7500000000000009, "driven_lanedir": 0.6085670792754807, "sim_render-ego": 0.011411700929914202, "in-drivable-lane": 0, "agent_compute-ego": 0.021481159755161832, "deviation-heading": 0.32013156786773145, "set_robot_commands": 0.008834593636648996, "deviation-center-line": 0.09604910370355851, "driven_lanedir_consec": 0.6085670792754807, "sim_compute_sim_state": 0.004507943562098912, "sim_compute_performance-ego": 0.0066652570452008925, "sim_compute_robot_state-ego": 0.008408512387956892, "sim_compute_robot_state-npc0": 0.008085952486310687, "sim_compute_robot_state-npc1": 0.007465675898960658, "sim_compute_robot_state-npc2": 0.007573904309953962, "sim_compute_robot_state-npc3": 0.007496874673025949}, "udem1-2-0": {"driven_any": 1.0646337119139948, "sim_physics": 0.19882390675721345, "survival_time": 2.6999999999999984, "driven_lanedir": 0.54057801494714, "sim_render-ego": 0.011954766732675058, "in-drivable-lane": 0.9500000000000006, "agent_compute-ego": 0.023170091487743235, "deviation-heading": 0.7806490469039062, "set_robot_commands": 0.010142617755466037, "deviation-center-line": 0.18907742227401345, "driven_lanedir_consec": 0.54057801494714, "sim_compute_sim_state": 0.005051551041779695, "sim_compute_performance-ego": 0.006827734134815357, "sim_compute_robot_state-ego": 0.009104781680636937, "sim_compute_robot_state-npc0": 0.008523729112413194, "sim_compute_robot_state-npc1": 0.00838337121186433, "sim_compute_robot_state-npc2": 0.008407928325511791, "sim_compute_robot_state-npc3": 0.008389993950172706}, "udem1-3-0": {"driven_any": 0.28141737741661643, "sim_physics": 0.450531332116378, "survival_time": 0.9500000000000004, "driven_lanedir": 0.2574360490463805, "sim_render-ego": 0.014325857162475586, "in-drivable-lane": 0, "agent_compute-ego": 0.026630564739829617, "deviation-heading": 0.370261699898986, "set_robot_commands": 0.01169031544735557, "deviation-center-line": 0.05216491457142899, "driven_lanedir_consec": 0.2574360490463805, "sim_compute_sim_state": 0.005783545343499435, "sim_compute_performance-ego": 0.007773399353027344, "sim_compute_robot_state-ego": 0.01036257492868524, "sim_compute_robot_state-npc0": 0.010762365240799753, "sim_compute_robot_state-npc1": 0.011762957823903936, "sim_compute_robot_state-npc2": 0.011904591008236534, "sim_compute_robot_state-npc3": 0.012403613642642372}, "udem1-4-0": {"driven_any": 1.4415883765088768, "sim_physics": 0.2601860979912986, "survival_time": 3.5499999999999954, "driven_lanedir": 0.5714453508506352, "sim_render-ego": 0.013278279505984885, "in-drivable-lane": 1.8499999999999943, "agent_compute-ego": 0.02427607858684701, "deviation-heading": 0.38647524317752424, "set_robot_commands": 0.010111315149656484, "deviation-center-line": 0.13680180419291485, "driven_lanedir_consec": 0.5714453508506352, "sim_compute_sim_state": 0.004959509406291264, "sim_compute_performance-ego": 0.007702189432063573, "sim_compute_robot_state-ego": 0.009287431206501703, "sim_compute_robot_state-npc0": 0.009351065461064728, "sim_compute_robot_state-npc1": 0.00872952165737958, "sim_compute_robot_state-npc2": 0.008206417862798127, "sim_compute_robot_state-npc3": 0.008279565354468117}, "udem1-5-0": {"driven_any": 1.0080391968248454, "sim_physics": 0.218753654223222, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6704865591525617, "sim_render-ego": 0.011873071010296162, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.02279581014926617, "deviation-heading": 0.3922278328684869, "set_robot_commands": 0.009896012452932503, "deviation-center-line": 0.07771251037610638, "driven_lanedir_consec": 0.6704865591525617, "sim_compute_sim_state": 0.004861758305476262, "sim_compute_performance-ego": 0.006713303235860972, "sim_compute_robot_state-ego": 0.00937803891988901, "sim_compute_robot_state-npc0": 0.008243936758774977, "sim_compute_robot_state-npc1": 0.00816861024269691, "sim_compute_robot_state-npc2": 0.008386364349952111, "sim_compute_robot_state-npc3": 0.00841516714829665}, "udem1-6-0": {"driven_any": 1.0203763919640902, "sim_physics": 0.22162998639620268, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6885137224643074, "sim_render-ego": 0.012562925998981182, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.023904438202197734, "deviation-heading": 0.48275274423678327, "set_robot_commands": 0.009716180654672476, "deviation-center-line": 0.2218899592142332, "driven_lanedir_consec": 0.6510741719617279, "sim_compute_sim_state": 0.004859740917499249, "sim_compute_performance-ego": 0.007051289081573486, "sim_compute_robot_state-ego": 0.009161976667550894, "sim_compute_robot_state-npc0": 0.008554834585923415, "sim_compute_robot_state-npc1": 0.008562885797940768, "sim_compute_robot_state-npc2": 0.008659133544334998, "sim_compute_robot_state-npc3": 0.00816883949133066}, "udem1-7-0": {"driven_any": 1.518889572352387, "sim_physics": 0.2788069574800256, "survival_time": 3.649999999999995, "driven_lanedir": 1.5148389893669991, "sim_render-ego": 0.012896283032142951, "in-drivable-lane": 0, "agent_compute-ego": 0.024895583113578906, "deviation-heading": 0.20977423156921973, "set_robot_commands": 0.011070160016621628, "deviation-center-line": 0.21770843077410823, "driven_lanedir_consec": 1.5148199711845598, "sim_compute_sim_state": 0.0054980304143200185, "sim_compute_performance-ego": 0.007593158173234495, "sim_compute_robot_state-ego": 0.009850681644596468, "sim_compute_robot_state-npc0": 0.009405201428557096, "sim_compute_robot_state-npc1": 0.008968353271484375, "sim_compute_robot_state-npc2": 0.009276801592683138, "sim_compute_robot_state-npc3": 0.009074106608351616}, "udem1-8-0": {"driven_any": 1.0327164362829535, "sim_physics": 0.21691766610512367, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8071665223942781, "sim_render-ego": 0.011909571977762075, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.02127812458918645, "deviation-heading": 0.7544988063126181, "set_robot_commands": 0.009428973381335918, "deviation-center-line": 0.25456483764263077, "driven_lanedir_consec": 0.7988277806254289, "sim_compute_sim_state": 0.004533941929156964, "sim_compute_performance-ego": 0.00733265051474938, "sim_compute_robot_state-ego": 0.009143655116741476, "sim_compute_robot_state-npc0": 0.008596401948195238, "sim_compute_robot_state-npc1": 0.007909073279454159, "sim_compute_robot_state-npc2": 0.007792940506568322, "sim_compute_robot_state-npc3": 0.007867648051335262}, "udem1-9-0": {"driven_any": 2.194603187711772, "sim_physics": 0.22461057626284087, "survival_time": 5.1999999999999895, "driven_lanedir": 0.9504366656971932, "sim_render-ego": 0.012342906915224517, "in-drivable-lane": 2.449999999999994, "agent_compute-ego": 0.022180552666003887, "deviation-heading": 1.2179728408173982, "set_robot_commands": 0.0096551592533405, "deviation-center-line": 0.3036287511501312, "driven_lanedir_consec": 0.891948749340645, "sim_compute_sim_state": 0.004889696836471558, "sim_compute_performance-ego": 0.007021766442518968, "sim_compute_robot_state-ego": 0.009430543734477116, "sim_compute_robot_state-npc0": 0.008519557806161733, "sim_compute_robot_state-npc1": 0.008516898522010216, "sim_compute_robot_state-npc2": 0.008500034992511455, "sim_compute_robot_state-npc3": 0.008483150830635658}, "udem1-10-0": {"driven_any": 0.289456859388621, "sim_physics": 0.2060707688331604, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2655179454616352, "sim_render-ego": 0.011491799354553222, "in-drivable-lane": 0, "agent_compute-ego": 0.019658422470092772, "deviation-heading": 0.36575855943077534, "set_robot_commands": 0.008406603336334228, "deviation-center-line": 0.06115233279890005, "driven_lanedir_consec": 0.2655179454616352, "sim_compute_sim_state": 0.004560148715972901, "sim_compute_performance-ego": 0.00654066801071167, "sim_compute_robot_state-ego": 0.007860398292541504, "sim_compute_robot_state-npc0": 0.008357429504394531, "sim_compute_robot_state-npc1": 0.008275294303894043, "sim_compute_robot_state-npc2": 0.00888291597366333, "sim_compute_robot_state-npc3": 0.00770035982131958}, "udem1-11-0": {"driven_any": 1.2100209344634405, "sim_physics": 0.1577436317831783, "survival_time": 2.9499999999999975, "driven_lanedir": 0.46508942212711313, "sim_render-ego": 0.009291479143045716, "in-drivable-lane": 1.599999999999997, "agent_compute-ego": 0.01645133454920882, "deviation-heading": 0.17653006715371072, "set_robot_commands": 0.007119021173250877, "deviation-center-line": 0.129995313593986, "driven_lanedir_consec": 0.46508942212711313, "sim_compute_sim_state": 0.0036667928857318424, "sim_compute_performance-ego": 0.005178188873549639, "sim_compute_robot_state-ego": 0.006861290689242088, "sim_compute_robot_state-npc0": 0.006686392477003194, "sim_compute_robot_state-npc1": 0.0065414218579308465, "sim_compute_robot_state-npc2": 0.006304951037390758, "sim_compute_robot_state-npc3": 0.006076606653504453}, "udem1-12-0": {"driven_any": 2.224828697235836, "sim_physics": 0.18825208223783052, "survival_time": 5.1999999999999895, "driven_lanedir": 1.0703777445593876, "sim_render-ego": 0.011088346059505755, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.02138521579595713, "deviation-heading": 0.9732612596020856, "set_robot_commands": 0.008955712501819316, "deviation-center-line": 0.1588932542141487, "driven_lanedir_consec": 0.861653506375097, "sim_compute_sim_state": 0.004373754446323101, "sim_compute_performance-ego": 0.00645371125294612, "sim_compute_robot_state-ego": 0.00825378757256728, "sim_compute_robot_state-npc0": 0.007744681376677293, "sim_compute_robot_state-npc1": 0.007581765835101788, "sim_compute_robot_state-npc2": 0.007409966908968412, "sim_compute_robot_state-npc3": 0.007363039713639479}, "udem1-13-0": {"driven_any": 0.35013548857591936, "sim_physics": 0.2624701369892467, "survival_time": 1.1000000000000003, "driven_lanedir": 0.32471197024708154, "sim_render-ego": 0.012857523831454193, "in-drivable-lane": 0, "agent_compute-ego": 0.023917425762523304, "deviation-heading": 0.39731350514028857, "set_robot_commands": 0.009840304201299494, "deviation-center-line": 0.06622448803036315, "driven_lanedir_consec": 0.32471197024708154, "sim_compute_sim_state": 0.004681738940152255, "sim_compute_performance-ego": 0.007029956037347967, "sim_compute_robot_state-ego": 0.009229118173772638, "sim_compute_robot_state-npc0": 0.008265332742170855, "sim_compute_robot_state-npc1": 0.00805709578774192, "sim_compute_robot_state-npc2": 0.00820347395810214, "sim_compute_robot_state-npc3": 0.007992549376054243}, "udem1-14-0": {"driven_any": 1.035889090772785, "sim_physics": 0.2457334307523874, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6625717078190373, "sim_render-ego": 0.011735022068023682, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.02153160021855281, "deviation-heading": 0.6505569862752227, "set_robot_commands": 0.009112532322223367, "deviation-center-line": 0.1996123845417775, "driven_lanedir_consec": 0.6589411412501393, "sim_compute_sim_state": 0.004687052506666917, "sim_compute_performance-ego": 0.006601269428546612, "sim_compute_robot_state-ego": 0.008548456888932448, "sim_compute_robot_state-npc0": 0.007938495049109826, "sim_compute_robot_state-npc1": 0.007556970302875225, "sim_compute_robot_state-npc2": 0.007749873858231764, "sim_compute_robot_state-npc3": 0.007822105517754188}}
set_robot_commands_max0.01169031544735557
set_robot_commands_mean0.009576845507733156
set_robot_commands_median0.009673181333039935
set_robot_commands_min0.007119021173250877
sim_compute_performance-ego_max0.007773399353027344
sim_compute_performance-ego_mean0.0069198586899954445
sim_compute_performance-ego_median0.007021766442518968
sim_compute_performance-ego_min0.005178188873549639
sim_compute_robot_state-ego_max0.01036257492868524
sim_compute_robot_state-ego_mean0.008933551493784149
sim_compute_robot_state-ego_median0.009143655116741476
sim_compute_robot_state-ego_min0.006861290689242088
sim_compute_robot_state-npc0_max0.010762365240799753
sim_compute_robot_state-npc0_mean0.008501437269578244
sim_compute_robot_state-npc0_median0.008486183066117136
sim_compute_robot_state-npc0_min0.006686392477003194
sim_compute_robot_state-npc1_max0.011762957823903936
sim_compute_robot_state-npc1_mean0.008295945756525846
sim_compute_robot_state-npc1_median0.00816861024269691
sim_compute_robot_state-npc1_min0.0065414218579308465
sim_compute_robot_state-npc2_max0.011904591008236534
sim_compute_robot_state-npc2_mean0.008354384490656081
sim_compute_robot_state-npc2_median0.008206417862798127
sim_compute_robot_state-npc2_min0.006304951037390758
sim_compute_robot_state-npc3_max0.012403613642642372
sim_compute_robot_state-npc3_mean0.008231021171582363
sim_compute_robot_state-npc3_median0.007992549376054243
sim_compute_robot_state-npc3_min0.006076606653504453
sim_compute_sim_state_max0.005783545343499435
sim_compute_sim_state_mean0.004776239853484012
sim_compute_sim_state_median0.004728392550819798
sim_compute_sim_state_min0.0036667928857318424
sim_physics_max0.450531332116378
sim_physics_mean0.2410646745491661
sim_physics_median0.22461057626284087
sim_physics_min0.1577436317831783
sim_render-ego_max0.014325857162475586
sim_render-ego_mean0.012142013656606054
sim_render-ego_median0.011954766732675058
sim_render-ego_min0.009291479143045716
simulation-passed1
survival_time_max5.1999999999999895
survival_time_mean2.7533333333333307
survival_time_min0.9500000000000004
No reset possible