Duckietown Challenges Home Challenges Submissions

Submission 4334

Submission4334
Competingyes
Challengeaido3-LFVI-sim-testing
UserSoroush Saryazdi 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27577
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
27577step1-simulationsuccessyes0:17:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6510741719617279
survival_time_median2.5999999999999988
deviation-center-line_median0.13998987879563426
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.026630564739829617
agent_compute-ego_mean0.022505570482858055
agent_compute-ego_median0.02279581014926617
agent_compute-ego_min0.01645133454920882
deviation-center-line_max0.3036287511501312
deviation-center-line_mean0.15369769239159572
deviation-center-line_min0.05216491457142899
deviation-heading_max1.2179728408173982
deviation-heading_mean0.5261661462618537
deviation-heading_median0.39731350514028857
deviation-heading_min0.17653006715371072
driven_any_max2.224828697235836
driven_any_mean1.0945516051967747
driven_any_median1.035889090772785
driven_any_min0.28141737741661643
driven_lanedir_consec_max1.5148199711845598
driven_lanedir_consec_mean0.6776353875620368
driven_lanedir_consec_min0.2574360490463805
driven_lanedir_max1.5148389893669991
driven_lanedir_mean0.6987447229996103
driven_lanedir_median0.6625717078190373
driven_lanedir_min0.2574360490463805
in-drivable-lane_max2.449999999999994
in-drivable-lane_mean0.7399999999999982
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.120585162571246, "sim_physics": 0.25827586023431076, "survival_time": 2.849999999999998, "driven_lanedir": 1.0834331015849266, "sim_render-ego": 0.013110671127051636, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.024027155156721148, "deviation-heading": 0.41432780267306696, "set_robot_commands": 0.009673181333039935, "deviation-center-line": 0.13998987879563426, "driven_lanedir_consec": 1.0834331015849266, "sim_compute_sim_state": 0.004728392550819798, "sim_compute_performance-ego": 0.007313339333785207, "sim_compute_robot_state-ego": 0.009122024502670556, "sim_compute_robot_state-npc0": 0.008486183066117136, "sim_compute_robot_state-npc1": 0.00795929055464895, "sim_compute_robot_state-npc2": 0.008056469130934331, "sim_compute_robot_state-npc3": 0.007931696741204513}, "udem1-1-0": {"driven_any": 0.625093593968239, "sim_physics": 0.22716403007507324, "survival_time": 1.7500000000000009, "driven_lanedir": 0.6085670792754807, "sim_render-ego": 0.011411700929914202, "in-drivable-lane": 0, "agent_compute-ego": 0.021481159755161832, "deviation-heading": 0.32013156786773145, "set_robot_commands": 0.008834593636648996, "deviation-center-line": 0.09604910370355851, "driven_lanedir_consec": 0.6085670792754807, "sim_compute_sim_state": 0.004507943562098912, "sim_compute_performance-ego": 0.0066652570452008925, "sim_compute_robot_state-ego": 0.008408512387956892, "sim_compute_robot_state-npc0": 0.008085952486310687, "sim_compute_robot_state-npc1": 0.007465675898960658, "sim_compute_robot_state-npc2": 0.007573904309953962, "sim_compute_robot_state-npc3": 0.007496874673025949}, "udem1-2-0": {"driven_any": 1.0646337119139948, "sim_physics": 0.19882390675721345, "survival_time": 2.6999999999999984, "driven_lanedir": 0.54057801494714, "sim_render-ego": 0.011954766732675058, "in-drivable-lane": 0.9500000000000006, "agent_compute-ego": 0.023170091487743235, "deviation-heading": 0.7806490469039062, "set_robot_commands": 0.010142617755466037, "deviation-center-line": 0.18907742227401345, "driven_lanedir_consec": 0.54057801494714, "sim_compute_sim_state": 0.005051551041779695, "sim_compute_performance-ego": 0.006827734134815357, "sim_compute_robot_state-ego": 0.009104781680636937, "sim_compute_robot_state-npc0": 0.008523729112413194, "sim_compute_robot_state-npc1": 0.00838337121186433, "sim_compute_robot_state-npc2": 0.008407928325511791, "sim_compute_robot_state-npc3": 0.008389993950172706}, "udem1-3-0": {"driven_any": 0.28141737741661643, "sim_physics": 0.450531332116378, "survival_time": 0.9500000000000004, "driven_lanedir": 0.2574360490463805, "sim_render-ego": 0.014325857162475586, "in-drivable-lane": 0, "agent_compute-ego": 0.026630564739829617, "deviation-heading": 0.370261699898986, "set_robot_commands": 0.01169031544735557, "deviation-center-line": 0.05216491457142899, "driven_lanedir_consec": 0.2574360490463805, "sim_compute_sim_state": 0.005783545343499435, "sim_compute_performance-ego": 0.007773399353027344, "sim_compute_robot_state-ego": 0.01036257492868524, "sim_compute_robot_state-npc0": 0.010762365240799753, "sim_compute_robot_state-npc1": 0.011762957823903936, "sim_compute_robot_state-npc2": 0.011904591008236534, "sim_compute_robot_state-npc3": 0.012403613642642372}, "udem1-4-0": {"driven_any": 1.4415883765088768, "sim_physics": 0.2601860979912986, "survival_time": 3.5499999999999954, "driven_lanedir": 0.5714453508506352, "sim_render-ego": 0.013278279505984885, "in-drivable-lane": 1.8499999999999943, "agent_compute-ego": 0.02427607858684701, "deviation-heading": 0.38647524317752424, "set_robot_commands": 0.010111315149656484, "deviation-center-line": 0.13680180419291485, "driven_lanedir_consec": 0.5714453508506352, "sim_compute_sim_state": 0.004959509406291264, "sim_compute_performance-ego": 0.007702189432063573, "sim_compute_robot_state-ego": 0.009287431206501703, "sim_compute_robot_state-npc0": 0.009351065461064728, "sim_compute_robot_state-npc1": 0.00872952165737958, "sim_compute_robot_state-npc2": 0.008206417862798127, "sim_compute_robot_state-npc3": 0.008279565354468117}, "udem1-5-0": {"driven_any": 1.0080391968248454, "sim_physics": 0.218753654223222, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6704865591525617, "sim_render-ego": 0.011873071010296162, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.02279581014926617, "deviation-heading": 0.3922278328684869, "set_robot_commands": 0.009896012452932503, "deviation-center-line": 0.07771251037610638, "driven_lanedir_consec": 0.6704865591525617, "sim_compute_sim_state": 0.004861758305476262, "sim_compute_performance-ego": 0.006713303235860972, "sim_compute_robot_state-ego": 0.00937803891988901, "sim_compute_robot_state-npc0": 0.008243936758774977, "sim_compute_robot_state-npc1": 0.00816861024269691, "sim_compute_robot_state-npc2": 0.008386364349952111, "sim_compute_robot_state-npc3": 0.00841516714829665}, "udem1-6-0": {"driven_any": 1.0203763919640902, "sim_physics": 0.22162998639620268, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6885137224643074, "sim_render-ego": 0.012562925998981182, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.023904438202197734, "deviation-heading": 0.48275274423678327, "set_robot_commands": 0.009716180654672476, "deviation-center-line": 0.2218899592142332, "driven_lanedir_consec": 0.6510741719617279, "sim_compute_sim_state": 0.004859740917499249, "sim_compute_performance-ego": 0.007051289081573486, "sim_compute_robot_state-ego": 0.009161976667550894, "sim_compute_robot_state-npc0": 0.008554834585923415, "sim_compute_robot_state-npc1": 0.008562885797940768, "sim_compute_robot_state-npc2": 0.008659133544334998, "sim_compute_robot_state-npc3": 0.00816883949133066}, "udem1-7-0": {"driven_any": 1.518889572352387, "sim_physics": 0.2788069574800256, "survival_time": 3.649999999999995, "driven_lanedir": 1.5148389893669991, "sim_render-ego": 0.012896283032142951, "in-drivable-lane": 0, "agent_compute-ego": 0.024895583113578906, "deviation-heading": 0.20977423156921973, "set_robot_commands": 0.011070160016621628, "deviation-center-line": 0.21770843077410823, "driven_lanedir_consec": 1.5148199711845598, "sim_compute_sim_state": 0.0054980304143200185, "sim_compute_performance-ego": 0.007593158173234495, "sim_compute_robot_state-ego": 0.009850681644596468, "sim_compute_robot_state-npc0": 0.009405201428557096, "sim_compute_robot_state-npc1": 0.008968353271484375, "sim_compute_robot_state-npc2": 0.009276801592683138, "sim_compute_robot_state-npc3": 0.009074106608351616}, "udem1-8-0": {"driven_any": 1.0327164362829535, "sim_physics": 0.21691766610512367, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8071665223942781, "sim_render-ego": 0.011909571977762075, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.02127812458918645, "deviation-heading": 0.7544988063126181, "set_robot_commands": 0.009428973381335918, "deviation-center-line": 0.25456483764263077, "driven_lanedir_consec": 0.7988277806254289, "sim_compute_sim_state": 0.004533941929156964, "sim_compute_performance-ego": 0.00733265051474938, "sim_compute_robot_state-ego": 0.009143655116741476, "sim_compute_robot_state-npc0": 0.008596401948195238, "sim_compute_robot_state-npc1": 0.007909073279454159, "sim_compute_robot_state-npc2": 0.007792940506568322, "sim_compute_robot_state-npc3": 0.007867648051335262}, "udem1-9-0": {"driven_any": 2.194603187711772, "sim_physics": 0.22461057626284087, "survival_time": 5.1999999999999895, "driven_lanedir": 0.9504366656971932, "sim_render-ego": 0.012342906915224517, "in-drivable-lane": 2.449999999999994, "agent_compute-ego": 0.022180552666003887, "deviation-heading": 1.2179728408173982, "set_robot_commands": 0.0096551592533405, "deviation-center-line": 0.3036287511501312, "driven_lanedir_consec": 0.891948749340645, "sim_compute_sim_state": 0.004889696836471558, "sim_compute_performance-ego": 0.007021766442518968, "sim_compute_robot_state-ego": 0.009430543734477116, "sim_compute_robot_state-npc0": 0.008519557806161733, "sim_compute_robot_state-npc1": 0.008516898522010216, "sim_compute_robot_state-npc2": 0.008500034992511455, "sim_compute_robot_state-npc3": 0.008483150830635658}, "udem1-10-0": {"driven_any": 0.289456859388621, "sim_physics": 0.2060707688331604, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2655179454616352, "sim_render-ego": 0.011491799354553222, "in-drivable-lane": 0, "agent_compute-ego": 0.019658422470092772, "deviation-heading": 0.36575855943077534, "set_robot_commands": 0.008406603336334228, "deviation-center-line": 0.06115233279890005, "driven_lanedir_consec": 0.2655179454616352, "sim_compute_sim_state": 0.004560148715972901, "sim_compute_performance-ego": 0.00654066801071167, "sim_compute_robot_state-ego": 0.007860398292541504, "sim_compute_robot_state-npc0": 0.008357429504394531, "sim_compute_robot_state-npc1": 0.008275294303894043, "sim_compute_robot_state-npc2": 0.00888291597366333, "sim_compute_robot_state-npc3": 0.00770035982131958}, "udem1-11-0": {"driven_any": 1.2100209344634405, "sim_physics": 0.1577436317831783, "survival_time": 2.9499999999999975, "driven_lanedir": 0.46508942212711313, "sim_render-ego": 0.009291479143045716, "in-drivable-lane": 1.599999999999997, "agent_compute-ego": 0.01645133454920882, "deviation-heading": 0.17653006715371072, "set_robot_commands": 0.007119021173250877, "deviation-center-line": 0.129995313593986, "driven_lanedir_consec": 0.46508942212711313, "sim_compute_sim_state": 0.0036667928857318424, "sim_compute_performance-ego": 0.005178188873549639, "sim_compute_robot_state-ego": 0.006861290689242088, "sim_compute_robot_state-npc0": 0.006686392477003194, "sim_compute_robot_state-npc1": 0.0065414218579308465, "sim_compute_robot_state-npc2": 0.006304951037390758, "sim_compute_robot_state-npc3": 0.006076606653504453}, "udem1-12-0": {"driven_any": 2.224828697235836, "sim_physics": 0.18825208223783052, "survival_time": 5.1999999999999895, "driven_lanedir": 1.0703777445593876, "sim_render-ego": 0.011088346059505755, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.02138521579595713, "deviation-heading": 0.9732612596020856, "set_robot_commands": 0.008955712501819316, "deviation-center-line": 0.1588932542141487, "driven_lanedir_consec": 0.861653506375097, "sim_compute_sim_state": 0.004373754446323101, "sim_compute_performance-ego": 0.00645371125294612, "sim_compute_robot_state-ego": 0.00825378757256728, "sim_compute_robot_state-npc0": 0.007744681376677293, "sim_compute_robot_state-npc1": 0.007581765835101788, "sim_compute_robot_state-npc2": 0.007409966908968412, "sim_compute_robot_state-npc3": 0.007363039713639479}, "udem1-13-0": {"driven_any": 0.35013548857591936, "sim_physics": 0.2624701369892467, "survival_time": 1.1000000000000003, "driven_lanedir": 0.32471197024708154, "sim_render-ego": 0.012857523831454193, "in-drivable-lane": 0, "agent_compute-ego": 0.023917425762523304, "deviation-heading": 0.39731350514028857, "set_robot_commands": 0.009840304201299494, "deviation-center-line": 0.06622448803036315, "driven_lanedir_consec": 0.32471197024708154, "sim_compute_sim_state": 0.004681738940152255, "sim_compute_performance-ego": 0.007029956037347967, "sim_compute_robot_state-ego": 0.009229118173772638, "sim_compute_robot_state-npc0": 0.008265332742170855, "sim_compute_robot_state-npc1": 0.00805709578774192, "sim_compute_robot_state-npc2": 0.00820347395810214, "sim_compute_robot_state-npc3": 0.007992549376054243}, "udem1-14-0": {"driven_any": 1.035889090772785, "sim_physics": 0.2457334307523874, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6625717078190373, "sim_render-ego": 0.011735022068023682, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.02153160021855281, "deviation-heading": 0.6505569862752227, "set_robot_commands": 0.009112532322223367, "deviation-center-line": 0.1996123845417775, "driven_lanedir_consec": 0.6589411412501393, "sim_compute_sim_state": 0.004687052506666917, "sim_compute_performance-ego": 0.006601269428546612, "sim_compute_robot_state-ego": 0.008548456888932448, "sim_compute_robot_state-npc0": 0.007938495049109826, "sim_compute_robot_state-npc1": 0.007556970302875225, "sim_compute_robot_state-npc2": 0.007749873858231764, "sim_compute_robot_state-npc3": 0.007822105517754188}}
set_robot_commands_max0.01169031544735557
set_robot_commands_mean0.009576845507733156
set_robot_commands_median0.009673181333039935
set_robot_commands_min0.007119021173250877
sim_compute_performance-ego_max0.007773399353027344
sim_compute_performance-ego_mean0.0069198586899954445
sim_compute_performance-ego_median0.007021766442518968
sim_compute_performance-ego_min0.005178188873549639
sim_compute_robot_state-ego_max0.01036257492868524
sim_compute_robot_state-ego_mean0.008933551493784149
sim_compute_robot_state-ego_median0.009143655116741476
sim_compute_robot_state-ego_min0.006861290689242088
sim_compute_robot_state-npc0_max0.010762365240799753
sim_compute_robot_state-npc0_mean0.008501437269578244
sim_compute_robot_state-npc0_median0.008486183066117136
sim_compute_robot_state-npc0_min0.006686392477003194
sim_compute_robot_state-npc1_max0.011762957823903936
sim_compute_robot_state-npc1_mean0.008295945756525846
sim_compute_robot_state-npc1_median0.00816861024269691
sim_compute_robot_state-npc1_min0.0065414218579308465
sim_compute_robot_state-npc2_max0.011904591008236534
sim_compute_robot_state-npc2_mean0.008354384490656081
sim_compute_robot_state-npc2_median0.008206417862798127
sim_compute_robot_state-npc2_min0.006304951037390758
sim_compute_robot_state-npc3_max0.012403613642642372
sim_compute_robot_state-npc3_mean0.008231021171582363
sim_compute_robot_state-npc3_median0.007992549376054243
sim_compute_robot_state-npc3_min0.006076606653504453
sim_compute_sim_state_max0.005783545343499435
sim_compute_sim_state_mean0.004776239853484012
sim_compute_sim_state_median0.004728392550819798
sim_compute_sim_state_min0.0036667928857318424
sim_physics_max0.450531332116378
sim_physics_mean0.2410646745491661
sim_physics_median0.22461057626284087
sim_physics_min0.1577436317831783
sim_render-ego_max0.014325857162475586
sim_render-ego_mean0.012142013656606054
sim_render-ego_median0.011954766732675058
sim_render-ego_min0.009291479143045716
simulation-passed1
survival_time_max5.1999999999999895
survival_time_mean2.7533333333333307
survival_time_min0.9500000000000004
No reset possible
25858step1-simulationsuccessno0:15:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24835step1-simulationsuccessno0:24:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24830step1-simulationsuccessno0:19:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24796step1-simulationsuccessno0:18:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24795step1-simulationsuccessno0:15:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24791step1-simulationsuccessno0:16:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible