Duckietown Challenges Home Challenges Submissions

Submission 3830

Submission3830
Competingyes
Challengeaido2-LFV-sim-testing-offseason
UserDonghoon Lee
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 24040
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
24040step1-simulationsuccessyes0:37:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.05619252710304179
survival_time_median1.5500000000000007
deviation-center-line_median0.07150011916070365
in-drivable-lane_median0.6000000000000004


other stats
agent_compute-ego_max0.16363341410954793
agent_compute-ego_mean0.11574671522941628
agent_compute-ego_median0.11757416560732084
agent_compute-ego_min0.09233924058767463
deviation-center-line_max0.67455409294423
deviation-center-line_mean0.2062292765429776
deviation-center-line_min0.0252460442318012
deviation-heading_max5.951946366406269
deviation-heading_mean2.992326580684763
deviation-heading_median0.660032058750875
deviation-heading_min0.475064368099676
driven_any_max1.549300856112976
driven_any_mean0.756381258447249
driven_any_median0.13902285579015622
driven_any_min0.09785778688038418
driven_lanedir_consec_max0.5128275283186512
driven_lanedir_consec_mean0.2448402237322826
driven_lanedir_consec_min0.03539412568615141
driven_lanedir_max0.5128275283186512
driven_lanedir_mean0.2448402237322826
driven_lanedir_median0.05619252710304179
driven_lanedir_min0.03539412568615141
in-drivable-lane_max7.400000000000042
in-drivable-lane_mean3.650000000000019
in-drivable-lane_min0.40000000000000024
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.520449431210659, "sim_physics": 0.15357592344284057, "survival_time": 14.950000000000076, "driven_lanedir": 0.4761497610365853, "sim_render-ego": 0.05812755823135376, "in-drivable-lane": 7.400000000000042, "agent_compute-ego": 0.15606792052586874, "deviation-heading": 5.703725350250262, "set_robot_commands": 0.08969576597213745, "deviation-center-line": 0.67455409294423, "driven_lanedir_consec": 0.4761497610365853, "sim_compute_sim_state": 0.03624515453974406, "sim_compute_performance-ego": 0.06333513975143433, "sim_compute_robot_state-ego": 0.0677087124188741, "sim_compute_robot_state-npc0": 0.06804217179616293, "sim_compute_robot_state-npc1": 0.06287844101587932, "sim_compute_robot_state-npc2": 0.06436240275700887, "sim_compute_robot_state-npc3": 0.06611492077509562}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5007181505792806, "sim_physics": 0.15405097166697185, "survival_time": 14.950000000000076, "driven_lanedir": 0.5128275283186512, "sim_render-ego": 0.056550753911336266, "in-drivable-lane": 7.250000000000039, "agent_compute-ego": 0.16363341410954793, "deviation-heading": 5.951946366406269, "set_robot_commands": 0.08858625888824463, "deviation-center-line": 0.6486559452884139, "driven_lanedir_consec": 0.5128275283186512, "sim_compute_sim_state": 0.03634945392608643, "sim_compute_performance-ego": 0.06272190332412719, "sim_compute_robot_state-ego": 0.06941298802693685, "sim_compute_robot_state-npc0": 0.06595839897791544, "sim_compute_robot_state-npc1": 0.0645911447207133, "sim_compute_robot_state-npc2": 0.06565740585327148, "sim_compute_robot_state-npc3": 0.06607284625371297}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11253832201412475, "sim_physics": 0.1473619054864954, "survival_time": 1.3500000000000003, "driven_lanedir": 0.03932019861766678, "sim_render-ego": 0.06759012186968769, "in-drivable-lane": 0.40000000000000024, "agent_compute-ego": 0.13401043856585468, "deviation-heading": 0.4791709020455639, "set_robot_commands": 0.0827018243295175, "deviation-center-line": 0.07150011916070365, "driven_lanedir_consec": 0.03932019861766678, "sim_compute_sim_state": 0.02831494366681134, "sim_compute_performance-ego": 0.05273879015887225, "sim_compute_robot_state-ego": 0.054263282705236365, "sim_compute_robot_state-npc0": 0.050477036723384154, "sim_compute_robot_state-npc1": 0.04830805460611979, "sim_compute_robot_state-npc2": 0.051373702508431894, "sim_compute_robot_state-npc3": 0.04924785649334943}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.09785778688038418, "sim_physics": 0.12603880677904403, "survival_time": 1.4000000000000006, "driven_lanedir": 0.03658928646741266, "sim_render-ego": 0.03883779048919678, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.12104438883917672, "deviation-heading": 0.475064368099676, "set_robot_commands": 0.06639944655554635, "deviation-center-line": 0.06487951268102517, "driven_lanedir_consec": 0.03658928646741266, "sim_compute_sim_state": 0.02553622211728777, "sim_compute_performance-ego": 0.040439026696341376, "sim_compute_robot_state-ego": 0.04547431639262608, "sim_compute_robot_state-npc0": 0.046820376600537984, "sim_compute_robot_state-npc1": 0.04576652390616281, "sim_compute_robot_state-npc2": 0.04686811140605381, "sim_compute_robot_state-npc3": 0.045682319572993686}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13902285579015622, "sim_physics": 0.11336714990677373, "survival_time": 1.5500000000000007, "driven_lanedir": 0.04511625552223309, "sim_render-ego": 0.04513412906277564, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.130077761988486, "deviation-heading": 0.660032058750875, "set_robot_commands": 0.07208092751041535, "deviation-center-line": 0.0252460442318012, "driven_lanedir_consec": 0.04511625552223309, "sim_compute_sim_state": 0.030574229455763293, "sim_compute_performance-ego": 0.047448519737489765, "sim_compute_robot_state-ego": 0.052729491264589375, "sim_compute_robot_state-npc0": 0.05188827360829999, "sim_compute_robot_state-npc1": 0.05176391140107186, "sim_compute_robot_state-npc2": 0.053771018981933594, "sim_compute_robot_state-npc3": 0.053046787938764016}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.5231332255954098, "sim_physics": 0.11337181488672891, "survival_time": 14.950000000000076, "driven_lanedir": 0.46154987075899934, "sim_render-ego": 0.04284192403157552, "in-drivable-lane": 7.250000000000042, "agent_compute-ego": 0.1198224933942159, "deviation-heading": 5.846279732457238, "set_robot_commands": 0.06863049030303955, "deviation-center-line": 0.19487592557061875, "driven_lanedir_consec": 0.46154987075899934, "sim_compute_sim_state": 0.027536209424336752, "sim_compute_performance-ego": 0.04710146347681681, "sim_compute_robot_state-ego": 0.04930564324061076, "sim_compute_robot_state-npc0": 0.05037042856216431, "sim_compute_robot_state-npc1": 0.04956636110941569, "sim_compute_robot_state-npc2": 0.04895167509714762, "sim_compute_robot_state-npc3": 0.04918215433756511}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.12250839159386852, "sim_physics": 0.12772474617793642, "survival_time": 1.4500000000000006, "driven_lanedir": 0.05619252710304179, "sim_render-ego": 0.04367977175219306, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.13004909712692786, "deviation-heading": 0.5552112406757185, "set_robot_commands": 0.0724709938312399, "deviation-center-line": 0.06029425998802036, "driven_lanedir_consec": 0.05619252710304179, "sim_compute_sim_state": 0.029237969168301285, "sim_compute_performance-ego": 0.048412692957911, "sim_compute_robot_state-ego": 0.05017775502698175, "sim_compute_robot_state-npc0": 0.05222282738521181, "sim_compute_robot_state-npc1": 0.04961733160347774, "sim_compute_robot_state-npc2": 0.048100372840618265, "sim_compute_robot_state-npc3": 0.04701910347774111}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.11630928031024144, "sim_physics": 0.11538097776215651, "survival_time": 1.4500000000000006, "driven_lanedir": 0.0474967363266976, "sim_render-ego": 0.03910641834653657, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.11757416560732084, "deviation-heading": 0.5030055899666701, "set_robot_commands": 0.06500858273999445, "deviation-center-line": 0.06487076640014555, "driven_lanedir_consec": 0.0474967363266976, "sim_compute_sim_state": 0.025905395376271213, "sim_compute_performance-ego": 0.04349142107470282, "sim_compute_robot_state-ego": 0.04523434310123838, "sim_compute_robot_state-npc0": 0.04470735582812079, "sim_compute_robot_state-npc1": 0.04745567256006701, "sim_compute_robot_state-npc2": 0.04347459201155038, "sim_compute_robot_state-npc3": 0.04311674216697956}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.4173505343595274, "sim_physics": 0.08691491921742757, "survival_time": 14.950000000000076, "driven_lanedir": 0.4648112553924002, "sim_render-ego": 0.03542586167653402, "in-drivable-lane": 7.250000000000042, "agent_compute-ego": 0.09706971089045206, "deviation-heading": 5.70587525882846, "set_robot_commands": 0.05512343883514404, "deviation-center-line": 0.17941614396429134, "driven_lanedir_consec": 0.4648112553924002, "sim_compute_sim_state": 0.02249463478724162, "sim_compute_performance-ego": 0.0382056721051534, "sim_compute_robot_state-ego": 0.04035648028055827, "sim_compute_robot_state-npc0": 0.040192278226216634, "sim_compute_robot_state-npc1": 0.04291801611582438, "sim_compute_robot_state-npc2": 0.039559539953867594, "sim_compute_robot_state-npc3": 0.03960151354471842}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.549300856112976, "sim_physics": 0.08637301524480184, "survival_time": 14.950000000000076, "driven_lanedir": 0.5021161672433161, "sim_render-ego": 0.03440210501352946, "in-drivable-lane": 7.250000000000042, "agent_compute-ego": 0.09415711164474488, "deviation-heading": 5.914564142579523, "set_robot_commands": 0.05417873064676921, "deviation-center-line": 0.2599067842059366, "driven_lanedir_consec": 0.5021161672433161, "sim_compute_sim_state": 0.021880664825439457, "sim_compute_performance-ego": 0.03747548818588257, "sim_compute_robot_state-ego": 0.0396323815981547, "sim_compute_robot_state-npc0": 0.03898825883865356, "sim_compute_robot_state-npc1": 0.03846743901570638, "sim_compute_robot_state-npc2": 0.03816656986872355, "sim_compute_robot_state-npc3": 0.03838402430216471}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.4753623571873176, "sim_physics": 0.08769421946721447, "survival_time": 14.850000000000076, "driven_lanedir": 0.43921059175913646, "sim_render-ego": 0.03594921494172478, "in-drivable-lane": 7.400000000000042, "agent_compute-ego": 0.09418090104254008, "deviation-heading": 5.785997466850599, "set_robot_commands": 0.05346408355918396, "deviation-center-line": 0.16129015706442756, "driven_lanedir_consec": 0.43921059175913646, "sim_compute_sim_state": 0.02190391222635905, "sim_compute_performance-ego": 0.037550302466960866, "sim_compute_robot_state-ego": 0.04084114675168638, "sim_compute_robot_state-npc0": 0.03899870496807677, "sim_compute_robot_state-npc1": 0.038403901186856354, "sim_compute_robot_state-npc2": 0.03838756670454135, "sim_compute_robot_state-npc3": 0.03856651068536521}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.1062414247922028, "sim_physics": 0.08574439929081844, "survival_time": 1.3000000000000005, "driven_lanedir": 0.03539412568615141, "sim_render-ego": 0.03405158336345966, "in-drivable-lane": 0.40000000000000024, "agent_compute-ego": 0.09233924058767463, "deviation-heading": 0.5469586710936079, "set_robot_commands": 0.05391481289496789, "deviation-center-line": 0.06768869117415303, "driven_lanedir_consec": 0.03539412568615141, "sim_compute_sim_state": 0.02190543138063871, "sim_compute_performance-ego": 0.03741241418398344, "sim_compute_robot_state-ego": 0.0394969811806312, "sim_compute_robot_state-npc0": 0.038795021864084095, "sim_compute_robot_state-npc1": 0.038312636888944186, "sim_compute_robot_state-npc2": 0.03814960443056547, "sim_compute_robot_state-npc3": 0.03826470558459942}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.4144272744009805, "sim_physics": 0.0870790688196818, "survival_time": 14.950000000000076, "driven_lanedir": 0.4637785754440843, "sim_render-ego": 0.0348508087793986, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.09484684546788534, "deviation-heading": 5.626897126940251, "set_robot_commands": 0.05315001885096232, "deviation-center-line": 0.4964700492703755, "driven_lanedir_consec": 0.4637785754440843, "sim_compute_sim_state": 0.021866169770558674, "sim_compute_performance-ego": 0.03748757123947143, "sim_compute_robot_state-ego": 0.03958635171254476, "sim_compute_robot_state-npc0": 0.0388403590520223, "sim_compute_robot_state-npc1": 0.038857120672861734, "sim_compute_robot_state-npc2": 0.03832295020421346, "sim_compute_robot_state-npc3": 0.03830404837926229}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.12083257660815765, "sim_physics": 0.08946015153612409, "survival_time": 1.4000000000000006, "driven_lanedir": 0.042197402673734175, "sim_render-ego": 0.03497825350080218, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.0966081704412188, "deviation-heading": 0.5229829866540693, "set_robot_commands": 0.053070204598563056, "deviation-center-line": 0.061918832249083615, "driven_lanedir_consec": 0.042197402673734175, "sim_compute_sim_state": 0.02204619986670358, "sim_compute_performance-ego": 0.03740223816462925, "sim_compute_robot_state-ego": 0.03991428443363735, "sim_compute_robot_state-npc0": 0.03886995996747698, "sim_compute_robot_state-npc1": 0.03862914868763515, "sim_compute_robot_state-npc2": 0.0382178681237357, "sim_compute_robot_state-npc3": 0.03828510216304234}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.12966640927345294, "sim_physics": 0.0859628438949585, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04985307363412872, "sim_render-ego": 0.03415618737538655, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.09471906820933024, "deviation-heading": 0.6071874486726682, "set_robot_commands": 0.052899408340454104, "deviation-center-line": 0.06187182395143777, "driven_lanedir_consec": 0.04985307363412872, "sim_compute_sim_state": 0.02197280724843343, "sim_compute_performance-ego": 0.03885881900787354, "sim_compute_robot_state-ego": 0.039401976267496745, "sim_compute_robot_state-npc0": 0.03872841993967692, "sim_compute_robot_state-npc1": 0.038318204879760745, "sim_compute_robot_state-npc2": 0.038157113393147785, "sim_compute_robot_state-npc3": 0.038229330380757647}}
set_robot_commands_max0.08969576597213745
set_robot_commands_mean0.06542499919041199
set_robot_commands_median0.06500858273999445
set_robot_commands_min0.052899408340454104
sim_compute_performance-ego_max0.06333513975143433
sim_compute_performance-ego_mean0.044672097502110014
sim_compute_performance-ego_median0.040439026696341376
sim_compute_performance-ego_min0.03740223816462925
sim_compute_robot_state-ego_max0.06941298802693685
sim_compute_robot_state-ego_mean0.047569075626786875
sim_compute_robot_state-ego_median0.04523434310123838
sim_compute_robot_state-ego_min0.039401976267496745
sim_compute_robot_state-npc0_max0.06804217179616293
sim_compute_robot_state-npc0_mean0.04692665815586698
sim_compute_robot_state-npc0_median0.04470735582812079
sim_compute_robot_state-npc0_min0.03872841993967692
sim_compute_robot_state-npc1_max0.0645911447207133
sim_compute_robot_state-npc1_mean0.046256927224699755
sim_compute_robot_state-npc1_median0.04576652390616281
sim_compute_robot_state-npc1_min0.038312636888944186
sim_compute_robot_state-npc2_max0.06565740585327148
sim_compute_robot_state-npc2_mean0.04610136627565406
sim_compute_robot_state-npc2_median0.04347459201155038
sim_compute_robot_state-npc2_min0.03814960443056547
sim_compute_robot_state-npc3_max0.06611492077509562
sim_compute_robot_state-npc3_mean0.04594119773707409
sim_compute_robot_state-npc3_median0.04311674216697956
sim_compute_robot_state-npc3_min0.038229330380757647
sim_compute_sim_state_max0.03634945392608643
sim_compute_sim_state_mean0.026251293185331776
sim_compute_sim_state_median0.02553622211728777
sim_compute_sim_state_min0.021866169770558674
sim_physics_max0.15405097166697185
sim_physics_mean0.11067339423866496
sim_physics_median0.11336714990677373
sim_physics_min0.08574439929081844
sim_render-ego_max0.06759012186968769
sim_render-ego_mean0.04237883215636603
sim_render-ego_median0.03883779048919678
sim_render-ego_min0.03405158336345966
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.730000000000036
survival_time_min1.3000000000000005
No reset possible