Duckietown Challenges Home Challenges Submissions

Submission 13186

Submission13186
Competingyes
Challengeaido5-LFV-sim-testing
UserYury Belousov 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVv-sim: 60456
Next
User labelJetBrains Research2 sim2real v0.1.1
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
60456LFVv-simsuccessyes0:39:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4447053822752323
survival_time_median10.425000000000024
deviation-center-line_median0.8703838345622069
in-drivable-lane_median0.4750000000000023


other stats
agent_compute-ego0_max0.06696660041809083
agent_compute-ego0_mean0.03192320956552384
agent_compute-ego0_median0.020454873663793487
agent_compute-ego0_min0.019816490516417543
agent_compute-npc0_max0.0249304723739624
agent_compute-npc0_mean0.022537335484201976
agent_compute-npc0_median0.022457676417154036
agent_compute-npc0_min0.020303516728537425
agent_compute-npc1_max0.05750828509708103
agent_compute-npc1_mean0.04741500447842375
agent_compute-npc1_median0.051345214343428355
agent_compute-npc1_min0.033391513994761875
agent_compute-npc2_max0.0513744199876305
agent_compute-npc2_mean0.04634610451246627
agent_compute-npc2_median0.04645404340878799
agent_compute-npc2_min0.04120985014098031
agent_compute-npc3_max0.05192082775736774
agent_compute-npc3_mean0.049174061988668784
agent_compute-npc3_median0.049174061988668784
agent_compute-npc3_min0.04642729621996983
complete-iteration_max1.36044473099194
complete-iteration_mean0.9874490458147438
complete-iteration_median1.069486854511432
complete-iteration_min0.4503777432441711
deviation-center-line_max3.2926375478830914
deviation-center-line_mean1.350327736428761
deviation-center-line_min0.36790572870753846
deviation-heading_max9.448239201048027
deviation-heading_mean3.6989439998500737
deviation-heading_median2.0964816563498117
deviation-heading_min1.1545734856526408
driven_any_max12.078028506797953
driven_any_mean4.603640722646334
driven_any_median2.6284703796642974
driven_any_min1.079593624458789
driven_lanedir_consec_max8.452998176803764
driven_lanedir_consec_mean3.595001205926687
driven_lanedir_consec_min1.0375958823525202
driven_lanedir_max8.469387456936463
driven_lanedir_mean3.599098525959862
driven_lanedir_median2.4447053822752323
driven_lanedir_min1.0375958823525202
get_duckie_state_max1.6706452952872075e-06
get_duckie_state_mean1.6133369708362345e-06
get_duckie_state_median1.6307960266948803e-06
get_duckie_state_min1.5211105346679687e-06
get_robot_state_max0.017430041333754285
get_robot_state_mean0.013933081231962833
get_robot_state_median0.01558341518495746
get_robot_state_min0.0071354532241821285
get_state_dump_max0.011652502224599714
get_state_dump_mean0.009659987627743848
get_state_dump_median0.01034868506161435
get_state_dump_min0.006290078163146973
get_ui_image_max0.059183237363966246
get_ui_image_mean0.04805997663475647
get_ui_image_median0.05021775361867299
get_ui_image_min0.032621161937713625
in-drivable-lane_max12.300000000000168
in-drivable-lane_mean3.312500000000043
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 3.8154212629000184, "get_ui_image": 0.04565339003290449, "step_physics": 0.5780973655836923, "survival_time": 13.950000000000063, "driven_lanedir": 3.5121453790321207, "get_state_dump": 0.00972480263028826, "get_robot_state": 0.013885012694767544, "sim_render-ego0": 0.003645322152546474, "sim_render-npc0": 0.0035846684660230366, "sim_render-npc1": 0.003583662850516183, "sim_render-npc2": 0.0036620659487588063, "get_duckie_state": 1.6289097922188895e-06, "in-drivable-lane": 0.9500000000000046, "deviation-heading": 2.5499517361268085, "agent_compute-ego0": 0.01997770241328648, "agent_compute-npc0": 0.020303516728537425, "agent_compute-npc1": 0.033391513994761875, "agent_compute-npc2": 0.04120985014098031, "complete-iteration": 0.8279575330870492, "set_robot_commands": 0.0023294244493756978, "deviation-center-line": 1.2420574125997923, "driven_lanedir_consec": 3.5121453790321207, "sim_compute_sim_state": 0.03470855184963771, "sim_compute_performance-ego0": 0.001955256291798183, "sim_compute_performance-npc0": 0.0018836941037859236, "sim_compute_performance-npc1": 0.001892482382910592, "sim_compute_performance-npc2": 0.0019346960953303743}, "LFV-norm-zigzag-000-ego0": {"driven_any": 1.441519496428576, "get_ui_image": 0.059183237363966246, "step_physics": 0.9676269610151113, "survival_time": 6.8999999999999835, "driven_lanedir": 1.377265385518344, "get_state_dump": 0.011652502224599714, "get_robot_state": 0.017430041333754285, "sim_render-ego0": 0.003733014031279859, "sim_render-npc0": 0.003639185171333148, "sim_render-npc1": 0.0037243160412465926, "sim_render-npc2": 0.003733641809696774, "sim_render-npc3": 0.003955624944014515, "get_duckie_state": 1.6706452952872075e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.6430115765728148, "agent_compute-ego0": 0.020932044914300493, "agent_compute-npc0": 0.023687640540033795, "agent_compute-npc1": 0.05750828509708103, "agent_compute-npc2": 0.0513744199876305, "agent_compute-npc3": 0.04642729621996983, "complete-iteration": 1.36044473099194, "set_robot_commands": 0.0024887331955724483, "deviation-center-line": 0.49871025652462136, "driven_lanedir_consec": 1.377265385518344, "sim_compute_sim_state": 0.06417231765582407, "sim_compute_performance-ego0": 0.0020151618573305418, "sim_compute_performance-npc0": 0.0019149059871975467, "sim_compute_performance-npc1": 0.001900271546068809, "sim_compute_performance-npc2": 0.0019604730949127416, "sim_compute_performance-npc3": 0.002139340201727778}, "LFV-norm-techtrack-000-ego0": {"driven_any": 12.078028506797953, "get_ui_image": 0.054782117204441504, "step_physics": 0.946389894158733, "survival_time": 46.64999999999949, "driven_lanedir": 8.469387456936463, "get_state_dump": 0.01097256749294044, "get_robot_state": 0.017281817675147373, "sim_render-ego0": 0.0036584406899691137, "sim_render-npc0": 0.0035852946867524172, "sim_render-npc1": 0.0038800515250424503, "sim_render-npc2": 0.004067615982807167, "sim_render-npc3": 0.003762728141768331, "get_duckie_state": 1.6326822611708713e-06, "in-drivable-lane": 12.300000000000168, "deviation-heading": 9.448239201048027, "agent_compute-ego0": 0.019816490516417543, "agent_compute-npc0": 0.02122771229427427, "agent_compute-npc1": 0.051345214343428355, "agent_compute-npc2": 0.04645404340878799, "agent_compute-npc3": 0.05192082775736774, "complete-iteration": 1.3110161759358148, "set_robot_commands": 0.002143362604831475, "deviation-center-line": 3.2926375478830914, "driven_lanedir_consec": 8.452998176803764, "sim_compute_sim_state": 0.0504170235015085, "sim_compute_performance-ego0": 0.0019498741856479032, "sim_compute_performance-npc0": 0.0018726526031657511, "sim_compute_performance-npc1": 0.0020035489978831125, "sim_compute_performance-npc2": 0.0021368456601586023, "sim_compute_performance-npc3": 0.0019771685181644285}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.079593624458789, "get_ui_image": 0.032621161937713625, "step_physics": 0.28605204820632935, "survival_time": 4.94999999999999, "driven_lanedir": 1.0375958823525202, "get_state_dump": 0.006290078163146973, "get_robot_state": 0.0071354532241821285, "sim_render-ego0": 0.003706619739532471, "sim_render-npc0": 0.003713078498840332, "get_duckie_state": 1.5211105346679687e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.1545734856526408, "agent_compute-ego0": 0.06696660041809083, "agent_compute-npc0": 0.0249304723739624, "complete-iteration": 0.4503777432441711, "set_robot_commands": 0.002168862819671631, "deviation-center-line": 0.36790572870753846, "driven_lanedir_consec": 1.0375958823525202, "sim_compute_sim_state": 0.010595431327819824, "sim_compute_performance-ego0": 0.001959860324859619, "sim_compute_performance-npc0": 0.0019423246383666992}}
set_robot_commands_max0.0024887331955724483
set_robot_commands_mean0.002282595767362813
set_robot_commands_median0.0022491436345236644
set_robot_commands_min0.002143362604831475
sim_compute_performance-ego0_max0.0020151618573305418
sim_compute_performance-ego0_mean0.0019700381649090616
sim_compute_performance-ego0_median0.0019575583083289013
sim_compute_performance-ego0_min0.0019498741856479032
sim_compute_performance-npc0_max0.0019423246383666992
sim_compute_performance-npc0_mean0.00190339433312898
sim_compute_performance-npc0_median0.0018993000454917352
sim_compute_performance-npc0_min0.0018726526031657511
sim_compute_performance-npc1_max0.0020035489978831125
sim_compute_performance-npc1_mean0.0019321009756208376
sim_compute_performance-npc1_median0.001900271546068809
sim_compute_performance-npc1_min0.001892482382910592
sim_compute_performance-npc2_max0.0021368456601586023
sim_compute_performance-npc2_mean0.0020106716168005728
sim_compute_performance-npc2_median0.0019604730949127416
sim_compute_performance-npc2_min0.0019346960953303743
sim_compute_performance-npc3_max0.002139340201727778
sim_compute_performance-npc3_mean0.002058254359946103
sim_compute_performance-npc3_median0.002058254359946103
sim_compute_performance-npc3_min0.0019771685181644285
sim_compute_sim_state_max0.06417231765582407
sim_compute_sim_state_mean0.03997333108369753
sim_compute_sim_state_median0.0425627876755731
sim_compute_sim_state_min0.010595431327819824
sim_render-ego0_max0.003733014031279859
sim_render-ego0_mean0.003685849153331979
sim_render-ego0_median0.003682530214750793
sim_render-ego0_min0.003645322152546474
sim_render-npc0_max0.003713078498840332
sim_render-npc0_mean0.0036305567057372335
sim_render-npc0_median0.0036122399290427825
sim_render-npc0_min0.0035846684660230366
sim_render-npc1_max0.0038800515250424503
sim_render-npc1_mean0.0037293434722684097
sim_render-npc1_median0.0037243160412465926
sim_render-npc1_min0.003583662850516183
sim_render-npc2_max0.004067615982807167
sim_render-npc2_mean0.0038211079137542496
sim_render-npc2_median0.003733641809696774
sim_render-npc2_min0.0036620659487588063
sim_render-npc3_max0.003955624944014515
sim_render-npc3_mean0.0038591765428914225
sim_render-npc3_median0.0038591765428914225
sim_render-npc3_min0.003762728141768331
simulation-passed1
step_physics_max0.9676269610151113
step_physics_mean0.6945415672409665
step_physics_median0.7622436298712126
step_physics_min0.28605204820632935
survival_time_max46.64999999999949
survival_time_mean18.11249999999988
survival_time_min4.94999999999999
No reset possible