Duckietown Challenges Home Challenges Submissions

Submission 12896

Submission12896
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserAleksei Shpilman 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 59143
Next
User labelsim2real
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
59143LFVmultibodyv-simsuccessyes2:21:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0517138067383085
survival_time_median59.99999999999873
deviation-center-line_median2.4412095349883094
in-drivable-lane_median32.874999999999304


other stats
agent_compute-ego0_max0.04990057147214256
agent_compute-ego0_mean0.04911125033820896
agent_compute-ego0_median0.04890162422694731
agent_compute-ego0_min0.04862534056892998
agent_compute-ego1_max0.049576605090888515
agent_compute-ego1_mean0.04798155031150908
agent_compute-ego1_median0.04733588078139128
agent_compute-ego1_min0.04730320115768344
agent_compute-ego2_max0.04923635994167153
agent_compute-ego2_mean0.04784697517566538
agent_compute-ego2_median0.04720853587967669
agent_compute-ego2_min0.04709602970564792
agent_compute-ego3_max0.04915648495327126
agent_compute-ego3_mean0.04776240738438065
agent_compute-ego3_median0.047341104153292464
agent_compute-ego3_min0.04678963304657821
complete-iteration_max1.397784700600134
complete-iteration_mean1.17965799185103
complete-iteration_median1.3336973303462147
complete-iteration_min0.3720323104445484
deviation-center-line_max8.87613797054082
deviation-center-line_mean2.681209253023904
deviation-center-line_min0.1302480277093724
deviation-heading_max29.500523302844396
deviation-heading_mean14.174348738803774
deviation-heading_median14.853242899994882
deviation-heading_min1.120196860803528
driven_any_max10.916185501809172
driven_any_mean6.476051025199205
driven_any_median7.894744730985876
driven_any_min0.3330580690812184
driven_lanedir_consec_max9.592600259638385
driven_lanedir_consec_mean2.996005131712105
driven_lanedir_consec_min0.0713018264667693
driven_lanedir_max9.793336150145787
driven_lanedir_mean3.920105648324675
driven_lanedir_median2.6122449525021176
driven_lanedir_min0.2092277843034465
get_duckie_state_max1.7987599877096235e-06
get_duckie_state_mean1.743657418517957e-06
get_duckie_state_median1.738212388520634e-06
get_duckie_state_min1.7052586132243313e-06
get_robot_state_max0.013816461872796433
get_robot_state_mean0.01277434404758178
get_robot_state_median0.013759731551590411
get_robot_state_min0.0069721684070749145
get_state_dump_max0.00926645133616426
get_state_dump_mean0.008757389923246348
get_state_dump_median0.009238417202189602
get_state_dump_min0.006003466176549958
get_ui_image_max0.0485369351186125
get_ui_image_mean0.04332798886018374
get_ui_image_median0.0462778180366154
get_ui_image_min0.02910015962205263
in-drivable-lane_max57.99999999999873
in-drivable-lane_mean30.09999999999929
in-drivable-lane_min3.000000000000042
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 3.12896645873563, "get_ui_image": 0.04228312804438887, "step_physics": 0.9130737509556752, "survival_time": 59.99999999999873, "driven_lanedir": 2.200044763009948, "get_state_dump": 0.009238417202189602, "get_robot_state": 0.013647926538611929, "sim_render-ego0": 0.003684617597594249, "sim_render-ego1": 0.003646932573342304, "sim_render-ego2": 0.0035268692648678795, "sim_render-ego3": 0.0035046226873088142, "get_duckie_state": 1.7987599877096235e-06, "in-drivable-lane": 3.0500000000000185, "deviation-heading": 27.417524907837084, "agent_compute-ego0": 0.04890162422694731, "agent_compute-ego1": 0.04730320115768344, "agent_compute-ego2": 0.04709602970564792, "agent_compute-ego3": 0.04678963304657821, "complete-iteration": 1.2113047853099814, "set_robot_commands": 0.002139824216907765, "deviation-center-line": 8.87613797054082, "driven_lanedir_consec": 1.9609958672662813, "sim_compute_sim_state": 0.012294019687979744, "sim_compute_performance-ego0": 0.001885362310671588, "sim_compute_performance-ego1": 0.0019228869334148627, "sim_compute_performance-ego2": 0.001872722552678269, "sim_compute_performance-ego3": 0.0018417315121792837}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 2.123291342537121, "get_ui_image": 0.04228312804438887, "step_physics": 0.9130737509556752, "survival_time": 59.99999999999873, "driven_lanedir": 1.0933491047311272, "get_state_dump": 0.009238417202189602, "get_robot_state": 0.013647926538611929, "sim_render-ego0": 0.003684617597594249, "sim_render-ego1": 0.003646932573342304, "sim_render-ego2": 0.0035268692648678795, "sim_render-ego3": 0.0035046226873088142, "get_duckie_state": 1.7987599877096235e-06, "in-drivable-lane": 53.24999999999871, "deviation-heading": 2.469138250641944, "agent_compute-ego0": 0.04890162422694731, "agent_compute-ego1": 0.04730320115768344, "agent_compute-ego2": 0.04709602970564792, "agent_compute-ego3": 0.04678963304657821, "complete-iteration": 1.2113047853099814, "set_robot_commands": 0.002139824216907765, "deviation-center-line": 0.7056485561166665, "driven_lanedir_consec": 1.071910015542823, "sim_compute_sim_state": 0.012294019687979744, "sim_compute_performance-ego0": 0.001885362310671588, "sim_compute_performance-ego1": 0.0019228869334148627, "sim_compute_performance-ego2": 0.001872722552678269, "sim_compute_performance-ego3": 0.0018417315121792837}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 10.776116200532528, "get_ui_image": 0.04228312804438887, "step_physics": 0.9130737509556752, "survival_time": 59.99999999999873, "driven_lanedir": 7.582465908548546, "get_state_dump": 0.009238417202189602, "get_robot_state": 0.013647926538611929, "sim_render-ego0": 0.003684617597594249, "sim_render-ego1": 0.003646932573342304, "sim_render-ego2": 0.0035268692648678795, "sim_render-ego3": 0.0035046226873088142, "get_duckie_state": 1.7987599877096235e-06, "in-drivable-lane": 7.349999999999806, "deviation-heading": 29.500523302844396, "agent_compute-ego0": 0.04890162422694731, "agent_compute-ego1": 0.04730320115768344, "agent_compute-ego2": 0.04709602970564792, "agent_compute-ego3": 0.04678963304657821, "complete-iteration": 1.2113047853099814, "set_robot_commands": 0.002139824216907765, "deviation-center-line": 4.380688829640706, "driven_lanedir_consec": 5.59692933088373, "sim_compute_sim_state": 0.012294019687979744, "sim_compute_performance-ego0": 0.001885362310671588, "sim_compute_performance-ego1": 0.0019228869334148627, "sim_compute_performance-ego2": 0.001872722552678269, "sim_compute_performance-ego3": 0.0018417315121792837}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 3.064975600895236, "get_ui_image": 0.04228312804438887, "step_physics": 0.9130737509556752, "survival_time": 59.99999999999873, "driven_lanedir": 1.6226512981681769, "get_state_dump": 0.009238417202189602, "get_robot_state": 0.013647926538611929, "sim_render-ego0": 0.003684617597594249, "sim_render-ego1": 0.003646932573342304, "sim_render-ego2": 0.0035268692648678795, "sim_render-ego3": 0.0035046226873088142, "get_duckie_state": 1.7987599877096235e-06, "in-drivable-lane": 48.79999999999865, "deviation-heading": 5.075340001507113, "agent_compute-ego0": 0.04890162422694731, "agent_compute-ego1": 0.04730320115768344, "agent_compute-ego2": 0.04709602970564792, "agent_compute-ego3": 0.04678963304657821, "complete-iteration": 1.2113047853099814, "set_robot_commands": 0.002139824216907765, "deviation-center-line": 1.2118643086740724, "driven_lanedir_consec": 0.8674395367243533, "sim_compute_sim_state": 0.012294019687979744, "sim_compute_performance-ego0": 0.001885362310671588, "sim_compute_performance-ego1": 0.0019228869334148627, "sim_compute_performance-ego2": 0.001872722552678269, "sim_compute_performance-ego3": 0.0018417315121792837}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 2.343210156573418, "get_ui_image": 0.0485369351186125, "step_physics": 1.0650767583235614, "survival_time": 59.99999999999873, "driven_lanedir": 1.1743168698521005, "get_state_dump": 0.00914426310473338, "get_robot_state": 0.013816461872796433, "sim_render-ego0": 0.0035479308961333085, "sim_render-ego1": 0.003592204094727172, "sim_render-ego2": 0.003526867279700693, "sim_render-ego3": 0.003535640726081537, "get_duckie_state": 1.7131992819704285e-06, "in-drivable-lane": 51.89999999999871, "deviation-heading": 3.825852281975636, "agent_compute-ego0": 0.04990057147214256, "agent_compute-ego1": 0.049576605090888515, "agent_compute-ego2": 0.04923635994167153, "agent_compute-ego3": 0.04915648495327126, "complete-iteration": 1.397784700600134, "set_robot_commands": 0.0020933339835999907, "deviation-center-line": 0.6789953041628775, "driven_lanedir_consec": 0.9288460162090866, "sim_compute_sim_state": 0.03294427488169801, "sim_compute_performance-ego0": 0.001879137421924804, "sim_compute_performance-ego1": 0.0018958019078720817, "sim_compute_performance-ego2": 0.0018511005087160845, "sim_compute_performance-ego3": 0.001860343844169979}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 8.944435754546014, "get_ui_image": 0.0485369351186125, "step_physics": 1.0650767583235614, "survival_time": 59.99999999999873, "driven_lanedir": 1.7638385868390172, "get_state_dump": 0.00914426310473338, "get_robot_state": 0.013816461872796433, "sim_render-ego0": 0.0035479308961333085, "sim_render-ego1": 0.003592204094727172, "sim_render-ego2": 0.003526867279700693, "sim_render-ego3": 0.003535640726081537, "get_duckie_state": 1.7131992819704285e-06, "in-drivable-lane": 38.64999999999911, "deviation-heading": 19.072150775228017, "agent_compute-ego0": 0.04990057147214256, "agent_compute-ego1": 0.049576605090888515, "agent_compute-ego2": 0.04923635994167153, "agent_compute-ego3": 0.04915648495327126, "complete-iteration": 1.397784700600134, "set_robot_commands": 0.0020933339835999907, "deviation-center-line": 2.083229171271941, "driven_lanedir_consec": 1.7638385868390172, "sim_compute_sim_state": 0.03294427488169801, "sim_compute_performance-ego0": 0.001879137421924804, "sim_compute_performance-ego1": 0.0018958019078720817, "sim_compute_performance-ego2": 0.0018511005087160845, "sim_compute_performance-ego3": 0.001860343844169979}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 6.8450537074257385, "get_ui_image": 0.0485369351186125, "step_physics": 1.0650767583235614, "survival_time": 59.99999999999873, "driven_lanedir": 3.0244451419942866, "get_state_dump": 0.00914426310473338, "get_robot_state": 0.013816461872796433, "sim_render-ego0": 0.0035479308961333085, "sim_render-ego1": 0.003592204094727172, "sim_render-ego2": 0.003526867279700693, "sim_render-ego3": 0.003535640726081537, "get_duckie_state": 1.7131992819704285e-06, "in-drivable-lane": 39.799999999998775, "deviation-heading": 9.230140567608048, "agent_compute-ego0": 0.04990057147214256, "agent_compute-ego1": 0.049576605090888515, "agent_compute-ego2": 0.04923635994167153, "agent_compute-ego3": 0.04915648495327126, "complete-iteration": 1.397784700600134, "set_robot_commands": 0.0020933339835999907, "deviation-center-line": 2.23041810585849, "driven_lanedir_consec": 2.1424317462103355, "sim_compute_sim_state": 0.03294427488169801, "sim_compute_performance-ego0": 0.001879137421924804, "sim_compute_performance-ego1": 0.0018958019078720817, "sim_compute_performance-ego2": 0.0018511005087160845, "sim_compute_performance-ego3": 0.001860343844169979}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 10.692747873221288, "get_ui_image": 0.0485369351186125, "step_physics": 1.0650767583235614, "survival_time": 59.99999999999873, "driven_lanedir": 4.664025006709611, "get_state_dump": 0.00914426310473338, "get_robot_state": 0.013816461872796433, "sim_render-ego0": 0.0035479308961333085, "sim_render-ego1": 0.003592204094727172, "sim_render-ego2": 0.003526867279700693, "sim_render-ego3": 0.003535640726081537, "get_duckie_state": 1.7131992819704285e-06, "in-drivable-lane": 27.099999999999493, "deviation-heading": 18.51254282202185, "agent_compute-ego0": 0.04990057147214256, "agent_compute-ego1": 0.049576605090888515, "agent_compute-ego2": 0.04923635994167153, "agent_compute-ego3": 0.04915648495327126, "complete-iteration": 1.397784700600134, "set_robot_commands": 0.0020933339835999907, "deviation-center-line": 2.6520009641181286, "driven_lanedir_consec": 3.041742064737644, "sim_compute_sim_state": 0.03294427488169801, "sim_compute_performance-ego0": 0.001879137421924804, "sim_compute_performance-ego1": 0.0018958019078720817, "sim_compute_performance-ego2": 0.0018511005087160845, "sim_compute_performance-ego3": 0.001860343844169979}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.3634023651642794, "get_ui_image": 0.0462778180366154, "step_physics": 1.0194923276210406, "survival_time": 59.99999999999873, "driven_lanedir": 0.30731526985166213, "get_state_dump": 0.00926645133616426, "get_robot_state": 0.013759731551590411, "sim_render-ego0": 0.003643739034889342, "sim_render-ego1": 0.0035895705719375293, "sim_render-ego2": 0.0035731931411654228, "sim_render-ego3": 0.0035818615722020995, "get_duckie_state": 1.738212388520634e-06, "in-drivable-lane": 57.59999999999873, "deviation-heading": 1.198068853730612, "agent_compute-ego0": 0.04862534056892998, "agent_compute-ego1": 0.04733588078139128, "agent_compute-ego2": 0.04720853587967669, "agent_compute-ego3": 0.047341104153292464, "complete-iteration": 1.3336973303462147, "set_robot_commands": 0.002226815037088132, "deviation-center-line": 0.1302480277093724, "driven_lanedir_consec": 0.30731526985166213, "sim_compute_sim_state": 0.02364634832275797, "sim_compute_performance-ego0": 0.001865647416825497, "sim_compute_performance-ego1": 0.0019002723058594156, "sim_compute_performance-ego2": 0.001871879253657434, "sim_compute_performance-ego3": 0.001859410418558875}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 9.790373911134512, "get_ui_image": 0.0462778180366154, "step_physics": 1.0194923276210406, "survival_time": 59.99999999999873, "driven_lanedir": 5.7276029531191766, "get_state_dump": 0.00926645133616426, "get_robot_state": 0.013759731551590411, "sim_render-ego0": 0.003643739034889342, "sim_render-ego1": 0.0035895705719375293, "sim_render-ego2": 0.0035731931411654228, "sim_render-ego3": 0.0035818615722020995, "get_duckie_state": 1.738212388520634e-06, "in-drivable-lane": 15.499999999999527, "deviation-heading": 22.35779160467515, "agent_compute-ego0": 0.04862534056892998, "agent_compute-ego1": 0.04733588078139128, "agent_compute-ego2": 0.04720853587967669, "agent_compute-ego3": 0.047341104153292464, "complete-iteration": 1.3336973303462147, "set_robot_commands": 0.002226815037088132, "deviation-center-line": 4.586804647639471, "driven_lanedir_consec": 3.818458238093246, "sim_compute_sim_state": 0.02364634832275797, "sim_compute_performance-ego0": 0.001865647416825497, "sim_compute_performance-ego1": 0.0019002723058594156, "sim_compute_performance-ego2": 0.001871879253657434, "sim_compute_performance-ego3": 0.001859410418558875}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 10.487705621588058, "get_ui_image": 0.0462778180366154, "step_physics": 1.0194923276210406, "survival_time": 59.99999999999873, "driven_lanedir": 6.348355409264102, "get_state_dump": 0.00926645133616426, "get_robot_state": 0.013759731551590411, "sim_render-ego0": 0.003643739034889342, "sim_render-ego1": 0.0035895705719375293, "sim_render-ego2": 0.0035731931411654228, "sim_render-ego3": 0.0035818615722020995, "get_duckie_state": 1.738212388520634e-06, "in-drivable-lane": 12.599999999999763, "deviation-heading": 28.95512631438973, "agent_compute-ego0": 0.04862534056892998, "agent_compute-ego1": 0.04733588078139128, "agent_compute-ego2": 0.04720853587967669, "agent_compute-ego3": 0.047341104153292464, "complete-iteration": 1.3336973303462147, "set_robot_commands": 0.002226815037088132, "deviation-center-line": 3.3502810569349646, "driven_lanedir_consec": 3.880707710189346, "sim_compute_sim_state": 0.02364634832275797, "sim_compute_performance-ego0": 0.001865647416825497, "sim_compute_performance-ego1": 0.0019002723058594156, "sim_compute_performance-ego2": 0.001871879253657434, "sim_compute_performance-ego3": 0.001859410418558875}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 0.3330580690812184, "get_ui_image": 0.0462778180366154, "step_physics": 1.0194923276210406, "survival_time": 59.99999999999873, "driven_lanedir": 0.2092277843034465, "get_state_dump": 0.00926645133616426, "get_robot_state": 0.013759731551590411, "sim_render-ego0": 0.003643739034889342, "sim_render-ego1": 0.0035895705719375293, "sim_render-ego2": 0.0035731931411654228, "sim_render-ego3": 0.0035818615722020995, "get_duckie_state": 1.738212388520634e-06, "in-drivable-lane": 57.99999999999873, "deviation-heading": 1.120196860803528, "agent_compute-ego0": 0.04862534056892998, "agent_compute-ego1": 0.04733588078139128, "agent_compute-ego2": 0.04720853587967669, "agent_compute-ego3": 0.047341104153292464, "complete-iteration": 1.3336973303462147, "set_robot_commands": 0.002226815037088132, "deviation-center-line": 0.22923175679065436, "driven_lanedir_consec": 0.0713018264667693, "sim_compute_sim_state": 0.02364634832275797, "sim_compute_performance-ego0": 0.001865647416825497, "sim_compute_performance-ego1": 0.0019002723058594156, "sim_compute_performance-ego2": 0.001871879253657434, "sim_compute_performance-ego3": 0.001859410418558875}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 10.85519178954467, "get_ui_image": 0.02910015962205263, "step_physics": 0.20783204500323824, "survival_time": 59.99999999999873, "driven_lanedir": 9.37050483000846, "get_state_dump": 0.006003466176549958, "get_robot_state": 0.0069721684070749145, "sim_render-ego0": 0.0036623509698466, "sim_render-ego1": 0.0036426448107361297, "get_duckie_state": 1.7052586132243313e-06, "in-drivable-lane": 4.799999999999999, "deviation-heading": 14.873014061783174, "agent_compute-ego0": 0.04892367983142303, "agent_compute-ego1": 0.04743947812063708, "complete-iteration": 0.3720323104445484, "set_robot_commands": 0.002118898768111331, "deviation-center-line": 3.2266280423260447, "driven_lanedir_consec": 6.899555375316785, "sim_compute_sim_state": 0.010160581158360871, "sim_compute_performance-ego0": 0.0019222558487662664, "sim_compute_performance-ego1": 0.0019174291132689515}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 10.916185501809172, "get_ui_image": 0.02910015962205263, "step_physics": 0.20783204500323824, "survival_time": 59.99999999999873, "driven_lanedir": 9.793336150145787, "get_state_dump": 0.006003466176549958, "get_robot_state": 0.0069721684070749145, "sim_render-ego0": 0.0036623509698466, "sim_render-ego1": 0.0036426448107361297, "get_duckie_state": 1.7052586132243313e-06, "in-drivable-lane": 3.000000000000042, "deviation-heading": 14.833471738206592, "agent_compute-ego0": 0.04892367983142303, "agent_compute-ego1": 0.04743947812063708, "complete-iteration": 0.3720323104445484, "set_robot_commands": 0.002118898768111331, "deviation-center-line": 3.19475280055045, "driven_lanedir_consec": 9.592600259638385, "sim_compute_sim_state": 0.010160581158360871, "sim_compute_performance-ego0": 0.0019222558487662664, "sim_compute_performance-ego1": 0.0019174291132689515}}
set_robot_commands_max0.002226815037088132
set_robot_commands_mean0.002148406463329015
set_robot_commands_median0.002139824216907765
set_robot_commands_min0.0020933339835999907
sim_compute_performance-ego0_max0.0019222558487662664
sim_compute_performance-ego0_mean0.0018832214496585771
sim_compute_performance-ego0_median0.001879137421924804
sim_compute_performance-ego0_min0.001865647416825497
sim_compute_performance-ego1_max0.0019228869334148627
sim_compute_performance-ego1_mean0.001907907343937381
sim_compute_performance-ego1_median0.0019002723058594156
sim_compute_performance-ego1_min0.0018958019078720817
sim_compute_performance-ego2_max0.001872722552678269
sim_compute_performance-ego2_mean0.0018652341050172628
sim_compute_performance-ego2_median0.001871879253657434
sim_compute_performance-ego2_min0.0018511005087160845
sim_compute_performance-ego3_max0.001860343844169979
sim_compute_performance-ego3_mean0.0018538285916360456
sim_compute_performance-ego3_median0.001859410418558875
sim_compute_performance-ego3_min0.0018417315121792837
sim_compute_sim_state_max0.03294427488169801
sim_compute_sim_state_mean0.021132838134747475
sim_compute_sim_state_median0.02364634832275797
sim_compute_sim_state_min0.010160581158360871
sim_render-ego0_max0.003684617597594249
sim_render-ego0_mean0.003630703718154342
sim_render-ego0_median0.003643739034889342
sim_render-ego0_min0.0035479308961333085
sim_render-ego1_max0.003646932573342304
sim_render-ego1_mean0.003614294184392878
sim_render-ego1_median0.003592204094727172
sim_render-ego1_min0.0035895705719375293
sim_render-ego2_max0.0035731931411654228
sim_render-ego2_mean0.003542309895244665
sim_render-ego2_median0.0035268692648678795
sim_render-ego2_min0.003526867279700693
sim_render-ego3_max0.0035818615722020995
sim_render-ego3_mean0.003540708328530816
sim_render-ego3_median0.003535640726081537
sim_render-ego3_min0.0035046226873088142
simulation-passed1
step_physics_max1.0650767583235614
step_physics_mean0.8861596741148278
step_physics_median1.0194923276210406
step_physics_min0.20783204500323824
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873
No reset possible