Duckietown Challenges Home Challenges Submissions

Submission 12896

Submission12896
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserAleksei Shpilman 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 59143
Next
User labelsim2real
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
59143LFVmultibodyv-simsuccessyes2:21:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0517138067383085
survival_time_median59.99999999999873
deviation-center-line_median2.4412095349883094
in-drivable-lane_median32.874999999999304


other stats
agent_compute-ego0_max0.04990057147214256
agent_compute-ego0_mean0.04911125033820896
agent_compute-ego0_median0.04890162422694731
agent_compute-ego0_min0.04862534056892998
agent_compute-ego1_max0.049576605090888515
agent_compute-ego1_mean0.04798155031150908
agent_compute-ego1_median0.04733588078139128
agent_compute-ego1_min0.04730320115768344
agent_compute-ego2_max0.04923635994167153
agent_compute-ego2_mean0.04784697517566538
agent_compute-ego2_median0.04720853587967669
agent_compute-ego2_min0.04709602970564792
agent_compute-ego3_max0.04915648495327126
agent_compute-ego3_mean0.04776240738438065
agent_compute-ego3_median0.047341104153292464
agent_compute-ego3_min0.04678963304657821
complete-iteration_max1.397784700600134
complete-iteration_mean1.17965799185103
complete-iteration_median1.3336973303462147
complete-iteration_min0.3720323104445484
deviation-center-line_max8.87613797054082
deviation-center-line_mean2.681209253023904
deviation-center-line_min0.1302480277093724
deviation-heading_max29.500523302844396
deviation-heading_mean14.174348738803774
deviation-heading_median14.853242899994882
deviation-heading_min1.120196860803528
driven_any_max10.916185501809172
driven_any_mean6.476051025199205
driven_any_median7.894744730985876
driven_any_min0.3330580690812184
driven_lanedir_consec_max9.592600259638385
driven_lanedir_consec_mean2.996005131712105
driven_lanedir_consec_min0.0713018264667693
driven_lanedir_max9.793336150145787
driven_lanedir_mean3.920105648324675
driven_lanedir_median2.6122449525021176
driven_lanedir_min0.2092277843034465
get_duckie_state_max1.7987599877096235e-06
get_duckie_state_mean1.743657418517957e-06
get_duckie_state_median1.738212388520634e-06
get_duckie_state_min1.7052586132243313e-06
get_robot_state_max0.013816461872796433
get_robot_state_mean0.01277434404758178
get_robot_state_median0.013759731551590411
get_robot_state_min0.0069721684070749145
get_state_dump_max0.00926645133616426
get_state_dump_mean0.008757389923246348
get_state_dump_median0.009238417202189602
get_state_dump_min0.006003466176549958
get_ui_image_max0.0485369351186125
get_ui_image_mean0.04332798886018374
get_ui_image_median0.0462778180366154
get_ui_image_min0.02910015962205263
in-drivable-lane_max57.99999999999873
in-drivable-lane_mean30.09999999999929
in-drivable-lane_min3.000000000000042
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 3.12896645873563, "get_ui_image": 0.04228312804438887, "step_physics": 0.9130737509556752, "survival_time": 59.99999999999873, "driven_lanedir": 2.200044763009948, "get_state_dump": 0.009238417202189602, "get_robot_state": 0.013647926538611929, "sim_render-ego0": 0.003684617597594249, "sim_render-ego1": 0.003646932573342304, "sim_render-ego2": 0.0035268692648678795, "sim_render-ego3": 0.0035046226873088142, "get_duckie_state": 1.7987599877096235e-06, "in-drivable-lane": 3.0500000000000185, "deviation-heading": 27.417524907837084, "agent_compute-ego0": 0.04890162422694731, "agent_compute-ego1": 0.04730320115768344, "agent_compute-ego2": 0.04709602970564792, "agent_compute-ego3": 0.04678963304657821, "complete-iteration": 1.2113047853099814, "set_robot_commands": 0.002139824216907765, "deviation-center-line": 8.87613797054082, "driven_lanedir_consec": 1.9609958672662813, "sim_compute_sim_state": 0.012294019687979744, "sim_compute_performance-ego0": 0.001885362310671588, "sim_compute_performance-ego1": 0.0019228869334148627, "sim_compute_performance-ego2": 0.001872722552678269, "sim_compute_performance-ego3": 0.0018417315121792837}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 2.123291342537121, "get_ui_image": 0.04228312804438887, "step_physics": 0.9130737509556752, "survival_time": 59.99999999999873, "driven_lanedir": 1.0933491047311272, "get_state_dump": 0.009238417202189602, "get_robot_state": 0.013647926538611929, "sim_render-ego0": 0.003684617597594249, "sim_render-ego1": 0.003646932573342304, "sim_render-ego2": 0.0035268692648678795, "sim_render-ego3": 0.0035046226873088142, "get_duckie_state": 1.7987599877096235e-06, "in-drivable-lane": 53.24999999999871, "deviation-heading": 2.469138250641944, "agent_compute-ego0": 0.04890162422694731, "agent_compute-ego1": 0.04730320115768344, "agent_compute-ego2": 0.04709602970564792, "agent_compute-ego3": 0.04678963304657821, "complete-iteration": 1.2113047853099814, "set_robot_commands": 0.002139824216907765, "deviation-center-line": 0.7056485561166665, "driven_lanedir_consec": 1.071910015542823, "sim_compute_sim_state": 0.012294019687979744, "sim_compute_performance-ego0": 0.001885362310671588, "sim_compute_performance-ego1": 0.0019228869334148627, "sim_compute_performance-ego2": 0.001872722552678269, "sim_compute_performance-ego3": 0.0018417315121792837}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 10.776116200532528, "get_ui_image": 0.04228312804438887, "step_physics": 0.9130737509556752, "survival_time": 59.99999999999873, "driven_lanedir": 7.582465908548546, "get_state_dump": 0.009238417202189602, "get_robot_state": 0.013647926538611929, "sim_render-ego0": 0.003684617597594249, "sim_render-ego1": 0.003646932573342304, "sim_render-ego2": 0.0035268692648678795, "sim_render-ego3": 0.0035046226873088142, "get_duckie_state": 1.7987599877096235e-06, "in-drivable-lane": 7.349999999999806, "deviation-heading": 29.500523302844396, "agent_compute-ego0": 0.04890162422694731, "agent_compute-ego1": 0.04730320115768344, "agent_compute-ego2": 0.04709602970564792, "agent_compute-ego3": 0.04678963304657821, "complete-iteration": 1.2113047853099814, "set_robot_commands": 0.002139824216907765, "deviation-center-line": 4.380688829640706, "driven_lanedir_consec": 5.59692933088373, "sim_compute_sim_state": 0.012294019687979744, "sim_compute_performance-ego0": 0.001885362310671588, "sim_compute_performance-ego1": 0.0019228869334148627, "sim_compute_performance-ego2": 0.001872722552678269, "sim_compute_performance-ego3": 0.0018417315121792837}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 3.064975600895236, "get_ui_image": 0.04228312804438887, "step_physics": 0.9130737509556752, "survival_time": 59.99999999999873, "driven_lanedir": 1.6226512981681769, "get_state_dump": 0.009238417202189602, "get_robot_state": 0.013647926538611929, "sim_render-ego0": 0.003684617597594249, "sim_render-ego1": 0.003646932573342304, "sim_render-ego2": 0.0035268692648678795, "sim_render-ego3": 0.0035046226873088142, "get_duckie_state": 1.7987599877096235e-06, "in-drivable-lane": 48.79999999999865, "deviation-heading": 5.075340001507113, "agent_compute-ego0": 0.04890162422694731, "agent_compute-ego1": 0.04730320115768344, "agent_compute-ego2": 0.04709602970564792, "agent_compute-ego3": 0.04678963304657821, "complete-iteration": 1.2113047853099814, "set_robot_commands": 0.002139824216907765, "deviation-center-line": 1.2118643086740724, "driven_lanedir_consec": 0.8674395367243533, "sim_compute_sim_state": 0.012294019687979744, "sim_compute_performance-ego0": 0.001885362310671588, "sim_compute_performance-ego1": 0.0019228869334148627, "sim_compute_performance-ego2": 0.001872722552678269, "sim_compute_performance-ego3": 0.0018417315121792837}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 2.343210156573418, "get_ui_image": 0.0485369351186125, "step_physics": 1.0650767583235614, "survival_time": 59.99999999999873, "driven_lanedir": 1.1743168698521005, "get_state_dump": 0.00914426310473338, "get_robot_state": 0.013816461872796433, "sim_render-ego0": 0.0035479308961333085, "sim_render-ego1": 0.003592204094727172, "sim_render-ego2": 0.003526867279700693, "sim_render-ego3": 0.003535640726081537, "get_duckie_state": 1.7131992819704285e-06, "in-drivable-lane": 51.89999999999871, "deviation-heading": 3.825852281975636, "agent_compute-ego0": 0.04990057147214256, "agent_compute-ego1": 0.049576605090888515, "agent_compute-ego2": 0.04923635994167153, "agent_compute-ego3": 0.04915648495327126, "complete-iteration": 1.397784700600134, "set_robot_commands": 0.0020933339835999907, "deviation-center-line": 0.6789953041628775, "driven_lanedir_consec": 0.9288460162090866, "sim_compute_sim_state": 0.03294427488169801, "sim_compute_performance-ego0": 0.001879137421924804, "sim_compute_performance-ego1": 0.0018958019078720817, "sim_compute_performance-ego2": 0.0018511005087160845, "sim_compute_performance-ego3": 0.001860343844169979}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 8.944435754546014, "get_ui_image": 0.0485369351186125, "step_physics": 1.0650767583235614, "survival_time": 59.99999999999873, "driven_lanedir": 1.7638385868390172, "get_state_dump": 0.00914426310473338, "get_robot_state": 0.013816461872796433, "sim_render-ego0": 0.0035479308961333085, "sim_render-ego1": 0.003592204094727172, "sim_render-ego2": 0.003526867279700693, "sim_render-ego3": 0.003535640726081537, "get_duckie_state": 1.7131992819704285e-06, "in-drivable-lane": 38.64999999999911, "deviation-heading": 19.072150775228017, "agent_compute-ego0": 0.04990057147214256, "agent_compute-ego1": 0.049576605090888515, "agent_compute-ego2": 0.04923635994167153, "agent_compute-ego3": 0.04915648495327126, "complete-iteration": 1.397784700600134, "set_robot_commands": 0.0020933339835999907, "deviation-center-line": 2.083229171271941, "driven_lanedir_consec": 1.7638385868390172, "sim_compute_sim_state": 0.03294427488169801, "sim_compute_performance-ego0": 0.001879137421924804, "sim_compute_performance-ego1": 0.0018958019078720817, "sim_compute_performance-ego2": 0.0018511005087160845, "sim_compute_performance-ego3": 0.001860343844169979}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 6.8450537074257385, "get_ui_image": 0.0485369351186125, "step_physics": 1.0650767583235614, "survival_time": 59.99999999999873, "driven_lanedir": 3.0244451419942866, "get_state_dump": 0.00914426310473338, "get_robot_state": 0.013816461872796433, "sim_render-ego0": 0.0035479308961333085, "sim_render-ego1": 0.003592204094727172, "sim_render-ego2": 0.003526867279700693, "sim_render-ego3": 0.003535640726081537, "get_duckie_state": 1.7131992819704285e-06, "in-drivable-lane": 39.799999999998775, "deviation-heading": 9.230140567608048, "agent_compute-ego0": 0.04990057147214256, "agent_compute-ego1": 0.049576605090888515, "agent_compute-ego2": 0.04923635994167153, "agent_compute-ego3": 0.04915648495327126, "complete-iteration": 1.397784700600134, "set_robot_commands": 0.0020933339835999907, "deviation-center-line": 2.23041810585849, "driven_lanedir_consec": 2.1424317462103355, "sim_compute_sim_state": 0.03294427488169801, "sim_compute_performance-ego0": 0.001879137421924804, "sim_compute_performance-ego1": 0.0018958019078720817, "sim_compute_performance-ego2": 0.0018511005087160845, "sim_compute_performance-ego3": 0.001860343844169979}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 10.692747873221288, "get_ui_image": 0.0485369351186125, "step_physics": 1.0650767583235614, "survival_time": 59.99999999999873, "driven_lanedir": 4.664025006709611, "get_state_dump": 0.00914426310473338, "get_robot_state": 0.013816461872796433, "sim_render-ego0": 0.0035479308961333085, "sim_render-ego1": 0.003592204094727172, "sim_render-ego2": 0.003526867279700693, "sim_render-ego3": 0.003535640726081537, "get_duckie_state": 1.7131992819704285e-06, "in-drivable-lane": 27.099999999999493, "deviation-heading": 18.51254282202185, "agent_compute-ego0": 0.04990057147214256, "agent_compute-ego1": 0.049576605090888515, "agent_compute-ego2": 0.04923635994167153, "agent_compute-ego3": 0.04915648495327126, "complete-iteration": 1.397784700600134, "set_robot_commands": 0.0020933339835999907, "deviation-center-line": 2.6520009641181286, "driven_lanedir_consec": 3.041742064737644, "sim_compute_sim_state": 0.03294427488169801, "sim_compute_performance-ego0": 0.001879137421924804, "sim_compute_performance-ego1": 0.0018958019078720817, "sim_compute_performance-ego2": 0.0018511005087160845, "sim_compute_performance-ego3": 0.001860343844169979}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.3634023651642794, "get_ui_image": 0.0462778180366154, "step_physics": 1.0194923276210406, "survival_time": 59.99999999999873, "driven_lanedir": 0.30731526985166213, "get_state_dump": 0.00926645133616426, "get_robot_state": 0.013759731551590411, "sim_render-ego0": 0.003643739034889342, "sim_render-ego1": 0.0035895705719375293, "sim_render-ego2": 0.0035731931411654228, "sim_render-ego3": 0.0035818615722020995, "get_duckie_state": 1.738212388520634e-06, "in-drivable-lane": 57.59999999999873, "deviation-heading": 1.198068853730612, "agent_compute-ego0": 0.04862534056892998, "agent_compute-ego1": 0.04733588078139128, "agent_compute-ego2": 0.04720853587967669, "agent_compute-ego3": 0.047341104153292464, "complete-iteration": 1.3336973303462147, "set_robot_commands": 0.002226815037088132, "deviation-center-line": 0.1302480277093724, "driven_lanedir_consec": 0.30731526985166213, "sim_compute_sim_state": 0.02364634832275797, "sim_compute_performance-ego0": 0.001865647416825497, "sim_compute_performance-ego1": 0.0019002723058594156, "sim_compute_performance-ego2": 0.001871879253657434, "sim_compute_performance-ego3": 0.001859410418558875}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 9.790373911134512, "get_ui_image": 0.0462778180366154, "step_physics": 1.0194923276210406, "survival_time": 59.99999999999873, "driven_lanedir": 5.7276029531191766, "get_state_dump": 0.00926645133616426, "get_robot_state": 0.013759731551590411, "sim_render-ego0": 0.003643739034889342, "sim_render-ego1": 0.0035895705719375293, "sim_render-ego2": 0.0035731931411654228, "sim_render-ego3": 0.0035818615722020995, "get_duckie_state": 1.738212388520634e-06, "in-drivable-lane": 15.499999999999527, "deviation-heading": 22.35779160467515, "agent_compute-ego0": 0.04862534056892998, "agent_compute-ego1": 0.04733588078139128, "agent_compute-ego2": 0.04720853587967669, "agent_compute-ego3": 0.047341104153292464, "complete-iteration": 1.3336973303462147, "set_robot_commands": 0.002226815037088132, "deviation-center-line": 4.586804647639471, "driven_lanedir_consec": 3.818458238093246, "sim_compute_sim_state": 0.02364634832275797, "sim_compute_performance-ego0": 0.001865647416825497, "sim_compute_performance-ego1": 0.0019002723058594156, "sim_compute_performance-ego2": 0.001871879253657434, "sim_compute_performance-ego3": 0.001859410418558875}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 10.487705621588058, "get_ui_image": 0.0462778180366154, "step_physics": 1.0194923276210406, "survival_time": 59.99999999999873, "driven_lanedir": 6.348355409264102, "get_state_dump": 0.00926645133616426, "get_robot_state": 0.013759731551590411, "sim_render-ego0": 0.003643739034889342, "sim_render-ego1": 0.0035895705719375293, "sim_render-ego2": 0.0035731931411654228, "sim_render-ego3": 0.0035818615722020995, "get_duckie_state": 1.738212388520634e-06, "in-drivable-lane": 12.599999999999763, "deviation-heading": 28.95512631438973, "agent_compute-ego0": 0.04862534056892998, "agent_compute-ego1": 0.04733588078139128, "agent_compute-ego2": 0.04720853587967669, "agent_compute-ego3": 0.047341104153292464, "complete-iteration": 1.3336973303462147, "set_robot_commands": 0.002226815037088132, "deviation-center-line": 3.3502810569349646, "driven_lanedir_consec": 3.880707710189346, "sim_compute_sim_state": 0.02364634832275797, "sim_compute_performance-ego0": 0.001865647416825497, "sim_compute_performance-ego1": 0.0019002723058594156, "sim_compute_performance-ego2": 0.001871879253657434, "sim_compute_performance-ego3": 0.001859410418558875}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 0.3330580690812184, "get_ui_image": 0.0462778180366154, "step_physics": 1.0194923276210406, "survival_time": 59.99999999999873, "driven_lanedir": 0.2092277843034465, "get_state_dump": 0.00926645133616426, "get_robot_state": 0.013759731551590411, "sim_render-ego0": 0.003643739034889342, "sim_render-ego1": 0.0035895705719375293, "sim_render-ego2": 0.0035731931411654228, "sim_render-ego3": 0.0035818615722020995, "get_duckie_state": 1.738212388520634e-06, "in-drivable-lane": 57.99999999999873, "deviation-heading": 1.120196860803528, "agent_compute-ego0": 0.04862534056892998, "agent_compute-ego1": 0.04733588078139128, "agent_compute-ego2": 0.04720853587967669, "agent_compute-ego3": 0.047341104153292464, "complete-iteration": 1.3336973303462147, "set_robot_commands": 0.002226815037088132, "deviation-center-line": 0.22923175679065436, "driven_lanedir_consec": 0.0713018264667693, "sim_compute_sim_state": 0.02364634832275797, "sim_compute_performance-ego0": 0.001865647416825497, "sim_compute_performance-ego1": 0.0019002723058594156, "sim_compute_performance-ego2": 0.001871879253657434, "sim_compute_performance-ego3": 0.001859410418558875}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 10.85519178954467, "get_ui_image": 0.02910015962205263, "step_physics": 0.20783204500323824, "survival_time": 59.99999999999873, "driven_lanedir": 9.37050483000846, "get_state_dump": 0.006003466176549958, "get_robot_state": 0.0069721684070749145, "sim_render-ego0": 0.0036623509698466, "sim_render-ego1": 0.0036426448107361297, "get_duckie_state": 1.7052586132243313e-06, "in-drivable-lane": 4.799999999999999, "deviation-heading": 14.873014061783174, "agent_compute-ego0": 0.04892367983142303, "agent_compute-ego1": 0.04743947812063708, "complete-iteration": 0.3720323104445484, "set_robot_commands": 0.002118898768111331, "deviation-center-line": 3.2266280423260447, "driven_lanedir_consec": 6.899555375316785, "sim_compute_sim_state": 0.010160581158360871, "sim_compute_performance-ego0": 0.0019222558487662664, "sim_compute_performance-ego1": 0.0019174291132689515}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 10.916185501809172, "get_ui_image": 0.02910015962205263, "step_physics": 0.20783204500323824, "survival_time": 59.99999999999873, "driven_lanedir": 9.793336150145787, "get_state_dump": 0.006003466176549958, "get_robot_state": 0.0069721684070749145, "sim_render-ego0": 0.0036623509698466, "sim_render-ego1": 0.0036426448107361297, "get_duckie_state": 1.7052586132243313e-06, "in-drivable-lane": 3.000000000000042, "deviation-heading": 14.833471738206592, "agent_compute-ego0": 0.04892367983142303, "agent_compute-ego1": 0.04743947812063708, "complete-iteration": 0.3720323104445484, "set_robot_commands": 0.002118898768111331, "deviation-center-line": 3.19475280055045, "driven_lanedir_consec": 9.592600259638385, "sim_compute_sim_state": 0.010160581158360871, "sim_compute_performance-ego0": 0.0019222558487662664, "sim_compute_performance-ego1": 0.0019174291132689515}}
set_robot_commands_max0.002226815037088132
set_robot_commands_mean0.002148406463329015
set_robot_commands_median0.002139824216907765
set_robot_commands_min0.0020933339835999907
sim_compute_performance-ego0_max0.0019222558487662664
sim_compute_performance-ego0_mean0.0018832214496585771
sim_compute_performance-ego0_median0.001879137421924804
sim_compute_performance-ego0_min0.001865647416825497
sim_compute_performance-ego1_max0.0019228869334148627
sim_compute_performance-ego1_mean0.001907907343937381
sim_compute_performance-ego1_median0.0019002723058594156
sim_compute_performance-ego1_min0.0018958019078720817
sim_compute_performance-ego2_max0.001872722552678269
sim_compute_performance-ego2_mean0.0018652341050172628
sim_compute_performance-ego2_median0.001871879253657434
sim_compute_performance-ego2_min0.0018511005087160845
sim_compute_performance-ego3_max0.001860343844169979
sim_compute_performance-ego3_mean0.0018538285916360456
sim_compute_performance-ego3_median0.001859410418558875
sim_compute_performance-ego3_min0.0018417315121792837
sim_compute_sim_state_max0.03294427488169801
sim_compute_sim_state_mean0.021132838134747475
sim_compute_sim_state_median0.02364634832275797
sim_compute_sim_state_min0.010160581158360871
sim_render-ego0_max0.003684617597594249
sim_render-ego0_mean0.003630703718154342
sim_render-ego0_median0.003643739034889342
sim_render-ego0_min0.0035479308961333085
sim_render-ego1_max0.003646932573342304
sim_render-ego1_mean0.003614294184392878
sim_render-ego1_median0.003592204094727172
sim_render-ego1_min0.0035895705719375293
sim_render-ego2_max0.0035731931411654228
sim_render-ego2_mean0.003542309895244665
sim_render-ego2_median0.0035268692648678795
sim_render-ego2_min0.003526867279700693
sim_render-ego3_max0.0035818615722020995
sim_render-ego3_mean0.003540708328530816
sim_render-ego3_median0.003535640726081537
sim_render-ego3_min0.0035046226873088142
simulation-passed1
step_physics_max1.0650767583235614
step_physics_mean0.8861596741148278
step_physics_median1.0194923276210406
step_physics_min0.20783204500323824
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873
No reset possible