Duckietown Challenges Home Challenges Submissions

Submission 13022

Submission13022
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserMárton Tim 🇭🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60271
Next
User labelLF-only
Admin priority50
Blessingn/a
User priority50

60271

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

challenge-solution-output

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
60271LFVmultibodyv-simsuccessyes2:17:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median21.61000459893521
survival_time_median59.99999999999873
deviation-center-line_median3.545905221070157
in-drivable-lane_median0.9749999999999748


other stats
agent_compute-ego0_max0.0424270975301903
agent_compute-ego0_mean0.04200368378642121
agent_compute-ego0_median0.04211758415863774
agent_compute-ego0_min0.04113693270287495
agent_compute-ego1_max0.04237950116172619
agent_compute-ego1_mean0.04193143138564818
agent_compute-ego1_median0.04215207901922094
agent_compute-ego1_min0.041419743784802704
agent_compute-ego2_max0.04204949193155637
agent_compute-ego2_mean0.04173602986395309
agent_compute-ego2_median0.04200649618804703
agent_compute-ego2_min0.04115210147225589
agent_compute-ego3_max0.04230099871791868
agent_compute-ego3_mean0.04139791691663892
agent_compute-ego3_median0.04105037177829917
agent_compute-ego3_min0.04084238025369891
complete-iteration_max1.3178619494743886
complete-iteration_mean1.0991179879018516
complete-iteration_median1.3005676672520188
complete-iteration_min0.4187182687487998
deviation-center-line_max4.304454387249305
deviation-center-line_mean3.6279124879535978
deviation-center-line_min2.204671180929971
deviation-heading_max20.233198041272072
deviation-heading_mean16.624619301354336
deviation-heading_median16.81948813742953
deviation-heading_min10.770612203769272
driven_any_max27.019738066559125
driven_any_mean23.398182048802187
driven_any_median24.500892879258984
driven_any_min16.206423121707367
driven_lanedir_consec_max25.582242713884984
driven_lanedir_consec_mean21.34326315048699
driven_lanedir_consec_min14.509231350632056
driven_lanedir_max25.582242713884984
driven_lanedir_mean21.34326315048699
driven_lanedir_median21.61000459893521
driven_lanedir_min14.509231350632056
get_duckie_state_max1.3878303800991037e-06
get_duckie_state_mean1.3339121295923175e-06
get_duckie_state_median1.3785000943224395e-06
get_duckie_state_min1.2283739836319634e-06
get_robot_state_max0.014474643656455111
get_robot_state_mean0.013087748350939343
get_robot_state_median0.014048130287913655
get_robot_state_min0.00696481617071883
get_state_dump_max0.00956838930973304
get_state_dump_mean0.008952821954444601
get_state_dump_median0.009364203350629338
get_state_dump_min0.006113965991928643
get_ui_image_max0.04987891290110414
get_ui_image_mean0.04398861667983745
get_ui_image_median0.04689811925705426
get_ui_image_min0.0296315767548301
in-drivable-lane_max25.19999999999859
in-drivable-lane_mean3.5928571428569893
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 27.019738066559125, "get_ui_image": 0.042367337843857635, "step_physics": 0.7244586847306886, "survival_time": 59.99999999999873, "driven_lanedir": 25.303808038301213, "get_state_dump": 0.00934530118422941, "get_robot_state": 0.014048130287913655, "sim_render-ego0": 0.003723977308884747, "sim_render-ego1": 0.0037456064994488033, "sim_render-ego2": 0.0036635688699155327, "sim_render-ego3": 0.0036385704536025074, "get_duckie_state": 1.3878303800991037e-06, "in-drivable-lane": 0.70000000000001, "deviation-heading": 16.75725945472029, "agent_compute-ego0": 0.04189974521220872, "agent_compute-ego1": 0.04215207901922094, "agent_compute-ego2": 0.04115210147225589, "agent_compute-ego3": 0.04084238025369891, "complete-iteration": 1.0191242065556738, "set_robot_commands": 0.0021862120155887142, "deviation-center-line": 3.4387961071160213, "driven_lanedir_consec": 25.303808038301213, "sim_compute_sim_state": 0.03124492511860437, "sim_compute_performance-ego0": 0.0019668984869735426, "sim_compute_performance-ego1": 0.001933159975088407, "sim_compute_performance-ego2": 0.0019364096937727472, "sim_compute_performance-ego3": 0.0019244012189447433}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 26.970845947226703, "get_ui_image": 0.042367337843857635, "step_physics": 0.7244586847306886, "survival_time": 59.99999999999873, "driven_lanedir": 25.582242713884984, "get_state_dump": 0.00934530118422941, "get_robot_state": 0.014048130287913655, "sim_render-ego0": 0.003723977308884747, "sim_render-ego1": 0.0037456064994488033, "sim_render-ego2": 0.0036635688699155327, "sim_render-ego3": 0.0036385704536025074, "get_duckie_state": 1.3878303800991037e-06, "in-drivable-lane": 0.0, "deviation-heading": 16.49673198305872, "agent_compute-ego0": 0.04189974521220872, "agent_compute-ego1": 0.04215207901922094, "agent_compute-ego2": 0.04115210147225589, "agent_compute-ego3": 0.04084238025369891, "complete-iteration": 1.0191242065556738, "set_robot_commands": 0.0021862120155887142, "deviation-center-line": 3.412362211665715, "driven_lanedir_consec": 25.582242713884984, "sim_compute_sim_state": 0.03124492511860437, "sim_compute_performance-ego0": 0.0019668984869735426, "sim_compute_performance-ego1": 0.001933159975088407, "sim_compute_performance-ego2": 0.0019364096937727472, "sim_compute_performance-ego3": 0.0019244012189447433}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 26.339376326503626, "get_ui_image": 0.042367337843857635, "step_physics": 0.7244586847306886, "survival_time": 59.99999999999873, "driven_lanedir": 24.426693497975695, "get_state_dump": 0.00934530118422941, "get_robot_state": 0.014048130287913655, "sim_render-ego0": 0.003723977308884747, "sim_render-ego1": 0.0037456064994488033, "sim_render-ego2": 0.0036635688699155327, "sim_render-ego3": 0.0036385704536025074, "get_duckie_state": 1.3878303800991037e-06, "in-drivable-lane": 1.2499999999999396, "deviation-heading": 16.881716820138774, "agent_compute-ego0": 0.04189974521220872, "agent_compute-ego1": 0.04215207901922094, "agent_compute-ego2": 0.04115210147225589, "agent_compute-ego3": 0.04084238025369891, "complete-iteration": 1.0191242065556738, "set_robot_commands": 0.0021862120155887142, "deviation-center-line": 3.513249566637494, "driven_lanedir_consec": 24.426693497975695, "sim_compute_sim_state": 0.03124492511860437, "sim_compute_performance-ego0": 0.0019668984869735426, "sim_compute_performance-ego1": 0.001933159975088407, "sim_compute_performance-ego2": 0.0019364096937727472, "sim_compute_performance-ego3": 0.0019244012189447433}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 26.66584907207099, "get_ui_image": 0.042367337843857635, "step_physics": 0.7244586847306886, "survival_time": 59.99999999999873, "driven_lanedir": 25.14065434514595, "get_state_dump": 0.00934530118422941, "get_robot_state": 0.014048130287913655, "sim_render-ego0": 0.003723977308884747, "sim_render-ego1": 0.0037456064994488033, "sim_render-ego2": 0.0036635688699155327, "sim_render-ego3": 0.0036385704536025074, "get_duckie_state": 1.3878303800991037e-06, "in-drivable-lane": 0.0, "deviation-heading": 17.44914985438102, "agent_compute-ego0": 0.04189974521220872, "agent_compute-ego1": 0.04215207901922094, "agent_compute-ego2": 0.04115210147225589, "agent_compute-ego3": 0.04084238025369891, "complete-iteration": 1.0191242065556738, "set_robot_commands": 0.0021862120155887142, "deviation-center-line": 3.5785608755028204, "driven_lanedir_consec": 25.14065434514595, "sim_compute_sim_state": 0.03124492511860437, "sim_compute_performance-ego0": 0.0019668984869735426, "sim_compute_performance-ego1": 0.001933159975088407, "sim_compute_performance-ego2": 0.0019364096937727472, "sim_compute_performance-ego3": 0.0019244012189447433}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 25.836875688617095, "get_ui_image": 0.04987891290110414, "step_physics": 0.996897783207953, "survival_time": 59.99999999999873, "driven_lanedir": 22.70225645779353, "get_state_dump": 0.00956838930973304, "get_robot_state": 0.014474643656455111, "sim_render-ego0": 0.0038311872553765825, "sim_render-ego1": 0.003826127659768288, "sim_render-ego2": 0.0037978622538164, "sim_render-ego3": 0.0038014268200165222, "get_duckie_state": 1.3785000943224395e-06, "in-drivable-lane": 2.8499999999999917, "deviation-heading": 19.611840008962343, "agent_compute-ego0": 0.0424270975301903, "agent_compute-ego1": 0.04237950116172619, "agent_compute-ego2": 0.04204949193155637, "agent_compute-ego3": 0.04230099871791868, "complete-iteration": 1.3178619494743886, "set_robot_commands": 0.002334664405930747, "deviation-center-line": 4.174956819770892, "driven_lanedir_consec": 22.70225645779353, "sim_compute_sim_state": 0.04491540811937318, "sim_compute_performance-ego0": 0.0020897245526214523, "sim_compute_performance-ego1": 0.0020291622631952826, "sim_compute_performance-ego2": 0.002019912178172954, "sim_compute_performance-ego3": 0.0020296089258122502}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 25.89242533482143, "get_ui_image": 0.04987891290110414, "step_physics": 0.996897783207953, "survival_time": 59.99999999999873, "driven_lanedir": 23.41389770288307, "get_state_dump": 0.00956838930973304, "get_robot_state": 0.014474643656455111, "sim_render-ego0": 0.0038311872553765825, "sim_render-ego1": 0.003826127659768288, "sim_render-ego2": 0.0037978622538164, "sim_render-ego3": 0.0038014268200165222, "get_duckie_state": 1.3785000943224395e-06, "in-drivable-lane": 1.4999999999999147, "deviation-heading": 19.264667600618957, "agent_compute-ego0": 0.0424270975301903, "agent_compute-ego1": 0.04237950116172619, "agent_compute-ego2": 0.04204949193155637, "agent_compute-ego3": 0.04230099871791868, "complete-iteration": 1.3178619494743886, "set_robot_commands": 0.002334664405930747, "deviation-center-line": 4.304454387249305, "driven_lanedir_consec": 23.41389770288307, "sim_compute_sim_state": 0.04491540811937318, "sim_compute_performance-ego0": 0.0020897245526214523, "sim_compute_performance-ego1": 0.0020291622631952826, "sim_compute_performance-ego2": 0.002019912178172954, "sim_compute_performance-ego3": 0.0020296089258122502}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 21.91511062293265, "get_ui_image": 0.04987891290110414, "step_physics": 0.996897783207953, "survival_time": 59.99999999999873, "driven_lanedir": 19.99995261783172, "get_state_dump": 0.00956838930973304, "get_robot_state": 0.014474643656455111, "sim_render-ego0": 0.0038311872553765825, "sim_render-ego1": 0.003826127659768288, "sim_render-ego2": 0.0037978622538164, "sim_render-ego3": 0.0038014268200165222, "get_duckie_state": 1.3785000943224395e-06, "in-drivable-lane": 10.599999999999431, "deviation-heading": 15.801955667840542, "agent_compute-ego0": 0.0424270975301903, "agent_compute-ego1": 0.04237950116172619, "agent_compute-ego2": 0.04204949193155637, "agent_compute-ego3": 0.04230099871791868, "complete-iteration": 1.3178619494743886, "set_robot_commands": 0.002334664405930747, "deviation-center-line": 3.508906963529278, "driven_lanedir_consec": 19.99995261783172, "sim_compute_sim_state": 0.04491540811937318, "sim_compute_performance-ego0": 0.0020897245526214523, "sim_compute_performance-ego1": 0.0020291622631952826, "sim_compute_performance-ego2": 0.002019912178172954, "sim_compute_performance-ego3": 0.0020296089258122502}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 22.171896080229153, "get_ui_image": 0.04987891290110414, "step_physics": 0.996897783207953, "survival_time": 59.99999999999873, "driven_lanedir": 19.885325292532432, "get_state_dump": 0.00956838930973304, "get_robot_state": 0.014474643656455111, "sim_render-ego0": 0.0038311872553765825, "sim_render-ego1": 0.003826127659768288, "sim_render-ego2": 0.0037978622538164, "sim_render-ego3": 0.0038014268200165222, "get_duckie_state": 1.3785000943224395e-06, "in-drivable-lane": 2.4499999999999833, "deviation-heading": 14.849919329895677, "agent_compute-ego0": 0.0424270975301903, "agent_compute-ego1": 0.04237950116172619, "agent_compute-ego2": 0.04204949193155637, "agent_compute-ego3": 0.04230099871791868, "complete-iteration": 1.3178619494743886, "set_robot_commands": 0.002334664405930747, "deviation-center-line": 3.7688488979980304, "driven_lanedir_consec": 19.885325292532432, "sim_compute_sim_state": 0.04491540811937318, "sim_compute_performance-ego0": 0.0020897245526214523, "sim_compute_performance-ego1": 0.0020291622631952826, "sim_compute_performance-ego2": 0.002019912178172954, "sim_compute_performance-ego3": 0.0020296089258122502}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 23.16491006990087, "get_ui_image": 0.04689811925705426, "step_physics": 0.9968350281028524, "survival_time": 59.99999999999873, "driven_lanedir": 21.69620711662536, "get_state_dump": 0.009364203350629338, "get_robot_state": 0.01380193719855951, "sim_render-ego0": 0.0036524457796527185, "sim_render-ego1": 0.003655992280831444, "sim_render-ego2": 0.003626840696247491, "sim_render-ego3": 0.0035934450227354687, "get_duckie_state": 1.2881749873355862e-06, "in-drivable-lane": 0.0, "deviation-heading": 18.227976727368883, "agent_compute-ego0": 0.04211758415863774, "agent_compute-ego1": 0.04151855777642014, "agent_compute-ego2": 0.04200649618804703, "agent_compute-ego3": 0.04105037177829917, "complete-iteration": 1.3005676672520188, "set_robot_commands": 0.0020948766570206387, "deviation-center-line": 4.00341427521483, "driven_lanedir_consec": 21.69620711662536, "sim_compute_sim_state": 0.03593885174004065, "sim_compute_performance-ego0": 0.001924002200340252, "sim_compute_performance-ego1": 0.0019187581827003297, "sim_compute_performance-ego2": 0.0019282450981680105, "sim_compute_performance-ego3": 0.0019146909721685784}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 16.814075997458517, "get_ui_image": 0.04689811925705426, "step_physics": 0.9968350281028524, "survival_time": 59.99999999999873, "driven_lanedir": 14.509231350632056, "get_state_dump": 0.009364203350629338, "get_robot_state": 0.01380193719855951, "sim_render-ego0": 0.0036524457796527185, "sim_render-ego1": 0.003655992280831444, "sim_render-ego2": 0.003626840696247491, "sim_render-ego3": 0.0035934450227354687, "get_duckie_state": 1.2881749873355862e-06, "in-drivable-lane": 25.19999999999859, "deviation-heading": 10.770612203769272, "agent_compute-ego0": 0.04211758415863774, "agent_compute-ego1": 0.04151855777642014, "agent_compute-ego2": 0.04200649618804703, "agent_compute-ego3": 0.04105037177829917, "complete-iteration": 1.3005676672520188, "set_robot_commands": 0.0020948766570206387, "deviation-center-line": 2.204671180929971, "driven_lanedir_consec": 14.509231350632056, "sim_compute_sim_state": 0.03593885174004065, "sim_compute_performance-ego0": 0.001924002200340252, "sim_compute_performance-ego1": 0.0019187581827003297, "sim_compute_performance-ego2": 0.0019282450981680105, "sim_compute_performance-ego3": 0.0019146909721685784}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 16.206423121707367, "get_ui_image": 0.04689811925705426, "step_physics": 0.9968350281028524, "survival_time": 59.99999999999873, "driven_lanedir": 15.1817948798708, "get_state_dump": 0.009364203350629338, "get_robot_state": 0.01380193719855951, "sim_render-ego0": 0.0036524457796527185, "sim_render-ego1": 0.003655992280831444, "sim_render-ego2": 0.003626840696247491, "sim_render-ego3": 0.0035934450227354687, "get_duckie_state": 1.2881749873355862e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.289649703369934, "agent_compute-ego0": 0.04211758415863774, "agent_compute-ego1": 0.04151855777642014, "agent_compute-ego2": 0.04200649618804703, "agent_compute-ego3": 0.04105037177829917, "complete-iteration": 1.3005676672520188, "set_robot_commands": 0.0020948766570206387, "deviation-center-line": 4.211712105087423, "driven_lanedir_consec": 15.1817948798708, "sim_compute_sim_state": 0.03593885174004065, "sim_compute_performance-ego0": 0.001924002200340252, "sim_compute_performance-ego1": 0.0019187581827003297, "sim_compute_performance-ego2": 0.0019282450981680105, "sim_compute_performance-ego3": 0.0019146909721685784}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 25.884045880639373, "get_ui_image": 0.04689811925705426, "step_physics": 0.9968350281028524, "survival_time": 59.99999999999873, "driven_lanedir": 21.52380208124506, "get_state_dump": 0.009364203350629338, "get_robot_state": 0.01380193719855951, "sim_render-ego0": 0.0036524457796527185, "sim_render-ego1": 0.003655992280831444, "sim_render-ego2": 0.003626840696247491, "sim_render-ego3": 0.0035934450227354687, "get_duckie_state": 1.2881749873355862e-06, "in-drivable-lane": 5.349999999999998, "deviation-heading": 20.233198041272072, "agent_compute-ego0": 0.04211758415863774, "agent_compute-ego1": 0.04151855777642014, "agent_compute-ego2": 0.04200649618804703, "agent_compute-ego3": 0.04105037177829917, "complete-iteration": 1.3005676672520188, "set_robot_commands": 0.0020948766570206387, "deviation-center-line": 3.8574039717450166, "driven_lanedir_consec": 21.52380208124506, "sim_compute_sim_state": 0.03593885174004065, "sim_compute_performance-ego0": 0.001924002200340252, "sim_compute_performance-ego1": 0.0019187581827003297, "sim_compute_performance-ego2": 0.0019282450981680105, "sim_compute_performance-ego3": 0.0019146909721685784}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 21.451999504275015, "get_ui_image": 0.0296315767548301, "step_physics": 0.2682003932508084, "survival_time": 50.549999999999265, "driven_lanedir": 19.77019127744148, "get_state_dump": 0.006113965991928643, "get_robot_state": 0.00696481617071883, "sim_render-ego0": 0.0035676444943243337, "sim_render-ego1": 0.003552967851812189, "get_duckie_state": 1.2283739836319634e-06, "in-drivable-lane": 0.0, "deviation-heading": 17.42739019500292, "agent_compute-ego0": 0.04113693270287495, "agent_compute-ego1": 0.041419743784802704, "complete-iteration": 0.4187182687487998, "set_robot_commands": 0.0021135799969609075, "deviation-center-line": 3.4825812892937376, "driven_lanedir_consec": 19.77019127744148, "sim_compute_sim_state": 0.010084112171127865, "sim_compute_performance-ego0": 0.0018532236103012628, "sim_compute_performance-ego1": 0.0018742287111847768}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 21.240976970288724, "get_ui_image": 0.0296315767548301, "step_physics": 0.2682003932508084, "survival_time": 50.549999999999265, "driven_lanedir": 19.669626734654635, "get_state_dump": 0.006113965991928643, "get_robot_state": 0.00696481617071883, "sim_render-ego0": 0.0035676444943243337, "sim_render-ego1": 0.003552967851812189, "get_duckie_state": 1.2283739836319634e-06, "in-drivable-lane": 0.399999999999995, "deviation-heading": 15.682602628561275, "agent_compute-ego0": 0.04113693270287495, "agent_compute-ego1": 0.041419743784802704, "complete-iteration": 0.4187182687487998, "set_robot_commands": 0.0021135799969609075, "deviation-center-line": 3.3308561796098304, "driven_lanedir_consec": 19.669626734654635, "sim_compute_sim_state": 0.010084112171127865, "sim_compute_performance-ego0": 0.0018532236103012628, "sim_compute_performance-ego1": 0.0018742287111847768}}
set_robot_commands_max0.002334664405930747
set_robot_commands_mean0.0021921551648630155
set_robot_commands_median0.0021862120155887142
set_robot_commands_min0.0020948766570206387
sim_compute_performance-ego0_max0.0020897245526214523
sim_compute_performance-ego0_mean0.001973496298595965
sim_compute_performance-ego0_median0.0019668984869735426
sim_compute_performance-ego0_min0.0018532236103012628
sim_compute_performance-ego1_max0.0020291622631952826
sim_compute_performance-ego1_mean0.0019480556504504025
sim_compute_performance-ego1_median0.001933159975088407
sim_compute_performance-ego1_min0.0018742287111847768
sim_compute_performance-ego2_max0.002019912178172954
sim_compute_performance-ego2_mean0.001961522323371237
sim_compute_performance-ego2_median0.0019364096937727472
sim_compute_performance-ego2_min0.0019282450981680105
sim_compute_performance-ego3_max0.0020296089258122502
sim_compute_performance-ego3_mean0.001956233705641858
sim_compute_performance-ego3_median0.0019244012189447433
sim_compute_performance-ego3_min0.0019146909721685784
sim_compute_sim_state_max0.04491540811937318
sim_compute_sim_state_mean0.03346892601816632
sim_compute_sim_state_median0.03593885174004065
sim_compute_sim_state_min0.010084112171127865
sim_render-ego0_max0.0038311872553765825
sim_render-ego0_mean0.003711837883164634
sim_render-ego0_median0.003723977308884747
sim_render-ego0_min0.0035676444943243337
sim_render-ego1_max0.003826127659768288
sim_render-ego1_mean0.003715488675987037
sim_render-ego1_median0.0037456064994488033
sim_render-ego1_min0.003552967851812189
sim_render-ego2_max0.0037978622538164
sim_render-ego2_mean0.003696090606659807
sim_render-ego2_median0.0036635688699155327
sim_render-ego2_min0.003626840696247491
sim_render-ego3_max0.0038014268200165222
sim_render-ego3_mean0.003677814098784833
sim_render-ego3_median0.0036385704536025074
sim_render-ego3_min0.0035934450227354687
simulation-passed1
step_physics_max0.996897783207953
step_physics_mean0.8149404836191138
step_physics_median0.9968350281028524
step_physics_min0.2682003932508084
survival_time_max59.99999999999873
survival_time_mean58.64999999999882
survival_time_min50.549999999999265
No reset possible