Duckietown Challenges Home Challenges Submissions

Submission 13204

Submission13204
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserAndrás Kalapos 🇭🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60430
Next
User labelreal-v1.0-3091-310
Admin priority50
Blessingn/a
User priority50

60430

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
60430LFVmultibodyv-simsuccessyes1:38:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median22.213260373809632
survival_time_median48.49999999999938
deviation-center-line_median2.3973930564944865
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.01413236651165268
agent_compute-ego0_mean0.013192586311838565
agent_compute-ego0_median0.013095709617056882
agent_compute-ego0_min0.012621207995577517
agent_compute-ego1_max0.013661186187898716
agent_compute-ego1_mean0.012864084719988728
agent_compute-ego1_median0.012638978192047528
agent_compute-ego1_min0.012481906828931924
agent_compute-ego2_max0.013750571417912043
agent_compute-ego2_mean0.013006993630356742
agent_compute-ego2_median0.012668231488747406
agent_compute-ego2_min0.012602177984410778
agent_compute-ego3_max0.013961679166029228
agent_compute-ego3_mean0.013063927014221105
agent_compute-ego3_median0.012778320082220606
agent_compute-ego3_min0.01245178179441348
complete-iteration_max1.2061265832953447
complete-iteration_mean0.8810181249347957
complete-iteration_median0.9976686017029562
complete-iteration_min0.32772716654031897
deviation-center-line_max3.021926694294508
deviation-center-line_mean2.409973906098086
deviation-center-line_min1.7552461566378856
deviation-heading_max8.681750103007847
deviation-heading_mean6.238205996545249
deviation-heading_median6.230723169520763
deviation-heading_min4.096902825393694
driven_any_max31.007389317577907
driven_any_mean21.77619866767055
driven_any_median22.506280523797663
driven_any_min8.8519330710508
driven_lanedir_consec_max30.66014072699254
driven_lanedir_consec_mean21.51453727777201
driven_lanedir_consec_min8.730369543206958
driven_lanedir_max30.66014072699254
driven_lanedir_mean21.51453727777201
driven_lanedir_median22.213260373809632
driven_lanedir_min8.730369543206958
get_duckie_state_max1.4339618158409462e-06
get_duckie_state_mean1.3075052100868398e-06
get_duckie_state_median1.2683233154703438e-06
get_duckie_state_min1.2355533368064497e-06
get_robot_state_max0.01408173344414762
get_robot_state_mean0.012904326101182736
get_robot_state_median0.013923701398279347
get_robot_state_min0.00695939703249713
get_state_dump_max0.009639923203353771
get_state_dump_mean0.00896841784799903
get_state_dump_median0.009371198905606962
get_state_dump_min0.006140345439227991
get_ui_image_max0.05179820633486625
get_ui_image_mean0.0444135740977973
get_ui_image_median0.046629155332838346
get_ui_image_min0.029957172177812637
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 31.007389317577907, "get_ui_image": 0.042041561585679635, "step_physics": 0.538930782172007, "survival_time": 59.99999999999873, "driven_lanedir": 30.66014072699254, "get_state_dump": 0.00930816763942188, "get_robot_state": 0.013923701398279347, "sim_render-ego0": 0.003649057893332196, "sim_render-ego1": 0.0035947506671940455, "sim_render-ego2": 0.0035842364277073385, "sim_render-ego3": 0.0035777350051714716, "get_duckie_state": 1.2683233154703438e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.964406641469687, "agent_compute-ego0": 0.012621207995577517, "agent_compute-ego1": 0.01248317872554833, "agent_compute-ego2": 0.012602177984410778, "agent_compute-ego3": 0.012778320082220606, "complete-iteration": 0.7159046690033238, "set_robot_commands": 0.002120378313215448, "deviation-center-line": 2.4952621667402997, "driven_lanedir_consec": 30.66014072699254, "sim_compute_sim_state": 0.030642958306750092, "sim_compute_performance-ego0": 0.001923079097598518, "sim_compute_performance-ego1": 0.001864006477629116, "sim_compute_performance-ego2": 0.0018631985145842007, "sim_compute_performance-ego3": 0.001855750961367236}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 30.74599170430112, "get_ui_image": 0.042041561585679635, "step_physics": 0.538930782172007, "survival_time": 59.99999999999873, "driven_lanedir": 30.3585092613001, "get_state_dump": 0.00930816763942188, "get_robot_state": 0.013923701398279347, "sim_render-ego0": 0.003649057893332196, "sim_render-ego1": 0.0035947506671940455, "sim_render-ego2": 0.0035842364277073385, "sim_render-ego3": 0.0035777350051714716, "get_duckie_state": 1.2683233154703438e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.455242462388488, "agent_compute-ego0": 0.012621207995577517, "agent_compute-ego1": 0.01248317872554833, "agent_compute-ego2": 0.012602177984410778, "agent_compute-ego3": 0.012778320082220606, "complete-iteration": 0.7159046690033238, "set_robot_commands": 0.002120378313215448, "deviation-center-line": 2.6265355333890095, "driven_lanedir_consec": 30.3585092613001, "sim_compute_sim_state": 0.030642958306750092, "sim_compute_performance-ego0": 0.001923079097598518, "sim_compute_performance-ego1": 0.001864006477629116, "sim_compute_performance-ego2": 0.0018631985145842007, "sim_compute_performance-ego3": 0.001855750961367236}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 30.462913183494567, "get_ui_image": 0.042041561585679635, "step_physics": 0.538930782172007, "survival_time": 59.99999999999873, "driven_lanedir": 30.21241141840564, "get_state_dump": 0.00930816763942188, "get_robot_state": 0.013923701398279347, "sim_render-ego0": 0.003649057893332196, "sim_render-ego1": 0.0035947506671940455, "sim_render-ego2": 0.0035842364277073385, "sim_render-ego3": 0.0035777350051714716, "get_duckie_state": 1.2683233154703438e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.505790408692261, "agent_compute-ego0": 0.012621207995577517, "agent_compute-ego1": 0.01248317872554833, "agent_compute-ego2": 0.012602177984410778, "agent_compute-ego3": 0.012778320082220606, "complete-iteration": 0.7159046690033238, "set_robot_commands": 0.002120378313215448, "deviation-center-line": 2.196229013299058, "driven_lanedir_consec": 30.21241141840564, "sim_compute_sim_state": 0.030642958306750092, "sim_compute_performance-ego0": 0.001923079097598518, "sim_compute_performance-ego1": 0.001864006477629116, "sim_compute_performance-ego2": 0.0018631985145842007, "sim_compute_performance-ego3": 0.001855750961367236}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 30.86478225483991, "get_ui_image": 0.042041561585679635, "step_physics": 0.538930782172007, "survival_time": 59.99999999999873, "driven_lanedir": 30.48743597129798, "get_state_dump": 0.00930816763942188, "get_robot_state": 0.013923701398279347, "sim_render-ego0": 0.003649057893332196, "sim_render-ego1": 0.0035947506671940455, "sim_render-ego2": 0.0035842364277073385, "sim_render-ego3": 0.0035777350051714716, "get_duckie_state": 1.2683233154703438e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.281678021723404, "agent_compute-ego0": 0.012621207995577517, "agent_compute-ego1": 0.01248317872554833, "agent_compute-ego2": 0.012602177984410778, "agent_compute-ego3": 0.012778320082220606, "complete-iteration": 0.7159046690033238, "set_robot_commands": 0.002120378313215448, "deviation-center-line": 2.5261367088470736, "driven_lanedir_consec": 30.48743597129798, "sim_compute_sim_state": 0.030642958306750092, "sim_compute_performance-ego0": 0.001923079097598518, "sim_compute_performance-ego1": 0.001864006477629116, "sim_compute_performance-ego2": 0.0018631985145842007, "sim_compute_performance-ego3": 0.001855750961367236}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 8.891745810881737, "get_ui_image": 0.05179820633486625, "step_physics": 1.0073076578021567, "survival_time": 34.50000000000018, "driven_lanedir": 8.76827655929289, "get_state_dump": 0.009639923203353771, "get_robot_state": 0.01408173344414762, "sim_render-ego0": 0.0037758267564124894, "sim_render-ego1": 0.003692170472980063, "sim_render-ego2": 0.0036770348610995303, "sim_render-ego3": 0.003709862442679067, "get_duckie_state": 1.4339618158409462e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.096902825393694, "agent_compute-ego0": 0.01413236651165268, "agent_compute-ego1": 0.013661186187898716, "agent_compute-ego2": 0.013750571417912043, "agent_compute-ego3": 0.013961679166029228, "complete-iteration": 1.2061265832953447, "set_robot_commands": 0.0022108475482239564, "deviation-center-line": 2.668689323866618, "driven_lanedir_consec": 8.76827655929289, "sim_compute_sim_state": 0.036199022478029114, "sim_compute_performance-ego0": 0.001996827712107326, "sim_compute_performance-ego1": 0.0019574720849176563, "sim_compute_performance-ego2": 0.0019347888515930617, "sim_compute_performance-ego3": 0.0019275603867129204}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 13.021723613165385, "get_ui_image": 0.05179820633486625, "step_physics": 1.0073076578021567, "survival_time": 34.50000000000018, "driven_lanedir": 12.83052162229231, "get_state_dump": 0.009639923203353771, "get_robot_state": 0.01408173344414762, "sim_render-ego0": 0.0037758267564124894, "sim_render-ego1": 0.003692170472980063, "sim_render-ego2": 0.0036770348610995303, "sim_render-ego3": 0.003709862442679067, "get_duckie_state": 1.4339618158409462e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955655930349265, "agent_compute-ego0": 0.01413236651165268, "agent_compute-ego1": 0.013661186187898716, "agent_compute-ego2": 0.013750571417912043, "agent_compute-ego3": 0.013961679166029228, "complete-iteration": 1.2061265832953447, "set_robot_commands": 0.0022108475482239564, "deviation-center-line": 2.1172772985152792, "driven_lanedir_consec": 12.83052162229231, "sim_compute_sim_state": 0.036199022478029114, "sim_compute_performance-ego0": 0.001996827712107326, "sim_compute_performance-ego1": 0.0019574720849176563, "sim_compute_performance-ego2": 0.0019347888515930617, "sim_compute_performance-ego3": 0.0019275603867129204}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 16.371055932927245, "get_ui_image": 0.05179820633486625, "step_physics": 1.0073076578021567, "survival_time": 34.50000000000018, "driven_lanedir": 16.14166309867434, "get_state_dump": 0.009639923203353771, "get_robot_state": 0.01408173344414762, "sim_render-ego0": 0.0037758267564124894, "sim_render-ego1": 0.003692170472980063, "sim_render-ego2": 0.0036770348610995303, "sim_render-ego3": 0.003709862442679067, "get_duckie_state": 1.4339618158409462e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.680776301466541, "agent_compute-ego0": 0.01413236651165268, "agent_compute-ego1": 0.013661186187898716, "agent_compute-ego2": 0.013750571417912043, "agent_compute-ego3": 0.013961679166029228, "complete-iteration": 1.2061265832953447, "set_robot_commands": 0.0022108475482239564, "deviation-center-line": 1.7552461566378856, "driven_lanedir_consec": 16.14166309867434, "sim_compute_sim_state": 0.036199022478029114, "sim_compute_performance-ego0": 0.001996827712107326, "sim_compute_performance-ego1": 0.0019574720849176563, "sim_compute_performance-ego2": 0.0019347888515930617, "sim_compute_performance-ego3": 0.0019275603867129204}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 8.8519330710508, "get_ui_image": 0.05179820633486625, "step_physics": 1.0073076578021567, "survival_time": 34.50000000000018, "driven_lanedir": 8.730369543206958, "get_state_dump": 0.009639923203353771, "get_robot_state": 0.01408173344414762, "sim_render-ego0": 0.0037758267564124894, "sim_render-ego1": 0.003692170472980063, "sim_render-ego2": 0.0036770348610995303, "sim_render-ego3": 0.003709862442679067, "get_duckie_state": 1.4339618158409462e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.045901491531796, "agent_compute-ego0": 0.01413236651165268, "agent_compute-ego1": 0.013661186187898716, "agent_compute-ego2": 0.013750571417912043, "agent_compute-ego3": 0.013961679166029228, "complete-iteration": 1.2061265832953447, "set_robot_commands": 0.0022108475482239564, "deviation-center-line": 2.1406839371034274, "driven_lanedir_consec": 8.730369543206958, "sim_compute_sim_state": 0.036199022478029114, "sim_compute_performance-ego0": 0.001996827712107326, "sim_compute_performance-ego1": 0.0019574720849176563, "sim_compute_performance-ego2": 0.0019347888515930617, "sim_compute_performance-ego3": 0.0019275603867129204}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 21.067984732168856, "get_ui_image": 0.046629155332838346, "step_physics": 0.8112956146747027, "survival_time": 48.49999999999938, "driven_lanedir": 20.781255019578072, "get_state_dump": 0.009371198905606962, "get_robot_state": 0.01368000799546404, "sim_render-ego0": 0.003615266139917344, "sim_render-ego1": 0.0035848507061063566, "sim_render-ego2": 0.003554735812296214, "sim_render-ego3": 0.0035491728758099885, "get_duckie_state": 1.2355533368064497e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.305689384002323, "agent_compute-ego0": 0.013095709617056882, "agent_compute-ego1": 0.012638978192047528, "agent_compute-ego2": 0.012668231488747406, "agent_compute-ego3": 0.01245178179441348, "complete-iteration": 0.9976686017029562, "set_robot_commands": 0.0020535949820961446, "deviation-center-line": 2.299523946248673, "driven_lanedir_consec": 20.781255019578072, "sim_compute_sim_state": 0.035665297238146605, "sim_compute_performance-ego0": 0.001876482143461029, "sim_compute_performance-ego1": 0.0018451410268043025, "sim_compute_performance-ego2": 0.0018444301907728925, "sim_compute_performance-ego3": 0.001849170079805824}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 15.39801086973054, "get_ui_image": 0.046629155332838346, "step_physics": 0.8112956146747027, "survival_time": 48.49999999999938, "driven_lanedir": 15.187734733911158, "get_state_dump": 0.009371198905606962, "get_robot_state": 0.01368000799546404, "sim_render-ego0": 0.003615266139917344, "sim_render-ego1": 0.0035848507061063566, "sim_render-ego2": 0.003554735812296214, "sim_render-ego3": 0.0035491728758099885, "get_duckie_state": 1.2355533368064497e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.1088910736474995, "agent_compute-ego0": 0.013095709617056882, "agent_compute-ego1": 0.012638978192047528, "agent_compute-ego2": 0.012668231488747406, "agent_compute-ego3": 0.01245178179441348, "complete-iteration": 0.9976686017029562, "set_robot_commands": 0.0020535949820961446, "deviation-center-line": 3.021926694294508, "driven_lanedir_consec": 15.187734733911158, "sim_compute_sim_state": 0.035665297238146605, "sim_compute_performance-ego0": 0.001876482143461029, "sim_compute_performance-ego1": 0.0018451410268043025, "sim_compute_performance-ego2": 0.0018444301907728925, "sim_compute_performance-ego3": 0.001849170079805824}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 15.611061516763428, "get_ui_image": 0.046629155332838346, "step_physics": 0.8112956146747027, "survival_time": 48.49999999999938, "driven_lanedir": 15.455134432061897, "get_state_dump": 0.009371198905606962, "get_robot_state": 0.01368000799546404, "sim_render-ego0": 0.003615266139917344, "sim_render-ego1": 0.0035848507061063566, "sim_render-ego2": 0.003554735812296214, "sim_render-ego3": 0.0035491728758099885, "get_duckie_state": 1.2355533368064497e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.692923730374298, "agent_compute-ego0": 0.013095709617056882, "agent_compute-ego1": 0.012638978192047528, "agent_compute-ego2": 0.012668231488747406, "agent_compute-ego3": 0.01245178179441348, "complete-iteration": 0.9976686017029562, "set_robot_commands": 0.0020535949820961446, "deviation-center-line": 2.844608571264679, "driven_lanedir_consec": 15.455134432061897, "sim_compute_sim_state": 0.035665297238146605, "sim_compute_performance-ego0": 0.001876482143461029, "sim_compute_performance-ego1": 0.0018451410268043025, "sim_compute_performance-ego2": 0.0018444301907728925, "sim_compute_performance-ego3": 0.001849170079805824}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 23.94457631542647, "get_ui_image": 0.046629155332838346, "step_physics": 0.8112956146747027, "survival_time": 48.49999999999938, "driven_lanedir": 23.645265728041196, "get_state_dump": 0.009371198905606962, "get_robot_state": 0.01368000799546404, "sim_render-ego0": 0.003615266139917344, "sim_render-ego1": 0.0035848507061063566, "sim_render-ego2": 0.003554735812296214, "sim_render-ego3": 0.0035491728758099885, "get_duckie_state": 1.2355533368064497e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.860165401930306, "agent_compute-ego0": 0.013095709617056882, "agent_compute-ego1": 0.012638978192047528, "agent_compute-ego2": 0.012668231488747406, "agent_compute-ego3": 0.01245178179441348, "complete-iteration": 0.9976686017029562, "set_robot_commands": 0.0020535949820961446, "deviation-center-line": 2.2309798799812577, "driven_lanedir_consec": 23.645265728041196, "sim_compute_sim_state": 0.035665297238146605, "sim_compute_performance-ego0": 0.001876482143461029, "sim_compute_performance-ego1": 0.0018451410268043025, "sim_compute_performance-ego2": 0.0018444301907728925, "sim_compute_performance-ego3": 0.001849170079805824}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 29.881381833125342, "get_ui_image": 0.029957172177812637, "step_physics": 0.23404800107735185, "survival_time": 59.99999999999873, "driven_lanedir": 29.39360397336714, "get_state_dump": 0.006140345439227991, "get_robot_state": 0.00695939703249713, "sim_render-ego0": 0.003617986850595593, "sim_render-ego1": 0.0035629058062881355, "get_duckie_state": 1.276859534372398e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.681750103007847, "agent_compute-ego0": 0.01264953593429578, "agent_compute-ego1": 0.012481906828931924, "complete-iteration": 0.32772716654031897, "set_robot_commands": 0.002090532912699805, "deviation-center-line": 2.922900722398135, "driven_lanedir_consec": 29.39360397336714, "sim_compute_sim_state": 0.01029089984052088, "sim_compute_performance-ego0": 0.001865101297332484, "sim_compute_performance-ego1": 0.001849617588827751}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 28.746231191934324, "get_ui_image": 0.029957172177812637, "step_physics": 0.23404800107735185, "survival_time": 59.99999999999873, "driven_lanedir": 28.551199800385927, "get_state_dump": 0.006140345439227991, "get_robot_state": 0.00695939703249713, "sim_render-ego0": 0.003617986850595593, "sim_render-ego1": 0.0035629058062881355, "get_duckie_state": 1.276859534372398e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.699110175656073, "agent_compute-ego0": 0.01264953593429578, "agent_compute-ego1": 0.012481906828931924, "complete-iteration": 0.32772716654031897, "set_robot_commands": 0.002090532912699805, "deviation-center-line": 1.8936347327873015, "driven_lanedir_consec": 28.551199800385927, "sim_compute_sim_state": 0.01029089984052088, "sim_compute_performance-ego0": 0.001865101297332484, "sim_compute_performance-ego1": 0.001849617588827751}}
set_robot_commands_max0.0022108475482239564
set_robot_commands_mean0.002122882085681558
set_robot_commands_median0.002120378313215448
set_robot_commands_min0.0020535949820961446
sim_compute_performance-ego0_max0.001996827712107326
sim_compute_performance-ego0_mean0.0019225541719523188
sim_compute_performance-ego0_median0.001923079097598518
sim_compute_performance-ego0_min0.001865101297332484
sim_compute_performance-ego1_max0.0019574720849176563
sim_compute_performance-ego1_mean0.0018832652525042717
sim_compute_performance-ego1_median0.001864006477629116
sim_compute_performance-ego1_min0.0018451410268043025
sim_compute_performance-ego2_max0.0019347888515930617
sim_compute_performance-ego2_mean0.001880805852316718
sim_compute_performance-ego2_median0.0018631985145842007
sim_compute_performance-ego2_min0.0018444301907728925
sim_compute_performance-ego3_max0.0019275603867129204
sim_compute_performance-ego3_mean0.0018774938092953263
sim_compute_performance-ego3_median0.001855750961367236
sim_compute_performance-ego3_min0.001849170079805824
sim_compute_sim_state_max0.036199022478029114
sim_compute_sim_state_mean0.03075792226948178
sim_compute_sim_state_median0.035665297238146605
sim_compute_sim_state_min0.01029089984052088
sim_render-ego0_max0.0037758267564124894
sim_render-ego0_mean0.0036711840614170937
sim_render-ego0_median0.003649057893332196
sim_render-ego0_min0.003615266139917344
sim_render-ego1_max0.003692170472980063
sim_render-ego1_mean0.003615207071264152
sim_render-ego1_median0.0035947506671940455
sim_render-ego1_min0.0035629058062881355
sim_render-ego2_max0.0036770348610995303
sim_render-ego2_mean0.003605335700367694
sim_render-ego2_median0.0035842364277073385
sim_render-ego2_min0.003554735812296214
sim_render-ego3_max0.003709862442679067
sim_render-ego3_mean0.0036122567745535098
sim_render-ego3_median0.0035777350051714716
sim_render-ego3_min0.0035491728758099885
simulation-passed1
step_physics_max1.0073076578021567
step_physics_mean0.7070165871964408
step_physics_median0.8112956146747027
step_physics_min0.23404800107735185
survival_time_max59.99999999999873
survival_time_mean49.42857142857077
survival_time_min34.50000000000018
No reset possible