Duckietown Challenges Home Challenges Submissions

Submission 12592

Submission12592
Competingyes
Challengeaido5-LFVI_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVIv-sim: 53599
Next
User labeltemplate-ros
Admin priority50
Blessingn/a
User priority50

53599

Click the images to see detailed statistics about the episode.

LFVI_multi-norm-4way-000

LFVI_multi-norm-udem1-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53599LFVIv-simsuccessyes0:09:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.34771476648757627
survival_time_median6.474999999999985
deviation-center-line_median0.11681981016966436
in-drivable-lane_median4.499999999999986


other stats
agent_compute-ego0_max0.014279536115444772
agent_compute-ego0_mean0.013321467699959068
agent_compute-ego0_median0.013321467699959068
agent_compute-ego0_min0.012363399284473364
agent_compute-ego1_max0.01254661296441303
agent_compute-ego1_mean0.012363598514420692
agent_compute-ego1_median0.012363598514420692
agent_compute-ego1_min0.012180584064428356
agent_compute-ego2_max0.01272542302201434
agent_compute-ego2_mean0.01231504125028754
agent_compute-ego2_median0.01231504125028754
agent_compute-ego2_min0.011904659478560738
agent_compute-ego3_max0.013601469799755066
agent_compute-ego3_mean0.012864469175584831
agent_compute-ego3_median0.012864469175584831
agent_compute-ego3_min0.0121274685514146
complete-iteration_max1.1962318090888542
complete-iteration_mean1.0461163952098629
complete-iteration_median1.0461163952098629
complete-iteration_min0.8960009813308716
deviation-center-line_max0.5602291561052376
deviation-center-line_mean0.1807220965001034
deviation-center-line_min0.07201599844442215
deviation-heading_max4.871448104385203
deviation-heading_mean1.366512235649041
deviation-heading_median0.6786103116857072
deviation-heading_min0.4101536711904785
driven_any_max1.7947019090619127
driven_any_mean1.1820105100413187
driven_any_median1.1536045728913609
driven_any_min0.39365958309081694
driven_lanedir_consec_max0.6507754468226339
driven_lanedir_consec_mean0.4044518776631787
driven_lanedir_consec_min0.16474465670829996
driven_lanedir_max0.6507754468226339
driven_lanedir_mean0.4044518776631787
driven_lanedir_median0.34771476648757627
driven_lanedir_min0.16474465670829996
get_duckie_state_max1.5894571940104167e-06
get_duckie_state_mean1.5022098154261494e-06
get_duckie_state_median1.5022098154261494e-06
get_duckie_state_min1.4149624368418818e-06
get_robot_state_max0.014834301258490338
get_robot_state_mean0.014510306358843063
get_robot_state_median0.014510306358843063
get_robot_state_min0.014186311459195787
get_state_dump_max0.01020469181779502
get_state_dump_mean0.010104654576088183
get_state_dump_median0.010104654576088183
get_state_dump_min0.010004617334381353
get_ui_image_max0.053709462406189463
get_ui_image_mean0.053544182876851205
get_ui_image_median0.053544182876851205
get_ui_image_min0.05337890334751295
in-drivable-lane_max4.999999999999986
in-drivable-lane_mean4.118749999999987
in-drivable-lane_min1.5999999999999963
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 1.7947019090619127, "get_ui_image": 0.05337890334751295, "step_physics": 0.706765447837719, "survival_time": 6.849999999999984, "driven_lanedir": 0.6507754468226339, "get_state_dump": 0.01020469181779502, "get_robot_state": 0.014186311459195787, "sim_render-ego0": 0.0037462072096009183, "sim_render-ego1": 0.0037516355514526367, "sim_render-ego2": 0.00360214883002682, "sim_render-ego3": 0.0035991979681927223, "get_duckie_state": 1.4149624368418818e-06, "in-drivable-lane": 4.249999999999985, "deviation-heading": 0.4986915140743071, "agent_compute-ego0": 0.012363399284473364, "agent_compute-ego1": 0.012180584064428356, "agent_compute-ego2": 0.011904659478560738, "agent_compute-ego3": 0.0121274685514146, "complete-iteration": 0.8960009813308716, "set_robot_commands": 0.002232829729715983, "deviation-center-line": 0.12866023335927002, "driven_lanedir_consec": 0.6507754468226339, "sim_compute_sim_state": 0.03133397344229878, "sim_compute_performance-ego0": 0.0020520773486814637, "sim_compute_performance-ego1": 0.0018901755844337351, "sim_compute_performance-ego2": 0.0018840285315029864, "sim_compute_performance-ego3": 0.0019448511842368305}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 1.20914116652865, "get_ui_image": 0.05337890334751295, "step_physics": 0.706765447837719, "survival_time": 6.849999999999984, "driven_lanedir": 0.25853917004708826, "get_state_dump": 0.01020469181779502, "get_robot_state": 0.014186311459195787, "sim_render-ego0": 0.0037462072096009183, "sim_render-ego1": 0.0037516355514526367, "sim_render-ego2": 0.00360214883002682, "sim_render-ego3": 0.0035991979681927223, "get_duckie_state": 1.4149624368418818e-06, "in-drivable-lane": 4.749999999999987, "deviation-heading": 1.684960236647266, "agent_compute-ego0": 0.012363399284473364, "agent_compute-ego1": 0.012180584064428356, "agent_compute-ego2": 0.011904659478560738, "agent_compute-ego3": 0.0121274685514146, "complete-iteration": 0.8960009813308716, "set_robot_commands": 0.002232829729715983, "deviation-center-line": 0.14209026115492115, "driven_lanedir_consec": 0.25853917004708826, "sim_compute_sim_state": 0.03133397344229878, "sim_compute_performance-ego0": 0.0020520773486814637, "sim_compute_performance-ego1": 0.0018901755844337351, "sim_compute_performance-ego2": 0.0018840285315029864, "sim_compute_performance-ego3": 0.0019448511842368305}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 1.701439969923149, "get_ui_image": 0.05337890334751295, "step_physics": 0.706765447837719, "survival_time": 6.849999999999984, "driven_lanedir": 0.6271322732404546, "get_state_dump": 0.01020469181779502, "get_robot_state": 0.014186311459195787, "sim_render-ego0": 0.0037462072096009183, "sim_render-ego1": 0.0037516355514526367, "sim_render-ego2": 0.00360214883002682, "sim_render-ego3": 0.0035991979681927223, "get_duckie_state": 1.4149624368418818e-06, "in-drivable-lane": 3.949999999999986, "deviation-heading": 1.50076389675061, "agent_compute-ego0": 0.012363399284473364, "agent_compute-ego1": 0.012180584064428356, "agent_compute-ego2": 0.011904659478560738, "agent_compute-ego3": 0.0121274685514146, "complete-iteration": 0.8960009813308716, "set_robot_commands": 0.002232829729715983, "deviation-center-line": 0.26764675068567245, "driven_lanedir_consec": 0.6271322732404546, "sim_compute_sim_state": 0.03133397344229878, "sim_compute_performance-ego0": 0.0020520773486814637, "sim_compute_performance-ego1": 0.0018901755844337351, "sim_compute_performance-ego2": 0.0018840285315029864, "sim_compute_performance-ego3": 0.0019448511842368305}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 1.0980679792540715, "get_ui_image": 0.05337890334751295, "step_physics": 0.706765447837719, "survival_time": 6.849999999999984, "driven_lanedir": 0.4146748872228423, "get_state_dump": 0.01020469181779502, "get_robot_state": 0.014186311459195787, "sim_render-ego0": 0.0037462072096009183, "sim_render-ego1": 0.0037516355514526367, "sim_render-ego2": 0.00360214883002682, "sim_render-ego3": 0.0035991979681927223, "get_duckie_state": 1.4149624368418818e-06, "in-drivable-lane": 1.5999999999999963, "deviation-heading": 4.871448104385203, "agent_compute-ego0": 0.012363399284473364, "agent_compute-ego1": 0.012180584064428356, "agent_compute-ego2": 0.011904659478560738, "agent_compute-ego3": 0.0121274685514146, "complete-iteration": 0.8960009813308716, "set_robot_commands": 0.002232829729715983, "deviation-center-line": 0.5602291561052376, "driven_lanedir_consec": 0.4146748872228423, "sim_compute_sim_state": 0.03133397344229878, "sim_compute_performance-ego0": 0.0020520773486814637, "sim_compute_performance-ego1": 0.0018901755844337351, "sim_compute_performance-ego2": 0.0018840285315029864, "sim_compute_performance-ego3": 0.0019448511842368305}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 0.8426358060924353, "get_ui_image": 0.053709462406189463, "step_physics": 1.00517648603858, "survival_time": 6.099999999999986, "driven_lanedir": 0.2102889439457201, "get_state_dump": 0.010004617334381353, "get_robot_state": 0.014834301258490338, "sim_render-ego0": 0.004003850425161966, "sim_render-ego1": 0.0038313497372759065, "sim_render-ego2": 0.004070049378930069, "sim_render-ego3": 0.00389032635262342, "get_duckie_state": 1.5894571940104167e-06, "in-drivable-lane": 4.799999999999986, "deviation-heading": 0.6324589654149725, "agent_compute-ego0": 0.014279536115444772, "agent_compute-ego1": 0.01254661296441303, "agent_compute-ego2": 0.01272542302201434, "agent_compute-ego3": 0.013601469799755066, "complete-iteration": 1.1962318090888542, "set_robot_commands": 0.0024321389392139466, "deviation-center-line": 0.07713517689558541, "driven_lanedir_consec": 0.2102889439457201, "sim_compute_sim_state": 0.0253216212357932, "sim_compute_performance-ego0": 0.002186216959139196, "sim_compute_performance-ego1": 0.0020225144983307135, "sim_compute_performance-ego2": 0.0020710646621580047, "sim_compute_performance-ego3": 0.002048465294566581}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 1.7143265011785107, "get_ui_image": 0.053709462406189463, "step_physics": 1.00517648603858, "survival_time": 6.099999999999986, "driven_lanedir": 0.6287049975660808, "get_state_dump": 0.010004617334381353, "get_robot_state": 0.014834301258490338, "sim_render-ego0": 0.004003850425161966, "sim_render-ego1": 0.0038313497372759065, "sim_render-ego2": 0.004070049378930069, "sim_render-ego3": 0.00389032635262342, "get_duckie_state": 1.5894571940104167e-06, "in-drivable-lane": 3.8499999999999863, "deviation-heading": 0.4101536711904785, "agent_compute-ego0": 0.014279536115444772, "agent_compute-ego1": 0.01254661296441303, "agent_compute-ego2": 0.01272542302201434, "agent_compute-ego3": 0.013601469799755066, "complete-iteration": 1.1962318090888542, "set_robot_commands": 0.0024321389392139466, "deviation-center-line": 0.10497938698005872, "driven_lanedir_consec": 0.6287049975660808, "sim_compute_sim_state": 0.0253216212357932, "sim_compute_performance-ego0": 0.002186216959139196, "sim_compute_performance-ego1": 0.0020225144983307135, "sim_compute_performance-ego2": 0.0020710646621580047, "sim_compute_performance-ego3": 0.002048465294566581}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.7021111652010029, "get_ui_image": 0.053709462406189463, "step_physics": 1.00517648603858, "survival_time": 6.099999999999986, "driven_lanedir": 0.16474465670829996, "get_state_dump": 0.010004617334381353, "get_robot_state": 0.014834301258490338, "sim_render-ego0": 0.004003850425161966, "sim_render-ego1": 0.0038313497372759065, "sim_render-ego2": 0.004070049378930069, "sim_render-ego3": 0.00389032635262342, "get_duckie_state": 1.5894571940104167e-06, "in-drivable-lane": 4.999999999999986, "deviation-heading": 0.7247616579564419, "agent_compute-ego0": 0.014279536115444772, "agent_compute-ego1": 0.01254661296441303, "agent_compute-ego2": 0.01272542302201434, "agent_compute-ego3": 0.013601469799755066, "complete-iteration": 1.1962318090888542, "set_robot_commands": 0.0024321389392139466, "deviation-center-line": 0.07201599844442215, "driven_lanedir_consec": 0.16474465670829996, "sim_compute_sim_state": 0.0253216212357932, "sim_compute_performance-ego0": 0.002186216959139196, "sim_compute_performance-ego1": 0.0020225144983307135, "sim_compute_performance-ego2": 0.0020710646621580047, "sim_compute_performance-ego3": 0.002048465294566581}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 0.39365958309081694, "get_ui_image": 0.053709462406189463, "step_physics": 1.00517648603858, "survival_time": 6.099999999999986, "driven_lanedir": 0.28075464575231024, "get_state_dump": 0.010004617334381353, "get_robot_state": 0.014834301258490338, "sim_render-ego0": 0.004003850425161966, "sim_render-ego1": 0.0038313497372759065, "sim_render-ego2": 0.004070049378930069, "sim_render-ego3": 0.00389032635262342, "get_duckie_state": 1.5894571940104167e-06, "in-drivable-lane": 4.749999999999986, "deviation-heading": 0.6088598387730487, "agent_compute-ego0": 0.014279536115444772, "agent_compute-ego1": 0.01254661296441303, "agent_compute-ego2": 0.01272542302201434, "agent_compute-ego3": 0.013601469799755066, "complete-iteration": 1.1962318090888542, "set_robot_commands": 0.0024321389392139466, "deviation-center-line": 0.09301980837565985, "driven_lanedir_consec": 0.28075464575231024, "sim_compute_sim_state": 0.0253216212357932, "sim_compute_performance-ego0": 0.002186216959139196, "sim_compute_performance-ego1": 0.0020225144983307135, "sim_compute_performance-ego2": 0.0020710646621580047, "sim_compute_performance-ego3": 0.002048465294566581}}
set_robot_commands_max0.0024321389392139466
set_robot_commands_mean0.0023324843344649645
set_robot_commands_median0.0023324843344649645
set_robot_commands_min0.002232829729715983
sim_compute_performance-ego0_max0.002186216959139196
sim_compute_performance-ego0_mean0.00211914715391033
sim_compute_performance-ego0_median0.00211914715391033
sim_compute_performance-ego0_min0.0020520773486814637
sim_compute_performance-ego1_max0.0020225144983307135
sim_compute_performance-ego1_mean0.0019563450413822244
sim_compute_performance-ego1_median0.0019563450413822244
sim_compute_performance-ego1_min0.0018901755844337351
sim_compute_performance-ego2_max0.0020710646621580047
sim_compute_performance-ego2_mean0.0019775465968304953
sim_compute_performance-ego2_median0.0019775465968304953
sim_compute_performance-ego2_min0.0018840285315029864
sim_compute_performance-ego3_max0.002048465294566581
sim_compute_performance-ego3_mean0.0019966582394017056
sim_compute_performance-ego3_median0.0019966582394017056
sim_compute_performance-ego3_min0.0019448511842368305
sim_compute_sim_state_max0.03133397344229878
sim_compute_sim_state_mean0.02832779733904599
sim_compute_sim_state_median0.02832779733904599
sim_compute_sim_state_min0.0253216212357932
sim_render-ego0_max0.004003850425161966
sim_render-ego0_mean0.0038750288173814425
sim_render-ego0_median0.0038750288173814425
sim_render-ego0_min0.0037462072096009183
sim_render-ego1_max0.0038313497372759065
sim_render-ego1_mean0.003791492644364272
sim_render-ego1_median0.003791492644364272
sim_render-ego1_min0.0037516355514526367
sim_render-ego2_max0.004070049378930069
sim_render-ego2_mean0.003836099104478445
sim_render-ego2_median0.003836099104478445
sim_render-ego2_min0.00360214883002682
sim_render-ego3_max0.00389032635262342
sim_render-ego3_mean0.003744762160408071
sim_render-ego3_median0.003744762160408071
sim_render-ego3_min0.0035991979681927223
simulation-passed1
step_physics_max1.00517648603858
step_physics_mean0.8559709669381496
step_physics_median0.8559709669381496
step_physics_min0.706765447837719
survival_time_max6.849999999999984
survival_time_mean6.474999999999985
survival_time_min6.099999999999986
No reset possible
53596LFVIv-simsuccessyes0:17:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53582LFVIv-simsuccessyes0:13:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible