Duckietown Challenges Home Challenges Submissions

Submission 12833

Submission12833
Competingyes
Challengeaido5-LFVI_multi-sim-validation
UserMelisande Teng
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVIv-sim: 58873
Next
User labelexercise_state_estimation
Admin priority50
Blessingn/a
User priority50

58873

Click the images to see detailed statistics about the episode.

LFVI_multi-norm-4way-000

LFVI_multi-norm-udem1-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
58873LFVIv-simsuccessyes0:57:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.55611251776348
survival_time_median42.749999999999474
deviation-center-line_median2.2803953473726555
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012924432754516602
agent_compute-ego0_mean0.01282236860689585
agent_compute-ego0_median0.01282236860689585
agent_compute-ego0_min0.0127203044592751
agent_compute-ego1_max0.012675216652570816
agent_compute-ego1_mean0.01229731042425842
agent_compute-ego1_median0.01229731042425842
agent_compute-ego1_min0.011919404195946025
agent_compute-ego2_max0.013281737834984417
agent_compute-ego2_mean0.013098353782400865
agent_compute-ego2_median0.013098353782400865
agent_compute-ego2_min0.01291496972981731
agent_compute-ego3_max0.013474641691933662
agent_compute-ego3_mean0.013046324358653544
agent_compute-ego3_median0.013046324358653544
agent_compute-ego3_min0.012618007025373426
complete-iteration_max1.0148931393317635
complete-iteration_mean1.000041876247129
complete-iteration_median1.000041876247129
complete-iteration_min0.9851906131624942
deviation-center-line_max7.765135079712317
deviation-center-line_mean2.7897970854213057
deviation-center-line_min1.0124409190390091
deviation-heading_max29.56426715569536
deviation-heading_mean10.308736758903434
deviation-heading_median8.053912372085533
deviation-heading_min4.441478026952295
driven_any_max11.66336849263322
driven_any_mean6.650719877183547
driven_any_median4.785804610560643
driven_any_min1.7139223317446532
driven_lanedir_consec_max11.139553608035994
driven_lanedir_consec_mean6.214104847403533
driven_lanedir_consec_min1.386364205545996
driven_lanedir_max11.438917268252528
driven_lanedir_mean6.442836941182122
driven_lanedir_median4.5809901014161305
driven_lanedir_min1.4950900026694878
get_duckie_state_max1.9075471495311525e-06
get_duckie_state_mean1.8132002336796232e-06
get_duckie_state_median1.8132002336796232e-06
get_duckie_state_min1.7188533178280945e-06
get_robot_state_max0.016145853674679772
get_robot_state_mean0.01564363727147901
get_robot_state_median0.01564363727147901
get_robot_state_min0.015141420868278249
get_state_dump_max0.010515531234995311
get_state_dump_mean0.01024418732015695
get_state_dump_median0.01024418732015695
get_state_dump_min0.009972843405318586
get_ui_image_max0.05535909760954795
get_ui_image_mean0.055347064088592024
get_ui_image_median0.055347064088592024
get_ui_image_min0.0553350305676361
in-drivable-lane_max0.6000000000000085
in-drivable-lane_mean0.11874999999999968
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 3.4651447965138487, "get_ui_image": 0.05535909760954795, "step_physics": 0.7802862649794428, "survival_time": 25.500000000000227, "driven_lanedir": 3.37629941816905, "get_state_dump": 0.009972843405318586, "get_robot_state": 0.015141420868278249, "sim_render-ego0": 0.004143951923646572, "sim_render-ego1": 0.004222018844694074, "sim_render-ego2": 0.004265397495486265, "sim_render-ego3": 0.004253341727060814, "get_duckie_state": 1.7188533178280945e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.441478026952295, "agent_compute-ego0": 0.0127203044592751, "agent_compute-ego1": 0.011919404195946025, "agent_compute-ego2": 0.01291496972981731, "agent_compute-ego3": 0.012618007025373426, "complete-iteration": 0.9851906131624942, "set_robot_commands": 0.0024394928359238836, "deviation-center-line": 1.3761741955457598, "driven_lanedir_consec": 3.1291407035510748, "sim_compute_sim_state": 0.038679434595276, "sim_compute_performance-ego0": 0.002298523068661326, "sim_compute_performance-ego1": 0.0020816848702626687, "sim_compute_performance-ego2": 0.002141851268402518, "sim_compute_performance-ego3": 0.002142209129557451}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 4.7857543118467465, "get_ui_image": 0.05535909760954795, "step_physics": 0.7802862649794428, "survival_time": 25.500000000000227, "driven_lanedir": 4.642558013130001, "get_state_dump": 0.009972843405318586, "get_robot_state": 0.015141420868278249, "sim_render-ego0": 0.004143951923646572, "sim_render-ego1": 0.004222018844694074, "sim_render-ego2": 0.004265397495486265, "sim_render-ego3": 0.004253341727060814, "get_duckie_state": 1.7188533178280945e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.327932284141074, "agent_compute-ego0": 0.0127203044592751, "agent_compute-ego1": 0.011919404195946025, "agent_compute-ego2": 0.01291496972981731, "agent_compute-ego3": 0.012618007025373426, "complete-iteration": 0.9851906131624942, "set_robot_commands": 0.0024394928359238836, "deviation-center-line": 1.0124409190390091, "driven_lanedir_consec": 4.641684536647073, "sim_compute_sim_state": 0.038679434595276, "sim_compute_performance-ego0": 0.002298523068661326, "sim_compute_performance-ego1": 0.0020816848702626687, "sim_compute_performance-ego2": 0.002141851268402518, "sim_compute_performance-ego3": 0.002142209129557451}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 4.78585490927454, "get_ui_image": 0.05535909760954795, "step_physics": 0.7802862649794428, "survival_time": 25.500000000000227, "driven_lanedir": 4.51942218970226, "get_state_dump": 0.009972843405318586, "get_robot_state": 0.015141420868278249, "sim_render-ego0": 0.004143951923646572, "sim_render-ego1": 0.004222018844694074, "sim_render-ego2": 0.004265397495486265, "sim_render-ego3": 0.004253341727060814, "get_duckie_state": 1.7188533178280945e-06, "in-drivable-lane": 0.6000000000000085, "deviation-heading": 5.332075345790447, "agent_compute-ego0": 0.0127203044592751, "agent_compute-ego1": 0.011919404195946025, "agent_compute-ego2": 0.01291496972981731, "agent_compute-ego3": 0.012618007025373426, "complete-iteration": 0.9851906131624942, "set_robot_commands": 0.0024394928359238836, "deviation-center-line": 1.463605295308116, "driven_lanedir_consec": 4.4705404988798865, "sim_compute_sim_state": 0.038679434595276, "sim_compute_performance-ego0": 0.002298523068661326, "sim_compute_performance-ego1": 0.0020816848702626687, "sim_compute_performance-ego2": 0.002141851268402518, "sim_compute_performance-ego3": 0.002142209129557451}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 3.465086432536394, "get_ui_image": 0.05535909760954795, "step_physics": 0.7802862649794428, "survival_time": 25.500000000000227, "driven_lanedir": 3.3563333177320036, "get_state_dump": 0.009972843405318586, "get_robot_state": 0.015141420868278249, "sim_render-ego0": 0.004143951923646572, "sim_render-ego1": 0.004222018844694074, "sim_render-ego2": 0.004265397495486265, "sim_render-ego3": 0.004253341727060814, "get_duckie_state": 1.7188533178280945e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.294786085017458, "agent_compute-ego0": 0.0127203044592751, "agent_compute-ego1": 0.011919404195946025, "agent_compute-ego2": 0.01291496972981731, "agent_compute-ego3": 0.012618007025373426, "complete-iteration": 0.9851906131624942, "set_robot_commands": 0.0024394928359238836, "deviation-center-line": 1.7039374886038754, "driven_lanedir_consec": 3.1194250353667208, "sim_compute_sim_state": 0.038679434595276, "sim_compute_performance-ego0": 0.002298523068661326, "sim_compute_performance-ego1": 0.0020816848702626687, "sim_compute_performance-ego2": 0.002141851268402518, "sim_compute_performance-ego3": 0.002142209129557451}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 11.663320237348971, "get_ui_image": 0.0553350305676361, "step_physics": 0.8057879226392354, "survival_time": 59.99999999999873, "driven_lanedir": 11.389329975625062, "get_state_dump": 0.010515531234995311, "get_robot_state": 0.016145853674679772, "sim_render-ego0": 0.004331630235111386, "sim_render-ego1": 0.004454098176598847, "sim_render-ego2": 0.004413895960354388, "sim_render-ego3": 0.004617407955198264, "get_duckie_state": 1.9075471495311525e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.942684344578884, "agent_compute-ego0": 0.012924432754516602, "agent_compute-ego1": 0.012675216652570816, "agent_compute-ego2": 0.013281737834984417, "agent_compute-ego3": 0.013474641691933662, "complete-iteration": 1.0148931393317635, "set_robot_commands": 0.0027221714229409047, "deviation-center-line": 3.038654254593744, "driven_lanedir_consec": 11.139553608035994, "sim_compute_sim_state": 0.03708030659392116, "sim_compute_performance-ego0": 0.0024320640532202167, "sim_compute_performance-ego1": 0.0022617748238264175, "sim_compute_performance-ego2": 0.0022421951198657287, "sim_compute_performance-ego3": 0.0022592421475298497}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 11.663307505569998, "get_ui_image": 0.0553350305676361, "step_physics": 0.8057879226392354, "survival_time": 59.99999999999873, "driven_lanedir": 11.324745344176591, "get_state_dump": 0.010515531234995311, "get_robot_state": 0.016145853674679772, "sim_render-ego0": 0.004331630235111386, "sim_render-ego1": 0.004454098176598847, "sim_render-ego2": 0.004413895960354388, "sim_render-ego3": 0.004617407955198264, "get_duckie_state": 1.9075471495311525e-06, "in-drivable-lane": 0.19999999999998863, "deviation-heading": 10.75363216989835, "agent_compute-ego0": 0.012924432754516602, "agent_compute-ego1": 0.012675216652570816, "agent_compute-ego2": 0.013281737834984417, "agent_compute-ego3": 0.013474641691933662, "complete-iteration": 1.0148931393317635, "set_robot_commands": 0.0027221714229409047, "deviation-center-line": 2.856853206141435, "driven_lanedir_consec": 10.92933349278455, "sim_compute_sim_state": 0.03708030659392116, "sim_compute_performance-ego0": 0.0024320640532202167, "sim_compute_performance-ego1": 0.0022617748238264175, "sim_compute_performance-ego2": 0.0022421951198657287, "sim_compute_performance-ego3": 0.0022592421475298497}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 11.66336849263322, "get_ui_image": 0.0553350305676361, "step_physics": 0.8057879226392354, "survival_time": 59.99999999999873, "driven_lanedir": 11.438917268252528, "get_state_dump": 0.010515531234995311, "get_robot_state": 0.016145853674679772, "sim_render-ego0": 0.004331630235111386, "sim_render-ego1": 0.004454098176598847, "sim_render-ego2": 0.004413895960354388, "sim_render-ego3": 0.004617407955198264, "get_duckie_state": 1.9075471495311525e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.813038659153609, "agent_compute-ego0": 0.012924432754516602, "agent_compute-ego1": 0.012675216652570816, "agent_compute-ego2": 0.013281737834984417, "agent_compute-ego3": 0.013474641691933662, "complete-iteration": 1.0148931393317635, "set_robot_commands": 0.0027221714229409047, "deviation-center-line": 3.1015762444261883, "driven_lanedir_consec": 10.89679669841697, "sim_compute_sim_state": 0.03708030659392116, "sim_compute_performance-ego0": 0.0024320640532202167, "sim_compute_performance-ego1": 0.0022617748238264175, "sim_compute_performance-ego2": 0.0022421951198657287, "sim_compute_performance-ego3": 0.0022592421475298497}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.7139223317446532, "get_ui_image": 0.0553350305676361, "step_physics": 0.8057879226392354, "survival_time": 59.99999999999873, "driven_lanedir": 1.4950900026694878, "get_state_dump": 0.010515531234995311, "get_robot_state": 0.016145853674679772, "sim_render-ego0": 0.004331630235111386, "sim_render-ego1": 0.004454098176598847, "sim_render-ego2": 0.004413895960354388, "sim_render-ego3": 0.004617407955198264, "get_duckie_state": 1.9075471495311525e-06, "in-drivable-lane": 0.15000000000000036, "deviation-heading": 29.56426715569536, "agent_compute-ego0": 0.012924432754516602, "agent_compute-ego1": 0.012675216652570816, "agent_compute-ego2": 0.013281737834984417, "agent_compute-ego3": 0.013474641691933662, "complete-iteration": 1.0148931393317635, "set_robot_commands": 0.0027221714229409047, "deviation-center-line": 7.765135079712317, "driven_lanedir_consec": 1.386364205545996, "sim_compute_sim_state": 0.03708030659392116, "sim_compute_performance-ego0": 0.0024320640532202167, "sim_compute_performance-ego1": 0.0022617748238264175, "sim_compute_performance-ego2": 0.0022421951198657287, "sim_compute_performance-ego3": 0.0022592421475298497}}
set_robot_commands_max0.0027221714229409047
set_robot_commands_mean0.0025808321294323944
set_robot_commands_median0.0025808321294323944
set_robot_commands_min0.0024394928359238836
sim_compute_performance-ego0_max0.0024320640532202167
sim_compute_performance-ego0_mean0.0023652935609407713
sim_compute_performance-ego0_median0.0023652935609407713
sim_compute_performance-ego0_min0.002298523068661326
sim_compute_performance-ego1_max0.0022617748238264175
sim_compute_performance-ego1_mean0.002171729847044543
sim_compute_performance-ego1_median0.002171729847044543
sim_compute_performance-ego1_min0.0020816848702626687
sim_compute_performance-ego2_max0.0022421951198657287
sim_compute_performance-ego2_mean0.0021920231941341232
sim_compute_performance-ego2_median0.0021920231941341232
sim_compute_performance-ego2_min0.002141851268402518
sim_compute_performance-ego3_max0.0022592421475298497
sim_compute_performance-ego3_mean0.0022007256385436504
sim_compute_performance-ego3_median0.0022007256385436504
sim_compute_performance-ego3_min0.002142209129557451
sim_compute_sim_state_max0.038679434595276
sim_compute_sim_state_mean0.03787987059459858
sim_compute_sim_state_median0.03787987059459858
sim_compute_sim_state_min0.03708030659392116
sim_render-ego0_max0.004331630235111386
sim_render-ego0_mean0.0042377910793789785
sim_render-ego0_median0.0042377910793789785
sim_render-ego0_min0.004143951923646572
sim_render-ego1_max0.004454098176598847
sim_render-ego1_mean0.0043380585106464606
sim_render-ego1_median0.0043380585106464606
sim_render-ego1_min0.004222018844694074
sim_render-ego2_max0.004413895960354388
sim_render-ego2_mean0.004339646727920326
sim_render-ego2_median0.004339646727920326
sim_render-ego2_min0.004265397495486265
sim_render-ego3_max0.004617407955198264
sim_render-ego3_mean0.004435374841129539
sim_render-ego3_median0.004435374841129539
sim_render-ego3_min0.004253341727060814
simulation-passed1
step_physics_max0.8057879226392354
step_physics_mean0.7930370938093391
step_physics_median0.7930370938093391
step_physics_min0.7802862649794428
survival_time_max59.99999999999873
survival_time_mean42.749999999999474
survival_time_min25.500000000000227
No reset possible
58871LFVIv-simsuccessyes1:25:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58870LFVIv-simsuccessyes1:13:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible