Duckietown Challenges Home Challenges Submissions

Submission 12577

Submission12577
Competingyes
Challengeaido5-LFVI_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVIv-sim: 53435
Next
User labelstraight
Admin priority50
Blessingn/a
User priority50

53435

Click the images to see detailed statistics about the episode.

LFVI_multi-norm-4way-000

LFVI_multi-norm-udem1-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
53435LFVIv-simsuccessyes0:17:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.46767534266050315
survival_time_median14.550000000000072
deviation-center-line_median0.4947914603921105
in-drivable-lane_median6.1250000000000435


other stats
agent_compute-ego0_max0.01031970121583886
agent_compute-ego0_mean0.010270106377700594
agent_compute-ego0_median0.010270106377700594
agent_compute-ego0_min0.010220511539562329
agent_compute-ego1_max0.009931086176666763
agent_compute-ego1_mean0.009876833184066475
agent_compute-ego1_median0.009876833184066475
agent_compute-ego1_min0.009822580191466186
agent_compute-ego2_max0.01044251467730548
agent_compute-ego2_mean0.010370709405864587
agent_compute-ego2_median0.010370709405864587
agent_compute-ego2_min0.010298904134423694
agent_compute-ego3_max0.010404746176788162
agent_compute-ego3_mean0.010300027577103675
agent_compute-ego3_median0.010300027577103675
agent_compute-ego3_min0.010195308977419193
complete-iteration_max0.9805203235901154
complete-iteration_mean0.9474642438599234
complete-iteration_median0.9474642438599234
complete-iteration_min0.9144081641297314
deviation-center-line_max1.2340961821728105
deviation-center-line_mean0.5740882372190792
deviation-center-line_min0.18439074482977807
deviation-heading_max9.89336417759698
deviation-heading_mean3.8469412731858306
deviation-heading_median2.5994044932190894
deviation-heading_min0.7805520674724286
driven_any_max2.811085470195488
driven_any_mean1.6353907877707912
driven_any_median1.6388351926111284
driven_any_min0.38992907230453727
driven_lanedir_consec_max1.729279566578996
driven_lanedir_consec_mean0.6731111064412199
driven_lanedir_consec_min0.3192616717652883
driven_lanedir_max1.985679044301906
driven_lanedir_mean0.7183405276415334
driven_lanedir_median0.5144441989315507
driven_lanedir_min0.3192616717652883
get_duckie_state_max1.6379751553192982e-06
get_duckie_state_mean1.6115682595378165e-06
get_duckie_state_median1.6115682595378165e-06
get_duckie_state_min1.5851613637563344e-06
get_robot_state_max0.014576709072892838
get_robot_state_mean0.014475578185686174
get_robot_state_median0.014475578185686174
get_robot_state_min0.01437444729847951
get_state_dump_max0.009887120341727746
get_state_dump_mean0.009790217352509172
get_state_dump_median0.009790217352509172
get_state_dump_min0.009693314363290595
get_ui_image_max0.05574994192597616
get_ui_image_mean0.05365998378810338
get_ui_image_median0.05365998378810338
get_ui_image_min0.05157002565023061
in-drivable-lane_max14.700000000000127
in-drivable-lane_mean7.787500000000053
in-drivable-lane_min3.149999999999989
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 2.811085470195488, "get_ui_image": 0.05574994192597616, "step_physics": 0.7252282319147942, "survival_time": 18.05000000000012, "driven_lanedir": 1.985679044301906, "get_state_dump": 0.009887120341727746, "get_robot_state": 0.014576709072892838, "sim_render-ego0": 0.003881011878587923, "sim_render-ego1": 0.003801393245465189, "sim_render-ego2": 0.0037537879048131447, "sim_render-ego3": 0.0038439153966324103, "get_duckie_state": 1.6379751553192982e-06, "in-drivable-lane": 5.4500000000000774, "deviation-heading": 1.1835461994210874, "agent_compute-ego0": 0.01031970121583886, "agent_compute-ego1": 0.009931086176666763, "agent_compute-ego2": 0.010298904134423694, "agent_compute-ego3": 0.010404746176788162, "complete-iteration": 0.9144081641297314, "set_robot_commands": 0.002332839517962208, "deviation-center-line": 0.8433943002957107, "driven_lanedir_consec": 1.729279566578996, "sim_compute_sim_state": 0.03500686034313223, "sim_compute_performance-ego0": 0.0021525509449658474, "sim_compute_performance-ego1": 0.00200931406811456, "sim_compute_performance-ego2": 0.002020695591499792, "sim_compute_performance-ego3": 0.0020196266595829916}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 1.281856013323797, "get_ui_image": 0.05574994192597616, "step_physics": 0.7252282319147942, "survival_time": 18.05000000000012, "driven_lanedir": 0.4319797592418459, "get_state_dump": 0.009887120341727746, "get_robot_state": 0.014576709072892838, "sim_render-ego0": 0.003881011878587923, "sim_render-ego1": 0.003801393245465189, "sim_render-ego2": 0.0037537879048131447, "sim_render-ego3": 0.0038439153966324103, "get_duckie_state": 1.6379751553192982e-06, "in-drivable-lane": 14.050000000000129, "deviation-heading": 2.5819444733430332, "agent_compute-ego0": 0.01031970121583886, "agent_compute-ego1": 0.009931086176666763, "agent_compute-ego2": 0.010298904134423694, "agent_compute-ego3": 0.010404746176788162, "complete-iteration": 0.9144081641297314, "set_robot_commands": 0.002332839517962208, "deviation-center-line": 0.34051915970784424, "driven_lanedir_consec": 0.4319797592418459, "sim_compute_sim_state": 0.03500686034313223, "sim_compute_performance-ego0": 0.0021525509449658474, "sim_compute_performance-ego1": 0.00200931406811456, "sim_compute_performance-ego2": 0.002020695591499792, "sim_compute_performance-ego3": 0.0020196266595829916}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 2.05404400432433, "get_ui_image": 0.05574994192597616, "step_physics": 0.7252282319147942, "survival_time": 18.05000000000012, "driven_lanedir": 0.3452608587421049, "get_state_dump": 0.009887120341727746, "get_robot_state": 0.014576709072892838, "sim_render-ego0": 0.003881011878587923, "sim_render-ego1": 0.003801393245465189, "sim_render-ego2": 0.0037537879048131447, "sim_render-ego3": 0.0038439153966324103, "get_duckie_state": 1.6379751553192982e-06, "in-drivable-lane": 14.700000000000127, "deviation-heading": 2.616864513095146, "agent_compute-ego0": 0.01031970121583886, "agent_compute-ego1": 0.009931086176666763, "agent_compute-ego2": 0.010298904134423694, "agent_compute-ego3": 0.010404746176788162, "complete-iteration": 0.9144081641297314, "set_robot_commands": 0.002332839517962208, "deviation-center-line": 0.2744113396428254, "driven_lanedir_consec": 0.3452608587421049, "sim_compute_sim_state": 0.03500686034313223, "sim_compute_performance-ego0": 0.0021525509449658474, "sim_compute_performance-ego1": 0.00200931406811456, "sim_compute_performance-ego2": 0.002020695591499792, "sim_compute_performance-ego3": 0.0020196266595829916}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 2.1921646557830226, "get_ui_image": 0.05574994192597616, "step_physics": 0.7252282319147942, "survival_time": 18.05000000000012, "driven_lanedir": 0.950247335154313, "get_state_dump": 0.009887120341727746, "get_robot_state": 0.014576709072892838, "sim_render-ego0": 0.003881011878587923, "sim_render-ego1": 0.003801393245465189, "sim_render-ego2": 0.0037537879048131447, "sim_render-ego3": 0.0038439153966324103, "get_duckie_state": 1.6379751553192982e-06, "in-drivable-lane": 5.900000000000056, "deviation-heading": 9.89336417759698, "agent_compute-ego0": 0.01031970121583886, "agent_compute-ego1": 0.009931086176666763, "agent_compute-ego2": 0.010298904134423694, "agent_compute-ego3": 0.010404746176788162, "complete-iteration": 0.9144081641297314, "set_robot_commands": 0.002332839517962208, "deviation-center-line": 1.2340961821728105, "driven_lanedir_consec": 0.9383491558168096, "sim_compute_sim_state": 0.03500686034313223, "sim_compute_performance-ego0": 0.0021525509449658474, "sim_compute_performance-ego1": 0.00200931406811456, "sim_compute_performance-ego2": 0.002020695591499792, "sim_compute_performance-ego3": 0.0020196266595829916}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 1.6265458788524405, "get_ui_image": 0.05157002565023061, "step_physics": 0.8015551470421456, "survival_time": 11.050000000000022, "driven_lanedir": 0.5969086386212554, "get_state_dump": 0.009693314363290595, "get_robot_state": 0.01437444729847951, "sim_render-ego0": 0.003812215349695704, "sim_render-ego1": 0.0037010467804230018, "sim_render-ego2": 0.003705713126036498, "sim_render-ego3": 0.003753016660879324, "get_duckie_state": 1.5851613637563344e-06, "in-drivable-lane": 4.099999999999986, "deviation-heading": 5.515599778378545, "agent_compute-ego0": 0.010220511539562329, "agent_compute-ego1": 0.009822580191466186, "agent_compute-ego2": 0.01044251467730548, "agent_compute-ego3": 0.010195308977419193, "complete-iteration": 0.9805203235901154, "set_robot_commands": 0.00232209063865043, "deviation-center-line": 0.6490637610763768, "driven_lanedir_consec": 0.5033709260791603, "sim_compute_sim_state": 0.03065669214403307, "sim_compute_performance-ego0": 0.002106360487035803, "sim_compute_performance-ego1": 0.0019287440153929565, "sim_compute_performance-ego2": 0.0019097467800518416, "sim_compute_performance-ego3": 0.0019259903882000895}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 1.6511245063698163, "get_ui_image": 0.05157002565023061, "step_physics": 0.8015551470421456, "survival_time": 11.050000000000022, "driven_lanedir": 0.7044487625693081, "get_state_dump": 0.009693314363290595, "get_robot_state": 0.01437444729847951, "sim_render-ego0": 0.003812215349695704, "sim_render-ego1": 0.0037010467804230018, "sim_render-ego2": 0.003705713126036498, "sim_render-ego3": 0.003753016660879324, "get_duckie_state": 1.5851613637563344e-06, "in-drivable-lane": 6.350000000000031, "deviation-heading": 0.7805520674724286, "agent_compute-ego0": 0.010220511539562329, "agent_compute-ego1": 0.009822580191466186, "agent_compute-ego2": 0.01044251467730548, "agent_compute-ego3": 0.010195308977419193, "complete-iteration": 0.9805203235901154, "set_robot_commands": 0.00232209063865043, "deviation-center-line": 0.20859790767505185, "driven_lanedir_consec": 0.7044487625693081, "sim_compute_sim_state": 0.03065669214403307, "sim_compute_performance-ego0": 0.002106360487035803, "sim_compute_performance-ego1": 0.0019287440153929565, "sim_compute_performance-ego2": 0.0019097467800518416, "sim_compute_performance-ego3": 0.0019259903882000895}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 1.076376701012898, "get_ui_image": 0.05157002565023061, "step_physics": 0.8015551470421456, "survival_time": 11.050000000000022, "driven_lanedir": 0.4129381507362462, "get_state_dump": 0.009693314363290595, "get_robot_state": 0.01437444729847951, "sim_render-ego0": 0.003812215349695704, "sim_render-ego1": 0.0037010467804230018, "sim_render-ego2": 0.003705713126036498, "sim_render-ego3": 0.003753016660879324, "get_duckie_state": 1.5851613637563344e-06, "in-drivable-lane": 3.149999999999989, "deviation-heading": 7.197997781935392, "agent_compute-ego0": 0.010220511539562329, "agent_compute-ego1": 0.009822580191466186, "agent_compute-ego2": 0.01044251467730548, "agent_compute-ego3": 0.010195308977419193, "complete-iteration": 0.9805203235901154, "set_robot_commands": 0.00232209063865043, "deviation-center-line": 0.8582325023522362, "driven_lanedir_consec": 0.4129381507362462, "sim_compute_sim_state": 0.03065669214403307, "sim_compute_performance-ego0": 0.002106360487035803, "sim_compute_performance-ego1": 0.0019287440153929565, "sim_compute_performance-ego2": 0.0019097467800518416, "sim_compute_performance-ego3": 0.0019259903882000895}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 0.38992907230453727, "get_ui_image": 0.05157002565023061, "step_physics": 0.8015551470421456, "survival_time": 11.050000000000022, "driven_lanedir": 0.3192616717652883, "get_state_dump": 0.009693314363290595, "get_robot_state": 0.01437444729847951, "sim_render-ego0": 0.003812215349695704, "sim_render-ego1": 0.0037010467804230018, "sim_render-ego2": 0.003705713126036498, "sim_render-ego3": 0.003753016660879324, "get_duckie_state": 1.5851613637563344e-06, "in-drivable-lane": 8.600000000000023, "deviation-heading": 1.0056611942440323, "agent_compute-ego0": 0.010220511539562329, "agent_compute-ego1": 0.009822580191466186, "agent_compute-ego2": 0.01044251467730548, "agent_compute-ego3": 0.010195308977419193, "complete-iteration": 0.9805203235901154, "set_robot_commands": 0.00232209063865043, "deviation-center-line": 0.18439074482977807, "driven_lanedir_consec": 0.3192616717652883, "sim_compute_sim_state": 0.03065669214403307, "sim_compute_performance-ego0": 0.002106360487035803, "sim_compute_performance-ego1": 0.0019287440153929565, "sim_compute_performance-ego2": 0.0019097467800518416, "sim_compute_performance-ego3": 0.0019259903882000895}}
set_robot_commands_max0.002332839517962208
set_robot_commands_mean0.002327465078306319
set_robot_commands_median0.002327465078306319
set_robot_commands_min0.00232209063865043
sim_compute_performance-ego0_max0.0021525509449658474
sim_compute_performance-ego0_mean0.002129455716000825
sim_compute_performance-ego0_median0.002129455716000825
sim_compute_performance-ego0_min0.002106360487035803
sim_compute_performance-ego1_max0.00200931406811456
sim_compute_performance-ego1_mean0.001969029041753758
sim_compute_performance-ego1_median0.001969029041753758
sim_compute_performance-ego1_min0.0019287440153929565
sim_compute_performance-ego2_max0.002020695591499792
sim_compute_performance-ego2_mean0.0019652211857758167
sim_compute_performance-ego2_median0.0019652211857758167
sim_compute_performance-ego2_min0.0019097467800518416
sim_compute_performance-ego3_max0.0020196266595829916
sim_compute_performance-ego3_mean0.0019728085238915408
sim_compute_performance-ego3_median0.0019728085238915408
sim_compute_performance-ego3_min0.0019259903882000895
sim_compute_sim_state_max0.03500686034313223
sim_compute_sim_state_mean0.03283177624358265
sim_compute_sim_state_median0.03283177624358265
sim_compute_sim_state_min0.03065669214403307
sim_render-ego0_max0.003881011878587923
sim_render-ego0_mean0.0038466136141418134
sim_render-ego0_median0.0038466136141418134
sim_render-ego0_min0.003812215349695704
sim_render-ego1_max0.003801393245465189
sim_render-ego1_mean0.003751220012944095
sim_render-ego1_median0.003751220012944095
sim_render-ego1_min0.0037010467804230018
sim_render-ego2_max0.0037537879048131447
sim_render-ego2_mean0.0037297505154248217
sim_render-ego2_median0.0037297505154248217
sim_render-ego2_min0.003705713126036498
sim_render-ego3_max0.0038439153966324103
sim_render-ego3_mean0.003798466028755867
sim_render-ego3_median0.003798466028755867
sim_render-ego3_min0.003753016660879324
simulation-passed1
step_physics_max0.8015551470421456
step_physics_mean0.7633916894784699
step_physics_median0.7633916894784699
step_physics_min0.7252282319147942
survival_time_max18.05000000000012
survival_time_mean14.550000000000072
survival_time_min11.050000000000022
No reset possible
53430LFVIv-simsuccessyes0:17:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53429LFVIv-simsuccessyes0:17:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53422LFVIv-simsuccessyes0:17:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53381LFVIv-simabortedno0:45:12
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53380LFVIv-simabortedno0:45:44
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53376LFVIv-simabortedno0:46:17
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53336LFVIv-simabortedno0:06:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible