Duckietown Challenges Home Challenges Submissions

Job 65897

Job ID65897
submission13593
userAndras Beres
user label202-1
challengeaido-LFV_multi-sim-validation
step402
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorgpu-production-spot-1-02
date started
date completed
duration0:48:04
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median41.99999999999975
in-drivable-lane_median0.5500000000000043
driven_lanedir_consec_median12.593708356652003
deviation-center-line_median3.17688221834753


other stats
agent_compute-ego0_max0.027368413462183785
agent_compute-ego0_mean0.02630675889484556
agent_compute-ego0_median0.02630675889484556
agent_compute-ego0_min0.025245104327507335
agent_compute-ego1_max0.02325963940793093
agent_compute-ego1_mean0.021361117127696217
agent_compute-ego1_median0.021361117127696217
agent_compute-ego1_min0.019462594847461493
agent_compute-ego2_max0.022118828754903213
agent_compute-ego2_mean0.020646384842268828
agent_compute-ego2_median0.020646384842268828
agent_compute-ego2_min0.019173940929634443
agent_compute-ego3_max0.020340878933791797
agent_compute-ego3_mean0.019357355001348373
agent_compute-ego3_median0.019357355001348373
agent_compute-ego3_min0.01837383106890495
complete-iteration_max0.9311465796593312
complete-iteration_mean0.8285011882207092
complete-iteration_median0.8285011882207092
complete-iteration_min0.7258557967820871
deviation-center-line_max4.36426391100485
deviation-center-line_mean3.22735939084556
deviation-center-line_min2.300471697029999
deviation-heading_max11.24195297238657
deviation-heading_mean6.3085036813801
deviation-heading_median5.86399088311939
deviation-heading_min3.3710689067607893
driven_any_max22.505112897383498
driven_any_mean14.393412240237208
driven_any_median13.148016157425744
driven_any_min10.857545182725268
driven_lanedir_consec_max21.23246817162177
driven_lanedir_consec_mean13.868149980024302
driven_lanedir_consec_min10.64994298166031
driven_lanedir_max21.23246817162177
driven_lanedir_mean13.868149980024302
driven_lanedir_median12.593708356652003
driven_lanedir_min10.64994298166031
get_duckie_state_max3.3033259399754092e-06
get_duckie_state_mean3.1691081899852533e-06
get_duckie_state_median3.1691081899852533e-06
get_duckie_state_min3.034890439995097e-06
get_robot_state_max0.016313316430222026
get_robot_state_mean0.015999533088339603
get_robot_state_median0.015999533088339603
get_robot_state_min0.015685749746457176
get_state_dump_max0.010736210764616646
get_state_dump_mean0.010661013172338016
get_state_dump_median0.010661013172338016
get_state_dump_min0.010585815580059384
get_ui_image_max0.05411938710826066
get_ui_image_mean0.050877602185192106
get_ui_image_median0.050877602185192106
get_ui_image_min0.04763581726212355
in-drivable-lane_max2.2999999999999865
in-drivable-lane_mean0.8062500000000015
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 17.965589558795916, "get_ui_image": 0.04763581726212355, "step_physics": 0.4985884773365966, "survival_time": 35.8500000000001, "driven_lanedir": 17.573629289655322, "get_state_dump": 0.010736210764616646, "get_robot_state": 0.016313316430222026, "sim_render-ego0": 0.004321186987470451, "sim_render-ego1": 0.004143127491879264, "sim_render-ego2": 0.00412072079427395, "sim_render-ego3": 0.0041115473239866805, "get_duckie_state": 3.3033259399754092e-06, "in-drivable-lane": 0.4500000000000029, "deviation-heading": 4.5992298488982035, "agent_compute-ego0": 0.025245104327507335, "agent_compute-ego1": 0.02325963940793093, "agent_compute-ego2": 0.022118828754903213, "agent_compute-ego3": 0.01837383106890495, "complete-iteration": 0.7258557967820871, "set_robot_commands": 0.002542113527282035, "deviation-center-line": 2.300471697029999, "driven_lanedir_consec": 17.573629289655322, "sim_compute_sim_state": 0.02686701544812131, "sim_compute_performance-ego0": 0.002414611720773171, "sim_compute_performance-ego1": 0.0023202627150129143, "sim_compute_performance-ego2": 0.0022977085830773484, "sim_compute_performance-ego3": 0.0022906798838240854}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 11.220895235839588, "get_ui_image": 0.04763581726212355, "step_physics": 0.4985884773365966, "survival_time": 35.8500000000001, "driven_lanedir": 11.081393940726109, "get_state_dump": 0.010736210764616646, "get_robot_state": 0.016313316430222026, "sim_render-ego0": 0.004321186987470451, "sim_render-ego1": 0.004143127491879264, "sim_render-ego2": 0.00412072079427395, "sim_render-ego3": 0.0041115473239866805, "get_duckie_state": 3.3033259399754092e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.3710689067607893, "agent_compute-ego0": 0.025245104327507335, "agent_compute-ego1": 0.02325963940793093, "agent_compute-ego2": 0.022118828754903213, "agent_compute-ego3": 0.01837383106890495, "complete-iteration": 0.7258557967820871, "set_robot_commands": 0.002542113527282035, "deviation-center-line": 3.1983738649826936, "driven_lanedir_consec": 11.081393940726109, "sim_compute_sim_state": 0.02686701544812131, "sim_compute_performance-ego0": 0.002414611720773171, "sim_compute_performance-ego1": 0.0023202627150129143, "sim_compute_performance-ego2": 0.0022977085830773484, "sim_compute_performance-ego3": 0.0022906798838240854}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 10.857545182725268, "get_ui_image": 0.04763581726212355, "step_physics": 0.4985884773365966, "survival_time": 35.8500000000001, "driven_lanedir": 10.64994298166031, "get_state_dump": 0.010736210764616646, "get_robot_state": 0.016313316430222026, "sim_render-ego0": 0.004321186987470451, "sim_render-ego1": 0.004143127491879264, "sim_render-ego2": 0.00412072079427395, "sim_render-ego3": 0.0041115473239866805, "get_duckie_state": 3.3033259399754092e-06, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 3.610357908114036, "agent_compute-ego0": 0.025245104327507335, "agent_compute-ego1": 0.02325963940793093, "agent_compute-ego2": 0.022118828754903213, "agent_compute-ego3": 0.01837383106890495, "complete-iteration": 0.7258557967820871, "set_robot_commands": 0.002542113527282035, "deviation-center-line": 2.462117451170284, "driven_lanedir_consec": 10.64994298166031, "sim_compute_sim_state": 0.02686701544812131, "sim_compute_performance-ego0": 0.002414611720773171, "sim_compute_performance-ego1": 0.0023202627150129143, "sim_compute_performance-ego2": 0.0022977085830773484, "sim_compute_performance-ego3": 0.0022906798838240854}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 14.709919736822012, "get_ui_image": 0.04763581726212355, "step_physics": 0.4985884773365966, "survival_time": 35.8500000000001, "driven_lanedir": 14.45320891348207, "get_state_dump": 0.010736210764616646, "get_robot_state": 0.016313316430222026, "sim_render-ego0": 0.004321186987470451, "sim_render-ego1": 0.004143127491879264, "sim_render-ego2": 0.00412072079427395, "sim_render-ego3": 0.0041115473239866805, "get_duckie_state": 3.3033259399754092e-06, "in-drivable-lane": 0.20000000000000284, "deviation-heading": 4.3397854135411205, "agent_compute-ego0": 0.025245104327507335, "agent_compute-ego1": 0.02325963940793093, "agent_compute-ego2": 0.022118828754903213, "agent_compute-ego3": 0.01837383106890495, "complete-iteration": 0.7258557967820871, "set_robot_commands": 0.002542113527282035, "deviation-center-line": 2.6612846070622944, "driven_lanedir_consec": 14.45320891348207, "sim_compute_sim_state": 0.02686701544812131, "sim_compute_performance-ego0": 0.002414611720773171, "sim_compute_performance-ego1": 0.0023202627150129143, "sim_compute_performance-ego2": 0.0022977085830773484, "sim_compute_performance-ego3": 0.0022906798838240854}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 22.505112897383498, "get_ui_image": 0.05411938710826066, "step_physics": 0.6922467773880702, "survival_time": 48.1499999999994, "driven_lanedir": 21.23246817162177, "get_state_dump": 0.010585815580059384, "get_robot_state": 0.015685749746457176, "sim_render-ego0": 0.004146445588946837, "sim_render-ego1": 0.004119389779340182, "sim_render-ego2": 0.004107974376915896, "sim_render-ego3": 0.00407834369611938, "get_duckie_state": 3.034890439995097e-06, "in-drivable-lane": 2.2999999999999865, "deviation-heading": 7.7640754021523986, "agent_compute-ego0": 0.027368413462183785, "agent_compute-ego1": 0.019462594847461493, "agent_compute-ego2": 0.019173940929634443, "agent_compute-ego3": 0.020340878933791797, "complete-iteration": 0.9311465796593312, "set_robot_commands": 0.002527799596430355, "deviation-center-line": 3.4963581838987436, "driven_lanedir_consec": 21.23246817162177, "sim_compute_sim_state": 0.03634548879757956, "sim_compute_performance-ego0": 0.002304686550282838, "sim_compute_performance-ego1": 0.0022368144197582704, "sim_compute_performance-ego2": 0.002272171845574597, "sim_compute_performance-ego3": 0.002213444699884945}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 11.586112578029471, "get_ui_image": 0.05411938710826066, "step_physics": 0.6922467773880702, "survival_time": 48.1499999999994, "driven_lanedir": 10.953939461462518, "get_state_dump": 0.010585815580059384, "get_robot_state": 0.015685749746457176, "sim_render-ego0": 0.004146445588946837, "sim_render-ego1": 0.004119389779340182, "sim_render-ego2": 0.004107974376915896, "sim_render-ego3": 0.00407834369611938, "get_duckie_state": 3.034890439995097e-06, "in-drivable-lane": 1.150000000000002, "deviation-heading": 11.24195297238657, "agent_compute-ego0": 0.027368413462183785, "agent_compute-ego1": 0.019462594847461493, "agent_compute-ego2": 0.019173940929634443, "agent_compute-ego3": 0.020340878933791797, "complete-iteration": 0.9311465796593312, "set_robot_commands": 0.002527799596430355, "deviation-center-line": 4.180614839903248, "driven_lanedir_consec": 10.953939461462518, "sim_compute_sim_state": 0.03634548879757956, "sim_compute_performance-ego0": 0.002304686550282838, "sim_compute_performance-ego1": 0.0022368144197582704, "sim_compute_performance-ego2": 0.002272171845574597, "sim_compute_performance-ego3": 0.002213444699884945}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 14.954890892498108, "get_ui_image": 0.05411938710826066, "step_physics": 0.6922467773880702, "survival_time": 48.1499999999994, "driven_lanedir": 14.106022772577898, "get_state_dump": 0.010585815580059384, "get_robot_state": 0.015685749746457176, "sim_render-ego0": 0.004146445588946837, "sim_render-ego1": 0.004119389779340182, "sim_render-ego2": 0.004107974376915896, "sim_render-ego3": 0.00407834369611938, "get_duckie_state": 3.034890439995097e-06, "in-drivable-lane": 1.5000000000000124, "deviation-heading": 7.128751917340577, "agent_compute-ego0": 0.027368413462183785, "agent_compute-ego1": 0.019462594847461493, "agent_compute-ego2": 0.019173940929634443, "agent_compute-ego3": 0.020340878933791797, "complete-iteration": 0.9311465796593312, "set_robot_commands": 0.002527799596430355, "deviation-center-line": 3.155390571712366, "driven_lanedir_consec": 14.106022772577898, "sim_compute_sim_state": 0.03634548879757956, "sim_compute_performance-ego0": 0.002304686550282838, "sim_compute_performance-ego1": 0.0022368144197582704, "sim_compute_performance-ego2": 0.002272171845574597, "sim_compute_performance-ego3": 0.002213444699884945}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 11.347231839803808, "get_ui_image": 0.05411938710826066, "step_physics": 0.6922467773880702, "survival_time": 48.1499999999994, "driven_lanedir": 10.89459430900842, "get_state_dump": 0.010585815580059384, "get_robot_state": 0.015685749746457176, "sim_render-ego0": 0.004146445588946837, "sim_render-ego1": 0.004119389779340182, "sim_render-ego2": 0.004107974376915896, "sim_render-ego3": 0.00407834369611938, "get_duckie_state": 3.034890439995097e-06, "in-drivable-lane": 0.6500000000000057, "deviation-heading": 8.4128070818471, "agent_compute-ego0": 0.027368413462183785, "agent_compute-ego1": 0.019462594847461493, "agent_compute-ego2": 0.019173940929634443, "agent_compute-ego3": 0.020340878933791797, "complete-iteration": 0.9311465796593312, "set_robot_commands": 0.002527799596430355, "deviation-center-line": 4.36426391100485, "driven_lanedir_consec": 10.89459430900842, "sim_compute_sim_state": 0.03634548879757956, "sim_compute_performance-ego0": 0.002304686550282838, "sim_compute_performance-ego1": 0.0022368144197582704, "sim_compute_performance-ego2": 0.002272171845574597, "sim_compute_performance-ego3": 0.002213444699884945}}
set_robot_commands_max0.002542113527282035
set_robot_commands_mean0.002534956561856195
set_robot_commands_median0.002534956561856195
set_robot_commands_min0.002527799596430355
sim_compute_performance-ego0_max0.002414611720773171
sim_compute_performance-ego0_mean0.0023596491355280047
sim_compute_performance-ego0_median0.0023596491355280047
sim_compute_performance-ego0_min0.002304686550282838
sim_compute_performance-ego1_max0.0023202627150129143
sim_compute_performance-ego1_mean0.0022785385673855926
sim_compute_performance-ego1_median0.0022785385673855926
sim_compute_performance-ego1_min0.0022368144197582704
sim_compute_performance-ego2_max0.0022977085830773484
sim_compute_performance-ego2_mean0.002284940214325973
sim_compute_performance-ego2_median0.002284940214325973
sim_compute_performance-ego2_min0.002272171845574597
sim_compute_performance-ego3_max0.0022906798838240854
sim_compute_performance-ego3_mean0.0022520622918545154
sim_compute_performance-ego3_median0.0022520622918545154
sim_compute_performance-ego3_min0.002213444699884945
sim_compute_sim_state_max0.03634548879757956
sim_compute_sim_state_mean0.03160625212285043
sim_compute_sim_state_median0.03160625212285043
sim_compute_sim_state_min0.02686701544812131
sim_render-ego0_max0.004321186987470451
sim_render-ego0_mean0.004233816288208644
sim_render-ego0_median0.004233816288208644
sim_render-ego0_min0.004146445588946837
sim_render-ego1_max0.004143127491879264
sim_render-ego1_mean0.004131258635609723
sim_render-ego1_median0.004131258635609723
sim_render-ego1_min0.004119389779340182
sim_render-ego2_max0.00412072079427395
sim_render-ego2_mean0.004114347585594923
sim_render-ego2_median0.004114347585594923
sim_render-ego2_min0.004107974376915896
sim_render-ego3_max0.0041115473239866805
sim_render-ego3_mean0.00409494551005303
sim_render-ego3_median0.00409494551005303
sim_render-ego3_min0.00407834369611938
simulation-passed1
step_physics_max0.6922467773880702
step_physics_mean0.5954176273623334
step_physics_median0.5954176273623334
step_physics_min0.4985884773365966
survival_time_max48.1499999999994
survival_time_mean41.99999999999975
survival_time_min35.8500000000001

Highlights

65897

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-zigzag-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.