Duckietown Challenges Home Challenges Submissions

Submission 12652

Submission12652
Competingyes
Challengeaido5-LFVI_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVIv-sim: 53820
Next
User labeltemplate-pytorch
Admin priority50
Blessingn/a
User priority50

53820

Click the images to see detailed statistics about the episode.

LFVI_multi-norm-4way-000

LFVI_multi-norm-udem1-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53820LFVIv-simsuccessyes0:16:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08672258165945501
survival_time_median9.725000000000051
deviation-center-line_median0.07049898153719247
in-drivable-lane_median8.45000000000005


other stats
agent_compute-ego0_max0.013256324421275743
agent_compute-ego0_mean0.012942744623789025
agent_compute-ego0_median0.012942744623789025
agent_compute-ego0_min0.0126291648263023
agent_compute-ego1_max0.013129880211570046
agent_compute-ego1_mean0.01259183892697999
agent_compute-ego1_median0.01259183892697999
agent_compute-ego1_min0.012053797642389933
agent_compute-ego2_max0.01327245452187278
agent_compute-ego2_mean0.012671333783632747
agent_compute-ego2_median0.012671333783632747
agent_compute-ego2_min0.012070213045392715
agent_compute-ego3_max0.012819177454168149
agent_compute-ego3_mean0.012320676078270008
agent_compute-ego3_median0.012320676078270008
agent_compute-ego3_min0.01182217470237187
complete-iteration_max1.5377024369580403
complete-iteration_mean1.4559744087519584
complete-iteration_median1.4559744087519584
complete-iteration_min1.3742463805458762
deviation-center-line_max0.21998756451335297
deviation-center-line_mean0.08730729117887631
deviation-center-line_min0.039660659054825305
deviation-heading_max1.6345977838434222
deviation-heading_mean0.8889140414729613
deviation-heading_median0.8251403596405193
deviation-heading_min0.6016189861540672
driven_any_max2.5059777030207475
driven_any_mean0.502999127444291
driven_any_median0.229345020306139
driven_any_min0.08613330749720749
driven_lanedir_consec_max0.12500032862450228
driven_lanedir_consec_mean0.08910260733273437
driven_lanedir_consec_min0.04557006531332019
driven_lanedir_max0.12500032862450228
driven_lanedir_mean0.08910260733273437
driven_lanedir_median0.08672258165945501
driven_lanedir_min0.04557006531332019
get_duckie_state_max1.1928024746122817e-06
get_duckie_state_mean1.1816104769190669e-06
get_duckie_state_median1.1816104769190669e-06
get_duckie_state_min1.1704184792258525e-06
get_robot_state_max0.013947824998335403
get_robot_state_mean0.013837472849336022
get_robot_state_median0.013837472849336022
get_robot_state_min0.013727120700336638
get_state_dump_max0.00949088443409313
get_state_dump_mean0.009386826103383844
get_state_dump_median0.009386826103383844
get_state_dump_min0.00928276777267456
get_ui_image_max0.05405940966946738
get_ui_image_mean0.05347828627019734
get_ui_image_median0.05347828627019734
get_ui_image_min0.05289716287092729
in-drivable-lane_max15.700000000000102
in-drivable-lane_mean8.312500000000052
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 2.5059777030207475, "get_ui_image": 0.05405940966946738, "step_physics": 1.3674101957253046, "survival_time": 16.750000000000103, "driven_lanedir": 0.12500032862450228, "get_state_dump": 0.00928276777267456, "get_robot_state": 0.013727120700336638, "sim_render-ego0": 0.0036003043254216513, "sim_render-ego1": 0.0035558023623057772, "sim_render-ego2": 0.0035548110802968345, "sim_render-ego3": 0.0035266436281658356, "get_duckie_state": 1.1928024746122817e-06, "in-drivable-lane": 15.350000000000104, "deviation-heading": 0.7547441266989323, "agent_compute-ego0": 0.0126291648263023, "agent_compute-ego1": 0.012053797642389933, "agent_compute-ego2": 0.012070213045392715, "agent_compute-ego3": 0.01182217470237187, "complete-iteration": 1.5377024369580403, "set_robot_commands": 0.0021240065495173135, "deviation-center-line": 0.06987775375947997, "driven_lanedir_consec": 0.12500032862450228, "sim_compute_sim_state": 0.014249935746192932, "sim_compute_performance-ego0": 0.0018596301476160688, "sim_compute_performance-ego1": 0.0018373621361596243, "sim_compute_performance-ego2": 0.0018877663782664708, "sim_compute_performance-ego3": 0.0018895559367679417}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 0.17668828699244837, "get_ui_image": 0.05405940966946738, "step_physics": 1.3674101957253046, "survival_time": 16.750000000000103, "driven_lanedir": 0.04557006531332019, "get_state_dump": 0.00928276777267456, "get_robot_state": 0.013727120700336638, "sim_render-ego0": 0.0036003043254216513, "sim_render-ego1": 0.0035558023623057772, "sim_render-ego2": 0.0035548110802968345, "sim_render-ego3": 0.0035266436281658356, "get_duckie_state": 1.1928024746122817e-06, "in-drivable-lane": 15.700000000000102, "deviation-heading": 0.8690228611869966, "agent_compute-ego0": 0.0126291648263023, "agent_compute-ego1": 0.012053797642389933, "agent_compute-ego2": 0.012070213045392715, "agent_compute-ego3": 0.01182217470237187, "complete-iteration": 1.5377024369580403, "set_robot_commands": 0.0021240065495173135, "deviation-center-line": 0.039660659054825305, "driven_lanedir_consec": 0.04557006531332019, "sim_compute_sim_state": 0.014249935746192932, "sim_compute_performance-ego0": 0.0018596301476160688, "sim_compute_performance-ego1": 0.0018373621361596243, "sim_compute_performance-ego2": 0.0018877663782664708, "sim_compute_performance-ego3": 0.0018895559367679417}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 0.221782257270239, "get_ui_image": 0.05405940966946738, "step_physics": 1.3674101957253046, "survival_time": 16.750000000000103, "driven_lanedir": 0.1152078178995819, "get_state_dump": 0.00928276777267456, "get_robot_state": 0.013727120700336638, "sim_render-ego0": 0.0036003043254216513, "sim_render-ego1": 0.0035558023623057772, "sim_render-ego2": 0.0035548110802968345, "sim_render-ego3": 0.0035266436281658356, "get_duckie_state": 1.1928024746122817e-06, "in-drivable-lane": 15.300000000000104, "deviation-heading": 0.8798023541884048, "agent_compute-ego0": 0.0126291648263023, "agent_compute-ego1": 0.012053797642389933, "agent_compute-ego2": 0.012070213045392715, "agent_compute-ego3": 0.01182217470237187, "complete-iteration": 1.5377024369580403, "set_robot_commands": 0.0021240065495173135, "deviation-center-line": 0.079310250668293, "driven_lanedir_consec": 0.1152078178995819, "sim_compute_sim_state": 0.014249935746192932, "sim_compute_performance-ego0": 0.0018596301476160688, "sim_compute_performance-ego1": 0.0018373621361596243, "sim_compute_performance-ego2": 0.0018877663782664708, "sim_compute_performance-ego3": 0.0018895559367679417}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 0.267479969191447, "get_ui_image": 0.05405940966946738, "step_physics": 1.3674101957253046, "survival_time": 16.750000000000103, "driven_lanedir": 0.08269737970837587, "get_state_dump": 0.00928276777267456, "get_robot_state": 0.013727120700336638, "sim_render-ego0": 0.0036003043254216513, "sim_render-ego1": 0.0035558023623057772, "sim_render-ego2": 0.0035548110802968345, "sim_render-ego3": 0.0035266436281658356, "get_duckie_state": 1.1928024746122817e-06, "in-drivable-lane": 15.650000000000102, "deviation-heading": 0.6016189861540672, "agent_compute-ego0": 0.0126291648263023, "agent_compute-ego1": 0.012053797642389933, "agent_compute-ego2": 0.012070213045392715, "agent_compute-ego3": 0.01182217470237187, "complete-iteration": 1.5377024369580403, "set_robot_commands": 0.0021240065495173135, "deviation-center-line": 0.071120209314905, "driven_lanedir_consec": 0.08269737970837587, "sim_compute_sim_state": 0.014249935746192932, "sim_compute_performance-ego0": 0.0018596301476160688, "sim_compute_performance-ego1": 0.0018373621361596243, "sim_compute_performance-ego2": 0.0018877663782664708, "sim_compute_performance-ego3": 0.0018895559367679417}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 0.08613330749720749, "get_ui_image": 0.05289716287092729, "step_physics": 1.1878787170756946, "survival_time": 2.6999999999999984, "driven_lanedir": 0.07276239153796382, "get_state_dump": 0.00949088443409313, "get_robot_state": 0.013947824998335403, "sim_render-ego0": 0.003642749786376953, "sim_render-ego1": 0.00381860299543901, "sim_render-ego2": 0.003716291080821644, "sim_render-ego3": 0.003723075173117898, "get_duckie_state": 1.1704184792258525e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.6345977838434222, "agent_compute-ego0": 0.013256324421275743, "agent_compute-ego1": 0.013129880211570046, "agent_compute-ego2": 0.01327245452187278, "agent_compute-ego3": 0.012819177454168149, "complete-iteration": 1.3742463805458762, "set_robot_commands": 0.0021427371285178444, "deviation-center-line": 0.21998756451335297, "driven_lanedir_consec": 0.07276239153796382, "sim_compute_sim_state": 0.025907291065562856, "sim_compute_performance-ego0": 0.0019515210931951349, "sim_compute_performance-ego1": 0.0019725366072221237, "sim_compute_performance-ego2": 0.001957832683216442, "sim_compute_performance-ego3": 0.0019353433088822795}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 0.23690778334203905, "get_ui_image": 0.05289716287092729, "step_physics": 1.1878787170756946, "survival_time": 2.6999999999999984, "driven_lanedir": 0.09074778361053416, "get_state_dump": 0.00949088443409313, "get_robot_state": 0.013947824998335403, "sim_render-ego0": 0.003642749786376953, "sim_render-ego1": 0.00381860299543901, "sim_render-ego2": 0.003716291080821644, "sim_render-ego3": 0.003723075173117898, "get_duckie_state": 1.1704184792258525e-06, "in-drivable-lane": 1.499999999999998, "deviation-heading": 0.7814913067265511, "agent_compute-ego0": 0.013256324421275743, "agent_compute-ego1": 0.013129880211570046, "agent_compute-ego2": 0.01327245452187278, "agent_compute-ego3": 0.012819177454168149, "complete-iteration": 1.3742463805458762, "set_robot_commands": 0.0021427371285178444, "deviation-center-line": 0.059209150285057896, "driven_lanedir_consec": 0.09074778361053416, "sim_compute_sim_state": 0.025907291065562856, "sim_compute_performance-ego0": 0.0019515210931951349, "sim_compute_performance-ego1": 0.0019725366072221237, "sim_compute_performance-ego2": 0.001957832683216442, "sim_compute_performance-ego3": 0.0019353433088822795}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.20121237197910127, "get_ui_image": 0.05289716287092729, "step_physics": 1.1878787170756946, "survival_time": 2.6999999999999984, "driven_lanedir": 0.0815858534442162, "get_state_dump": 0.00949088443409313, "get_robot_state": 0.013947824998335403, "sim_render-ego0": 0.003642749786376953, "sim_render-ego1": 0.00381860299543901, "sim_render-ego2": 0.003716291080821644, "sim_render-ego3": 0.003723075173117898, "get_duckie_state": 1.1704184792258525e-06, "in-drivable-lane": 1.399999999999998, "deviation-heading": 0.7212455004308286, "agent_compute-ego0": 0.013256324421275743, "agent_compute-ego1": 0.013129880211570046, "agent_compute-ego2": 0.01327245452187278, "agent_compute-ego3": 0.012819177454168149, "complete-iteration": 1.3742463805458762, "set_robot_commands": 0.0021427371285178444, "deviation-center-line": 0.09138670317253247, "driven_lanedir_consec": 0.0815858534442162, "sim_compute_sim_state": 0.025907291065562856, "sim_compute_performance-ego0": 0.0019515210931951349, "sim_compute_performance-ego1": 0.0019725366072221237, "sim_compute_performance-ego2": 0.001957832683216442, "sim_compute_performance-ego3": 0.0019353433088822795}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 0.32781134026109854, "get_ui_image": 0.05289716287092729, "step_physics": 1.1878787170756946, "survival_time": 2.6999999999999984, "driven_lanedir": 0.09924923852338052, "get_state_dump": 0.00949088443409313, "get_robot_state": 0.013947824998335403, "sim_render-ego0": 0.003642749786376953, "sim_render-ego1": 0.00381860299543901, "sim_render-ego2": 0.003716291080821644, "sim_render-ego3": 0.003723075173117898, "get_duckie_state": 1.1704184792258525e-06, "in-drivable-lane": 1.599999999999998, "deviation-heading": 0.8687894125544877, "agent_compute-ego0": 0.013256324421275743, "agent_compute-ego1": 0.013129880211570046, "agent_compute-ego2": 0.01327245452187278, "agent_compute-ego3": 0.012819177454168149, "complete-iteration": 1.3742463805458762, "set_robot_commands": 0.0021427371285178444, "deviation-center-line": 0.06790603866256387, "driven_lanedir_consec": 0.09924923852338052, "sim_compute_sim_state": 0.025907291065562856, "sim_compute_performance-ego0": 0.0019515210931951349, "sim_compute_performance-ego1": 0.0019725366072221237, "sim_compute_performance-ego2": 0.001957832683216442, "sim_compute_performance-ego3": 0.0019353433088822795}}
set_robot_commands_max0.0021427371285178444
set_robot_commands_mean0.0021333718390175787
set_robot_commands_median0.0021333718390175787
set_robot_commands_min0.0021240065495173135
sim_compute_performance-ego0_max0.0019515210931951349
sim_compute_performance-ego0_mean0.0019055756204056015
sim_compute_performance-ego0_median0.0019055756204056015
sim_compute_performance-ego0_min0.0018596301476160688
sim_compute_performance-ego1_max0.0019725366072221237
sim_compute_performance-ego1_mean0.001904949371690874
sim_compute_performance-ego1_median0.001904949371690874
sim_compute_performance-ego1_min0.0018373621361596243
sim_compute_performance-ego2_max0.001957832683216442
sim_compute_performance-ego2_mean0.001922799530741456
sim_compute_performance-ego2_median0.001922799530741456
sim_compute_performance-ego2_min0.0018877663782664708
sim_compute_performance-ego3_max0.0019353433088822795
sim_compute_performance-ego3_mean0.0019124496228251104
sim_compute_performance-ego3_median0.0019124496228251104
sim_compute_performance-ego3_min0.0018895559367679417
sim_compute_sim_state_max0.025907291065562856
sim_compute_sim_state_mean0.020078613405877896
sim_compute_sim_state_median0.020078613405877896
sim_compute_sim_state_min0.014249935746192932
sim_render-ego0_max0.003642749786376953
sim_render-ego0_mean0.003621527055899302
sim_render-ego0_median0.003621527055899302
sim_render-ego0_min0.0036003043254216513
sim_render-ego1_max0.00381860299543901
sim_render-ego1_mean0.0036872026788723937
sim_render-ego1_median0.0036872026788723937
sim_render-ego1_min0.0035558023623057772
sim_render-ego2_max0.003716291080821644
sim_render-ego2_mean0.0036355510805592393
sim_render-ego2_median0.0036355510805592393
sim_render-ego2_min0.0035548110802968345
sim_render-ego3_max0.003723075173117898
sim_render-ego3_mean0.0036248594006418663
sim_render-ego3_median0.0036248594006418663
sim_render-ego3_min0.0035266436281658356
simulation-passed1
step_physics_max1.3674101957253046
step_physics_mean1.2776444564004996
step_physics_median1.2776444564004996
step_physics_min1.1878787170756946
survival_time_max16.750000000000103
survival_time_mean9.725000000000051
survival_time_min2.6999999999999984
No reset possible
53819LFVIv-simsuccessyes0:19:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53818LFVIv-simsuccessyes0:40:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible