Duckietown Challenges Home Challenges Submissions

Job 36057

Job ID36057
submission9800
userBea Baselines 🐤
user labelstraight
challengeaido5-LFVI_multi-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg05-1d8e1780ead1-1
date started
date completed
duration0:07:16
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4448271993029011
survival_time_median3.049999999999997
deviation-center-line_median0.16204229780465118
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.047864710698362255
agent_compute-ego0_mean0.04541067021792052
agent_compute-ego0_median0.04541067021792052
agent_compute-ego0_min0.04295662973747879
agent_compute-ego1_max0.045797148688894805
agent_compute-ego1_mean0.04396546277843538
agent_compute-ego1_median0.04396546277843538
agent_compute-ego1_min0.04213377686797595
agent_compute-ego2_max0.0460925962104172
agent_compute-ego2_mean0.04405393170528724
agent_compute-ego2_median0.04405393170528724
agent_compute-ego2_min0.04201526720015729
complete-iteration_max1.6197361008065645
complete-iteration_mean1.4833895573850535
complete-iteration_median1.4833895573850535
complete-iteration_min1.347043013963543
deviation-center-line_max0.25746356861009595
deviation-center-line_mean0.18326009620399683
deviation-center-line_min0.13466842791086536
deviation-heading_max0.7352695890794486
deviation-heading_mean0.3775885919320583
deviation-heading_median0.35956679565697475
deviation-heading_min0.030836127410108667
driven_any_max0.4484649879563624
driven_any_mean0.44802759571271383
driven_any_median0.4480275957127146
driven_any_min0.44759020346906503
driven_lanedir_consec_max0.44840955910620695
driven_lanedir_consec_mean0.4312421305378989
driven_lanedir_consec_min0.392074025770182
driven_lanedir_max0.44840955910620695
driven_lanedir_mean0.4312421305378989
driven_lanedir_median0.4448271993029011
driven_lanedir_min0.392074025770182
get_state_dump_max0.04584924901118044
get_state_dump_mean0.04398891964896781
get_state_dump_median0.04398891964896781
get_state_dump_min0.04212859028675517
get_ui_image_max0.1522679328918457
get_ui_image_mean0.1431624635321195
get_ui_image_median0.1431624635321195
get_ui_image_min0.1340569941723933
in-drivable-lane_max0.2499999999999991
in-drivable-lane_mean0.06666666666666643
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego0": {"driven_any": 0.4484649879563562, "get_ui_image": 0.1340569941723933, "step_physics": 0.8208649705667965, "survival_time": 3.049999999999997, "driven_lanedir": 0.445595259456681, "get_state_dump": 0.04584924901118044, "sim_render-ego0": 0.00868793393744797, "sim_render-ego1": 0.008883999996497983, "sim_render-ego2": 0.008675508811825612, "in-drivable-lane": 0.0, "deviation-heading": 0.3432464204151321, "agent_compute-ego0": 0.047864710698362255, "agent_compute-ego1": 0.045797148688894805, "agent_compute-ego2": 0.0460925962104172, "complete-iteration": 1.347043013963543, "set_robot_commands": 0.006458157398661629, "deviation-center-line": 0.1591290213325826, "driven_lanedir_consec": 0.445595259456681, "sim_compute_sim_state": 0.052483007556102315, "sim_compute_performance-ego0": 0.006364013327926886, "sim_compute_performance-ego1": 0.006189897412159404, "sim_compute_performance-ego2": 0.006204030552848441, "sim_compute_robot_state-ego0": 0.011554190369903064, "sim_compute_robot_state-ego1": 0.009084928231161148, "sim_compute_robot_state-ego2": 0.009697605351932714, "sim_compute_robot_state-parked0": 0.009908992736065974, "sim_compute_robot_state-parked1": 0.009955718869068583, "sim_compute_robot_state-parked2": 0.009964196408381228, "sim_compute_robot_state-parked3": 0.010380440070980886, "sim_compute_robot_state-parked4": 0.009446527137130989, "sim_compute_robot_state-parked5": 0.009297183302582288}, "udem1-0-0-ego1": {"driven_any": 0.4484649879563624, "get_ui_image": 0.1340569941723933, "step_physics": 0.8208649705667965, "survival_time": 3.049999999999997, "driven_lanedir": 0.44840955910620695, "get_state_dump": 0.04584924901118044, "sim_render-ego0": 0.00868793393744797, "sim_render-ego1": 0.008883999996497983, "sim_render-ego2": 0.008675508811825612, "in-drivable-lane": 0.0, "deviation-heading": 0.04625276718878463, "agent_compute-ego0": 0.047864710698362255, "agent_compute-ego1": 0.045797148688894805, "agent_compute-ego2": 0.0460925962104172, "complete-iteration": 1.347043013963543, "set_robot_commands": 0.006458157398661629, "deviation-center-line": 0.1398467777788016, "driven_lanedir_consec": 0.44840955910620695, "sim_compute_sim_state": 0.052483007556102315, "sim_compute_performance-ego0": 0.006364013327926886, "sim_compute_performance-ego1": 0.006189897412159404, "sim_compute_performance-ego2": 0.006204030552848441, "sim_compute_robot_state-ego0": 0.011554190369903064, "sim_compute_robot_state-ego1": 0.009084928231161148, "sim_compute_robot_state-ego2": 0.009697605351932714, "sim_compute_robot_state-parked0": 0.009908992736065974, "sim_compute_robot_state-parked1": 0.009955718869068583, "sim_compute_robot_state-parked2": 0.009964196408381228, "sim_compute_robot_state-parked3": 0.010380440070980886, "sim_compute_robot_state-parked4": 0.009446527137130989, "sim_compute_robot_state-parked5": 0.009297183302582288}, "udem1-0-0-ego2": {"driven_any": 0.4484649879563602, "get_ui_image": 0.1340569941723933, "step_physics": 0.8208649705667965, "survival_time": 3.049999999999997, "driven_lanedir": 0.4097509793208185, "get_state_dump": 0.04584924901118044, "sim_render-ego0": 0.00868793393744797, "sim_render-ego1": 0.008883999996497983, "sim_render-ego2": 0.008675508811825612, "in-drivable-lane": 0.14999999999999947, "deviation-heading": 0.7352695890794486, "agent_compute-ego0": 0.047864710698362255, "agent_compute-ego1": 0.045797148688894805, "agent_compute-ego2": 0.0460925962104172, "complete-iteration": 1.347043013963543, "set_robot_commands": 0.006458157398661629, "deviation-center-line": 0.25746356861009595, "driven_lanedir_consec": 0.4097509793208185, "sim_compute_sim_state": 0.052483007556102315, "sim_compute_performance-ego0": 0.006364013327926886, "sim_compute_performance-ego1": 0.006189897412159404, "sim_compute_performance-ego2": 0.006204030552848441, "sim_compute_robot_state-ego0": 0.011554190369903064, "sim_compute_robot_state-ego1": 0.009084928231161148, "sim_compute_robot_state-ego2": 0.009697605351932714, "sim_compute_robot_state-parked0": 0.009908992736065974, "sim_compute_robot_state-parked1": 0.009955718869068583, "sim_compute_robot_state-parked2": 0.009964196408381228, "sim_compute_robot_state-parked3": 0.010380440070980886, "sim_compute_robot_state-parked4": 0.009446527137130989, "sim_compute_robot_state-parked5": 0.009297183302582288}, "udem1-0-1-ego0": {"driven_any": 0.447590203469073, "get_ui_image": 0.1522679328918457, "step_physics": 1.0981566515125212, "survival_time": 3.049999999999997, "driven_lanedir": 0.4440591391491213, "get_state_dump": 0.04212859028675517, "sim_render-ego0": 0.009175120807084882, "sim_render-ego1": 0.00839025466168513, "sim_render-ego2": 0.008138840315771884, "in-drivable-lane": 0.0, "deviation-heading": 0.3758871708988174, "agent_compute-ego0": 0.04295662973747879, "agent_compute-ego1": 0.04213377686797595, "agent_compute-ego2": 0.04201526720015729, "complete-iteration": 1.6197361008065645, "set_robot_commands": 0.006342176531181961, "deviation-center-line": 0.16495557427671975, "driven_lanedir_consec": 0.4440591391491213, "sim_compute_sim_state": 0.05780729700307377, "sim_compute_performance-ego0": 0.006921639207933769, "sim_compute_performance-ego1": 0.005846426135203878, "sim_compute_performance-ego2": 0.005255257497068311, "sim_compute_robot_state-ego0": 0.010036734283947552, "sim_compute_robot_state-ego1": 0.009594639793771212, "sim_compute_robot_state-ego2": 0.008991405612132589, "sim_compute_robot_state-parked0": 0.00931142978980893, "sim_compute_robot_state-parked1": 0.008645155390755076, "sim_compute_robot_state-parked2": 0.008813389012070953, "sim_compute_robot_state-parked3": 0.008349891568793625, "sim_compute_robot_state-parked4": 0.00806734601005179, "sim_compute_robot_state-parked5": 0.008098324791329806}, "udem1-0-1-ego1": {"driven_any": 0.44759020346906503, "get_ui_image": 0.1522679328918457, "step_physics": 1.0981566515125212, "survival_time": 3.049999999999997, "driven_lanedir": 0.4475638204243837, "get_state_dump": 0.04212859028675517, "sim_render-ego0": 0.009175120807084882, "sim_render-ego1": 0.00839025466168513, "sim_render-ego2": 0.008138840315771884, "in-drivable-lane": 0.0, "deviation-heading": 0.030836127410108667, "agent_compute-ego0": 0.04295662973747879, "agent_compute-ego1": 0.04213377686797595, "agent_compute-ego2": 0.04201526720015729, "complete-iteration": 1.6197361008065645, "set_robot_commands": 0.006342176531181961, "deviation-center-line": 0.13466842791086536, "driven_lanedir_consec": 0.4475638204243837, "sim_compute_sim_state": 0.05780729700307377, "sim_compute_performance-ego0": 0.006921639207933769, "sim_compute_performance-ego1": 0.005846426135203878, "sim_compute_performance-ego2": 0.005255257497068311, "sim_compute_robot_state-ego0": 0.010036734283947552, "sim_compute_robot_state-ego1": 0.009594639793771212, "sim_compute_robot_state-ego2": 0.008991405612132589, "sim_compute_robot_state-parked0": 0.00931142978980893, "sim_compute_robot_state-parked1": 0.008645155390755076, "sim_compute_robot_state-parked2": 0.008813389012070953, "sim_compute_robot_state-parked3": 0.008349891568793625, "sim_compute_robot_state-parked4": 0.00806734601005179, "sim_compute_robot_state-parked5": 0.008098324791329806}, "udem1-0-1-ego2": {"driven_any": 0.4475902034690664, "get_ui_image": 0.1522679328918457, "step_physics": 1.0981566515125212, "survival_time": 3.049999999999997, "driven_lanedir": 0.392074025770182, "get_state_dump": 0.04212859028675517, "sim_render-ego0": 0.009175120807084882, "sim_render-ego1": 0.00839025466168513, "sim_render-ego2": 0.008138840315771884, "in-drivable-lane": 0.2499999999999991, "deviation-heading": 0.7340394766000586, "agent_compute-ego0": 0.04295662973747879, "agent_compute-ego1": 0.04213377686797595, "agent_compute-ego2": 0.04201526720015729, "complete-iteration": 1.6197361008065645, "set_robot_commands": 0.006342176531181961, "deviation-center-line": 0.24349720731491545, "driven_lanedir_consec": 0.392074025770182, "sim_compute_sim_state": 0.05780729700307377, "sim_compute_performance-ego0": 0.006921639207933769, "sim_compute_performance-ego1": 0.005846426135203878, "sim_compute_performance-ego2": 0.005255257497068311, "sim_compute_robot_state-ego0": 0.010036734283947552, "sim_compute_robot_state-ego1": 0.009594639793771212, "sim_compute_robot_state-ego2": 0.008991405612132589, "sim_compute_robot_state-parked0": 0.00931142978980893, "sim_compute_robot_state-parked1": 0.008645155390755076, "sim_compute_robot_state-parked2": 0.008813389012070953, "sim_compute_robot_state-parked3": 0.008349891568793625, "sim_compute_robot_state-parked4": 0.00806734601005179, "sim_compute_robot_state-parked5": 0.008098324791329806}}
set_robot_commands_max0.006458157398661629
set_robot_commands_mean0.006400166964921794
set_robot_commands_median0.006400166964921795
set_robot_commands_min0.006342176531181961
sim_compute_performance-ego0_max0.006921639207933769
sim_compute_performance-ego0_mean0.006642826267930327
sim_compute_performance-ego0_median0.006642826267930328
sim_compute_performance-ego0_min0.006364013327926886
sim_compute_performance-ego1_max0.006189897412159404
sim_compute_performance-ego1_mean0.006018161773681641
sim_compute_performance-ego1_median0.006018161773681641
sim_compute_performance-ego1_min0.005846426135203878
sim_compute_performance-ego2_max0.006204030552848441
sim_compute_performance-ego2_mean0.0057296440249583755
sim_compute_performance-ego2_median0.005729644024958376
sim_compute_performance-ego2_min0.005255257497068311
sim_compute_robot_state-ego0_max0.011554190369903064
sim_compute_robot_state-ego0_mean0.010795462326925308
sim_compute_robot_state-ego0_median0.010795462326925308
sim_compute_robot_state-ego0_min0.010036734283947552
sim_compute_robot_state-ego1_max0.009594639793771212
sim_compute_robot_state-ego1_mean0.00933978401246618
sim_compute_robot_state-ego1_median0.00933978401246618
sim_compute_robot_state-ego1_min0.009084928231161148
sim_compute_robot_state-ego2_max0.009697605351932714
sim_compute_robot_state-ego2_mean0.009344505482032653
sim_compute_robot_state-ego2_median0.009344505482032653
sim_compute_robot_state-ego2_min0.008991405612132589
sim_compute_robot_state-parked0_max0.009908992736065974
sim_compute_robot_state-parked0_mean0.009610211262937452
sim_compute_robot_state-parked0_median0.009610211262937452
sim_compute_robot_state-parked0_min0.00931142978980893
sim_compute_robot_state-parked1_max0.009955718869068583
sim_compute_robot_state-parked1_mean0.00930043712991183
sim_compute_robot_state-parked1_median0.00930043712991183
sim_compute_robot_state-parked1_min0.008645155390755076
sim_compute_robot_state-parked2_max0.009964196408381228
sim_compute_robot_state-parked2_mean0.009388792710226091
sim_compute_robot_state-parked2_median0.00938879271022609
sim_compute_robot_state-parked2_min0.008813389012070953
sim_compute_robot_state-parked3_max0.010380440070980886
sim_compute_robot_state-parked3_mean0.009365165819887255
sim_compute_robot_state-parked3_median0.009365165819887255
sim_compute_robot_state-parked3_min0.008349891568793625
sim_compute_robot_state-parked4_max0.009446527137130989
sim_compute_robot_state-parked4_mean0.008756936573591388
sim_compute_robot_state-parked4_median0.00875693657359139
sim_compute_robot_state-parked4_min0.00806734601005179
sim_compute_robot_state-parked5_max0.009297183302582288
sim_compute_robot_state-parked5_mean0.008697754046956047
sim_compute_robot_state-parked5_median0.008697754046956047
sim_compute_robot_state-parked5_min0.008098324791329806
sim_compute_sim_state_max0.05780729700307377
sim_compute_sim_state_mean0.05514515227958805
sim_compute_sim_state_median0.05514515227958804
sim_compute_sim_state_min0.052483007556102315
sim_render-ego0_max0.009175120807084882
sim_render-ego0_mean0.008931527372266426
sim_render-ego0_median0.008931527372266426
sim_render-ego0_min0.00868793393744797
sim_render-ego1_max0.008883999996497983
sim_render-ego1_mean0.008637127329091556
sim_render-ego1_median0.008637127329091557
sim_render-ego1_min0.00839025466168513
sim_render-ego2_max0.008675508811825612
sim_render-ego2_mean0.008407174563798747
sim_render-ego2_median0.008407174563798747
sim_render-ego2_min0.008138840315771884
simulation-passed1
step_physics_max1.0981566515125212
step_physics_mean0.959510811039659
step_physics_median0.9595108110396589
step_physics_min0.8208649705667965
survival_time_max3.049999999999997
survival_time_mean3.049999999999997
survival_time_min3.049999999999997

Highlights

36057

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.