Duckietown Challenges Home Challenges Submissions

Job 53875

Job ID53875
submission12643
userBea Baselines 🐤
user labeltemplate-pytorch
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to dateyes
evaluatorgpu-prod-01
date started
date completed
duration2:14:38
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9884741295813332
survival_time_median59.99999999999873
deviation-center-line_median1.6869417722911018
in-drivable-lane_median40.82499999999885


other stats
agent_compute-ego0_max0.015862491506025457
agent_compute-ego0_mean0.01331177208161856
agent_compute-ego0_median0.012930740226218346
agent_compute-ego0_min0.011817524772599576
agent_compute-ego1_max0.011858659223354825
agent_compute-ego1_mean0.011379878558116565
agent_compute-ego1_median0.011300503463173388
agent_compute-ego1_min0.01103389273078912
agent_compute-ego2_max0.01218581358459371
agent_compute-ego2_mean0.011425795900533836
agent_compute-ego2_median0.011265026341866297
agent_compute-ego2_min0.010826547775141504
agent_compute-ego3_max0.01138636690690853
agent_compute-ego3_mean0.011132247905217704
agent_compute-ego3_median0.011025125835459991
agent_compute-ego3_min0.010985250973284592
complete-iteration_max1.3385350317085514
complete-iteration_mean1.138740836106399
complete-iteration_median1.2771563246089357
complete-iteration_min0.4034838726081816
deviation-center-line_max2.782713727043242
deviation-center-line_mean1.5065086973219544
deviation-center-line_min0.06480231930509503
deviation-heading_max23.00442407461409
deviation-heading_mean13.56613914753582
deviation-heading_median15.233554173497872
deviation-heading_min0.6866504584270209
driven_any_max9.57495344195894
driven_any_mean5.049082865416262
driven_any_median4.804023708951546
driven_any_min0.2162730990379674
driven_lanedir_consec_max1.637483221139553
driven_lanedir_consec_mean0.9096758584503924
driven_lanedir_consec_min0.10620327390227402
driven_lanedir_max1.8002422720037723
driven_lanedir_mean0.9725108762961538
driven_lanedir_median0.9884741295813332
driven_lanedir_min0.10620327390227402
get_duckie_state_max1.1764100747342708e-06
get_duckie_state_mean1.1594227155238704e-06
get_duckie_state_median1.1742263908290942e-06
get_duckie_state_min1.124597211165988e-06
get_robot_state_max0.014064460273190004
get_robot_state_mean0.01294032637168582
get_robot_state_median0.01391595249668347
get_robot_state_min0.00701660796267901
get_state_dump_max0.009485656871684484
get_state_dump_mean0.008895786222328794
get_state_dump_median0.00935316324035492
get_state_dump_min0.0060566196235193005
get_ui_image_max0.04893119368922403
get_ui_image_mean0.043182219735249126
get_ui_image_median0.0460148915760126
get_ui_image_min0.029304719983687708
in-drivable-lane_max58.64999999999874
in-drivable-lane_mean42.78571428571325
in-drivable-lane_min31.44999999999929
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 4.221466832791312, "get_ui_image": 0.041539323816291496, "step_physics": 1.0021302269261445, "survival_time": 59.99999999999873, "driven_lanedir": 0.7415536648172059, "get_state_dump": 0.00935316324035492, "get_robot_state": 0.01391595249668347, "sim_render-ego0": 0.003592098086799412, "sim_render-ego1": 0.003531210229954652, "sim_render-ego2": 0.0035223526124850994, "sim_render-ego3": 0.003558875122832617, "get_duckie_state": 1.1742263908290942e-06, "in-drivable-lane": 39.69999999999901, "deviation-heading": 16.892377204061, "agent_compute-ego0": 0.012930740226218346, "agent_compute-ego1": 0.011153465901485192, "agent_compute-ego2": 0.010826547775141504, "agent_compute-ego3": 0.011025125835459991, "complete-iteration": 1.1681596337508202, "set_robot_commands": 0.002116274575607465, "deviation-center-line": 2.584460742171308, "driven_lanedir_consec": 0.719509119455904, "sim_compute_sim_state": 0.025032194925287583, "sim_compute_performance-ego0": 0.0018844755364893675, "sim_compute_performance-ego1": 0.001854470131498491, "sim_compute_performance-ego2": 0.0018366339998777265, "sim_compute_performance-ego3": 0.0018443054799533304}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 6.324931889856341, "get_ui_image": 0.041539323816291496, "step_physics": 1.0021302269261445, "survival_time": 59.99999999999873, "driven_lanedir": 1.637483221139553, "get_state_dump": 0.00935316324035492, "get_robot_state": 0.01391595249668347, "sim_render-ego0": 0.003592098086799412, "sim_render-ego1": 0.003531210229954652, "sim_render-ego2": 0.0035223526124850994, "sim_render-ego3": 0.003558875122832617, "get_duckie_state": 1.1742263908290942e-06, "in-drivable-lane": 33.5499999999994, "deviation-heading": 20.67091630006453, "agent_compute-ego0": 0.012930740226218346, "agent_compute-ego1": 0.011153465901485192, "agent_compute-ego2": 0.010826547775141504, "agent_compute-ego3": 0.011025125835459991, "complete-iteration": 1.1681596337508202, "set_robot_commands": 0.002116274575607465, "deviation-center-line": 2.5610646865203397, "driven_lanedir_consec": 1.637483221139553, "sim_compute_sim_state": 0.025032194925287583, "sim_compute_performance-ego0": 0.0018844755364893675, "sim_compute_performance-ego1": 0.001854470131498491, "sim_compute_performance-ego2": 0.0018366339998777265, "sim_compute_performance-ego3": 0.0018443054799533304}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 4.572781361265547, "get_ui_image": 0.041539323816291496, "step_physics": 1.0021302269261445, "survival_time": 59.99999999999873, "driven_lanedir": 1.1276160522685272, "get_state_dump": 0.00935316324035492, "get_robot_state": 0.01391595249668347, "sim_render-ego0": 0.003592098086799412, "sim_render-ego1": 0.003531210229954652, "sim_render-ego2": 0.0035223526124850994, "sim_render-ego3": 0.003558875122832617, "get_duckie_state": 1.1742263908290942e-06, "in-drivable-lane": 48.49999999999862, "deviation-heading": 8.530770730636743, "agent_compute-ego0": 0.012930740226218346, "agent_compute-ego1": 0.011153465901485192, "agent_compute-ego2": 0.010826547775141504, "agent_compute-ego3": 0.011025125835459991, "complete-iteration": 1.1681596337508202, "set_robot_commands": 0.002116274575607465, "deviation-center-line": 0.9820125413389889, "driven_lanedir_consec": 1.1275633165248584, "sim_compute_sim_state": 0.025032194925287583, "sim_compute_performance-ego0": 0.0018844755364893675, "sim_compute_performance-ego1": 0.001854470131498491, "sim_compute_performance-ego2": 0.0018366339998777265, "sim_compute_performance-ego3": 0.0018443054799533304}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 3.1772537904083267, "get_ui_image": 0.041539323816291496, "step_physics": 1.0021302269261445, "survival_time": 59.99999999999873, "driven_lanedir": 0.941958145049233, "get_state_dump": 0.00935316324035492, "get_robot_state": 0.01391595249668347, "sim_render-ego0": 0.003592098086799412, "sim_render-ego1": 0.003531210229954652, "sim_render-ego2": 0.0035223526124850994, "sim_render-ego3": 0.003558875122832617, "get_duckie_state": 1.1742263908290942e-06, "in-drivable-lane": 44.799999999998576, "deviation-heading": 11.485587261835214, "agent_compute-ego0": 0.012930740226218346, "agent_compute-ego1": 0.011153465901485192, "agent_compute-ego2": 0.010826547775141504, "agent_compute-ego3": 0.011025125835459991, "complete-iteration": 1.1681596337508202, "set_robot_commands": 0.002116274575607465, "deviation-center-line": 0.9408337739084124, "driven_lanedir_consec": 0.941958145049233, "sim_compute_sim_state": 0.025032194925287583, "sim_compute_performance-ego0": 0.0018844755364893675, "sim_compute_performance-ego1": 0.001854470131498491, "sim_compute_performance-ego2": 0.0018366339998777265, "sim_compute_performance-ego3": 0.0018443054799533304}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 4.245226433009073, "get_ui_image": 0.04893119368922403, "step_physics": 1.145267730350796, "survival_time": 59.99999999999873, "driven_lanedir": 1.2665674242275973, "get_state_dump": 0.00926812185435172, "get_robot_state": 0.013802425549687396, "sim_render-ego0": 0.0035793678051823877, "sim_render-ego1": 0.00356676477278202, "sim_render-ego2": 0.003525659901017849, "sim_render-ego3": 0.003516059433987099, "get_duckie_state": 1.1450444331871877e-06, "in-drivable-lane": 31.44999999999929, "deviation-heading": 22.583343103081106, "agent_compute-ego0": 0.011889208167121372, "agent_compute-ego1": 0.011300503463173388, "agent_compute-ego2": 0.011265026341866297, "agent_compute-ego3": 0.010985250973284592, "complete-iteration": 1.3385350317085514, "set_robot_commands": 0.002080533228547845, "deviation-center-line": 2.1656525926382426, "driven_lanedir_consec": 1.2665674242275973, "sim_compute_sim_state": 0.045780785971140485, "sim_compute_performance-ego0": 0.001853700482180275, "sim_compute_performance-ego1": 0.0018413035101338688, "sim_compute_performance-ego2": 0.0018316591709082969, "sim_compute_performance-ego3": 0.001822351913070996}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 5.035266056637545, "get_ui_image": 0.04893119368922403, "step_physics": 1.145267730350796, "survival_time": 59.99999999999873, "driven_lanedir": 1.0291022899311306, "get_state_dump": 0.00926812185435172, "get_robot_state": 0.013802425549687396, "sim_render-ego0": 0.0035793678051823877, "sim_render-ego1": 0.00356676477278202, "sim_render-ego2": 0.003525659901017849, "sim_render-ego3": 0.003516059433987099, "get_duckie_state": 1.1450444331871877e-06, "in-drivable-lane": 42.59999999999884, "deviation-heading": 14.039033073863012, "agent_compute-ego0": 0.011889208167121372, "agent_compute-ego1": 0.011300503463173388, "agent_compute-ego2": 0.011265026341866297, "agent_compute-ego3": 0.010985250973284592, "complete-iteration": 1.3385350317085514, "set_robot_commands": 0.002080533228547845, "deviation-center-line": 1.6911023418253412, "driven_lanedir_consec": 1.0291022899311306, "sim_compute_sim_state": 0.045780785971140485, "sim_compute_performance-ego0": 0.001853700482180275, "sim_compute_performance-ego1": 0.0018413035101338688, "sim_compute_performance-ego2": 0.0018316591709082969, "sim_compute_performance-ego3": 0.001822351913070996}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 9.57495344195894, "get_ui_image": 0.04893119368922403, "step_physics": 1.145267730350796, "survival_time": 59.99999999999873, "driven_lanedir": 1.8002422720037723, "get_state_dump": 0.00926812185435172, "get_robot_state": 0.013802425549687396, "sim_render-ego0": 0.0035793678051823877, "sim_render-ego1": 0.00356676477278202, "sim_render-ego2": 0.003525659901017849, "sim_render-ego3": 0.003516059433987099, "get_duckie_state": 1.1450444331871877e-06, "in-drivable-lane": 41.59999999999898, "deviation-heading": 15.300483730600195, "agent_compute-ego0": 0.011889208167121372, "agent_compute-ego1": 0.011300503463173388, "agent_compute-ego2": 0.011265026341866297, "agent_compute-ego3": 0.010985250973284592, "complete-iteration": 1.3385350317085514, "set_robot_commands": 0.002080533228547845, "deviation-center-line": 1.5061620656049373, "driven_lanedir_consec": 1.306054329891055, "sim_compute_sim_state": 0.045780785971140485, "sim_compute_performance-ego0": 0.001853700482180275, "sim_compute_performance-ego1": 0.0018413035101338688, "sim_compute_performance-ego2": 0.0018316591709082969, "sim_compute_performance-ego3": 0.001822351913070996}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 6.709940922612449, "get_ui_image": 0.04893119368922403, "step_physics": 1.145267730350796, "survival_time": 59.99999999999873, "driven_lanedir": 0.10620327390227402, "get_state_dump": 0.00926812185435172, "get_robot_state": 0.013802425549687396, "sim_render-ego0": 0.0035793678051823877, "sim_render-ego1": 0.00356676477278202, "sim_render-ego2": 0.003525659901017849, "sim_render-ego3": 0.003516059433987099, "get_duckie_state": 1.1450444331871877e-06, "in-drivable-lane": 58.64999999999874, "deviation-heading": 0.6866504584270209, "agent_compute-ego0": 0.011889208167121372, "agent_compute-ego1": 0.011300503463173388, "agent_compute-ego2": 0.011265026341866297, "agent_compute-ego3": 0.010985250973284592, "complete-iteration": 1.3385350317085514, "set_robot_commands": 0.002080533228547845, "deviation-center-line": 0.1413985775695685, "driven_lanedir_consec": 0.10620327390227402, "sim_compute_sim_state": 0.045780785971140485, "sim_compute_performance-ego0": 0.001853700482180275, "sim_compute_performance-ego1": 0.0018413035101338688, "sim_compute_performance-ego2": 0.0018316591709082969, "sim_compute_performance-ego3": 0.001822351913070996}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 3.881275388850821, "get_ui_image": 0.0460148915760126, "step_physics": 1.0906622779061654, "survival_time": 59.99999999999873, "driven_lanedir": 0.947845969231536, "get_state_dump": 0.009485656871684484, "get_robot_state": 0.014064460273190004, "sim_render-ego0": 0.003631645594905754, "sim_render-ego1": 0.0035877003459311046, "sim_render-ego2": 0.003704539742894613, "sim_render-ego3": 0.0035648957378759073, "get_duckie_state": 1.1764100747342708e-06, "in-drivable-lane": 40.04999999999872, "deviation-heading": 15.16662461639555, "agent_compute-ego0": 0.015862491506025457, "agent_compute-ego1": 0.011858659223354825, "agent_compute-ego2": 0.01218581358459371, "agent_compute-ego3": 0.01138636690690853, "complete-iteration": 1.2771563246089357, "set_robot_commands": 0.002146344895565341, "deviation-center-line": 1.8666588814029428, "driven_lanedir_consec": 0.947845969231536, "sim_compute_sim_state": 0.03468417922821172, "sim_compute_performance-ego0": 0.0019282998887823583, "sim_compute_performance-ego1": 0.0018821483249966053, "sim_compute_performance-ego2": 0.0018987377716242323, "sim_compute_performance-ego3": 0.0019061295416432555}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 6.1719485129041605, "get_ui_image": 0.0460148915760126, "step_physics": 1.0906622779061654, "survival_time": 59.99999999999873, "driven_lanedir": 1.3704345896585612, "get_state_dump": 0.009485656871684484, "get_robot_state": 0.014064460273190004, "sim_render-ego0": 0.003631645594905754, "sim_render-ego1": 0.0035877003459311046, "sim_render-ego2": 0.003704539742894613, "sim_render-ego3": 0.0035648957378759073, "get_duckie_state": 1.1764100747342708e-06, "in-drivable-lane": 35.99999999999929, "deviation-heading": 18.49293099744935, "agent_compute-ego0": 0.015862491506025457, "agent_compute-ego1": 0.011858659223354825, "agent_compute-ego2": 0.01218581358459371, "agent_compute-ego3": 0.01138636690690853, "complete-iteration": 1.2771563246089357, "set_robot_commands": 0.002146344895565341, "deviation-center-line": 1.8868167199594357, "driven_lanedir_consec": 1.3704345896585612, "sim_compute_sim_state": 0.03468417922821172, "sim_compute_performance-ego0": 0.0019282998887823583, "sim_compute_performance-ego1": 0.0018821483249966053, "sim_compute_performance-ego2": 0.0018987377716242323, "sim_compute_performance-ego3": 0.0019061295416432555}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.2162730990379674, "get_ui_image": 0.0460148915760126, "step_physics": 1.0906622779061654, "survival_time": 59.99999999999873, "driven_lanedir": 0.14290052938467168, "get_state_dump": 0.009485656871684484, "get_robot_state": 0.014064460273190004, "sim_render-ego0": 0.003631645594905754, "sim_render-ego1": 0.0035877003459311046, "sim_render-ego2": 0.003704539742894613, "sim_render-ego3": 0.0035648957378759073, "get_duckie_state": 1.1764100747342708e-06, "in-drivable-lane": 58.44999999999872, "deviation-heading": 0.7958592119055209, "agent_compute-ego0": 0.015862491506025457, "agent_compute-ego1": 0.011858659223354825, "agent_compute-ego2": 0.01218581358459371, "agent_compute-ego3": 0.01138636690690853, "complete-iteration": 1.2771563246089357, "set_robot_commands": 0.002146344895565341, "deviation-center-line": 0.06480231930509503, "driven_lanedir_consec": 0.14290052938467168, "sim_compute_sim_state": 0.03468417922821172, "sim_compute_performance-ego0": 0.0019282998887823583, "sim_compute_performance-ego1": 0.0018821483249966053, "sim_compute_performance-ego2": 0.0018987377716242323, "sim_compute_performance-ego3": 0.0019061295416432555}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 6.092861754328063, "get_ui_image": 0.0460148915760126, "step_physics": 1.0906622779061654, "survival_time": 59.99999999999873, "driven_lanedir": 1.6000108587237034, "get_state_dump": 0.009485656871684484, "get_robot_state": 0.014064460273190004, "sim_render-ego0": 0.003631645594905754, "sim_render-ego1": 0.0035877003459311046, "sim_render-ego2": 0.003704539742894613, "sim_render-ego3": 0.0035648957378759073, "get_duckie_state": 1.1764100747342708e-06, "in-drivable-lane": 32.049999999999216, "deviation-heading": 23.00442407461409, "agent_compute-ego0": 0.015862491506025457, "agent_compute-ego1": 0.011858659223354825, "agent_compute-ego2": 0.01218581358459371, "agent_compute-ego3": 0.01138636690690853, "complete-iteration": 1.2771563246089357, "set_robot_commands": 0.002146344895565341, "deviation-center-line": 1.682781202756862, "driven_lanedir_consec": 1.2366058321007325, "sim_compute_sim_state": 0.03468417922821172, "sim_compute_performance-ego0": 0.0019282998887823583, "sim_compute_performance-ego1": 0.0018821483249966053, "sim_compute_performance-ego2": 0.0018987377716242323, "sim_compute_performance-ego3": 0.0019061295416432555}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 3.5852775819263174, "get_ui_image": 0.029304719983687708, "step_physics": 0.31344048109380135, "survival_time": 59.99999999999873, "driven_lanedir": 0.7559515986403552, "get_state_dump": 0.0060566196235193005, "get_robot_state": 0.00701660796267901, "sim_render-ego0": 0.003578884019939032, "sim_render-ego1": 0.003557514489242973, "get_duckie_state": 1.124597211165988e-06, "in-drivable-lane": 33.69999999999929, "deviation-heading": 20.91343266363293, "agent_compute-ego0": 0.011817524772599576, "agent_compute-ego1": 0.01103389273078912, "complete-iteration": 0.4034838726081816, "set_robot_commands": 0.0021078600474539444, "deviation-center-line": 2.782713727043242, "driven_lanedir_consec": 0.7559515986403552, "sim_compute_sim_state": 0.00965240674650143, "sim_compute_performance-ego0": 0.001860919542654071, "sim_compute_performance-ego1": 0.001836083115983466}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 6.877703050240796, "get_ui_image": 0.029304719983687708, "step_physics": 0.31344048109380135, "survival_time": 59.99999999999873, "driven_lanedir": 0.14728237916803266, "get_state_dump": 0.0060566196235193005, "get_robot_state": 0.00701660796267901, "sim_render-ego0": 0.003578884019939032, "sim_render-ego1": 0.003557514489242973, "get_duckie_state": 1.124597211165988e-06, "in-drivable-lane": 57.89999999999873, "deviation-heading": 1.3635146389352115, "agent_compute-ego0": 0.011817524772599576, "agent_compute-ego1": 0.01103389273078912, "complete-iteration": 0.4034838726081816, "set_robot_commands": 0.0021078600474539444, "deviation-center-line": 0.2346615904626487, "driven_lanedir_consec": 0.14728237916803266, "sim_compute_sim_state": 0.00965240674650143, "sim_compute_performance-ego0": 0.001860919542654071, "sim_compute_performance-ego1": 0.001836083115983466}}
set_robot_commands_max0.002146344895565341
set_robot_commands_mean0.0021134522066993213
set_robot_commands_median0.002116274575607465
set_robot_commands_min0.002080533228547845
sim_compute_performance-ego0_max0.0019282998887823583
sim_compute_performance-ego0_mean0.001884838765365439
sim_compute_performance-ego0_median0.0018844755364893675
sim_compute_performance-ego0_min0.001853700482180275
sim_compute_performance-ego1_max0.0018821483249966053
sim_compute_performance-ego1_mean0.0018559895784630565
sim_compute_performance-ego1_median0.001854470131498491
sim_compute_performance-ego1_min0.001836083115983466
sim_compute_performance-ego2_max0.0018987377716242323
sim_compute_performance-ego2_mean0.001855676980803418
sim_compute_performance-ego2_median0.0018366339998777265
sim_compute_performance-ego2_min0.0018316591709082969
sim_compute_performance-ego3_max0.0019061295416432555
sim_compute_performance-ego3_mean0.0018575956448891936
sim_compute_performance-ego3_median0.0018443054799533304
sim_compute_performance-ego3_min0.001822351913070996
sim_compute_sim_state_max0.045780785971140485
sim_compute_sim_state_mean0.03152096099939728
sim_compute_sim_state_median0.03468417922821172
sim_compute_sim_state_min0.00965240674650143
sim_render-ego0_max0.003631645594905754
sim_render-ego0_mean0.0035978724276734477
sim_render-ego0_median0.003592098086799412
sim_render-ego0_min0.003578884019939032
sim_render-ego1_max0.0035877003459311046
sim_render-ego1_mean0.003561266455225503
sim_render-ego1_median0.00356676477278202
sim_render-ego1_min0.003531210229954652
sim_render-ego2_max0.003704539742894613
sim_render-ego2_mean0.003584184085465854
sim_render-ego2_median0.003525659901017849
sim_render-ego2_min0.0035223526124850994
sim_render-ego3_max0.0035648957378759073
sim_render-ego3_mean0.003546610098231874
sim_render-ego3_median0.003558875122832617
sim_render-ego3_min0.003516059433987099
simulation-passed1
step_physics_max1.145267730350796
step_physics_mean0.969937278780002
step_physics_median1.0906622779061654
step_physics_min0.31344048109380135
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873

Highlights

53875

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.