Duckietown Challenges Home Challenges Submissions

Submission 12947

Submission12947
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserThomas Wiggers 🇳🇱
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 59887
Next
User labelppo_v1
Admin priority50
Blessingn/a
User priority50

59887

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
59887LFVmultibodyv-simsuccessyes1:26:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.603169706587444
survival_time_median59.99999999999873
deviation-center-line_median2.0294809747983686
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.027046601837818863
agent_compute-ego0_mean0.020680694527896587
agent_compute-ego0_median0.01998044132293015
agent_compute-ego0_min0.01834847567778245
agent_compute-ego1_max0.022615182211158873
agent_compute-ego1_mean0.020324411014462963
agent_compute-ego1_median0.019582755758204527
agent_compute-ego1_min0.01902740087040656
complete-iteration_max0.5339286023631481
complete-iteration_mean0.47495431481437744
complete-iteration_median0.5124277022359374
complete-iteration_min0.2343629917236887
deviation-center-line_max3.625900649028611
deviation-center-line_mean1.911963936449362
deviation-center-line_min0.7114760559486222
deviation-heading_max9.98431178456633
deviation-heading_mean6.61752111563247
deviation-heading_median6.831199845222097
deviation-heading_min2.006422221087432
driven_any_max6.649340430696085
driven_any_mean5.5721571284938465
driven_any_median5.67427391391271
driven_any_min3.449647418007973
driven_lanedir_consec_max6.092021751737596
driven_lanedir_consec_mean5.291646849552937
driven_lanedir_consec_min2.476782991096463
driven_lanedir_max6.092021751737596
driven_lanedir_mean5.292671411617647
driven_lanedir_median5.603169706587444
driven_lanedir_min2.476782991096463
get_duckie_state_max1.3810808116649212e-06
get_duckie_state_mean1.2128804319038457e-06
get_duckie_state_median1.2472805432931866e-06
get_duckie_state_min1.074173964628272e-06
get_robot_state_max0.014264192906744176
get_robot_state_mean0.012434804313344764
get_robot_state_median0.013625699812724728
get_robot_state_min0.0063121965981641475
get_state_dump_max0.008631954185174566
get_state_dump_mean0.008012218737383867
get_state_dump_median0.008462747665964297
get_state_dump_min0.005488583686250533
get_ui_image_max0.043557605973687595
get_ui_image_mean0.03854908996492189
get_ui_image_median0.0401282929858002
get_ui_image_min0.027001908379331616
in-drivable-lane_max36.449999999998525
in-drivable-lane_mean5.924999999999736
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 5.629914357787646, "get_ui_image": 0.03773496172807298, "step_physics": 0.3137879020268474, "survival_time": 59.99999999999873, "driven_lanedir": 5.569936716108135, "get_state_dump": 0.0082037718865794, "get_robot_state": 0.012475824078155695, "sim_render-ego0": 0.003356079574826357, "sim_render-ego1": 0.0032144930837156374, "sim_render-ego2": 0.00307333777091783, "sim_render-ego3": 0.00315089726031174, "get_duckie_state": 1.074173964628272e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.679588907645966, "agent_compute-ego0": 0.01998044132293015, "agent_compute-ego1": 0.019582755758204527, "agent_compute-ego2": 0.01820589044906019, "agent_compute-ego3": 0.018391415638093846, "complete-iteration": 0.49880230138939086, "set_robot_commands": 0.001748590048504908, "deviation-center-line": 2.03391744238745, "driven_lanedir_consec": 5.569936716108135, "sim_compute_sim_state": 0.023934045103964064, "sim_compute_performance-ego0": 0.0017090230857601371, "sim_compute_performance-ego1": 0.0015732964111505995, "sim_compute_performance-ego2": 0.0015671054687627051, "sim_compute_performance-ego3": 0.0015780838403376214}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 5.6597154397575915, "get_ui_image": 0.03773496172807298, "step_physics": 0.3137879020268474, "survival_time": 59.99999999999873, "driven_lanedir": 5.596339808767911, "get_state_dump": 0.0082037718865794, "get_robot_state": 0.012475824078155695, "sim_render-ego0": 0.003356079574826357, "sim_render-ego1": 0.0032144930837156374, "sim_render-ego2": 0.00307333777091783, "sim_render-ego3": 0.00315089726031174, "get_duckie_state": 1.074173964628272e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.982810782798226, "agent_compute-ego0": 0.01998044132293015, "agent_compute-ego1": 0.019582755758204527, "agent_compute-ego2": 0.01820589044906019, "agent_compute-ego3": 0.018391415638093846, "complete-iteration": 0.49880230138939086, "set_robot_commands": 0.001748590048504908, "deviation-center-line": 2.1254154602312485, "driven_lanedir_consec": 5.596339808767911, "sim_compute_sim_state": 0.023934045103964064, "sim_compute_performance-ego0": 0.0017090230857601371, "sim_compute_performance-ego1": 0.0015732964111505995, "sim_compute_performance-ego2": 0.0015671054687627051, "sim_compute_performance-ego3": 0.0015780838403376214}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.833724830394466, "get_ui_image": 0.03773496172807298, "step_physics": 0.3137879020268474, "survival_time": 59.99999999999873, "driven_lanedir": 2.7316989963368883, "get_state_dump": 0.0082037718865794, "get_robot_state": 0.012475824078155695, "sim_render-ego0": 0.003356079574826357, "sim_render-ego1": 0.0032144930837156374, "sim_render-ego2": 0.00307333777091783, "sim_render-ego3": 0.00315089726031174, "get_duckie_state": 1.074173964628272e-06, "in-drivable-lane": 33.749999999998494, "deviation-heading": 4.414919959463324, "agent_compute-ego0": 0.01998044132293015, "agent_compute-ego1": 0.019582755758204527, "agent_compute-ego2": 0.01820589044906019, "agent_compute-ego3": 0.018391415638093846, "complete-iteration": 0.49880230138939086, "set_robot_commands": 0.001748590048504908, "deviation-center-line": 0.7627361068704387, "driven_lanedir_consec": 2.7173551274309453, "sim_compute_sim_state": 0.023934045103964064, "sim_compute_performance-ego0": 0.0017090230857601371, "sim_compute_performance-ego1": 0.0015732964111505995, "sim_compute_performance-ego2": 0.0015671054687627051, "sim_compute_performance-ego3": 0.0015780838403376214}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 5.859005414900621, "get_ui_image": 0.03773496172807298, "step_physics": 0.3137879020268474, "survival_time": 59.99999999999873, "driven_lanedir": 5.811420029009017, "get_state_dump": 0.0082037718865794, "get_robot_state": 0.012475824078155695, "sim_render-ego0": 0.003356079574826357, "sim_render-ego1": 0.0032144930837156374, "sim_render-ego2": 0.00307333777091783, "sim_render-ego3": 0.00315089726031174, "get_duckie_state": 1.074173964628272e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.510664331831594, "agent_compute-ego0": 0.01998044132293015, "agent_compute-ego1": 0.019582755758204527, "agent_compute-ego2": 0.01820589044906019, "agent_compute-ego3": 0.018391415638093846, "complete-iteration": 0.49880230138939086, "set_robot_commands": 0.001748590048504908, "deviation-center-line": 1.841881415794145, "driven_lanedir_consec": 5.811420029009017, "sim_compute_sim_state": 0.023934045103964064, "sim_compute_performance-ego0": 0.0017090230857601371, "sim_compute_performance-ego1": 0.0015732964111505995, "sim_compute_performance-ego2": 0.0015671054687627051, "sim_compute_performance-ego3": 0.0015780838403376214}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 5.664886893939243, "get_ui_image": 0.043557605973687595, "step_physics": 0.30024757274084546, "survival_time": 59.99999999999873, "driven_lanedir": 5.593005155551786, "get_state_dump": 0.008462747665964297, "get_robot_state": 0.013625699812724728, "sim_render-ego0": 0.003574708816312334, "sim_render-ego1": 0.0034307832027057326, "sim_render-ego2": 0.0033963173255634545, "sim_render-ego3": 0.0033829011686834862, "get_duckie_state": 1.2472805432931866e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.634716622070456, "agent_compute-ego0": 0.02053021292801602, "agent_compute-ego1": 0.02121769081642983, "agent_compute-ego2": 0.019651710540428448, "agent_compute-ego3": 0.018119249812371525, "complete-iteration": 0.5124277022359374, "set_robot_commands": 0.0019334416703121748, "deviation-center-line": 2.048389834494869, "driven_lanedir_consec": 5.593005155551786, "sim_compute_sim_state": 0.03848685451987185, "sim_compute_performance-ego0": 0.001892085277865471, "sim_compute_performance-ego1": 0.0016890572667816696, "sim_compute_performance-ego2": 0.0016793110884794288, "sim_compute_performance-ego3": 0.0016705880653451223}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 6.1660491043929, "get_ui_image": 0.043557605973687595, "step_physics": 0.30024757274084546, "survival_time": 59.99999999999873, "driven_lanedir": 6.092021751737596, "get_state_dump": 0.008462747665964297, "get_robot_state": 0.013625699812724728, "sim_render-ego0": 0.003574708816312334, "sim_render-ego1": 0.0034307832027057326, "sim_render-ego2": 0.0033963173255634545, "sim_render-ego3": 0.0033829011686834862, "get_duckie_state": 1.2472805432931866e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.936241407019831, "agent_compute-ego0": 0.02053021292801602, "agent_compute-ego1": 0.02121769081642983, "agent_compute-ego2": 0.019651710540428448, "agent_compute-ego3": 0.018119249812371525, "complete-iteration": 0.5124277022359374, "set_robot_commands": 0.0019334416703121748, "deviation-center-line": 2.025044507209287, "driven_lanedir_consec": 6.092021751737596, "sim_compute_sim_state": 0.03848685451987185, "sim_compute_performance-ego0": 0.001892085277865471, "sim_compute_performance-ego1": 0.0016890572667816696, "sim_compute_performance-ego2": 0.0016793110884794288, "sim_compute_performance-ego3": 0.0016705880653451223}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 6.060663619715146, "get_ui_image": 0.043557605973687595, "step_physics": 0.30024757274084546, "survival_time": 59.99999999999873, "driven_lanedir": 6.008529695189044, "get_state_dump": 0.008462747665964297, "get_robot_state": 0.013625699812724728, "sim_render-ego0": 0.003574708816312334, "sim_render-ego1": 0.0034307832027057326, "sim_render-ego2": 0.0033963173255634545, "sim_render-ego3": 0.0033829011686834862, "get_duckie_state": 1.2472805432931866e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.5199379559382855, "agent_compute-ego0": 0.02053021292801602, "agent_compute-ego1": 0.02121769081642983, "agent_compute-ego2": 0.019651710540428448, "agent_compute-ego3": 0.018119249812371525, "complete-iteration": 0.5124277022359374, "set_robot_commands": 0.0019334416703121748, "deviation-center-line": 1.869306340150052, "driven_lanedir_consec": 6.008529695189044, "sim_compute_sim_state": 0.03848685451987185, "sim_compute_performance-ego0": 0.001892085277865471, "sim_compute_performance-ego1": 0.0016890572667816696, "sim_compute_performance-ego2": 0.0016793110884794288, "sim_compute_performance-ego3": 0.0016705880653451223}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 6.134470866409535, "get_ui_image": 0.043557605973687595, "step_physics": 0.30024757274084546, "survival_time": 59.99999999999873, "driven_lanedir": 6.05339228396983, "get_state_dump": 0.008462747665964297, "get_robot_state": 0.013625699812724728, "sim_render-ego0": 0.003574708816312334, "sim_render-ego1": 0.0034307832027057326, "sim_render-ego2": 0.0033963173255634545, "sim_render-ego3": 0.0033829011686834862, "get_duckie_state": 1.2472805432931866e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.007524412427301, "agent_compute-ego0": 0.02053021292801602, "agent_compute-ego1": 0.02121769081642983, "agent_compute-ego2": 0.019651710540428448, "agent_compute-ego3": 0.018119249812371525, "complete-iteration": 0.5124277022359374, "set_robot_commands": 0.0019334416703121748, "deviation-center-line": 2.0883453829963456, "driven_lanedir_consec": 6.05339228396983, "sim_compute_sim_state": 0.03848685451987185, "sim_compute_performance-ego0": 0.001892085277865471, "sim_compute_performance-ego1": 0.0016890572667816696, "sim_compute_performance-ego2": 0.0016793110884794288, "sim_compute_performance-ego3": 0.0016705880653451223}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 5.683660933886178, "get_ui_image": 0.0401282929858002, "step_physics": 0.33817660103828884, "survival_time": 59.99999999999873, "driven_lanedir": 5.609999604406978, "get_state_dump": 0.008631954185174566, "get_robot_state": 0.014264192906744176, "sim_render-ego0": 0.0035114909687407507, "sim_render-ego1": 0.003422183259936991, "sim_render-ego2": 0.0032944681245421093, "sim_render-ego3": 0.0033634810721645944, "get_duckie_state": 1.3810808116649212e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.411949663647146, "agent_compute-ego0": 0.01834847567778245, "agent_compute-ego1": 0.01902740087040656, "agent_compute-ego2": 0.018130453103388677, "agent_compute-ego3": 0.017994018121126987, "complete-iteration": 0.5339286023631481, "set_robot_commands": 0.00205097389062378, "deviation-center-line": 2.1801993508150135, "driven_lanedir_consec": 5.609999604406978, "sim_compute_sim_state": 0.030721891928870513, "sim_compute_performance-ego0": 0.001859633749867359, "sim_compute_performance-ego1": 0.001669016011450114, "sim_compute_performance-ego2": 0.001662074278832276, "sim_compute_performance-ego3": 0.00166765835561125}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 6.119652890048254, "get_ui_image": 0.0401282929858002, "step_physics": 0.33817660103828884, "survival_time": 59.99999999999873, "driven_lanedir": 5.932856970746171, "get_state_dump": 0.008631954185174566, "get_robot_state": 0.014264192906744176, "sim_render-ego0": 0.0035114909687407507, "sim_render-ego1": 0.003422183259936991, "sim_render-ego2": 0.0032944681245421093, "sim_render-ego3": 0.0033634810721645944, "get_duckie_state": 1.3810808116649212e-06, "in-drivable-lane": 0.30000000000000426, "deviation-heading": 9.98431178456633, "agent_compute-ego0": 0.01834847567778245, "agent_compute-ego1": 0.01902740087040656, "agent_compute-ego2": 0.018130453103388677, "agent_compute-ego3": 0.017994018121126987, "complete-iteration": 0.5339286023631481, "set_robot_commands": 0.00205097389062378, "deviation-center-line": 3.625900649028611, "driven_lanedir_consec": 5.932856970746171, "sim_compute_sim_state": 0.030721891928870513, "sim_compute_performance-ego0": 0.001859633749867359, "sim_compute_performance-ego1": 0.001669016011450114, "sim_compute_performance-ego2": 0.001662074278832276, "sim_compute_performance-ego3": 0.00166765835561125}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.449647418007973, "get_ui_image": 0.0401282929858002, "step_physics": 0.33817660103828884, "survival_time": 59.99999999999873, "driven_lanedir": 2.476782991096463, "get_state_dump": 0.008631954185174566, "get_robot_state": 0.014264192906744176, "sim_render-ego0": 0.0035114909687407507, "sim_render-ego1": 0.003422183259936991, "sim_render-ego2": 0.0032944681245421093, "sim_render-ego3": 0.0033634810721645944, "get_duckie_state": 1.3810808116649212e-06, "in-drivable-lane": 36.449999999998525, "deviation-heading": 2.006422221087432, "agent_compute-ego0": 0.01834847567778245, "agent_compute-ego1": 0.01902740087040656, "agent_compute-ego2": 0.018130453103388677, "agent_compute-ego3": 0.017994018121126987, "complete-iteration": 0.5339286023631481, "set_robot_commands": 0.00205097389062378, "deviation-center-line": 0.7114760559486222, "driven_lanedir_consec": 2.476782991096463, "sim_compute_sim_state": 0.030721891928870513, "sim_compute_performance-ego0": 0.001859633749867359, "sim_compute_performance-ego1": 0.001669016011450114, "sim_compute_performance-ego2": 0.001662074278832276, "sim_compute_performance-ego3": 0.00166765835561125}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 5.551635695350327, "get_ui_image": 0.0401282929858002, "step_physics": 0.33817660103828884, "survival_time": 59.99999999999873, "driven_lanedir": 5.493271657907646, "get_state_dump": 0.008631954185174566, "get_robot_state": 0.014264192906744176, "sim_render-ego0": 0.0035114909687407507, "sim_render-ego1": 0.003422183259936991, "sim_render-ego2": 0.0032944681245421093, "sim_render-ego3": 0.0033634810721645944, "get_duckie_state": 1.3810808116649212e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.3202151521091325, "agent_compute-ego0": 0.01834847567778245, "agent_compute-ego1": 0.01902740087040656, "agent_compute-ego2": 0.018130453103388677, "agent_compute-ego3": 0.017994018121126987, "complete-iteration": 0.5339286023631481, "set_robot_commands": 0.00205097389062378, "deviation-center-line": 2.0193888030706666, "driven_lanedir_consec": 5.493271657907646, "sim_compute_sim_state": 0.030721891928870513, "sim_compute_performance-ego0": 0.001859633749867359, "sim_compute_performance-ego1": 0.001669016011450114, "sim_compute_performance-ego2": 0.001662074278832276, "sim_compute_performance-ego3": 0.00166765835561125}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 5.5478319036278805, "get_ui_image": 0.027001908379331616, "step_physics": 0.12370828129071974, "survival_time": 59.99999999999873, "driven_lanedir": 5.465448807911994, "get_state_dump": 0.005488583686250533, "get_robot_state": 0.0063121965981641475, "sim_render-ego0": 0.0034023161037676935, "sim_render-ego1": 0.0032388159476350884, "get_duckie_state": 1.0850923841541554e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.973059570307961, "agent_compute-ego0": 0.027046601837818863, "agent_compute-ego1": 0.022615182211158873, "complete-iteration": 0.2343629917236887, "set_robot_commands": 0.0018312021854219587, "deviation-center-line": 2.318990829966169, "driven_lanedir_consec": 5.465448807911994, "sim_compute_sim_state": 0.008519347164652727, "sim_compute_performance-ego0": 0.0016741321843232245, "sim_compute_performance-ego1": 0.0016133950016679216}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 6.649340430696085, "get_ui_image": 0.027001908379331616, "step_physics": 0.12370828129071974, "survival_time": 59.99999999999873, "driven_lanedir": 5.662695293907608, "get_state_dump": 0.005488583686250533, "get_robot_state": 0.0063121965981641475, "sim_render-ego0": 0.0034023161037676935, "sim_render-ego1": 0.0032388159476350884, "get_duckie_state": 1.0850923841541554e-06, "in-drivable-lane": 12.449999999999292, "deviation-heading": 5.262932847941591, "agent_compute-ego0": 0.027046601837818863, "agent_compute-ego1": 0.022615182211158873, "complete-iteration": 0.2343629917236887, "set_robot_commands": 0.0018312021854219587, "deviation-center-line": 1.1165029313281536, "driven_lanedir_consec": 5.662695293907608, "sim_compute_sim_state": 0.008519347164652727, "sim_compute_performance-ego0": 0.0016741321843232245, "sim_compute_performance-ego1": 0.0016133950016679216}}
set_robot_commands_max0.00205097389062378
set_robot_commands_mean0.0018996019149005272
set_robot_commands_median0.0019334416703121748
set_robot_commands_min0.001748590048504908
sim_compute_performance-ego0_max0.001892085277865471
sim_compute_performance-ego0_mean0.0017993737730441655
sim_compute_performance-ego0_median0.001859633749867359
sim_compute_performance-ego0_min0.0016741321843232245
sim_compute_performance-ego1_max0.0016890572667816696
sim_compute_performance-ego1_mean0.001639447768633241
sim_compute_performance-ego1_median0.001669016011450114
sim_compute_performance-ego1_min0.0015732964111505995
sim_compute_sim_state_max0.03848685451987185
sim_compute_sim_state_mean0.027829275752866516
sim_compute_sim_state_median0.030721891928870513
sim_compute_sim_state_min0.008519347164652727
sim_render-ego0_max0.003574708816312334
sim_render-ego0_mean0.0034695535462180823
sim_render-ego0_median0.0035114909687407507
sim_render-ego0_min0.003356079574826357
sim_render-ego1_max0.0034307832027057326
sim_render-ego1_mean0.003339105005764544
sim_render-ego1_median0.003422183259936991
sim_render-ego1_min0.0032144930837156374
simulation-passed1
step_physics_max0.33817660103828884
step_physics_mean0.28973320470038333
step_physics_median0.3137879020268474
step_physics_min0.12370828129071974
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873
No reset possible