Duckietown Challenges Home Challenges Submissions

Submission 12744

Submission12744
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserThomas Wiggers 🇳🇱
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 58790
Next
User labelppo_v1
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
58790LFVmultibodyv-simsuccessyes1:55:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0983541398027032
survival_time_median59.99999999999873
deviation-center-line_median1.3815148761237874
in-drivable-lane_median23.32499999999964


other stats
agent_compute-ego0_max0.07344313307070514
agent_compute-ego0_mean0.06857923177673088
agent_compute-ego0_median0.06838649059711745
agent_compute-ego0_min0.06385679601350289
agent_compute-ego1_max0.06957206221841754
agent_compute-ego1_mean0.06383618347670947
agent_compute-ego1_median0.06562529118432292
agent_compute-ego1_min0.056468133824575835
complete-iteration_max1.1431993554771989
complete-iteration_mean0.9280768572549098
complete-iteration_median0.9799355849139796
complete-iteration_min0.3285292425189578
deviation-center-line_max4.413645943315625
deviation-center-line_mean1.4417684591753008
deviation-center-line_min0.2530789513376133
deviation-heading_max27.31715699009108
deviation-heading_mean8.432814022344413
deviation-heading_median6.796731492199607
deviation-heading_min1.9006536347707013
driven_any_max9.728362916027685
driven_any_mean4.879117997701984
driven_any_median4.572768804413098
driven_any_min0.7973361560178924
driven_lanedir_consec_max8.079859861323152
driven_lanedir_consec_mean2.6282550880024007
driven_lanedir_consec_min0.07904964542260284
driven_lanedir_max8.08409399177013
driven_lanedir_mean3.0985706524549146
driven_lanedir_median2.6709602445456113
driven_lanedir_min0.0975031382126268
get_duckie_state_max1.72153698415383e-06
get_duckie_state_mean1.6531632645032736e-06
get_duckie_state_median1.717765166499434e-06
get_duckie_state_min1.3965728868369105e-06
get_robot_state_max0.015586556641882802
get_robot_state_mean0.014016934176212898
get_robot_state_median0.014937869317327114
get_robot_state_min0.0072503488683191486
get_state_dump_max0.01007144000508406
get_state_dump_mean0.00938309260991023
get_state_dump_median0.009844722596930028
get_state_dump_min0.006205536716773417
get_ui_image_max0.05020669219297334
get_ui_image_mean0.04541812819476749
get_ui_image_median0.05008560930263192
get_ui_image_min0.029434516336570005
in-drivable-lane_max56.749999999998735
in-drivable-lane_mean23.032142857142333
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.8080912424391244, "get_ui_image": 0.04395388901779594, "step_physics": 0.5903470228355592, "survival_time": 59.99999999999873, "driven_lanedir": 1.3605112972951914, "get_state_dump": 0.009844722596930028, "get_robot_state": 0.014937869317327114, "sim_render-ego0": 0.004144628875757832, "sim_render-ego1": 0.003886106707075057, "sim_render-ego2": 0.003907866521639987, "sim_render-ego3": 0.003824431929957559, "get_duckie_state": 1.6484828316897375e-06, "in-drivable-lane": 14.350000000000202, "deviation-heading": 27.31715699009108, "agent_compute-ego0": 0.06626928954398403, "agent_compute-ego1": 0.059995221853454746, "agent_compute-ego2": 0.05921423425285346, "agent_compute-ego3": 0.06124226834553664, "complete-iteration": 0.9608694387415267, "set_robot_commands": 0.002203908788472985, "deviation-center-line": 4.413645943315625, "driven_lanedir_consec": 1.3132834376113705, "sim_compute_sim_state": 0.021711568054211924, "sim_compute_performance-ego0": 0.002148043404610131, "sim_compute_performance-ego1": 0.0020328713495665843, "sim_compute_performance-ego2": 0.001988427029561242, "sim_compute_performance-ego3": 0.0019364061204718117}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.3142893202758046, "get_ui_image": 0.04395388901779594, "step_physics": 0.5903470228355592, "survival_time": 59.99999999999873, "driven_lanedir": 2.5319699155430535, "get_state_dump": 0.009844722596930028, "get_robot_state": 0.014937869317327114, "sim_render-ego0": 0.004144628875757832, "sim_render-ego1": 0.003886106707075057, "sim_render-ego2": 0.003907866521639987, "sim_render-ego3": 0.003824431929957559, "get_duckie_state": 1.6484828316897375e-06, "in-drivable-lane": 3.4499999999999904, "deviation-heading": 13.308626802537782, "agent_compute-ego0": 0.06626928954398403, "agent_compute-ego1": 0.059995221853454746, "agent_compute-ego2": 0.05921423425285346, "agent_compute-ego3": 0.06124226834553664, "complete-iteration": 0.9608694387415267, "set_robot_commands": 0.002203908788472985, "deviation-center-line": 2.467832836497597, "driven_lanedir_consec": 2.5319699155430535, "sim_compute_sim_state": 0.021711568054211924, "sim_compute_performance-ego0": 0.002148043404610131, "sim_compute_performance-ego1": 0.0020328713495665843, "sim_compute_performance-ego2": 0.001988427029561242, "sim_compute_performance-ego3": 0.0019364061204718117}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 7.249375470341283, "get_ui_image": 0.04395388901779594, "step_physics": 0.5903470228355592, "survival_time": 59.99999999999873, "driven_lanedir": 4.509140212445026, "get_state_dump": 0.009844722596930028, "get_robot_state": 0.014937869317327114, "sim_render-ego0": 0.004144628875757832, "sim_render-ego1": 0.003886106707075057, "sim_render-ego2": 0.003907866521639987, "sim_render-ego3": 0.003824431929957559, "get_duckie_state": 1.6484828316897375e-06, "in-drivable-lane": 25.299999999999415, "deviation-heading": 7.969840486418534, "agent_compute-ego0": 0.06626928954398403, "agent_compute-ego1": 0.059995221853454746, "agent_compute-ego2": 0.05921423425285346, "agent_compute-ego3": 0.06124226834553664, "complete-iteration": 0.9608694387415267, "set_robot_commands": 0.002203908788472985, "deviation-center-line": 1.5084287656737665, "driven_lanedir_consec": 3.98050054375529, "sim_compute_sim_state": 0.021711568054211924, "sim_compute_performance-ego0": 0.002148043404610131, "sim_compute_performance-ego1": 0.0020328713495665843, "sim_compute_performance-ego2": 0.001988427029561242, "sim_compute_performance-ego3": 0.0019364061204718117}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 8.836925542371242, "get_ui_image": 0.04395388901779594, "step_physics": 0.5903470228355592, "survival_time": 59.99999999999873, "driven_lanedir": 8.08409399177013, "get_state_dump": 0.009844722596930028, "get_robot_state": 0.014937869317327114, "sim_render-ego0": 0.004144628875757832, "sim_render-ego1": 0.003886106707075057, "sim_render-ego2": 0.003907866521639987, "sim_render-ego3": 0.003824431929957559, "get_duckie_state": 1.6484828316897375e-06, "in-drivable-lane": 9.199999999999475, "deviation-heading": 7.516984176738013, "agent_compute-ego0": 0.06626928954398403, "agent_compute-ego1": 0.059995221853454746, "agent_compute-ego2": 0.05921423425285346, "agent_compute-ego3": 0.06124226834553664, "complete-iteration": 0.9608694387415267, "set_robot_commands": 0.002203908788472985, "deviation-center-line": 2.071209476960221, "driven_lanedir_consec": 8.079859861323152, "sim_compute_sim_state": 0.021711568054211924, "sim_compute_performance-ego0": 0.002148043404610131, "sim_compute_performance-ego1": 0.0020328713495665843, "sim_compute_performance-ego2": 0.001988427029561242, "sim_compute_performance-ego3": 0.0019364061204718117}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 6.793733571695143, "get_ui_image": 0.05008560930263192, "step_physics": 0.5622428960347553, "survival_time": 59.99999999999873, "driven_lanedir": 3.53672069906364, "get_state_dump": 0.009821893174285, "get_robot_state": 0.014909669223375662, "sim_render-ego0": 0.0041881959503834495, "sim_render-ego1": 0.004024331714588835, "sim_render-ego2": 0.003826365879830671, "sim_render-ego3": 0.003835443850857927, "get_duckie_state": 1.717765166499434e-06, "in-drivable-lane": 26.799999999999493, "deviation-heading": 11.538091660163886, "agent_compute-ego0": 0.07344313307070514, "agent_compute-ego1": 0.06957206221841754, "agent_compute-ego2": 0.06513185882250733, "agent_compute-ego3": 0.06868350476051349, "complete-iteration": 0.9799355849139796, "set_robot_commands": 0.002183086369853532, "deviation-center-line": 1.8205898778486296, "driven_lanedir_consec": 1.960633532019494, "sim_compute_sim_state": 0.03273219033939257, "sim_compute_performance-ego0": 0.0022254958934926866, "sim_compute_performance-ego1": 0.0019810019087334856, "sim_compute_performance-ego2": 0.0019738880621205756, "sim_compute_performance-ego3": 0.0019498276373031832}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 0.7973361560178924, "get_ui_image": 0.05008560930263192, "step_physics": 0.5622428960347553, "survival_time": 59.99999999999873, "driven_lanedir": 0.0975031382126268, "get_state_dump": 0.009821893174285, "get_robot_state": 0.014909669223375662, "sim_render-ego0": 0.0041881959503834495, "sim_render-ego1": 0.004024331714588835, "sim_render-ego2": 0.003826365879830671, "sim_render-ego3": 0.003835443850857927, "get_duckie_state": 1.717765166499434e-06, "in-drivable-lane": 56.749999999998735, "deviation-heading": 3.8293023567133737, "agent_compute-ego0": 0.07344313307070514, "agent_compute-ego1": 0.06957206221841754, "agent_compute-ego2": 0.06513185882250733, "agent_compute-ego3": 0.06868350476051349, "complete-iteration": 0.9799355849139796, "set_robot_commands": 0.002183086369853532, "deviation-center-line": 0.2530789513376133, "driven_lanedir_consec": 0.07904964542260284, "sim_compute_sim_state": 0.03273219033939257, "sim_compute_performance-ego0": 0.0022254958934926866, "sim_compute_performance-ego1": 0.0019810019087334856, "sim_compute_performance-ego2": 0.0019738880621205756, "sim_compute_performance-ego3": 0.0019498276373031832}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 6.297324339091237, "get_ui_image": 0.05008560930263192, "step_physics": 0.5622428960347553, "survival_time": 59.99999999999873, "driven_lanedir": 3.2562059933482588, "get_state_dump": 0.009821893174285, "get_robot_state": 0.014909669223375662, "sim_render-ego0": 0.0041881959503834495, "sim_render-ego1": 0.004024331714588835, "sim_render-ego2": 0.003826365879830671, "sim_render-ego3": 0.003835443850857927, "get_duckie_state": 1.717765166499434e-06, "in-drivable-lane": 27.449999999998916, "deviation-heading": 13.805730385774654, "agent_compute-ego0": 0.07344313307070514, "agent_compute-ego1": 0.06957206221841754, "agent_compute-ego2": 0.06513185882250733, "agent_compute-ego3": 0.06868350476051349, "complete-iteration": 0.9799355849139796, "set_robot_commands": 0.002183086369853532, "deviation-center-line": 1.684034840294491, "driven_lanedir_consec": 2.795995015923963, "sim_compute_sim_state": 0.03273219033939257, "sim_compute_performance-ego0": 0.0022254958934926866, "sim_compute_performance-ego1": 0.0019810019087334856, "sim_compute_performance-ego2": 0.0019738880621205756, "sim_compute_performance-ego3": 0.0019498276373031832}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 6.4697816352780775, "get_ui_image": 0.05008560930263192, "step_physics": 0.5622428960347553, "survival_time": 59.99999999999873, "driven_lanedir": 2.9224230610932356, "get_state_dump": 0.009821893174285, "get_robot_state": 0.014909669223375662, "sim_render-ego0": 0.0041881959503834495, "sim_render-ego1": 0.004024331714588835, "sim_render-ego2": 0.003826365879830671, "sim_render-ego3": 0.003835443850857927, "get_duckie_state": 1.717765166499434e-06, "in-drivable-lane": 29.949999999998965, "deviation-heading": 11.154848597705762, "agent_compute-ego0": 0.07344313307070514, "agent_compute-ego1": 0.06957206221841754, "agent_compute-ego2": 0.06513185882250733, "agent_compute-ego3": 0.06868350476051349, "complete-iteration": 0.9799355849139796, "set_robot_commands": 0.002183086369853532, "deviation-center-line": 1.5810046345441815, "driven_lanedir_consec": 2.2360747475859126, "sim_compute_sim_state": 0.03273219033939257, "sim_compute_performance-ego0": 0.0022254958934926866, "sim_compute_performance-ego1": 0.0019810019087334856, "sim_compute_performance-ego2": 0.0019738880621205756, "sim_compute_performance-ego3": 0.0019498276373031832}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 9.728362916027685, "get_ui_image": 0.05020669219297334, "step_physics": 0.7386424259579648, "survival_time": 59.99999999999873, "driven_lanedir": 7.259982135946148, "get_state_dump": 0.01007144000508406, "get_robot_state": 0.015586556641882802, "sim_render-ego0": 0.004252444893791714, "sim_render-ego1": 0.0043588782428801804, "sim_render-ego2": 0.004146571957400002, "sim_render-ego3": 0.004049060743714649, "get_duckie_state": 1.72153698415383e-06, "in-drivable-lane": 21.349999999999863, "deviation-heading": 4.897446819080791, "agent_compute-ego0": 0.06838649059711745, "agent_compute-ego1": 0.06562529118432292, "agent_compute-ego2": 0.06182542391164813, "agent_compute-ego3": 0.06731745662736853, "complete-iteration": 1.1431993554771989, "set_robot_commands": 0.0024741539649423415, "deviation-center-line": 1.2546009865738084, "driven_lanedir_consec": 4.638905733553564, "sim_compute_sim_state": 0.02944537801210529, "sim_compute_performance-ego0": 0.002339213813572105, "sim_compute_performance-ego1": 0.0022474988910379658, "sim_compute_performance-ego2": 0.002181450393575117, "sim_compute_performance-ego3": 0.0021494443370936615}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.3557900717984817, "get_ui_image": 0.05020669219297334, "step_physics": 0.7386424259579648, "survival_time": 59.99999999999873, "driven_lanedir": 1.2658322592935, "get_state_dump": 0.01007144000508406, "get_robot_state": 0.015586556641882802, "sim_render-ego0": 0.004252444893791714, "sim_render-ego1": 0.0043588782428801804, "sim_render-ego2": 0.004146571957400002, "sim_render-ego3": 0.004049060743714649, "get_duckie_state": 1.72153698415383e-06, "in-drivable-lane": 51.54999999999875, "deviation-heading": 2.0436738190618966, "agent_compute-ego0": 0.06838649059711745, "agent_compute-ego1": 0.06562529118432292, "agent_compute-ego2": 0.06182542391164813, "agent_compute-ego3": 0.06731745662736853, "complete-iteration": 1.1431993554771989, "set_robot_commands": 0.0024741539649423415, "deviation-center-line": 0.27460122912983925, "driven_lanedir_consec": 1.2658322592935, "sim_compute_sim_state": 0.02944537801210529, "sim_compute_performance-ego0": 0.002339213813572105, "sim_compute_performance-ego1": 0.0022474988910379658, "sim_compute_performance-ego2": 0.002181450393575117, "sim_compute_performance-ego3": 0.0021494443370936615}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.931015304270937, "get_ui_image": 0.05020669219297334, "step_physics": 0.7386424259579648, "survival_time": 59.99999999999873, "driven_lanedir": 2.307110483155605, "get_state_dump": 0.01007144000508406, "get_robot_state": 0.015586556641882802, "sim_render-ego0": 0.004252444893791714, "sim_render-ego1": 0.0043588782428801804, "sim_render-ego2": 0.004146571957400002, "sim_render-ego3": 0.004049060743714649, "get_duckie_state": 1.72153698415383e-06, "in-drivable-lane": 38.49999999999864, "deviation-heading": 6.0764788076612, "agent_compute-ego0": 0.06838649059711745, "agent_compute-ego1": 0.06562529118432292, "agent_compute-ego2": 0.06182542391164813, "agent_compute-ego3": 0.06731745662736853, "complete-iteration": 1.1431993554771989, "set_robot_commands": 0.0024741539649423415, "deviation-center-line": 1.20138517553391, "driven_lanedir_consec": 1.6649705927993144, "sim_compute_sim_state": 0.02944537801210529, "sim_compute_performance-ego0": 0.002339213813572105, "sim_compute_performance-ego1": 0.0022474988910379658, "sim_compute_performance-ego2": 0.002181450393575117, "sim_compute_performance-ego3": 0.0021494443370936615}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 5.214522304555258, "get_ui_image": 0.05020669219297334, "step_physics": 0.7386424259579648, "survival_time": 59.99999999999873, "driven_lanedir": 2.8099505735481696, "get_state_dump": 0.01007144000508406, "get_robot_state": 0.015586556641882802, "sim_render-ego0": 0.004252444893791714, "sim_render-ego1": 0.0043588782428801804, "sim_render-ego2": 0.004146571957400002, "sim_render-ego3": 0.004049060743714649, "get_duckie_state": 1.72153698415383e-06, "in-drivable-lane": 17.050000000000242, "deviation-heading": 4.624203606628596, "agent_compute-ego0": 0.06838649059711745, "agent_compute-ego1": 0.06562529118432292, "agent_compute-ego2": 0.06182542391164813, "agent_compute-ego3": 0.06731745662736853, "complete-iteration": 1.1431993554771989, "set_robot_commands": 0.0024741539649423415, "deviation-center-line": 0.7162236741317428, "driven_lanedir_consec": 2.8099505735481696, "sim_compute_sim_state": 0.02944537801210529, "sim_compute_performance-ego0": 0.002339213813572105, "sim_compute_performance-ego1": 0.0022474988910379658, "sim_compute_performance-ego2": 0.002181450393575117, "sim_compute_performance-ego3": 0.0021494443370936615}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.8868319209481177, "get_ui_image": 0.029434516336570005, "step_physics": 0.14044011275539195, "survival_time": 14.000000000000064, "driven_lanedir": 1.8695941055544616, "get_state_dump": 0.006205536716773417, "get_robot_state": 0.0072503488683191486, "sim_render-ego0": 0.003776163393068144, "sim_render-ego1": 0.003677805971844765, "get_duckie_state": 1.3965728868369105e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.9006536347707013, "agent_compute-ego0": 0.06385679601350289, "agent_compute-ego1": 0.056468133824575835, "complete-iteration": 0.3285292425189578, "set_robot_commands": 0.0020843799428159233, "deviation-center-line": 0.5799403265632029, "driven_lanedir_consec": 1.8695941055544616, "sim_compute_sim_state": 0.009298642759221303, "sim_compute_performance-ego0": 0.001890151101923498, "sim_compute_performance-ego1": 0.001887839035631499}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.6242721727174907, "get_ui_image": 0.029434516336570005, "step_physics": 0.14044011275539195, "survival_time": 14.000000000000064, "driven_lanedir": 1.5689512680997564, "get_state_dump": 0.006205536716773417, "get_robot_state": 0.0072503488683191486, "sim_render-ego0": 0.003776163393068144, "sim_render-ego1": 0.003677805971844765, "get_duckie_state": 1.3965728868369105e-06, "in-drivable-lane": 0.7500000000000107, "deviation-heading": 2.0763581694755175, "agent_compute-ego0": 0.06385679601350289, "agent_compute-ego1": 0.056468133824575835, "complete-iteration": 0.3285292425189578, "set_robot_commands": 0.0020843799428159233, "deviation-center-line": 0.358181710049586, "driven_lanedir_consec": 1.5689512680997564, "sim_compute_sim_state": 0.009298642759221303, "sim_compute_performance-ego0": 0.001890151101923498, "sim_compute_performance-ego1": 0.001887839035631499}}
set_robot_commands_max0.0024741539649423415
set_robot_commands_mean0.002258096884193377
set_robot_commands_median0.002203908788472985
set_robot_commands_min0.0020843799428159233
sim_compute_performance-ego0_max0.002339213813572105
sim_compute_performance-ego0_mean0.0021879510464676206
sim_compute_performance-ego0_median0.0022254958934926866
sim_compute_performance-ego0_min0.001890151101923498
sim_compute_performance-ego1_max0.0022474988910379658
sim_compute_performance-ego1_mean0.0020586547620439384
sim_compute_performance-ego1_median0.0020328713495665843
sim_compute_performance-ego1_min0.001887839035631499
sim_compute_sim_state_max0.03273219033939257
sim_compute_sim_state_mean0.02529670222437727
sim_compute_sim_state_median0.02944537801210529
sim_compute_sim_state_min0.009298642759221303
sim_render-ego0_max0.004252444893791714
sim_render-ego0_mean0.004135243261847734
sim_render-ego0_median0.0041881959503834495
sim_render-ego0_min0.003776163393068144
sim_render-ego1_max0.0043588782428801804
sim_render-ego1_mean0.0040309199001332735
sim_render-ego1_median0.004024331714588835
sim_render-ego1_min0.003677805971844765
simulation-passed1
step_physics_max0.7386424259579648
step_physics_mean0.5604149717731356
step_physics_median0.5903470228355592
step_physics_min0.14044011275539195
survival_time_max59.99999999999873
survival_time_mean53.42857142857036
survival_time_min14.000000000000064
No reset possible
58789LFVmultibodyv-simsuccessyes2:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58788LFVmultibodyv-simsuccessyes1:27:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible