Duckietown Challenges Home Challenges Submissions

Submission 12744

Submission12744
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserThomas Wiggers 🇳🇱
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 58790
Next
User labelppo_v1
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
58790LFVmultibodyv-simsuccessyes1:55:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0983541398027032
survival_time_median59.99999999999873
deviation-center-line_median1.3815148761237874
in-drivable-lane_median23.32499999999964


other stats
agent_compute-ego0_max0.07344313307070514
agent_compute-ego0_mean0.06857923177673088
agent_compute-ego0_median0.06838649059711745
agent_compute-ego0_min0.06385679601350289
agent_compute-ego1_max0.06957206221841754
agent_compute-ego1_mean0.06383618347670947
agent_compute-ego1_median0.06562529118432292
agent_compute-ego1_min0.056468133824575835
complete-iteration_max1.1431993554771989
complete-iteration_mean0.9280768572549098
complete-iteration_median0.9799355849139796
complete-iteration_min0.3285292425189578
deviation-center-line_max4.413645943315625
deviation-center-line_mean1.4417684591753008
deviation-center-line_min0.2530789513376133
deviation-heading_max27.31715699009108
deviation-heading_mean8.432814022344413
deviation-heading_median6.796731492199607
deviation-heading_min1.9006536347707013
driven_any_max9.728362916027685
driven_any_mean4.879117997701984
driven_any_median4.572768804413098
driven_any_min0.7973361560178924
driven_lanedir_consec_max8.079859861323152
driven_lanedir_consec_mean2.6282550880024007
driven_lanedir_consec_min0.07904964542260284
driven_lanedir_max8.08409399177013
driven_lanedir_mean3.0985706524549146
driven_lanedir_median2.6709602445456113
driven_lanedir_min0.0975031382126268
get_duckie_state_max1.72153698415383e-06
get_duckie_state_mean1.6531632645032736e-06
get_duckie_state_median1.717765166499434e-06
get_duckie_state_min1.3965728868369105e-06
get_robot_state_max0.015586556641882802
get_robot_state_mean0.014016934176212898
get_robot_state_median0.014937869317327114
get_robot_state_min0.0072503488683191486
get_state_dump_max0.01007144000508406
get_state_dump_mean0.00938309260991023
get_state_dump_median0.009844722596930028
get_state_dump_min0.006205536716773417
get_ui_image_max0.05020669219297334
get_ui_image_mean0.04541812819476749
get_ui_image_median0.05008560930263192
get_ui_image_min0.029434516336570005
in-drivable-lane_max56.749999999998735
in-drivable-lane_mean23.032142857142333
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.8080912424391244, "get_ui_image": 0.04395388901779594, "step_physics": 0.5903470228355592, "survival_time": 59.99999999999873, "driven_lanedir": 1.3605112972951914, "get_state_dump": 0.009844722596930028, "get_robot_state": 0.014937869317327114, "sim_render-ego0": 0.004144628875757832, "sim_render-ego1": 0.003886106707075057, "sim_render-ego2": 0.003907866521639987, "sim_render-ego3": 0.003824431929957559, "get_duckie_state": 1.6484828316897375e-06, "in-drivable-lane": 14.350000000000202, "deviation-heading": 27.31715699009108, "agent_compute-ego0": 0.06626928954398403, "agent_compute-ego1": 0.059995221853454746, "agent_compute-ego2": 0.05921423425285346, "agent_compute-ego3": 0.06124226834553664, "complete-iteration": 0.9608694387415267, "set_robot_commands": 0.002203908788472985, "deviation-center-line": 4.413645943315625, "driven_lanedir_consec": 1.3132834376113705, "sim_compute_sim_state": 0.021711568054211924, "sim_compute_performance-ego0": 0.002148043404610131, "sim_compute_performance-ego1": 0.0020328713495665843, "sim_compute_performance-ego2": 0.001988427029561242, "sim_compute_performance-ego3": 0.0019364061204718117}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.3142893202758046, "get_ui_image": 0.04395388901779594, "step_physics": 0.5903470228355592, "survival_time": 59.99999999999873, "driven_lanedir": 2.5319699155430535, "get_state_dump": 0.009844722596930028, "get_robot_state": 0.014937869317327114, "sim_render-ego0": 0.004144628875757832, "sim_render-ego1": 0.003886106707075057, "sim_render-ego2": 0.003907866521639987, "sim_render-ego3": 0.003824431929957559, "get_duckie_state": 1.6484828316897375e-06, "in-drivable-lane": 3.4499999999999904, "deviation-heading": 13.308626802537782, "agent_compute-ego0": 0.06626928954398403, "agent_compute-ego1": 0.059995221853454746, "agent_compute-ego2": 0.05921423425285346, "agent_compute-ego3": 0.06124226834553664, "complete-iteration": 0.9608694387415267, "set_robot_commands": 0.002203908788472985, "deviation-center-line": 2.467832836497597, "driven_lanedir_consec": 2.5319699155430535, "sim_compute_sim_state": 0.021711568054211924, "sim_compute_performance-ego0": 0.002148043404610131, "sim_compute_performance-ego1": 0.0020328713495665843, "sim_compute_performance-ego2": 0.001988427029561242, "sim_compute_performance-ego3": 0.0019364061204718117}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 7.249375470341283, "get_ui_image": 0.04395388901779594, "step_physics": 0.5903470228355592, "survival_time": 59.99999999999873, "driven_lanedir": 4.509140212445026, "get_state_dump": 0.009844722596930028, "get_robot_state": 0.014937869317327114, "sim_render-ego0": 0.004144628875757832, "sim_render-ego1": 0.003886106707075057, "sim_render-ego2": 0.003907866521639987, "sim_render-ego3": 0.003824431929957559, "get_duckie_state": 1.6484828316897375e-06, "in-drivable-lane": 25.299999999999415, "deviation-heading": 7.969840486418534, "agent_compute-ego0": 0.06626928954398403, "agent_compute-ego1": 0.059995221853454746, "agent_compute-ego2": 0.05921423425285346, "agent_compute-ego3": 0.06124226834553664, "complete-iteration": 0.9608694387415267, "set_robot_commands": 0.002203908788472985, "deviation-center-line": 1.5084287656737665, "driven_lanedir_consec": 3.98050054375529, "sim_compute_sim_state": 0.021711568054211924, "sim_compute_performance-ego0": 0.002148043404610131, "sim_compute_performance-ego1": 0.0020328713495665843, "sim_compute_performance-ego2": 0.001988427029561242, "sim_compute_performance-ego3": 0.0019364061204718117}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 8.836925542371242, "get_ui_image": 0.04395388901779594, "step_physics": 0.5903470228355592, "survival_time": 59.99999999999873, "driven_lanedir": 8.08409399177013, "get_state_dump": 0.009844722596930028, "get_robot_state": 0.014937869317327114, "sim_render-ego0": 0.004144628875757832, "sim_render-ego1": 0.003886106707075057, "sim_render-ego2": 0.003907866521639987, "sim_render-ego3": 0.003824431929957559, "get_duckie_state": 1.6484828316897375e-06, "in-drivable-lane": 9.199999999999475, "deviation-heading": 7.516984176738013, "agent_compute-ego0": 0.06626928954398403, "agent_compute-ego1": 0.059995221853454746, "agent_compute-ego2": 0.05921423425285346, "agent_compute-ego3": 0.06124226834553664, "complete-iteration": 0.9608694387415267, "set_robot_commands": 0.002203908788472985, "deviation-center-line": 2.071209476960221, "driven_lanedir_consec": 8.079859861323152, "sim_compute_sim_state": 0.021711568054211924, "sim_compute_performance-ego0": 0.002148043404610131, "sim_compute_performance-ego1": 0.0020328713495665843, "sim_compute_performance-ego2": 0.001988427029561242, "sim_compute_performance-ego3": 0.0019364061204718117}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 6.793733571695143, "get_ui_image": 0.05008560930263192, "step_physics": 0.5622428960347553, "survival_time": 59.99999999999873, "driven_lanedir": 3.53672069906364, "get_state_dump": 0.009821893174285, "get_robot_state": 0.014909669223375662, "sim_render-ego0": 0.0041881959503834495, "sim_render-ego1": 0.004024331714588835, "sim_render-ego2": 0.003826365879830671, "sim_render-ego3": 0.003835443850857927, "get_duckie_state": 1.717765166499434e-06, "in-drivable-lane": 26.799999999999493, "deviation-heading": 11.538091660163886, "agent_compute-ego0": 0.07344313307070514, "agent_compute-ego1": 0.06957206221841754, "agent_compute-ego2": 0.06513185882250733, "agent_compute-ego3": 0.06868350476051349, "complete-iteration": 0.9799355849139796, "set_robot_commands": 0.002183086369853532, "deviation-center-line": 1.8205898778486296, "driven_lanedir_consec": 1.960633532019494, "sim_compute_sim_state": 0.03273219033939257, "sim_compute_performance-ego0": 0.0022254958934926866, "sim_compute_performance-ego1": 0.0019810019087334856, "sim_compute_performance-ego2": 0.0019738880621205756, "sim_compute_performance-ego3": 0.0019498276373031832}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 0.7973361560178924, "get_ui_image": 0.05008560930263192, "step_physics": 0.5622428960347553, "survival_time": 59.99999999999873, "driven_lanedir": 0.0975031382126268, "get_state_dump": 0.009821893174285, "get_robot_state": 0.014909669223375662, "sim_render-ego0": 0.0041881959503834495, "sim_render-ego1": 0.004024331714588835, "sim_render-ego2": 0.003826365879830671, "sim_render-ego3": 0.003835443850857927, "get_duckie_state": 1.717765166499434e-06, "in-drivable-lane": 56.749999999998735, "deviation-heading": 3.8293023567133737, "agent_compute-ego0": 0.07344313307070514, "agent_compute-ego1": 0.06957206221841754, "agent_compute-ego2": 0.06513185882250733, "agent_compute-ego3": 0.06868350476051349, "complete-iteration": 0.9799355849139796, "set_robot_commands": 0.002183086369853532, "deviation-center-line": 0.2530789513376133, "driven_lanedir_consec": 0.07904964542260284, "sim_compute_sim_state": 0.03273219033939257, "sim_compute_performance-ego0": 0.0022254958934926866, "sim_compute_performance-ego1": 0.0019810019087334856, "sim_compute_performance-ego2": 0.0019738880621205756, "sim_compute_performance-ego3": 0.0019498276373031832}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 6.297324339091237, "get_ui_image": 0.05008560930263192, "step_physics": 0.5622428960347553, "survival_time": 59.99999999999873, "driven_lanedir": 3.2562059933482588, "get_state_dump": 0.009821893174285, "get_robot_state": 0.014909669223375662, "sim_render-ego0": 0.0041881959503834495, "sim_render-ego1": 0.004024331714588835, "sim_render-ego2": 0.003826365879830671, "sim_render-ego3": 0.003835443850857927, "get_duckie_state": 1.717765166499434e-06, "in-drivable-lane": 27.449999999998916, "deviation-heading": 13.805730385774654, "agent_compute-ego0": 0.07344313307070514, "agent_compute-ego1": 0.06957206221841754, "agent_compute-ego2": 0.06513185882250733, "agent_compute-ego3": 0.06868350476051349, "complete-iteration": 0.9799355849139796, "set_robot_commands": 0.002183086369853532, "deviation-center-line": 1.684034840294491, "driven_lanedir_consec": 2.795995015923963, "sim_compute_sim_state": 0.03273219033939257, "sim_compute_performance-ego0": 0.0022254958934926866, "sim_compute_performance-ego1": 0.0019810019087334856, "sim_compute_performance-ego2": 0.0019738880621205756, "sim_compute_performance-ego3": 0.0019498276373031832}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 6.4697816352780775, "get_ui_image": 0.05008560930263192, "step_physics": 0.5622428960347553, "survival_time": 59.99999999999873, "driven_lanedir": 2.9224230610932356, "get_state_dump": 0.009821893174285, "get_robot_state": 0.014909669223375662, "sim_render-ego0": 0.0041881959503834495, "sim_render-ego1": 0.004024331714588835, "sim_render-ego2": 0.003826365879830671, "sim_render-ego3": 0.003835443850857927, "get_duckie_state": 1.717765166499434e-06, "in-drivable-lane": 29.949999999998965, "deviation-heading": 11.154848597705762, "agent_compute-ego0": 0.07344313307070514, "agent_compute-ego1": 0.06957206221841754, "agent_compute-ego2": 0.06513185882250733, "agent_compute-ego3": 0.06868350476051349, "complete-iteration": 0.9799355849139796, "set_robot_commands": 0.002183086369853532, "deviation-center-line": 1.5810046345441815, "driven_lanedir_consec": 2.2360747475859126, "sim_compute_sim_state": 0.03273219033939257, "sim_compute_performance-ego0": 0.0022254958934926866, "sim_compute_performance-ego1": 0.0019810019087334856, "sim_compute_performance-ego2": 0.0019738880621205756, "sim_compute_performance-ego3": 0.0019498276373031832}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 9.728362916027685, "get_ui_image": 0.05020669219297334, "step_physics": 0.7386424259579648, "survival_time": 59.99999999999873, "driven_lanedir": 7.259982135946148, "get_state_dump": 0.01007144000508406, "get_robot_state": 0.015586556641882802, "sim_render-ego0": 0.004252444893791714, "sim_render-ego1": 0.0043588782428801804, "sim_render-ego2": 0.004146571957400002, "sim_render-ego3": 0.004049060743714649, "get_duckie_state": 1.72153698415383e-06, "in-drivable-lane": 21.349999999999863, "deviation-heading": 4.897446819080791, "agent_compute-ego0": 0.06838649059711745, "agent_compute-ego1": 0.06562529118432292, "agent_compute-ego2": 0.06182542391164813, "agent_compute-ego3": 0.06731745662736853, "complete-iteration": 1.1431993554771989, "set_robot_commands": 0.0024741539649423415, "deviation-center-line": 1.2546009865738084, "driven_lanedir_consec": 4.638905733553564, "sim_compute_sim_state": 0.02944537801210529, "sim_compute_performance-ego0": 0.002339213813572105, "sim_compute_performance-ego1": 0.0022474988910379658, "sim_compute_performance-ego2": 0.002181450393575117, "sim_compute_performance-ego3": 0.0021494443370936615}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.3557900717984817, "get_ui_image": 0.05020669219297334, "step_physics": 0.7386424259579648, "survival_time": 59.99999999999873, "driven_lanedir": 1.2658322592935, "get_state_dump": 0.01007144000508406, "get_robot_state": 0.015586556641882802, "sim_render-ego0": 0.004252444893791714, "sim_render-ego1": 0.0043588782428801804, "sim_render-ego2": 0.004146571957400002, "sim_render-ego3": 0.004049060743714649, "get_duckie_state": 1.72153698415383e-06, "in-drivable-lane": 51.54999999999875, "deviation-heading": 2.0436738190618966, "agent_compute-ego0": 0.06838649059711745, "agent_compute-ego1": 0.06562529118432292, "agent_compute-ego2": 0.06182542391164813, "agent_compute-ego3": 0.06731745662736853, "complete-iteration": 1.1431993554771989, "set_robot_commands": 0.0024741539649423415, "deviation-center-line": 0.27460122912983925, "driven_lanedir_consec": 1.2658322592935, "sim_compute_sim_state": 0.02944537801210529, "sim_compute_performance-ego0": 0.002339213813572105, "sim_compute_performance-ego1": 0.0022474988910379658, "sim_compute_performance-ego2": 0.002181450393575117, "sim_compute_performance-ego3": 0.0021494443370936615}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.931015304270937, "get_ui_image": 0.05020669219297334, "step_physics": 0.7386424259579648, "survival_time": 59.99999999999873, "driven_lanedir": 2.307110483155605, "get_state_dump": 0.01007144000508406, "get_robot_state": 0.015586556641882802, "sim_render-ego0": 0.004252444893791714, "sim_render-ego1": 0.0043588782428801804, "sim_render-ego2": 0.004146571957400002, "sim_render-ego3": 0.004049060743714649, "get_duckie_state": 1.72153698415383e-06, "in-drivable-lane": 38.49999999999864, "deviation-heading": 6.0764788076612, "agent_compute-ego0": 0.06838649059711745, "agent_compute-ego1": 0.06562529118432292, "agent_compute-ego2": 0.06182542391164813, "agent_compute-ego3": 0.06731745662736853, "complete-iteration": 1.1431993554771989, "set_robot_commands": 0.0024741539649423415, "deviation-center-line": 1.20138517553391, "driven_lanedir_consec": 1.6649705927993144, "sim_compute_sim_state": 0.02944537801210529, "sim_compute_performance-ego0": 0.002339213813572105, "sim_compute_performance-ego1": 0.0022474988910379658, "sim_compute_performance-ego2": 0.002181450393575117, "sim_compute_performance-ego3": 0.0021494443370936615}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 5.214522304555258, "get_ui_image": 0.05020669219297334, "step_physics": 0.7386424259579648, "survival_time": 59.99999999999873, "driven_lanedir": 2.8099505735481696, "get_state_dump": 0.01007144000508406, "get_robot_state": 0.015586556641882802, "sim_render-ego0": 0.004252444893791714, "sim_render-ego1": 0.0043588782428801804, "sim_render-ego2": 0.004146571957400002, "sim_render-ego3": 0.004049060743714649, "get_duckie_state": 1.72153698415383e-06, "in-drivable-lane": 17.050000000000242, "deviation-heading": 4.624203606628596, "agent_compute-ego0": 0.06838649059711745, "agent_compute-ego1": 0.06562529118432292, "agent_compute-ego2": 0.06182542391164813, "agent_compute-ego3": 0.06731745662736853, "complete-iteration": 1.1431993554771989, "set_robot_commands": 0.0024741539649423415, "deviation-center-line": 0.7162236741317428, "driven_lanedir_consec": 2.8099505735481696, "sim_compute_sim_state": 0.02944537801210529, "sim_compute_performance-ego0": 0.002339213813572105, "sim_compute_performance-ego1": 0.0022474988910379658, "sim_compute_performance-ego2": 0.002181450393575117, "sim_compute_performance-ego3": 0.0021494443370936615}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.8868319209481177, "get_ui_image": 0.029434516336570005, "step_physics": 0.14044011275539195, "survival_time": 14.000000000000064, "driven_lanedir": 1.8695941055544616, "get_state_dump": 0.006205536716773417, "get_robot_state": 0.0072503488683191486, "sim_render-ego0": 0.003776163393068144, "sim_render-ego1": 0.003677805971844765, "get_duckie_state": 1.3965728868369105e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.9006536347707013, "agent_compute-ego0": 0.06385679601350289, "agent_compute-ego1": 0.056468133824575835, "complete-iteration": 0.3285292425189578, "set_robot_commands": 0.0020843799428159233, "deviation-center-line": 0.5799403265632029, "driven_lanedir_consec": 1.8695941055544616, "sim_compute_sim_state": 0.009298642759221303, "sim_compute_performance-ego0": 0.001890151101923498, "sim_compute_performance-ego1": 0.001887839035631499}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.6242721727174907, "get_ui_image": 0.029434516336570005, "step_physics": 0.14044011275539195, "survival_time": 14.000000000000064, "driven_lanedir": 1.5689512680997564, "get_state_dump": 0.006205536716773417, "get_robot_state": 0.0072503488683191486, "sim_render-ego0": 0.003776163393068144, "sim_render-ego1": 0.003677805971844765, "get_duckie_state": 1.3965728868369105e-06, "in-drivable-lane": 0.7500000000000107, "deviation-heading": 2.0763581694755175, "agent_compute-ego0": 0.06385679601350289, "agent_compute-ego1": 0.056468133824575835, "complete-iteration": 0.3285292425189578, "set_robot_commands": 0.0020843799428159233, "deviation-center-line": 0.358181710049586, "driven_lanedir_consec": 1.5689512680997564, "sim_compute_sim_state": 0.009298642759221303, "sim_compute_performance-ego0": 0.001890151101923498, "sim_compute_performance-ego1": 0.001887839035631499}}
set_robot_commands_max0.0024741539649423415
set_robot_commands_mean0.002258096884193377
set_robot_commands_median0.002203908788472985
set_robot_commands_min0.0020843799428159233
sim_compute_performance-ego0_max0.002339213813572105
sim_compute_performance-ego0_mean0.0021879510464676206
sim_compute_performance-ego0_median0.0022254958934926866
sim_compute_performance-ego0_min0.001890151101923498
sim_compute_performance-ego1_max0.0022474988910379658
sim_compute_performance-ego1_mean0.0020586547620439384
sim_compute_performance-ego1_median0.0020328713495665843
sim_compute_performance-ego1_min0.001887839035631499
sim_compute_sim_state_max0.03273219033939257
sim_compute_sim_state_mean0.02529670222437727
sim_compute_sim_state_median0.02944537801210529
sim_compute_sim_state_min0.009298642759221303
sim_render-ego0_max0.004252444893791714
sim_render-ego0_mean0.004135243261847734
sim_render-ego0_median0.0041881959503834495
sim_render-ego0_min0.003776163393068144
sim_render-ego1_max0.0043588782428801804
sim_render-ego1_mean0.0040309199001332735
sim_render-ego1_median0.004024331714588835
sim_render-ego1_min0.003677805971844765
simulation-passed1
step_physics_max0.7386424259579648
step_physics_mean0.5604149717731356
step_physics_median0.5903470228355592
step_physics_min0.14044011275539195
survival_time_max59.99999999999873
survival_time_mean53.42857142857036
survival_time_min14.000000000000064
No reset possible
58789LFVmultibodyv-simsuccessyes2:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58788LFVmultibodyv-simsuccessyes1:27:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible