Duckietown Challenges Home Challenges Submissions

Submission 12848

Submission12848
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserRaphael Jean
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 58890
Next
User labelexercise_state_estimation
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
58890LFVmultibodyv-simsuccessyes1:53:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.793491061002037
survival_time_median59.99999999999873
deviation-center-line_median2.832891030800841
in-drivable-lane_median0.39999999999997726


other stats
agent_compute-ego0_max0.01265458004560002
agent_compute-ego0_mean0.012482446222335446
agent_compute-ego0_median0.012562019441844425
agent_compute-ego0_min0.012101759189551536
agent_compute-ego1_max0.013603949208207795
agent_compute-ego1_mean0.013428983425016937
agent_compute-ego1_median0.013394974153504383
agent_compute-ego1_min0.013230190388268972
complete-iteration_max0.8536739325543228
complete-iteration_mean0.7167808244573194
complete-iteration_median0.7615731038419928
complete-iteration_min0.31115600877537164
deviation-center-line_max3.2219619150488223
deviation-center-line_mean2.6841379364849316
deviation-center-line_min1.470900002173385
deviation-heading_max14.0581177238736
deviation-heading_mean11.292188999663583
deviation-heading_median11.570473009987378
deviation-heading_min6.734227259330157
driven_any_max13.15675454546058
driven_any_mean11.976233511566637
driven_any_median12.317259903620512
driven_any_min9.605020699484449
driven_lanedir_consec_max12.67169577979376
driven_lanedir_consec_mean11.49087961772119
driven_lanedir_consec_min9.189551847815316
driven_lanedir_max12.67169577979376
driven_lanedir_mean11.49087961772119
driven_lanedir_median11.793491061002037
driven_lanedir_min9.189551847815316
get_duckie_state_max1.9883434540226894e-06
get_duckie_state_mean1.8633825459082016e-06
get_duckie_state_median1.8706230398618016e-06
get_duckie_state_min1.6504063044574326e-06
get_robot_state_max0.015876032728438176
get_robot_state_mean0.014423203391496149
get_robot_state_median0.015609581206462268
get_robot_state_min0.007723593174066758
get_state_dump_max0.010372359786402873
get_state_dump_mean0.0096878273271955
get_state_dump_median0.010327658387246875
get_state_dump_min0.006613391184667397
get_ui_image_max0.05320540097829801
get_ui_image_mean0.04661870970133549
get_ui_image_median0.04835869847090417
get_ui_image_min0.0332816907935274
in-drivable-lane_max17.999999999998977
in-drivable-lane_mean2.107142857142744
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 9.605020699484449, "get_ui_image": 0.04496053910870834, "step_physics": 0.5551639452862005, "survival_time": 59.99999999999873, "driven_lanedir": 9.189551847815316, "get_state_dump": 0.009900681879200804, "get_robot_state": 0.015133801348302684, "sim_render-ego0": 0.004137507882543051, "sim_render-ego1": 0.004180781747975219, "sim_render-ego2": 0.004254054268829828, "sim_render-ego3": 0.004309099977161366, "get_duckie_state": 1.8376692645654988e-06, "in-drivable-lane": 17.999999999998977, "deviation-heading": 6.734227259330157, "agent_compute-ego0": 0.012421082695953852, "agent_compute-ego1": 0.013230190388268972, "agent_compute-ego2": 0.012418467833735762, "agent_compute-ego3": 0.012357788419445587, "complete-iteration": 0.7379078448166161, "set_robot_commands": 0.002418304065383543, "deviation-center-line": 1.470900002173385, "driven_lanedir_consec": 9.189551847815316, "sim_compute_sim_state": 0.027150975774468032, "sim_compute_performance-ego0": 0.0021768301154652006, "sim_compute_performance-ego1": 0.002091392093058133, "sim_compute_performance-ego2": 0.0021085463197503262, "sim_compute_performance-ego3": 0.00212197200543279}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 12.729893485875111, "get_ui_image": 0.04496053910870834, "step_physics": 0.5551639452862005, "survival_time": 59.99999999999873, "driven_lanedir": 12.391834096800164, "get_state_dump": 0.009900681879200804, "get_robot_state": 0.015133801348302684, "sim_render-ego0": 0.004137507882543051, "sim_render-ego1": 0.004180781747975219, "sim_render-ego2": 0.004254054268829828, "sim_render-ego3": 0.004309099977161366, "get_duckie_state": 1.8376692645654988e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.0335919919765, "agent_compute-ego0": 0.012421082695953852, "agent_compute-ego1": 0.013230190388268972, "agent_compute-ego2": 0.012418467833735762, "agent_compute-ego3": 0.012357788419445587, "complete-iteration": 0.7379078448166161, "set_robot_commands": 0.002418304065383543, "deviation-center-line": 2.5491723741911403, "driven_lanedir_consec": 12.391834096800164, "sim_compute_sim_state": 0.027150975774468032, "sim_compute_performance-ego0": 0.0021768301154652006, "sim_compute_performance-ego1": 0.002091392093058133, "sim_compute_performance-ego2": 0.0021085463197503262, "sim_compute_performance-ego3": 0.00212197200543279}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 13.15675454546058, "get_ui_image": 0.04496053910870834, "step_physics": 0.5551639452862005, "survival_time": 59.99999999999873, "driven_lanedir": 12.67169577979376, "get_state_dump": 0.009900681879200804, "get_robot_state": 0.015133801348302684, "sim_render-ego0": 0.004137507882543051, "sim_render-ego1": 0.004180781747975219, "sim_render-ego2": 0.004254054268829828, "sim_render-ego3": 0.004309099977161366, "get_duckie_state": 1.8376692645654988e-06, "in-drivable-lane": 1.6499999999999062, "deviation-heading": 9.667137337377063, "agent_compute-ego0": 0.012421082695953852, "agent_compute-ego1": 0.013230190388268972, "agent_compute-ego2": 0.012418467833735762, "agent_compute-ego3": 0.012357788419445587, "complete-iteration": 0.7379078448166161, "set_robot_commands": 0.002418304065383543, "deviation-center-line": 2.1142253492938843, "driven_lanedir_consec": 12.67169577979376, "sim_compute_sim_state": 0.027150975774468032, "sim_compute_performance-ego0": 0.0021768301154652006, "sim_compute_performance-ego1": 0.002091392093058133, "sim_compute_performance-ego2": 0.0021085463197503262, "sim_compute_performance-ego3": 0.00212197200543279}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 10.066989486085204, "get_ui_image": 0.04496053910870834, "step_physics": 0.5551639452862005, "survival_time": 59.99999999999873, "driven_lanedir": 9.79623364235938, "get_state_dump": 0.009900681879200804, "get_robot_state": 0.015133801348302684, "sim_render-ego0": 0.004137507882543051, "sim_render-ego1": 0.004180781747975219, "sim_render-ego2": 0.004254054268829828, "sim_render-ego3": 0.004309099977161366, "get_duckie_state": 1.8376692645654988e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.935090231739808, "agent_compute-ego0": 0.012421082695953852, "agent_compute-ego1": 0.013230190388268972, "agent_compute-ego2": 0.012418467833735762, "agent_compute-ego3": 0.012357788419445587, "complete-iteration": 0.7379078448166161, "set_robot_commands": 0.002418304065383543, "deviation-center-line": 2.791749835640689, "driven_lanedir_consec": 9.79623364235938, "sim_compute_sim_state": 0.027150975774468032, "sim_compute_performance-ego0": 0.0021768301154652006, "sim_compute_performance-ego1": 0.002091392093058133, "sim_compute_performance-ego2": 0.0021085463197503262, "sim_compute_performance-ego3": 0.00212197200543279}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 11.761823474414404, "get_ui_image": 0.05320540097829801, "step_physics": 0.6351948385929486, "survival_time": 59.99999999999873, "driven_lanedir": 11.404529564159846, "get_state_dump": 0.010372359786402873, "get_robot_state": 0.015609581206462268, "sim_render-ego0": 0.004245964315511305, "sim_render-ego1": 0.004260746267415602, "sim_render-ego2": 0.0043643799352209136, "sim_render-ego3": 0.004316865752678331, "get_duckie_state": 1.8706230398618016e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.900609269709186, "agent_compute-ego0": 0.012562019441844425, "agent_compute-ego1": 0.013394974153504383, "agent_compute-ego2": 0.012887336133818742, "agent_compute-ego3": 0.012452240689013225, "complete-iteration": 0.8536739325543228, "set_robot_commands": 0.0023841113472461302, "deviation-center-line": 2.901641841880598, "driven_lanedir_consec": 11.404529564159846, "sim_compute_sim_state": 0.05218466513361363, "sim_compute_performance-ego0": 0.002351885731273845, "sim_compute_performance-ego1": 0.0021622482684133053, "sim_compute_performance-ego2": 0.002175770036187597, "sim_compute_performance-ego3": 0.0021725407647252776}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 12.358442570695937, "get_ui_image": 0.05320540097829801, "step_physics": 0.6351948385929486, "survival_time": 59.99999999999873, "driven_lanedir": 11.883958952039952, "get_state_dump": 0.010372359786402873, "get_robot_state": 0.015609581206462268, "sim_render-ego0": 0.004245964315511305, "sim_render-ego1": 0.004260746267415602, "sim_render-ego2": 0.0043643799352209136, "sim_render-ego3": 0.004316865752678331, "get_duckie_state": 1.8706230398618016e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.843112176195133, "agent_compute-ego0": 0.012562019441844425, "agent_compute-ego1": 0.013394974153504383, "agent_compute-ego2": 0.012887336133818742, "agent_compute-ego3": 0.012452240689013225, "complete-iteration": 0.8536739325543228, "set_robot_commands": 0.0023841113472461302, "deviation-center-line": 3.045032350778056, "driven_lanedir_consec": 11.883958952039952, "sim_compute_sim_state": 0.05218466513361363, "sim_compute_performance-ego0": 0.002351885731273845, "sim_compute_performance-ego1": 0.0021622482684133053, "sim_compute_performance-ego2": 0.002175770036187597, "sim_compute_performance-ego3": 0.0021725407647252776}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 11.758261731301484, "get_ui_image": 0.05320540097829801, "step_physics": 0.6351948385929486, "survival_time": 59.99999999999873, "driven_lanedir": 11.053653688726538, "get_state_dump": 0.010372359786402873, "get_robot_state": 0.015609581206462268, "sim_render-ego0": 0.004245964315511305, "sim_render-ego1": 0.004260746267415602, "sim_render-ego2": 0.0043643799352209136, "sim_render-ego3": 0.004316865752678331, "get_duckie_state": 1.8706230398618016e-06, "in-drivable-lane": 1.54999999999995, "deviation-heading": 14.0581177238736, "agent_compute-ego0": 0.012562019441844425, "agent_compute-ego1": 0.013394974153504383, "agent_compute-ego2": 0.012887336133818742, "agent_compute-ego3": 0.012452240689013225, "complete-iteration": 0.8536739325543228, "set_robot_commands": 0.0023841113472461302, "deviation-center-line": 3.1799253068445967, "driven_lanedir_consec": 11.053653688726538, "sim_compute_sim_state": 0.05218466513361363, "sim_compute_performance-ego0": 0.002351885731273845, "sim_compute_performance-ego1": 0.0021622482684133053, "sim_compute_performance-ego2": 0.002175770036187597, "sim_compute_performance-ego3": 0.0021725407647252776}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 12.124884855342724, "get_ui_image": 0.05320540097829801, "step_physics": 0.6351948385929486, "survival_time": 59.99999999999873, "driven_lanedir": 11.70302316996412, "get_state_dump": 0.010372359786402873, "get_robot_state": 0.015609581206462268, "sim_render-ego0": 0.004245964315511305, "sim_render-ego1": 0.004260746267415602, "sim_render-ego2": 0.0043643799352209136, "sim_render-ego3": 0.004316865752678331, "get_duckie_state": 1.8706230398618016e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.30770068006252, "agent_compute-ego0": 0.012562019441844425, "agent_compute-ego1": 0.013394974153504383, "agent_compute-ego2": 0.012887336133818742, "agent_compute-ego3": 0.012452240689013225, "complete-iteration": 0.8536739325543228, "set_robot_commands": 0.0023841113472461302, "deviation-center-line": 3.0233654414533175, "driven_lanedir_consec": 11.70302316996412, "sim_compute_sim_state": 0.05218466513361363, "sim_compute_performance-ego0": 0.002351885731273845, "sim_compute_performance-ego1": 0.0021622482684133053, "sim_compute_performance-ego2": 0.002175770036187597, "sim_compute_performance-ego3": 0.0021725407647252776}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 12.292330237289017, "get_ui_image": 0.04835869847090417, "step_physics": 0.5515930958334155, "survival_time": 59.99999999999873, "driven_lanedir": 10.92939381711261, "get_state_dump": 0.010327658387246875, "get_robot_state": 0.015876032728438176, "sim_render-ego0": 0.0042936708607542624, "sim_render-ego1": 0.004372762303666012, "sim_render-ego2": 0.004455478860377074, "sim_render-ego3": 0.0044139892632121544, "get_duckie_state": 1.9883434540226894e-06, "in-drivable-lane": 5.499999999999687, "deviation-heading": 11.240336750265568, "agent_compute-ego0": 0.01265458004560002, "agent_compute-ego1": 0.01357430284168202, "agent_compute-ego2": 0.012943507630461756, "agent_compute-ego3": 0.01263751396033091, "complete-iteration": 0.7615731038419928, "set_robot_commands": 0.0024433360310220204, "deviation-center-line": 2.6329031186280676, "driven_lanedir_consec": 10.92939381711261, "sim_compute_sim_state": 0.04655727240366304, "sim_compute_performance-ego0": 0.002496616131657863, "sim_compute_performance-ego1": 0.0022743147279102537, "sim_compute_performance-ego2": 0.0023180979872424834, "sim_compute_performance-ego3": 0.002277597003336453}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 12.555697899878016, "get_ui_image": 0.04835869847090417, "step_physics": 0.5515930958334155, "survival_time": 59.99999999999873, "driven_lanedir": 12.079467342239806, "get_state_dump": 0.010327658387246875, "get_robot_state": 0.015876032728438176, "sim_render-ego0": 0.0042936708607542624, "sim_render-ego1": 0.004372762303666012, "sim_render-ego2": 0.004455478860377074, "sim_render-ego3": 0.0044139892632121544, "get_duckie_state": 1.9883434540226894e-06, "in-drivable-lane": 0.7999999999999545, "deviation-heading": 11.933219922184197, "agent_compute-ego0": 0.01265458004560002, "agent_compute-ego1": 0.01357430284168202, "agent_compute-ego2": 0.012943507630461756, "agent_compute-ego3": 0.01263751396033091, "complete-iteration": 0.7615731038419928, "set_robot_commands": 0.0024433360310220204, "deviation-center-line": 3.2219619150488223, "driven_lanedir_consec": 12.079467342239806, "sim_compute_sim_state": 0.04655727240366304, "sim_compute_performance-ego0": 0.002496616131657863, "sim_compute_performance-ego1": 0.0022743147279102537, "sim_compute_performance-ego2": 0.0023180979872424834, "sim_compute_performance-ego3": 0.002277597003336453}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 12.34218956995201, "get_ui_image": 0.04835869847090417, "step_physics": 0.5515930958334155, "survival_time": 59.99999999999873, "driven_lanedir": 12.059791441374523, "get_state_dump": 0.010327658387246875, "get_robot_state": 0.015876032728438176, "sim_render-ego0": 0.0042936708607542624, "sim_render-ego1": 0.004372762303666012, "sim_render-ego2": 0.004455478860377074, "sim_render-ego3": 0.0044139892632121544, "get_duckie_state": 1.9883434540226894e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.480699278883648, "agent_compute-ego0": 0.01265458004560002, "agent_compute-ego1": 0.01357430284168202, "agent_compute-ego2": 0.012943507630461756, "agent_compute-ego3": 0.01263751396033091, "complete-iteration": 0.7615731038419928, "set_robot_commands": 0.0024433360310220204, "deviation-center-line": 2.7957626803214253, "driven_lanedir_consec": 12.059791441374523, "sim_compute_sim_state": 0.04655727240366304, "sim_compute_performance-ego0": 0.002496616131657863, "sim_compute_performance-ego1": 0.0022743147279102537, "sim_compute_performance-ego2": 0.0023180979872424834, "sim_compute_performance-ego3": 0.002277597003336453}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 12.579073254667296, "get_ui_image": 0.04835869847090417, "step_physics": 0.5515930958334155, "survival_time": 59.99999999999873, "driven_lanedir": 12.028819150422938, "get_state_dump": 0.010327658387246875, "get_robot_state": 0.015876032728438176, "sim_render-ego0": 0.0042936708607542624, "sim_render-ego1": 0.004372762303666012, "sim_render-ego2": 0.004455478860377074, "sim_render-ego3": 0.0044139892632121544, "get_duckie_state": 1.9883434540226894e-06, "in-drivable-lane": 1.1999999999999886, "deviation-heading": 11.909416689255572, "agent_compute-ego0": 0.01265458004560002, "agent_compute-ego1": 0.01357430284168202, "agent_compute-ego2": 0.012943507630461756, "agent_compute-ego3": 0.01263751396033091, "complete-iteration": 0.7615731038419928, "set_robot_commands": 0.0024433360310220204, "deviation-center-line": 2.8700193812802564, "driven_lanedir_consec": 12.028819150422938, "sim_compute_sim_state": 0.04655727240366304, "sim_compute_performance-ego0": 0.002496616131657863, "sim_compute_performance-ego1": 0.0022743147279102537, "sim_compute_performance-ego2": 0.0023180979872424834, "sim_compute_performance-ego3": 0.002277597003336453}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 13.08244984908215, "get_ui_image": 0.0332816907935274, "step_physics": 0.20965059419024856, "survival_time": 59.79999999999874, "driven_lanedir": 12.64016487002798, "get_state_dump": 0.006613391184667397, "get_robot_state": 0.007723593174066758, "sim_render-ego0": 0.0040952278956235605, "sim_render-ego1": 0.004197808833747679, "get_duckie_state": 1.6504063044574326e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.823345842066242, "agent_compute-ego0": 0.012101759189551536, "agent_compute-ego1": 0.013603949208207795, "complete-iteration": 0.31115600877537164, "set_robot_commands": 0.0024421549679940206, "deviation-center-line": 2.940878034606406, "driven_lanedir_consec": 12.64016487002798, "sim_compute_sim_state": 0.010699498025994552, "sim_compute_performance-ego0": 0.002120696412789991, "sim_compute_performance-ego1": 0.0021022748429275298}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 11.25345750240458, "get_ui_image": 0.0332816907935274, "step_physics": 0.20965059419024856, "survival_time": 59.79999999999874, "driven_lanedir": 11.04019728525973, "get_state_dump": 0.006613391184667397, "get_robot_state": 0.007723593174066758, "sim_render-ego0": 0.0040952278956235605, "sim_render-ego1": 0.004197808833747679, "get_duckie_state": 1.6504063044574326e-06, "in-drivable-lane": 0.7999999999999545, "deviation-heading": 9.224040842370997, "agent_compute-ego0": 0.012101759189551536, "agent_compute-ego1": 0.013603949208207795, "complete-iteration": 0.31115600877537164, "set_robot_commands": 0.0024421549679940206, "deviation-center-line": 2.0403934786483973, "driven_lanedir_consec": 11.04019728525973, "sim_compute_sim_state": 0.010699498025994552, "sim_compute_performance-ego0": 0.002120696412789991, "sim_compute_performance-ego1": 0.0021022748429275298}}
set_robot_commands_max0.0024433360310220204
set_robot_commands_mean0.002419093979328201
set_robot_commands_median0.002418304065383543
set_robot_commands_min0.0023841113472461302
sim_compute_performance-ego0_max0.002496616131657863
sim_compute_performance-ego0_mean0.002310194338511973
sim_compute_performance-ego0_median0.002351885731273845
sim_compute_performance-ego0_min0.002120696412789991
sim_compute_performance-ego1_max0.0022743147279102537
sim_compute_performance-ego1_mean0.0021654550030987016
sim_compute_performance-ego1_median0.0021622482684133053
sim_compute_performance-ego1_min0.002091392093058133
sim_compute_sim_state_max0.05218466513361363
sim_compute_sim_state_mean0.03749790352135485
sim_compute_sim_state_median0.04655727240366304
sim_compute_sim_state_min0.010699498025994552
sim_render-ego0_max0.0042936708607542624
sim_render-ego0_mean0.004207073430462971
sim_render-ego0_median0.004245964315511305
sim_render-ego0_min0.0040952278956235605
sim_render-ego1_max0.004372762303666012
sim_render-ego1_mean0.004260912781694478
sim_render-ego1_median0.004260746267415602
sim_render-ego1_min0.004180781747975219
simulation-passed1
step_physics_max0.6351948385929486
step_physics_mean0.5276506219450541
step_physics_median0.5551639452862005
step_physics_min0.20965059419024856
survival_time_max59.99999999999873
survival_time_mean59.971428571427296
survival_time_min59.79999999999874
No reset possible
58888LFVmultibodyv-simsuccessyes1:56:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58886LFVmultibodyv-simsuccessyes1:48:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible