Duckietown Challenges Home Challenges Submissions

Submission 12848

Submission12848
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserRaphael Jean
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 58890
Next
User labelexercise_state_estimation
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
58890LFVmultibodyv-simsuccessyes1:53:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.793491061002037
survival_time_median59.99999999999873
deviation-center-line_median2.832891030800841
in-drivable-lane_median0.39999999999997726


other stats
agent_compute-ego0_max0.01265458004560002
agent_compute-ego0_mean0.012482446222335446
agent_compute-ego0_median0.012562019441844425
agent_compute-ego0_min0.012101759189551536
agent_compute-ego1_max0.013603949208207795
agent_compute-ego1_mean0.013428983425016937
agent_compute-ego1_median0.013394974153504383
agent_compute-ego1_min0.013230190388268972
complete-iteration_max0.8536739325543228
complete-iteration_mean0.7167808244573194
complete-iteration_median0.7615731038419928
complete-iteration_min0.31115600877537164
deviation-center-line_max3.2219619150488223
deviation-center-line_mean2.6841379364849316
deviation-center-line_min1.470900002173385
deviation-heading_max14.0581177238736
deviation-heading_mean11.292188999663583
deviation-heading_median11.570473009987378
deviation-heading_min6.734227259330157
driven_any_max13.15675454546058
driven_any_mean11.976233511566637
driven_any_median12.317259903620512
driven_any_min9.605020699484449
driven_lanedir_consec_max12.67169577979376
driven_lanedir_consec_mean11.49087961772119
driven_lanedir_consec_min9.189551847815316
driven_lanedir_max12.67169577979376
driven_lanedir_mean11.49087961772119
driven_lanedir_median11.793491061002037
driven_lanedir_min9.189551847815316
get_duckie_state_max1.9883434540226894e-06
get_duckie_state_mean1.8633825459082016e-06
get_duckie_state_median1.8706230398618016e-06
get_duckie_state_min1.6504063044574326e-06
get_robot_state_max0.015876032728438176
get_robot_state_mean0.014423203391496149
get_robot_state_median0.015609581206462268
get_robot_state_min0.007723593174066758
get_state_dump_max0.010372359786402873
get_state_dump_mean0.0096878273271955
get_state_dump_median0.010327658387246875
get_state_dump_min0.006613391184667397
get_ui_image_max0.05320540097829801
get_ui_image_mean0.04661870970133549
get_ui_image_median0.04835869847090417
get_ui_image_min0.0332816907935274
in-drivable-lane_max17.999999999998977
in-drivable-lane_mean2.107142857142744
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 9.605020699484449, "get_ui_image": 0.04496053910870834, "step_physics": 0.5551639452862005, "survival_time": 59.99999999999873, "driven_lanedir": 9.189551847815316, "get_state_dump": 0.009900681879200804, "get_robot_state": 0.015133801348302684, "sim_render-ego0": 0.004137507882543051, "sim_render-ego1": 0.004180781747975219, "sim_render-ego2": 0.004254054268829828, "sim_render-ego3": 0.004309099977161366, "get_duckie_state": 1.8376692645654988e-06, "in-drivable-lane": 17.999999999998977, "deviation-heading": 6.734227259330157, "agent_compute-ego0": 0.012421082695953852, "agent_compute-ego1": 0.013230190388268972, "agent_compute-ego2": 0.012418467833735762, "agent_compute-ego3": 0.012357788419445587, "complete-iteration": 0.7379078448166161, "set_robot_commands": 0.002418304065383543, "deviation-center-line": 1.470900002173385, "driven_lanedir_consec": 9.189551847815316, "sim_compute_sim_state": 0.027150975774468032, "sim_compute_performance-ego0": 0.0021768301154652006, "sim_compute_performance-ego1": 0.002091392093058133, "sim_compute_performance-ego2": 0.0021085463197503262, "sim_compute_performance-ego3": 0.00212197200543279}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 12.729893485875111, "get_ui_image": 0.04496053910870834, "step_physics": 0.5551639452862005, "survival_time": 59.99999999999873, "driven_lanedir": 12.391834096800164, "get_state_dump": 0.009900681879200804, "get_robot_state": 0.015133801348302684, "sim_render-ego0": 0.004137507882543051, "sim_render-ego1": 0.004180781747975219, "sim_render-ego2": 0.004254054268829828, "sim_render-ego3": 0.004309099977161366, "get_duckie_state": 1.8376692645654988e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.0335919919765, "agent_compute-ego0": 0.012421082695953852, "agent_compute-ego1": 0.013230190388268972, "agent_compute-ego2": 0.012418467833735762, "agent_compute-ego3": 0.012357788419445587, "complete-iteration": 0.7379078448166161, "set_robot_commands": 0.002418304065383543, "deviation-center-line": 2.5491723741911403, "driven_lanedir_consec": 12.391834096800164, "sim_compute_sim_state": 0.027150975774468032, "sim_compute_performance-ego0": 0.0021768301154652006, "sim_compute_performance-ego1": 0.002091392093058133, "sim_compute_performance-ego2": 0.0021085463197503262, "sim_compute_performance-ego3": 0.00212197200543279}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 13.15675454546058, "get_ui_image": 0.04496053910870834, "step_physics": 0.5551639452862005, "survival_time": 59.99999999999873, "driven_lanedir": 12.67169577979376, "get_state_dump": 0.009900681879200804, "get_robot_state": 0.015133801348302684, "sim_render-ego0": 0.004137507882543051, "sim_render-ego1": 0.004180781747975219, "sim_render-ego2": 0.004254054268829828, "sim_render-ego3": 0.004309099977161366, "get_duckie_state": 1.8376692645654988e-06, "in-drivable-lane": 1.6499999999999062, "deviation-heading": 9.667137337377063, "agent_compute-ego0": 0.012421082695953852, "agent_compute-ego1": 0.013230190388268972, "agent_compute-ego2": 0.012418467833735762, "agent_compute-ego3": 0.012357788419445587, "complete-iteration": 0.7379078448166161, "set_robot_commands": 0.002418304065383543, "deviation-center-line": 2.1142253492938843, "driven_lanedir_consec": 12.67169577979376, "sim_compute_sim_state": 0.027150975774468032, "sim_compute_performance-ego0": 0.0021768301154652006, "sim_compute_performance-ego1": 0.002091392093058133, "sim_compute_performance-ego2": 0.0021085463197503262, "sim_compute_performance-ego3": 0.00212197200543279}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 10.066989486085204, "get_ui_image": 0.04496053910870834, "step_physics": 0.5551639452862005, "survival_time": 59.99999999999873, "driven_lanedir": 9.79623364235938, "get_state_dump": 0.009900681879200804, "get_robot_state": 0.015133801348302684, "sim_render-ego0": 0.004137507882543051, "sim_render-ego1": 0.004180781747975219, "sim_render-ego2": 0.004254054268829828, "sim_render-ego3": 0.004309099977161366, "get_duckie_state": 1.8376692645654988e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.935090231739808, "agent_compute-ego0": 0.012421082695953852, "agent_compute-ego1": 0.013230190388268972, "agent_compute-ego2": 0.012418467833735762, "agent_compute-ego3": 0.012357788419445587, "complete-iteration": 0.7379078448166161, "set_robot_commands": 0.002418304065383543, "deviation-center-line": 2.791749835640689, "driven_lanedir_consec": 9.79623364235938, "sim_compute_sim_state": 0.027150975774468032, "sim_compute_performance-ego0": 0.0021768301154652006, "sim_compute_performance-ego1": 0.002091392093058133, "sim_compute_performance-ego2": 0.0021085463197503262, "sim_compute_performance-ego3": 0.00212197200543279}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 11.761823474414404, "get_ui_image": 0.05320540097829801, "step_physics": 0.6351948385929486, "survival_time": 59.99999999999873, "driven_lanedir": 11.404529564159846, "get_state_dump": 0.010372359786402873, "get_robot_state": 0.015609581206462268, "sim_render-ego0": 0.004245964315511305, "sim_render-ego1": 0.004260746267415602, "sim_render-ego2": 0.0043643799352209136, "sim_render-ego3": 0.004316865752678331, "get_duckie_state": 1.8706230398618016e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.900609269709186, "agent_compute-ego0": 0.012562019441844425, "agent_compute-ego1": 0.013394974153504383, "agent_compute-ego2": 0.012887336133818742, "agent_compute-ego3": 0.012452240689013225, "complete-iteration": 0.8536739325543228, "set_robot_commands": 0.0023841113472461302, "deviation-center-line": 2.901641841880598, "driven_lanedir_consec": 11.404529564159846, "sim_compute_sim_state": 0.05218466513361363, "sim_compute_performance-ego0": 0.002351885731273845, "sim_compute_performance-ego1": 0.0021622482684133053, "sim_compute_performance-ego2": 0.002175770036187597, "sim_compute_performance-ego3": 0.0021725407647252776}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 12.358442570695937, "get_ui_image": 0.05320540097829801, "step_physics": 0.6351948385929486, "survival_time": 59.99999999999873, "driven_lanedir": 11.883958952039952, "get_state_dump": 0.010372359786402873, "get_robot_state": 0.015609581206462268, "sim_render-ego0": 0.004245964315511305, "sim_render-ego1": 0.004260746267415602, "sim_render-ego2": 0.0043643799352209136, "sim_render-ego3": 0.004316865752678331, "get_duckie_state": 1.8706230398618016e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.843112176195133, "agent_compute-ego0": 0.012562019441844425, "agent_compute-ego1": 0.013394974153504383, "agent_compute-ego2": 0.012887336133818742, "agent_compute-ego3": 0.012452240689013225, "complete-iteration": 0.8536739325543228, "set_robot_commands": 0.0023841113472461302, "deviation-center-line": 3.045032350778056, "driven_lanedir_consec": 11.883958952039952, "sim_compute_sim_state": 0.05218466513361363, "sim_compute_performance-ego0": 0.002351885731273845, "sim_compute_performance-ego1": 0.0021622482684133053, "sim_compute_performance-ego2": 0.002175770036187597, "sim_compute_performance-ego3": 0.0021725407647252776}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 11.758261731301484, "get_ui_image": 0.05320540097829801, "step_physics": 0.6351948385929486, "survival_time": 59.99999999999873, "driven_lanedir": 11.053653688726538, "get_state_dump": 0.010372359786402873, "get_robot_state": 0.015609581206462268, "sim_render-ego0": 0.004245964315511305, "sim_render-ego1": 0.004260746267415602, "sim_render-ego2": 0.0043643799352209136, "sim_render-ego3": 0.004316865752678331, "get_duckie_state": 1.8706230398618016e-06, "in-drivable-lane": 1.54999999999995, "deviation-heading": 14.0581177238736, "agent_compute-ego0": 0.012562019441844425, "agent_compute-ego1": 0.013394974153504383, "agent_compute-ego2": 0.012887336133818742, "agent_compute-ego3": 0.012452240689013225, "complete-iteration": 0.8536739325543228, "set_robot_commands": 0.0023841113472461302, "deviation-center-line": 3.1799253068445967, "driven_lanedir_consec": 11.053653688726538, "sim_compute_sim_state": 0.05218466513361363, "sim_compute_performance-ego0": 0.002351885731273845, "sim_compute_performance-ego1": 0.0021622482684133053, "sim_compute_performance-ego2": 0.002175770036187597, "sim_compute_performance-ego3": 0.0021725407647252776}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 12.124884855342724, "get_ui_image": 0.05320540097829801, "step_physics": 0.6351948385929486, "survival_time": 59.99999999999873, "driven_lanedir": 11.70302316996412, "get_state_dump": 0.010372359786402873, "get_robot_state": 0.015609581206462268, "sim_render-ego0": 0.004245964315511305, "sim_render-ego1": 0.004260746267415602, "sim_render-ego2": 0.0043643799352209136, "sim_render-ego3": 0.004316865752678331, "get_duckie_state": 1.8706230398618016e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.30770068006252, "agent_compute-ego0": 0.012562019441844425, "agent_compute-ego1": 0.013394974153504383, "agent_compute-ego2": 0.012887336133818742, "agent_compute-ego3": 0.012452240689013225, "complete-iteration": 0.8536739325543228, "set_robot_commands": 0.0023841113472461302, "deviation-center-line": 3.0233654414533175, "driven_lanedir_consec": 11.70302316996412, "sim_compute_sim_state": 0.05218466513361363, "sim_compute_performance-ego0": 0.002351885731273845, "sim_compute_performance-ego1": 0.0021622482684133053, "sim_compute_performance-ego2": 0.002175770036187597, "sim_compute_performance-ego3": 0.0021725407647252776}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 12.292330237289017, "get_ui_image": 0.04835869847090417, "step_physics": 0.5515930958334155, "survival_time": 59.99999999999873, "driven_lanedir": 10.92939381711261, "get_state_dump": 0.010327658387246875, "get_robot_state": 0.015876032728438176, "sim_render-ego0": 0.0042936708607542624, "sim_render-ego1": 0.004372762303666012, "sim_render-ego2": 0.004455478860377074, "sim_render-ego3": 0.0044139892632121544, "get_duckie_state": 1.9883434540226894e-06, "in-drivable-lane": 5.499999999999687, "deviation-heading": 11.240336750265568, "agent_compute-ego0": 0.01265458004560002, "agent_compute-ego1": 0.01357430284168202, "agent_compute-ego2": 0.012943507630461756, "agent_compute-ego3": 0.01263751396033091, "complete-iteration": 0.7615731038419928, "set_robot_commands": 0.0024433360310220204, "deviation-center-line": 2.6329031186280676, "driven_lanedir_consec": 10.92939381711261, "sim_compute_sim_state": 0.04655727240366304, "sim_compute_performance-ego0": 0.002496616131657863, "sim_compute_performance-ego1": 0.0022743147279102537, "sim_compute_performance-ego2": 0.0023180979872424834, "sim_compute_performance-ego3": 0.002277597003336453}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 12.555697899878016, "get_ui_image": 0.04835869847090417, "step_physics": 0.5515930958334155, "survival_time": 59.99999999999873, "driven_lanedir": 12.079467342239806, "get_state_dump": 0.010327658387246875, "get_robot_state": 0.015876032728438176, "sim_render-ego0": 0.0042936708607542624, "sim_render-ego1": 0.004372762303666012, "sim_render-ego2": 0.004455478860377074, "sim_render-ego3": 0.0044139892632121544, "get_duckie_state": 1.9883434540226894e-06, "in-drivable-lane": 0.7999999999999545, "deviation-heading": 11.933219922184197, "agent_compute-ego0": 0.01265458004560002, "agent_compute-ego1": 0.01357430284168202, "agent_compute-ego2": 0.012943507630461756, "agent_compute-ego3": 0.01263751396033091, "complete-iteration": 0.7615731038419928, "set_robot_commands": 0.0024433360310220204, "deviation-center-line": 3.2219619150488223, "driven_lanedir_consec": 12.079467342239806, "sim_compute_sim_state": 0.04655727240366304, "sim_compute_performance-ego0": 0.002496616131657863, "sim_compute_performance-ego1": 0.0022743147279102537, "sim_compute_performance-ego2": 0.0023180979872424834, "sim_compute_performance-ego3": 0.002277597003336453}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 12.34218956995201, "get_ui_image": 0.04835869847090417, "step_physics": 0.5515930958334155, "survival_time": 59.99999999999873, "driven_lanedir": 12.059791441374523, "get_state_dump": 0.010327658387246875, "get_robot_state": 0.015876032728438176, "sim_render-ego0": 0.0042936708607542624, "sim_render-ego1": 0.004372762303666012, "sim_render-ego2": 0.004455478860377074, "sim_render-ego3": 0.0044139892632121544, "get_duckie_state": 1.9883434540226894e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.480699278883648, "agent_compute-ego0": 0.01265458004560002, "agent_compute-ego1": 0.01357430284168202, "agent_compute-ego2": 0.012943507630461756, "agent_compute-ego3": 0.01263751396033091, "complete-iteration": 0.7615731038419928, "set_robot_commands": 0.0024433360310220204, "deviation-center-line": 2.7957626803214253, "driven_lanedir_consec": 12.059791441374523, "sim_compute_sim_state": 0.04655727240366304, "sim_compute_performance-ego0": 0.002496616131657863, "sim_compute_performance-ego1": 0.0022743147279102537, "sim_compute_performance-ego2": 0.0023180979872424834, "sim_compute_performance-ego3": 0.002277597003336453}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 12.579073254667296, "get_ui_image": 0.04835869847090417, "step_physics": 0.5515930958334155, "survival_time": 59.99999999999873, "driven_lanedir": 12.028819150422938, "get_state_dump": 0.010327658387246875, "get_robot_state": 0.015876032728438176, "sim_render-ego0": 0.0042936708607542624, "sim_render-ego1": 0.004372762303666012, "sim_render-ego2": 0.004455478860377074, "sim_render-ego3": 0.0044139892632121544, "get_duckie_state": 1.9883434540226894e-06, "in-drivable-lane": 1.1999999999999886, "deviation-heading": 11.909416689255572, "agent_compute-ego0": 0.01265458004560002, "agent_compute-ego1": 0.01357430284168202, "agent_compute-ego2": 0.012943507630461756, "agent_compute-ego3": 0.01263751396033091, "complete-iteration": 0.7615731038419928, "set_robot_commands": 0.0024433360310220204, "deviation-center-line": 2.8700193812802564, "driven_lanedir_consec": 12.028819150422938, "sim_compute_sim_state": 0.04655727240366304, "sim_compute_performance-ego0": 0.002496616131657863, "sim_compute_performance-ego1": 0.0022743147279102537, "sim_compute_performance-ego2": 0.0023180979872424834, "sim_compute_performance-ego3": 0.002277597003336453}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 13.08244984908215, "get_ui_image": 0.0332816907935274, "step_physics": 0.20965059419024856, "survival_time": 59.79999999999874, "driven_lanedir": 12.64016487002798, "get_state_dump": 0.006613391184667397, "get_robot_state": 0.007723593174066758, "sim_render-ego0": 0.0040952278956235605, "sim_render-ego1": 0.004197808833747679, "get_duckie_state": 1.6504063044574326e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.823345842066242, "agent_compute-ego0": 0.012101759189551536, "agent_compute-ego1": 0.013603949208207795, "complete-iteration": 0.31115600877537164, "set_robot_commands": 0.0024421549679940206, "deviation-center-line": 2.940878034606406, "driven_lanedir_consec": 12.64016487002798, "sim_compute_sim_state": 0.010699498025994552, "sim_compute_performance-ego0": 0.002120696412789991, "sim_compute_performance-ego1": 0.0021022748429275298}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 11.25345750240458, "get_ui_image": 0.0332816907935274, "step_physics": 0.20965059419024856, "survival_time": 59.79999999999874, "driven_lanedir": 11.04019728525973, "get_state_dump": 0.006613391184667397, "get_robot_state": 0.007723593174066758, "sim_render-ego0": 0.0040952278956235605, "sim_render-ego1": 0.004197808833747679, "get_duckie_state": 1.6504063044574326e-06, "in-drivable-lane": 0.7999999999999545, "deviation-heading": 9.224040842370997, "agent_compute-ego0": 0.012101759189551536, "agent_compute-ego1": 0.013603949208207795, "complete-iteration": 0.31115600877537164, "set_robot_commands": 0.0024421549679940206, "deviation-center-line": 2.0403934786483973, "driven_lanedir_consec": 11.04019728525973, "sim_compute_sim_state": 0.010699498025994552, "sim_compute_performance-ego0": 0.002120696412789991, "sim_compute_performance-ego1": 0.0021022748429275298}}
set_robot_commands_max0.0024433360310220204
set_robot_commands_mean0.002419093979328201
set_robot_commands_median0.002418304065383543
set_robot_commands_min0.0023841113472461302
sim_compute_performance-ego0_max0.002496616131657863
sim_compute_performance-ego0_mean0.002310194338511973
sim_compute_performance-ego0_median0.002351885731273845
sim_compute_performance-ego0_min0.002120696412789991
sim_compute_performance-ego1_max0.0022743147279102537
sim_compute_performance-ego1_mean0.0021654550030987016
sim_compute_performance-ego1_median0.0021622482684133053
sim_compute_performance-ego1_min0.002091392093058133
sim_compute_sim_state_max0.05218466513361363
sim_compute_sim_state_mean0.03749790352135485
sim_compute_sim_state_median0.04655727240366304
sim_compute_sim_state_min0.010699498025994552
sim_render-ego0_max0.0042936708607542624
sim_render-ego0_mean0.004207073430462971
sim_render-ego0_median0.004245964315511305
sim_render-ego0_min0.0040952278956235605
sim_render-ego1_max0.004372762303666012
sim_render-ego1_mean0.004260912781694478
sim_render-ego1_median0.004260746267415602
sim_render-ego1_min0.004180781747975219
simulation-passed1
step_physics_max0.6351948385929486
step_physics_mean0.5276506219450541
step_physics_median0.5551639452862005
step_physics_min0.20965059419024856
survival_time_max59.99999999999873
survival_time_mean59.971428571427296
survival_time_min59.79999999999874
No reset possible
58888LFVmultibodyv-simsuccessyes1:56:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58886LFVmultibodyv-simsuccessyes1:48:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible