Duckietown Challenges Home Challenges Submissions

Submission 13221

Submission13221
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserYury Belousov 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60422
Next
User labelJetBrains Research2 sim2real
Admin priority50
Blessingn/a
User priority50

60422

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
60422LFVmultibodyv-simsuccessyes1:06:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.060188037424887
survival_time_median20.05000000000015
deviation-center-line_median1.9717970762926984
in-drivable-lane_median1.300000000000003


other stats
agent_compute-ego0_max0.027174154189504453
agent_compute-ego0_mean0.022902203873604993
agent_compute-ego0_median0.02126848401121832
agent_compute-ego0_min0.021134392993228213
agent_compute-ego1_max0.026646660924652635
agent_compute-ego1_mean0.022480374243775175
agent_compute-ego1_median0.02092544297080728
agent_compute-ego1_min0.02062274100350552
agent_compute-ego2_max0.026724448708272994
agent_compute-ego2_mean0.02301287326112598
agent_compute-ego2_median0.021766900300263643
agent_compute-ego2_min0.02054727077484131
agent_compute-ego3_max0.02616140050356037
agent_compute-ego3_mean0.022392674348167208
agent_compute-ego3_median0.02124992648402492
agent_compute-ego3_min0.019766696056916347
complete-iteration_max1.2444911769202522
complete-iteration_mean1.0068615743227574
complete-iteration_median1.0794828809908967
complete-iteration_min0.3388484902069217
deviation-center-line_max6.031880874536202
deviation-center-line_mean2.7772056944635244
deviation-center-line_min0.9318348487774142
deviation-heading_max14.203288533927696
deviation-heading_mean6.0986895773769945
deviation-heading_median3.8063309951983486
deviation-heading_min1.3186029664766128
driven_any_max16.302007987518003
driven_any_mean6.4557661131028485
driven_any_median3.6091413404470014
driven_any_min0.7032781325259748
driven_lanedir_consec_max14.35624342589468
driven_lanedir_consec_mean5.515878455464284
driven_lanedir_consec_min0.5436773305758875
driven_lanedir_max14.35624342589468
driven_lanedir_mean5.585293282494042
driven_lanedir_median3.060188037424887
driven_lanedir_min0.5436773305758875
get_duckie_state_max1.4985287869656766e-06
get_duckie_state_mean1.4101541270089531e-06
get_duckie_state_median1.4035132008726451e-06
get_duckie_state_min1.3285015352922889e-06
get_robot_state_max0.01424248368890436
get_robot_state_mean0.013023622123329187
get_robot_state_median0.013986149993566153
get_robot_state_min0.007105914295696822
get_state_dump_max0.009590559893542225
get_state_dump_mean0.009042334500252202
get_state_dump_median0.009462135348153943
get_state_dump_min0.006320169714630627
get_ui_image_max0.05005592847247605
get_ui_image_mean0.04470257327011389
get_ui_image_median0.0477320181356894
get_ui_image_min0.029940699944730663
in-drivable-lane_max13.149999999999832
in-drivable-lane_mean3.042857142857124
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.9613094746678976, "get_ui_image": 0.04370070986486786, "step_physics": 0.8811319514886656, "survival_time": 20.05000000000015, "driven_lanedir": 0.9232976646322616, "get_state_dump": 0.009462135348153943, "get_robot_state": 0.01380108660133324, "sim_render-ego0": 0.003656838070693894, "sim_render-ego1": 0.003625195417831193, "sim_render-ego2": 0.003679655084562539, "sim_render-ego3": 0.003622829617552496, "get_duckie_state": 1.3285015352922889e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.021758722004149, "agent_compute-ego0": 0.02126848401121832, "agent_compute-ego1": 0.02092544297080728, "agent_compute-ego2": 0.02054727077484131, "agent_compute-ego3": 0.019766696056916347, "complete-iteration": 1.0794828809908967, "set_robot_commands": 0.0021226613675776997, "deviation-center-line": 2.694872395144472, "driven_lanedir_consec": 0.9232976646322616, "sim_compute_sim_state": 0.017450790500166406, "sim_compute_performance-ego0": 0.0018908093817791537, "sim_compute_performance-ego1": 0.0019723129509693353, "sim_compute_performance-ego2": 0.001955239926997702, "sim_compute_performance-ego3": 0.001954086977451002}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.100168978381658, "get_ui_image": 0.04370070986486786, "step_physics": 0.8811319514886656, "survival_time": 20.05000000000015, "driven_lanedir": 2.8252305394740223, "get_state_dump": 0.009462135348153943, "get_robot_state": 0.01380108660133324, "sim_render-ego0": 0.003656838070693894, "sim_render-ego1": 0.003625195417831193, "sim_render-ego2": 0.003679655084562539, "sim_render-ego3": 0.003622829617552496, "get_duckie_state": 1.3285015352922889e-06, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 3.5909032683925486, "agent_compute-ego0": 0.02126848401121832, "agent_compute-ego1": 0.02092544297080728, "agent_compute-ego2": 0.02054727077484131, "agent_compute-ego3": 0.019766696056916347, "complete-iteration": 1.0794828809908967, "set_robot_commands": 0.0021226613675776997, "deviation-center-line": 2.7450517832152133, "driven_lanedir_consec": 2.8252305394740223, "sim_compute_sim_state": 0.017450790500166406, "sim_compute_performance-ego0": 0.0018908093817791537, "sim_compute_performance-ego1": 0.0019723129509693353, "sim_compute_performance-ego2": 0.001955239926997702, "sim_compute_performance-ego3": 0.001954086977451002}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.144849723840246, "get_ui_image": 0.04370070986486786, "step_physics": 0.8811319514886656, "survival_time": 20.05000000000015, "driven_lanedir": 1.1077505897144322, "get_state_dump": 0.009462135348153943, "get_robot_state": 0.01380108660133324, "sim_render-ego0": 0.003656838070693894, "sim_render-ego1": 0.003625195417831193, "sim_render-ego2": 0.003679655084562539, "sim_render-ego3": 0.003622829617552496, "get_duckie_state": 1.3285015352922889e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.062597020100278, "agent_compute-ego0": 0.02126848401121832, "agent_compute-ego1": 0.02092544297080728, "agent_compute-ego2": 0.02054727077484131, "agent_compute-ego3": 0.019766696056916347, "complete-iteration": 1.0794828809908967, "set_robot_commands": 0.0021226613675776997, "deviation-center-line": 1.0720234541372635, "driven_lanedir_consec": 1.1077505897144322, "sim_compute_sim_state": 0.017450790500166406, "sim_compute_performance-ego0": 0.0018908093817791537, "sim_compute_performance-ego1": 0.0019723129509693353, "sim_compute_performance-ego2": 0.001955239926997702, "sim_compute_performance-ego3": 0.001954086977451002}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 6.465036600578314, "get_ui_image": 0.04370070986486786, "step_physics": 0.8811319514886656, "survival_time": 20.05000000000015, "driven_lanedir": 5.97833382549196, "get_state_dump": 0.009462135348153943, "get_robot_state": 0.01380108660133324, "sim_render-ego0": 0.003656838070693894, "sim_render-ego1": 0.003625195417831193, "sim_render-ego2": 0.003679655084562539, "sim_render-ego3": 0.003622829617552496, "get_duckie_state": 1.3285015352922889e-06, "in-drivable-lane": 1.500000000000005, "deviation-heading": 2.821087076496758, "agent_compute-ego0": 0.02126848401121832, "agent_compute-ego1": 0.02092544297080728, "agent_compute-ego2": 0.02054727077484131, "agent_compute-ego3": 0.019766696056916347, "complete-iteration": 1.0794828809908967, "set_robot_commands": 0.0021226613675776997, "deviation-center-line": 1.4639565629041025, "driven_lanedir_consec": 5.97833382549196, "sim_compute_sim_state": 0.017450790500166406, "sim_compute_performance-ego0": 0.0018908093817791537, "sim_compute_performance-ego1": 0.0019723129509693353, "sim_compute_performance-ego2": 0.001955239926997702, "sim_compute_performance-ego3": 0.001954086977451002}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 15.522741006218968, "get_ui_image": 0.05005592847247605, "step_physics": 0.7707352922123537, "survival_time": 59.99999999999873, "driven_lanedir": 13.58682399730127, "get_state_dump": 0.009435390651871224, "get_robot_state": 0.013986149993566153, "sim_render-ego0": 0.003722082069771773, "sim_render-ego1": 0.003692522533330989, "sim_render-ego2": 0.0036695910730925726, "sim_render-ego3": 0.003687910592923256, "get_duckie_state": 1.4035132008726451e-06, "in-drivable-lane": 6.200000000000014, "deviation-heading": 14.203288533927696, "agent_compute-ego0": 0.027174154189504453, "agent_compute-ego1": 0.026646660924652635, "agent_compute-ego2": 0.026724448708272994, "agent_compute-ego3": 0.02616140050356037, "complete-iteration": 1.03061720711504, "set_robot_commands": 0.0021123159537208168, "deviation-center-line": 5.948660267325567, "driven_lanedir_consec": 13.58682399730127, "sim_compute_sim_state": 0.04845817321345371, "sim_compute_performance-ego0": 0.001957564032345787, "sim_compute_performance-ego1": 0.0019271598072671376, "sim_compute_performance-ego2": 0.0019151227460316477, "sim_compute_performance-ego3": 0.0019299579004165431}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 15.893913928889097, "get_ui_image": 0.05005592847247605, "step_physics": 0.7707352922123537, "survival_time": 59.99999999999873, "driven_lanedir": 13.943854397368, "get_state_dump": 0.009435390651871224, "get_robot_state": 0.013986149993566153, "sim_render-ego0": 0.003722082069771773, "sim_render-ego1": 0.003692522533330989, "sim_render-ego2": 0.0036695910730925726, "sim_render-ego3": 0.003687910592923256, "get_duckie_state": 1.4035132008726451e-06, "in-drivable-lane": 5.999999999999916, "deviation-heading": 14.062978285382243, "agent_compute-ego0": 0.027174154189504453, "agent_compute-ego1": 0.026646660924652635, "agent_compute-ego2": 0.026724448708272994, "agent_compute-ego3": 0.02616140050356037, "complete-iteration": 1.03061720711504, "set_robot_commands": 0.0021123159537208168, "deviation-center-line": 5.530402096479917, "driven_lanedir_consec": 13.943854397368, "sim_compute_sim_state": 0.04845817321345371, "sim_compute_performance-ego0": 0.001957564032345787, "sim_compute_performance-ego1": 0.0019271598072671376, "sim_compute_performance-ego2": 0.0019151227460316477, "sim_compute_performance-ego3": 0.0019299579004165431}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 16.302007987518003, "get_ui_image": 0.05005592847247605, "step_physics": 0.7707352922123537, "survival_time": 59.99999999999873, "driven_lanedir": 14.35624342589468, "get_state_dump": 0.009435390651871224, "get_robot_state": 0.013986149993566153, "sim_render-ego0": 0.003722082069771773, "sim_render-ego1": 0.003692522533330989, "sim_render-ego2": 0.0036695910730925726, "sim_render-ego3": 0.003687910592923256, "get_duckie_state": 1.4035132008726451e-06, "in-drivable-lane": 6.899999999999925, "deviation-heading": 12.601139054040749, "agent_compute-ego0": 0.027174154189504453, "agent_compute-ego1": 0.026646660924652635, "agent_compute-ego2": 0.026724448708272994, "agent_compute-ego3": 0.02616140050356037, "complete-iteration": 1.03061720711504, "set_robot_commands": 0.0021123159537208168, "deviation-center-line": 6.031880874536202, "driven_lanedir_consec": 14.35624342589468, "sim_compute_sim_state": 0.04845817321345371, "sim_compute_performance-ego0": 0.001957564032345787, "sim_compute_performance-ego1": 0.0019271598072671376, "sim_compute_performance-ego2": 0.0019151227460316477, "sim_compute_performance-ego3": 0.0019299579004165431}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 15.552590764961844, "get_ui_image": 0.05005592847247605, "step_physics": 0.7707352922123537, "survival_time": 59.99999999999873, "driven_lanedir": 12.193300113737296, "get_state_dump": 0.009435390651871224, "get_robot_state": 0.013986149993566153, "sim_render-ego0": 0.003722082069771773, "sim_render-ego1": 0.003692522533330989, "sim_render-ego2": 0.0036695910730925726, "sim_render-ego3": 0.003687910592923256, "get_duckie_state": 1.4035132008726451e-06, "in-drivable-lane": 13.149999999999832, "deviation-heading": 13.055067408820976, "agent_compute-ego0": 0.027174154189504453, "agent_compute-ego1": 0.026646660924652635, "agent_compute-ego2": 0.026724448708272994, "agent_compute-ego3": 0.02616140050356037, "complete-iteration": 1.03061720711504, "set_robot_commands": 0.0021123159537208168, "deviation-center-line": 4.576077335554707, "driven_lanedir_consec": 11.23943895438529, "sim_compute_sim_state": 0.04845817321345371, "sim_compute_performance-ego0": 0.001957564032345787, "sim_compute_performance-ego1": 0.0019271598072671376, "sim_compute_performance-ego2": 0.0019151227460316477, "sim_compute_performance-ego3": 0.0019299579004165431}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.7998148112219143, "get_ui_image": 0.0477320181356894, "step_physics": 1.033508436815875, "survival_time": 16.6000000000001, "driven_lanedir": 0.777412829889192, "get_state_dump": 0.009590559893542225, "get_robot_state": 0.01424248368890436, "sim_render-ego0": 0.0038044782014222474, "sim_render-ego1": 0.0037278950035393057, "sim_render-ego2": 0.0036956476377653287, "sim_render-ego3": 0.003767929993592225, "get_duckie_state": 1.4985287869656766e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.3186029664766128, "agent_compute-ego0": 0.021134392993228213, "agent_compute-ego1": 0.020797835456000432, "agent_compute-ego2": 0.021766900300263643, "agent_compute-ego3": 0.02124992648402492, "complete-iteration": 1.2444911769202522, "set_robot_commands": 0.002249063314260305, "deviation-center-line": 1.9942316365673616, "driven_lanedir_consec": 0.777412829889192, "sim_compute_sim_state": 0.022125035076885968, "sim_compute_performance-ego0": 0.0020289063095688463, "sim_compute_performance-ego1": 0.001987454411503789, "sim_compute_performance-ego2": 0.001951393064435896, "sim_compute_performance-ego3": 0.0020548388048693225}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.618900698537464, "get_ui_image": 0.0477320181356894, "step_physics": 1.033508436815875, "survival_time": 16.6000000000001, "driven_lanedir": 2.717893460361194, "get_state_dump": 0.009590559893542225, "get_robot_state": 0.01424248368890436, "sim_render-ego0": 0.0038044782014222474, "sim_render-ego1": 0.0037278950035393057, "sim_render-ego2": 0.0036956476377653287, "sim_render-ego3": 0.003767929993592225, "get_duckie_state": 1.4985287869656766e-06, "in-drivable-lane": 3.700000000000044, "deviation-heading": 6.058073697421199, "agent_compute-ego0": 0.021134392993228213, "agent_compute-ego1": 0.020797835456000432, "agent_compute-ego2": 0.021766900300263643, "agent_compute-ego3": 0.02124992648402492, "complete-iteration": 1.2444911769202522, "set_robot_commands": 0.002249063314260305, "deviation-center-line": 1.2394505347743598, "driven_lanedir_consec": 2.699947041296583, "sim_compute_sim_state": 0.022125035076885968, "sim_compute_performance-ego0": 0.0020289063095688463, "sim_compute_performance-ego1": 0.001987454411503789, "sim_compute_performance-ego2": 0.001951393064435896, "sim_compute_performance-ego3": 0.0020548388048693225}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.7032781325259748, "get_ui_image": 0.0477320181356894, "step_physics": 1.033508436815875, "survival_time": 16.6000000000001, "driven_lanedir": 0.5436773305758875, "get_state_dump": 0.009590559893542225, "get_robot_state": 0.01424248368890436, "sim_render-ego0": 0.0038044782014222474, "sim_render-ego1": 0.0037278950035393057, "sim_render-ego2": 0.0036956476377653287, "sim_render-ego3": 0.003767929993592225, "get_duckie_state": 1.4985287869656766e-06, "in-drivable-lane": 0.6500000000000005, "deviation-heading": 1.7385881882769407, "agent_compute-ego0": 0.021134392993228213, "agent_compute-ego1": 0.020797835456000432, "agent_compute-ego2": 0.021766900300263643, "agent_compute-ego3": 0.02124992648402492, "complete-iteration": 1.2444911769202522, "set_robot_commands": 0.002249063314260305, "deviation-center-line": 1.9493625160180343, "driven_lanedir_consec": 0.5436773305758875, "sim_compute_sim_state": 0.022125035076885968, "sim_compute_performance-ego0": 0.0020289063095688463, "sim_compute_performance-ego1": 0.001987454411503789, "sim_compute_performance-ego2": 0.001951393064435896, "sim_compute_performance-ego3": 0.0020548388048693225}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 3.5993819823565385, "get_ui_image": 0.0477320181356894, "step_physics": 1.033508436815875, "survival_time": 16.6000000000001, "driven_lanedir": 3.2951455353757515, "get_state_dump": 0.009590559893542225, "get_robot_state": 0.01424248368890436, "sim_render-ego0": 0.0038044782014222474, "sim_render-ego1": 0.0037278950035393057, "sim_render-ego2": 0.0036956476377653287, "sim_render-ego3": 0.003767929993592225, "get_duckie_state": 1.4985287869656766e-06, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 2.3249076086587066, "agent_compute-ego0": 0.021134392993228213, "agent_compute-ego1": 0.020797835456000432, "agent_compute-ego2": 0.021766900300263643, "agent_compute-ego3": 0.02124992648402492, "complete-iteration": 1.2444911769202522, "set_robot_commands": 0.002249063314260305, "deviation-center-line": 1.4583158653917767, "driven_lanedir_consec": 3.2951455353757515, "sim_compute_sim_state": 0.022125035076885968, "sim_compute_performance-ego0": 0.0020289063095688463, "sim_compute_performance-ego1": 0.001987454411503789, "sim_compute_performance-ego2": 0.001951393064435896, "sim_compute_performance-ego3": 0.0020548388048693225}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 3.749315765719876, "get_ui_image": 0.029940699944730663, "step_physics": 0.22810263418760457, "survival_time": 12.150000000000038, "driven_lanedir": 3.418498485873827, "get_state_dump": 0.006320169714630627, "get_robot_state": 0.007105914295696822, "sim_render-ego0": 0.0037400058058441664, "sim_render-ego1": 0.003640253035748591, "get_duckie_state": 1.4099918428014536e-06, "in-drivable-lane": 1.1000000000000003, "deviation-heading": 1.8567180985949112, "agent_compute-ego0": 0.021161364727332942, "agent_compute-ego1": 0.02062274100350552, "complete-iteration": 0.3388484902069217, "set_robot_commands": 0.0021835213801899896, "deviation-center-line": 1.2447595516629395, "driven_lanedir_consec": 3.418498485873827, "sim_compute_sim_state": 0.009865717809708392, "sim_compute_performance-ego0": 0.0019214290087340307, "sim_compute_performance-ego1": 0.0019013393120687516}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 2.9674157280220825, "get_ui_image": 0.029940699944730663, "step_physics": 0.22810263418760457, "survival_time": 12.150000000000038, "driven_lanedir": 2.5266437592268245, "get_state_dump": 0.006320169714630627, "get_robot_state": 0.007105914295696822, "sim_render-ego0": 0.0037400058058441664, "sim_render-ego1": 0.003640253035748591, "get_duckie_state": 1.4099918428014536e-06, "in-drivable-lane": 1.6000000000000036, "deviation-heading": 2.665944154684152, "agent_compute-ego0": 0.021161364727332942, "agent_compute-ego1": 0.02062274100350552, "complete-iteration": 0.3388484902069217, "set_robot_commands": 0.0021835213801899896, "deviation-center-line": 0.9318348487774142, "driven_lanedir_consec": 2.5266437592268245, "sim_compute_sim_state": 0.009865717809708392, "sim_compute_performance-ego0": 0.0019214290087340307, "sim_compute_performance-ego1": 0.0019013393120687516}}
set_robot_commands_max0.002249063314260305
set_robot_commands_mean0.0021645146644725184
set_robot_commands_median0.0021226613675776997
set_robot_commands_min0.0021123159537208168
sim_compute_performance-ego0_max0.0020289063095688463
sim_compute_performance-ego0_mean0.001953712636588801
sim_compute_performance-ego0_median0.001957564032345787
sim_compute_performance-ego0_min0.0018908093817791537
sim_compute_performance-ego1_max0.001987454411503789
sim_compute_performance-ego1_mean0.001953599093078468
sim_compute_performance-ego1_median0.0019723129509693353
sim_compute_performance-ego1_min0.0019013393120687516
sim_compute_performance-ego2_max0.001955239926997702
sim_compute_performance-ego2_mean0.001940585245821749
sim_compute_performance-ego2_median0.001951393064435896
sim_compute_performance-ego2_min0.0019151227460316477
sim_compute_performance-ego3_max0.0020548388048693225
sim_compute_performance-ego3_mean0.0019796278942456227
sim_compute_performance-ego3_median0.001954086977451002
sim_compute_performance-ego3_min0.0019299579004165431
sim_compute_sim_state_max0.04845817321345371
sim_compute_sim_state_mean0.026561959341531504
sim_compute_sim_state_median0.022125035076885968
sim_compute_sim_state_min0.009865717809708392
sim_render-ego0_max0.0038044782014222474
sim_render-ego0_mean0.003729543212802856
sim_render-ego0_median0.003722082069771773
sim_render-ego0_min0.003656838070693894
sim_render-ego1_max0.0037278950035393057
sim_render-ego1_mean0.00367592556359308
sim_render-ego1_median0.003692522533330989
sim_render-ego1_min0.003625195417831193
sim_render-ego2_max0.0036956476377653287
sim_render-ego2_mean0.003681631265140147
sim_render-ego2_median0.003679655084562539
sim_render-ego2_min0.0036695910730925726
sim_render-ego3_max0.003767929993592225
sim_render-ego3_mean0.003692890068022659
sim_render-ego3_median0.003687910592923256
sim_render-ego3_min0.003622829617552496
simulation-passed1
step_physics_max1.033508436815875
step_physics_mean0.7998362850316276
step_physics_median0.8811319514886656
step_physics_min0.22810263418760457
survival_time_max59.99999999999873
survival_time_mean29.349999999999707
survival_time_min12.150000000000038
No reset possible