Duckietown Challenges Home Challenges Submissions

Submission 12821

Submission12821
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserYishu Malhotra 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 58915
Next
User labelsim-exercise-2
Admin priority50
Blessingn/a
User priority50

58915

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
58915LFVmultibodyv-simsuccessyes1:53:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.6648730896757975
survival_time_median59.99999999999873
deviation-center-line_median3.6816988727117295
in-drivable-lane_median1.500000000000021


other stats
agent_compute-ego0_max0.013217503581813332
agent_compute-ego0_mean0.012910015061480956
agent_compute-ego0_median0.013093328844957688
agent_compute-ego0_min0.012550156082737754
agent_compute-ego1_max0.012292263410569826
agent_compute-ego1_mean0.012057601606256598
agent_compute-ego1_median0.01211688818284415
agent_compute-ego1_min0.011613335679559147
complete-iteration_max1.2186243513587829
complete-iteration_mean0.9184464920954402
complete-iteration_median0.9601668628625926
complete-iteration_min0.3444407389444463
deviation-center-line_max6.8061229905690235
deviation-center-line_mean3.110531870478269
deviation-center-line_min0.2510014367118118
deviation-heading_max39.01692473854389
deviation-heading_mean16.139698368186536
deviation-heading_median18.21737519777684
deviation-heading_min1.2658548814446504
driven_any_max12.351797067857383
driven_any_mean7.351132437128406
driven_any_median9.618527146297836
driven_any_min1.136076090962484
driven_lanedir_consec_max11.357718902528466
driven_lanedir_consec_mean6.02700627074329
driven_lanedir_consec_min0.8729610777237207
driven_lanedir_max11.357718902528466
driven_lanedir_mean6.263360875920654
driven_lanedir_median7.301254164226468
driven_lanedir_min0.8729610777237207
get_duckie_state_max2.3248292921385497e-06
get_duckie_state_mean2.1872917450407815e-06
get_duckie_state_median2.224693396741321e-06
get_duckie_state_min1.865274765912224e-06
get_robot_state_max0.015042151340735544
get_robot_state_mean0.013687952828866643
get_robot_state_median0.014730796871365706
get_robot_state_min0.007057458162307739
get_state_dump_max0.00989291471406681
get_state_dump_mean0.00923065781899862
get_state_dump_median0.00975284900320878
get_state_dump_min0.006124994334052591
get_ui_image_max0.04877636950776341
get_ui_image_mean0.04465781376289441
get_ui_image_median0.047931837605077035
get_ui_image_min0.03012990951538086
in-drivable-lane_max52.29999999999873
in-drivable-lane_mean10.289285714285423
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 12.351797067857383, "get_ui_image": 0.04452918629959958, "step_physics": 0.6836385101601047, "survival_time": 59.99999999999873, "driven_lanedir": 11.335588289683512, "get_state_dump": 0.00989291471406681, "get_robot_state": 0.015042151340735544, "sim_render-ego0": 0.004106724292015056, "sim_render-ego1": 0.004269505222075984, "sim_render-ego2": 0.004151814783939612, "sim_render-ego3": 0.004222044639047437, "get_duckie_state": 2.3248292921385497e-06, "in-drivable-lane": 1.2499999999999716, "deviation-heading": 17.604156196650386, "agent_compute-ego0": 0.013217503581813332, "agent_compute-ego1": 0.012292263410569826, "agent_compute-ego2": 0.0114152270689495, "agent_compute-ego3": 0.012116477848786696, "complete-iteration": 0.8635511386404426, "set_robot_commands": 0.0023384457523876385, "deviation-center-line": 3.5970818396405897, "driven_lanedir_consec": 11.335588289683512, "sim_compute_sim_state": 0.026253815594561192, "sim_compute_performance-ego0": 0.0022003741982973783, "sim_compute_performance-ego1": 0.002117216934470908, "sim_compute_performance-ego2": 0.0020856853329470314, "sim_compute_performance-ego3": 0.0021910607864417996}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 9.5712368940087, "get_ui_image": 0.04452918629959958, "step_physics": 0.6836385101601047, "survival_time": 59.99999999999873, "driven_lanedir": 6.012991586022755, "get_state_dump": 0.00989291471406681, "get_robot_state": 0.015042151340735544, "sim_render-ego0": 0.004106724292015056, "sim_render-ego1": 0.004269505222075984, "sim_render-ego2": 0.004151814783939612, "sim_render-ego3": 0.004222044639047437, "get_duckie_state": 2.3248292921385497e-06, "in-drivable-lane": 27.799999999998477, "deviation-heading": 8.989287504667587, "agent_compute-ego0": 0.013217503581813332, "agent_compute-ego1": 0.012292263410569826, "agent_compute-ego2": 0.0114152270689495, "agent_compute-ego3": 0.012116477848786696, "complete-iteration": 0.8635511386404426, "set_robot_commands": 0.0023384457523876385, "deviation-center-line": 2.047990081486739, "driven_lanedir_consec": 6.012991586022755, "sim_compute_sim_state": 0.026253815594561192, "sim_compute_performance-ego0": 0.0022003741982973783, "sim_compute_performance-ego1": 0.002117216934470908, "sim_compute_performance-ego2": 0.0020856853329470314, "sim_compute_performance-ego3": 0.0021910607864417996}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 2.322318618857918, "get_ui_image": 0.04452918629959958, "step_physics": 0.6836385101601047, "survival_time": 59.99999999999873, "driven_lanedir": 1.2299312115531742, "get_state_dump": 0.00989291471406681, "get_robot_state": 0.015042151340735544, "sim_render-ego0": 0.004106724292015056, "sim_render-ego1": 0.004269505222075984, "sim_render-ego2": 0.004151814783939612, "sim_render-ego3": 0.004222044639047437, "get_duckie_state": 2.3248292921385497e-06, "in-drivable-lane": 52.29999999999873, "deviation-heading": 3.4701205647526145, "agent_compute-ego0": 0.013217503581813332, "agent_compute-ego1": 0.012292263410569826, "agent_compute-ego2": 0.0114152270689495, "agent_compute-ego3": 0.012116477848786696, "complete-iteration": 0.8635511386404426, "set_robot_commands": 0.0023384457523876385, "deviation-center-line": 0.47120177924920104, "driven_lanedir_consec": 1.1937288881714148, "sim_compute_sim_state": 0.026253815594561192, "sim_compute_performance-ego0": 0.0022003741982973783, "sim_compute_performance-ego1": 0.002117216934470908, "sim_compute_performance-ego2": 0.0020856853329470314, "sim_compute_performance-ego3": 0.0021910607864417996}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 12.305599067824756, "get_ui_image": 0.04452918629959958, "step_physics": 0.6836385101601047, "survival_time": 59.99999999999873, "driven_lanedir": 10.913621102277109, "get_state_dump": 0.00989291471406681, "get_robot_state": 0.015042151340735544, "sim_render-ego0": 0.004106724292015056, "sim_render-ego1": 0.004269505222075984, "sim_render-ego2": 0.004151814783939612, "sim_render-ego3": 0.004222044639047437, "get_duckie_state": 2.3248292921385497e-06, "in-drivable-lane": 3.1999999999998323, "deviation-heading": 18.209846903577308, "agent_compute-ego0": 0.013217503581813332, "agent_compute-ego1": 0.012292263410569826, "agent_compute-ego2": 0.0114152270689495, "agent_compute-ego3": 0.012116477848786696, "complete-iteration": 0.8635511386404426, "set_robot_commands": 0.0023384457523876385, "deviation-center-line": 3.766315905782869, "driven_lanedir_consec": 10.913621102277109, "sim_compute_sim_state": 0.026253815594561192, "sim_compute_performance-ego0": 0.0022003741982973783, "sim_compute_performance-ego1": 0.002117216934470908, "sim_compute_performance-ego2": 0.0020856853329470314, "sim_compute_performance-ego3": 0.0021910607864417996}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 9.822913344445864, "get_ui_image": 0.04877636950776341, "step_physics": 0.7615132522424194, "survival_time": 59.99999999999873, "driven_lanedir": 8.816854699785235, "get_state_dump": 0.009599041482193286, "get_robot_state": 0.014606157607778125, "sim_render-ego0": 0.003921126247345657, "sim_render-ego1": 0.004091892313897659, "sim_render-ego2": 0.004065231121549201, "sim_render-ego3": 0.004085147509864724, "get_duckie_state": 2.1733610358067498e-06, "in-drivable-lane": 1.4500000000000206, "deviation-heading": 19.50811253170587, "agent_compute-ego0": 0.012550156082737754, "agent_compute-ego1": 0.01211688818284415, "agent_compute-ego2": 0.011949123689078174, "agent_compute-ego3": 0.011907571956180316, "complete-iteration": 0.9601668628625926, "set_robot_commands": 0.0022143513634242584, "deviation-center-line": 5.050346867220948, "driven_lanedir_consec": 8.816854699785235, "sim_compute_sim_state": 0.04342404591054543, "sim_compute_performance-ego0": 0.00217216040669234, "sim_compute_performance-ego1": 0.0020565732531900908, "sim_compute_performance-ego2": 0.002017536925634278, "sim_compute_performance-ego3": 0.0020334823840265966}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 12.173604186437672, "get_ui_image": 0.04877636950776341, "step_physics": 0.7615132522424194, "survival_time": 59.99999999999873, "driven_lanedir": 11.136626019070322, "get_state_dump": 0.009599041482193286, "get_robot_state": 0.014606157607778125, "sim_render-ego0": 0.003921126247345657, "sim_render-ego1": 0.004091892313897659, "sim_render-ego2": 0.004065231121549201, "sim_render-ego3": 0.004085147509864724, "get_duckie_state": 2.1733610358067498e-06, "in-drivable-lane": 0.8500000000000121, "deviation-heading": 18.50411865015321, "agent_compute-ego0": 0.012550156082737754, "agent_compute-ego1": 0.01211688818284415, "agent_compute-ego2": 0.011949123689078174, "agent_compute-ego3": 0.011907571956180316, "complete-iteration": 0.9601668628625926, "set_robot_commands": 0.0022143513634242584, "deviation-center-line": 4.164099044121296, "driven_lanedir_consec": 11.136626019070322, "sim_compute_sim_state": 0.04342404591054543, "sim_compute_performance-ego0": 0.00217216040669234, "sim_compute_performance-ego1": 0.0020565732531900908, "sim_compute_performance-ego2": 0.002017536925634278, "sim_compute_performance-ego3": 0.0020334823840265966}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 9.665817398586972, "get_ui_image": 0.04877636950776341, "step_physics": 0.7615132522424194, "survival_time": 59.99999999999873, "driven_lanedir": 8.589516742430181, "get_state_dump": 0.009599041482193286, "get_robot_state": 0.014606157607778125, "sim_render-ego0": 0.003921126247345657, "sim_render-ego1": 0.004091892313897659, "sim_render-ego2": 0.004065231121549201, "sim_render-ego3": 0.004085147509864724, "get_duckie_state": 2.1733610358067498e-06, "in-drivable-lane": 1.8000000000000256, "deviation-heading": 18.224903491976377, "agent_compute-ego0": 0.012550156082737754, "agent_compute-ego1": 0.01211688818284415, "agent_compute-ego2": 0.011949123689078174, "agent_compute-ego3": 0.011907571956180316, "complete-iteration": 0.9601668628625926, "set_robot_commands": 0.0022143513634242584, "deviation-center-line": 4.884249950271387, "driven_lanedir_consec": 5.31675459332884, "sim_compute_sim_state": 0.04342404591054543, "sim_compute_performance-ego0": 0.00217216040669234, "sim_compute_performance-ego1": 0.0020565732531900908, "sim_compute_performance-ego2": 0.002017536925634278, "sim_compute_performance-ego3": 0.0020334823840265966}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 12.329749097064765, "get_ui_image": 0.04877636950776341, "step_physics": 0.7615132522424194, "survival_time": 59.99999999999873, "driven_lanedir": 11.357718902528466, "get_state_dump": 0.009599041482193286, "get_robot_state": 0.014606157607778125, "sim_render-ego0": 0.003921126247345657, "sim_render-ego1": 0.004091892313897659, "sim_render-ego2": 0.004065231121549201, "sim_render-ego3": 0.004085147509864724, "get_duckie_state": 2.1733610358067498e-06, "in-drivable-lane": 0.0, "deviation-heading": 19.883107668912515, "agent_compute-ego0": 0.012550156082737754, "agent_compute-ego1": 0.01211688818284415, "agent_compute-ego2": 0.011949123689078174, "agent_compute-ego3": 0.011907571956180316, "complete-iteration": 0.9601668628625926, "set_robot_commands": 0.0022143513634242584, "deviation-center-line": 4.318611668162077, "driven_lanedir_consec": 11.357718902528466, "sim_compute_sim_state": 0.04342404591054543, "sim_compute_performance-ego0": 0.00217216040669234, "sim_compute_performance-ego1": 0.0020565732531900908, "sim_compute_performance-ego2": 0.002017536925634278, "sim_compute_performance-ego3": 0.0020334823840265966}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 11.762522832224445, "get_ui_image": 0.047931837605077035, "step_physics": 1.0407248646251517, "survival_time": 58.09999999999883, "driven_lanedir": 10.619110682781098, "get_state_dump": 0.00975284900320878, "get_robot_state": 0.014730796871365706, "sim_render-ego0": 0.003953353147104908, "sim_render-ego1": 0.004180357974865061, "sim_render-ego2": 0.004195296754123626, "sim_render-ego3": 0.004194923238516469, "get_duckie_state": 2.224693396741321e-06, "in-drivable-lane": 1.550000000000022, "deviation-heading": 18.541832009368303, "agent_compute-ego0": 0.013093328844957688, "agent_compute-ego1": 0.01198578618870454, "agent_compute-ego2": 0.012391619711012445, "agent_compute-ego3": 0.012395672211847937, "complete-iteration": 1.2186243513587829, "set_robot_commands": 0.002503518492419046, "deviation-center-line": 4.0621131742629855, "driven_lanedir_consec": 10.619110682781098, "sim_compute_sim_state": 0.020842211264940756, "sim_compute_performance-ego0": 0.0021537928773940687, "sim_compute_performance-ego1": 0.0020254459856710655, "sim_compute_performance-ego2": 0.002074039505149205, "sim_compute_performance-ego3": 0.002091030365213278}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.497603839592919, "get_ui_image": 0.047931837605077035, "step_physics": 1.0407248646251517, "survival_time": 58.09999999999883, "driven_lanedir": 1.328181155287271, "get_state_dump": 0.00975284900320878, "get_robot_state": 0.014730796871365706, "sim_render-ego0": 0.003953353147104908, "sim_render-ego1": 0.004180357974865061, "sim_render-ego2": 0.004195296754123626, "sim_render-ego3": 0.004194923238516469, "get_duckie_state": 2.224693396741321e-06, "in-drivable-lane": 51.99999999999885, "deviation-heading": 1.2658548814446504, "agent_compute-ego0": 0.013093328844957688, "agent_compute-ego1": 0.01198578618870454, "agent_compute-ego2": 0.012391619711012445, "agent_compute-ego3": 0.012395672211847937, "complete-iteration": 1.2186243513587829, "set_robot_commands": 0.002503518492419046, "deviation-center-line": 0.33780465998057935, "driven_lanedir_consec": 1.328181155287271, "sim_compute_sim_state": 0.020842211264940756, "sim_compute_performance-ego0": 0.0021537928773940687, "sim_compute_performance-ego1": 0.0020254459856710655, "sim_compute_performance-ego2": 0.002074039505149205, "sim_compute_performance-ego3": 0.002091030365213278}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 2.479472907816198, "get_ui_image": 0.047931837605077035, "step_physics": 1.0407248646251517, "survival_time": 58.09999999999883, "driven_lanedir": 2.353874814365641, "get_state_dump": 0.00975284900320878, "get_robot_state": 0.014730796871365706, "sim_render-ego0": 0.003953353147104908, "sim_render-ego1": 0.004180357974865061, "sim_render-ego2": 0.004195296754123626, "sim_render-ego3": 0.004194923238516469, "get_duckie_state": 2.224693396741321e-06, "in-drivable-lane": 0.0, "deviation-heading": 39.01692473854389, "agent_compute-ego0": 0.013093328844957688, "agent_compute-ego1": 0.01198578618870454, "agent_compute-ego2": 0.012391619711012445, "agent_compute-ego3": 0.012395672211847937, "complete-iteration": 1.2186243513587829, "set_robot_commands": 0.002503518492419046, "deviation-center-line": 6.8061229905690235, "driven_lanedir_consec": 2.353874814365641, "sim_compute_sim_state": 0.020842211264940756, "sim_compute_performance-ego0": 0.0021537928773940687, "sim_compute_performance-ego1": 0.0020254459856710655, "sim_compute_performance-ego2": 0.002074039505149205, "sim_compute_performance-ego3": 0.002091030365213278}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 2.2728734678524107, "get_ui_image": 0.047931837605077035, "step_physics": 1.0407248646251517, "survival_time": 58.09999999999883, "driven_lanedir": 2.0836125546021647, "get_state_dump": 0.00975284900320878, "get_robot_state": 0.014730796871365706, "sim_render-ego0": 0.003953353147104908, "sim_render-ego1": 0.004180357974865061, "sim_render-ego2": 0.004195296754123626, "sim_render-ego3": 0.004194923238516469, "get_duckie_state": 2.224693396741321e-06, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 38.93044223749277, "agent_compute-ego0": 0.013093328844957688, "agent_compute-ego1": 0.01198578618870454, "agent_compute-ego2": 0.012391619711012445, "agent_compute-ego3": 0.012395672211847937, "complete-iteration": 1.2186243513587829, "set_robot_commands": 0.002503518492419046, "deviation-center-line": 3.3756183588465603, "driven_lanedir_consec": 2.0836125546021647, "sim_compute_sim_state": 0.020842211264940756, "sim_compute_performance-ego0": 0.0021537928773940687, "sim_compute_performance-ego1": 0.0020254459856710655, "sim_compute_performance-ego2": 0.002074039505149205, "sim_compute_performance-ego3": 0.002091030365213278}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.224269306265181, "get_ui_image": 0.03012990951538086, "step_physics": 0.25194814801216125, "survival_time": 6.749999999999984, "driven_lanedir": 0.8729610777237207, "get_state_dump": 0.006124994334052591, "get_robot_state": 0.007057458162307739, "sim_render-ego0": 0.003660957602893605, "sim_render-ego1": 0.003922153921688304, "get_duckie_state": 1.865274765912224e-06, "in-drivable-lane": 1.649999999999994, "deviation-heading": 1.6420912560159036, "agent_compute-ego0": 0.012648128411349128, "agent_compute-ego1": 0.011613335679559147, "complete-iteration": 0.3444407389444463, "set_robot_commands": 0.002161863972158993, "deviation-center-line": 0.2510014367118118, "driven_lanedir_consec": 0.8729610777237207, "sim_compute_sim_state": 0.008993057643665987, "sim_compute_performance-ego0": 0.0018437890445484831, "sim_compute_performance-ego1": 0.00193175147561466}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.136076090962484, "get_ui_image": 0.03012990951538086, "step_physics": 0.25194814801216125, "survival_time": 6.749999999999984, "driven_lanedir": 1.0364634247785138, "get_state_dump": 0.006124994334052591, "get_robot_state": 0.007057458162307739, "sim_render-ego0": 0.003660957602893605, "sim_render-ego1": 0.003922153921688304, "get_duckie_state": 1.865274765912224e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.164978519350116, "agent_compute-ego0": 0.012648128411349128, "agent_compute-ego1": 0.011613335679559147, "complete-iteration": 0.3444407389444463, "set_robot_commands": 0.002161863972158993, "deviation-center-line": 0.4148884303897118, "driven_lanedir_consec": 1.0364634247785138, "sim_compute_sim_state": 0.008993057643665987, "sim_compute_performance-ego0": 0.0018437890445484831, "sim_compute_performance-ego1": 0.00193175147561466}}
set_robot_commands_max0.002503518492419046
set_robot_commands_mean0.002324927884088697
set_robot_commands_median0.0023384457523876385
set_robot_commands_min0.002161863972158993
sim_compute_performance-ego0_max0.0022003741982973783
sim_compute_performance-ego0_mean0.002128063429902294
sim_compute_performance-ego0_median0.00217216040669234
sim_compute_performance-ego0_min0.0018437890445484831
sim_compute_performance-ego1_max0.002117216934470908
sim_compute_performance-ego1_mean0.0020471748317541128
sim_compute_performance-ego1_median0.0020565732531900908
sim_compute_performance-ego1_min0.00193175147561466
sim_compute_sim_state_max0.04342404591054543
sim_compute_sim_state_mean0.02714760045482296
sim_compute_sim_state_median0.026253815594561192
sim_compute_sim_state_min0.008993057643665987
sim_render-ego0_max0.004106724292015056
sim_render-ego0_mean0.003946194996546406
sim_render-ego0_median0.003953353147104908
sim_render-ego0_min0.003660957602893605
sim_render-ego1_max0.004269505222075984
sim_render-ego1_mean0.004143666420480816
sim_render-ego1_median0.004180357974865061
sim_render-ego1_min0.003922153921688304
simulation-passed1
step_physics_max1.0407248646251517
step_physics_mean0.7462430574382161
step_physics_median0.7615132522424194
step_physics_min0.25194814801216125
survival_time_max59.99999999999873
survival_time_mean51.84999999999894
survival_time_min6.749999999999984
No reset possible