Duckietown Challenges Home Challenges Submissions

Submission 12819

Submission12819
Competingyes
Challengeaido5-LFVI_multi-sim-validation
UserYishu Malhotra 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVIv-sim: 58966
Next
User labelsim-exercise-2
Admin priority50
Blessingn/a
User priority50

58966

Click the images to see detailed statistics about the episode.

LFVI_multi-norm-4way-000

LFVI_multi-norm-udem1-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
58966LFVIv-simsuccessyes0:53:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1319556601064265
survival_time_median38.27499999999991
deviation-center-line_median2.1238497867270243
in-drivable-lane_median0.6750000000000038


other stats
agent_compute-ego0_max0.012097907376988315
agent_compute-ego0_mean0.012046411182389314
agent_compute-ego0_median0.012046411182389314
agent_compute-ego0_min0.011994914987790312
agent_compute-ego1_max0.012733730579745651
agent_compute-ego1_mean0.012724558030123704
agent_compute-ego1_median0.012724558030123704
agent_compute-ego1_min0.012715385480501752
agent_compute-ego2_max0.01293103547360299
agent_compute-ego2_mean0.012789028852156875
agent_compute-ego2_median0.012789028852156875
agent_compute-ego2_min0.012647022230710766
agent_compute-ego3_max0.012892913352394723
agent_compute-ego3_mean0.012659645885314569
agent_compute-ego3_median0.012659645885314569
agent_compute-ego3_min0.012426378418234407
complete-iteration_max1.3271485085845385
complete-iteration_mean1.2012834593729786
complete-iteration_median1.2012834593729786
complete-iteration_min1.075418410161419
deviation-center-line_max3.256269871906936
deviation-center-line_mean1.861261327897684
deviation-center-line_min0.1067536284185742
deviation-heading_max21.08025338240988
deviation-heading_mean11.542861954394567
deviation-heading_median11.772909396450578
deviation-heading_min1.4214901187034708
driven_any_max9.711725003802396
driven_any_mean3.9864237401083447
driven_any_median3.750986342819481
driven_any_min1.0201125238962585
driven_lanedir_consec_max7.826365953627754
driven_lanedir_consec_mean3.265623460465599
driven_lanedir_consec_min0.5598897446900288
driven_lanedir_max8.978766292987487
driven_lanedir_mean3.540078826928334
driven_lanedir_median3.383124747011506
driven_lanedir_min0.5598897446900288
get_duckie_state_max1.625085940687908e-06
get_duckie_state_mean1.5775016036176968e-06
get_duckie_state_median1.5775016036176968e-06
get_duckie_state_min1.5299172665474858e-06
get_robot_state_max0.01485020758926674
get_robot_state_mean0.0147030357520025
get_robot_state_median0.0147030357520025
get_robot_state_min0.01455586391473826
get_state_dump_max0.009744455837659803
get_state_dump_mean0.00967307229293762
get_state_dump_median0.00967307229293762
get_state_dump_min0.009601688748215436
get_ui_image_max0.05327916999593232
get_ui_image_mean0.053035717784688935
get_ui_image_median0.053035717784688935
get_ui_image_min0.05279226557344555
in-drivable-lane_max42.049999999999535
in-drivable-lane_mean5.931249999999946
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 4.872337679914978, "get_ui_image": 0.05327916999593232, "step_physics": 0.8776032287833745, "survival_time": 30.6500000000003, "driven_lanedir": 4.431568618911275, "get_state_dump": 0.009744455837659803, "get_robot_state": 0.01455586391473826, "sim_render-ego0": 0.004009875878448983, "sim_render-ego1": 0.004232567374015088, "sim_render-ego2": 0.004119810141647289, "sim_render-ego3": 0.0040554476094944855, "get_duckie_state": 1.5299172665474858e-06, "in-drivable-lane": 0.70000000000001, "deviation-heading": 14.01003101547331, "agent_compute-ego0": 0.012097907376988315, "agent_compute-ego1": 0.012715385480501752, "agent_compute-ego2": 0.01293103547360299, "agent_compute-ego3": 0.012892913352394723, "complete-iteration": 1.075418410161419, "set_robot_commands": 0.0022558319452142873, "deviation-center-line": 2.315411225448387, "driven_lanedir_consec": 3.931596952493432, "sim_compute_sim_state": 0.035409488584785584, "sim_compute_performance-ego0": 0.0021251762340433822, "sim_compute_performance-ego1": 0.002051556537516342, "sim_compute_performance-ego2": 0.002044242445731396, "sim_compute_performance-ego3": 0.0020628810317197916}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 1.745894547026457, "get_ui_image": 0.05327916999593232, "step_physics": 0.8776032287833745, "survival_time": 30.6500000000003, "driven_lanedir": 1.4865340204964046, "get_state_dump": 0.009744455837659803, "get_robot_state": 0.01455586391473826, "sim_render-ego0": 0.004009875878448983, "sim_render-ego1": 0.004232567374015088, "sim_render-ego2": 0.004119810141647289, "sim_render-ego3": 0.0040554476094944855, "get_duckie_state": 1.5299172665474858e-06, "in-drivable-lane": 0.25000000000000355, "deviation-heading": 13.74619180711901, "agent_compute-ego0": 0.012097907376988315, "agent_compute-ego1": 0.012715385480501752, "agent_compute-ego2": 0.01293103547360299, "agent_compute-ego3": 0.012892913352394723, "complete-iteration": 1.075418410161419, "set_robot_commands": 0.0022558319452142873, "deviation-center-line": 3.139060618524531, "driven_lanedir_consec": 1.3818942016184177, "sim_compute_sim_state": 0.035409488584785584, "sim_compute_performance-ego0": 0.0021251762340433822, "sim_compute_performance-ego1": 0.002051556537516342, "sim_compute_performance-ego2": 0.002044242445731396, "sim_compute_performance-ego3": 0.0020628810317197916}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 4.902676709578541, "get_ui_image": 0.05327916999593232, "step_physics": 0.8776032287833745, "survival_time": 30.6500000000003, "driven_lanedir": 4.501181014105132, "get_state_dump": 0.009744455837659803, "get_robot_state": 0.01455586391473826, "sim_render-ego0": 0.004009875878448983, "sim_render-ego1": 0.004232567374015088, "sim_render-ego2": 0.004119810141647289, "sim_render-ego3": 0.0040554476094944855, "get_duckie_state": 1.5299172665474858e-06, "in-drivable-lane": 0.350000000000005, "deviation-heading": 8.241387656849348, "agent_compute-ego0": 0.012097907376988315, "agent_compute-ego1": 0.012715385480501752, "agent_compute-ego2": 0.01293103547360299, "agent_compute-ego3": 0.012892913352394723, "complete-iteration": 1.075418410161419, "set_robot_commands": 0.0022558319452142873, "deviation-center-line": 2.3473379049724805, "driven_lanedir_consec": 4.312521985658179, "sim_compute_sim_state": 0.035409488584785584, "sim_compute_performance-ego0": 0.0021251762340433822, "sim_compute_performance-ego1": 0.002051556537516342, "sim_compute_performance-ego2": 0.002044242445731396, "sim_compute_performance-ego3": 0.0020628810317197916}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 5.918041559689872, "get_ui_image": 0.05327916999593232, "step_physics": 0.8776032287833745, "survival_time": 30.6500000000003, "driven_lanedir": 4.969521433300612, "get_state_dump": 0.009744455837659803, "get_robot_state": 0.01455586391473826, "sim_render-ego0": 0.004009875878448983, "sim_render-ego1": 0.004232567374015088, "sim_render-ego2": 0.004119810141647289, "sim_render-ego3": 0.0040554476094944855, "get_duckie_state": 1.5299172665474858e-06, "in-drivable-lane": 2.600000000000037, "deviation-heading": 10.29772286170038, "agent_compute-ego0": 0.012097907376988315, "agent_compute-ego1": 0.012715385480501752, "agent_compute-ego2": 0.01293103547360299, "agent_compute-ego3": 0.012892913352394723, "complete-iteration": 1.075418410161419, "set_robot_commands": 0.0022558319452142873, "deviation-center-line": 1.9322883480056616, "driven_lanedir_consec": 4.7377676662726405, "sim_compute_sim_state": 0.035409488584785584, "sim_compute_performance-ego0": 0.0021251762340433822, "sim_compute_performance-ego1": 0.002051556537516342, "sim_compute_performance-ego2": 0.002044242445731396, "sim_compute_performance-ego3": 0.0020628810317197916}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 2.6296350057239843, "get_ui_image": 0.05279226557344555, "step_physics": 1.1468031683995492, "survival_time": 45.89999999999953, "driven_lanedir": 2.3346808751117374, "get_state_dump": 0.009601688748215436, "get_robot_state": 0.01485020758926674, "sim_render-ego0": 0.0040068460366930875, "sim_render-ego1": 0.0041901948532419965, "sim_render-ego2": 0.004161180168292987, "sim_render-ego3": 0.00411544946124686, "get_duckie_state": 1.625085940687908e-06, "in-drivable-lane": 0.6499999999999977, "deviation-heading": 10.587102469416942, "agent_compute-ego0": 0.011994914987790312, "agent_compute-ego1": 0.012733730579745651, "agent_compute-ego2": 0.012647022230710766, "agent_compute-ego3": 0.012426378418234407, "complete-iteration": 1.3271485085845385, "set_robot_commands": 0.002511960507995805, "deviation-center-line": 1.2213982487271475, "driven_lanedir_consec": 2.332314367719422, "sim_compute_sim_state": 0.0182947834894888, "sim_compute_performance-ego0": 0.0021172903307892944, "sim_compute_performance-ego1": 0.0021008132461365213, "sim_compute_performance-ego2": 0.0020766655171656893, "sim_compute_performance-ego3": 0.0021012252251393646}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 9.711725003802396, "get_ui_image": 0.05279226557344555, "step_physics": 1.1468031683995492, "survival_time": 45.89999999999953, "driven_lanedir": 8.978766292987487, "get_state_dump": 0.009601688748215436, "get_robot_state": 0.01485020758926674, "sim_render-ego0": 0.0040068460366930875, "sim_render-ego1": 0.0041901948532419965, "sim_render-ego2": 0.004161180168292987, "sim_render-ego3": 0.00411544946124686, "get_duckie_state": 1.625085940687908e-06, "in-drivable-lane": 0.8499999999999819, "deviation-heading": 12.958716323484213, "agent_compute-ego0": 0.011994914987790312, "agent_compute-ego1": 0.012733730579745651, "agent_compute-ego2": 0.012647022230710766, "agent_compute-ego3": 0.012426378418234407, "complete-iteration": 1.3271485085845385, "set_robot_commands": 0.002511960507995805, "deviation-center-line": 3.256269871906936, "driven_lanedir_consec": 7.826365953627754, "sim_compute_sim_state": 0.0182947834894888, "sim_compute_performance-ego0": 0.0021172903307892944, "sim_compute_performance-ego1": 0.0021008132461365213, "sim_compute_performance-ego2": 0.0020766655171656893, "sim_compute_performance-ego3": 0.0021012252251393646}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 1.0201125238962585, "get_ui_image": 0.05279226557344555, "step_physics": 1.1468031683995492, "survival_time": 45.89999999999953, "driven_lanedir": 0.5598897446900288, "get_state_dump": 0.009601688748215436, "get_robot_state": 0.01485020758926674, "sim_render-ego0": 0.0040068460366930875, "sim_render-ego1": 0.0041901948532419965, "sim_render-ego2": 0.004161180168292987, "sim_render-ego3": 0.00411544946124686, "get_duckie_state": 1.625085940687908e-06, "in-drivable-lane": 42.049999999999535, "deviation-heading": 1.4214901187034708, "agent_compute-ego0": 0.011994914987790312, "agent_compute-ego1": 0.012733730579745651, "agent_compute-ego2": 0.012647022230710766, "agent_compute-ego3": 0.012426378418234407, "complete-iteration": 1.3271485085845385, "set_robot_commands": 0.002511960507995805, "deviation-center-line": 0.1067536284185742, "driven_lanedir_consec": 0.5598897446900288, "sim_compute_sim_state": 0.0182947834894888, "sim_compute_performance-ego0": 0.0021172903307892944, "sim_compute_performance-ego1": 0.0021008132461365213, "sim_compute_performance-ego2": 0.0020766655171656893, "sim_compute_performance-ego3": 0.0021012252251393646}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.0909668912342725, "get_ui_image": 0.05279226557344555, "step_physics": 1.1468031683995492, "survival_time": 45.89999999999953, "driven_lanedir": 1.058488615823999, "get_state_dump": 0.009601688748215436, "get_robot_state": 0.01485020758926674, "sim_render-ego0": 0.0040068460366930875, "sim_render-ego1": 0.0041901948532419965, "sim_render-ego2": 0.004161180168292987, "sim_render-ego3": 0.00411544946124686, "get_duckie_state": 1.625085940687908e-06, "in-drivable-lane": 0.0, "deviation-heading": 21.08025338240988, "agent_compute-ego0": 0.011994914987790312, "agent_compute-ego1": 0.012733730579745651, "agent_compute-ego2": 0.012647022230710766, "agent_compute-ego3": 0.012426378418234407, "complete-iteration": 1.3271485085845385, "set_robot_commands": 0.002511960507995805, "deviation-center-line": 0.5715707771777548, "driven_lanedir_consec": 1.0426368116449198, "sim_compute_sim_state": 0.0182947834894888, "sim_compute_performance-ego0": 0.0021172903307892944, "sim_compute_performance-ego1": 0.0021008132461365213, "sim_compute_performance-ego2": 0.0020766655171656893, "sim_compute_performance-ego3": 0.0021012252251393646}}
set_robot_commands_max0.002511960507995805
set_robot_commands_mean0.0023838962266050463
set_robot_commands_median0.0023838962266050463
set_robot_commands_min0.0022558319452142873
sim_compute_performance-ego0_max0.0021251762340433822
sim_compute_performance-ego0_mean0.0021212332824163383
sim_compute_performance-ego0_median0.0021212332824163383
sim_compute_performance-ego0_min0.0021172903307892944
sim_compute_performance-ego1_max0.0021008132461365213
sim_compute_performance-ego1_mean0.0020761848918264317
sim_compute_performance-ego1_median0.0020761848918264317
sim_compute_performance-ego1_min0.002051556537516342
sim_compute_performance-ego2_max0.0020766655171656893
sim_compute_performance-ego2_mean0.0020604539814485425
sim_compute_performance-ego2_median0.0020604539814485425
sim_compute_performance-ego2_min0.002044242445731396
sim_compute_performance-ego3_max0.0021012252251393646
sim_compute_performance-ego3_mean0.002082053128429578
sim_compute_performance-ego3_median0.002082053128429578
sim_compute_performance-ego3_min0.0020628810317197916
sim_compute_sim_state_max0.035409488584785584
sim_compute_sim_state_mean0.026852136037137195
sim_compute_sim_state_median0.026852136037137195
sim_compute_sim_state_min0.0182947834894888
sim_render-ego0_max0.004009875878448983
sim_render-ego0_mean0.004008360957571035
sim_render-ego0_median0.004008360957571035
sim_render-ego0_min0.0040068460366930875
sim_render-ego1_max0.004232567374015088
sim_render-ego1_mean0.0042113811136285425
sim_render-ego1_median0.0042113811136285425
sim_render-ego1_min0.0041901948532419965
sim_render-ego2_max0.004161180168292987
sim_render-ego2_mean0.004140495154970138
sim_render-ego2_median0.004140495154970138
sim_render-ego2_min0.004119810141647289
sim_render-ego3_max0.00411544946124686
sim_render-ego3_mean0.004085448535370673
sim_render-ego3_median0.004085448535370673
sim_render-ego3_min0.0040554476094944855
simulation-passed1
step_physics_max1.1468031683995492
step_physics_mean1.012203198591462
step_physics_median1.012203198591462
step_physics_min0.8776032287833745
survival_time_max45.89999999999953
survival_time_mean38.27499999999991
survival_time_min30.6500000000003
No reset possible
58965LFVIv-simsuccessyes1:32:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58964LFVIv-simsuccessyes1:35:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58963LFVIv-simsuccessyes1:05:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58961LFVIv-simsuccessyes0:42:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58960LFVIv-simsuccessyes1:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58959LFVIv-simsuccessyes1:02:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible