Duckietown Challenges Home Challenges Submissions

Submission 12712

Submission12712
Competingyes
Challengeaido5-LFVI_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVIv-sim: 53608
Next
User labelbaseline-behavior-cloning
Admin priority50
Blessingn/a
User priority50

53608

Click the images to see detailed statistics about the episode.

LFVI_multi-norm-4way-000

LFVI_multi-norm-udem1-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53608LFVIv-simsuccessyes1:23:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.001862950425226
survival_time_median59.99999999999873
deviation-center-line_median2.8250653723789654
in-drivable-lane_median0.24999999999998845


other stats
agent_compute-ego0_max0.033910900627345864
agent_compute-ego0_mean0.03325135017017043
agent_compute-ego0_median0.03325135017017043
agent_compute-ego0_min0.03259179971299501
agent_compute-ego1_max0.03362199646745693
agent_compute-ego1_mean0.03274526375715778
agent_compute-ego1_median0.03274526375715778
agent_compute-ego1_min0.031868531046858634
agent_compute-ego2_max0.03343223632126426
agent_compute-ego2_mean0.032644821245604805
agent_compute-ego2_median0.032644821245604805
agent_compute-ego2_min0.031857406169945354
agent_compute-ego3_max0.03282807689225247
agent_compute-ego3_mean0.032344622477008145
agent_compute-ego3_median0.032344622477008145
agent_compute-ego3_min0.03186116806176382
complete-iteration_max1.1315312343870572
complete-iteration_mean1.1226635435836498
complete-iteration_median1.1226635435836498
complete-iteration_min1.1137958527802427
deviation-center-line_max6.953126488911857
deviation-center-line_mean3.9800467478416106
deviation-center-line_min1.995252279550883
deviation-heading_max41.46245700705427
deviation-heading_mean21.776382167376397
deviation-heading_median14.873179467855088
deviation-heading_min9.057332406441803
driven_any_max14.590346671601536
driven_any_mean7.930683341165914
driven_any_median8.415175253319164
driven_any_min0.491555568886973
driven_lanedir_consec_max14.289296906523838
driven_lanedir_consec_mean7.6142481301488125
driven_lanedir_consec_min0.4710403014268969
driven_lanedir_max14.289296906523838
driven_lanedir_mean7.6380822941817375
driven_lanedir_median8.00186552823373
driven_lanedir_min0.4710403014268969
get_duckie_state_max1.2165104519020609e-06
get_duckie_state_mean1.1971550718334494e-06
get_duckie_state_median1.1971550718334494e-06
get_duckie_state_min1.177799691764838e-06
get_robot_state_max0.013753088586634144
get_robot_state_mean0.013634717236152796
get_robot_state_median0.013634717236152796
get_robot_state_min0.013516345885671443
get_state_dump_max0.009249896629962395
get_state_dump_mean0.009147911643505494
get_state_dump_median0.009147911643505494
get_state_dump_min0.00904592665704859
get_ui_image_max0.05246790362635222
get_ui_image_mean0.0521051582944681
get_ui_image_median0.0521051582944681
get_ui_image_min0.05174241296258397
in-drivable-lane_max1.4499999999999948
in-drivable-lane_mean0.44999999999999385
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 14.590274564005348, "get_ui_image": 0.05246790362635222, "step_physics": 0.8536377828583729, "survival_time": 59.99999999999873, "driven_lanedir": 14.28710329263761, "get_state_dump": 0.009249896629962395, "get_robot_state": 0.013753088586634144, "sim_render-ego0": 0.003602781462530411, "sim_render-ego1": 0.0035503605422528956, "sim_render-ego2": 0.0035643188482915034, "sim_render-ego3": 0.0035358281258639447, "get_duckie_state": 1.2165104519020609e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.621844223088113, "agent_compute-ego0": 0.03259179971299501, "agent_compute-ego1": 0.031868531046858634, "agent_compute-ego2": 0.031857406169945354, "agent_compute-ego3": 0.03186116806176382, "complete-iteration": 1.1137958527802427, "set_robot_commands": 0.002173376321594086, "deviation-center-line": 2.868592428738889, "driven_lanedir_consec": 14.28710329263761, "sim_compute_sim_state": 0.02613036618641671, "sim_compute_performance-ego0": 0.0018805449054600497, "sim_compute_performance-ego1": 0.0018353898956019316, "sim_compute_performance-ego2": 0.0018661119459471437, "sim_compute_performance-ego3": 0.0018192471115912724}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 2.240089432902503, "get_ui_image": 0.05246790362635222, "step_physics": 0.8536377828583729, "survival_time": 59.99999999999873, "driven_lanedir": 1.9003814960433445, "get_state_dump": 0.009249896629962395, "get_robot_state": 0.013753088586634144, "sim_render-ego0": 0.003602781462530411, "sim_render-ego1": 0.0035503605422528956, "sim_render-ego2": 0.0035643188482915034, "sim_render-ego3": 0.0035358281258639447, "get_duckie_state": 1.2165104519020609e-06, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 38.215030147960086, "agent_compute-ego0": 0.03259179971299501, "agent_compute-ego1": 0.031868531046858634, "agent_compute-ego2": 0.031857406169945354, "agent_compute-ego3": 0.03186116806176382, "complete-iteration": 1.1137958527802427, "set_robot_commands": 0.002173376321594086, "deviation-center-line": 5.9544361323540524, "driven_lanedir_consec": 1.9003814960433445, "sim_compute_sim_state": 0.02613036618641671, "sim_compute_performance-ego0": 0.0018805449054600497, "sim_compute_performance-ego1": 0.0018353898956019316, "sim_compute_performance-ego2": 0.0018661119459471437, "sim_compute_performance-ego3": 0.0018192471115912724}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 14.590261073735824, "get_ui_image": 0.05246790362635222, "step_physics": 0.8536377828583729, "survival_time": 59.99999999999873, "driven_lanedir": 14.289296906523838, "get_state_dump": 0.009249896629962395, "get_robot_state": 0.013753088586634144, "sim_render-ego0": 0.003602781462530411, "sim_render-ego1": 0.0035503605422528956, "sim_render-ego2": 0.0035643188482915034, "sim_render-ego3": 0.0035358281258639447, "get_duckie_state": 1.2165104519020609e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.730272699257808, "agent_compute-ego0": 0.03259179971299501, "agent_compute-ego1": 0.031868531046858634, "agent_compute-ego2": 0.031857406169945354, "agent_compute-ego3": 0.03186116806176382, "complete-iteration": 1.1137958527802427, "set_robot_commands": 0.002173376321594086, "deviation-center-line": 2.7598534943829054, "driven_lanedir_consec": 14.289296906523838, "sim_compute_sim_state": 0.02613036618641671, "sim_compute_performance-ego0": 0.0018805449054600497, "sim_compute_performance-ego1": 0.0018353898956019316, "sim_compute_performance-ego2": 0.0018661119459471437, "sim_compute_performance-ego3": 0.0018192471115912724}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 0.9929038889132118, "get_ui_image": 0.05246790362635222, "step_physics": 0.8536377828583729, "survival_time": 59.99999999999873, "driven_lanedir": 0.8506605764094891, "get_state_dump": 0.009249896629962395, "get_robot_state": 0.013753088586634144, "sim_render-ego0": 0.003602781462530411, "sim_render-ego1": 0.0035503605422528956, "sim_render-ego2": 0.0035643188482915034, "sim_render-ego3": 0.0035358281258639447, "get_duckie_state": 1.2165104519020609e-06, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 41.46245700705427, "agent_compute-ego0": 0.03259179971299501, "agent_compute-ego1": 0.031868531046858634, "agent_compute-ego2": 0.031857406169945354, "agent_compute-ego3": 0.03186116806176382, "complete-iteration": 1.1137958527802427, "set_robot_commands": 0.002173376321594086, "deviation-center-line": 6.953126488911857, "driven_lanedir_consec": 0.6898939120510256, "sim_compute_sim_state": 0.02613036618641671, "sim_compute_performance-ego0": 0.0018805449054600497, "sim_compute_performance-ego1": 0.0018353898956019316, "sim_compute_performance-ego2": 0.0018661119459471437, "sim_compute_performance-ego3": 0.0018192471115912724}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 14.590346671601536, "get_ui_image": 0.05174241296258397, "step_physics": 0.8687292199448483, "survival_time": 59.99999999999873, "driven_lanedir": 14.24763229859456, "get_state_dump": 0.00904592665704859, "get_robot_state": 0.013516345885671443, "sim_render-ego0": 0.003564631512123381, "sim_render-ego1": 0.003543764824275669, "sim_render-ego2": 0.0035545391206638103, "sim_render-ego3": 0.003492281498460349, "get_duckie_state": 1.177799691764838e-06, "in-drivable-lane": 0.39999999999997726, "deviation-heading": 9.057332406441803, "agent_compute-ego0": 0.033910900627345864, "agent_compute-ego1": 0.03362199646745693, "agent_compute-ego2": 0.03343223632126426, "agent_compute-ego3": 0.03282807689225247, "complete-iteration": 1.1315312343870572, "set_robot_commands": 0.0021150616384564987, "deviation-center-line": 2.487761478855997, "driven_lanedir_consec": 14.24762370028614, "sim_compute_sim_state": 0.024660790194877477, "sim_compute_performance-ego0": 0.001835029786274296, "sim_compute_performance-ego1": 0.0018339409220724876, "sim_compute_performance-ego2": 0.001841869282782028, "sim_compute_performance-ego3": 0.0018520516023151485}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 14.590327041928132, "get_ui_image": 0.05174241296258397, "step_physics": 0.8687292199448483, "survival_time": 59.99999999999873, "driven_lanedir": 14.103349560424114, "get_state_dump": 0.00904592665704859, "get_robot_state": 0.013516345885671443, "sim_render-ego0": 0.003564631512123381, "sim_render-ego1": 0.003543764824275669, "sim_render-ego2": 0.0035545391206638103, "sim_render-ego3": 0.003492281498460349, "get_duckie_state": 1.177799691764838e-06, "in-drivable-lane": 0.7499999999999822, "deviation-heading": 9.979384463858311, "agent_compute-ego0": 0.033910900627345864, "agent_compute-ego1": 0.03362199646745693, "agent_compute-ego2": 0.03343223632126426, "agent_compute-ego3": 0.03282807689225247, "complete-iteration": 1.1315312343870572, "set_robot_commands": 0.0021150616384564987, "deviation-center-line": 2.7815383160190423, "driven_lanedir_consec": 14.103344404807109, "sim_compute_sim_state": 0.024660790194877477, "sim_compute_performance-ego0": 0.001835029786274296, "sim_compute_performance-ego1": 0.0018339409220724876, "sim_compute_performance-ego2": 0.001841869282782028, "sim_compute_performance-ego3": 0.0018520516023151485}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.491555568886973, "get_ui_image": 0.05174241296258397, "step_physics": 0.8687292199448483, "survival_time": 59.99999999999873, "driven_lanedir": 0.4710403014268969, "get_state_dump": 0.00904592665704859, "get_robot_state": 0.013516345885671443, "sim_render-ego0": 0.003564631512123381, "sim_render-ego1": 0.003543764824275669, "sim_render-ego2": 0.0035545391206638103, "sim_render-ego3": 0.003492281498460349, "get_duckie_state": 1.177799691764838e-06, "in-drivable-lane": 0.0, "deviation-heading": 35.12865015489841, "agent_compute-ego0": 0.033910900627345864, "agent_compute-ego1": 0.03362199646745693, "agent_compute-ego2": 0.03343223632126426, "agent_compute-ego3": 0.03282807689225247, "complete-iteration": 1.1315312343870572, "set_robot_commands": 0.0021150616384564987, "deviation-center-line": 6.039813363919256, "driven_lanedir_consec": 0.4710403014268969, "sim_compute_sim_state": 0.024660790194877477, "sim_compute_performance-ego0": 0.001835029786274296, "sim_compute_performance-ego1": 0.0018339409220724876, "sim_compute_performance-ego2": 0.001841869282782028, "sim_compute_performance-ego3": 0.0018520516023151485}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.359708487353784, "get_ui_image": 0.05174241296258397, "step_physics": 0.8687292199448483, "survival_time": 59.99999999999873, "driven_lanedir": 0.955193921394044, "get_state_dump": 0.00904592665704859, "get_robot_state": 0.013516345885671443, "sim_render-ego0": 0.003564631512123381, "sim_render-ego1": 0.003543764824275669, "sim_render-ego2": 0.0035545391206638103, "sim_render-ego3": 0.003492281498460349, "get_duckie_state": 1.177799691764838e-06, "in-drivable-lane": 1.4499999999999948, "deviation-heading": 19.01608623645237, "agent_compute-ego0": 0.033910900627345864, "agent_compute-ego1": 0.03362199646745693, "agent_compute-ego2": 0.03343223632126426, "agent_compute-ego3": 0.03282807689225247, "complete-iteration": 1.1315312343870572, "set_robot_commands": 0.0021150616384564987, "deviation-center-line": 1.995252279550883, "driven_lanedir_consec": 0.9253010274145366, "sim_compute_sim_state": 0.024660790194877477, "sim_compute_performance-ego0": 0.001835029786274296, "sim_compute_performance-ego1": 0.0018339409220724876, "sim_compute_performance-ego2": 0.001841869282782028, "sim_compute_performance-ego3": 0.0018520516023151485}}
set_robot_commands_max0.002173376321594086
set_robot_commands_mean0.0021442189800252925
set_robot_commands_median0.0021442189800252925
set_robot_commands_min0.0021150616384564987
sim_compute_performance-ego0_max0.0018805449054600497
sim_compute_performance-ego0_mean0.0018577873458671729
sim_compute_performance-ego0_median0.0018577873458671729
sim_compute_performance-ego0_min0.001835029786274296
sim_compute_performance-ego1_max0.0018353898956019316
sim_compute_performance-ego1_mean0.0018346654088372096
sim_compute_performance-ego1_median0.0018346654088372096
sim_compute_performance-ego1_min0.0018339409220724876
sim_compute_performance-ego2_max0.0018661119459471437
sim_compute_performance-ego2_mean0.001853990614364586
sim_compute_performance-ego2_median0.001853990614364586
sim_compute_performance-ego2_min0.001841869282782028
sim_compute_performance-ego3_max0.0018520516023151485
sim_compute_performance-ego3_mean0.0018356493569532104
sim_compute_performance-ego3_median0.0018356493569532104
sim_compute_performance-ego3_min0.0018192471115912724
sim_compute_sim_state_max0.02613036618641671
sim_compute_sim_state_mean0.025395578190647097
sim_compute_sim_state_median0.025395578190647097
sim_compute_sim_state_min0.024660790194877477
sim_render-ego0_max0.003602781462530411
sim_render-ego0_mean0.0035837064873268957
sim_render-ego0_median0.0035837064873268957
sim_render-ego0_min0.003564631512123381
sim_render-ego1_max0.0035503605422528956
sim_render-ego1_mean0.003547062683264282
sim_render-ego1_median0.003547062683264282
sim_render-ego1_min0.003543764824275669
sim_render-ego2_max0.0035643188482915034
sim_render-ego2_mean0.003559428984477657
sim_render-ego2_median0.003559428984477657
sim_render-ego2_min0.0035545391206638103
sim_render-ego3_max0.0035358281258639447
sim_render-ego3_mean0.0035140548121621465
sim_render-ego3_median0.0035140548121621465
sim_render-ego3_min0.003492281498460349
simulation-passed1
step_physics_max0.8687292199448483
step_physics_mean0.8611835014016106
step_physics_median0.8611835014016106
step_physics_min0.8536377828583729
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
53605LFVIv-simsuccessyes1:24:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible