Duckietown Challenges Home Challenges Submissions

Submission 3698

Submission3698
Competingyes
Challengeaido2-LFVI-sim-validation
UserManfred Diaz
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23593
Next
User labelchallenge-aido_LF-template-tensorflow
Admin priority50
Blessingn/a
User priority50

23593

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-1-0

udem1-2-0

udem1-3-0

udem1-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23593step1-simulationsuccessyes0:07:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.31164394050994515
survival_time_median1.3500000000000003
deviation-center-line_median0.11338316797747965
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.12490536005069049
agent_compute-ego_mean0.11800945097842508
agent_compute-ego_median0.11763600147131716
agent_compute-ego_min0.11252692612734708
deviation-center-line_max0.2772721175430746
deviation-center-line_mean0.14443514760838658
deviation-center-line_min0.08153787799650823
deviation-heading_max2.2587549649829324
deviation-heading_mean0.8533733985305432
deviation-heading_median0.6542959360319799
deviation-heading_min0.28991243479889717
driven_any_max1.1892543981816193
driven_any_mean0.523835107633617
driven_any_median0.33474497376245504
driven_any_min0.2958765921299978
driven_lanedir_consec_max0.8644751313077783
driven_lanedir_consec_mean0.4239426101062383
driven_lanedir_consec_min0.22328956350070528
driven_lanedir_max0.8644751313077783
driven_lanedir_mean0.4239426101062383
driven_lanedir_median0.31164394050994515
driven_lanedir_min0.22328956350070528
in-drivable-lane_max0.549999999999998
in-drivable-lane_mean0.13999999999999962
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.2958765921299978, "sim_physics": 0.15839164345352738, "survival_time": 1.3500000000000003, "driven_lanedir": 0.22328956350070528, "sim_render-ego": 0.04717820662039297, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.12090684749461988, "deviation-heading": 0.6542959360319799, "set_robot_commands": 0.07324233761540165, "deviation-center-line": 0.10034787406632492, "driven_lanedir_consec": 0.22328956350070528, "sim_compute_sim_state": 0.03179673795346861, "sim_compute_performance-ego": 0.05500554155420374, "sim_compute_robot_state-ego": 0.06066057417127821, "sim_compute_robot_state-npc0": 0.06140045766477232, "sim_compute_robot_state-npc1": 0.05678017051131637, "sim_compute_robot_state-npc2": 0.05616159792299624, "sim_compute_robot_state-npc3": 0.054959526768437135}, "udem1-1-0": {"driven_any": 0.5008674911959674, "sim_physics": 0.14675251031533265, "survival_time": 1.950000000000001, "driven_lanedir": 0.4498655867580923, "sim_render-ego": 0.04993008344601362, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12490536005069049, "deviation-heading": 0.6670264824364776, "set_robot_commands": 0.0687400561112624, "deviation-center-line": 0.14963470045854546, "driven_lanedir_consec": 0.4498655867580923, "sim_compute_sim_state": 0.03020515197362655, "sim_compute_performance-ego": 0.05510972707699507, "sim_compute_robot_state-ego": 0.05222088862688114, "sim_compute_robot_state-npc0": 0.054560520710089266, "sim_compute_robot_state-npc1": 0.0522003051562187, "sim_compute_robot_state-npc2": 0.05540864284221943, "sim_compute_robot_state-npc3": 0.0502325571500338}, "udem1-2-0": {"driven_any": 0.33474497376245504, "sim_physics": 0.1788859190764251, "survival_time": 1.3500000000000003, "driven_lanedir": 0.31164394050994515, "sim_render-ego": 0.04913396305508084, "in-drivable-lane": 0, "agent_compute-ego": 0.11407211974815086, "deviation-heading": 0.39687717440242926, "set_robot_commands": 0.06803565555148655, "deviation-center-line": 0.11338316797747965, "driven_lanedir_consec": 0.31164394050994515, "sim_compute_sim_state": 0.03244834476047092, "sim_compute_performance-ego": 0.052422673613936814, "sim_compute_robot_state-ego": 0.05624846175864891, "sim_compute_robot_state-npc0": 0.051244771039044415, "sim_compute_robot_state-npc1": 0.04816450013054742, "sim_compute_robot_state-npc2": 0.05234947027983489, "sim_compute_robot_state-npc3": 0.052131970723470054}, "udem1-3-0": {"driven_any": 0.298432082898045, "sim_physics": 0.17244294556704434, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2704388284546706, "sim_render-ego": 0.04465459693561901, "in-drivable-lane": 0, "agent_compute-ego": 0.11252692612734708, "deviation-heading": 0.28991243479889717, "set_robot_commands": 0.07127796519886363, "deviation-center-line": 0.08153787799650823, "driven_lanedir_consec": 0.2704388284546706, "sim_compute_sim_state": 0.02611360766670921, "sim_compute_performance-ego": 0.05200833624059504, "sim_compute_robot_state-ego": 0.053190935741771354, "sim_compute_robot_state-npc0": 0.050740870562466706, "sim_compute_robot_state-npc1": 0.051395297050476074, "sim_compute_robot_state-npc2": 0.048339128494262695, "sim_compute_robot_state-npc3": 0.04904314604672519}, "udem1-4-0": {"driven_any": 1.1892543981816193, "sim_physics": 0.14532276596685853, "survival_time": 4.94999999999999, "driven_lanedir": 0.8644751313077783, "sim_render-ego": 0.047155871535792496, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.11763600147131716, "deviation-heading": 2.2587549649829324, "set_robot_commands": 0.07643443647057119, "deviation-center-line": 0.2772721175430746, "driven_lanedir_consec": 0.8644751313077783, "sim_compute_sim_state": 0.029935480368257772, "sim_compute_performance-ego": 0.051621227553396515, "sim_compute_robot_state-ego": 0.055698866796011874, "sim_compute_robot_state-npc0": 0.05393665727942881, "sim_compute_robot_state-npc1": 0.05287222428755327, "sim_compute_robot_state-npc2": 0.05248110944574529, "sim_compute_robot_state-npc3": 0.05472396600126016}}
set_robot_commands_max0.07643443647057119
set_robot_commands_mean0.07154609018951709
set_robot_commands_median0.07127796519886363
set_robot_commands_min0.06803565555148655
sim_compute_performance-ego_max0.05510972707699507
sim_compute_performance-ego_mean0.05323350120782544
sim_compute_performance-ego_median0.052422673613936814
sim_compute_performance-ego_min0.051621227553396515
sim_compute_robot_state-ego_max0.06066057417127821
sim_compute_robot_state-ego_mean0.0556039454189183
sim_compute_robot_state-ego_median0.055698866796011874
sim_compute_robot_state-ego_min0.05222088862688114
sim_compute_robot_state-npc0_max0.06140045766477232
sim_compute_robot_state-npc0_mean0.054376655451160306
sim_compute_robot_state-npc0_median0.05393665727942881
sim_compute_robot_state-npc0_min0.050740870562466706
sim_compute_robot_state-npc1_max0.05678017051131637
sim_compute_robot_state-npc1_mean0.05228249942722237
sim_compute_robot_state-npc1_median0.0522003051562187
sim_compute_robot_state-npc1_min0.04816450013054742
sim_compute_robot_state-npc2_max0.05616159792299624
sim_compute_robot_state-npc2_mean0.05294798979701171
sim_compute_robot_state-npc2_median0.05248110944574529
sim_compute_robot_state-npc2_min0.048339128494262695
sim_compute_robot_state-npc3_max0.054959526768437135
sim_compute_robot_state-npc3_mean0.05221823333798527
sim_compute_robot_state-npc3_median0.052131970723470054
sim_compute_robot_state-npc3_min0.04904314604672519
sim_compute_sim_state_max0.03244834476047092
sim_compute_sim_state_mean0.03009986454450661
sim_compute_sim_state_median0.03020515197362655
sim_compute_sim_state_min0.02611360766670921
sim_physics_max0.1788859190764251
sim_physics_mean0.1603591568758376
sim_physics_median0.15839164345352738
sim_physics_min0.14532276596685853
sim_render-ego_max0.04993008344601362
sim_render-ego_mean0.047610544318579785
sim_render-ego_median0.04717820662039297
sim_render-ego_min0.04465459693561901
simulation-passed1
survival_time_max4.94999999999999
survival_time_mean2.1399999999999983
survival_time_min1.1000000000000003
No reset possible