Duckietown Challenges Home Challenges Submissions

Submission 11420

Submission11420
Competingyes
Challengeaido5-LFVI-sim-validation
UserFrank (Chude) Qian 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVIv-sim: 56375
Next
User labelchallenge-aido_LF-baseline-behavior-cloning
Admin priority50
Blessingn/a
User priority50

56375

Click the images to see detailed statistics about the episode.

LFVI-norm-4way-000

LFVI-norm-udem1-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
56375LFVIv-simsuccessyes0:34:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.699242061385539
survival_time_median33.64999999999935
deviation-center-line_median1.6113918751975642
in-drivable-lane_median0.6749999999999976


other stats
agent_compute-ego0_max0.0490106319894596
agent_compute-ego0_mean0.0462070826829917
agent_compute-ego0_median0.0462070826829917
agent_compute-ego0_min0.04340353337652379
agent_compute-npc0_max0.041184113087205466
agent_compute-npc0_mean0.039649482055540294
agent_compute-npc0_median0.039649482055540294
agent_compute-npc0_min0.03811485102387513
agent_compute-npc1_max0.04352186502366141
agent_compute-npc1_mean0.04092439833608766
agent_compute-npc1_median0.04092439833608766
agent_compute-npc1_min0.0383269316485139
agent_compute-npc2_max0.042536741490169526
agent_compute-npc2_mean0.04049869919467139
agent_compute-npc2_median0.04049869919467139
agent_compute-npc2_min0.038460656899173246
complete-iteration_max1.305956402603461
complete-iteration_mean1.1783461971824547
complete-iteration_median1.1783461971824547
complete-iteration_min1.0507359917614485
deviation-center-line_max2.8305007562607853
deviation-center-line_mean1.6113918751975642
deviation-center-line_min0.3922829941343432
deviation-heading_max10.829028225443134
deviation-heading_mean6.452009420831732
deviation-heading_median6.452009420831732
deviation-heading_min2.0749906162203295
driven_any_max14.590269734375006
driven_any_mean8.060581239889531
driven_any_median8.060581239889531
driven_any_min1.5308927454040566
driven_lanedir_consec_max14.2852209595819
driven_lanedir_consec_mean7.699242061385539
driven_lanedir_consec_min1.1132631631891798
driven_lanedir_max14.285221064869503
driven_lanedir_mean7.699952379115072
driven_lanedir_median7.699952379115072
driven_lanedir_min1.1146836933606394
get_duckie_state_max1.493765383350606e-06
get_duckie_state_mean1.4440734075826198e-06
get_duckie_state_median1.4440734075826198e-06
get_duckie_state_min1.3943814318146335e-06
get_robot_state_max0.014940196965016476
get_robot_state_mean0.014533956600494023
get_robot_state_median0.014533956600494023
get_robot_state_min0.01412771623597157
get_state_dump_max0.009979900048703564
get_state_dump_mean0.009684996577856335
get_state_dump_median0.009684996577856335
get_state_dump_min0.009390093107009112
get_ui_image_max0.05213805283007979
get_ui_image_mean0.05150617787764882
get_ui_image_median0.05150617787764882
get_ui_image_min0.05087430292521786
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.6749999999999976
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 14.590269734375006, "get_ui_image": 0.05087430292521786, "step_physics": 0.7319630780486044, "survival_time": 59.99999999999873, "driven_lanedir": 14.285221064869503, "get_state_dump": 0.009390093107009112, "get_robot_state": 0.01412771623597157, "sim_render-ego0": 0.003937299602930988, "sim_render-npc0": 0.003870021889946244, "sim_render-npc1": 0.0038459741701988457, "sim_render-npc2": 0.003914459460383152, "get_duckie_state": 1.3943814318146335e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.829028225443134, "agent_compute-ego0": 0.04340353337652379, "agent_compute-npc0": 0.041184113087205466, "agent_compute-npc1": 0.04352186502366141, "agent_compute-npc2": 0.042536741490169526, "complete-iteration": 1.0507359917614485, "set_robot_commands": 0.002270697554779688, "deviation-center-line": 2.8305007562607853, "driven_lanedir_consec": 14.2852209595819, "sim_compute_sim_state": 0.04104001357295333, "sim_compute_performance-ego0": 0.0020881908124531436, "sim_compute_performance-npc0": 0.00195194501662433, "sim_compute_performance-npc1": 0.0019327798155721876, "sim_compute_performance-npc2": 0.0019648194213790957}, "LFVI-norm-udem1-000-ego0": {"driven_any": 1.5308927454040566, "get_ui_image": 0.05213805283007979, "step_physics": 0.9866156091495436, "survival_time": 7.299999999999982, "driven_lanedir": 1.1146836933606394, "get_state_dump": 0.009979900048703564, "get_robot_state": 0.014940196965016476, "sim_render-ego0": 0.004074643258334828, "sim_render-npc0": 0.004125053379811397, "sim_render-npc1": 0.004058946557596427, "sim_render-npc2": 0.004039311895565111, "get_duckie_state": 1.493765383350606e-06, "in-drivable-lane": 1.3499999999999952, "deviation-heading": 2.0749906162203295, "agent_compute-ego0": 0.0490106319894596, "agent_compute-npc0": 0.03811485102387513, "agent_compute-npc1": 0.0383269316485139, "agent_compute-npc2": 0.038460656899173246, "complete-iteration": 1.305956402603461, "set_robot_commands": 0.0023806743881329387, "deviation-center-line": 0.3922829941343432, "driven_lanedir_consec": 1.1132631631891798, "sim_compute_sim_state": 0.04391206851621874, "sim_compute_performance-ego0": 0.0022602081298828125, "sim_compute_performance-npc0": 0.0020450296856108167, "sim_compute_performance-npc1": 0.0020133183926952128, "sim_compute_performance-npc2": 0.0020596932391731106}}
set_robot_commands_max0.0023806743881329387
set_robot_commands_mean0.002325685971456313
set_robot_commands_median0.002325685971456313
set_robot_commands_min0.002270697554779688
sim_compute_performance-ego0_max0.0022602081298828125
sim_compute_performance-ego0_mean0.002174199471167978
sim_compute_performance-ego0_median0.002174199471167978
sim_compute_performance-ego0_min0.0020881908124531436
sim_compute_performance-npc0_max0.0020450296856108167
sim_compute_performance-npc0_mean0.0019984873511175736
sim_compute_performance-npc0_median0.0019984873511175736
sim_compute_performance-npc0_min0.00195194501662433
sim_compute_performance-npc1_max0.0020133183926952128
sim_compute_performance-npc1_mean0.0019730491041337
sim_compute_performance-npc1_median0.0019730491041337
sim_compute_performance-npc1_min0.0019327798155721876
sim_compute_performance-npc2_max0.0020596932391731106
sim_compute_performance-npc2_mean0.002012256330276103
sim_compute_performance-npc2_median0.002012256330276103
sim_compute_performance-npc2_min0.0019648194213790957
sim_compute_sim_state_max0.04391206851621874
sim_compute_sim_state_mean0.042476041044586035
sim_compute_sim_state_median0.042476041044586035
sim_compute_sim_state_min0.04104001357295333
sim_render-ego0_max0.004074643258334828
sim_render-ego0_mean0.004005971430632908
sim_render-ego0_median0.004005971430632908
sim_render-ego0_min0.003937299602930988
sim_render-npc0_max0.004125053379811397
sim_render-npc0_mean0.00399753763487882
sim_render-npc0_median0.00399753763487882
sim_render-npc0_min0.003870021889946244
sim_render-npc1_max0.004058946557596427
sim_render-npc1_mean0.0039524603638976365
sim_render-npc1_median0.0039524603638976365
sim_render-npc1_min0.0038459741701988457
sim_render-npc2_max0.004039311895565111
sim_render-npc2_mean0.003976885677974131
sim_render-npc2_median0.003976885677974131
sim_render-npc2_min0.003914459460383152
simulation-passed1
step_physics_max0.9866156091495436
step_physics_mean0.859289343599074
step_physics_median0.859289343599074
step_physics_min0.7319630780486044
survival_time_max59.99999999999873
survival_time_mean33.64999999999935
survival_time_min7.299999999999982
No reset possible
56364LFVIv-simsuccessyes0:34:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
56344LFVIv-simsuccessyes0:40:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
56332LFVIv-simsuccessyes0:31:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
56320LFVIv-simsuccessyes0:30:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
56314LFVIv-simsuccessyes0:35:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55812LFVIv-simtimeoutyes0:41:18
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55810LFVIv-simsuccessyes0:32:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55805LFVIv-simsuccessyes0:33:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55784LFVIv-simsuccessyes0:35:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
55779LFVIv-simsuccessyes0:33:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible