Duckietown Challenges Home Challenges Submissions

Submission 11421

Submission11421
Competingyes
Challengeaido5-LFVI-sim-testing
UserFrank (Chude) Qian 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVIt-sim: 56767
Next
User labelchallenge-aido_LF-baseline-behavior-cloning
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
56767LFVIt-simsuccessyes0:13:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9832923991717628
survival_time_median10.07500000000002
deviation-center-line_median0.4239133090419831
in-drivable-lane_median0.574999999999998


other stats
agent_compute-ego0_max0.047697374180181704
agent_compute-ego0_mean0.047204707975753296
agent_compute-ego0_median0.047204707975753296
agent_compute-ego0_min0.04671204177132488
agent_compute-npc0_max0.04484873387350965
agent_compute-npc0_mean0.04392350300527993
agent_compute-npc0_median0.04392350300527993
agent_compute-npc0_min0.04299827213705021
agent_compute-npc1_max0.046009315483605685
agent_compute-npc1_mean0.038642824712383006
agent_compute-npc1_median0.038642824712383006
agent_compute-npc1_min0.03127633394116033
agent_compute-npc2_max0.03938737467153749
agent_compute-npc2_mean0.03533279492855332
agent_compute-npc2_median0.03533279492855332
agent_compute-npc2_min0.03127821518556915
complete-iteration_max1.158647574595551
complete-iteration_mean1.105435857346588
complete-iteration_median1.105435857346588
complete-iteration_min1.052224140097625
deviation-center-line_max0.46008615393263785
deviation-center-line_mean0.4239133090419831
deviation-center-line_min0.3877404641513284
deviation-heading_max2.337012532611664
deviation-heading_mean2.220127785303513
deviation-heading_median2.220127785303513
deviation-heading_min2.103243037995362
driven_any_max3.0105050086991096
driven_any_mean2.209563563845541
driven_any_median2.209563563845541
driven_any_min1.4086221189919723
driven_lanedir_consec_max2.9634880118141544
driven_lanedir_consec_mean1.9832923991717628
driven_lanedir_consec_min1.0030967865293712
driven_lanedir_max2.9634891663213527
driven_lanedir_mean1.9869603497083763
driven_lanedir_median1.9869603497083763
driven_lanedir_min1.0104315330954003
get_duckie_state_max1.8290359608448336e-06
get_duckie_state_mean1.706725982996825e-06
get_duckie_state_median1.706725982996825e-06
get_duckie_state_min1.5844160051488164e-06
get_robot_state_max0.014625107174489036
get_robot_state_mean0.01453344398742798
get_robot_state_median0.01453344398742798
get_robot_state_min0.014441780800366923
get_state_dump_max0.00965755822053596
get_state_dump_mean0.009656778830876213
get_state_dump_median0.009656778830876213
get_state_dump_min0.00965599944121646
get_ui_image_max0.05332303569264656
get_ui_image_mean0.05273540156484235
get_ui_image_median0.05273540156484235
get_ui_image_min0.05214776743703814
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.574999999999998
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 1.4086221189919723, "get_ui_image": 0.05332303569264656, "step_physics": 0.747353435432824, "survival_time": 6.799999999999984, "driven_lanedir": 1.0104315330954003, "get_state_dump": 0.00965599944121646, "get_robot_state": 0.014441780800366923, "sim_render-ego0": 0.004074221979962649, "sim_render-npc0": 0.0038973884860964586, "sim_render-npc1": 0.0038594938542721047, "sim_render-npc2": 0.003878650874116995, "get_duckie_state": 1.8290359608448336e-06, "in-drivable-lane": 1.149999999999996, "deviation-heading": 2.337012532611664, "agent_compute-ego0": 0.04671204177132488, "agent_compute-npc0": 0.04299827213705021, "agent_compute-npc1": 0.03127633394116033, "agent_compute-npc2": 0.03127821518556915, "complete-iteration": 1.052224140097625, "set_robot_commands": 0.0022964964817910297, "deviation-center-line": 0.3877404641513284, "driven_lanedir_consec": 1.0030967865293712, "sim_compute_sim_state": 0.042091865609162046, "sim_compute_performance-ego0": 0.0022139497046923117, "sim_compute_performance-npc0": 0.0020044685280236015, "sim_compute_performance-npc1": 0.001981223586701999, "sim_compute_performance-npc2": 0.001925625070168154}, "LFVI-norm-udem1-000-ego0": {"driven_any": 3.0105050086991096, "get_ui_image": 0.05214776743703814, "step_physics": 0.826188868551112, "survival_time": 13.350000000000056, "driven_lanedir": 2.9634891663213527, "get_state_dump": 0.00965755822053596, "get_robot_state": 0.014625107174489036, "sim_render-ego0": 0.004041117518695432, "sim_render-npc0": 0.004020743405641015, "sim_render-npc1": 0.003981544900296339, "sim_render-npc2": 0.003955493222421675, "get_duckie_state": 1.5844160051488164e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.103243037995362, "agent_compute-ego0": 0.047697374180181704, "agent_compute-npc0": 0.04484873387350965, "agent_compute-npc1": 0.046009315483605685, "agent_compute-npc2": 0.03938737467153749, "complete-iteration": 1.158647574595551, "set_robot_commands": 0.002230458295167382, "deviation-center-line": 0.46008615393263785, "driven_lanedir_consec": 2.9634880118141544, "sim_compute_sim_state": 0.04441414662261507, "sim_compute_performance-ego0": 0.0022199145003930845, "sim_compute_performance-npc0": 0.002064720018586116, "sim_compute_performance-npc1": 0.0020408799399190872, "sim_compute_performance-npc2": 0.0020170371923873675}}
set_robot_commands_max0.0022964964817910297
set_robot_commands_mean0.002263477388479206
set_robot_commands_median0.002263477388479206
set_robot_commands_min0.002230458295167382
sim_compute_performance-ego0_max0.0022199145003930845
sim_compute_performance-ego0_mean0.002216932102542698
sim_compute_performance-ego0_median0.002216932102542698
sim_compute_performance-ego0_min0.0022139497046923117
sim_compute_performance-npc0_max0.002064720018586116
sim_compute_performance-npc0_mean0.0020345942733048586
sim_compute_performance-npc0_median0.0020345942733048586
sim_compute_performance-npc0_min0.0020044685280236015
sim_compute_performance-npc1_max0.0020408799399190872
sim_compute_performance-npc1_mean0.002011051763310543
sim_compute_performance-npc1_median0.002011051763310543
sim_compute_performance-npc1_min0.001981223586701999
sim_compute_performance-npc2_max0.0020170371923873675
sim_compute_performance-npc2_mean0.001971331131277761
sim_compute_performance-npc2_median0.001971331131277761
sim_compute_performance-npc2_min0.001925625070168154
sim_compute_sim_state_max0.04441414662261507
sim_compute_sim_state_mean0.04325300611588856
sim_compute_sim_state_median0.04325300611588856
sim_compute_sim_state_min0.042091865609162046
sim_render-ego0_max0.004074221979962649
sim_render-ego0_mean0.0040576697493290405
sim_render-ego0_median0.0040576697493290405
sim_render-ego0_min0.004041117518695432
sim_render-npc0_max0.004020743405641015
sim_render-npc0_mean0.003959065945868737
sim_render-npc0_median0.003959065945868737
sim_render-npc0_min0.0038973884860964586
sim_render-npc1_max0.003981544900296339
sim_render-npc1_mean0.003920519377284222
sim_render-npc1_median0.003920519377284222
sim_render-npc1_min0.0038594938542721047
sim_render-npc2_max0.003955493222421675
sim_render-npc2_mean0.003917072048269335
sim_render-npc2_median0.003917072048269335
sim_render-npc2_min0.003878650874116995
simulation-passed1
step_physics_max0.826188868551112
step_physics_mean0.786771151991968
step_physics_median0.786771151991968
step_physics_min0.747353435432824
survival_time_max13.350000000000056
survival_time_mean10.07500000000002
survival_time_min6.799999999999984
No reset possible
56758LFVIt-simsuccessyes0:11:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
56750LFVIt-simtimeoutyes0:19:36
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible