Duckietown Challenges Home Challenges Submissions

Submission 11421

Submission11421
Competingyes
Challengeaido5-LFVI-sim-testing
UserFrank (Chude) Qian 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVIt-sim: 56767
Next
User labelchallenge-aido_LF-baseline-behavior-cloning
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
56767LFVIt-simsuccessyes0:13:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9832923991717628
survival_time_median10.07500000000002
deviation-center-line_median0.4239133090419831
in-drivable-lane_median0.574999999999998


other stats
agent_compute-ego0_max0.047697374180181704
agent_compute-ego0_mean0.047204707975753296
agent_compute-ego0_median0.047204707975753296
agent_compute-ego0_min0.04671204177132488
agent_compute-npc0_max0.04484873387350965
agent_compute-npc0_mean0.04392350300527993
agent_compute-npc0_median0.04392350300527993
agent_compute-npc0_min0.04299827213705021
agent_compute-npc1_max0.046009315483605685
agent_compute-npc1_mean0.038642824712383006
agent_compute-npc1_median0.038642824712383006
agent_compute-npc1_min0.03127633394116033
agent_compute-npc2_max0.03938737467153749
agent_compute-npc2_mean0.03533279492855332
agent_compute-npc2_median0.03533279492855332
agent_compute-npc2_min0.03127821518556915
complete-iteration_max1.158647574595551
complete-iteration_mean1.105435857346588
complete-iteration_median1.105435857346588
complete-iteration_min1.052224140097625
deviation-center-line_max0.46008615393263785
deviation-center-line_mean0.4239133090419831
deviation-center-line_min0.3877404641513284
deviation-heading_max2.337012532611664
deviation-heading_mean2.220127785303513
deviation-heading_median2.220127785303513
deviation-heading_min2.103243037995362
driven_any_max3.0105050086991096
driven_any_mean2.209563563845541
driven_any_median2.209563563845541
driven_any_min1.4086221189919723
driven_lanedir_consec_max2.9634880118141544
driven_lanedir_consec_mean1.9832923991717628
driven_lanedir_consec_min1.0030967865293712
driven_lanedir_max2.9634891663213527
driven_lanedir_mean1.9869603497083763
driven_lanedir_median1.9869603497083763
driven_lanedir_min1.0104315330954003
get_duckie_state_max1.8290359608448336e-06
get_duckie_state_mean1.706725982996825e-06
get_duckie_state_median1.706725982996825e-06
get_duckie_state_min1.5844160051488164e-06
get_robot_state_max0.014625107174489036
get_robot_state_mean0.01453344398742798
get_robot_state_median0.01453344398742798
get_robot_state_min0.014441780800366923
get_state_dump_max0.00965755822053596
get_state_dump_mean0.009656778830876213
get_state_dump_median0.009656778830876213
get_state_dump_min0.00965599944121646
get_ui_image_max0.05332303569264656
get_ui_image_mean0.05273540156484235
get_ui_image_median0.05273540156484235
get_ui_image_min0.05214776743703814
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.574999999999998
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 1.4086221189919723, "get_ui_image": 0.05332303569264656, "step_physics": 0.747353435432824, "survival_time": 6.799999999999984, "driven_lanedir": 1.0104315330954003, "get_state_dump": 0.00965599944121646, "get_robot_state": 0.014441780800366923, "sim_render-ego0": 0.004074221979962649, "sim_render-npc0": 0.0038973884860964586, "sim_render-npc1": 0.0038594938542721047, "sim_render-npc2": 0.003878650874116995, "get_duckie_state": 1.8290359608448336e-06, "in-drivable-lane": 1.149999999999996, "deviation-heading": 2.337012532611664, "agent_compute-ego0": 0.04671204177132488, "agent_compute-npc0": 0.04299827213705021, "agent_compute-npc1": 0.03127633394116033, "agent_compute-npc2": 0.03127821518556915, "complete-iteration": 1.052224140097625, "set_robot_commands": 0.0022964964817910297, "deviation-center-line": 0.3877404641513284, "driven_lanedir_consec": 1.0030967865293712, "sim_compute_sim_state": 0.042091865609162046, "sim_compute_performance-ego0": 0.0022139497046923117, "sim_compute_performance-npc0": 0.0020044685280236015, "sim_compute_performance-npc1": 0.001981223586701999, "sim_compute_performance-npc2": 0.001925625070168154}, "LFVI-norm-udem1-000-ego0": {"driven_any": 3.0105050086991096, "get_ui_image": 0.05214776743703814, "step_physics": 0.826188868551112, "survival_time": 13.350000000000056, "driven_lanedir": 2.9634891663213527, "get_state_dump": 0.00965755822053596, "get_robot_state": 0.014625107174489036, "sim_render-ego0": 0.004041117518695432, "sim_render-npc0": 0.004020743405641015, "sim_render-npc1": 0.003981544900296339, "sim_render-npc2": 0.003955493222421675, "get_duckie_state": 1.5844160051488164e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.103243037995362, "agent_compute-ego0": 0.047697374180181704, "agent_compute-npc0": 0.04484873387350965, "agent_compute-npc1": 0.046009315483605685, "agent_compute-npc2": 0.03938737467153749, "complete-iteration": 1.158647574595551, "set_robot_commands": 0.002230458295167382, "deviation-center-line": 0.46008615393263785, "driven_lanedir_consec": 2.9634880118141544, "sim_compute_sim_state": 0.04441414662261507, "sim_compute_performance-ego0": 0.0022199145003930845, "sim_compute_performance-npc0": 0.002064720018586116, "sim_compute_performance-npc1": 0.0020408799399190872, "sim_compute_performance-npc2": 0.0020170371923873675}}
set_robot_commands_max0.0022964964817910297
set_robot_commands_mean0.002263477388479206
set_robot_commands_median0.002263477388479206
set_robot_commands_min0.002230458295167382
sim_compute_performance-ego0_max0.0022199145003930845
sim_compute_performance-ego0_mean0.002216932102542698
sim_compute_performance-ego0_median0.002216932102542698
sim_compute_performance-ego0_min0.0022139497046923117
sim_compute_performance-npc0_max0.002064720018586116
sim_compute_performance-npc0_mean0.0020345942733048586
sim_compute_performance-npc0_median0.0020345942733048586
sim_compute_performance-npc0_min0.0020044685280236015
sim_compute_performance-npc1_max0.0020408799399190872
sim_compute_performance-npc1_mean0.002011051763310543
sim_compute_performance-npc1_median0.002011051763310543
sim_compute_performance-npc1_min0.001981223586701999
sim_compute_performance-npc2_max0.0020170371923873675
sim_compute_performance-npc2_mean0.001971331131277761
sim_compute_performance-npc2_median0.001971331131277761
sim_compute_performance-npc2_min0.001925625070168154
sim_compute_sim_state_max0.04441414662261507
sim_compute_sim_state_mean0.04325300611588856
sim_compute_sim_state_median0.04325300611588856
sim_compute_sim_state_min0.042091865609162046
sim_render-ego0_max0.004074221979962649
sim_render-ego0_mean0.0040576697493290405
sim_render-ego0_median0.0040576697493290405
sim_render-ego0_min0.004041117518695432
sim_render-npc0_max0.004020743405641015
sim_render-npc0_mean0.003959065945868737
sim_render-npc0_median0.003959065945868737
sim_render-npc0_min0.0038973884860964586
sim_render-npc1_max0.003981544900296339
sim_render-npc1_mean0.003920519377284222
sim_render-npc1_median0.003920519377284222
sim_render-npc1_min0.0038594938542721047
sim_render-npc2_max0.003955493222421675
sim_render-npc2_mean0.003917072048269335
sim_render-npc2_median0.003917072048269335
sim_render-npc2_min0.003878650874116995
simulation-passed1
step_physics_max0.826188868551112
step_physics_mean0.786771151991968
step_physics_median0.786771151991968
step_physics_min0.747353435432824
survival_time_max13.350000000000056
survival_time_mean10.07500000000002
survival_time_min6.799999999999984
No reset possible
56758LFVIt-simsuccessyes0:11:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
56750LFVIt-simtimeoutyes0:19:36
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible