Duckietown Challenges Home Challenges Submissions

Submission 12574

Submission12574
Competingyes
Challengeaido5-LFV-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVv-sim: 53445
Next
User labelstraight
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
53445LFVv-simsuccessyes0:21:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6193714958383224
survival_time_median9.6
deviation-center-line_median0.26371422989698395
in-drivable-lane_median4.575000000000011


other stats
agent_compute-ego0_max0.01061035506427288
agent_compute-ego0_mean0.010496309826192865
agent_compute-ego0_median0.01050659463581462
agent_compute-ego0_min0.010361694968869331
agent_compute-npc0_max0.025682058034990934
agent_compute-npc0_mean0.022495963689012563
agent_compute-npc0_median0.021719702440817265
agent_compute-npc0_min0.02086239183942477
agent_compute-npc1_max0.03213862261157826
agent_compute-npc1_mean0.028567449466129796
agent_compute-npc1_median0.02729446378846963
agent_compute-npc1_min0.026269261998341495
agent_compute-npc2_max0.03290772079525137
agent_compute-npc2_mean0.030727493971920053
agent_compute-npc2_median0.03184417274100649
agent_compute-npc2_min0.027430588379502296
agent_compute-npc3_max0.04290228858029932
agent_compute-npc3_mean0.04229550044703528
agent_compute-npc3_median0.04229550044703528
agent_compute-npc3_min0.04168871231377125
complete-iteration_max1.234556430329879
complete-iteration_mean0.920478716526034
complete-iteration_median1.066004377674191
complete-iteration_min0.31534968042587486
deviation-center-line_max0.5600236295347618
deviation-center-line_mean0.3253905152177584
deviation-center-line_min0.21410997154230388
deviation-heading_max1.908871012683688
deviation-heading_mean1.0766142147862303
deviation-heading_median0.8482219769421233
deviation-heading_min0.7011418925769862
driven_any_max2.984498978515761
driven_any_mean1.6846091701953825
driven_any_median1.4167591311847954
driven_any_min0.920419439896177
driven_lanedir_consec_max1.058934844763729
driven_lanedir_consec_mean0.6924950861139013
driven_lanedir_consec_min0.4723025080152312
driven_lanedir_max1.058934844763729
driven_lanedir_mean0.6924950861139013
driven_lanedir_median0.6193714958383224
driven_lanedir_min0.4723025080152312
get_duckie_state_max1.5124221520921203e-06
get_duckie_state_mean1.408460981111212e-06
get_duckie_state_median1.3951702337515985e-06
get_duckie_state_min1.3310813048495306e-06
get_robot_state_max0.018178111628482214
get_robot_state_mean0.014360374824190293
get_robot_state_median0.01597578441133772
get_robot_state_min0.007311818845603498
get_state_dump_max0.012248123498787558
get_state_dump_mean0.00987640929592143
get_state_dump_median0.01042341363020165
get_state_dump_min0.006410686424494859
get_ui_image_max0.052974154178361245
get_ui_image_mean0.043762556258690744
get_ui_image_median0.04586627181992696
get_ui_image_min0.03034352721654781
in-drivable-lane_max14.850000000000144
in-drivable-lane_mean6.33750000000004
in-drivable-lane_min1.349999999999996
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 1.1741327645678017, "get_ui_image": 0.04290832771114045, "step_physics": 0.7678777308551812, "survival_time": 8.09999999999998, "driven_lanedir": 1.058934844763729, "get_state_dump": 0.009681473480411831, "get_robot_state": 0.014410214921448127, "sim_render-ego0": 0.003852532685168682, "sim_render-npc0": 0.003693307104286241, "sim_render-npc1": 0.003770794605184918, "sim_render-npc2": 0.0038174017806726, "get_duckie_state": 1.5124221520921203e-06, "in-drivable-lane": 1.349999999999996, "deviation-heading": 0.7421302334609048, "agent_compute-ego0": 0.010581989229822453, "agent_compute-npc0": 0.021009212622613262, "agent_compute-npc1": 0.03213862261157826, "agent_compute-npc2": 0.03184417274100649, "complete-iteration": 0.996184085775738, "set_robot_commands": 0.0023121716786015985, "deviation-center-line": 0.5600236295347618, "driven_lanedir_consec": 1.058934844763729, "sim_compute_sim_state": 0.03324230609495947, "sim_compute_performance-ego0": 0.0021143091236886804, "sim_compute_performance-npc0": 0.0019258896997369872, "sim_compute_performance-npc1": 0.0019749044640663942, "sim_compute_performance-npc2": 0.0020274340740742127}, "LFV-norm-zigzag-000-ego0": {"driven_any": 0.920419439896177, "get_ui_image": 0.052974154178361245, "step_physics": 0.819039167318129, "survival_time": 6.5999999999999845, "driven_lanedir": 0.4723025080152312, "get_state_dump": 0.012248123498787558, "get_robot_state": 0.018178111628482214, "sim_render-ego0": 0.0036981249214115, "sim_render-npc0": 0.0035142181511212114, "sim_render-npc1": 0.003627429331155648, "sim_render-npc2": 0.003617643413687111, "sim_render-npc3": 0.003903804865098538, "get_duckie_state": 1.380318089535362e-06, "in-drivable-lane": 2.249999999999992, "deviation-heading": 1.908871012683688, "agent_compute-ego0": 0.010431200041806789, "agent_compute-npc0": 0.02243019225902127, "agent_compute-npc1": 0.026269261998341495, "agent_compute-npc2": 0.03290772079525137, "agent_compute-npc3": 0.04290228858029932, "complete-iteration": 1.1358246695726435, "set_robot_commands": 0.0021516488010721994, "deviation-center-line": 0.3113567499237792, "driven_lanedir_consec": 0.4723025080152312, "sim_compute_sim_state": 0.05873279643238039, "sim_compute_performance-ego0": 0.002128651267603824, "sim_compute_performance-npc0": 0.0018469659905684624, "sim_compute_performance-npc1": 0.0018355523733268107, "sim_compute_performance-npc2": 0.0018838742621859216, "sim_compute_performance-npc3": 0.0019146714891706191}, "LFV-norm-techtrack-000-ego0": {"driven_any": 2.984498978515761, "get_ui_image": 0.04882421592871348, "step_physics": 0.9373630806803704, "survival_time": 19.150000000000137, "driven_lanedir": 0.6255010756848516, "get_state_dump": 0.011165353779991468, "get_robot_state": 0.017541353901227314, "sim_render-ego0": 0.0037827901542186737, "sim_render-npc0": 0.003559888650973638, "sim_render-npc1": 0.003725017110506694, "sim_render-npc2": 0.003671324501434962, "sim_render-npc3": 0.003665369004011154, "get_duckie_state": 1.4100223779678345e-06, "in-drivable-lane": 14.850000000000144, "deviation-heading": 0.7011418925769862, "agent_compute-ego0": 0.01061035506427288, "agent_compute-npc0": 0.02086239183942477, "agent_compute-npc1": 0.02729446378846963, "agent_compute-npc2": 0.027430588379502296, "agent_compute-npc3": 0.04168871231377125, "complete-iteration": 1.234556430329879, "set_robot_commands": 0.0022287902732690177, "deviation-center-line": 0.21410997154230388, "driven_lanedir_consec": 0.6255010756848516, "sim_compute_sim_state": 0.05262060587604841, "sim_compute_performance-ego0": 0.0020576311896244683, "sim_compute_performance-npc0": 0.001829632247487704, "sim_compute_performance-npc1": 0.001985978956023852, "sim_compute_performance-npc2": 0.0019107523063818617, "sim_compute_performance-npc3": 0.0019145775586366651}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.6593854978017892, "get_ui_image": 0.03034352721654781, "step_physics": 0.20766742026324764, "survival_time": 11.100000000000025, "driven_lanedir": 0.6132419159917932, "get_state_dump": 0.006410686424494859, "get_robot_state": 0.007311818845603498, "sim_render-ego0": 0.0038063857587463655, "sim_render-npc0": 0.0036966255427476, "get_duckie_state": 1.3310813048495306e-06, "in-drivable-lane": 6.90000000000003, "deviation-heading": 0.9543137204233418, "agent_compute-ego0": 0.010361694968869331, "agent_compute-npc0": 0.025682058034990934, "complete-iteration": 0.31534968042587486, "set_robot_commands": 0.002345399471676403, "deviation-center-line": 0.21607170987018873, "driven_lanedir_consec": 0.6132419159917932, "sim_compute_sim_state": 0.01135866524392714, "sim_compute_performance-ego0": 0.002058520979945435, "sim_compute_performance-npc0": 0.0019423715736833925}}
set_robot_commands_max0.002345399471676403
set_robot_commands_mean0.0022595025561548045
set_robot_commands_median0.0022704809759353083
set_robot_commands_min0.0021516488010721994
sim_compute_performance-ego0_max0.002128651267603824
sim_compute_performance-ego0_mean0.0020897781402156018
sim_compute_performance-ego0_median0.002086415051817058
sim_compute_performance-ego0_min0.0020576311896244683
sim_compute_performance-npc0_max0.0019423715736833925
sim_compute_performance-npc0_mean0.0018862148778691363
sim_compute_performance-npc0_median0.0018864278451527247
sim_compute_performance-npc0_min0.001829632247487704
sim_compute_performance-npc1_max0.001985978956023852
sim_compute_performance-npc1_mean0.0019321452644723524
sim_compute_performance-npc1_median0.0019749044640663942
sim_compute_performance-npc1_min0.0018355523733268107
sim_compute_performance-npc2_max0.0020274340740742127
sim_compute_performance-npc2_mean0.0019406868808806651
sim_compute_performance-npc2_median0.0019107523063818617
sim_compute_performance-npc2_min0.0018838742621859216
sim_compute_performance-npc3_max0.0019146714891706191
sim_compute_performance-npc3_mean0.0019146245239036424
sim_compute_performance-npc3_median0.0019146245239036424
sim_compute_performance-npc3_min0.0019145775586366651
sim_compute_sim_state_max0.05873279643238039
sim_compute_sim_state_mean0.03898859341182885
sim_compute_sim_state_median0.042931455985503936
sim_compute_sim_state_min0.01135866524392714
sim_render-ego0_max0.003852532685168682
sim_render-ego0_mean0.0037849583798863057
sim_render-ego0_median0.0037945879564825194
sim_render-ego0_min0.0036981249214115
sim_render-npc0_max0.0036966255427476
sim_render-npc0_mean0.0036160098622821726
sim_render-npc0_median0.0036265978776299393
sim_render-npc0_min0.0035142181511212114
sim_render-npc1_max0.003770794605184918
sim_render-npc1_mean0.003707747015615753
sim_render-npc1_median0.003725017110506694
sim_render-npc1_min0.003627429331155648
sim_render-npc2_max0.0038174017806726
sim_render-npc2_mean0.0037021232319315576
sim_render-npc2_median0.003671324501434962
sim_render-npc2_min0.003617643413687111
sim_render-npc3_max0.003903804865098538
sim_render-npc3_mean0.0037845869345548458
sim_render-npc3_median0.0037845869345548458
sim_render-npc3_min0.003665369004011154
simulation-passed1
step_physics_max0.9373630806803704
step_physics_mean0.682986849779232
step_physics_median0.7934584490866551
step_physics_min0.20766742026324764
survival_time_max19.150000000000137
survival_time_mean11.237500000000033
survival_time_min6.5999999999999845
No reset possible
53444LFVv-simsuccessyes0:21:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53389LFVv-simabortedno0:19:35
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53334LFVv-simabortedno0:09:00
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible