Duckietown Challenges Home Challenges Submissions

Job 34384

Job ID34384
submission9204
userBea Baselines 🐤
user labelstraight
challengeaido5-LFVI-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg10-9558a63416c8-1
date started
date completed
duration0:37:05
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.33789528967124394
survival_time_median14.950000000000076
deviation-center-line_median0.3589435578350136
in-drivable-lane_median7.900000000000068


other stats
agent_compute-ego_max0.06568217754364014
agent_compute-ego_mean0.06025757477018569
agent_compute-ego_median0.05943782885869344
agent_compute-ego_min0.058660515149434406
complete-iteration_max0.5540038283665975
complete-iteration_mean0.5336713590092129
complete-iteration_median0.5363393521308899
complete-iteration_min0.5079129669401381
deviation-center-line_max1.072692446199104
deviation-center-line_mean0.4047491372444456
deviation-center-line_min0.042832302069148405
deviation-heading_max6.026702069189959
deviation-heading_mean2.3833821319050172
deviation-heading_median1.2252262625812709
deviation-heading_min0.5365473280810413
driven_any_max1.9396748373842467
driven_any_mean1.637531297547574
driven_any_median1.939375592471652
driven_any_min0.4329753716821084
driven_lanedir_consec_max1.2897091026113126
driven_lanedir_consec_mean0.4192170448038633
driven_lanedir_consec_min0.08878087491095421
driven_lanedir_max1.2897091026113126
driven_lanedir_mean0.4863554807215249
driven_lanedir_median0.3959574281209563
driven_lanedir_min0.08878087491095421
get_state_dump_max0.034886178043153554
get_state_dump_mean0.034338485214445325
get_state_dump_median0.03435660395357344
get_state_dump_min0.033891624609629314
get_ui_image_max0.10067383448282878
get_ui_image_mean0.09684672560956745
get_ui_image_median0.09693861921628316
get_ui_image_min0.09361661752065024
in-drivable-lane_max13.650000000000077
in-drivable-lane_mean7.715000000000046
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego": {"driven_any": 1.9331253846320633, "get_ui_image": 0.09733630180358886, "step_physics": 0.24928399085998537, "survival_time": 14.950000000000076, "driven_lanedir": 0.0910023178433006, "get_state_dump": 0.03453276475270589, "sim_render-ego": 0.0071675658226013185, "in-drivable-lane": 13.650000000000077, "agent_compute-ego": 0.06139597336451213, "deviation-heading": 0.5365473280810413, "complete-iteration": 0.5479306221008301, "set_robot_commands": 0.0062090039253234865, "deviation-center-line": 0.042832302069148405, "driven_lanedir_consec": 0.0910023178433006, "sim_compute_sim_state": 0.026570783456166584, "sim_compute_performance-ego": 0.005759573777516683, "sim_compute_robot_state-ego": 0.00997883955637614, "sim_compute_robot_state-npc0": 0.009846258958180743, "sim_compute_robot_state-npc1": 0.009750863711039226, "sim_compute_robot_state-npc2": 0.009883546829223632, "sim_compute_robot_state-npc3": 0.01000758409500122, "sim_compute_robot_state-parked0": 0.009940759340922038}, "udem1-0-1-ego": {"driven_any": 1.9395289624686007, "get_ui_image": 0.09732816457748412, "step_physics": 0.2304743997255961, "survival_time": 14.950000000000076, "driven_lanedir": 0.30678297241367947, "get_state_dump": 0.034086748758951825, "sim_render-ego": 0.007300144831339519, "in-drivable-lane": 11.750000000000052, "agent_compute-ego": 0.06568217754364014, "deviation-heading": 1.319837799828615, "complete-iteration": 0.5295968294143677, "set_robot_commands": 0.006429558595021566, "deviation-center-line": 0.2719021969028858, "driven_lanedir_consec": 0.30678297241367947, "sim_compute_sim_state": 0.022314449151357017, "sim_compute_performance-ego": 0.0056336180369059245, "sim_compute_robot_state-ego": 0.0101262895266215, "sim_compute_robot_state-npc0": 0.010304598013559978, "sim_compute_robot_state-npc1": 0.009978322982788088, "sim_compute_robot_state-npc2": 0.010010382334391277, "sim_compute_robot_state-npc3": 0.009768509864807129, "sim_compute_robot_state-parked0": 0.009890583356221515}, "udem1-1-0-ego": {"driven_any": 1.9393470494824137, "get_ui_image": 0.09519671122233073, "step_physics": 0.23292760133743287, "survival_time": 14.950000000000076, "driven_lanedir": 0.08878087491095421, "get_state_dump": 0.034077497323354085, "sim_render-ego": 0.0072218036651611325, "in-drivable-lane": 13.600000000000076, "agent_compute-ego": 0.058660515149434406, "deviation-heading": 0.7132419014286397, "complete-iteration": 0.5277226877212524, "set_robot_commands": 0.00624338706334432, "deviation-center-line": 0.10302960204242176, "driven_lanedir_consec": 0.08878087491095421, "sim_compute_sim_state": 0.02724908192952474, "sim_compute_performance-ego": 0.005663080215454102, "sim_compute_robot_state-ego": 0.010308672587076824, "sim_compute_robot_state-npc0": 0.009934293429056804, "sim_compute_robot_state-npc1": 0.009913864930470783, "sim_compute_robot_state-npc2": 0.009901069005330405, "sim_compute_robot_state-npc3": 0.010070873101552328, "sim_compute_robot_state-parked0": 0.010081693331400554}, "udem1-1-1-ego": {"driven_any": 1.9393942900015, "get_ui_image": 0.09646712144215902, "step_physics": 0.24122403303782144, "survival_time": 14.950000000000076, "driven_lanedir": 0.10883371019196364, "get_state_dump": 0.0343223245938619, "sim_render-ego": 0.007413609822591146, "in-drivable-lane": 13.500000000000078, "agent_compute-ego": 0.058784333070119224, "deviation-heading": 0.7346216249430697, "complete-iteration": 0.5380058654149373, "set_robot_commands": 0.006347044308980306, "deviation-center-line": 0.12356745336129592, "driven_lanedir_consec": 0.10883371019196364, "sim_compute_sim_state": 0.02737545649210612, "sim_compute_performance-ego": 0.00578963836034139, "sim_compute_robot_state-ego": 0.010097188154856364, "sim_compute_robot_state-npc0": 0.01003291686375936, "sim_compute_robot_state-npc1": 0.010131179491678874, "sim_compute_robot_state-npc2": 0.009994523525238035, "sim_compute_robot_state-npc3": 0.00991621494293213, "sim_compute_robot_state-parked0": 0.009834621747334798}, "udem1-2-0-ego": {"driven_any": 1.939356894941804, "get_ui_image": 0.09840252161026002, "step_physics": 0.2647994089126587, "survival_time": 14.950000000000076, "driven_lanedir": 0.6628388214721457, "get_state_dump": 0.033891624609629314, "sim_render-ego": 0.007042195796966553, "in-drivable-lane": 6.850000000000042, "agent_compute-ego": 0.05956515630086263, "deviation-heading": 6.026702069189959, "complete-iteration": 0.5540038283665975, "set_robot_commands": 0.00643844207127889, "deviation-center-line": 0.6495280089602984, "driven_lanedir_consec": 0.3690076069288084, "sim_compute_sim_state": 0.01972850163777669, "sim_compute_performance-ego": 0.005712940692901612, "sim_compute_robot_state-ego": 0.009731620152791342, "sim_compute_robot_state-npc0": 0.009792956511179606, "sim_compute_robot_state-npc1": 0.00966816504796346, "sim_compute_robot_state-npc2": 0.00977101961771647, "sim_compute_robot_state-npc3": 0.0095577605565389, "sim_compute_robot_state-parked0": 0.0096308437983195}, "udem1-2-1-ego": {"driven_any": 1.9394280102617525, "get_ui_image": 0.10067383448282878, "step_physics": 0.249605233669281, "survival_time": 14.950000000000076, "driven_lanedir": 0.5567446127236095, "get_state_dump": 0.03395219723383586, "sim_render-ego": 0.007398504416147868, "in-drivable-lane": 8.950000000000093, "agent_compute-ego": 0.059310501416524254, "deviation-heading": 3.618916929282047, "complete-iteration": 0.5417541853586832, "set_robot_commands": 0.006438540617624919, "deviation-center-line": 0.4614094618822541, "driven_lanedir_consec": 0.17919146809033035, "sim_compute_sim_state": 0.01906244913736979, "sim_compute_performance-ego": 0.005792692502339681, "sim_compute_robot_state-ego": 0.009869290987650553, "sim_compute_robot_state-npc0": 0.009957692623138429, "sim_compute_robot_state-npc1": 0.0099217955271403, "sim_compute_robot_state-npc2": 0.009823495546976726, "sim_compute_robot_state-npc3": 0.009789683024088542, "sim_compute_robot_state-parked0": 0.009883536497751873}, "udem1-3-0-ego": {"driven_any": 1.939496303885957, "get_ui_image": 0.0991646154721578, "step_physics": 0.24120289087295532, "survival_time": 14.950000000000076, "driven_lanedir": 0.966947538806371, "get_state_dump": 0.03470277945200602, "sim_render-ego": 0.007126732667287191, "in-drivable-lane": 5.600000000000035, "agent_compute-ego": 0.0592209267616272, "deviation-heading": 4.544306658299553, "complete-iteration": 0.5430371761322021, "set_robot_commands": 0.006518957614898682, "deviation-center-line": 0.6046427853570199, "driven_lanedir_consec": 0.966947538806371, "sim_compute_sim_state": 0.028837261199951173, "sim_compute_performance-ego": 0.005991653601328532, "sim_compute_robot_state-ego": 0.010067006746927898, "sim_compute_robot_state-npc0": 0.010035898685455322, "sim_compute_robot_state-npc1": 0.009929155508677163, "sim_compute_robot_state-npc2": 0.009889051914215088, "sim_compute_robot_state-npc3": 0.010265170733133952, "sim_compute_robot_state-parked0": 0.009805419445037844}, "udem1-3-1-ego": {"driven_any": 1.9396748373842467, "get_ui_image": 0.09361661752065024, "step_physics": 0.2357530426979065, "survival_time": 14.950000000000076, "driven_lanedir": 1.2897091026113126, "get_state_dump": 0.03454185406366984, "sim_render-ego": 0.0071551895141601565, "in-drivable-lane": 3.250000000000006, "agent_compute-ego": 0.061301542123158775, "deviation-heading": 4.148139137305117, "complete-iteration": 0.5346728388468425, "set_robot_commands": 0.00642848014831543, "deviation-center-line": 1.072692446199104, "driven_lanedir_consec": 1.2897091026113126, "sim_compute_sim_state": 0.029132235050201415, "sim_compute_performance-ego": 0.005873495737711588, "sim_compute_robot_state-ego": 0.010336617628733316, "sim_compute_robot_state-npc0": 0.010176735719045003, "sim_compute_robot_state-npc1": 0.01006563107172648, "sim_compute_robot_state-npc2": 0.010054317315419515, "sim_compute_robot_state-npc3": 0.010024912357330322, "sim_compute_robot_state-parked0": 0.0099256960550944}, "udem1-4-0-ego": {"driven_any": 0.432985870735295, "get_ui_image": 0.0965490738550822, "step_physics": 0.21747735142707825, "survival_time": 3.599999999999995, "driven_lanedir": 0.3987420795258356, "get_state_dump": 0.03439088331328498, "sim_render-ego": 0.007184760438071357, "in-drivable-lane": 0.0, "agent_compute-ego": 0.05980723102887472, "deviation-heading": 1.060893145358205, "complete-iteration": 0.5079129669401381, "set_robot_commands": 0.006379031472735935, "deviation-center-line": 0.3829501043942702, "driven_lanedir_consec": 0.3987420795258356, "sim_compute_sim_state": 0.020253052314122517, "sim_compute_performance-ego": 0.0056264036231570775, "sim_compute_robot_state-ego": 0.009684529569413926, "sim_compute_robot_state-npc0": 0.010093417432573106, "sim_compute_robot_state-npc1": 0.009994659158918591, "sim_compute_robot_state-npc2": 0.010196248690287272, "sim_compute_robot_state-npc3": 0.009858389695485434, "sim_compute_robot_state-parked0": 0.010147131151623197}, "udem1-4-1-ego": {"driven_any": 0.4329753716821084, "get_ui_image": 0.09373229410913256, "step_physics": 0.22430660327275595, "survival_time": 3.599999999999995, "driven_lanedir": 0.3931727767160771, "get_state_dump": 0.034886178043153554, "sim_render-ego": 0.00710608892970615, "in-drivable-lane": 0.0, "agent_compute-ego": 0.058847390943103366, "deviation-heading": 1.1306147253339265, "complete-iteration": 0.5120765897962782, "set_robot_commands": 0.0064138306511773, "deviation-center-line": 0.33493701127575704, "driven_lanedir_consec": 0.3931727767160771, "sim_compute_sim_state": 0.021007789505852595, "sim_compute_performance-ego": 0.005754739046096802, "sim_compute_robot_state-ego": 0.009863687886132134, "sim_compute_robot_state-npc0": 0.009771780835257636, "sim_compute_robot_state-npc1": 0.010037279791302152, "sim_compute_robot_state-npc2": 0.009853210714128282, "sim_compute_robot_state-npc3": 0.009985238313674928, "sim_compute_robot_state-parked0": 0.010240091217888726}}
set_robot_commands_max0.006518957614898682
set_robot_commands_mean0.006384627646870084
set_robot_commands_median0.006421155399746365
set_robot_commands_min0.0062090039253234865
sim_compute_performance-ego_max0.005991653601328532
sim_compute_performance-ego_mean0.005759783559375339
sim_compute_performance-ego_median0.005757156411806743
sim_compute_performance-ego_min0.0056264036231570775
sim_compute_robot_state-ego_max0.010336617628733316
sim_compute_robot_state-ego_mean0.010006374279658
sim_compute_robot_state-ego_median0.01002292315165202
sim_compute_robot_state-ego_min0.009684529569413926
sim_compute_robot_state-npc0_max0.010304598013559978
sim_compute_robot_state-npc0_mean0.009994654907120598
sim_compute_robot_state-npc0_median0.009995304743448893
sim_compute_robot_state-npc0_min0.009771780835257636
sim_compute_robot_state-npc1_max0.010131179491678874
sim_compute_robot_state-npc1_mean0.009939091722170511
sim_compute_robot_state-npc1_median0.009953739245732625
sim_compute_robot_state-npc1_min0.00966816504796346
sim_compute_robot_state-npc2_max0.010196248690287272
sim_compute_robot_state-npc2_mean0.009937686549292672
sim_compute_robot_state-npc2_median0.009895060459772745
sim_compute_robot_state-npc2_min0.00977101961771647
sim_compute_robot_state-npc3_max0.010265170733133952
sim_compute_robot_state-npc3_mean0.009924433668454488
sim_compute_robot_state-npc3_median0.009950726628303527
sim_compute_robot_state-npc3_min0.0095577605565389
sim_compute_robot_state-parked0_max0.010240091217888726
sim_compute_robot_state-parked0_mean0.009938037594159444
sim_compute_robot_state-parked0_median0.00990813970565796
sim_compute_robot_state-parked0_min0.0096308437983195
sim_compute_sim_state_max0.029132235050201415
sim_compute_sim_state_mean0.024153105987442865
sim_compute_sim_state_median0.0244426163037618
sim_compute_sim_state_min0.01906244913736979
sim_render-ego_max0.007413609822591146
sim_render-ego_mean0.00721165959040324
sim_render-ego_median0.007176163130336338
sim_render-ego_min0.007042195796966553
simulation-passed1
step_physics_max0.2647994089126587
step_physics_mean0.2387054555813472
step_physics_median0.23847796678543093
step_physics_min0.21747735142707825
survival_time_max14.950000000000076
survival_time_mean12.68000000000006
survival_time_min3.599999999999995

Highlights

34384

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

udem1-1-0

udem1-1-1

udem1-2-0

udem1-2-1

udem1-3-0

udem1-3-1

udem1-4-0

udem1-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.