Duckietown Challenges Home Challenges Submissions

Job 34372

Job ID34372
submission9217
userBea Baselines 🐤
user labelbaseline-duckietown
challengeaido5-LFV-sim-validation
stepLFVv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg03-aaa41a7eebc2-1
date started
date completed
duration0:29:34
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5769977954698178
survival_time_median11.175000000000024
deviation-center-line_median0.3041364782352682
in-drivable-lane_median2.7000000000000246


other stats
agent_compute-ego_max0.06384831767971233
agent_compute-ego_mean0.05873685338473483
agent_compute-ego_median0.05904912094275157
agent_compute-ego_min0.05034885984478575
complete-iteration_max0.5766934742361812
complete-iteration_mean0.5611740850602114
complete-iteration_median0.5637888308115109
complete-iteration_min0.5470244129498799
deviation-center-line_max1.1647826176558174
deviation-center-line_mean0.46518456966193195
deviation-center-line_min0.09068351993748695
deviation-heading_max7.187037940572696
deviation-heading_mean2.4574386861748256
deviation-heading_median2.022762375331193
deviation-heading_min0.6652122981427817
driven_any_max1.9395823507939616
driven_any_mean1.23464015807808
driven_any_median1.4384140458362735
driven_any_min0.17405896208775412
driven_lanedir_consec_max1.2983759902069396
driven_lanedir_consec_mean0.6482930151802049
driven_lanedir_consec_min0.05875985801473016
driven_lanedir_max1.2983759902069396
driven_lanedir_mean0.6555271024156203
driven_lanedir_median0.5769977954698178
driven_lanedir_min0.05875985801473016
get_state_dump_max0.03418765552973343
get_state_dump_mean0.03381655374175505
get_state_dump_median0.03410813248518742
get_state_dump_min0.032731986708111234
get_ui_image_max0.10763515125621448
get_ui_image_mean0.10039881840766882
get_ui_image_median0.09973282012674543
get_ui_image_min0.09537798881530762
in-drivable-lane_max8.450000000000044
in-drivable-lane_mean3.465000000000022
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 0.3934256013797072, "get_ui_image": 0.09800446923099349, "step_physics": 0.26430284799034914, "survival_time": 3.349999999999996, "driven_lanedir": 0.33562834726570157, "get_state_dump": 0.034161631740740876, "sim_render-ego": 0.007299437451718458, "in-drivable-lane": 0.0, "agent_compute-ego": 0.056336200059349854, "deviation-heading": 1.3772352720718553, "complete-iteration": 0.5529008801303693, "set_robot_commands": 0.006640363095411614, "deviation-center-line": 0.21113973830522484, "driven_lanedir_consec": 0.33562834726570157, "sim_compute_sim_state": 0.02126616150585573, "sim_compute_performance-ego": 0.006130524535677326, "sim_compute_robot_state-ego": 0.009789530910662751, "sim_compute_robot_state-npc0": 0.009758981306161454, "sim_compute_robot_state-npc1": 0.009569331781188054, "sim_compute_robot_state-npc2": 0.010217581222306435, "sim_compute_robot_state-npc3": 0.009544159049418436, "sim_compute_robot_state-parked0": 0.009604752953372785}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 0.4329363594654913, "get_ui_image": 0.1000780827469296, "step_physics": 0.2764091557926602, "survival_time": 3.599999999999995, "driven_lanedir": 0.39691378837115976, "get_state_dump": 0.032731986708111234, "sim_render-ego": 0.006884621249304878, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.05831510821978251, "deviation-heading": 0.6652122981427817, "complete-iteration": 0.5681448313925002, "set_robot_commands": 0.007074226935704549, "deviation-center-line": 0.10759910759553476, "driven_lanedir_consec": 0.39691378837115976, "sim_compute_sim_state": 0.02181414431995816, "sim_compute_performance-ego": 0.0054027073913150364, "sim_compute_robot_state-ego": 0.009610527091556124, "sim_compute_robot_state-npc0": 0.010411888360977173, "sim_compute_robot_state-npc1": 0.009352809853023954, "sim_compute_robot_state-npc2": 0.00982777608765496, "sim_compute_robot_state-npc3": 0.01001468300819397, "sim_compute_robot_state-parked0": 0.009945048226250542}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.7382065538811262, "get_ui_image": 0.100705185178983, "step_physics": 0.2901668124279733, "survival_time": 5.899999999999987, "driven_lanedir": 0.4118068175575247, "get_state_dump": 0.03312959509380793, "sim_render-ego": 0.0067269478814076565, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.05725395679473877, "deviation-heading": 1.2784469606256983, "complete-iteration": 0.5766934742361812, "set_robot_commands": 0.006486278469279661, "deviation-center-line": 0.23135695707018697, "driven_lanedir_consec": 0.4118068175575247, "sim_compute_sim_state": 0.01839646040383032, "sim_compute_performance-ego": 0.005623752787961798, "sim_compute_robot_state-ego": 0.009188866211196123, "sim_compute_robot_state-npc0": 0.009674904710155422, "sim_compute_robot_state-npc1": 0.009975037332308494, "sim_compute_robot_state-npc2": 0.010083643056578556, "sim_compute_robot_state-npc3": 0.009618579331090896, "sim_compute_robot_state-parked0": 0.009386672811993098}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.17405896208775412, "get_ui_image": 0.10763515125621448, "step_physics": 0.2741940599499327, "survival_time": 1.6500000000000008, "driven_lanedir": 0.05875985801473016, "get_state_dump": 0.0340917832923658, "sim_render-ego": 0.006856940009377219, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.05034885984478575, "deviation-heading": 0.7417169785339611, "complete-iteration": 0.5636850053613837, "set_robot_commands": 0.006758682655565666, "deviation-center-line": 0.09068351993748695, "driven_lanedir_consec": 0.05875985801473016, "sim_compute_sim_state": 0.01931417349613074, "sim_compute_performance-ego": 0.005853566256436435, "sim_compute_robot_state-ego": 0.01014402418425589, "sim_compute_robot_state-npc0": 0.010315765034068714, "sim_compute_robot_state-npc1": 0.009595769824403706, "sim_compute_robot_state-npc2": 0.0091245969136556, "sim_compute_robot_state-npc3": 0.009551373395052824, "sim_compute_robot_state-parked0": 0.009598305731108694}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.9392406312042552, "get_ui_image": 0.10043447732925416, "step_physics": 0.25329249143600463, "survival_time": 14.950000000000076, "driven_lanedir": 1.1561284143587296, "get_state_dump": 0.034124481678009036, "sim_render-ego": 0.006902469793955485, "in-drivable-lane": 3.0500000000000247, "agent_compute-ego": 0.05666946887969971, "deviation-heading": 7.187037940572696, "complete-iteration": 0.5470244129498799, "set_robot_commands": 0.006136127312978109, "deviation-center-line": 1.1647826176558174, "driven_lanedir_consec": 1.0837875420045748, "sim_compute_sim_state": 0.02571924130121867, "sim_compute_performance-ego": 0.005417040983835856, "sim_compute_robot_state-ego": 0.009699650605519613, "sim_compute_robot_state-npc0": 0.009512534936269124, "sim_compute_robot_state-npc1": 0.009868280092875164, "sim_compute_robot_state-npc2": 0.009689555962880451, "sim_compute_robot_state-npc3": 0.009650154908498128, "sim_compute_robot_state-parked0": 0.009627362887064617}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.5412539624800152, "get_ui_image": 0.09869611911693876, "step_physics": 0.2661470908001377, "survival_time": 11.950000000000037, "driven_lanedir": 0.31505004312811646, "get_state_dump": 0.03399646232317681, "sim_render-ego": 0.006761589808444099, "in-drivable-lane": 8.450000000000044, "agent_compute-ego": 0.05994643726109461, "deviation-heading": 2.013899938875534, "complete-iteration": 0.5574761444554668, "set_robot_commands": 0.006389034343065078, "deviation-center-line": 0.20532834168569436, "driven_lanedir_consec": 0.31505004312811646, "sim_compute_sim_state": 0.02133166740130181, "sim_compute_performance-ego": 0.005589991932633532, "sim_compute_robot_state-ego": 0.009550669203243494, "sim_compute_robot_state-npc0": 0.00980739314187022, "sim_compute_robot_state-npc1": 0.00978788970404589, "sim_compute_robot_state-npc2": 0.009867135450929775, "sim_compute_robot_state-npc3": 0.009500437700598809, "sim_compute_robot_state-parked0": 0.00980783306903919}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.939162914868637, "get_ui_image": 0.09938755750656128, "step_physics": 0.2756494625409444, "survival_time": 14.950000000000076, "driven_lanedir": 0.8818221686713295, "get_state_dump": 0.03415938933690389, "sim_render-ego": 0.0071510561307271325, "in-drivable-lane": 6.70000000000004, "agent_compute-ego": 0.06137612422307332, "deviation-heading": 3.463991225264077, "complete-iteration": 0.5678118753433228, "set_robot_commands": 0.00634116252263387, "deviation-center-line": 0.5234230846888496, "driven_lanedir_consec": 0.8818221686713295, "sim_compute_sim_state": 0.018962525526682535, "sim_compute_performance-ego": 0.005771737893422444, "sim_compute_robot_state-ego": 0.009789580504099529, "sim_compute_robot_state-npc0": 0.00994386355082194, "sim_compute_robot_state-npc1": 0.009853610197703044, "sim_compute_robot_state-npc2": 0.009541252454121909, "sim_compute_robot_state-npc3": 0.0098272967338562, "sim_compute_robot_state-parked0": 0.009773604075113932}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.9395823507939616, "get_ui_image": 0.09537798881530762, "step_physics": 0.2620004367828369, "survival_time": 14.950000000000076, "driven_lanedir": 0.7421887733821109, "get_state_dump": 0.034170504411061606, "sim_render-ego": 0.007148936589558919, "in-drivable-lane": 8.250000000000048, "agent_compute-ego": 0.05978313366572062, "deviation-heading": 2.1544585695988134, "complete-iteration": 0.5486932961146037, "set_robot_commands": 0.006286377906799316, "deviation-center-line": 0.3769159994003494, "driven_lanedir_consec": 0.7421887733821109, "sim_compute_sim_state": 0.01848047415415446, "sim_compute_performance-ego": 0.005796831448872884, "sim_compute_robot_state-ego": 0.00990780750910441, "sim_compute_robot_state-npc0": 0.009977993170420328, "sim_compute_robot_state-npc1": 0.010003390312194825, "sim_compute_robot_state-npc2": 0.009790958563486735, "sim_compute_robot_state-npc3": 0.00982848008473714, "sim_compute_robot_state-parked0": 0.009847325483957926}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.3355741291925325, "get_ui_image": 0.0990194701231443, "step_physics": 0.2724522386605923, "survival_time": 10.400000000000013, "driven_lanedir": 0.9585968231998608, "get_state_dump": 0.033412047303639926, "sim_render-ego": 0.007198921762979948, "in-drivable-lane": 2.3500000000000245, "agent_compute-ego": 0.06349092721939087, "deviation-heading": 2.0316248117868514, "complete-iteration": 0.5654182743567687, "set_robot_commands": 0.006388402902162992, "deviation-center-line": 0.8161973938180549, "driven_lanedir_consec": 0.9585968231998608, "sim_compute_sim_state": 0.019849888407267056, "sim_compute_performance-ego": 0.005670008751062246, "sim_compute_robot_state-ego": 0.00969588068815378, "sim_compute_robot_state-npc0": 0.009488224983215332, "sim_compute_robot_state-npc1": 0.00968182316193214, "sim_compute_robot_state-npc2": 0.009630618187097402, "sim_compute_robot_state-npc3": 0.009608001663134648, "sim_compute_robot_state-parked0": 0.009551450610160828}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.9129601154273224, "get_ui_image": 0.10464968277236164, "step_physics": 0.26545543347374867, "survival_time": 14.750000000000076, "driven_lanedir": 1.2983759902069396, "get_state_dump": 0.03418765552973343, "sim_render-ego": 0.006936215546171544, "in-drivable-lane": 3.4000000000000483, "agent_compute-ego": 0.06384831767971233, "deviation-heading": 3.660762866275989, "complete-iteration": 0.5638926562616381, "set_robot_commands": 0.006271384126048977, "deviation-center-line": 0.92441893646212, "driven_lanedir_consec": 1.2983759902069396, "sim_compute_sim_state": 0.01872999789351124, "sim_compute_performance-ego": 0.005523675175036414, "sim_compute_robot_state-ego": 0.009750476934142032, "sim_compute_robot_state-npc0": 0.009647525367090258, "sim_compute_robot_state-npc1": 0.009594787985591564, "sim_compute_robot_state-npc2": 0.009675142320535951, "sim_compute_robot_state-npc3": 0.009844395265740864, "sim_compute_robot_state-parked0": 0.009495247016518804}}
set_robot_commands_max0.007074226935704549
set_robot_commands_mean0.0064772040269649835
set_robot_commands_median0.006388718622614035
set_robot_commands_min0.006136127312978109
sim_compute_performance-ego_max0.006130524535677326
sim_compute_performance-ego_mean0.005677983715625398
sim_compute_performance-ego_median0.005646880769512022
sim_compute_performance-ego_min0.0054027073913150364
sim_compute_robot_state-ego_max0.01014402418425589
sim_compute_robot_state-ego_mean0.009712701384193374
sim_compute_robot_state-ego_median0.009725063769830823
sim_compute_robot_state-ego_min0.009188866211196123
sim_compute_robot_state-npc0_max0.010411888360977173
sim_compute_robot_state-npc0_mean0.009853907456104996
sim_compute_robot_state-npc0_median0.009783187224015836
sim_compute_robot_state-npc0_min0.009488224983215332
sim_compute_robot_state-npc1_max0.010003390312194825
sim_compute_robot_state-npc1_mean0.009728273024526684
sim_compute_robot_state-npc1_median0.009734856432989014
sim_compute_robot_state-npc1_min0.009352809853023954
sim_compute_robot_state-npc2_max0.010217581222306435
sim_compute_robot_state-npc2_mean0.009744826021924778
sim_compute_robot_state-npc2_median0.009740257263183595
sim_compute_robot_state-npc2_min0.0091245969136556
sim_compute_robot_state-npc3_max0.01001468300819397
sim_compute_robot_state-npc3_mean0.009698756114032193
sim_compute_robot_state-npc3_median0.009634367119794512
sim_compute_robot_state-npc3_min0.009500437700598809
sim_compute_robot_state-parked0_max0.009945048226250542
sim_compute_robot_state-parked0_mean0.009663760286458042
sim_compute_robot_state-parked0_median0.0096160579202187
sim_compute_robot_state-parked0_min0.009386672811993098
sim_compute_sim_state_max0.02571924130121867
sim_compute_sim_state_mean0.020386473440991072
sim_compute_sim_state_median0.0195820309516989
sim_compute_sim_state_min0.01839646040383032
sim_render-ego_max0.007299437451718458
sim_render-ego_mean0.006986713622364535
sim_render-ego_median0.006919342670063514
sim_render-ego_min0.0067269478814076565
simulation-passed1
step_physics_max0.2901668124279733
step_physics_mean0.270007002985518
step_physics_median0.26929966473036504
step_physics_min0.25329249143600463
survival_time_max14.950000000000076
survival_time_mean9.645000000000032
survival_time_min1.6500000000000008

Highlights

34372

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-1-1

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-2-1

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-3-1

ETHZ_autolab_technical_track-4-0

ETHZ_autolab_technical_track-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.