Duckietown Challenges Home Challenges Submissions

Submission 4404

Submission4404
Competingyes
Challengeaido3-LFV-sim-testing
UserAlex Deliyannis
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27462
Next
User labelchallenge-aido_LF-template-tensorflow
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
27462step1-simulationsuccessyes0:10:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.23631341009403584
survival_time_median1.0000000000000002
deviation-center-line_median0.06506280426212205
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03253335219163161
agent_compute-ego_mean0.02872816582463347
agent_compute-ego_median0.02799689769744873
agent_compute-ego_min0.024882018566131592
deviation-center-line_max0.12248946832205532
deviation-center-line_mean0.06883650683706119
deviation-center-line_min0.03866885633962419
deviation-heading_max0.6825851825213449
deviation-heading_mean0.4236013239089602
deviation-heading_median0.43245935302508554
deviation-heading_min0.15274853879697994
driven_any_max0.435811889651772
driven_any_mean0.29038579834363426
driven_any_median0.2863968970065738
driven_any_min0.19444673160941617
driven_lanedir_consec_max0.3818105767101674
driven_lanedir_consec_mean0.2402079180928385
driven_lanedir_consec_min0.15605639488417378
driven_lanedir_max0.3818105767101674
driven_lanedir_mean0.2402079180928385
driven_lanedir_median0.23631341009403584
driven_lanedir_min0.15605639488417378
in-drivable-lane_max0.05000000000000005
in-drivable-lane_mean0.010000000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2863968970065738, "sim_physics": 0.15605669021606444, "survival_time": 1.0000000000000002, "driven_lanedir": 0.23631341009403584, "sim_render-ego": 0.012744450569152832, "in-drivable-lane": 0.04999999999999993, "agent_compute-ego": 0.0265913724899292, "deviation-heading": 0.3883337785520484, "set_robot_commands": 0.007698225975036621, "deviation-center-line": 0.051632004151774505, "driven_lanedir_consec": 0.23631341009403584, "sim_compute_sim_state": 0.004842722415924072, "sim_compute_performance-ego": 0.007319211959838867, "sim_compute_robot_state-ego": 0.00931941270828247, "sim_compute_robot_state-npc0": 0.007720398902893067, "sim_compute_robot_state-npc1": 0.008195161819458008, "sim_compute_robot_state-npc2": 0.007808339595794678, "sim_compute_robot_state-npc3": 0.007776594161987305}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.234923235395348, "sim_physics": 0.17042492628097533, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1633417165629436, "sim_render-ego": 0.01377711296081543, "in-drivable-lane": 0, "agent_compute-ego": 0.028824317455291747, "deviation-heading": 0.5123514093463503, "set_robot_commands": 0.009134960174560548, "deviation-center-line": 0.0573237364130864, "driven_lanedir_consec": 0.1633417165629436, "sim_compute_sim_state": 0.005047452449798584, "sim_compute_performance-ego": 0.0073874473571777345, "sim_compute_robot_state-ego": 0.009455227851867675, "sim_compute_robot_state-npc0": 0.009709298610687256, "sim_compute_robot_state-npc1": 0.00825425386428833, "sim_compute_robot_state-npc2": 0.008027434349060059, "sim_compute_robot_state-npc3": 0.008939743041992188}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.30391903375090085, "sim_physics": 0.14956978956858316, "survival_time": 1.2000000000000004, "driven_lanedir": 0.20491262664081733, "sim_render-ego": 0.013685842355092369, "in-drivable-lane": 0, "agent_compute-ego": 0.02799689769744873, "deviation-heading": 0.6825851825213449, "set_robot_commands": 0.00955157478650411, "deviation-center-line": 0.09606667382303734, "driven_lanedir_consec": 0.20491262664081733, "sim_compute_sim_state": 0.004666497310002645, "sim_compute_performance-ego": 0.007610638936360677, "sim_compute_robot_state-ego": 0.009727120399475098, "sim_compute_robot_state-npc0": 0.008532057205835978, "sim_compute_robot_state-npc1": 0.008877962827682495, "sim_compute_robot_state-npc2": 0.008456140756607056, "sim_compute_robot_state-npc3": 0.008133798837661743}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2738039531713772, "sim_physics": 0.17602124214172363, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2437449478717194, "sim_render-ego": 0.014212489128112791, "in-drivable-lane": 0, "agent_compute-ego": 0.03228803873062134, "deviation-heading": 0.43245935302508554, "set_robot_commands": 0.010007548332214357, "deviation-center-line": 0.06525733509857072, "driven_lanedir_consec": 0.2437449478717194, "sim_compute_sim_state": 0.0053515791893005375, "sim_compute_performance-ego": 0.00911620855331421, "sim_compute_robot_state-ego": 0.009487283229827882, "sim_compute_robot_state-npc0": 0.009373033046722412, "sim_compute_robot_state-npc1": 0.009835505485534668, "sim_compute_robot_state-npc2": 0.009245645999908448, "sim_compute_robot_state-npc3": 0.008600580692291259}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.34165119571448826, "sim_physics": 0.1587196680215689, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28405290434106645, "sim_render-ego": 0.015169409605172964, "in-drivable-lane": 0, "agent_compute-ego": 0.03253335219163161, "deviation-heading": 0.5114881760503482, "set_robot_commands": 0.009766633693988506, "deviation-center-line": 0.03866885633962419, "driven_lanedir_consec": 0.28405290434106645, "sim_compute_sim_state": 0.005582910317641038, "sim_compute_performance-ego": 0.007956284743088942, "sim_compute_robot_state-ego": 0.00991073021521935, "sim_compute_robot_state-npc0": 0.00961885085472694, "sim_compute_robot_state-npc1": 0.009489884743323691, "sim_compute_robot_state-npc2": 0.009542355170616737, "sim_compute_robot_state-npc3": 0.008846539717454176}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.37082894265900707, "sim_physics": 0.16825027465820314, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3263582236103111, "sim_render-ego": 0.014610328674316409, "in-drivable-lane": 0, "agent_compute-ego": 0.03231172561645508, "deviation-heading": 0.3931147516933041, "set_robot_commands": 0.009998855590820312, "deviation-center-line": 0.04632705920862815, "driven_lanedir_consec": 0.3263582236103111, "sim_compute_sim_state": 0.005557699203491211, "sim_compute_performance-ego": 0.00794281005859375, "sim_compute_robot_state-ego": 0.009751081466674805, "sim_compute_robot_state-npc0": 0.009504032135009766, "sim_compute_robot_state-npc1": 0.009612083435058594, "sim_compute_robot_state-npc2": 0.009206876754760744, "sim_compute_robot_state-npc3": 0.008961286544799805}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.19487324154133864, "sim_physics": 0.2042918046315511, "survival_time": 0.7500000000000001, "driven_lanedir": 0.17128165981682342, "sim_render-ego": 0.015062491099039711, "in-drivable-lane": 0, "agent_compute-ego": 0.032294909159342446, "deviation-heading": 0.2756983653720393, "set_robot_commands": 0.009709517161051432, "deviation-center-line": 0.06506280426212205, "driven_lanedir_consec": 0.17128165981682342, "sim_compute_sim_state": 0.005155229568481445, "sim_compute_performance-ego": 0.008278735478719075, "sim_compute_robot_state-ego": 0.00913364092508952, "sim_compute_robot_state-npc0": 0.009198745091756184, "sim_compute_robot_state-npc1": 0.0092011292775472, "sim_compute_robot_state-npc2": 0.009193801879882812, "sim_compute_robot_state-npc3": 0.008757940928141276}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.19444673160941617, "sim_physics": 0.16042065620422363, "survival_time": 0.9000000000000002, "driven_lanedir": 0.15605639488417378, "sim_render-ego": 0.012520379490322538, "in-drivable-lane": 0, "agent_compute-ego": 0.02865367465549045, "deviation-heading": 0.30087251658153535, "set_robot_commands": 0.008089847034878202, "deviation-center-line": 0.06087988144540214, "driven_lanedir_consec": 0.15605639488417378, "sim_compute_sim_state": 0.005834884113735623, "sim_compute_performance-ego": 0.007924199104309082, "sim_compute_robot_state-ego": 0.008834812376234267, "sim_compute_robot_state-npc0": 0.009451707204182943, "sim_compute_robot_state-npc1": 0.00906315114763048, "sim_compute_robot_state-npc2": 0.008573426140679253, "sim_compute_robot_state-npc3": 0.008932007683648003}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.435811889651772, "sim_physics": 0.12603206634521483, "survival_time": 1.5000000000000009, "driven_lanedir": 0.3818105767101674, "sim_render-ego": 0.012359007199605306, "in-drivable-lane": 0, "agent_compute-ego": 0.026887996991475423, "deviation-heading": 0.5852745342218716, "set_robot_commands": 0.008757781982421876, "deviation-center-line": 0.12248946832205532, "driven_lanedir_consec": 0.3818105767101674, "sim_compute_sim_state": 0.00502012570699056, "sim_compute_performance-ego": 0.007049973805745443, "sim_compute_robot_state-ego": 0.008357532819112142, "sim_compute_robot_state-npc0": 0.008264931042989095, "sim_compute_robot_state-npc1": 0.008333182334899903, "sim_compute_robot_state-npc2": 0.007914113998413085, "sim_compute_robot_state-npc3": 0.008501545588175455}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.328619643548658, "sim_physics": 0.13694153229395548, "survival_time": 1.2000000000000004, "driven_lanedir": 0.2663851931149388, "sim_render-ego": 0.01179047425587972, "in-drivable-lane": 0, "agent_compute-ego": 0.024882018566131592, "deviation-heading": 0.547135809804864, "set_robot_commands": 0.007652401924133301, "deviation-center-line": 0.08441712027510609, "driven_lanedir_consec": 0.2663851931149388, "sim_compute_sim_state": 0.004615098237991333, "sim_compute_performance-ego": 0.0067959825197855634, "sim_compute_robot_state-ego": 0.007952898740768433, "sim_compute_robot_state-npc0": 0.008015920718510946, "sim_compute_robot_state-npc1": 0.00780719518661499, "sim_compute_robot_state-npc2": 0.007631013790766398, "sim_compute_robot_state-npc3": 0.007851779460906982}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.2927140508540439, "sim_physics": 0.1431864443279448, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2625214612026787, "sim_render-ego": 0.01293855621701195, "in-drivable-lane": 0, "agent_compute-ego": 0.027557191394624255, "deviation-heading": 0.40572159821551834, "set_robot_commands": 0.00902375720796131, "deviation-center-line": 0.06594402458865765, "driven_lanedir_consec": 0.2625214612026787, "sim_compute_sim_state": 0.005107550393967401, "sim_compute_performance-ego": 0.0072732652936662945, "sim_compute_robot_state-ego": 0.008898349035353888, "sim_compute_robot_state-npc0": 0.008700881685529436, "sim_compute_robot_state-npc1": 0.008773383640107654, "sim_compute_robot_state-npc2": 0.008244446345738001, "sim_compute_robot_state-npc3": 0.008690027963547479}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.27520060073343, "sim_physics": 0.16509867849804105, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2075163495656156, "sim_render-ego": 0.012612796965099517, "in-drivable-lane": 0, "agent_compute-ego": 0.027029707318260557, "deviation-heading": 0.4463252511069403, "set_robot_commands": 0.00798526264372326, "deviation-center-line": 0.06288901855249772, "driven_lanedir_consec": 0.2075163495656156, "sim_compute_sim_state": 0.004869756244477772, "sim_compute_performance-ego": 0.007522900899251302, "sim_compute_robot_state-ego": 0.009881837027413505, "sim_compute_robot_state-npc0": 0.008869386854625884, "sim_compute_robot_state-npc1": 0.007713420050484794, "sim_compute_robot_state-npc2": 0.008073159626552038, "sim_compute_robot_state-npc3": 0.008345002219790504}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.23504953678764193, "sim_physics": 0.1899479627609253, "survival_time": 0.9000000000000002, "driven_lanedir": 0.1846320087674136, "sim_render-ego": 0.012208951844109427, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.02724562750922309, "deviation-heading": 0.2480911615377306, "set_robot_commands": 0.008872853385077583, "deviation-center-line": 0.06551644678834918, "driven_lanedir_consec": 0.1846320087674136, "sim_compute_sim_state": 0.005763265821668837, "sim_compute_performance-ego": 0.00649759504530165, "sim_compute_robot_state-ego": 0.008507092793782553, "sim_compute_robot_state-npc0": 0.009124437967936196, "sim_compute_robot_state-npc1": 0.00817455185784234, "sim_compute_robot_state-npc2": 0.008659005165100098, "sim_compute_robot_state-npc3": 0.008554180463155111}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.2485360495402546, "sim_physics": 0.12574335148459986, "survival_time": 0.9500000000000004, "driven_lanedir": 0.18204456077028383, "sim_render-ego": 0.012306175733867443, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.029053110825388057, "deviation-heading": 0.47181943180844255, "set_robot_commands": 0.008934673510099711, "deviation-center-line": 0.05047110540274004, "driven_lanedir_consec": 0.18204456077028383, "sim_compute_sim_state": 0.004579995807848479, "sim_compute_performance-ego": 0.006998689551102488, "sim_compute_robot_state-ego": 0.008575288872969778, "sim_compute_robot_state-npc0": 0.007775645507009406, "sim_compute_robot_state-npc1": 0.007831711518137078, "sim_compute_robot_state-npc2": 0.007667328182019685, "sim_compute_robot_state-npc3": 0.007670076269852488}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.3390119731902636, "sim_physics": 0.16182957887649535, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3321467374395892, "sim_render-ego": 0.013726353645324709, "in-drivable-lane": 0, "agent_compute-ego": 0.026772546768188476, "deviation-heading": 0.15274853879697994, "set_robot_commands": 0.01906336545944214, "deviation-center-line": 0.09960206788426644, "driven_lanedir_consec": 0.3321467374395892, "sim_compute_sim_state": 0.004789292812347412, "sim_compute_performance-ego": 0.006917023658752441, "sim_compute_robot_state-ego": 0.008774673938751221, "sim_compute_robot_state-npc0": 0.007866621017456055, "sim_compute_robot_state-npc1": 0.007498311996459961, "sim_compute_robot_state-npc2": 0.007938671112060546, "sim_compute_robot_state-npc3": 0.00823122262954712}}
set_robot_commands_max0.01906336545944214
set_robot_commands_mean0.009616483924127553
set_robot_commands_median0.00902375720796131
set_robot_commands_min0.007652401924133301
sim_compute_performance-ego_max0.00911620855331421
sim_compute_performance-ego_mean0.007506064464333834
sim_compute_performance-ego_median0.0073874473571777345
sim_compute_performance-ego_min0.00649759504530165
sim_compute_robot_state-ego_max0.00991073021521935
sim_compute_robot_state-ego_mean0.009104465493388171
sim_compute_robot_state-ego_median0.00913364092508952
sim_compute_robot_state-ego_min0.007952898740768433
sim_compute_robot_state-npc0_max0.009709298610687256
sim_compute_robot_state-npc0_mean0.008781729856391437
sim_compute_robot_state-npc0_median0.008869386854625884
sim_compute_robot_state-npc0_min0.007720398902893067
sim_compute_robot_state-npc1_max0.009835505485534668
sim_compute_robot_state-npc1_mean0.008577392612338012
sim_compute_robot_state-npc1_median0.008333182334899903
sim_compute_robot_state-npc1_min0.007498311996459961
sim_compute_robot_state-npc2_max0.009542355170616737
sim_compute_robot_state-npc2_mean0.008412117257863975
sim_compute_robot_state-npc2_median0.008244446345738001
sim_compute_robot_state-npc2_min0.007631013790766398
sim_compute_robot_state-npc3_max0.008961286544799805
sim_compute_robot_state-npc3_mean0.008452821746863393
sim_compute_robot_state-npc3_median0.008554180463155111
sim_compute_robot_state-npc3_min0.007670076269852488
sim_compute_sim_state_max0.005834884113735623
sim_compute_sim_state_mean0.005118937306244463
sim_compute_sim_state_median0.005047452449798584
sim_compute_sim_state_min0.004579995807848479
sim_physics_max0.2042918046315511
sim_physics_mean0.159502311087338
sim_physics_median0.16042065620422363
sim_physics_min0.12574335148459986
sim_render-ego_max0.015169409605172964
sim_render-ego_mean0.01331498798286154
sim_render-ego_median0.01293855621701195
sim_render-ego_min0.01179047425587972
simulation-passed1
survival_time_max1.5000000000000009
survival_time_mean1.0700000000000005
survival_time_min0.7500000000000001
No reset possible
27461step1-simulationsuccessyes0:10:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible