Duckietown Challenges Home Challenges Submissions

Submission 2960

Submission2960
Competingyes
Challengeaido2-LFV-sim-testing
UserJulian Zilly
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22692
Next
User labelBaseline-IL-logs-tensorflow
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22692step1-simulationsuccessyes0:37:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2564970347765132
survival_time_median5.799999999999987
deviation-center-line_median0.19046981397989968
in-drivable-lane_median2.049999999999994


other stats
agent_compute-ego_max0.21340139492138013
agent_compute-ego_mean0.20520924829429335
agent_compute-ego_median0.20371831787957084
agent_compute-ego_min0.19839586908855136
deviation-center-line_max0.631202957468221
deviation-center-line_mean0.24876549314417593
deviation-center-line_min0.12585284666494312
deviation-heading_max3.6899566992010016
deviation-heading_mean1.4083353542713417
deviation-heading_median1.2818754590528434
deviation-heading_min0.7187601798061267
driven_any_max1.7437108194499853
driven_any_mean0.7109284802822099
driven_any_median0.6628893056402629
driven_any_min0.4121657440890793
driven_lanedir_consec_max1.7387158657217774
driven_lanedir_consec_mean0.36447779401369945
driven_lanedir_consec_min0.10378850428751862
driven_lanedir_max1.7387158657217774
driven_lanedir_mean0.3679941668837759
driven_lanedir_median0.2564970347765132
driven_lanedir_min0.1039720427824089
in-drivable-lane_max3.1999999999999886
in-drivable-lane_mean2.0033333333333276
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0885991135964888, "sim_physics": 0.09439379481946009, "survival_time": 8.84999999999999, "driven_lanedir": 0.6296195242844069, "sim_render-ego": 0.06297759821185958, "in-drivable-lane": 2.8000000000000043, "agent_compute-ego": 0.20136609185213425, "deviation-heading": 1.925911416171025, "set_robot_commands": 0.07880560422347764, "deviation-center-line": 0.4346604384870684, "driven_lanedir_consec": 0.6135080240964372, "sim_compute_sim_state": 0.03766440267616746, "sim_compute_performance-ego": 0.06563289421426374, "sim_compute_robot_state-ego": 0.06196098812555863, "sim_compute_robot_state-npc0": 0.07293866044383938, "sim_compute_robot_state-npc1": 0.06852419632302839, "sim_compute_robot_state-npc2": 0.06687803861111571, "sim_compute_robot_state-npc3": 0.06650903534754521}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7611218279388255, "sim_physics": 0.104807580931712, "survival_time": 5.899999999999987, "driven_lanedir": 0.2564970347765132, "sim_render-ego": 0.06188208773984748, "in-drivable-lane": 3.1999999999999886, "agent_compute-ego": 0.2023637840303324, "deviation-heading": 0.7866563570194921, "set_robot_commands": 0.07683523226592501, "deviation-center-line": 0.2679172559788478, "driven_lanedir_consec": 0.2564970347765132, "sim_compute_sim_state": 0.03685413982908605, "sim_compute_performance-ego": 0.06490720530687752, "sim_compute_robot_state-ego": 0.061648348630484885, "sim_compute_robot_state-npc0": 0.07150447368621826, "sim_compute_robot_state-npc1": 0.06490434630442474, "sim_compute_robot_state-npc2": 0.06396438711780612, "sim_compute_robot_state-npc3": 0.06326189283597267}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6901067663531373, "sim_physics": 0.09016122694673208, "survival_time": 5.799999999999987, "driven_lanedir": 0.3407235641575177, "sim_render-ego": 0.06298473580130215, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.2033551766954619, "deviation-heading": 1.4001786673752634, "set_robot_commands": 0.07752729900952043, "deviation-center-line": 0.23215862569447487, "driven_lanedir_consec": 0.3407235641575177, "sim_compute_sim_state": 0.035672368674442685, "sim_compute_performance-ego": 0.06446215613134976, "sim_compute_robot_state-ego": 0.06265014410018921, "sim_compute_robot_state-npc0": 0.07128053903579712, "sim_compute_robot_state-npc1": 0.0666953654124819, "sim_compute_robot_state-npc2": 0.06491082290123248, "sim_compute_robot_state-npc3": 0.06434226241605036}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6628893056402629, "sim_physics": 0.0916042761369185, "survival_time": 5.4999999999999885, "driven_lanedir": 0.34269478843666157, "sim_render-ego": 0.0644241679798473, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.20232618722048673, "deviation-heading": 1.959200254447923, "set_robot_commands": 0.07644082199443471, "deviation-center-line": 0.26533398258816154, "driven_lanedir_consec": 0.3350252523542694, "sim_compute_sim_state": 0.03799872181632302, "sim_compute_performance-ego": 0.06575977802276611, "sim_compute_robot_state-ego": 0.062354024973782625, "sim_compute_robot_state-npc0": 0.07483699105002663, "sim_compute_robot_state-npc1": 0.07004897594451905, "sim_compute_robot_state-npc2": 0.06767524155703458, "sim_compute_robot_state-npc3": 0.06644494316794655}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6719868161298712, "sim_physics": 0.0892760468344403, "survival_time": 5.849999999999987, "driven_lanedir": 0.28874208356974596, "sim_render-ego": 0.06387762126759586, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 0.20371831787957084, "deviation-heading": 1.2818754590528434, "set_robot_commands": 0.07670067518185346, "deviation-center-line": 0.17306197204886853, "driven_lanedir_consec": 0.28874208356974596, "sim_compute_sim_state": 0.03730415482806344, "sim_compute_performance-ego": 0.06481288844703609, "sim_compute_robot_state-ego": 0.0620675718682444, "sim_compute_robot_state-npc0": 0.07329488004374708, "sim_compute_robot_state-npc1": 0.0689140446165688, "sim_compute_robot_state-npc2": 0.06471677315540802, "sim_compute_robot_state-npc3": 0.065689300879454}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4121657440890793, "sim_physics": 0.10617291182279588, "survival_time": 3.1999999999999966, "driven_lanedir": 0.1039720427824089, "sim_render-ego": 0.06528476253151894, "in-drivable-lane": 1.6999999999999962, "agent_compute-ego": 0.20422540605068207, "deviation-heading": 0.9666145699178194, "set_robot_commands": 0.0772901102900505, "deviation-center-line": 0.14439255646125687, "driven_lanedir_consec": 0.10378850428751862, "sim_compute_sim_state": 0.03754864260554314, "sim_compute_performance-ego": 0.06501493602991104, "sim_compute_robot_state-ego": 0.061612773686647415, "sim_compute_robot_state-npc0": 0.07163716852664948, "sim_compute_robot_state-npc1": 0.06808338686823845, "sim_compute_robot_state-npc2": 0.07101225852966309, "sim_compute_robot_state-npc3": 0.06588808447122574}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.5696118204294266, "sim_physics": 0.09242634634369784, "survival_time": 5.14999999999999, "driven_lanedir": 0.23767936204597917, "sim_render-ego": 0.06296688839069849, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.2109930631026481, "deviation-heading": 1.343765120258015, "set_robot_commands": 0.07773398658604298, "deviation-center-line": 0.17575713737049994, "driven_lanedir_consec": 0.23767936204597917, "sim_compute_sim_state": 0.03933679941788461, "sim_compute_performance-ego": 0.06482512742570302, "sim_compute_robot_state-ego": 0.06298026066381955, "sim_compute_robot_state-npc0": 0.07495416020884098, "sim_compute_robot_state-npc1": 0.06911006251585136, "sim_compute_robot_state-npc2": 0.06718795739331292, "sim_compute_robot_state-npc3": 0.0687619505576717}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.7437108194499853, "sim_physics": 0.09250037829081216, "survival_time": 14.950000000000076, "driven_lanedir": 1.7387158657217774, "sim_render-ego": 0.0592819348971049, "in-drivable-lane": 0, "agent_compute-ego": 0.20078521807988484, "deviation-heading": 0.8464405907175748, "set_robot_commands": 0.07619291543960571, "deviation-center-line": 0.631202957468221, "driven_lanedir_consec": 1.7387158657217774, "sim_compute_sim_state": 0.03586625973383586, "sim_compute_performance-ego": 0.06092290004094442, "sim_compute_robot_state-ego": 0.05989560921986898, "sim_compute_robot_state-npc0": 0.0708382519086202, "sim_compute_robot_state-npc1": 0.06568316380182902, "sim_compute_robot_state-npc2": 0.06372366110483806, "sim_compute_robot_state-npc3": 0.06387045701344808}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.5093097004826268, "sim_physics": 0.09546133828541588, "survival_time": 3.149999999999997, "driven_lanedir": 0.1884459549849815, "sim_render-ego": 0.05860351380847749, "in-drivable-lane": 1.499999999999996, "agent_compute-ego": 0.19839586908855136, "deviation-heading": 0.7390803559351188, "set_robot_commands": 0.07611176702711317, "deviation-center-line": 0.12585284666494312, "driven_lanedir_consec": 0.1884459549849815, "sim_compute_sim_state": 0.03692298086862716, "sim_compute_performance-ego": 0.06227876269628131, "sim_compute_robot_state-ego": 0.061978343933347675, "sim_compute_robot_state-npc0": 0.07235103561764672, "sim_compute_robot_state-npc1": 0.06621737328786699, "sim_compute_robot_state-npc2": 0.06402856963021415, "sim_compute_robot_state-npc3": 0.06572105014134967}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.541053611235075, "sim_physics": 0.11089417513679056, "survival_time": 4.249999999999993, "driven_lanedir": 0.2469171765467544, "sim_render-ego": 0.06226960911470301, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.20955420662375057, "deviation-heading": 1.1647295082897051, "set_robot_commands": 0.0770387284895953, "deviation-center-line": 0.19046981397989968, "driven_lanedir_consec": 0.24400727243057976, "sim_compute_sim_state": 0.03694644535289091, "sim_compute_performance-ego": 0.06475725173950195, "sim_compute_robot_state-ego": 0.06401635618770823, "sim_compute_robot_state-npc0": 0.0745756093193503, "sim_compute_robot_state-npc1": 0.06730589586145738, "sim_compute_robot_state-npc2": 0.06597322856678682, "sim_compute_robot_state-npc3": 0.06665061782388126}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.7019353605213867, "sim_physics": 0.09296444862607926, "survival_time": 6.299999999999986, "driven_lanedir": 0.25498099087611514, "sim_render-ego": 0.06524780061509874, "in-drivable-lane": 3.1999999999999886, "agent_compute-ego": 0.20980849909403967, "deviation-heading": 1.1784541713445174, "set_robot_commands": 0.07884430885314941, "deviation-center-line": 0.1850308545410544, "driven_lanedir_consec": 0.25498099087611514, "sim_compute_sim_state": 0.03824859952169751, "sim_compute_performance-ego": 0.06608895271543473, "sim_compute_robot_state-ego": 0.06417756610446507, "sim_compute_robot_state-npc0": 0.07412343933468774, "sim_compute_robot_state-npc1": 0.07020338187142024, "sim_compute_robot_state-npc2": 0.06858603916470966, "sim_compute_robot_state-npc3": 0.06819934693593828}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.7249698254550386, "sim_physics": 0.09393391464695786, "survival_time": 6.5999999999999845, "driven_lanedir": 0.2615327562744043, "sim_render-ego": 0.06053919141942805, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.2005307421539769, "deviation-heading": 1.542043438433386, "set_robot_commands": 0.07786295088854703, "deviation-center-line": 0.21692850994169724, "driven_lanedir_consec": 0.2615327562744043, "sim_compute_sim_state": 0.03626149531566736, "sim_compute_performance-ego": 0.06206380056612419, "sim_compute_robot_state-ego": 0.060288277539339935, "sim_compute_robot_state-npc0": 0.06954155004385745, "sim_compute_robot_state-npc1": 0.06586465149214774, "sim_compute_robot_state-npc2": 0.06397032015251392, "sim_compute_robot_state-npc3": 0.06369914249940352}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.48055021803102993, "sim_physics": 0.0901252321294836, "survival_time": 3.699999999999995, "driven_lanedir": 0.14002373328867945, "sim_render-ego": 0.06263970362173545, "in-drivable-lane": 2.049999999999994, "agent_compute-ego": 0.21340139492138013, "deviation-heading": 0.7187601798061267, "set_robot_commands": 0.07682711369282491, "deviation-center-line": 0.1761372560016644, "driven_lanedir_consec": 0.14002373328867945, "sim_compute_sim_state": 0.03675940552273312, "sim_compute_performance-ego": 0.06472397817147744, "sim_compute_robot_state-ego": 0.0612578263153901, "sim_compute_robot_state-npc0": 0.07400263000178982, "sim_compute_robot_state-npc1": 0.06857561098562705, "sim_compute_robot_state-npc2": 0.0678655617945903, "sim_compute_robot_state-npc3": 0.0676457269771679}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.5965972507988898, "sim_physics": 0.09787058645440629, "survival_time": 6.449999999999985, "driven_lanedir": 0.30159834994671453, "sim_render-ego": 0.0642276216847028, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.21206943378892057, "deviation-heading": 3.6899566992010016, "set_robot_commands": 0.07754764445992403, "deviation-center-line": 0.3540561545704014, "driven_lanedir_consec": 0.27761492573111557, "sim_compute_sim_state": 0.03975428906522056, "sim_compute_performance-ego": 0.06591807224953822, "sim_compute_robot_state-ego": 0.06255584169727887, "sim_compute_robot_state-npc0": 0.07592710598494655, "sim_compute_robot_state-npc1": 0.07048199343126874, "sim_compute_robot_state-npc2": 0.06781450537748115, "sim_compute_robot_state-npc3": 0.06692306385483852}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.5093190240820255, "sim_physics": 0.10034334504759156, "survival_time": 3.8499999999999943, "driven_lanedir": 0.1877692755639804, "sim_render-ego": 0.06366282933718198, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.20524533383257976, "deviation-heading": 1.5813635261003127, "set_robot_commands": 0.07747705261428635, "deviation-center-line": 0.15852203536557977, "driven_lanedir_consec": 0.18588158560985724, "sim_compute_sim_state": 0.03633026333598347, "sim_compute_performance-ego": 0.06490541433359122, "sim_compute_robot_state-ego": 0.062367364957735136, "sim_compute_robot_state-npc0": 0.07302775011434183, "sim_compute_robot_state-npc1": 0.06944203996039056, "sim_compute_robot_state-npc2": 0.06778356936070826, "sim_compute_robot_state-npc3": 0.06525596705350009}}
set_robot_commands_max0.07884430885314941
set_robot_commands_mean0.0772824140677567
set_robot_commands_median0.0772901102900505
set_robot_commands_min0.07611176702711317
sim_compute_performance-ego_max0.06608895271543473
sim_compute_performance-ego_mean0.06447160787272005
sim_compute_performance-ego_median0.06482512742570302
sim_compute_performance-ego_min0.06092290004094442
sim_compute_robot_state-ego_max0.06417756610446507
sim_compute_robot_state-ego_mean0.06212075320025738
sim_compute_robot_state-ego_median0.0620675718682444
sim_compute_robot_state-ego_min0.05989560921986898
sim_compute_robot_state-npc0_max0.07592710598494655
sim_compute_robot_state-npc0_mean0.07298894968802398
sim_compute_robot_state-npc0_median0.07302775011434183
sim_compute_robot_state-npc0_min0.06954155004385745
sim_compute_robot_state-npc1_max0.07048199343126874
sim_compute_robot_state-npc1_mean0.06800363257847471
sim_compute_robot_state-npc1_median0.06852419632302839
sim_compute_robot_state-npc1_min0.06490434630442474
sim_compute_robot_state-npc2_max0.07101225852966309
sim_compute_robot_state-npc2_mean0.06640606229449435
sim_compute_robot_state-npc2_median0.06687803861111571
sim_compute_robot_state-npc2_min0.06372366110483806
sim_compute_robot_state-npc3_max0.0687619505576717
sim_compute_robot_state-npc3_mean0.06592418946502625
sim_compute_robot_state-npc3_median0.06588808447122574
sim_compute_robot_state-npc3_min0.06326189283597267
sim_compute_sim_state_max0.03975428906522056
sim_compute_sim_state_mean0.03729793123761108
sim_compute_sim_state_median0.03694644535289091
sim_compute_sim_state_min0.035672368674442685
sim_physics_max0.11089417513679056
sim_physics_mean0.09619570683021958
sim_physics_median0.09393391464695786
sim_physics_min0.0892760468344403
sim_render-ego_max0.06528476253151894
sim_render-ego_mean0.06272467109474014
sim_render-ego_median0.06297759821185958
sim_render-ego_min0.05860351380847749
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean5.966666666666662
survival_time_min3.149999999999997
No reset possible