Duckietown Challenges Home Challenges Submissions

Submission 3632

Submission3632
Competingyes
Challengeaido2-LFVI-sim-testing
UserNicky Eichmann
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23394
Next
User label-
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
23394step1-simulationsuccessyes0:29:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4443672320455454
survival_time_median2.6499999999999986
deviation-center-line_median0.15455097642444732
in-drivable-lane_median0.5500000000000005


other stats
agent_compute-ego_max0.19856962703523184
agent_compute-ego_mean0.18069309699713895
agent_compute-ego_median0.17933961417939928
agent_compute-ego_min0.1724569116319929
deviation-center-line_max1.0784358315519502
deviation-center-line_mean0.25264532820047036
deviation-center-line_min0.054904029848945685
deviation-heading_max3.51076556334061
deviation-heading_mean1.0660647139887165
deviation-heading_median0.49698439206309897
deviation-heading_min0.13989224355569133
driven_any_max3.1292285179821775
driven_any_mean1.2030428238318789
driven_any_median1.078561487351979
driven_any_min0.37149985167138017
driven_lanedir_consec_max2.3505274914597605
driven_lanedir_consec_mean0.8313841401026959
driven_lanedir_consec_min0.17855427696068582
driven_lanedir_max2.382026106670273
driven_lanedir_mean0.9063043699176117
driven_lanedir_median0.4443672320455454
driven_lanedir_min0.17855427696068582
in-drivable-lane_max7.100000000000021
in-drivable-lane_mean1.416666666666667
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.010338636244216, "sim_physics": 0.11272485767092023, "survival_time": 4.199999999999993, "driven_lanedir": 1.830823469599922, "sim_render-ego": 0.06222089699336461, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.1724569116319929, "deviation-heading": 0.2911444873384423, "set_robot_commands": 0.0814916349592663, "deviation-center-line": 0.2077607380045966, "driven_lanedir_consec": 1.8307396754172969, "sim_compute_sim_state": 0.03867918536776588, "sim_compute_performance-ego": 0.06513242210660662, "sim_compute_robot_state-ego": 0.06428557918185279, "sim_compute_robot_state-npc0": 0.07722575323922294, "sim_compute_robot_state-npc1": 0.07056379034405663, "sim_compute_robot_state-npc2": 0.0696093581971668, "sim_compute_robot_state-npc3": 0.06856402045204527}, "udem1-1-0": {"driven_any": 0.46051146883057115, "sim_physics": 0.12112851576371626, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495908029179065, "sim_render-ego": 0.06798315048217773, "in-drivable-lane": 0, "agent_compute-ego": 0.17413712631572376, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.08191541108218106, "deviation-center-line": 0.07726482156623102, "driven_lanedir_consec": 0.43495908029179065, "sim_compute_sim_state": 0.036840568889271126, "sim_compute_performance-ego": 0.07051708481528542, "sim_compute_robot_state-ego": 0.0681661692532626, "sim_compute_robot_state-npc0": 0.07779848575592041, "sim_compute_robot_state-npc1": 0.07109752568331631, "sim_compute_robot_state-npc2": 0.07264091751792214, "sim_compute_robot_state-npc3": 0.06851435791362416}, "udem1-2-0": {"driven_any": 2.4315368727809226, "sim_physics": 0.11036513010660808, "survival_time": 11.250000000000025, "driven_lanedir": 2.12210503203844, "sim_render-ego": 0.06670431560940213, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.17843621359931097, "deviation-heading": 3.51076556334061, "set_robot_commands": 0.08137640529208713, "deviation-center-line": 1.0784358315519502, "driven_lanedir_consec": 1.7413838620089876, "sim_compute_sim_state": 0.03844295501708984, "sim_compute_performance-ego": 0.06809251255459256, "sim_compute_robot_state-ego": 0.06554528448316786, "sim_compute_robot_state-npc0": 0.07819848802354601, "sim_compute_robot_state-npc1": 0.07343192842271593, "sim_compute_robot_state-npc2": 0.07019767337375217, "sim_compute_robot_state-npc3": 0.06917512045966254}, "udem1-3-0": {"driven_any": 3.1292285179821775, "sim_physics": 0.12575491132407352, "survival_time": 11.60000000000003, "driven_lanedir": 2.382026106670273, "sim_render-ego": 0.0695524996724622, "in-drivable-lane": 7.100000000000021, "agent_compute-ego": 0.17500459222958006, "deviation-heading": 0.49698439206309897, "set_robot_commands": 0.07945322784884222, "deviation-center-line": 0.39589890311775394, "driven_lanedir_consec": 2.3505274914597605, "sim_compute_sim_state": 0.0420402350096867, "sim_compute_performance-ego": 0.07157202835740714, "sim_compute_robot_state-ego": 0.06927700905964293, "sim_compute_robot_state-npc0": 0.07963235830438548, "sim_compute_robot_state-npc1": 0.0748238717687541, "sim_compute_robot_state-npc2": 0.0750526683083896, "sim_compute_robot_state-npc3": 0.07403285338960845}, "udem1-4-0": {"driven_any": 0.400811386017319, "sim_physics": 0.13542786836624146, "survival_time": 1.0000000000000002, "driven_lanedir": 0.38693847040587825, "sim_render-ego": 0.068166184425354, "in-drivable-lane": 0, "agent_compute-ego": 0.17910600900650026, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.08183456659317016, "deviation-center-line": 0.060733287044270105, "driven_lanedir_consec": 0.38693847040587825, "sim_compute_sim_state": 0.040333545207977294, "sim_compute_performance-ego": 0.0730940818786621, "sim_compute_robot_state-ego": 0.07138292789459229, "sim_compute_robot_state-npc0": 0.08025563955307007, "sim_compute_robot_state-npc1": 0.07618296146392822, "sim_compute_robot_state-npc2": 0.07293900251388549, "sim_compute_robot_state-npc3": 0.07479374408721924}, "udem1-5-0": {"driven_any": 1.1283751676405205, "sim_physics": 0.13457672936575754, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3780924478915062, "sim_render-ego": 0.07245624795251963, "in-drivable-lane": 1.0500000000000005, "agent_compute-ego": 0.1815445325812515, "deviation-heading": 0.8764623285014278, "set_robot_commands": 0.0798094029329261, "deviation-center-line": 0.11729599329240677, "driven_lanedir_consec": 0.3780924478915062, "sim_compute_sim_state": 0.04433675688140246, "sim_compute_performance-ego": 0.07322302156565141, "sim_compute_robot_state-ego": 0.06953100768887267, "sim_compute_robot_state-npc0": 0.07966178290697994, "sim_compute_robot_state-npc1": 0.07518531838241889, "sim_compute_robot_state-npc2": 0.07637355765517877, "sim_compute_robot_state-npc3": 0.07795362569847886}, "udem1-6-0": {"driven_any": 0.8796785144013353, "sim_physics": 0.1444906128777398, "survival_time": 1.800000000000001, "driven_lanedir": 0.8770246919234508, "sim_render-ego": 0.0741525689760844, "in-drivable-lane": 0, "agent_compute-ego": 0.17933961417939928, "deviation-heading": 0.13989224355569133, "set_robot_commands": 0.08048618502087063, "deviation-center-line": 0.15455097642444732, "driven_lanedir_consec": 0.8770246919234508, "sim_compute_sim_state": 0.0439763069152832, "sim_compute_performance-ego": 0.07090753316879272, "sim_compute_robot_state-ego": 0.06382155418395996, "sim_compute_robot_state-npc0": 0.08227410581376818, "sim_compute_robot_state-npc1": 0.08040665255652533, "sim_compute_robot_state-npc2": 0.07773115899827746, "sim_compute_robot_state-npc3": 0.07800459861755371}, "udem1-7-0": {"driven_any": 1.078561487351979, "sim_physics": 0.12345225943459404, "survival_time": 3.599999999999995, "driven_lanedir": 0.9537280881161364, "sim_render-ego": 0.07034187184439765, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.17344636718432108, "deviation-heading": 2.1811672588990096, "set_robot_commands": 0.07934454083442688, "deviation-center-line": 0.27865438840344364, "driven_lanedir_consec": 0.8802918234417465, "sim_compute_sim_state": 0.04120506180657281, "sim_compute_performance-ego": 0.06919902894232008, "sim_compute_robot_state-ego": 0.06240819560156928, "sim_compute_robot_state-npc0": 0.07861327793863085, "sim_compute_robot_state-npc1": 0.0766742726167043, "sim_compute_robot_state-npc2": 0.07570645213127136, "sim_compute_robot_state-npc3": 0.07557382848527697}, "udem1-8-0": {"driven_any": 1.6026599126214285, "sim_physics": 0.1142796832939674, "survival_time": 5.799999999999987, "driven_lanedir": 1.1927312344519918, "sim_render-ego": 0.07346243899444053, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1748304819238597, "deviation-heading": 1.83159069180573, "set_robot_commands": 0.08114298047690556, "deviation-center-line": 0.5217457559857648, "driven_lanedir_consec": 1.1927312344519918, "sim_compute_sim_state": 0.04388064968174901, "sim_compute_performance-ego": 0.0746794425207993, "sim_compute_robot_state-ego": 0.0640682578086853, "sim_compute_robot_state-npc0": 0.08163870614150474, "sim_compute_robot_state-npc1": 0.07861820788219057, "sim_compute_robot_state-npc2": 0.07835412230984919, "sim_compute_robot_state-npc3": 0.07758430982458181}, "udem1-9-0": {"driven_any": 0.4605114688305781, "sim_physics": 0.1388880881396207, "survival_time": 1.1000000000000003, "driven_lanedir": 0.4443672320455454, "sim_render-ego": 0.07398217374628241, "in-drivable-lane": 0, "agent_compute-ego": 0.18989338658072732, "deviation-heading": 0.2921306476839709, "set_robot_commands": 0.08006465435028076, "deviation-center-line": 0.06393804025783281, "driven_lanedir_consec": 0.4443672320455454, "sim_compute_sim_state": 0.04402457584034313, "sim_compute_performance-ego": 0.07059829885309393, "sim_compute_robot_state-ego": 0.06399683518843217, "sim_compute_robot_state-npc0": 0.07760792428796942, "sim_compute_robot_state-npc1": 0.07567730816927823, "sim_compute_robot_state-npc2": 0.08072135665199974, "sim_compute_robot_state-npc3": 0.07406670396978204}, "udem1-10-0": {"driven_any": 0.37149985167138017, "sim_physics": 0.1275087281277305, "survival_time": 0.9500000000000004, "driven_lanedir": 0.3517991142132264, "sim_render-ego": 0.07346263684724506, "in-drivable-lane": 0, "agent_compute-ego": 0.1912548542022705, "deviation-heading": 0.31076793256366336, "set_robot_commands": 0.08698179847315739, "deviation-center-line": 0.054904029848945685, "driven_lanedir_consec": 0.3517991142132264, "sim_compute_sim_state": 0.04287121170445493, "sim_compute_performance-ego": 0.06895232200622559, "sim_compute_robot_state-ego": 0.06603076583460758, "sim_compute_robot_state-npc0": 0.08380586222598427, "sim_compute_robot_state-npc1": 0.07839226722717285, "sim_compute_robot_state-npc2": 0.07681468913429662, "sim_compute_robot_state-npc3": 0.07574179297999332}, "udem1-11-0": {"driven_any": 0.4307612897755775, "sim_physics": 0.11682437715076265, "survival_time": 1.0500000000000005, "driven_lanedir": 0.4261291824030562, "sim_render-ego": 0.07374467168535505, "in-drivable-lane": 0, "agent_compute-ego": 0.19856962703523184, "deviation-heading": 0.1541202345559414, "set_robot_commands": 0.07960591997419085, "deviation-center-line": 0.09941469755038562, "driven_lanedir_consec": 0.4261291824030562, "sim_compute_sim_state": 0.04217018399919782, "sim_compute_performance-ego": 0.0698781240554083, "sim_compute_robot_state-ego": 0.06353805178687685, "sim_compute_robot_state-npc0": 0.07984975406101771, "sim_compute_robot_state-npc1": 0.07940571648733956, "sim_compute_robot_state-npc2": 0.07567059426080613, "sim_compute_robot_state-npc3": 0.0713760739281064}, "udem1-12-0": {"driven_any": 1.3868122554217794, "sim_physics": 0.1141851921081543, "survival_time": 6.249999999999986, "driven_lanedir": 0.34148688335072763, "sim_render-ego": 0.07222339630126953, "in-drivable-lane": 4.799999999999987, "agent_compute-ego": 0.18220627975463868, "deviation-heading": 0.9922778058118694, "set_robot_commands": 0.08124766540527344, "deviation-center-line": 0.1700119133263783, "driven_lanedir_consec": 0.34148688335072763, "sim_compute_sim_state": 0.04392940330505371, "sim_compute_performance-ego": 0.07329129028320312, "sim_compute_robot_state-ego": 0.06306025886535645, "sim_compute_robot_state-npc0": 0.07983851432800293, "sim_compute_robot_state-npc1": 0.07777132797241211, "sim_compute_robot_state-npc2": 0.07735346794128418, "sim_compute_robot_state-npc3": 0.07591761779785157}, "udem1-13-0": {"driven_any": 1.6288372926366723, "sim_physics": 0.1141794999440511, "survival_time": 9.750000000000004, "driven_lanedir": 1.2938002384015448, "sim_render-ego": 0.07286071655077812, "in-drivable-lane": 4.050000000000004, "agent_compute-ego": 0.18061224008217835, "deviation-heading": 3.5074876700478246, "set_robot_commands": 0.08034965197245279, "deviation-center-line": 0.43117857132251314, "driven_lanedir_consec": 0.6557366352747889, "sim_compute_sim_state": 0.04465771699563051, "sim_compute_performance-ego": 0.07206925734495505, "sim_compute_robot_state-ego": 0.06348333481030587, "sim_compute_robot_state-npc0": 0.08117584815392127, "sim_compute_robot_state-npc1": 0.07829219377957858, "sim_compute_robot_state-npc2": 0.07835199404985477, "sim_compute_robot_state-npc3": 0.07790929843217899}, "udem1-14-0": {"driven_any": 0.6455182352717241, "sim_physics": 0.12706120509021687, "survival_time": 2.6499999999999986, "driven_lanedir": 0.17855427696068582, "sim_render-ego": 0.07250914033853782, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1795582186500981, "deviation-heading": 0.7741476850944534, "set_robot_commands": 0.08001538492598624, "deviation-center-line": 0.077891975310135, "driven_lanedir_consec": 0.17855427696068582, "sim_compute_sim_state": 0.0443396343375152, "sim_compute_performance-ego": 0.06969805933394523, "sim_compute_robot_state-ego": 0.062485402485109726, "sim_compute_robot_state-npc0": 0.08181786087324035, "sim_compute_robot_state-npc1": 0.07858324500749696, "sim_compute_robot_state-npc2": 0.07819504557915453, "sim_compute_robot_state-npc3": 0.07780934729666081}}
set_robot_commands_max0.08698179847315739
set_robot_commands_mean0.08100796200946783
set_robot_commands_median0.08048618502087063
set_robot_commands_min0.07934454083442688
sim_compute_performance-ego_max0.0746794425207993
sim_compute_performance-ego_mean0.07072696718579657
sim_compute_performance-ego_median0.07059829885309393
sim_compute_performance-ego_min0.06513242210660662
sim_compute_robot_state-ego_max0.07138292789459229
sim_compute_robot_state-ego_mean0.06540537560841962
sim_compute_robot_state-ego_median0.0640682578086853
sim_compute_robot_state-ego_min0.06240819560156928
sim_compute_robot_state-npc0_max0.08380586222598427
sim_compute_robot_state-npc0_mean0.0799596241071443
sim_compute_robot_state-npc0_median0.07983851432800293
sim_compute_robot_state-npc0_min0.07722575323922294
sim_compute_robot_state-npc1_max0.08040665255652533
sim_compute_robot_state-npc1_mean0.07634043918425924
sim_compute_robot_state-npc1_median0.0766742726167043
sim_compute_robot_state-npc1_min0.07056379034405663
sim_compute_robot_state-npc2_max0.08072135665199974
sim_compute_robot_state-npc2_mean0.07571413724153926
sim_compute_robot_state-npc2_median0.07637355765517877
sim_compute_robot_state-npc2_min0.0696093581971668
sim_compute_robot_state-npc3_max0.07800459861755371
sim_compute_robot_state-npc3_mean0.07446781955550827
sim_compute_robot_state-npc3_median0.07557382848527697
sim_compute_robot_state-npc3_min0.06851435791362416
sim_compute_sim_state_max0.04465771699563051
sim_compute_sim_state_mean0.04211519939726624
sim_compute_sim_state_median0.04287121170445493
sim_compute_sim_state_min0.036840568889271126
sim_physics_max0.1444906128777398
sim_physics_mean0.12405651058427695
sim_physics_median0.12345225943459404
sim_physics_min0.11036513010660808
sim_render-ego_max0.0741525689760844
sim_render-ego_mean0.07092152736131138
sim_render-ego_median0.07245624795251963
sim_render-ego_min0.06222089699336461
simulation-passed1
survival_time_max11.60000000000003
survival_time_mean4.303333333333334
survival_time_min0.9500000000000004
No reset possible
23390step1-simulationsuccessyes0:24:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible