Duckietown Challenges Home Challenges Submissions

Submission 3632

Submission3632
Competingyes
Challengeaido2-LFVI-sim-testing
UserNicky Eichmann
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23394
Next
User label-
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23394step1-simulationsuccessyes0:29:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4443672320455454
survival_time_median2.6499999999999986
deviation-center-line_median0.15455097642444732
in-drivable-lane_median0.5500000000000005


other stats
agent_compute-ego_max0.19856962703523184
agent_compute-ego_mean0.18069309699713895
agent_compute-ego_median0.17933961417939928
agent_compute-ego_min0.1724569116319929
deviation-center-line_max1.0784358315519502
deviation-center-line_mean0.25264532820047036
deviation-center-line_min0.054904029848945685
deviation-heading_max3.51076556334061
deviation-heading_mean1.0660647139887165
deviation-heading_median0.49698439206309897
deviation-heading_min0.13989224355569133
driven_any_max3.1292285179821775
driven_any_mean1.2030428238318789
driven_any_median1.078561487351979
driven_any_min0.37149985167138017
driven_lanedir_consec_max2.3505274914597605
driven_lanedir_consec_mean0.8313841401026959
driven_lanedir_consec_min0.17855427696068582
driven_lanedir_max2.382026106670273
driven_lanedir_mean0.9063043699176117
driven_lanedir_median0.4443672320455454
driven_lanedir_min0.17855427696068582
in-drivable-lane_max7.100000000000021
in-drivable-lane_mean1.416666666666667
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.010338636244216, "sim_physics": 0.11272485767092023, "survival_time": 4.199999999999993, "driven_lanedir": 1.830823469599922, "sim_render-ego": 0.06222089699336461, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.1724569116319929, "deviation-heading": 0.2911444873384423, "set_robot_commands": 0.0814916349592663, "deviation-center-line": 0.2077607380045966, "driven_lanedir_consec": 1.8307396754172969, "sim_compute_sim_state": 0.03867918536776588, "sim_compute_performance-ego": 0.06513242210660662, "sim_compute_robot_state-ego": 0.06428557918185279, "sim_compute_robot_state-npc0": 0.07722575323922294, "sim_compute_robot_state-npc1": 0.07056379034405663, "sim_compute_robot_state-npc2": 0.0696093581971668, "sim_compute_robot_state-npc3": 0.06856402045204527}, "udem1-1-0": {"driven_any": 0.46051146883057115, "sim_physics": 0.12112851576371626, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495908029179065, "sim_render-ego": 0.06798315048217773, "in-drivable-lane": 0, "agent_compute-ego": 0.17413712631572376, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.08191541108218106, "deviation-center-line": 0.07726482156623102, "driven_lanedir_consec": 0.43495908029179065, "sim_compute_sim_state": 0.036840568889271126, "sim_compute_performance-ego": 0.07051708481528542, "sim_compute_robot_state-ego": 0.0681661692532626, "sim_compute_robot_state-npc0": 0.07779848575592041, "sim_compute_robot_state-npc1": 0.07109752568331631, "sim_compute_robot_state-npc2": 0.07264091751792214, "sim_compute_robot_state-npc3": 0.06851435791362416}, "udem1-2-0": {"driven_any": 2.4315368727809226, "sim_physics": 0.11036513010660808, "survival_time": 11.250000000000025, "driven_lanedir": 2.12210503203844, "sim_render-ego": 0.06670431560940213, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.17843621359931097, "deviation-heading": 3.51076556334061, "set_robot_commands": 0.08137640529208713, "deviation-center-line": 1.0784358315519502, "driven_lanedir_consec": 1.7413838620089876, "sim_compute_sim_state": 0.03844295501708984, "sim_compute_performance-ego": 0.06809251255459256, "sim_compute_robot_state-ego": 0.06554528448316786, "sim_compute_robot_state-npc0": 0.07819848802354601, "sim_compute_robot_state-npc1": 0.07343192842271593, "sim_compute_robot_state-npc2": 0.07019767337375217, "sim_compute_robot_state-npc3": 0.06917512045966254}, "udem1-3-0": {"driven_any": 3.1292285179821775, "sim_physics": 0.12575491132407352, "survival_time": 11.60000000000003, "driven_lanedir": 2.382026106670273, "sim_render-ego": 0.0695524996724622, "in-drivable-lane": 7.100000000000021, "agent_compute-ego": 0.17500459222958006, "deviation-heading": 0.49698439206309897, "set_robot_commands": 0.07945322784884222, "deviation-center-line": 0.39589890311775394, "driven_lanedir_consec": 2.3505274914597605, "sim_compute_sim_state": 0.0420402350096867, "sim_compute_performance-ego": 0.07157202835740714, "sim_compute_robot_state-ego": 0.06927700905964293, "sim_compute_robot_state-npc0": 0.07963235830438548, "sim_compute_robot_state-npc1": 0.0748238717687541, "sim_compute_robot_state-npc2": 0.0750526683083896, "sim_compute_robot_state-npc3": 0.07403285338960845}, "udem1-4-0": {"driven_any": 0.400811386017319, "sim_physics": 0.13542786836624146, "survival_time": 1.0000000000000002, "driven_lanedir": 0.38693847040587825, "sim_render-ego": 0.068166184425354, "in-drivable-lane": 0, "agent_compute-ego": 0.17910600900650026, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.08183456659317016, "deviation-center-line": 0.060733287044270105, "driven_lanedir_consec": 0.38693847040587825, "sim_compute_sim_state": 0.040333545207977294, "sim_compute_performance-ego": 0.0730940818786621, "sim_compute_robot_state-ego": 0.07138292789459229, "sim_compute_robot_state-npc0": 0.08025563955307007, "sim_compute_robot_state-npc1": 0.07618296146392822, "sim_compute_robot_state-npc2": 0.07293900251388549, "sim_compute_robot_state-npc3": 0.07479374408721924}, "udem1-5-0": {"driven_any": 1.1283751676405205, "sim_physics": 0.13457672936575754, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3780924478915062, "sim_render-ego": 0.07245624795251963, "in-drivable-lane": 1.0500000000000005, "agent_compute-ego": 0.1815445325812515, "deviation-heading": 0.8764623285014278, "set_robot_commands": 0.0798094029329261, "deviation-center-line": 0.11729599329240677, "driven_lanedir_consec": 0.3780924478915062, "sim_compute_sim_state": 0.04433675688140246, "sim_compute_performance-ego": 0.07322302156565141, "sim_compute_robot_state-ego": 0.06953100768887267, "sim_compute_robot_state-npc0": 0.07966178290697994, "sim_compute_robot_state-npc1": 0.07518531838241889, "sim_compute_robot_state-npc2": 0.07637355765517877, "sim_compute_robot_state-npc3": 0.07795362569847886}, "udem1-6-0": {"driven_any": 0.8796785144013353, "sim_physics": 0.1444906128777398, "survival_time": 1.800000000000001, "driven_lanedir": 0.8770246919234508, "sim_render-ego": 0.0741525689760844, "in-drivable-lane": 0, "agent_compute-ego": 0.17933961417939928, "deviation-heading": 0.13989224355569133, "set_robot_commands": 0.08048618502087063, "deviation-center-line": 0.15455097642444732, "driven_lanedir_consec": 0.8770246919234508, "sim_compute_sim_state": 0.0439763069152832, "sim_compute_performance-ego": 0.07090753316879272, "sim_compute_robot_state-ego": 0.06382155418395996, "sim_compute_robot_state-npc0": 0.08227410581376818, "sim_compute_robot_state-npc1": 0.08040665255652533, "sim_compute_robot_state-npc2": 0.07773115899827746, "sim_compute_robot_state-npc3": 0.07800459861755371}, "udem1-7-0": {"driven_any": 1.078561487351979, "sim_physics": 0.12345225943459404, "survival_time": 3.599999999999995, "driven_lanedir": 0.9537280881161364, "sim_render-ego": 0.07034187184439765, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.17344636718432108, "deviation-heading": 2.1811672588990096, "set_robot_commands": 0.07934454083442688, "deviation-center-line": 0.27865438840344364, "driven_lanedir_consec": 0.8802918234417465, "sim_compute_sim_state": 0.04120506180657281, "sim_compute_performance-ego": 0.06919902894232008, "sim_compute_robot_state-ego": 0.06240819560156928, "sim_compute_robot_state-npc0": 0.07861327793863085, "sim_compute_robot_state-npc1": 0.0766742726167043, "sim_compute_robot_state-npc2": 0.07570645213127136, "sim_compute_robot_state-npc3": 0.07557382848527697}, "udem1-8-0": {"driven_any": 1.6026599126214285, "sim_physics": 0.1142796832939674, "survival_time": 5.799999999999987, "driven_lanedir": 1.1927312344519918, "sim_render-ego": 0.07346243899444053, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1748304819238597, "deviation-heading": 1.83159069180573, "set_robot_commands": 0.08114298047690556, "deviation-center-line": 0.5217457559857648, "driven_lanedir_consec": 1.1927312344519918, "sim_compute_sim_state": 0.04388064968174901, "sim_compute_performance-ego": 0.0746794425207993, "sim_compute_robot_state-ego": 0.0640682578086853, "sim_compute_robot_state-npc0": 0.08163870614150474, "sim_compute_robot_state-npc1": 0.07861820788219057, "sim_compute_robot_state-npc2": 0.07835412230984919, "sim_compute_robot_state-npc3": 0.07758430982458181}, "udem1-9-0": {"driven_any": 0.4605114688305781, "sim_physics": 0.1388880881396207, "survival_time": 1.1000000000000003, "driven_lanedir": 0.4443672320455454, "sim_render-ego": 0.07398217374628241, "in-drivable-lane": 0, "agent_compute-ego": 0.18989338658072732, "deviation-heading": 0.2921306476839709, "set_robot_commands": 0.08006465435028076, "deviation-center-line": 0.06393804025783281, "driven_lanedir_consec": 0.4443672320455454, "sim_compute_sim_state": 0.04402457584034313, "sim_compute_performance-ego": 0.07059829885309393, "sim_compute_robot_state-ego": 0.06399683518843217, "sim_compute_robot_state-npc0": 0.07760792428796942, "sim_compute_robot_state-npc1": 0.07567730816927823, "sim_compute_robot_state-npc2": 0.08072135665199974, "sim_compute_robot_state-npc3": 0.07406670396978204}, "udem1-10-0": {"driven_any": 0.37149985167138017, "sim_physics": 0.1275087281277305, "survival_time": 0.9500000000000004, "driven_lanedir": 0.3517991142132264, "sim_render-ego": 0.07346263684724506, "in-drivable-lane": 0, "agent_compute-ego": 0.1912548542022705, "deviation-heading": 0.31076793256366336, "set_robot_commands": 0.08698179847315739, "deviation-center-line": 0.054904029848945685, "driven_lanedir_consec": 0.3517991142132264, "sim_compute_sim_state": 0.04287121170445493, "sim_compute_performance-ego": 0.06895232200622559, "sim_compute_robot_state-ego": 0.06603076583460758, "sim_compute_robot_state-npc0": 0.08380586222598427, "sim_compute_robot_state-npc1": 0.07839226722717285, "sim_compute_robot_state-npc2": 0.07681468913429662, "sim_compute_robot_state-npc3": 0.07574179297999332}, "udem1-11-0": {"driven_any": 0.4307612897755775, "sim_physics": 0.11682437715076265, "survival_time": 1.0500000000000005, "driven_lanedir": 0.4261291824030562, "sim_render-ego": 0.07374467168535505, "in-drivable-lane": 0, "agent_compute-ego": 0.19856962703523184, "deviation-heading": 0.1541202345559414, "set_robot_commands": 0.07960591997419085, "deviation-center-line": 0.09941469755038562, "driven_lanedir_consec": 0.4261291824030562, "sim_compute_sim_state": 0.04217018399919782, "sim_compute_performance-ego": 0.0698781240554083, "sim_compute_robot_state-ego": 0.06353805178687685, "sim_compute_robot_state-npc0": 0.07984975406101771, "sim_compute_robot_state-npc1": 0.07940571648733956, "sim_compute_robot_state-npc2": 0.07567059426080613, "sim_compute_robot_state-npc3": 0.0713760739281064}, "udem1-12-0": {"driven_any": 1.3868122554217794, "sim_physics": 0.1141851921081543, "survival_time": 6.249999999999986, "driven_lanedir": 0.34148688335072763, "sim_render-ego": 0.07222339630126953, "in-drivable-lane": 4.799999999999987, "agent_compute-ego": 0.18220627975463868, "deviation-heading": 0.9922778058118694, "set_robot_commands": 0.08124766540527344, "deviation-center-line": 0.1700119133263783, "driven_lanedir_consec": 0.34148688335072763, "sim_compute_sim_state": 0.04392940330505371, "sim_compute_performance-ego": 0.07329129028320312, "sim_compute_robot_state-ego": 0.06306025886535645, "sim_compute_robot_state-npc0": 0.07983851432800293, "sim_compute_robot_state-npc1": 0.07777132797241211, "sim_compute_robot_state-npc2": 0.07735346794128418, "sim_compute_robot_state-npc3": 0.07591761779785157}, "udem1-13-0": {"driven_any": 1.6288372926366723, "sim_physics": 0.1141794999440511, "survival_time": 9.750000000000004, "driven_lanedir": 1.2938002384015448, "sim_render-ego": 0.07286071655077812, "in-drivable-lane": 4.050000000000004, "agent_compute-ego": 0.18061224008217835, "deviation-heading": 3.5074876700478246, "set_robot_commands": 0.08034965197245279, "deviation-center-line": 0.43117857132251314, "driven_lanedir_consec": 0.6557366352747889, "sim_compute_sim_state": 0.04465771699563051, "sim_compute_performance-ego": 0.07206925734495505, "sim_compute_robot_state-ego": 0.06348333481030587, "sim_compute_robot_state-npc0": 0.08117584815392127, "sim_compute_robot_state-npc1": 0.07829219377957858, "sim_compute_robot_state-npc2": 0.07835199404985477, "sim_compute_robot_state-npc3": 0.07790929843217899}, "udem1-14-0": {"driven_any": 0.6455182352717241, "sim_physics": 0.12706120509021687, "survival_time": 2.6499999999999986, "driven_lanedir": 0.17855427696068582, "sim_render-ego": 0.07250914033853782, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1795582186500981, "deviation-heading": 0.7741476850944534, "set_robot_commands": 0.08001538492598624, "deviation-center-line": 0.077891975310135, "driven_lanedir_consec": 0.17855427696068582, "sim_compute_sim_state": 0.0443396343375152, "sim_compute_performance-ego": 0.06969805933394523, "sim_compute_robot_state-ego": 0.062485402485109726, "sim_compute_robot_state-npc0": 0.08181786087324035, "sim_compute_robot_state-npc1": 0.07858324500749696, "sim_compute_robot_state-npc2": 0.07819504557915453, "sim_compute_robot_state-npc3": 0.07780934729666081}}
set_robot_commands_max0.08698179847315739
set_robot_commands_mean0.08100796200946783
set_robot_commands_median0.08048618502087063
set_robot_commands_min0.07934454083442688
sim_compute_performance-ego_max0.0746794425207993
sim_compute_performance-ego_mean0.07072696718579657
sim_compute_performance-ego_median0.07059829885309393
sim_compute_performance-ego_min0.06513242210660662
sim_compute_robot_state-ego_max0.07138292789459229
sim_compute_robot_state-ego_mean0.06540537560841962
sim_compute_robot_state-ego_median0.0640682578086853
sim_compute_robot_state-ego_min0.06240819560156928
sim_compute_robot_state-npc0_max0.08380586222598427
sim_compute_robot_state-npc0_mean0.0799596241071443
sim_compute_robot_state-npc0_median0.07983851432800293
sim_compute_robot_state-npc0_min0.07722575323922294
sim_compute_robot_state-npc1_max0.08040665255652533
sim_compute_robot_state-npc1_mean0.07634043918425924
sim_compute_robot_state-npc1_median0.0766742726167043
sim_compute_robot_state-npc1_min0.07056379034405663
sim_compute_robot_state-npc2_max0.08072135665199974
sim_compute_robot_state-npc2_mean0.07571413724153926
sim_compute_robot_state-npc2_median0.07637355765517877
sim_compute_robot_state-npc2_min0.0696093581971668
sim_compute_robot_state-npc3_max0.07800459861755371
sim_compute_robot_state-npc3_mean0.07446781955550827
sim_compute_robot_state-npc3_median0.07557382848527697
sim_compute_robot_state-npc3_min0.06851435791362416
sim_compute_sim_state_max0.04465771699563051
sim_compute_sim_state_mean0.04211519939726624
sim_compute_sim_state_median0.04287121170445493
sim_compute_sim_state_min0.036840568889271126
sim_physics_max0.1444906128777398
sim_physics_mean0.12405651058427695
sim_physics_median0.12345225943459404
sim_physics_min0.11036513010660808
sim_render-ego_max0.0741525689760844
sim_render-ego_mean0.07092152736131138
sim_render-ego_median0.07245624795251963
sim_render-ego_min0.06222089699336461
simulation-passed1
survival_time_max11.60000000000003
survival_time_mean4.303333333333334
survival_time_min0.9500000000000004
No reset possible
23390step1-simulationsuccessyes0:24:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible