Duckietown Challenges Home Challenges Submissions

Submission 2624

Submission2624
Competingyes
Challengeaido2-LFVI-sim-testing
UserAndrea Censi 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22858
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22858step1-simulationsuccessyes0:27:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.19035117901288545
agent_compute-ego_mean0.14768375103198966
agent_compute-ego_median0.14996348538445037
agent_compute-ego_min0.1197553248632522
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.19567220422286025, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.061594561685489706, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1523480656780774, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09168362617492676, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.0381959903089306, "sim_compute_performance-ego": 0.07090690166135377, "sim_compute_robot_state-ego": 0.07357261150698119, "sim_compute_robot_state-npc0": 0.06549656542041633, "sim_compute_robot_state-npc1": 0.06673955917358398, "sim_compute_robot_state-npc2": 0.06710352173334436, "sim_compute_robot_state-npc3": 0.06704140916655335}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.19222759349005564, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06281231982367379, "in-drivable-lane": 0, "agent_compute-ego": 0.15666175740105764, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.0915723272732326, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03440007141658238, "sim_compute_performance-ego": 0.06660535505839757, "sim_compute_robot_state-ego": 0.07319438457489014, "sim_compute_robot_state-npc0": 0.06686609131949288, "sim_compute_robot_state-npc1": 0.06373086145945958, "sim_compute_robot_state-npc2": 0.06058033875056675, "sim_compute_robot_state-npc3": 0.06223780768258231}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18107091570363465, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05725020112343205, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14993725239651876, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.09524662980755556, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.037459510043986795, "sim_compute_performance-ego": 0.06527639361261164, "sim_compute_robot_state-ego": 0.07088523698084563, "sim_compute_robot_state-npc0": 0.0672127158896437, "sim_compute_robot_state-npc1": 0.0654163892986705, "sim_compute_robot_state-npc2": 0.06699281525843352, "sim_compute_robot_state-npc3": 0.06765304491357896}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.15045641362667084, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.04839162031809489, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.12111954887708028, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.0740515540043513, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.029703860481580097, "sim_compute_performance-ego": 0.0530322790145874, "sim_compute_robot_state-ego": 0.0551749716202418, "sim_compute_robot_state-npc0": 0.05172191560268402, "sim_compute_robot_state-npc1": 0.05050571262836456, "sim_compute_robot_state-npc2": 0.051816980044047035, "sim_compute_robot_state-npc3": 0.0757492979367574}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.17214362961905344, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.049314317249116446, "in-drivable-lane": 0, "agent_compute-ego": 0.1197553248632522, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.07546254566737584, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.06799874986921038, "sim_compute_performance-ego": 0.07096278099786668, "sim_compute_robot_state-ego": 0.06248797689165387, "sim_compute_robot_state-npc0": 0.06049619402204241, "sim_compute_robot_state-npc1": 0.05990739095778693, "sim_compute_robot_state-npc2": 0.05864983513241723, "sim_compute_robot_state-npc3": 0.07334653536478679}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.18314608842312932, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.05945506638395572, "in-drivable-lane": 2, "agent_compute-ego": 0.15111475790332177, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.09370930323343792, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03714085196306605, "sim_compute_performance-ego": 0.06612402664687106, "sim_compute_robot_state-ego": 0.07277348940957806, "sim_compute_robot_state-npc0": 0.06934110989827595, "sim_compute_robot_state-npc1": 0.073142435736285, "sim_compute_robot_state-npc2": 0.06697347920811819, "sim_compute_robot_state-npc3": 0.06825473208627302}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.20966828216626807, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.059735626850313354, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14996348538445037, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.0942457138913349, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.03899671499011586, "sim_compute_performance-ego": 0.06725131886676677, "sim_compute_robot_state-ego": 0.07228562669846618, "sim_compute_robot_state-npc0": 0.06944960760838777, "sim_compute_robot_state-npc1": 0.06748239970901637, "sim_compute_robot_state-npc2": 0.06813944196238102, "sim_compute_robot_state-npc3": 0.07316087750555242}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.20285287857055664, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.061665501594543454, "in-drivable-lane": 0, "agent_compute-ego": 0.14907915115356446, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.1097263526916504, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03506758213043213, "sim_compute_performance-ego": 0.06116716861724854, "sim_compute_robot_state-ego": 0.06587601184844971, "sim_compute_robot_state-npc0": 0.06280867099761962, "sim_compute_robot_state-npc1": 0.06020464897155762, "sim_compute_robot_state-npc2": 0.06148030757904053, "sim_compute_robot_state-npc3": 0.06234848022460938}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.1394633650779724, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.046051887365487904, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.19035117901288545, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.08950298107587375, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.03063852511919462, "sim_compute_performance-ego": 0.050812799196976885, "sim_compute_robot_state-ego": 0.05324454032457792, "sim_compute_robot_state-npc0": 0.05539400760944073, "sim_compute_robot_state-npc1": 0.053239088792067304, "sim_compute_robot_state-npc2": 0.05125705553935124, "sim_compute_robot_state-npc3": 0.05289047956466675}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.2056397291330191, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.047837367424598105, "in-drivable-lane": 0, "agent_compute-ego": 0.12186570350940412, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.1109330837543194, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.03388706537393423, "sim_compute_performance-ego": 0.05386538688953106, "sim_compute_robot_state-ego": 0.06038700617276705, "sim_compute_robot_state-npc0": 0.052376848000746504, "sim_compute_robot_state-npc1": 0.05392351517310509, "sim_compute_robot_state-npc2": 0.05437093514662523, "sim_compute_robot_state-npc3": 0.0554657165820782}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.274671424518932, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06536099043759433, "in-drivable-lane": 0, "agent_compute-ego": 0.17276325009085916, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.11135086146267978, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.039329236203973945, "sim_compute_performance-ego": 0.07441614974628795, "sim_compute_robot_state-ego": 0.08766601302407005, "sim_compute_robot_state-npc0": 0.0815723484212702, "sim_compute_robot_state-npc1": 0.07754983685233376, "sim_compute_robot_state-npc2": 0.08192734284834428, "sim_compute_robot_state-npc3": 0.0767601728439331}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.15707058906555177, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.05333284854888916, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.13015392303466797, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.08186810970306396, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.03126850605010986, "sim_compute_performance-ego": 0.05475784301757813, "sim_compute_robot_state-ego": 0.05910179138183594, "sim_compute_robot_state-npc0": 0.06427786827087402, "sim_compute_robot_state-npc1": 0.0575523853302002, "sim_compute_robot_state-npc2": 0.05820993900299072, "sim_compute_robot_state-npc3": 0.057673282623291015}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.21055117566534817, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.06050950669227762, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.15513104073544767, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.09754127898114792, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.04621862350626195, "sim_compute_performance-ego": 0.06587822893832593, "sim_compute_robot_state-ego": 0.07534868666466246, "sim_compute_robot_state-npc0": 0.06872372170712085, "sim_compute_robot_state-npc1": 0.06820640411782772, "sim_compute_robot_state-npc2": 0.06909814286739269, "sim_compute_robot_state-npc3": 0.06855597394578}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.1999692962719844, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.061100276616903454, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1449161401161781, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.09501628233836248, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.03916304386579073, "sim_compute_performance-ego": 0.06494263502267691, "sim_compute_robot_state-ego": 0.07472266142184918, "sim_compute_robot_state-npc0": 0.06933337450027466, "sim_compute_robot_state-npc1": 0.06857509796436016, "sim_compute_robot_state-npc2": 0.06862868712498592, "sim_compute_robot_state-npc3": 0.0671996886913593}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.18343400955200195, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.05792255855741955, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.15009568532307943, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.08948915118262882, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.037850811367943174, "sim_compute_performance-ego": 0.06253281320844378, "sim_compute_robot_state-ego": 0.06858609290350051, "sim_compute_robot_state-npc0": 0.06513480004810152, "sim_compute_robot_state-npc1": 0.06537731261480423, "sim_compute_robot_state-npc2": 0.06638078008379256, "sim_compute_robot_state-npc3": 0.06538221949622744}}
set_robot_commands_max0.11135086146267978
set_robot_commands_mean0.09342665341612942
set_robot_commands_median0.09370930323343792
set_robot_commands_min0.0740515540043513
sim_compute_performance-ego_max0.07441614974628795
sim_compute_performance-ego_mean0.06323547203303495
sim_compute_performance-ego_median0.06527639361261164
sim_compute_performance-ego_min0.050812799196976885
sim_compute_robot_state-ego_max0.08766601302407005
sim_compute_robot_state-ego_mean0.06835380676162464
sim_compute_robot_state-ego_median0.07088523698084563
sim_compute_robot_state-ego_min0.05324454032457792
sim_compute_robot_state-npc0_max0.0815723484212702
sim_compute_robot_state-npc0_mean0.0646803892877594
sim_compute_robot_state-npc0_median0.06549656542041633
sim_compute_robot_state-npc0_min0.05172191560268402
sim_compute_robot_state-npc1_max0.07754983685233376
sim_compute_robot_state-npc1_mean0.06343686925196154
sim_compute_robot_state-npc1_median0.06537731261480423
sim_compute_robot_state-npc1_min0.05050571262836456
sim_compute_robot_state-npc2_max0.08192734284834428
sim_compute_robot_state-npc2_mean0.06344064015212209
sim_compute_robot_state-npc2_median0.06638078008379256
sim_compute_robot_state-npc2_min0.05125705553935124
sim_compute_robot_state-npc3_max0.0767601728439331
sim_compute_robot_state-npc3_mean0.06624798124186863
sim_compute_robot_state-npc3_median0.0671996886913593
sim_compute_robot_state-npc3_min0.05289047956466675
sim_compute_sim_state_max0.06799874986921038
sim_compute_sim_state_mean0.03848794284607419
sim_compute_sim_state_median0.037459510043986795
sim_compute_sim_state_min0.029703860481580097
sim_physics_max0.274671424518932
sim_physics_mean0.1905358396738026
sim_physics_median0.19222759349005564
sim_physics_min0.1394633650779724
sim_render-ego_max0.06536099043759433
sim_render-ego_mean0.056822310044785974
sim_render-ego_median0.05945506638395572
sim_render-ego_min0.046051887365487904
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
No reset possible