Duckietown Challenges Home Challenges Submissions

Submission 2443

Submission2443
Competingyes
Challengeaido2-LFVI-sim-testing
UserJacopo Tani
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22972
Next
User labelrandom_agent
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22972step1-simulationsuccessyes0:31:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.16722194506571844
agent_compute-ego_mean0.156397677146723
agent_compute-ego_median0.15397003330761874
agent_compute-ego_min0.14718160846016623
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1842850944663905, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06257108797000933, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15397003330761874, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09476546396183062, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.035986658893054045, "sim_compute_performance-ego": 0.06804596623287926, "sim_compute_robot_state-ego": 0.07399900351898579, "sim_compute_robot_state-npc0": 0.06907651997819732, "sim_compute_robot_state-npc1": 0.07032777991475939, "sim_compute_robot_state-npc2": 0.06592767449873912, "sim_compute_robot_state-npc3": 0.06460548050795929}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2283307569367545, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06655513388769967, "in-drivable-lane": 0, "agent_compute-ego": 0.1666585717882429, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10015562602451868, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04201396022524152, "sim_compute_performance-ego": 0.0713720406804766, "sim_compute_robot_state-ego": 0.0824567334992545, "sim_compute_robot_state-npc0": 0.07094841344015938, "sim_compute_robot_state-npc1": 0.0742525543485369, "sim_compute_robot_state-npc2": 0.07209922586168561, "sim_compute_robot_state-npc3": 0.07609885931015015}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.19834946891636523, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.0695742472861577, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16305812122752367, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10040039692110228, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04040974320717229, "sim_compute_performance-ego": 0.07102754046616044, "sim_compute_robot_state-ego": 0.07676100267947299, "sim_compute_robot_state-npc0": 0.0719196009404451, "sim_compute_robot_state-npc1": 0.07141532944244089, "sim_compute_robot_state-npc2": 0.0726843296902851, "sim_compute_robot_state-npc3": 0.07345060468877404}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.1931402335564295, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.05889975527922312, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.15390782058238983, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.0977311929066976, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.038101136684417725, "sim_compute_performance-ego": 0.06988384823004405, "sim_compute_robot_state-ego": 0.07611844937006633, "sim_compute_robot_state-npc0": 0.06970613201459248, "sim_compute_robot_state-npc1": 0.07253833611806233, "sim_compute_robot_state-npc2": 0.06788947681585948, "sim_compute_robot_state-npc3": 0.06834089756011963}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1980260894412086, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06301837875729516, "in-drivable-lane": 0, "agent_compute-ego": 0.15897234280904135, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.095352570215861, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03782377924237933, "sim_compute_performance-ego": 0.07013080233619326, "sim_compute_robot_state-ego": 0.07363406817118327, "sim_compute_robot_state-npc0": 0.06980569022042411, "sim_compute_robot_state-npc1": 0.07261940411158971, "sim_compute_robot_state-npc2": 0.07008000782557897, "sim_compute_robot_state-npc3": 0.06836785588945661}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.203996215751785, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.06271861127750603, "in-drivable-lane": 2, "agent_compute-ego": 0.15800981892797047, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.09801517989107236, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.04001798030145154, "sim_compute_performance-ego": 0.07133056303698146, "sim_compute_robot_state-ego": 0.07863844511751643, "sim_compute_robot_state-npc0": 0.06905841827392578, "sim_compute_robot_state-npc1": 0.07078269712939234, "sim_compute_robot_state-npc2": 0.07079041646626182, "sim_compute_robot_state-npc3": 0.07250153804253676}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.2051212070057693, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.061628804623501975, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14925430816354104, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.09431846396436969, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.0382951278130985, "sim_compute_performance-ego": 0.06620945976775827, "sim_compute_robot_state-ego": 0.07352233395993131, "sim_compute_robot_state-npc0": 0.07672594125988413, "sim_compute_robot_state-npc1": 0.06772145021308973, "sim_compute_robot_state-npc2": 0.07151989797944004, "sim_compute_robot_state-npc3": 0.0694707620491102}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.20525562286376953, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.06102067947387695, "in-drivable-lane": 0, "agent_compute-ego": 0.151539306640625, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.09516477108001709, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03948815822601318, "sim_compute_performance-ego": 0.06630090236663819, "sim_compute_robot_state-ego": 0.07105167388916016, "sim_compute_robot_state-npc0": 0.06939900398254395, "sim_compute_robot_state-npc1": 0.06909412860870362, "sim_compute_robot_state-npc2": 0.06847365379333496, "sim_compute_robot_state-npc3": 0.06674327850341796}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.23332378038993248, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06745843703930195, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16722194506571844, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.10699975490570068, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.04192429322462816, "sim_compute_performance-ego": 0.07541423119031467, "sim_compute_robot_state-ego": 0.08770690514491154, "sim_compute_robot_state-npc0": 0.07367177192981426, "sim_compute_robot_state-npc1": 0.07333363478000347, "sim_compute_robot_state-npc2": 0.07281445539914645, "sim_compute_robot_state-npc3": 0.07466728870685284}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.2414106955895057, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06662397201244648, "in-drivable-lane": 0, "agent_compute-ego": 0.16252249020796555, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.09817108741173378, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.040324706297654375, "sim_compute_performance-ego": 0.07334412978245662, "sim_compute_robot_state-ego": 0.07767229813795823, "sim_compute_robot_state-npc0": 0.07155010333428016, "sim_compute_robot_state-npc1": 0.07578729666196383, "sim_compute_robot_state-npc2": 0.07444368875943698, "sim_compute_robot_state-npc3": 0.07069266759432279}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.2006264708258889, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06342648376118053, "in-drivable-lane": 0, "agent_compute-ego": 0.14718160846016623, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.10354530811309814, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.0380151705308394, "sim_compute_performance-ego": 0.07033882357857445, "sim_compute_robot_state-ego": 0.07408400015397505, "sim_compute_robot_state-npc0": 0.06580479578538374, "sim_compute_robot_state-npc1": 0.07109386270696466, "sim_compute_robot_state-npc2": 0.07200832800431685, "sim_compute_robot_state-npc3": 0.06819708780808882}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.17453941822052002, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06271063327789307, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1537902069091797, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.09294427871704102, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.037311339378356935, "sim_compute_performance-ego": 0.06797646045684815, "sim_compute_robot_state-ego": 0.07400153636932373, "sim_compute_robot_state-npc0": 0.06761928081512451, "sim_compute_robot_state-npc1": 0.06517164707183838, "sim_compute_robot_state-npc2": 0.06578044414520264, "sim_compute_robot_state-npc3": 0.06474825859069824}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.20067748363981855, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.061021272172319126, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.1514436716729022, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.09447940613361117, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.03998952977200772, "sim_compute_performance-ego": 0.06893517869584104, "sim_compute_robot_state-ego": 0.0750314453814892, "sim_compute_robot_state-npc0": 0.06744057320533915, "sim_compute_robot_state-npc1": 0.06684420971160239, "sim_compute_robot_state-npc2": 0.07023898337749725, "sim_compute_robot_state-npc3": 0.06872883502473222}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.2069228887557983, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06417755438731267, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1573143463868361, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.0968733659157386, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.04015142642534696, "sim_compute_performance-ego": 0.07060102774546696, "sim_compute_robot_state-ego": 0.0784544302867009, "sim_compute_robot_state-npc0": 0.07124351996641892, "sim_compute_robot_state-npc1": 0.07042103547316331, "sim_compute_robot_state-npc2": 0.06921963508312519, "sim_compute_robot_state-npc3": 0.07040005463820237}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.1793178263164702, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.061737046922956194, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.1511205650511242, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.0928757349650065, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.03913474082946777, "sim_compute_performance-ego": 0.06761943499247233, "sim_compute_robot_state-ego": 0.07170276187715076, "sim_compute_robot_state-npc0": 0.06691044171651205, "sim_compute_robot_state-npc1": 0.06895176115490141, "sim_compute_robot_state-npc2": 0.06869666235787528, "sim_compute_robot_state-npc3": 0.06877732503981818}}
set_robot_commands_max0.10699975490570068
set_robot_commands_mean0.09745284007515992
set_robot_commands_median0.0968733659157386
set_robot_commands_min0.0928757349650065
sim_compute_performance-ego_max0.07541423119031467
sim_compute_performance-ego_mean0.06990202730394038
sim_compute_performance-ego_median0.07013080233619326
sim_compute_performance-ego_min0.06620945976775827
sim_compute_robot_state-ego_max0.08770690514491154
sim_compute_robot_state-ego_mean0.07632233917047201
sim_compute_robot_state-ego_median0.0750314453814892
sim_compute_robot_state-ego_min0.07105167388916016
sim_compute_robot_state-npc0_max0.07672594125988413
sim_compute_robot_state-npc0_mean0.07005868045753633
sim_compute_robot_state-npc0_median0.06970613201459248
sim_compute_robot_state-npc0_min0.06580479578538374
sim_compute_robot_state-npc1_max0.07578729666196383
sim_compute_robot_state-npc1_mean0.07069034182980082
sim_compute_robot_state-npc1_median0.07078269712939234
sim_compute_robot_state-npc1_min0.06517164707183838
sim_compute_robot_state-npc2_max0.07444368875943698
sim_compute_robot_state-npc2_mean0.0701777920038524
sim_compute_robot_state-npc2_median0.07023898337749725
sim_compute_robot_state-npc2_min0.06578044414520264
sim_compute_robot_state-npc3_max0.07609885931015015
sim_compute_robot_state-npc3_mean0.06971938626361601
sim_compute_robot_state-npc3_median0.06877732503981818
sim_compute_robot_state-npc3_min0.06460548050795929
sim_compute_sim_state_max0.04201396022524152
sim_compute_sim_state_mean0.039265850070075305
sim_compute_sim_state_median0.03948815822601318
sim_compute_sim_state_min0.035986658893054045
sim_physics_max0.2414106955895057
sim_physics_mean0.2035548835117605
sim_physics_median0.20067748363981855
sim_physics_min0.17453941822052002
sim_render-ego_max0.0695742472861577
sim_render-ego_mean0.063542806541912
sim_render-ego_median0.06271861127750603
sim_render-ego_min0.05889975527922312
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
No reset possible