Duckietown Challenges Home Challenges Submissions

Submission 3851

Submission3851
Competingyes
Challengeaido2-LFV-sim-testing-offseason
UserJunghyun Seo 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 24055
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
24055step1-simulationsuccessyes0:13:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06947524826232065
survival_time_median1.3000000000000005
deviation-center-line_median0.06512377432009957
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.16704841454823813
agent_compute-ego_mean0.1450840945902538
agent_compute-ego_median0.1480418806490691
agent_compute-ego_min0.12042725086212158
deviation-center-line_max0.09912182735535308
deviation-center-line_mean0.06956223729060027
deviation-center-line_min0.034221115106860704
deviation-heading_max0.9568908317311412
deviation-heading_mean0.7331424734268113
deviation-heading_median0.6918688301065948
deviation-heading_min0.6093679154268812
driven_any_max0.2664548389627696
driven_any_mean0.16158241740697565
driven_any_median0.16635266971035748
driven_any_min0.09830786333507666
driven_lanedir_consec_max0.14117875567636862
driven_lanedir_consec_mean0.07727458275898706
driven_lanedir_consec_min0.05206771627714435
driven_lanedir_max0.14117875567636862
driven_lanedir_mean0.07727458275898706
driven_lanedir_median0.06947524826232065
driven_lanedir_min0.05206771627714435
in-drivable-lane_max0.7000000000000006
in-drivable-lane_mean0.2600000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2216939397145425, "sim_physics": 0.18235335085127088, "survival_time": 1.800000000000001, "driven_lanedir": 0.07943468613563676, "sim_render-ego": 0.056959728399912514, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.16704841454823813, "deviation-heading": 0.6918688301065948, "set_robot_commands": 0.09787617127100628, "deviation-center-line": 0.05811903637043487, "driven_lanedir_consec": 0.07943468613563676, "sim_compute_sim_state": 0.03633320331573486, "sim_compute_performance-ego": 0.06499005688561334, "sim_compute_robot_state-ego": 0.07335406541824341, "sim_compute_robot_state-npc0": 0.06719151470396253, "sim_compute_robot_state-npc1": 0.07012327512105306, "sim_compute_robot_state-npc2": 0.07034833563698663, "sim_compute_robot_state-npc3": 0.0688115225897895}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20615819948533312, "sim_physics": 0.1589486522059287, "survival_time": 1.5500000000000007, "driven_lanedir": 0.09157991248925246, "sim_render-ego": 0.05703136228745984, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.16113135122483777, "deviation-heading": 0.9568908317311412, "set_robot_commands": 0.09058475494384766, "deviation-center-line": 0.07001847109510527, "driven_lanedir_consec": 0.09157991248925246, "sim_compute_sim_state": 0.039651801509241906, "sim_compute_performance-ego": 0.061763078935684695, "sim_compute_robot_state-ego": 0.06340051466418851, "sim_compute_robot_state-npc0": 0.06369275431479177, "sim_compute_robot_state-npc1": 0.06507884302446919, "sim_compute_robot_state-npc2": 0.0643343617839198, "sim_compute_robot_state-npc3": 0.06955517491986675}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09830786333507666, "sim_physics": 0.20347898939381476, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06330370880935465, "sim_render-ego": 0.06764827603879182, "in-drivable-lane": 0, "agent_compute-ego": 0.1480418806490691, "deviation-heading": 0.6093679154268812, "set_robot_commands": 0.09097525347834048, "deviation-center-line": 0.09912182735535308, "driven_lanedir_consec": 0.06330370880935465, "sim_compute_sim_state": 0.04063751386559528, "sim_compute_performance-ego": 0.0745113932568094, "sim_compute_robot_state-ego": 0.07761051343834918, "sim_compute_robot_state-npc0": 0.06494205930958623, "sim_compute_robot_state-npc1": 0.06941005458002505, "sim_compute_robot_state-npc2": 0.06838686569877293, "sim_compute_robot_state-npc3": 0.07157523735709813}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1133320044931791, "sim_physics": 0.1933247184753418, "survival_time": 1.2500000000000004, "driven_lanedir": 0.06814144662571531, "sim_render-ego": 0.05544223785400391, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15899683952331542, "deviation-heading": 0.638366169946637, "set_robot_commands": 0.08558884620666504, "deviation-center-line": 0.09466029891830084, "driven_lanedir_consec": 0.06814144662571531, "sim_compute_sim_state": 0.03705830574035644, "sim_compute_performance-ego": 0.05993223190307617, "sim_compute_robot_state-ego": 0.06578329086303711, "sim_compute_robot_state-npc0": 0.060085411071777346, "sim_compute_robot_state-npc1": 0.060624094009399415, "sim_compute_robot_state-npc2": 0.06081487655639648, "sim_compute_robot_state-npc3": 0.05813167572021485}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1360913024836359, "sim_physics": 0.1206211126767672, "survival_time": 1.3000000000000005, "driven_lanedir": 0.062190920984986575, "sim_render-ego": 0.041885201747600846, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1210268002289992, "deviation-heading": 0.8365001779512337, "set_robot_commands": 0.06595696852757381, "deviation-center-line": 0.04654452675863551, "driven_lanedir_consec": 0.062190920984986575, "sim_compute_sim_state": 0.027146293566777155, "sim_compute_performance-ego": 0.04698711175184984, "sim_compute_robot_state-ego": 0.04767457338479849, "sim_compute_robot_state-npc0": 0.04708421230316162, "sim_compute_robot_state-npc1": 0.045769498898432806, "sim_compute_robot_state-npc2": 0.04547284199641301, "sim_compute_robot_state-npc3": 0.0462725804402278}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.2156692827764211, "sim_physics": 0.1782274674146603, "survival_time": 1.950000000000001, "driven_lanedir": 0.06947524826232065, "sim_render-ego": 0.06243216685759716, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.16631625860165328, "deviation-heading": 0.6906570612038296, "set_robot_commands": 0.09298043373303536, "deviation-center-line": 0.04774932989614036, "driven_lanedir_consec": 0.06947524826232065, "sim_compute_sim_state": 0.04152528444925944, "sim_compute_performance-ego": 0.07140862024747409, "sim_compute_robot_state-ego": 0.0779262016981076, "sim_compute_robot_state-npc0": 0.06909989699339256, "sim_compute_robot_state-npc1": 0.0684819649427365, "sim_compute_robot_state-npc2": 0.06957450891152406, "sim_compute_robot_state-npc3": 0.06881208908863556}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.11992072199147588, "sim_physics": 0.1927576706959651, "survival_time": 1.3000000000000005, "driven_lanedir": 0.05373239123963269, "sim_render-ego": 0.058785502727215104, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.15995104496295637, "deviation-heading": 0.6137971284761422, "set_robot_commands": 0.09189346203437218, "deviation-center-line": 0.06512377432009957, "driven_lanedir_consec": 0.05373239123963269, "sim_compute_sim_state": 0.03601824320279635, "sim_compute_performance-ego": 0.06257947591634896, "sim_compute_robot_state-ego": 0.06917618788205661, "sim_compute_robot_state-npc0": 0.06844513232891376, "sim_compute_robot_state-npc1": 0.05966759645021879, "sim_compute_robot_state-npc2": 0.06216304118816669, "sim_compute_robot_state-npc3": 0.0634528581912701}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.10322377002716536, "sim_physics": 0.16976577043533325, "survival_time": 1.2000000000000004, "driven_lanedir": 0.05775063107126677, "sim_render-ego": 0.058421184619267784, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16690322756767273, "deviation-heading": 0.635272022705146, "set_robot_commands": 0.08777597546577454, "deviation-center-line": 0.08173861480172218, "driven_lanedir_consec": 0.05775063107126677, "sim_compute_sim_state": 0.03720415631930033, "sim_compute_performance-ego": 0.06373035907745361, "sim_compute_robot_state-ego": 0.06808560093243916, "sim_compute_robot_state-npc0": 0.06465348601341248, "sim_compute_robot_state-npc1": 0.06982527176539104, "sim_compute_robot_state-npc2": 0.0665293534596761, "sim_compute_robot_state-npc3": 0.06590592861175537}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.2664548389627696, "sim_physics": 0.1790088176727295, "survival_time": 2.000000000000001, "driven_lanedir": 0.14117875567636862, "sim_render-ego": 0.06046784520149231, "in-drivable-lane": 0.5000000000000002, "agent_compute-ego": 0.16685298681259156, "deviation-heading": 0.7666971028646175, "set_robot_commands": 0.08462631702423096, "deviation-center-line": 0.04455787468573659, "driven_lanedir_consec": 0.14117875567636862, "sim_compute_sim_state": 0.03818677663803101, "sim_compute_performance-ego": 0.06707600355148316, "sim_compute_robot_state-ego": 0.07247701287269592, "sim_compute_robot_state-npc0": 0.06787875890731812, "sim_compute_robot_state-npc1": 0.06965561509132386, "sim_compute_robot_state-npc2": 0.06925073266029358, "sim_compute_robot_state-npc3": 0.06856895685195923}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1684502708468383, "sim_physics": 0.1161815936748798, "survival_time": 1.3000000000000005, "driven_lanedir": 0.0877210200270544, "sim_render-ego": 0.04508034999553974, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12891615354097807, "deviation-heading": 0.8684815001261574, "set_robot_commands": 0.06699111828437218, "deviation-center-line": 0.05669407424921031, "driven_lanedir_consec": 0.0877210200270544, "sim_compute_sim_state": 0.02840133813711313, "sim_compute_performance-ego": 0.04933460859151987, "sim_compute_robot_state-ego": 0.049698206094595104, "sim_compute_robot_state-npc0": 0.04773864379295936, "sim_compute_robot_state-npc1": 0.04714820935175969, "sim_compute_robot_state-npc2": 0.05010886375720684, "sim_compute_robot_state-npc3": 0.048369838641240046}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.16635266971035748, "sim_physics": 0.13589370250701904, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05206771627714435, "sim_render-ego": 0.04869455844163895, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1307450607419014, "deviation-heading": 0.842795983716735, "set_robot_commands": 0.07418506592512131, "deviation-center-line": 0.034221115106860704, "driven_lanedir_consec": 0.05206771627714435, "sim_compute_sim_state": 0.029382482171058655, "sim_compute_performance-ego": 0.0518643856048584, "sim_compute_robot_state-ego": 0.05227695405483246, "sim_compute_robot_state-npc0": 0.05606383830308914, "sim_compute_robot_state-npc1": 0.05469105392694473, "sim_compute_robot_state-npc2": 0.05288615822792053, "sim_compute_robot_state-npc3": 0.05510794371366501}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.11152707836209318, "sim_physics": 0.11044746095483954, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07430216811015633, "sim_render-ego": 0.04369520057331432, "in-drivable-lane": 0, "agent_compute-ego": 0.12042725086212158, "deviation-heading": 0.633161668341792, "set_robot_commands": 0.07578564773906361, "deviation-center-line": 0.09856101392100196, "driven_lanedir_consec": 0.07430216811015633, "sim_compute_sim_state": 0.02698223157362505, "sim_compute_performance-ego": 0.049310619180852715, "sim_compute_robot_state-ego": 0.05137376351789995, "sim_compute_robot_state-npc0": 0.0521550178527832, "sim_compute_robot_state-npc1": 0.05090663649819114, "sim_compute_robot_state-npc2": 0.05012174086137251, "sim_compute_robot_state-npc3": 0.051370891657742584}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.213121520801667, "sim_physics": 0.12741071299502724, "survival_time": 1.900000000000001, "driven_lanedir": 0.07342749917038549, "sim_render-ego": 0.0453889809156719, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.1218564698570653, "deviation-heading": 0.7208020674825103, "set_robot_commands": 0.06580694098221629, "deviation-center-line": 0.06432396279468568, "driven_lanedir_consec": 0.07342749917038549, "sim_compute_sim_state": 0.028651852356760127, "sim_compute_performance-ego": 0.04859908003556101, "sim_compute_robot_state-ego": 0.049504562428123074, "sim_compute_robot_state-npc0": 0.05017357123525519, "sim_compute_robot_state-npc1": 0.04988887435511539, "sim_compute_robot_state-npc2": 0.050419518822117856, "sim_compute_robot_state-npc3": 0.05154264600653397}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.11543104782289168, "sim_physics": 0.12491594190182892, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06880245823933606, "sim_render-ego": 0.04531669616699219, "in-drivable-lane": 0, "agent_compute-ego": 0.13515500400377356, "deviation-heading": 0.687341124254223, "set_robot_commands": 0.06442269035007643, "deviation-center-line": 0.09017432794428108, "driven_lanedir_consec": 0.06880245823933606, "sim_compute_sim_state": 0.026953831962917164, "sim_compute_performance-ego": 0.047048641287762184, "sim_compute_robot_state-ego": 0.04680087255394977, "sim_compute_robot_state-npc0": 0.05067781780077064, "sim_compute_robot_state-npc1": 0.04745799562205439, "sim_compute_robot_state-npc2": 0.04632307135540506, "sim_compute_robot_state-npc3": 0.04648586978083071}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1680017502911879, "sim_physics": 0.1303401651053593, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11601017826619486, "sim_render-ego": 0.0469716006311877, "in-drivable-lane": 0, "agent_compute-ego": 0.12289267572863348, "deviation-heading": 0.8051375170685292, "set_robot_commands": 0.07019320849714608, "deviation-center-line": 0.09182531114143604, "driven_lanedir_consec": 0.11601017826619486, "sim_compute_sim_state": 0.029662428231074893, "sim_compute_performance-ego": 0.051585526301943026, "sim_compute_robot_state-ego": 0.05165175733895137, "sim_compute_robot_state-npc0": 0.05113275297756853, "sim_compute_robot_state-npc1": 0.05358579240996262, "sim_compute_robot_state-npc2": 0.05109383319986278, "sim_compute_robot_state-npc3": 0.04864432071817333}}
set_robot_commands_max0.09787617127100628
set_robot_commands_mean0.08037619029752283
set_robot_commands_median0.08462631702423096
set_robot_commands_min0.06442269035007643
sim_compute_performance-ego_max0.0745113932568094
sim_compute_performance-ego_mean0.05804807950188603
sim_compute_performance-ego_median0.05993223190307617
sim_compute_performance-ego_min0.04698711175184984
sim_compute_robot_state-ego_max0.0779262016981076
sim_compute_robot_state-ego_mean0.06111960514281783
sim_compute_robot_state-ego_median0.06340051466418851
sim_compute_robot_state-ego_min0.04680087255394977
sim_compute_robot_state-npc0_max0.06909989699339256
sim_compute_robot_state-npc0_mean0.05873432452724949
sim_compute_robot_state-npc0_median0.060085411071777346
sim_compute_robot_state-npc0_min0.04708421230316162
sim_compute_robot_state-npc1_max0.07012327512105306
sim_compute_robot_state-npc1_mean0.05882098506980518
sim_compute_robot_state-npc1_median0.05966759645021879
sim_compute_robot_state-npc1_min0.045769498898432806
sim_compute_robot_state-npc2_max0.07034833563698663
sim_compute_robot_state-npc2_mean0.058521873607735655
sim_compute_robot_state-npc2_median0.06081487655639648
sim_compute_robot_state-npc2_min0.04547284199641301
sim_compute_robot_state-npc3_max0.07157523735709813
sim_compute_robot_state-npc3_mean0.05884050228593353
sim_compute_robot_state-npc3_median0.05813167572021485
sim_compute_robot_state-npc3_min0.0462725804402278
sim_compute_sim_state_max0.04152528444925944
sim_compute_sim_state_mean0.033586382869309456
sim_compute_sim_state_median0.03601824320279635
sim_compute_sim_state_min0.026953831962917164
sim_physics_max0.20347898939381476
sim_physics_mean0.15491174179738437
sim_physics_median0.1589486522059287
sim_physics_min0.11044746095483954
sim_render-ego_max0.06764827603879182
sim_render-ego_mean0.052948059497179074
sim_render-ego_median0.05544223785400391
sim_render-ego_min0.041885201747600846
simulation-passed1
survival_time_max2.000000000000001
survival_time_mean1.4666666666666677
survival_time_min1.1000000000000003
No reset possible