Duckietown Challenges Home Challenges Submissions

Submission 3851

Submission3851
Competingyes
Challengeaido2-LFV-sim-testing-offseason
UserJunghyun Seo 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 24055
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
24055step1-simulationsuccessyes0:13:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06947524826232065
survival_time_median1.3000000000000005
deviation-center-line_median0.06512377432009957
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.16704841454823813
agent_compute-ego_mean0.1450840945902538
agent_compute-ego_median0.1480418806490691
agent_compute-ego_min0.12042725086212158
deviation-center-line_max0.09912182735535308
deviation-center-line_mean0.06956223729060027
deviation-center-line_min0.034221115106860704
deviation-heading_max0.9568908317311412
deviation-heading_mean0.7331424734268113
deviation-heading_median0.6918688301065948
deviation-heading_min0.6093679154268812
driven_any_max0.2664548389627696
driven_any_mean0.16158241740697565
driven_any_median0.16635266971035748
driven_any_min0.09830786333507666
driven_lanedir_consec_max0.14117875567636862
driven_lanedir_consec_mean0.07727458275898706
driven_lanedir_consec_min0.05206771627714435
driven_lanedir_max0.14117875567636862
driven_lanedir_mean0.07727458275898706
driven_lanedir_median0.06947524826232065
driven_lanedir_min0.05206771627714435
in-drivable-lane_max0.7000000000000006
in-drivable-lane_mean0.2600000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2216939397145425, "sim_physics": 0.18235335085127088, "survival_time": 1.800000000000001, "driven_lanedir": 0.07943468613563676, "sim_render-ego": 0.056959728399912514, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.16704841454823813, "deviation-heading": 0.6918688301065948, "set_robot_commands": 0.09787617127100628, "deviation-center-line": 0.05811903637043487, "driven_lanedir_consec": 0.07943468613563676, "sim_compute_sim_state": 0.03633320331573486, "sim_compute_performance-ego": 0.06499005688561334, "sim_compute_robot_state-ego": 0.07335406541824341, "sim_compute_robot_state-npc0": 0.06719151470396253, "sim_compute_robot_state-npc1": 0.07012327512105306, "sim_compute_robot_state-npc2": 0.07034833563698663, "sim_compute_robot_state-npc3": 0.0688115225897895}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20615819948533312, "sim_physics": 0.1589486522059287, "survival_time": 1.5500000000000007, "driven_lanedir": 0.09157991248925246, "sim_render-ego": 0.05703136228745984, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.16113135122483777, "deviation-heading": 0.9568908317311412, "set_robot_commands": 0.09058475494384766, "deviation-center-line": 0.07001847109510527, "driven_lanedir_consec": 0.09157991248925246, "sim_compute_sim_state": 0.039651801509241906, "sim_compute_performance-ego": 0.061763078935684695, "sim_compute_robot_state-ego": 0.06340051466418851, "sim_compute_robot_state-npc0": 0.06369275431479177, "sim_compute_robot_state-npc1": 0.06507884302446919, "sim_compute_robot_state-npc2": 0.0643343617839198, "sim_compute_robot_state-npc3": 0.06955517491986675}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09830786333507666, "sim_physics": 0.20347898939381476, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06330370880935465, "sim_render-ego": 0.06764827603879182, "in-drivable-lane": 0, "agent_compute-ego": 0.1480418806490691, "deviation-heading": 0.6093679154268812, "set_robot_commands": 0.09097525347834048, "deviation-center-line": 0.09912182735535308, "driven_lanedir_consec": 0.06330370880935465, "sim_compute_sim_state": 0.04063751386559528, "sim_compute_performance-ego": 0.0745113932568094, "sim_compute_robot_state-ego": 0.07761051343834918, "sim_compute_robot_state-npc0": 0.06494205930958623, "sim_compute_robot_state-npc1": 0.06941005458002505, "sim_compute_robot_state-npc2": 0.06838686569877293, "sim_compute_robot_state-npc3": 0.07157523735709813}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1133320044931791, "sim_physics": 0.1933247184753418, "survival_time": 1.2500000000000004, "driven_lanedir": 0.06814144662571531, "sim_render-ego": 0.05544223785400391, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15899683952331542, "deviation-heading": 0.638366169946637, "set_robot_commands": 0.08558884620666504, "deviation-center-line": 0.09466029891830084, "driven_lanedir_consec": 0.06814144662571531, "sim_compute_sim_state": 0.03705830574035644, "sim_compute_performance-ego": 0.05993223190307617, "sim_compute_robot_state-ego": 0.06578329086303711, "sim_compute_robot_state-npc0": 0.060085411071777346, "sim_compute_robot_state-npc1": 0.060624094009399415, "sim_compute_robot_state-npc2": 0.06081487655639648, "sim_compute_robot_state-npc3": 0.05813167572021485}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1360913024836359, "sim_physics": 0.1206211126767672, "survival_time": 1.3000000000000005, "driven_lanedir": 0.062190920984986575, "sim_render-ego": 0.041885201747600846, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1210268002289992, "deviation-heading": 0.8365001779512337, "set_robot_commands": 0.06595696852757381, "deviation-center-line": 0.04654452675863551, "driven_lanedir_consec": 0.062190920984986575, "sim_compute_sim_state": 0.027146293566777155, "sim_compute_performance-ego": 0.04698711175184984, "sim_compute_robot_state-ego": 0.04767457338479849, "sim_compute_robot_state-npc0": 0.04708421230316162, "sim_compute_robot_state-npc1": 0.045769498898432806, "sim_compute_robot_state-npc2": 0.04547284199641301, "sim_compute_robot_state-npc3": 0.0462725804402278}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.2156692827764211, "sim_physics": 0.1782274674146603, "survival_time": 1.950000000000001, "driven_lanedir": 0.06947524826232065, "sim_render-ego": 0.06243216685759716, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.16631625860165328, "deviation-heading": 0.6906570612038296, "set_robot_commands": 0.09298043373303536, "deviation-center-line": 0.04774932989614036, "driven_lanedir_consec": 0.06947524826232065, "sim_compute_sim_state": 0.04152528444925944, "sim_compute_performance-ego": 0.07140862024747409, "sim_compute_robot_state-ego": 0.0779262016981076, "sim_compute_robot_state-npc0": 0.06909989699339256, "sim_compute_robot_state-npc1": 0.0684819649427365, "sim_compute_robot_state-npc2": 0.06957450891152406, "sim_compute_robot_state-npc3": 0.06881208908863556}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.11992072199147588, "sim_physics": 0.1927576706959651, "survival_time": 1.3000000000000005, "driven_lanedir": 0.05373239123963269, "sim_render-ego": 0.058785502727215104, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.15995104496295637, "deviation-heading": 0.6137971284761422, "set_robot_commands": 0.09189346203437218, "deviation-center-line": 0.06512377432009957, "driven_lanedir_consec": 0.05373239123963269, "sim_compute_sim_state": 0.03601824320279635, "sim_compute_performance-ego": 0.06257947591634896, "sim_compute_robot_state-ego": 0.06917618788205661, "sim_compute_robot_state-npc0": 0.06844513232891376, "sim_compute_robot_state-npc1": 0.05966759645021879, "sim_compute_robot_state-npc2": 0.06216304118816669, "sim_compute_robot_state-npc3": 0.0634528581912701}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.10322377002716536, "sim_physics": 0.16976577043533325, "survival_time": 1.2000000000000004, "driven_lanedir": 0.05775063107126677, "sim_render-ego": 0.058421184619267784, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16690322756767273, "deviation-heading": 0.635272022705146, "set_robot_commands": 0.08777597546577454, "deviation-center-line": 0.08173861480172218, "driven_lanedir_consec": 0.05775063107126677, "sim_compute_sim_state": 0.03720415631930033, "sim_compute_performance-ego": 0.06373035907745361, "sim_compute_robot_state-ego": 0.06808560093243916, "sim_compute_robot_state-npc0": 0.06465348601341248, "sim_compute_robot_state-npc1": 0.06982527176539104, "sim_compute_robot_state-npc2": 0.0665293534596761, "sim_compute_robot_state-npc3": 0.06590592861175537}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.2664548389627696, "sim_physics": 0.1790088176727295, "survival_time": 2.000000000000001, "driven_lanedir": 0.14117875567636862, "sim_render-ego": 0.06046784520149231, "in-drivable-lane": 0.5000000000000002, "agent_compute-ego": 0.16685298681259156, "deviation-heading": 0.7666971028646175, "set_robot_commands": 0.08462631702423096, "deviation-center-line": 0.04455787468573659, "driven_lanedir_consec": 0.14117875567636862, "sim_compute_sim_state": 0.03818677663803101, "sim_compute_performance-ego": 0.06707600355148316, "sim_compute_robot_state-ego": 0.07247701287269592, "sim_compute_robot_state-npc0": 0.06787875890731812, "sim_compute_robot_state-npc1": 0.06965561509132386, "sim_compute_robot_state-npc2": 0.06925073266029358, "sim_compute_robot_state-npc3": 0.06856895685195923}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1684502708468383, "sim_physics": 0.1161815936748798, "survival_time": 1.3000000000000005, "driven_lanedir": 0.0877210200270544, "sim_render-ego": 0.04508034999553974, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12891615354097807, "deviation-heading": 0.8684815001261574, "set_robot_commands": 0.06699111828437218, "deviation-center-line": 0.05669407424921031, "driven_lanedir_consec": 0.0877210200270544, "sim_compute_sim_state": 0.02840133813711313, "sim_compute_performance-ego": 0.04933460859151987, "sim_compute_robot_state-ego": 0.049698206094595104, "sim_compute_robot_state-npc0": 0.04773864379295936, "sim_compute_robot_state-npc1": 0.04714820935175969, "sim_compute_robot_state-npc2": 0.05010886375720684, "sim_compute_robot_state-npc3": 0.048369838641240046}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.16635266971035748, "sim_physics": 0.13589370250701904, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05206771627714435, "sim_render-ego": 0.04869455844163895, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1307450607419014, "deviation-heading": 0.842795983716735, "set_robot_commands": 0.07418506592512131, "deviation-center-line": 0.034221115106860704, "driven_lanedir_consec": 0.05206771627714435, "sim_compute_sim_state": 0.029382482171058655, "sim_compute_performance-ego": 0.0518643856048584, "sim_compute_robot_state-ego": 0.05227695405483246, "sim_compute_robot_state-npc0": 0.05606383830308914, "sim_compute_robot_state-npc1": 0.05469105392694473, "sim_compute_robot_state-npc2": 0.05288615822792053, "sim_compute_robot_state-npc3": 0.05510794371366501}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.11152707836209318, "sim_physics": 0.11044746095483954, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07430216811015633, "sim_render-ego": 0.04369520057331432, "in-drivable-lane": 0, "agent_compute-ego": 0.12042725086212158, "deviation-heading": 0.633161668341792, "set_robot_commands": 0.07578564773906361, "deviation-center-line": 0.09856101392100196, "driven_lanedir_consec": 0.07430216811015633, "sim_compute_sim_state": 0.02698223157362505, "sim_compute_performance-ego": 0.049310619180852715, "sim_compute_robot_state-ego": 0.05137376351789995, "sim_compute_robot_state-npc0": 0.0521550178527832, "sim_compute_robot_state-npc1": 0.05090663649819114, "sim_compute_robot_state-npc2": 0.05012174086137251, "sim_compute_robot_state-npc3": 0.051370891657742584}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.213121520801667, "sim_physics": 0.12741071299502724, "survival_time": 1.900000000000001, "driven_lanedir": 0.07342749917038549, "sim_render-ego": 0.0453889809156719, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.1218564698570653, "deviation-heading": 0.7208020674825103, "set_robot_commands": 0.06580694098221629, "deviation-center-line": 0.06432396279468568, "driven_lanedir_consec": 0.07342749917038549, "sim_compute_sim_state": 0.028651852356760127, "sim_compute_performance-ego": 0.04859908003556101, "sim_compute_robot_state-ego": 0.049504562428123074, "sim_compute_robot_state-npc0": 0.05017357123525519, "sim_compute_robot_state-npc1": 0.04988887435511539, "sim_compute_robot_state-npc2": 0.050419518822117856, "sim_compute_robot_state-npc3": 0.05154264600653397}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.11543104782289168, "sim_physics": 0.12491594190182892, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06880245823933606, "sim_render-ego": 0.04531669616699219, "in-drivable-lane": 0, "agent_compute-ego": 0.13515500400377356, "deviation-heading": 0.687341124254223, "set_robot_commands": 0.06442269035007643, "deviation-center-line": 0.09017432794428108, "driven_lanedir_consec": 0.06880245823933606, "sim_compute_sim_state": 0.026953831962917164, "sim_compute_performance-ego": 0.047048641287762184, "sim_compute_robot_state-ego": 0.04680087255394977, "sim_compute_robot_state-npc0": 0.05067781780077064, "sim_compute_robot_state-npc1": 0.04745799562205439, "sim_compute_robot_state-npc2": 0.04632307135540506, "sim_compute_robot_state-npc3": 0.04648586978083071}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1680017502911879, "sim_physics": 0.1303401651053593, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11601017826619486, "sim_render-ego": 0.0469716006311877, "in-drivable-lane": 0, "agent_compute-ego": 0.12289267572863348, "deviation-heading": 0.8051375170685292, "set_robot_commands": 0.07019320849714608, "deviation-center-line": 0.09182531114143604, "driven_lanedir_consec": 0.11601017826619486, "sim_compute_sim_state": 0.029662428231074893, "sim_compute_performance-ego": 0.051585526301943026, "sim_compute_robot_state-ego": 0.05165175733895137, "sim_compute_robot_state-npc0": 0.05113275297756853, "sim_compute_robot_state-npc1": 0.05358579240996262, "sim_compute_robot_state-npc2": 0.05109383319986278, "sim_compute_robot_state-npc3": 0.04864432071817333}}
set_robot_commands_max0.09787617127100628
set_robot_commands_mean0.08037619029752283
set_robot_commands_median0.08462631702423096
set_robot_commands_min0.06442269035007643
sim_compute_performance-ego_max0.0745113932568094
sim_compute_performance-ego_mean0.05804807950188603
sim_compute_performance-ego_median0.05993223190307617
sim_compute_performance-ego_min0.04698711175184984
sim_compute_robot_state-ego_max0.0779262016981076
sim_compute_robot_state-ego_mean0.06111960514281783
sim_compute_robot_state-ego_median0.06340051466418851
sim_compute_robot_state-ego_min0.04680087255394977
sim_compute_robot_state-npc0_max0.06909989699339256
sim_compute_robot_state-npc0_mean0.05873432452724949
sim_compute_robot_state-npc0_median0.060085411071777346
sim_compute_robot_state-npc0_min0.04708421230316162
sim_compute_robot_state-npc1_max0.07012327512105306
sim_compute_robot_state-npc1_mean0.05882098506980518
sim_compute_robot_state-npc1_median0.05966759645021879
sim_compute_robot_state-npc1_min0.045769498898432806
sim_compute_robot_state-npc2_max0.07034833563698663
sim_compute_robot_state-npc2_mean0.058521873607735655
sim_compute_robot_state-npc2_median0.06081487655639648
sim_compute_robot_state-npc2_min0.04547284199641301
sim_compute_robot_state-npc3_max0.07157523735709813
sim_compute_robot_state-npc3_mean0.05884050228593353
sim_compute_robot_state-npc3_median0.05813167572021485
sim_compute_robot_state-npc3_min0.0462725804402278
sim_compute_sim_state_max0.04152528444925944
sim_compute_sim_state_mean0.033586382869309456
sim_compute_sim_state_median0.03601824320279635
sim_compute_sim_state_min0.026953831962917164
sim_physics_max0.20347898939381476
sim_physics_mean0.15491174179738437
sim_physics_median0.1589486522059287
sim_physics_min0.11044746095483954
sim_render-ego_max0.06764827603879182
sim_render-ego_mean0.052948059497179074
sim_render-ego_median0.05544223785400391
sim_render-ego_min0.041885201747600846
simulation-passed1
survival_time_max2.000000000000001
survival_time_mean1.4666666666666677
survival_time_min1.1000000000000003
No reset possible