Duckietown Challenges Home Challenges Submissions

Submission 5984

Submission5984
Competingyes
Challengeaido3-LFVI-sim-testing
UserFrank (Chude) Qian 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 29806
Next
User label2019-12-09|FrankNet|v3-LFSIM
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
29806step1-simulationsuccessyes0:47:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.220388383819243
survival_time_median12.750000000000046
deviation-center-line_median0.8903199250957368
in-drivable-lane_median0.5000000000000071


other stats
agent_compute-ego_max0.05930660883585612
agent_compute-ego_mean0.053093891604797314
agent_compute-ego_median0.05257230944338098
agent_compute-ego_min0.0501081238752641
deviation-center-line_max1.262757098781622
deviation-center-line_mean0.8075101109649307
deviation-center-line_min0.31303088247523814
deviation-heading_max3.6561993969464064
deviation-heading_mean2.2512010410168983
deviation-heading_median2.7513500726754616
deviation-heading_min0.7155142927226227
driven_any_max6.839047491099269
driven_any_mean4.527642906663776
driven_any_median4.9105582020542915
driven_any_min1.3662597145623137
driven_lanedir_consec_max6.6839073519389025
driven_lanedir_consec_mean3.919841228139269
driven_lanedir_consec_min1.269293127184714
driven_lanedir_max6.6839073519389025
driven_lanedir_mean4.117228035371524
driven_lanedir_median4.5414337985622435
driven_lanedir_min1.269293127184714
in-drivable-lane_max1.8500000000000243
in-drivable-lane_mean0.730000000000004
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 6.119811278749011, "sim_physics": 0.20469584226608276, "survival_time": 14.950000000000076, "driven_lanedir": 5.306188207774671, "sim_render-ego": 0.01396884282430013, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.05443699836730957, "deviation-heading": 3.0127360745654665, "set_robot_commands": 0.009388848940531411, "deviation-center-line": 0.8908889194405862, "driven_lanedir_consec": 5.14884170066425, "sim_compute_sim_state": 0.005946954886118571, "sim_compute_performance-ego": 0.00825126568476359, "sim_compute_robot_state-ego": 0.009806364377339682, "sim_compute_robot_state-npc0": 0.009980050722757976, "sim_compute_robot_state-npc1": 0.010988969802856446, "sim_compute_robot_state-npc2": 0.009937458833058676, "sim_compute_robot_state-npc3": 0.009525988101959228}, "udem1-1-0": {"driven_any": 2.0179830233929783, "sim_physics": 0.2097226876132893, "survival_time": 5.299999999999989, "driven_lanedir": 1.991019008773102, "sim_render-ego": 0.014622573582631236, "in-drivable-lane": 0, "agent_compute-ego": 0.055243233464798834, "deviation-heading": 0.7155142927226227, "set_robot_commands": 0.009890383144594587, "deviation-center-line": 0.3510487836245715, "driven_lanedir_consec": 1.991019008773102, "sim_compute_sim_state": 0.006097440449696667, "sim_compute_performance-ego": 0.008820072659906352, "sim_compute_robot_state-ego": 0.010300400122156684, "sim_compute_robot_state-npc0": 0.010186975856996933, "sim_compute_robot_state-npc1": 0.010041688973048949, "sim_compute_robot_state-npc2": 0.009599013148613696, "sim_compute_robot_state-npc3": 0.010113322509909576}, "udem1-2-0": {"driven_any": 6.302441861387461, "sim_physics": 0.19545791864395143, "survival_time": 14.950000000000076, "driven_lanedir": 5.6621657671156465, "sim_render-ego": 0.014205749034881593, "in-drivable-lane": 1.100000000000005, "agent_compute-ego": 0.05930660883585612, "deviation-heading": 2.8154358541800417, "set_robot_commands": 0.009789528052012126, "deviation-center-line": 1.2480982077921872, "driven_lanedir_consec": 5.6621657671156465, "sim_compute_sim_state": 0.0057508118947347, "sim_compute_performance-ego": 0.008686646620432536, "sim_compute_robot_state-ego": 0.010178903738657631, "sim_compute_robot_state-npc0": 0.00992882251739502, "sim_compute_robot_state-npc1": 0.00967765728632609, "sim_compute_robot_state-npc2": 0.009427625338236491, "sim_compute_robot_state-npc3": 0.00976277748743693}, "udem1-3-0": {"driven_any": 2.8620745801511225, "sim_physics": 0.17958033446109656, "survival_time": 6.5999999999999845, "driven_lanedir": 2.2737867113022965, "sim_render-ego": 0.013900617758433024, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.05259627103805542, "deviation-heading": 1.480166909745899, "set_robot_commands": 0.009510748314135002, "deviation-center-line": 0.4930083488010429, "driven_lanedir_consec": 2.243829124596388, "sim_compute_sim_state": 0.005686080817020301, "sim_compute_performance-ego": 0.008051453214703184, "sim_compute_robot_state-ego": 0.009816792878237638, "sim_compute_robot_state-npc0": 0.009172051241903597, "sim_compute_robot_state-npc1": 0.00951624819726655, "sim_compute_robot_state-npc2": 0.009292069709662235, "sim_compute_robot_state-npc3": 0.009452924583897446}, "udem1-4-0": {"driven_any": 5.913506912939874, "sim_physics": 0.1925493860244751, "survival_time": 14.950000000000076, "driven_lanedir": 5.5960530772395805, "sim_render-ego": 0.01448025623957316, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.05574036995569865, "deviation-heading": 2.8957003521372733, "set_robot_commands": 0.010328972339630128, "deviation-center-line": 0.8903199250957368, "driven_lanedir_consec": 5.194497310541327, "sim_compute_sim_state": 0.005932017167409261, "sim_compute_performance-ego": 0.008903448581695556, "sim_compute_robot_state-ego": 0.010665536721547445, "sim_compute_robot_state-npc0": 0.010540393193562826, "sim_compute_robot_state-npc1": 0.0100247319539388, "sim_compute_robot_state-npc2": 0.009753466447194416, "sim_compute_robot_state-npc3": 0.00943095604578654}, "udem1-5-0": {"driven_any": 1.3662597145623137, "sim_physics": 0.18766282892775263, "survival_time": 4.3499999999999925, "driven_lanedir": 1.269293127184714, "sim_render-ego": 0.014221040681860912, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.051066445208143914, "deviation-heading": 1.3357894348592294, "set_robot_commands": 0.010956435367978853, "deviation-center-line": 0.31303088247523814, "driven_lanedir_consec": 1.269293127184714, "sim_compute_sim_state": 0.005575835019692607, "sim_compute_performance-ego": 0.008938994900933627, "sim_compute_robot_state-ego": 0.010202473607556573, "sim_compute_robot_state-npc0": 0.009725839242167855, "sim_compute_robot_state-npc1": 0.00966867359205224, "sim_compute_robot_state-npc2": 0.009532257058154575, "sim_compute_robot_state-npc3": 0.009513693294305911}, "udem1-6-0": {"driven_any": 6.839047491099269, "sim_physics": 0.18509695688883465, "survival_time": 14.950000000000076, "driven_lanedir": 6.6839073519389025, "sim_render-ego": 0.013536015351613362, "in-drivable-lane": 0, "agent_compute-ego": 0.05156483809153239, "deviation-heading": 2.7513500726754616, "set_robot_commands": 0.00916245937347412, "deviation-center-line": 1.1236649549999926, "driven_lanedir_consec": 6.6839073519389025, "sim_compute_sim_state": 0.0059057664871215824, "sim_compute_performance-ego": 0.008028221925099692, "sim_compute_robot_state-ego": 0.00961132526397705, "sim_compute_robot_state-npc0": 0.009695361455281576, "sim_compute_robot_state-npc1": 0.009442718029022216, "sim_compute_robot_state-npc2": 0.009452024300893149, "sim_compute_robot_state-npc3": 0.009351558685302734}, "udem1-7-0": {"driven_any": 2.2757256038135587, "sim_physics": 0.1991124849403854, "survival_time": 5.649999999999988, "driven_lanedir": 2.141276311384422, "sim_render-ego": 0.013278522322663164, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.05257230944338098, "deviation-heading": 1.4349577424504227, "set_robot_commands": 0.008697556183401463, "deviation-center-line": 0.3726843930898237, "driven_lanedir_consec": 1.5921367913674225, "sim_compute_sim_state": 0.005889460048844329, "sim_compute_performance-ego": 0.008555169654103507, "sim_compute_robot_state-ego": 0.00948252720115459, "sim_compute_robot_state-npc0": 0.008991078992860507, "sim_compute_robot_state-npc1": 0.008988393091522487, "sim_compute_robot_state-npc2": 0.008847067841386374, "sim_compute_robot_state-npc3": 0.009537730596761789}, "udem1-8-0": {"driven_any": 6.156575124891453, "sim_physics": 0.1891631786028544, "survival_time": 14.950000000000076, "driven_lanedir": 5.332469748194744, "sim_render-ego": 0.013382169405619305, "in-drivable-lane": 1.5499999999999954, "agent_compute-ego": 0.051292884349823, "deviation-heading": 2.8199489394526984, "set_robot_commands": 0.00901136795679728, "deviation-center-line": 1.0898284109834335, "driven_lanedir_consec": 4.838165348377935, "sim_compute_sim_state": 0.005738257567087809, "sim_compute_performance-ego": 0.007819090684254964, "sim_compute_robot_state-ego": 0.009598886966705324, "sim_compute_robot_state-npc0": 0.009647793769836426, "sim_compute_robot_state-npc1": 0.00913701057434082, "sim_compute_robot_state-npc2": 0.009167846043904622, "sim_compute_robot_state-npc3": 0.009056918621063233}, "udem1-9-0": {"driven_any": 6.283512408164992, "sim_physics": 0.19852347294489545, "survival_time": 14.950000000000076, "driven_lanedir": 5.8893292068608805, "sim_render-ego": 0.013694180647532144, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.051917933622996015, "deviation-heading": 3.6561993969464064, "set_robot_commands": 0.009590488274892173, "deviation-center-line": 1.262757098781622, "driven_lanedir_consec": 5.878622989842787, "sim_compute_sim_state": 0.006221497853597005, "sim_compute_performance-ego": 0.008157397905985514, "sim_compute_robot_state-ego": 0.010008544921875, "sim_compute_robot_state-npc0": 0.009843810399373373, "sim_compute_robot_state-npc1": 0.00948850393295288, "sim_compute_robot_state-npc2": 0.009679469267527262, "sim_compute_robot_state-npc3": 0.00923697312672933}, "udem1-10-0": {"driven_any": 3.0510363518386048, "sim_physics": 0.18144322859274375, "survival_time": 9.249999999999996, "driven_lanedir": 2.561195406891373, "sim_render-ego": 0.013879764402234877, "in-drivable-lane": 1.4499999999999955, "agent_compute-ego": 0.052393283070744694, "deviation-heading": 1.6762951924924447, "set_robot_commands": 0.00954048440263078, "deviation-center-line": 0.6267133304933905, "driven_lanedir_consec": 2.561195406891373, "sim_compute_sim_state": 0.006049518327455263, "sim_compute_performance-ego": 0.008065678622271564, "sim_compute_robot_state-ego": 0.010031245205853436, "sim_compute_robot_state-npc0": 0.00967026916710106, "sim_compute_robot_state-npc1": 0.009850197869378166, "sim_compute_robot_state-npc2": 0.009950371046324034, "sim_compute_robot_state-npc3": 0.009678042901528848}, "udem1-11-0": {"driven_any": 4.731555170870541, "sim_physics": 0.20058434710783116, "survival_time": 12.750000000000046, "driven_lanedir": 4.5414337985622435, "sim_render-ego": 0.01346144302218568, "in-drivable-lane": 0, "agent_compute-ego": 0.05320083767760034, "deviation-heading": 2.9811259673461983, "set_robot_commands": 0.009389740813012215, "deviation-center-line": 1.102754429857594, "driven_lanedir_consec": 4.220388383819243, "sim_compute_sim_state": 0.005823577619066426, "sim_compute_performance-ego": 0.00819097687216366, "sim_compute_robot_state-ego": 0.009465591580260032, "sim_compute_robot_state-npc0": 0.010136837117812212, "sim_compute_robot_state-npc1": 0.01002515437556248, "sim_compute_robot_state-npc2": 0.009139686472275678, "sim_compute_robot_state-npc3": 0.009560086680393593}, "udem1-12-0": {"driven_any": 4.9105582020542915, "sim_physics": 0.18462490807309676, "survival_time": 10.450000000000014, "driven_lanedir": 4.455636377024307, "sim_render-ego": 0.013566640005157324, "in-drivable-lane": 1.2000000000000126, "agent_compute-ego": 0.052962038505590704, "deviation-heading": 1.6299715081773811, "set_robot_commands": 0.008825030623440536, "deviation-center-line": 0.6871982867082305, "driven_lanedir_consec": 4.153942141718898, "sim_compute_sim_state": 0.005816436840586685, "sim_compute_performance-ego": 0.00843791300029846, "sim_compute_robot_state-ego": 0.009892974744002784, "sim_compute_robot_state-npc0": 0.010067977403339586, "sim_compute_robot_state-npc1": 0.00949267565348502, "sim_compute_robot_state-npc2": 0.009935076727251116, "sim_compute_robot_state-npc3": 0.009561359597165048}, "udem1-13-0": {"driven_any": 6.026652882539915, "sim_physics": 0.18942035754521688, "survival_time": 14.950000000000076, "driven_lanedir": 5.0791650363690675, "sim_render-ego": 0.014137158393859863, "in-drivable-lane": 1.8500000000000243, "agent_compute-ego": 0.0520061985651652, "deviation-heading": 3.3840370878144372, "set_robot_commands": 0.009490211009979248, "deviation-center-line": 1.0600968041422254, "driven_lanedir_consec": 4.385856434563978, "sim_compute_sim_state": 0.005869024594624837, "sim_compute_performance-ego": 0.007910637060801189, "sim_compute_robot_state-ego": 0.010181514422098796, "sim_compute_robot_state-npc0": 0.010345198313395185, "sim_compute_robot_state-npc1": 0.009967291355133056, "sim_compute_robot_state-npc2": 0.009696685473124186, "sim_compute_robot_state-npc3": 0.009861844380696616}, "udem1-14-0": {"driven_any": 3.0579029935012696, "sim_physics": 0.2161046049130038, "survival_time": 7.94999999999998, "driven_lanedir": 2.9755013939569146, "sim_render-ego": 0.014030392064988238, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.0501081238752641, "deviation-heading": 1.1787867896874986, "set_robot_commands": 0.009263816869483804, "deviation-center-line": 0.600558888188286, "driven_lanedir_consec": 2.973757534693072, "sim_compute_sim_state": 0.005734100281817358, "sim_compute_performance-ego": 0.008598390615211343, "sim_compute_robot_state-ego": 0.010060157416001806, "sim_compute_robot_state-npc0": 0.009735287360425265, "sim_compute_robot_state-npc1": 0.00976550504096649, "sim_compute_robot_state-npc2": 0.009428018294040512, "sim_compute_robot_state-npc3": 0.009658030743868846}}
set_robot_commands_max0.010956435367978853
set_robot_commands_mean0.009522404777732914
set_robot_commands_median0.009490211009979248
set_robot_commands_min0.008697556183401463
sim_compute_performance-ego_max0.008938994900933627
sim_compute_performance-ego_mean0.00836102386684165
sim_compute_performance-ego_median0.00825126568476359
sim_compute_performance-ego_min0.007819090684254964
sim_compute_robot_state-ego_max0.010665536721547445
sim_compute_robot_state-ego_mean0.0099535492778283
sim_compute_robot_state-ego_median0.010008544921875
sim_compute_robot_state-ego_min0.009465591580260032
sim_compute_robot_state-npc0_max0.010540393193562826
sim_compute_robot_state-npc0_mean0.009844516450280625
sim_compute_robot_state-npc0_median0.009843810399373373
sim_compute_robot_state-npc0_min0.008991078992860507
sim_compute_robot_state-npc1_max0.010988969802856446
sim_compute_robot_state-npc1_mean0.00973836131519018
sim_compute_robot_state-npc1_median0.00967765728632609
sim_compute_robot_state-npc1_min0.008988393091522487
sim_compute_robot_state-npc2_max0.009950371046324034
sim_compute_robot_state-npc2_mean0.0095225424001098
sim_compute_robot_state-npc2_median0.009532257058154575
sim_compute_robot_state-npc2_min0.008847067841386374
sim_compute_robot_state-npc3_max0.010113322509909576
sim_compute_robot_state-npc3_mean0.00955348049045371
sim_compute_robot_state-npc3_median0.009537730596761789
sim_compute_robot_state-npc3_min0.009056918621063233
sim_compute_sim_state_max0.006221497853597005
sim_compute_sim_state_mean0.0058691186569915605
sim_compute_sim_state_median0.005869024594624837
sim_compute_sim_state_min0.005575835019692607
sim_physics_max0.2161046049130038
sim_physics_mean0.19424950250303397
sim_physics_median0.1925493860244751
sim_physics_min0.17958033446109656
sim_render-ego_max0.014622573582631236
sim_render-ego_mean0.013891024382502266
sim_render-ego_median0.013900617758433024
sim_render-ego_min0.013278522322663164
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.130000000000036
survival_time_min4.3499999999999925
No reset possible
29789step1-simulationabortedyes0:46:03
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
29787step1-simulationabortedyes0:49:50
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible