Duckietown Challenges Home Challenges Submissions

Submission 2620

Submission2620
Competingyes
Challengeaido2-LFV-sim-testing
UserAndrea Censi 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22860
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22860step1-simulationsuccessyes0:22:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.17894554138183594
agent_compute-ego_mean0.1641043366789378
agent_compute-ego_median0.16484166446485018
agent_compute-ego_min0.13732937335968018
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.17371439492260968, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06479727780377423, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16340051315448903, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10212986999087864, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04277892465944643, "sim_compute_performance-ego": 0.07574394897178367, "sim_compute_robot_state-ego": 0.08133443196614583, "sim_compute_robot_state-npc0": 0.07413212458292644, "sim_compute_robot_state-npc1": 0.07219793178417065, "sim_compute_robot_state-npc2": 0.07486850685543484, "sim_compute_robot_state-npc3": 0.07215634540275291}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.19436711311340332, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06822267532348633, "in-drivable-lane": 0, "agent_compute-ego": 0.1728217887878418, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.1066957950592041, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.04175745964050293, "sim_compute_performance-ego": 0.07350690841674805, "sim_compute_robot_state-ego": 0.07627725601196289, "sim_compute_robot_state-npc0": 0.07333404541015626, "sim_compute_robot_state-npc1": 0.0748359203338623, "sim_compute_robot_state-npc2": 0.07040090560913086, "sim_compute_robot_state-npc3": 0.07229434013366699}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.19041339347237035, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06651949568798668, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.16991090774536133, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.10567270768316168, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.041699807894857305, "sim_compute_performance-ego": 0.0752334845693488, "sim_compute_robot_state-ego": 0.07783845223878559, "sim_compute_robot_state-npc0": 0.07516330166866905, "sim_compute_robot_state-npc1": 0.07505862963827033, "sim_compute_robot_state-npc2": 0.0751759692242271, "sim_compute_robot_state-npc3": 0.07388115242907875}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.2180070273483856, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06817852394490302, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.172997197018394, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.1029549912561344, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04225815096987954, "sim_compute_performance-ego": 0.07349309740187246, "sim_compute_robot_state-ego": 0.0825493275364743, "sim_compute_robot_state-npc0": 0.07476439657090586, "sim_compute_robot_state-npc1": 0.0763187046292462, "sim_compute_robot_state-npc2": 0.07414486438413209, "sim_compute_robot_state-npc3": 0.07406338257125661}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.15257720436368669, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05375839982713971, "in-drivable-lane": 0, "agent_compute-ego": 0.14962342807224818, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.08765157631465367, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03689245666776385, "sim_compute_performance-ego": 0.06272843054362706, "sim_compute_robot_state-ego": 0.07990742581231254, "sim_compute_robot_state-npc0": 0.06349331140518188, "sim_compute_robot_state-npc1": 0.06205776759556362, "sim_compute_robot_state-npc2": 0.061711677483149936, "sim_compute_robot_state-npc3": 0.06129346575055804}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.16708012863441749, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.06694951763859501, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.1610933542251587, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.10173903571234807, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.03866135191034387, "sim_compute_performance-ego": 0.0715486694265295, "sim_compute_robot_state-ego": 0.0743307802412245, "sim_compute_robot_state-npc0": 0.0729471798296328, "sim_compute_robot_state-npc1": 0.07234976026746961, "sim_compute_robot_state-npc2": 0.07224173457534225, "sim_compute_robot_state-npc3": 0.06947841026164868}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.18203629829265452, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.06544323320742007, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.16610019736819798, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.09870035118526882, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.04008539076204653, "sim_compute_performance-ego": 0.07326321690170853, "sim_compute_robot_state-ego": 0.07892675752992984, "sim_compute_robot_state-npc0": 0.0694817613672327, "sim_compute_robot_state-npc1": 0.07031623963956479, "sim_compute_robot_state-npc2": 0.07198989391326904, "sim_compute_robot_state-npc3": 0.0718754839014124}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.21048988766140408, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.06630934609307183, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.16197489102681478, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.09950100051032172, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.03946984608968099, "sim_compute_performance-ego": 0.07030756208631728, "sim_compute_robot_state-ego": 0.07948763635423449, "sim_compute_robot_state-npc0": 0.0705475648244222, "sim_compute_robot_state-npc1": 0.06998089684380425, "sim_compute_robot_state-npc2": 0.07085490226745605, "sim_compute_robot_state-npc3": 0.07088179058498806}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.18042054901952329, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.06546001848967178, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.16413276091865872, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.10471918790236764, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.04275917488595714, "sim_compute_performance-ego": 0.07256140916243843, "sim_compute_robot_state-ego": 0.07817485539809517, "sim_compute_robot_state-npc0": 0.06970430457073709, "sim_compute_robot_state-npc1": 0.07105791050454845, "sim_compute_robot_state-npc2": 0.07054999600286069, "sim_compute_robot_state-npc3": 0.0719522704248843}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.1876191759109497, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.06084162712097168, "in-drivable-lane": 0, "agent_compute-ego": 0.1529305934906006, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.09340126991271971, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.03685147762298584, "sim_compute_performance-ego": 0.06588932514190673, "sim_compute_robot_state-ego": 0.07032912254333495, "sim_compute_robot_state-npc0": 0.07005438804626465, "sim_compute_robot_state-npc1": 0.06868003368377686, "sim_compute_robot_state-npc2": 0.06537526130676269, "sim_compute_robot_state-npc3": 0.06860183238983154}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.22837001085281372, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.06616885662078857, "in-drivable-lane": 0, "agent_compute-ego": 0.17004724740982055, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.11261087656021118, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.04823462963104248, "sim_compute_performance-ego": 0.07118991613388062, "sim_compute_robot_state-ego": 0.07813155651092529, "sim_compute_robot_state-npc0": 0.06611161231994629, "sim_compute_robot_state-npc1": 0.0787489652633667, "sim_compute_robot_state-npc2": 0.07429895401000977, "sim_compute_robot_state-npc3": 0.07396798133850098}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.20675666708695264, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.06942469195315712, "in-drivable-lane": 0, "agent_compute-ego": 0.16484166446485018, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.10268550170095345, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.04100787012200607, "sim_compute_performance-ego": 0.07530987890143144, "sim_compute_robot_state-ego": 0.07726994313691792, "sim_compute_robot_state-npc0": 0.13167216903284976, "sim_compute_robot_state-npc1": 0.07441158043710809, "sim_compute_robot_state-npc2": 0.08237955444737484, "sim_compute_robot_state-npc3": 0.07376685895417866}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.15116815090179445, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.05518273830413818, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.13732937335968018, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.08283607959747315, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.035532684326171876, "sim_compute_performance-ego": 0.06148674964904785, "sim_compute_robot_state-ego": 0.06379637241363526, "sim_compute_robot_state-npc0": 0.06174159049987793, "sim_compute_robot_state-npc1": 0.05965864658355713, "sim_compute_robot_state-npc2": 0.0606095027923584, "sim_compute_robot_state-npc3": 0.05984580039978027}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.23858028108423407, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.06597398627888072, "in-drivable-lane": 0, "agent_compute-ego": 0.1754155917601152, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.1083473725752397, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.04624971476468173, "sim_compute_performance-ego": 0.07481390779668634, "sim_compute_robot_state-ego": 0.08294003660028632, "sim_compute_robot_state-npc0": 0.07842193950306285, "sim_compute_robot_state-npc1": 0.07629722898656671, "sim_compute_robot_state-npc2": 0.07531619071960449, "sim_compute_robot_state-npc3": 0.07790307565168901}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.23718067091338488, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.06976325657902932, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.17894554138183594, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.11036939523657974, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.04402072089059012, "sim_compute_performance-ego": 0.07998849907699897, "sim_compute_robot_state-ego": 0.0848091086562799, "sim_compute_robot_state-npc0": 0.07924294471740723, "sim_compute_robot_state-npc1": 0.08094671307777872, "sim_compute_robot_state-npc2": 0.07911173664793676, "sim_compute_robot_state-npc3": 0.07891803858231525}}
set_robot_commands_max0.11261087656021118
set_robot_commands_mean0.10133433407983436
set_robot_commands_median0.10268550170095345
set_robot_commands_min0.08283607959747315
sim_compute_performance-ego_max0.07998849907699897
sim_compute_performance-ego_mean0.07180433361202172
sim_compute_performance-ego_median0.07326321690170853
sim_compute_performance-ego_min0.06148674964904785
sim_compute_robot_state-ego_max0.0848091086562799
sim_compute_robot_state-ego_mean0.077740204196703
sim_compute_robot_state-ego_median0.07817485539809517
sim_compute_robot_state-ego_min0.06379637241363526
sim_compute_robot_state-npc0_max0.13167216903284976
sim_compute_robot_state-npc0_mean0.07538750895661821
sim_compute_robot_state-npc0_median0.0729471798296328
sim_compute_robot_state-npc0_min0.06174159049987793
sim_compute_robot_state-npc1_max0.08094671307777872
sim_compute_robot_state-npc1_mean0.07219446195124363
sim_compute_robot_state-npc1_median0.07234976026746961
sim_compute_robot_state-npc1_min0.05965864658355713
sim_compute_robot_state-npc2_max0.08237955444737484
sim_compute_robot_state-npc2_mean0.07193531001593666
sim_compute_robot_state-npc2_median0.07224173457534225
sim_compute_robot_state-npc2_min0.0606095027923584
sim_compute_robot_state-npc3_max0.07891803858231525
sim_compute_robot_state-npc3_mean0.0713920152517695
sim_compute_robot_state-npc3_median0.07215634540275291
sim_compute_robot_state-npc3_min0.05984580039978027
sim_compute_sim_state_max0.04823462963104248
sim_compute_sim_state_mean0.04121731072253045
sim_compute_sim_state_median0.041699807894857305
sim_compute_sim_state_min0.035532684326171876
sim_physics_max0.23858028108423407
sim_physics_mean0.19458539690523896
sim_physics_median0.19041339347237035
sim_physics_min0.15116815090179445
sim_render-ego_max0.06976325657902932
sim_render-ego_mean0.06486624299153429
sim_render-ego_median0.06616885662078857
sim_render-ego_min0.05375839982713971
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
No reset possible