Duckietown Challenges Home Challenges Submissions

Submission 2467

Submission2467
Competingyes
Challengeaido2-LF-sim-testing
UserLiam Paull 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22957
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22957step1-simulationsuccessyes0:19:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.11420599619547528
agent_compute-ego_mean0.11085332741777036
agent_compute-ego_median0.1102033569699242
agent_compute-ego_min0.10686413764953612
deviation-center-line_max0.28386357003337986
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652288
deviation-heading_median0.3292838510353387
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.975949037827615
driven_any_median1.0117660515775695
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063861
driven_lanedir_consec_mean0.6896171461819268
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063861
driven_lanedir_mean0.6896171461819268
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429713, "sim_physics": 0.051242174925627534, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05310300544456199, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.11345919856318722, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.05256432515603525, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03802493766502098, "sim_compute_performance-ego": 0.05644834483111346, "sim_compute_robot_state-ego": 0.05697574880388048}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.050788042592067345, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.052358211255541035, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.10927055863773122, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.04991709952260934, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03784058608260809, "sim_compute_performance-ego": 0.05637369436376235, "sim_compute_robot_state-ego": 0.05645010050605325}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.05523242669947007, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.04946128059835995, "in-drivable-lane": 0, "agent_compute-ego": 0.11156781981973088, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.051030846203074735, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03867519603056066, "sim_compute_performance-ego": 0.05465270491207347, "sim_compute_robot_state-ego": 0.05504019120160271}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.05536458969116211, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.05238849639892578, "in-drivable-lane": 0, "agent_compute-ego": 0.10686413764953612, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.05593045234680176, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03721996307373047, "sim_compute_performance-ego": 0.05567527770996094, "sim_compute_robot_state-ego": 0.05645402908325195}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.049625867529760434, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.050421883788289906, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.11041047905064837, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.050948248633855504, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.0370446126672286, "sim_compute_performance-ego": 0.05611127841321728, "sim_compute_robot_state-ego": 0.0569859335694132}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.003851495683299, "sim_physics": 0.050207692749646246, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735949, "sim_render-ego": 0.05030215029813805, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.1097936386964759, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.04983089894664531, "deviation-center-line": 0.08968283443958694, "driven_lanedir_consec": 0.7531703123735949, "sim_compute_sim_state": 0.03584008800740145, "sim_compute_performance-ego": 0.05407767393151108, "sim_compute_robot_state-ego": 0.05417780000336316}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504386, "sim_physics": 0.0496373644896916, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.04960078426769802, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.1097897504057203, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.0510826621736799, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.03598413297108242, "sim_compute_performance-ego": 0.05399273548807416, "sim_compute_robot_state-ego": 0.05494415760040283}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.05874415806361607, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.05228654543558756, "in-drivable-lane": 0, "agent_compute-ego": 0.1102033569699242, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.05209870565505255, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.03999636286780948, "sim_compute_performance-ego": 0.05948378926231747, "sim_compute_robot_state-ego": 0.0577675842103504}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510798, "sim_physics": 0.05108849881059033, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.05341227579925019, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.11066576181832008, "deviation-heading": 0.3292838510353387, "set_robot_commands": 0.05313113584356793, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.03910320896213337, "sim_compute_performance-ego": 0.05657154826794641, "sim_compute_robot_state-ego": 0.05650295241404388}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.043548155325732, "sim_physics": 0.05300847833806818, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.05399504141374068, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.10996226830915971, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.05201142917979847, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.038637026873501866, "sim_compute_performance-ego": 0.05760091868313876, "sim_compute_robot_state-ego": 0.05626201629638672}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193285, "sim_physics": 0.051128991238482586, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848785, "sim_render-ego": 0.05281892689791592, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.11257674786951637, "deviation-heading": 0.35668107106767694, "set_robot_commands": 0.05177842486988415, "deviation-center-line": 0.2251391443608223, "driven_lanedir_consec": 1.1042463557848785, "sim_compute_sim_state": 0.039306711840939215, "sim_compute_performance-ego": 0.05714019552453772, "sim_compute_robot_state-ego": 0.055935299241697635}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.054289008889879496, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.05701209817613874, "in-drivable-lane": 0, "agent_compute-ego": 0.1137980307851519, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.051699204104287286, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.03641138757978167, "sim_compute_performance-ego": 0.05943553788321359, "sim_compute_robot_state-ego": 0.05669882467814854}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775695, "sim_physics": 0.05225794455584358, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.05210489852755677, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.11012794924717324, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.04987779318117628, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.038775032641840915, "sim_compute_performance-ego": 0.05672754960901597, "sim_compute_robot_state-ego": 0.056779819376328415}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.05223547970807111, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.050533798005845815, "in-drivable-lane": 0, "agent_compute-ego": 0.11420599619547528, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.05035904601768211, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.0378998562141701, "sim_compute_performance-ego": 0.05392802203143084, "sim_compute_robot_state-ego": 0.054707483009055806}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.05362315738902373, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063861, "sim_render-ego": 0.05166957658879897, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.11010421724880444, "deviation-heading": 0.5178939525116448, "set_robot_commands": 0.05384615122103224, "deviation-center-line": 0.28386357003337986, "driven_lanedir_consec": 1.919400421063861, "sim_compute_sim_state": 0.03692198033426322, "sim_compute_performance-ego": 0.056488294227450504, "sim_compute_robot_state-ego": 0.055830857333014995}}
set_robot_commands_max0.05593045234680176
set_robot_commands_mean0.05174042820367886
set_robot_commands_median0.051699204104287286
set_robot_commands_min0.04983089894664531
sim_compute_performance-ego_max0.05948378926231747
sim_compute_performance-ego_mean0.0563138376759176
sim_compute_performance-ego_median0.05644834483111346
sim_compute_performance-ego_min0.05392802203143084
sim_compute_robot_state-ego_max0.0577675842103504
sim_compute_robot_state-ego_mean0.056100853155132926
sim_compute_robot_state-ego_median0.05645010050605325
sim_compute_robot_state-ego_min0.05417780000336316
sim_compute_sim_state_max0.03999636286780948
sim_compute_sim_state_mean0.037845405587471494
sim_compute_sim_state_median0.0378998562141701
sim_compute_sim_state_min0.03584008800740145
sim_physics_max0.05874415806361607
sim_physics_mean0.052564925044733354
sim_physics_median0.05223547970807111
sim_physics_min0.049625867529760434
sim_render-ego_max0.05701209817613874
sim_render-ego_mean0.05209793152642329
sim_render-ego_median0.05228654543558756
sim_render-ego_min0.04946128059835995
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
No reset possible