Duckietown Challenges Home Challenges Submissions

Submission 3629

Submission3629
Competingyes
Challengeaido2-LFV-sim-testing
UserNicky Eichmann
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23389
Next
User label-
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23389step1-simulationsuccessyes0:37:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5816325136533065
survival_time_median5.549999999999988
deviation-center-line_median0.1718486605172825
in-drivable-lane_median1.5499999999999954


other stats
agent_compute-ego_max0.1886696457862854
agent_compute-ego_mean0.1733653735693769
agent_compute-ego_median0.17268130060744613
agent_compute-ego_min0.16599966350354647
deviation-center-line_max0.8018408063546754
deviation-center-line_mean0.29738896483852717
deviation-center-line_min0.05490219695165174
deviation-heading_max3.7186051204917727
deviation-heading_mean1.896532439120844
deviation-heading_median2.079664714937159
deviation-heading_min0.1751702493994341
driven_any_max4.163155074737692
driven_any_mean1.399107974216947
driven_any_median1.3926618380390252
driven_any_min0.3667036696809174
driven_lanedir_consec_max1.6156095313732937
driven_lanedir_consec_mean0.737417390440475
driven_lanedir_consec_min0.22208798290887088
driven_lanedir_max2.7854605377980457
driven_lanedir_mean1.0463265506314472
driven_lanedir_median0.9278014171127672
driven_lanedir_min0.34726622887935976
in-drivable-lane_max5.999999999999992
in-drivable-lane_mean1.89
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0143234608818994, "sim_physics": 0.09549236925024736, "survival_time": 3.7999999999999945, "driven_lanedir": 0.6697553564194623, "sim_render-ego": 0.06318799131794979, "in-drivable-lane": 2.249999999999994, "agent_compute-ego": 0.16599966350354647, "deviation-heading": 0.25835188233260464, "set_robot_commands": 0.08039351513511256, "deviation-center-line": 0.09456974525815567, "driven_lanedir_consec": 0.6697553564194623, "sim_compute_sim_state": 0.03620856059224982, "sim_compute_performance-ego": 0.06612154998277363, "sim_compute_robot_state-ego": 0.06448979440488313, "sim_compute_robot_state-npc0": 0.07329858290521722, "sim_compute_robot_state-npc1": 0.06711885803624203, "sim_compute_robot_state-npc2": 0.06741459432401155, "sim_compute_robot_state-npc3": 0.06631357418863397}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4604434416189949, "sim_physics": 0.1177454103123058, "survival_time": 1.1000000000000003, "driven_lanedir": 0.4348938925710728, "sim_render-ego": 0.0629831227389249, "in-drivable-lane": 0, "agent_compute-ego": 0.16960242661562833, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.08523367751728404, "deviation-center-line": 0.0772648215662309, "driven_lanedir_consec": 0.4348938925710728, "sim_compute_sim_state": 0.036206418817693535, "sim_compute_performance-ego": 0.06247908418828791, "sim_compute_robot_state-ego": 0.0655841285532171, "sim_compute_robot_state-npc0": 0.0732764330777255, "sim_compute_robot_state-npc1": 0.0657765648581765, "sim_compute_robot_state-npc2": 0.06784746863625267, "sim_compute_robot_state-npc3": 0.06335435130379417}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.599654688730019, "sim_physics": 0.10785658756891886, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2183798882653485, "sim_render-ego": 0.06328136523564656, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1886696457862854, "deviation-heading": 0.28606528190679475, "set_robot_commands": 0.0785965363184611, "deviation-center-line": 0.11803708647411268, "driven_lanedir_consec": 1.2183798882653485, "sim_compute_sim_state": 0.03741025527318319, "sim_compute_performance-ego": 0.0644898811976115, "sim_compute_robot_state-ego": 0.0636599858601888, "sim_compute_robot_state-npc0": 0.07205607096354166, "sim_compute_robot_state-npc1": 0.0664697011311849, "sim_compute_robot_state-npc2": 0.06372415622075399, "sim_compute_robot_state-npc3": 0.06387166976928711}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9280961155385217, "sim_physics": 0.10464342392009238, "survival_time": 9.199999999999996, "driven_lanedir": 1.6426924759127737, "sim_render-ego": 0.06561519140782564, "in-drivable-lane": 1.5499999999999954, "agent_compute-ego": 0.17407650014628534, "deviation-heading": 3.405735906841375, "set_robot_commands": 0.07949127321657927, "deviation-center-line": 0.7014256089860718, "driven_lanedir_consec": 1.2187176370157662, "sim_compute_sim_state": 0.038231856149175895, "sim_compute_performance-ego": 0.06807118395100469, "sim_compute_robot_state-ego": 0.06713312734728275, "sim_compute_robot_state-npc0": 0.07621128014896227, "sim_compute_robot_state-npc1": 0.06839512612508691, "sim_compute_robot_state-npc2": 0.06758942033933557, "sim_compute_robot_state-npc3": 0.06798942192741063}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.400811386017316, "sim_physics": 0.10466299057006836, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3869401393359331, "sim_render-ego": 0.06294416189193726, "in-drivable-lane": 0, "agent_compute-ego": 0.1701655864715576, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.07642977237701416, "deviation-center-line": 0.06073337098493198, "driven_lanedir_consec": 0.3869401393359331, "sim_compute_sim_state": 0.035930311679840087, "sim_compute_performance-ego": 0.06549464464187622, "sim_compute_robot_state-ego": 0.06771613359451294, "sim_compute_robot_state-npc0": 0.0752181887626648, "sim_compute_robot_state-npc1": 0.07037546634674072, "sim_compute_robot_state-npc2": 0.06819369792938232, "sim_compute_robot_state-npc3": 0.06477968692779541}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.6268656887496449, "sim_physics": 0.10709464442622554, "survival_time": 5.549999999999988, "driven_lanedir": 0.9811276283047056, "sim_render-ego": 0.06697437784693262, "in-drivable-lane": 0.9500000000000008, "agent_compute-ego": 0.18076161006549457, "deviation-heading": 2.079664714937159, "set_robot_commands": 0.08068123594060675, "deviation-center-line": 0.21731620667750273, "driven_lanedir_consec": 0.9811276283047056, "sim_compute_sim_state": 0.037844741666639176, "sim_compute_performance-ego": 0.06940082816390304, "sim_compute_robot_state-ego": 0.06965156503625818, "sim_compute_robot_state-npc0": 0.078307970150097, "sim_compute_robot_state-npc1": 0.07150580861546972, "sim_compute_robot_state-npc2": 0.07002889358245575, "sim_compute_robot_state-npc3": 0.06860656351656527}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.868401725663771, "sim_physics": 0.1001447346603986, "survival_time": 10.300000000000011, "driven_lanedir": 1.404068911499692, "sim_render-ego": 0.06477949457261169, "in-drivable-lane": 4.150000000000011, "agent_compute-ego": 0.16969172699937543, "deviation-heading": 3.576363421733165, "set_robot_commands": 0.07940578229219011, "deviation-center-line": 0.3605235654056141, "driven_lanedir_consec": 0.6650890986148243, "sim_compute_sim_state": 0.03612532199007794, "sim_compute_performance-ego": 0.06817685284660858, "sim_compute_robot_state-ego": 0.06980473208195954, "sim_compute_robot_state-npc0": 0.0782948153690227, "sim_compute_robot_state-npc1": 0.07014243695342424, "sim_compute_robot_state-npc2": 0.06735529135731817, "sim_compute_robot_state-npc3": 0.06602696191917345}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.163155074737692, "sim_physics": 0.10872254469623303, "survival_time": 14.600000000000072, "driven_lanedir": 2.7854605377980457, "sim_render-ego": 0.06733131816942398, "in-drivable-lane": 5.999999999999992, "agent_compute-ego": 0.17268130060744613, "deviation-heading": 3.4850723413004996, "set_robot_commands": 0.08005703230426736, "deviation-center-line": 0.7479474043560584, "driven_lanedir_consec": 1.6156095313732937, "sim_compute_sim_state": 0.03679320501954588, "sim_compute_performance-ego": 0.06892334353433896, "sim_compute_robot_state-ego": 0.06855387148791797, "sim_compute_robot_state-npc0": 0.07881815384512078, "sim_compute_robot_state-npc1": 0.07048323546370415, "sim_compute_robot_state-npc2": 0.06824129248318607, "sim_compute_robot_state-npc3": 0.06704708158153377}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.3926618380390252, "sim_physics": 0.102643805972779, "survival_time": 9.049999999999994, "driven_lanedir": 0.990124714975166, "sim_render-ego": 0.0654499583481425, "in-drivable-lane": 2.6499999999999946, "agent_compute-ego": 0.1759071876989544, "deviation-heading": 3.354063143826192, "set_robot_commands": 0.07945182573729458, "deviation-center-line": 0.4253806493017248, "driven_lanedir_consec": 0.5816325136533065, "sim_compute_sim_state": 0.03825700348912023, "sim_compute_performance-ego": 0.07078465177209338, "sim_compute_robot_state-ego": 0.07090286655320648, "sim_compute_robot_state-npc0": 0.07966564768585711, "sim_compute_robot_state-npc1": 0.07203652713838862, "sim_compute_robot_state-npc2": 0.07045478715422404, "sim_compute_robot_state-npc3": 0.06845732156743002}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.46051146883057537, "sim_physics": 0.12162237817590887, "survival_time": 1.1000000000000003, "driven_lanedir": 0.44436723204554784, "sim_render-ego": 0.06296879594976251, "in-drivable-lane": 0, "agent_compute-ego": 0.1725305752320723, "deviation-heading": 0.29213064768397096, "set_robot_commands": 0.07785260677337646, "deviation-center-line": 0.06393803408849831, "driven_lanedir_consec": 0.44436723204554784, "sim_compute_sim_state": 0.036826924844221634, "sim_compute_performance-ego": 0.06950664520263672, "sim_compute_robot_state-ego": 0.07265663146972656, "sim_compute_robot_state-npc0": 0.07597547227686102, "sim_compute_robot_state-npc1": 0.07293844223022461, "sim_compute_robot_state-npc2": 0.06876750425858931, "sim_compute_robot_state-npc3": 0.06625778024846857}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3667036696809174, "sim_physics": 0.12891941321523567, "survival_time": 0.9500000000000004, "driven_lanedir": 0.34726622887935976, "sim_render-ego": 0.0647654282419305, "in-drivable-lane": 0, "agent_compute-ego": 0.17386371211001747, "deviation-heading": 0.31076591218877697, "set_robot_commands": 0.07988080225492779, "deviation-center-line": 0.05490219695165174, "driven_lanedir_consec": 0.34726622887935976, "sim_compute_sim_state": 0.03750110927381014, "sim_compute_performance-ego": 0.07063497995075427, "sim_compute_robot_state-ego": 0.07223011318006013, "sim_compute_robot_state-npc0": 0.08140694467644942, "sim_compute_robot_state-npc1": 0.07226772057382684, "sim_compute_robot_state-npc2": 0.0670336924101177, "sim_compute_robot_state-npc3": 0.06603739136143734}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5767672947354673, "sim_physics": 0.09856053761073522, "survival_time": 1.4000000000000006, "driven_lanedir": 0.5722822868537518, "sim_render-ego": 0.06099264110837664, "in-drivable-lane": 0, "agent_compute-ego": 0.1729331271989005, "deviation-heading": 0.1751702493994341, "set_robot_commands": 0.07933510201317924, "deviation-center-line": 0.1329454609049869, "driven_lanedir_consec": 0.5722822868537518, "sim_compute_sim_state": 0.03499838284083775, "sim_compute_performance-ego": 0.06627084527696882, "sim_compute_robot_state-ego": 0.06461319753101893, "sim_compute_robot_state-npc0": 0.07464588539940971, "sim_compute_robot_state-npc1": 0.06892605338777814, "sim_compute_robot_state-npc2": 0.06422275304794312, "sim_compute_robot_state-npc3": 0.06604221888950892}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.4436560228305335, "sim_physics": 0.09190668269274709, "survival_time": 9.349999999999998, "driven_lanedir": 0.9278014171127672, "sim_render-ego": 0.06269738380921716, "in-drivable-lane": 2.899999999999994, "agent_compute-ego": 0.17591859440115046, "deviation-heading": 3.269815047086843, "set_robot_commands": 0.07775538872907506, "deviation-center-line": 0.8018408063546754, "driven_lanedir_consec": 0.4852362257971201, "sim_compute_sim_state": 0.036187938190399005, "sim_compute_performance-ego": 0.06405916953469343, "sim_compute_robot_state-ego": 0.062053653645642935, "sim_compute_robot_state-npc0": 0.07759243154270763, "sim_compute_robot_state-npc1": 0.06870964376684179, "sim_compute_robot_state-npc2": 0.06641449010308413, "sim_compute_robot_state-npc3": 0.06591106736086269}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.7367563341283097, "sim_physics": 0.09158678598041776, "survival_time": 11.850000000000032, "driven_lanedir": 2.220343967711205, "sim_render-ego": 0.06193298227173367, "in-drivable-lane": 4.350000000000029, "agent_compute-ego": 0.1669875921579353, "deviation-heading": 3.7186051204917727, "set_robot_commands": 0.07860481990540581, "deviation-center-line": 0.4321608547504101, "driven_lanedir_consec": 1.2178752145687624, "sim_compute_sim_state": 0.03627399855022189, "sim_compute_performance-ego": 0.06622545025016688, "sim_compute_robot_state-ego": 0.06365951304697286, "sim_compute_robot_state-npc0": 0.07793711308185561, "sim_compute_robot_state-npc1": 0.071149616804807, "sim_compute_robot_state-npc2": 0.06725515293169625, "sim_compute_robot_state-npc3": 0.06651093084600908}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.94781140307152, "sim_physics": 0.1019863282848975, "survival_time": 8.349999999999984, "driven_lanedir": 0.6693935817868732, "sim_render-ego": 0.0654709967310557, "in-drivable-lane": 2.9499999999999904, "agent_compute-ego": 0.17069135454600445, "deviation-heading": 3.6041511485150592, "set_robot_commands": 0.07888038857968267, "deviation-center-line": 0.1718486605172825, "driven_lanedir_consec": 0.22208798290887088, "sim_compute_sim_state": 0.03633276573912112, "sim_compute_performance-ego": 0.06790777023680909, "sim_compute_robot_state-ego": 0.06498856030538411, "sim_compute_robot_state-npc0": 0.07818766125661884, "sim_compute_robot_state-npc1": 0.07008445905354209, "sim_compute_robot_state-npc2": 0.06595282211988986, "sim_compute_robot_state-npc3": 0.06603149311271256}}
set_robot_commands_max0.08523367751728404
set_robot_commands_mean0.07946998393963048
set_robot_commands_median0.07940578229219011
set_robot_commands_min0.07642977237701416
sim_compute_performance-ego_max0.07078465177209338
sim_compute_performance-ego_mean0.06723645871536847
sim_compute_performance-ego_median0.06790777023680909
sim_compute_performance-ego_min0.06247908418828791
sim_compute_robot_state-ego_max0.07265663146972656
sim_compute_robot_state-ego_mean0.06717985827321549
sim_compute_robot_state-ego_median0.06713312734728275
sim_compute_robot_state-ego_min0.062053653645642935
sim_compute_robot_state-npc0_max0.08140694467644942
sim_compute_robot_state-npc0_mean0.07672617674280742
sim_compute_robot_state-npc0_median0.07759243154270763
sim_compute_robot_state-npc0_min0.07205607096354166
sim_compute_robot_state-npc1_max0.07293844223022461
sim_compute_robot_state-npc1_mean0.06975864403236254
sim_compute_robot_state-npc1_median0.07014243695342424
sim_compute_robot_state-npc1_min0.0657765648581765
sim_compute_robot_state-npc2_max0.07045478715422404
sim_compute_robot_state-npc2_mean0.06736640112654937
sim_compute_robot_state-npc2_median0.06741459432401155
sim_compute_robot_state-npc2_min0.06372415622075399
sim_compute_robot_state-npc3_max0.06860656351656527
sim_compute_robot_state-npc3_mean0.06621583430137486
sim_compute_robot_state-npc3_median0.06604221888950892
sim_compute_robot_state-npc3_min0.06335435130379417
sim_compute_sim_state_max0.03825700348912023
sim_compute_sim_state_mean0.03674191960774247
sim_compute_sim_state_median0.03633276573912112
sim_compute_sim_state_min0.03499838284083775
sim_physics_max0.12891941321523567
sim_physics_mean0.10557257582248074
sim_physics_median0.10464342392009238
sim_physics_min0.09158678598041776
sim_render-ego_max0.06733131816942398
sim_render-ego_mean0.06409168064276474
sim_render-ego_median0.06328136523564656
sim_render-ego_min0.06099264110837664
simulation-passed1
survival_time_max14.600000000000072
survival_time_mean6.0400000000000045
survival_time_min0.9500000000000004
No reset possible