Duckietown Challenges Home Challenges Submissions

Submission 3691

Submission3691
Competingyes
Challengeaido2-LF-sim-testing
UserManfred Diaz
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23592
Next
User labelchallenge-aido_LF-template-tensorflow
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23592step1-simulationsuccessyes0:14:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5730673664674821
survival_time_median3.899999999999994
deviation-center-line_median0.21186974191782376
in-drivable-lane_median0.7499999999999973


other stats
agent_compute-ego_max0.09261270573264674
agent_compute-ego_mean0.09009480232020424
agent_compute-ego_median0.09006434220534104
agent_compute-ego_min0.08856035942255064
deviation-center-line_max0.5239460356096675
deviation-center-line_mean0.23937452023049827
deviation-center-line_min0.06411568877654636
deviation-heading_max3.006943268491237
deviation-heading_mean1.1929000948121042
deviation-heading_median1.0677680114170414
deviation-heading_min0.3781625032515413
driven_any_max2.1879923625180044
driven_any_mean0.9383965224967
driven_any_median0.9228574223241656
driven_any_min0.3146754468860701
driven_lanedir_consec_max1.6951585638843074
driven_lanedir_consec_mean0.6919882987794135
driven_lanedir_consec_min0.2799133526913069
driven_lanedir_max1.6951585638843074
driven_lanedir_mean0.6980683980659316
driven_lanedir_median0.6277290869154601
driven_lanedir_min0.2799133526913069
in-drivable-lane_max1.4499999999999948
in-drivable-lane_mean0.6499999999999976
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0316749706337376, "sim_physics": 0.0647315203425396, "survival_time": 4.149999999999993, "driven_lanedir": 0.6351050343820952, "sim_render-ego": 0.0374070535223168, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.09010136558348876, "deviation-heading": 0.3781625032515413, "set_robot_commands": 0.05865025520324707, "deviation-center-line": 0.3929643786276097, "driven_lanedir_consec": 0.6351050343820952, "sim_compute_sim_state": 0.024174721844225044, "sim_compute_performance-ego": 0.04142711248742529, "sim_compute_robot_state-ego": 0.04261559463409056}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3146754468860701, "sim_physics": 0.0613934902044443, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2907978789206025, "sim_render-ego": 0.037256442583524264, "in-drivable-lane": 0, "agent_compute-ego": 0.08997735610375038, "deviation-heading": 0.3918106014099589, "set_robot_commands": 0.05806542359865629, "deviation-center-line": 0.06411568877654636, "driven_lanedir_consec": 0.2907978789206025, "sim_compute_sim_state": 0.02428408769460825, "sim_compute_performance-ego": 0.041119749729449935, "sim_compute_robot_state-ego": 0.042720978076641374}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6588769930822956, "sim_physics": 0.06223355678089878, "survival_time": 2.849999999999998, "driven_lanedir": 0.2799133526913069, "sim_render-ego": 0.037971952505279, "in-drivable-lane": 1.099999999999997, "agent_compute-ego": 0.09261270573264674, "deviation-heading": 0.7761099456651885, "set_robot_commands": 0.05864246686299642, "deviation-center-line": 0.1231317613238924, "driven_lanedir_consec": 0.2799133526913069, "sim_compute_sim_state": 0.02447157993651273, "sim_compute_performance-ego": 0.0416095214977599, "sim_compute_robot_state-ego": 0.04329788475705866}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9441484565813316, "sim_physics": 0.06286664531655507, "survival_time": 3.649999999999995, "driven_lanedir": 0.9003920952731561, "sim_render-ego": 0.03733477527148103, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.091889498984977, "deviation-heading": 1.1325112638216068, "set_robot_commands": 0.05808382818143662, "deviation-center-line": 0.21186974191782376, "driven_lanedir_consec": 0.9003920952731561, "sim_compute_sim_state": 0.024230411607925207, "sim_compute_performance-ego": 0.04102283307950791, "sim_compute_robot_state-ego": 0.0431983666877224}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1879923625180044, "sim_physics": 0.06403828584230863, "survival_time": 7.79999999999998, "driven_lanedir": 1.6951585638843074, "sim_render-ego": 0.03721731442671556, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.09007723514850324, "deviation-heading": 3.006943268491237, "set_robot_commands": 0.05727165326094016, "deviation-center-line": 0.5239460356096675, "driven_lanedir_consec": 1.6951585638843074, "sim_compute_sim_state": 0.024292893898792755, "sim_compute_performance-ego": 0.04133644165136875, "sim_compute_robot_state-ego": 0.042226962554149136}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.188384274002113, "sim_physics": 0.06252699238913399, "survival_time": 4.199999999999993, "driven_lanedir": 0.76510993579048, "sim_render-ego": 0.03777318341391427, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.08953302531015306, "deviation-heading": 1.716506050032251, "set_robot_commands": 0.05749041409719558, "deviation-center-line": 0.2127216497696847, "driven_lanedir_consec": 0.76510993579048, "sim_compute_sim_state": 0.02430781012489682, "sim_compute_performance-ego": 0.042522631940387544, "sim_compute_robot_state-ego": 0.043124636014302574}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.38796156382509395, "sim_physics": 0.06502617200215657, "survival_time": 1.5000000000000009, "driven_lanedir": 0.36705213210080245, "sim_render-ego": 0.03797659873962402, "in-drivable-lane": 0, "agent_compute-ego": 0.08960633277893067, "deviation-heading": 0.41264819339832015, "set_robot_commands": 0.05743210315704346, "deviation-center-line": 0.11161710575805824, "driven_lanedir_consec": 0.36705213210080245, "sim_compute_sim_state": 0.023897210756937664, "sim_compute_performance-ego": 0.04075245062510172, "sim_compute_robot_state-ego": 0.042766006787618}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.5433584613577912, "sim_physics": 0.06028340413020207, "survival_time": 1.950000000000001, "driven_lanedir": 0.4978725605114601, "sim_render-ego": 0.03666160656855656, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09006434220534104, "deviation-heading": 0.4486890052949937, "set_robot_commands": 0.05576899112799229, "deviation-center-line": 0.14624769687768413, "driven_lanedir_consec": 0.4978725605114601, "sim_compute_sim_state": 0.02450142762599847, "sim_compute_performance-ego": 0.040684718352097735, "sim_compute_robot_state-ego": 0.0428157280652951}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.711190213238187, "sim_physics": 0.05943419716574929, "survival_time": 7.149999999999983, "driven_lanedir": 1.2555860704927913, "sim_render-ego": 0.03755669827227826, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.09060060227667537, "deviation-heading": 1.910631449669402, "set_robot_commands": 0.057831525802612305, "deviation-center-line": 0.3792462196021766, "driven_lanedir_consec": 1.2555860704927913, "sim_compute_sim_state": 0.024257553207290755, "sim_compute_performance-ego": 0.04055659921019227, "sim_compute_robot_state-ego": 0.04255935695621517}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.7403060227910789, "sim_physics": 0.061478122686728455, "survival_time": 3.899999999999994, "driven_lanedir": 0.6948224668893908, "sim_render-ego": 0.038103149487422064, "in-drivable-lane": 0, "agent_compute-ego": 0.09168759676126334, "deviation-heading": 1.0677680114170414, "set_robot_commands": 0.05669271028958834, "deviation-center-line": 0.2162063987691845, "driven_lanedir_consec": 0.6948224668893908, "sim_compute_sim_state": 0.023799859560452975, "sim_compute_performance-ego": 0.040446645174271025, "sim_compute_robot_state-ego": 0.04306621123582889}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.9601998796525728, "sim_physics": 0.06397814220852321, "survival_time": 3.599999999999995, "driven_lanedir": 0.4750576108311232, "sim_render-ego": 0.03772815730836657, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.09028693371348911, "deviation-heading": 0.7624523882507178, "set_robot_commands": 0.05631539887852139, "deviation-center-line": 0.1599197832365024, "driven_lanedir_consec": 0.4750576108311232, "sim_compute_sim_state": 0.023905727598402236, "sim_compute_performance-ego": 0.040380239486694336, "sim_compute_robot_state-ego": 0.04245285193125407}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.460047374770625, "sim_physics": 0.06317187464514444, "survival_time": 2.1500000000000004, "driven_lanedir": 0.4252956824859204, "sim_render-ego": 0.037217833275018736, "in-drivable-lane": 0, "agent_compute-ego": 0.08856035942255064, "deviation-heading": 0.6048553975836963, "set_robot_commands": 0.056728656901869665, "deviation-center-line": 0.17094035496902682, "driven_lanedir_consec": 0.4252956824859204, "sim_compute_sim_state": 0.02346806193506995, "sim_compute_performance-ego": 0.04068633012993391, "sim_compute_robot_state-ego": 0.04207252347192099}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.1021746982117984, "sim_physics": 0.05981501035912092, "survival_time": 4.299999999999993, "driven_lanedir": 0.9549755696580258, "sim_render-ego": 0.03759774773619896, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08860500191533288, "deviation-heading": 1.3111285880436343, "set_robot_commands": 0.05776967558749886, "deviation-center-line": 0.20954568010006625, "driven_lanedir_consec": 0.9549755696580258, "sim_compute_sim_state": 0.024402238601861997, "sim_compute_performance-ego": 0.0405823546786641, "sim_compute_robot_state-ego": 0.042849033377891366}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.9220996975756331, "sim_physics": 0.05718335340607841, "survival_time": 5.299999999999989, "driven_lanedir": 0.6061579301620528, "sim_render-ego": 0.03732765620609499, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.08921914055662335, "deviation-heading": 2.0488280643323007, "set_robot_commands": 0.058348397039017584, "deviation-center-line": 0.3101625530401381, "driven_lanedir_consec": 0.5730673664674821, "sim_compute_sim_state": 0.02408398322339328, "sim_compute_performance-ego": 0.04035279211008324, "sim_compute_robot_state-ego": 0.04226056584772074}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9228574223241656, "sim_physics": 0.059326840835867575, "survival_time": 5.14999999999999, "driven_lanedir": 0.6277290869154601, "sim_render-ego": 0.037014320058730045, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.08860053830933802, "deviation-heading": 1.9244566915196717, "set_robot_commands": 0.057390238474873664, "deviation-center-line": 0.35798275507941196, "driven_lanedir_consec": 0.5696181613122571, "sim_compute_sim_state": 0.024335280205439597, "sim_compute_performance-ego": 0.04023271394007414, "sim_compute_robot_state-ego": 0.04204997970062552}}
set_robot_commands_max0.05865025520324707
set_robot_commands_mean0.05749878256423266
set_robot_commands_median0.05749041409719558
set_robot_commands_min0.05576899112799229
sim_compute_performance-ego_max0.042522631940387544
sim_compute_performance-ego_mean0.04091420893953412
sim_compute_performance-ego_median0.04068633012993391
sim_compute_performance-ego_min0.04023271394007414
sim_compute_robot_state-ego_max0.04329788475705866
sim_compute_robot_state-ego_mean0.0426717786732223
sim_compute_robot_state-ego_median0.042720978076641374
sim_compute_robot_state-ego_min0.04204997970062552
sim_compute_sim_state_max0.02450142762599847
sim_compute_sim_state_mean0.024160856521453847
sim_compute_sim_state_median0.024257553207290755
sim_compute_sim_state_min0.02346806193506995
sim_physics_max0.06502617200215657
sim_physics_mean0.06183250722103009
sim_physics_median0.06223355678089878
sim_physics_min0.05718335340607841
sim_render-ego_max0.038103149487422064
sim_render-ego_mean0.03747629929170141
sim_render-ego_median0.0374070535223168
sim_render-ego_min0.03666160656855656
simulation-passed1
survival_time_max7.79999999999998
survival_time_mean3.9299999999999935
survival_time_min1.3000000000000005
No reset possible