Duckietown Challenges Home Challenges Submissions

Submission 3687

Submission3687
Competingyes
Challengeaido2-LF-sim-testing
UserTony Hsu 🇹🇼
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23573
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23573step1-simulationsuccessyes0:48:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6950573847640089
survival_time_median14.950000000000076
deviation-center-line_median0.307138938696771
in-drivable-lane_median7.200000000000037


other stats
agent_compute-ego_max0.23721035003662108
agent_compute-ego_mean0.23668865002526177
agent_compute-ego_median0.23683757623036705
agent_compute-ego_min0.23561009486516316
deviation-center-line_max0.7441993675765441
deviation-center-line_mean0.36818899156986545
deviation-center-line_min0.10083546877568052
deviation-heading_max5.990117020581061
deviation-heading_mean5.896451626677996
deviation-heading_median5.9380236931489225
deviation-heading_min5.613995197946513
driven_any_max2.1853065485311514
driven_any_mean2.1853065485311425
driven_any_median2.1853065485311416
driven_any_min2.1853065485311323
driven_lanedir_consec_max0.6964859913423234
driven_lanedir_consec_mean0.694822873038991
driven_lanedir_consec_min0.6925369611104519
driven_lanedir_max0.6964859913423234
driven_lanedir_mean0.694822873038991
driven_lanedir_median0.6950573847640089
driven_lanedir_min0.6925369611104519
in-drivable-lane_max7.400000000000038
in-drivable-lane_mean7.236666666666703
in-drivable-lane_min7.200000000000037
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1853065485311434, "sim_physics": 0.05540801445643107, "survival_time": 14.950000000000076, "driven_lanedir": 0.6964859913423234, "sim_render-ego": 0.03698193152745565, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.23683757623036705, "deviation-heading": 5.613995197946513, "set_robot_commands": 0.05495564381281535, "deviation-center-line": 0.7337965812416224, "driven_lanedir_consec": 0.6964859913423234, "sim_compute_sim_state": 0.024101943969726564, "sim_compute_performance-ego": 0.040296319325764975, "sim_compute_robot_state-ego": 0.04209806362787882}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1853065485311514, "sim_physics": 0.05653468688329061, "survival_time": 14.950000000000076, "driven_lanedir": 0.694222936176982, "sim_render-ego": 0.037351961930592856, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23676480372746783, "deviation-heading": 5.990117020581061, "set_robot_commands": 0.05517516215642293, "deviation-center-line": 0.29799505396684733, "driven_lanedir_consec": 0.694222936176982, "sim_compute_sim_state": 0.024076714515686035, "sim_compute_performance-ego": 0.040464489459991454, "sim_compute_robot_state-ego": 0.04233774264653524}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.185306548531138, "sim_physics": 0.05321986198425293, "survival_time": 14.950000000000076, "driven_lanedir": 0.6950573847640089, "sim_render-ego": 0.03681208690007528, "in-drivable-lane": 7.300000000000038, "agent_compute-ego": 0.2370089077949524, "deviation-heading": 5.796667795845188, "set_robot_commands": 0.0544206706682841, "deviation-center-line": 0.307138938696771, "driven_lanedir_consec": 0.6950573847640089, "sim_compute_sim_state": 0.024102057615915936, "sim_compute_performance-ego": 0.04041594346364339, "sim_compute_robot_state-ego": 0.04165962855021159}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.1853065485311367, "sim_physics": 0.055453038215637206, "survival_time": 14.950000000000076, "driven_lanedir": 0.6955060473032337, "sim_render-ego": 0.03716473340988159, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23699439684549967, "deviation-heading": 5.969503120784673, "set_robot_commands": 0.05555543661117554, "deviation-center-line": 0.6234334658421105, "driven_lanedir_consec": 0.6955060473032337, "sim_compute_sim_state": 0.02432903289794922, "sim_compute_performance-ego": 0.040550702412923176, "sim_compute_robot_state-ego": 0.04204116264979045}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1853065485311407, "sim_physics": 0.05490198055903117, "survival_time": 14.950000000000076, "driven_lanedir": 0.6933707706415575, "sim_render-ego": 0.03692545970280965, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.2369475213686625, "deviation-heading": 5.951617305849203, "set_robot_commands": 0.0548666787147522, "deviation-center-line": 0.44374302000365046, "driven_lanedir_consec": 0.6933707706415575, "sim_compute_sim_state": 0.02398018995920817, "sim_compute_performance-ego": 0.04082356214523315, "sim_compute_robot_state-ego": 0.041719214121500654}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.1853065485311394, "sim_physics": 0.05635195096333822, "survival_time": 14.950000000000076, "driven_lanedir": 0.6957599080131578, "sim_render-ego": 0.03729402462641398, "in-drivable-lane": 7.300000000000038, "agent_compute-ego": 0.23721035003662108, "deviation-heading": 5.818542702573388, "set_robot_commands": 0.05534505287806193, "deviation-center-line": 0.7441993675765441, "driven_lanedir_consec": 0.6957599080131578, "sim_compute_sim_state": 0.02426735719045003, "sim_compute_performance-ego": 0.04018746614456177, "sim_compute_robot_state-ego": 0.042279125054677326}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.185306548531151, "sim_physics": 0.058723700841267906, "survival_time": 14.950000000000076, "driven_lanedir": 0.6947112112972071, "sim_render-ego": 0.036991956233978274, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.2369151457150777, "deviation-heading": 5.9347088906542345, "set_robot_commands": 0.05465580940246582, "deviation-center-line": 0.21723026496478212, "driven_lanedir_consec": 0.6947112112972071, "sim_compute_sim_state": 0.024090518951416017, "sim_compute_performance-ego": 0.039801987012227376, "sim_compute_robot_state-ego": 0.042444509665171305}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.1853065485311323, "sim_physics": 0.05456495443979899, "survival_time": 14.950000000000076, "driven_lanedir": 0.6954494436503662, "sim_render-ego": 0.036432549953460694, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.2360766800244649, "deviation-heading": 5.951584056210216, "set_robot_commands": 0.05435362259546916, "deviation-center-line": 0.26967879357000285, "driven_lanedir_consec": 0.6954494436503662, "sim_compute_sim_state": 0.023977265357971192, "sim_compute_performance-ego": 0.04027249018351237, "sim_compute_robot_state-ego": 0.04236126820246378}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.185306548531139, "sim_physics": 0.05507463216781616, "survival_time": 14.950000000000076, "driven_lanedir": 0.6951211993980144, "sim_render-ego": 0.03688037395477295, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23631850719451905, "deviation-heading": 5.9380236931489225, "set_robot_commands": 0.05519824028015137, "deviation-center-line": 0.19127509329278516, "driven_lanedir_consec": 0.6951211993980144, "sim_compute_sim_state": 0.02394600788752238, "sim_compute_performance-ego": 0.039985068639119464, "sim_compute_robot_state-ego": 0.04210440317789713}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.185306548531147, "sim_physics": 0.054854060808817544, "survival_time": 14.950000000000076, "driven_lanedir": 0.6957742227582209, "sim_render-ego": 0.036839893658955895, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.2371842900911967, "deviation-heading": 5.84542238624642, "set_robot_commands": 0.05441298961639404, "deviation-center-line": 0.13803594115198106, "driven_lanedir_consec": 0.6957742227582209, "sim_compute_sim_state": 0.02428417444229126, "sim_compute_performance-ego": 0.04047910213470459, "sim_compute_robot_state-ego": 0.04215747435887655}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.1853065485311443, "sim_physics": 0.05530855337778727, "survival_time": 14.950000000000076, "driven_lanedir": 0.6925369611104519, "sim_render-ego": 0.03663061698277791, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23694254398345949, "deviation-heading": 5.954990711277449, "set_robot_commands": 0.05444358269373576, "deviation-center-line": 0.30943438450656163, "driven_lanedir_consec": 0.6925369611104519, "sim_compute_sim_state": 0.02409991582234701, "sim_compute_performance-ego": 0.041022329330444335, "sim_compute_robot_state-ego": 0.04184239069620768}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.1853065485311416, "sim_physics": 0.05632275501887003, "survival_time": 14.950000000000076, "driven_lanedir": 0.6949038747368048, "sim_render-ego": 0.03682883103688558, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.2363297462463379, "deviation-heading": 5.860593780739516, "set_robot_commands": 0.05514081796010335, "deviation-center-line": 0.10083546877568052, "driven_lanedir_consec": 0.6949038747368048, "sim_compute_sim_state": 0.02405474106470744, "sim_compute_performance-ego": 0.04058392922083537, "sim_compute_robot_state-ego": 0.04217564264933269}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.185306548531148, "sim_physics": 0.055737411181132, "survival_time": 14.950000000000076, "driven_lanedir": 0.6952620692692497, "sim_render-ego": 0.03620652914047241, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.2365825978914897, "deviation-heading": 5.922408824528451, "set_robot_commands": 0.05512197971343994, "deviation-center-line": 0.5431694946909088, "driven_lanedir_consec": 0.6952620692692497, "sim_compute_sim_state": 0.023713927268981933, "sim_compute_performance-ego": 0.04018219312032064, "sim_compute_robot_state-ego": 0.04159367481867472}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.185306548531144, "sim_physics": 0.05142515659332275, "survival_time": 14.950000000000076, "driven_lanedir": 0.6941725425290013, "sim_render-ego": 0.03642830928166707, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23561009486516316, "deviation-heading": 5.949714932679345, "set_robot_commands": 0.05410462697347005, "deviation-center-line": 0.17004088680976326, "driven_lanedir_consec": 0.6941725425290013, "sim_compute_sim_state": 0.023550658226013182, "sim_compute_performance-ego": 0.03999435424804688, "sim_compute_robot_state-ego": 0.04115627447764079}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1853065485311363, "sim_physics": 0.05076943000157674, "survival_time": 14.950000000000076, "driven_lanedir": 0.6940085325942875, "sim_render-ego": 0.0364530865351359, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23660658836364745, "deviation-heading": 5.948883981105356, "set_robot_commands": 0.05396711508433024, "deviation-center-line": 0.4328281184579712, "driven_lanedir_consec": 0.6940085325942875, "sim_compute_sim_state": 0.023842470645904543, "sim_compute_performance-ego": 0.039710747400919594, "sim_compute_robot_state-ego": 0.041542232036590576}}
set_robot_commands_max0.05555543661117554
set_robot_commands_mean0.054781161944071455
set_robot_commands_median0.0548666787147522
set_robot_commands_min0.05396711508433024
sim_compute_performance-ego_max0.041022329330444335
sim_compute_performance-ego_mean0.0403180456161499
sim_compute_performance-ego_median0.040296319325764975
sim_compute_performance-ego_min0.039710747400919594
sim_compute_robot_state-ego_max0.042444509665171305
sim_compute_robot_state-ego_mean0.04196752044889662
sim_compute_robot_state-ego_median0.04209806362787882
sim_compute_robot_state-ego_min0.04115627447764079
sim_compute_sim_state_max0.02432903289794922
sim_compute_sim_state_mean0.024027798387739396
sim_compute_sim_state_median0.024076714515686035
sim_compute_sim_state_min0.023550658226013182
sim_physics_max0.058723700841267906
sim_physics_mean0.05497667916615803
sim_physics_median0.05530855337778727
sim_physics_min0.05076943000157674
sim_render-ego_max0.037351961930592856
sim_render-ego_mean0.03681482299168905
sim_render-ego_median0.036839893658955895
sim_render-ego_min0.03620652914047241
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
23569step1-simulationtimeoutyes0:36:48
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
23568step1-simulationerroryes0:37:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
23567step1-simulationtimeoutyes0:37:21
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
23562step1-simulationabortedyes0:14:53
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
23561step1-simulationabortedyes0:15:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible