Duckietown Challenges Home Challenges Submissions

Submission 2402

Submission2402
Competingyes
Challengeaido2-LF-sim-testing
UserVictor Guerra 🇫🇷
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23000
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
23000step1-simulationsuccessyes0:12:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07384245539307666
survival_time_median1.2500000000000004
deviation-center-line_median0.06129629209937979
in-drivable-lane_median0.10000000000000007


other stats
agent_compute-ego_max0.21473743604577103
agent_compute-ego_mean0.17403849545673902
agent_compute-ego_median0.17396066405556418
agent_compute-ego_min0.14278680086135864
deviation-center-line_max0.10463452649389111
deviation-center-line_mean0.06631176724701839
deviation-center-line_min0.02899641206291264
deviation-heading_max0.8421154151785527
deviation-heading_mean0.6651653308514553
deviation-heading_median0.6516655724600262
deviation-heading_min0.43800008900597226
driven_any_max0.20933027334969964
driven_any_mean0.15402345072704293
driven_any_median0.140177465042392
driven_any_min0.11001307896499384
driven_lanedir_consec_max0.10558253794669704
driven_lanedir_consec_mean0.07636009981704275
driven_lanedir_consec_min0.06208407563927665
driven_lanedir_max0.10558253794669704
driven_lanedir_mean0.07636009981704275
driven_lanedir_median0.07384245539307666
driven_lanedir_min0.06208407563927665
in-drivable-lane_max0.7000000000000006
in-drivable-lane_mean0.23666666666666689
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20933027334969964, "sim_physics": 0.13321546827043806, "survival_time": 1.7500000000000009, "driven_lanedir": 0.0656903175899064, "sim_render-ego": 0.06772597857883998, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.1839298725128174, "deviation-heading": 0.7113627300300794, "set_robot_commands": 0.10345631326947892, "deviation-center-line": 0.06129629209937979, "driven_lanedir_consec": 0.0656903175899064, "sim_compute_sim_state": 0.042230081558227536, "sim_compute_performance-ego": 0.0728480202811105, "sim_compute_robot_state-ego": 0.08382556097848075}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1836751411645134, "sim_physics": 0.11917195175633286, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07012978252520352, "sim_render-ego": 0.06432937853264087, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17832115924719608, "deviation-heading": 0.6133815271377522, "set_robot_commands": 0.09649127902406636, "deviation-center-line": 0.02899641206291264, "driven_lanedir_consec": 0.07012978252520352, "sim_compute_sim_state": 0.04093242414069898, "sim_compute_performance-ego": 0.0710708372520678, "sim_compute_robot_state-ego": 0.080594489068696}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11001307896499384, "sim_physics": 0.11718635559082032, "survival_time": 1.0000000000000002, "driven_lanedir": 0.07326677982026553, "sim_render-ego": 0.0629226803779602, "in-drivable-lane": 0, "agent_compute-ego": 0.17000824213027954, "deviation-heading": 0.593150384274204, "set_robot_commands": 0.09721889495849607, "deviation-center-line": 0.09034092845987364, "driven_lanedir_consec": 0.07326677982026553, "sim_compute_sim_state": 0.04045249223709106, "sim_compute_performance-ego": 0.07060298919677735, "sim_compute_robot_state-ego": 0.07143460512161255}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19918706130799696, "sim_physics": 0.124966202360211, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07406890404771538, "sim_render-ego": 0.06533323634754527, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17396066405556418, "deviation-heading": 0.8365736883208287, "set_robot_commands": 0.09572404803651752, "deviation-center-line": 0.05025707064245247, "driven_lanedir_consec": 0.07406890404771538, "sim_compute_sim_state": 0.039091247500795304, "sim_compute_performance-ego": 0.06820206931143095, "sim_compute_robot_state-ego": 0.07652029124173251}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.17895382527015097, "sim_physics": 0.10891495810614692, "survival_time": 1.800000000000001, "driven_lanedir": 0.06208407563927665, "sim_render-ego": 0.0586788190735711, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.1577324801021152, "deviation-heading": 0.6013700121647094, "set_robot_commands": 0.08959182765748766, "deviation-center-line": 0.033361912152579366, "driven_lanedir_consec": 0.06208407563927665, "sim_compute_sim_state": 0.03532114956114027, "sim_compute_performance-ego": 0.06516983111699422, "sim_compute_robot_state-ego": 0.06754748026529948}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.2079586789460103, "sim_physics": 0.1248425543308258, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07066389004287732, "sim_render-ego": 0.06271616369485855, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17941241711378098, "deviation-heading": 0.8421154151785527, "set_robot_commands": 0.09629464149475098, "deviation-center-line": 0.05855086020867172, "driven_lanedir_consec": 0.07066389004287732, "sim_compute_sim_state": 0.039028242230415344, "sim_compute_performance-ego": 0.07172425836324692, "sim_compute_robot_state-ego": 0.08450758457183838}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.140177465042392, "sim_physics": 0.1230799961090088, "survival_time": 1.2500000000000004, "driven_lanedir": 0.10558253794669704, "sim_render-ego": 0.06282269477844238, "in-drivable-lane": 0, "agent_compute-ego": 0.16885199546813964, "deviation-heading": 0.6107285462056107, "set_robot_commands": 0.09278315544128418, "deviation-center-line": 0.09201336979199956, "driven_lanedir_consec": 0.10558253794669704, "sim_compute_sim_state": 0.040288867950439455, "sim_compute_performance-ego": 0.07127076148986816, "sim_compute_robot_state-ego": 0.0857319164276123}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.12263577080685471, "sim_physics": 0.10157159566879272, "survival_time": 1.0000000000000002, "driven_lanedir": 0.08793450037576012, "sim_render-ego": 0.06342839002609253, "in-drivable-lane": 0, "agent_compute-ego": 0.15928304195404053, "deviation-heading": 0.5594777005777292, "set_robot_commands": 0.09211653470993042, "deviation-center-line": 0.08889676352749161, "driven_lanedir_consec": 0.08793450037576012, "sim_compute_sim_state": 0.03716362714767456, "sim_compute_performance-ego": 0.06515786647796631, "sim_compute_robot_state-ego": 0.07421598434448243}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.13836945619654736, "sim_physics": 0.0986503263314565, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07464022856388075, "sim_render-ego": 0.05200392007827759, "in-drivable-lane": 0, "agent_compute-ego": 0.14278680086135864, "deviation-heading": 0.8211368328934245, "set_robot_commands": 0.08161914348602295, "deviation-center-line": 0.05403791885042908, "driven_lanedir_consec": 0.07464022856388075, "sim_compute_sim_state": 0.033071041107177734, "sim_compute_performance-ego": 0.056772579749425255, "sim_compute_robot_state-ego": 0.06229841709136963}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.12557273984910214, "sim_physics": 0.15592581292857294, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07744915322449808, "sim_render-ego": 0.06751986171888269, "in-drivable-lane": 0, "agent_compute-ego": 0.21473743604577103, "deviation-heading": 0.6516655724600262, "set_robot_commands": 0.11061701567276663, "deviation-center-line": 0.08051928829336927, "driven_lanedir_consec": 0.07744915322449808, "sim_compute_sim_state": 0.039433406746905784, "sim_compute_performance-ego": 0.07069663379503333, "sim_compute_robot_state-ego": 0.09304376270460046}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1174625666632272, "sim_physics": 0.12574004043232312, "survival_time": 1.1000000000000003, "driven_lanedir": 0.08587516092241176, "sim_render-ego": 0.06334490125829523, "in-drivable-lane": 0, "agent_compute-ego": 0.17636982961134476, "deviation-heading": 0.512956857957348, "set_robot_commands": 0.09638529474085028, "deviation-center-line": 0.09571401954632656, "driven_lanedir_consec": 0.08587516092241176, "sim_compute_sim_state": 0.03776762702248313, "sim_compute_performance-ego": 0.08299802650104869, "sim_compute_robot_state-ego": 0.08091053095730869}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.13095550729922498, "sim_physics": 0.14112178802490236, "survival_time": 1.2500000000000004, "driven_lanedir": 0.07384245539307666, "sim_render-ego": 0.0651930046081543, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1876980781555176, "deviation-heading": 0.7175110092196466, "set_robot_commands": 0.10604693412780762, "deviation-center-line": 0.06717329332760248, "driven_lanedir_consec": 0.07384245539307666, "sim_compute_sim_state": 0.04110137939453125, "sim_compute_performance-ego": 0.07628146171569825, "sim_compute_robot_state-ego": 0.08425658226013183}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.1938183102535504, "sim_physics": 0.11268091201782228, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06982655427380668, "sim_render-ego": 0.06122004284578211, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16698809932259953, "deviation-heading": 0.6680181287359052, "set_robot_commands": 0.09298755842096663, "deviation-center-line": 0.04265143483271798, "driven_lanedir_consec": 0.06982655427380668, "sim_compute_sim_state": 0.038813450757194966, "sim_compute_performance-ego": 0.07103823914247401, "sim_compute_robot_state-ego": 0.0762264798669254}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.14170526005938627, "sim_physics": 0.12602609634399414, "survival_time": 1.2500000000000004, "driven_lanedir": 0.06925645603926789, "sim_render-ego": 0.0637918758392334, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.17721717834472656, "deviation-heading": 0.8000314686100403, "set_robot_commands": 0.1010504150390625, "deviation-center-line": 0.046232418415578576, "driven_lanedir_consec": 0.06925645603926789, "sim_compute_sim_state": 0.04268485069274902, "sim_compute_performance-ego": 0.07204590797424316, "sim_compute_robot_state-ego": 0.08372940063476562}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1105366257319934, "sim_physics": 0.11853709675016856, "survival_time": 1.0500000000000005, "driven_lanedir": 0.08509070085099735, "sim_render-ego": 0.06033188956124442, "in-drivable-lane": 0, "agent_compute-ego": 0.17328013692583358, "deviation-heading": 0.43800008900597226, "set_robot_commands": 0.09574048859732492, "deviation-center-line": 0.10463452649389111, "driven_lanedir_consec": 0.08509070085099735, "sim_compute_sim_state": 0.0419075261978876, "sim_compute_performance-ego": 0.06914990288870675, "sim_compute_robot_state-ego": 0.07323111806597028}}
set_robot_commands_max0.11061701567276663
set_robot_commands_mean0.09654156964512092
set_robot_commands_median0.09629464149475098
set_robot_commands_min0.08161914348602295
sim_compute_performance-ego_max0.08299802650104869
sim_compute_performance-ego_mean0.07033529235040611
sim_compute_performance-ego_median0.07103823914247401
sim_compute_performance-ego_min0.056772579749425255
sim_compute_robot_state-ego_max0.09304376270460046
sim_compute_robot_state-ego_mean0.07853828024005509
sim_compute_robot_state-ego_median0.080594489068696
sim_compute_robot_state-ego_min0.06229841709136963
sim_compute_sim_state_max0.04268485069274902
sim_compute_sim_state_mean0.039285827616360805
sim_compute_sim_state_median0.039433406746905784
sim_compute_sim_state_min0.033071041107177734
sim_physics_max0.15592581292857294
sim_physics_mean0.1221087436681211
sim_physics_median0.1230799961090088
sim_physics_min0.0986503263314565
sim_render-ego_max0.06772597857883998
sim_render-ego_mean0.06275752248798804
sim_render-ego_median0.06334490125829523
sim_render-ego_min0.05200392007827759
simulation-passed1
survival_time_max1.800000000000001
survival_time_mean1.3600000000000003
survival_time_min1.0000000000000002
No reset possible
21304step1-simulationsuccessno0:13:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20593step1-simulationsuccessno0:05:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19643step1-simulationsuccessno0:03:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18896step1-simulationsuccessno0:04:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18892step1-simulationhost-errorno0:01:04
Error while running [...]

stderr | Creating job18892-951325_evaluator_1      ... error
stderr | 
stderr | Creating job18892-951325_simulator_1      ... 
stderr | Creating job18892-951325_solution_1       ... 
stderr | Creating job18892-951325_scenario_maker_1 ... done
stderr | 
stderr | ERROR: for evaluator  Cannot create container for service evaluator: device or resource busy
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18525step1-simulationsuccessno0:04:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18243step1-simulationsuccessno0:04:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17962step1-simulationsuccessno0:03:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17859step1-simulationsuccessno0:07:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17592step1-simulationerrorno0:07:48
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible