Duckietown Challenges Home Challenges Submissions

Submission 3827

Submission3827
Competingyes
Challengeaido2-LF-sim-testing-offseason
UserDonghoon Lee
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 24041
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
24041step1-simulationsuccessyes0:07:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.09853991077945869
survival_time_median1.3000000000000005
deviation-center-line_median0.07278338816431716
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.13545525074005127
agent_compute-ego_mean0.1246676366144208
agent_compute-ego_median0.12817369699478148
agent_compute-ego_min0.10521774456418792
deviation-center-line_max0.11575411683258724
deviation-center-line_mean0.07287303182326406
deviation-center-line_min0.03477991694866784
deviation-heading_max0.9321483401134256
deviation-heading_mean0.6714893475414192
deviation-heading_median0.6793494373621005
deviation-heading_min0.392317376911526
driven_any_max0.21361167422931532
driven_any_mean0.1641776858945669
driven_any_median0.16475358325407058
driven_any_min0.1076250695166834
driven_lanedir_consec_max0.15446570437600782
driven_lanedir_consec_mean0.09964816406830242
driven_lanedir_consec_min0.06646211710974725
driven_lanedir_max0.15446570437600782
driven_lanedir_mean0.09964816406830242
driven_lanedir_median0.09853991077945869
driven_lanedir_min0.06646211710974725
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.10000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21361167422931532, "sim_physics": 0.08272887678707347, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06646211710974725, "sim_render-ego": 0.04861913007848403, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.13545525074005127, "deviation-heading": 0.6752071176558541, "set_robot_commands": 0.07354937581455007, "deviation-center-line": 0.05856314138961787, "driven_lanedir_consec": 0.06646211710974725, "sim_compute_sim_state": 0.029696892289554373, "sim_compute_performance-ego": 0.0501942424213185, "sim_compute_robot_state-ego": 0.050756216049194336}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.168720742680579, "sim_physics": 0.0825040170124599, "survival_time": 1.4000000000000006, "driven_lanedir": 0.08211406685946765, "sim_render-ego": 0.04629279885973249, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.12997389691216604, "deviation-heading": 0.6795917279335619, "set_robot_commands": 0.08368198360715594, "deviation-center-line": 0.03477991694866784, "driven_lanedir_consec": 0.08211406685946765, "sim_compute_sim_state": 0.030511345182146345, "sim_compute_performance-ego": 0.05162380422864642, "sim_compute_robot_state-ego": 0.05539630992071969}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13592775682666047, "sim_physics": 0.08166595697402954, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1071275341837774, "sim_render-ego": 0.04345148801803589, "in-drivable-lane": 0, "agent_compute-ego": 0.12817369699478148, "deviation-heading": 0.49705251497530345, "set_robot_commands": 0.07601308822631836, "deviation-center-line": 0.0936563504252406, "driven_lanedir_consec": 0.1071275341837774, "sim_compute_sim_state": 0.027845215797424317, "sim_compute_performance-ego": 0.0474449634552002, "sim_compute_robot_state-ego": 0.04770184755325317}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18584729875645828, "sim_physics": 0.08405514863821176, "survival_time": 1.3000000000000005, "driven_lanedir": 0.0993768499335741, "sim_render-ego": 0.04407639686877911, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12020298150869516, "deviation-heading": 0.8756731253994221, "set_robot_commands": 0.06453315111306998, "deviation-center-line": 0.0655501080445978, "driven_lanedir_consec": 0.0993768499335741, "sim_compute_sim_state": 0.02779349913963905, "sim_compute_performance-ego": 0.050340744165273815, "sim_compute_robot_state-ego": 0.052060301487262435}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1953388582881024, "sim_physics": 0.08071158672201223, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11167554690566694, "sim_render-ego": 0.050895320958104624, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.12948978358301624, "deviation-heading": 0.7088073994112413, "set_robot_commands": 0.0754426018945102, "deviation-center-line": 0.05037038883056152, "driven_lanedir_consec": 0.11167554690566694, "sim_compute_sim_state": 0.030752650622663823, "sim_compute_performance-ego": 0.048421333576070855, "sim_compute_robot_state-ego": 0.052400778079855034}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.19133773776132343, "sim_physics": 0.08001810770768386, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09619843846010134, "sim_render-ego": 0.04685034201695369, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12866279712090126, "deviation-heading": 0.9321483401134256, "set_robot_commands": 0.06835561532240647, "deviation-center-line": 0.07580912950287826, "driven_lanedir_consec": 0.09619843846010134, "sim_compute_sim_state": 0.03059562352987436, "sim_compute_performance-ego": 0.05482347194965069, "sim_compute_robot_state-ego": 0.05370264786940355}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.19713290317072696, "sim_physics": 0.0791018179484776, "survival_time": 1.4000000000000006, "driven_lanedir": 0.15446570437600782, "sim_render-ego": 0.04446329389299665, "in-drivable-lane": 0, "agent_compute-ego": 0.11633963244301931, "deviation-heading": 0.6742409540091541, "set_robot_commands": 0.0675654411315918, "deviation-center-line": 0.10088184901270492, "driven_lanedir_consec": 0.15446570437600782, "sim_compute_sim_state": 0.026526595864977156, "sim_compute_performance-ego": 0.047887367861611504, "sim_compute_robot_state-ego": 0.04885802098682949}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.1076250695166834, "sim_physics": 0.07416939735412598, "survival_time": 0.9500000000000004, "driven_lanedir": 0.07346733252519844, "sim_render-ego": 0.050861747641312446, "in-drivable-lane": 0, "agent_compute-ego": 0.12757224785654167, "deviation-heading": 0.5536005323435644, "set_robot_commands": 0.07286376702158075, "deviation-center-line": 0.08096847263704883, "driven_lanedir_consec": 0.07346733252519844, "sim_compute_sim_state": 0.03057149836891576, "sim_compute_performance-ego": 0.0535248831698769, "sim_compute_robot_state-ego": 0.05379227588051244}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.16475358325407058, "sim_physics": 0.07681849369635949, "survival_time": 1.3000000000000005, "driven_lanedir": 0.10477575797079997, "sim_render-ego": 0.04179925184983473, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12691367589510405, "deviation-heading": 0.6925177095610329, "set_robot_commands": 0.0788108568925124, "deviation-center-line": 0.048603917916147925, "driven_lanedir_consec": 0.10477575797079997, "sim_compute_sim_state": 0.029417734879713792, "sim_compute_performance-ego": 0.046737762597891, "sim_compute_robot_state-ego": 0.04919348313258244}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.11832924911584897, "sim_physics": 0.08576639838840651, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07154564918534634, "sim_render-ego": 0.05020324043605639, "in-drivable-lane": 0, "agent_compute-ego": 0.13354703654413638, "deviation-heading": 0.6793494373621005, "set_robot_commands": 0.07725259532099185, "deviation-center-line": 0.08041326071935247, "driven_lanedir_consec": 0.07154564918534634, "sim_compute_sim_state": 0.03276867451875106, "sim_compute_performance-ego": 0.050776066987410835, "sim_compute_robot_state-ego": 0.05293385878853176}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.14285644881769605, "sim_physics": 0.07725795455600905, "survival_time": 1.1500000000000004, "driven_lanedir": 0.11112680923832108, "sim_render-ego": 0.04266662183015243, "in-drivable-lane": 0, "agent_compute-ego": 0.11548063029413638, "deviation-heading": 0.5048470766573037, "set_robot_commands": 0.06669354438781738, "deviation-center-line": 0.10340747884493988, "driven_lanedir_consec": 0.11112680923832108, "sim_compute_sim_state": 0.02458144270855447, "sim_compute_performance-ego": 0.045714678971663765, "sim_compute_robot_state-ego": 0.04743417449619459}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.14104348546622464, "sim_physics": 0.09335608067719832, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09478783032320226, "sim_render-ego": 0.049534331197324005, "in-drivable-lane": 0, "agent_compute-ego": 0.13199357364488684, "deviation-heading": 0.6604787843909117, "set_robot_commands": 0.07430207211038341, "deviation-center-line": 0.07278338816431716, "driven_lanedir_consec": 0.09478783032320226, "sim_compute_sim_state": 0.03067615757817807, "sim_compute_performance-ego": 0.052826394205508026, "sim_compute_robot_state-ego": 0.05613565444946289}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.1905387201139992, "sim_physics": 0.07421320060203815, "survival_time": 1.4500000000000006, "driven_lanedir": 0.09853991077945869, "sim_render-ego": 0.04072509962936927, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.10521774456418792, "deviation-heading": 0.7398436384456799, "set_robot_commands": 0.06369448530262914, "deviation-center-line": 0.056224096421286535, "driven_lanedir_consec": 0.09853991077945869, "sim_compute_sim_state": 0.02532313609945363, "sim_compute_performance-ego": 0.04485001235172666, "sim_compute_robot_state-ego": 0.04689782241295124}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.15087571537709227, "sim_physics": 0.08077092170715332, "survival_time": 1.2500000000000004, "driven_lanedir": 0.0880338508168923, "sim_render-ego": 0.04673678398132324, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1325953197479248, "deviation-heading": 0.8066644779512048, "set_robot_commands": 0.07094217300415039, "deviation-center-line": 0.05532986165901217, "driven_lanedir_consec": 0.0880338508168923, "sim_compute_sim_state": 0.03169510841369629, "sim_compute_performance-ego": 0.04797802925109863, "sim_compute_robot_state-ego": 0.05175393104553223}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.15872604504372284, "sim_physics": 0.07145138408826746, "survival_time": 1.1500000000000004, "driven_lanedir": 0.13502506235697442, "sim_render-ego": 0.04221897539885148, "in-drivable-lane": 0, "agent_compute-ego": 0.10839628136676292, "deviation-heading": 0.392317376911526, "set_robot_commands": 0.060012921043064285, "deviation-center-line": 0.11575411683258724, "driven_lanedir_consec": 0.13502506235697442, "sim_compute_sim_state": 0.024806592775427776, "sim_compute_performance-ego": 0.047549019689145294, "sim_compute_robot_state-ego": 0.049333292505015496}}
set_robot_commands_max0.08368198360715594
set_robot_commands_mean0.07158091147951548
set_robot_commands_median0.07286376702158075
set_robot_commands_min0.060012921043064285
sim_compute_performance-ego_max0.05482347194965069
sim_compute_performance-ego_mean0.049379518325472875
sim_compute_performance-ego_median0.048421333576070855
sim_compute_performance-ego_min0.04485001235172666
sim_compute_robot_state-ego_max0.05613565444946289
sim_compute_robot_state-ego_mean0.05122337431048672
sim_compute_robot_state-ego_median0.05175393104553223
sim_compute_robot_state-ego_min0.04689782241295124
sim_compute_sim_state_max0.03276867451875106
sim_compute_sim_state_mean0.02890414451793135
sim_compute_sim_state_median0.029696892289554373
sim_compute_sim_state_min0.02458144270855447
sim_physics_max0.09335608067719832
sim_physics_mean0.08030595619063377
sim_physics_median0.08071158672201223
sim_physics_min0.07145138408826746
sim_render-ego_max0.050895320958104624
sim_render-ego_mean0.045959654843820696
sim_render-ego_median0.04629279885973249
sim_render-ego_min0.04072509962936927
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.273333333333334
survival_time_min0.9500000000000004
No reset possible