Duckietown Challenges Home Challenges Submissions

Submission 3503

Submission3503
Competingyes
Challengeaido2-LF-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22276
Next
User labelBaseline-IL-logs-tensorflow
Admin priority50
Blessingn/a
User priority50

22276

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-10-0

ETHZ_autolab_technical_track-11-0

ETHZ_autolab_technical_track-12-0

ETHZ_autolab_technical_track-13-0

ETHZ_autolab_technical_track-14-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

ETHZ_autolab_technical_track-5-0

ETHZ_autolab_technical_track-6-0

ETHZ_autolab_technical_track-7-0

ETHZ_autolab_technical_track-8-0

ETHZ_autolab_technical_track-9-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22276step1-simulationsuccessyes1 day, 3:51:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.9678760126397843
survival_time_median14.950000000000076
deviation-center-line_median1.1799241388583577
in-drivable-lane_median1.200000000000017


other stats
agent_compute-ego_max0.07281453212102254
agent_compute-ego_mean0.06773684305198299
agent_compute-ego_median0.0683297355969747
agent_compute-ego_min0.061025120593883375
deviation-center-line_max1.2676389696799428
deviation-center-line_mean1.0059158376221136
deviation-center-line_min0.11006084309054394
deviation-heading_max5.638744928889522
deviation-heading_mean3.5989768964507003
deviation-heading_median4.053523488341126
deviation-heading_min0.28184466440121475
driven_any_max4.0163449375348685
driven_any_mean3.0274197573520767
driven_any_median3.2847058413328853
driven_any_min0.42373047326918534
driven_lanedir_consec_max3.760656653783608
driven_lanedir_consec_mean2.6878808725695147
driven_lanedir_consec_min0.41279242019903695
driven_lanedir_max3.760656653783608
driven_lanedir_mean2.6878808725695147
driven_lanedir_median2.9678760126397843
driven_lanedir_min0.41279242019903695
in-drivable-lane_max3.150000000000018
in-drivable-lane_mean1.163333333333339
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.2847058413328853, "sim_physics": 0.059201111793518064, "survival_time": 14.950000000000076, "driven_lanedir": 3.03615757540568, "sim_render-ego": 0.05607789834340413, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.06659151156743368, "deviation-heading": 4.521479115271781, "set_robot_commands": 0.07625590880711873, "deviation-center-line": 1.214319384774014, "driven_lanedir_consec": 3.03615757540568, "sim_compute_sim_state": 0.03813521146774292, "sim_compute_performance-ego": 0.06009568770726522, "sim_compute_robot_state-ego": 0.06004502773284912}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.552507581732731, "sim_physics": 0.05869469324747721, "survival_time": 14.950000000000076, "driven_lanedir": 3.188104016054382, "sim_render-ego": 0.05631749868392944, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.06609118461608887, "deviation-heading": 4.3682697871538485, "set_robot_commands": 0.0751386014620463, "deviation-center-line": 1.2136795078397913, "driven_lanedir_consec": 3.188104016054382, "sim_compute_sim_state": 0.03840824206670125, "sim_compute_performance-ego": 0.06191477616628011, "sim_compute_robot_state-ego": 0.0613366969426473}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6214366352501626, "sim_physics": 0.057831777466668025, "survival_time": 5.399999999999989, "driven_lanedir": 1.2683424114333386, "sim_render-ego": 0.05629171044738204, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.061025120593883375, "deviation-heading": 0.28184466440121475, "set_robot_commands": 0.07261339823404948, "deviation-center-line": 0.3597283403773376, "driven_lanedir_consec": 1.2683424114333386, "sim_compute_sim_state": 0.03736336363686456, "sim_compute_performance-ego": 0.06079314152399699, "sim_compute_robot_state-ego": 0.060146194917184335}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.2906288923086273, "sim_physics": 0.05900099436442057, "survival_time": 14.950000000000076, "driven_lanedir": 2.970889297942154, "sim_render-ego": 0.05606263478597005, "in-drivable-lane": 0, "agent_compute-ego": 0.06658969958623251, "deviation-heading": 5.638744928889522, "set_robot_commands": 0.0755140209197998, "deviation-center-line": 1.257218937256981, "driven_lanedir_consec": 2.970889297942154, "sim_compute_sim_state": 0.038589565753936766, "sim_compute_performance-ego": 0.06000418186187744, "sim_compute_robot_state-ego": 0.06102757453918457}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.4329064050676616, "sim_physics": 0.05907625675201416, "survival_time": 14.950000000000076, "driven_lanedir": 2.9678760126397843, "sim_render-ego": 0.058206721146901445, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.06716002464294434, "deviation-heading": 3.4509620236611975, "set_robot_commands": 0.07577849706013998, "deviation-center-line": 0.9911518743635568, "driven_lanedir_consec": 2.9678760126397843, "sim_compute_sim_state": 0.03914027690887451, "sim_compute_performance-ego": 0.06409086465835571, "sim_compute_robot_state-ego": 0.062324378490448}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 3.4179987910473666, "sim_physics": 0.059421985149383544, "survival_time": 14.950000000000076, "driven_lanedir": 3.104273332305073, "sim_render-ego": 0.058186954657236736, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.06413701136906942, "deviation-heading": 4.053523488341126, "set_robot_commands": 0.07510673840840658, "deviation-center-line": 1.228733381785593, "driven_lanedir_consec": 3.104273332305073, "sim_compute_sim_state": 0.0401203727722168, "sim_compute_performance-ego": 0.06250218550364177, "sim_compute_robot_state-ego": 0.06310689131418865}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 3.064840140532996, "sim_physics": 0.058469441731770835, "survival_time": 14.950000000000076, "driven_lanedir": 2.772218432761381, "sim_render-ego": 0.06342108885447184, "in-drivable-lane": 0, "agent_compute-ego": 0.0683297355969747, "deviation-heading": 5.543844247431021, "set_robot_commands": 0.07657617568969727, "deviation-center-line": 1.2676389696799428, "driven_lanedir_consec": 2.772218432761381, "sim_compute_sim_state": 0.04228536367416382, "sim_compute_performance-ego": 0.06563953955968221, "sim_compute_robot_state-ego": 0.06318073829015096}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.831820611357723, "sim_physics": 0.05784619887669881, "survival_time": 14.950000000000076, "driven_lanedir": 2.2722915856324484, "sim_render-ego": 0.06297635157903035, "in-drivable-lane": 3.150000000000018, "agent_compute-ego": 0.06933698018391928, "deviation-heading": 3.803886956470918, "set_robot_commands": 0.0762282673517863, "deviation-center-line": 0.9599559987210612, "driven_lanedir_consec": 2.2722915856324484, "sim_compute_sim_state": 0.041030218601226805, "sim_compute_performance-ego": 0.06660337448120117, "sim_compute_robot_state-ego": 0.06386977036794027}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.42373047326918534, "sim_physics": 0.05887758731842041, "survival_time": 1.7000000000000008, "driven_lanedir": 0.41279242019903695, "sim_render-ego": 0.05636317589703728, "in-drivable-lane": 0, "agent_compute-ego": 0.06594274324529312, "deviation-heading": 0.3364895018434528, "set_robot_commands": 0.08639182062710032, "deviation-center-line": 0.11006084309054394, "driven_lanedir_consec": 0.41279242019903695, "sim_compute_sim_state": 0.04100625655230354, "sim_compute_performance-ego": 0.061294022728415096, "sim_compute_robot_state-ego": 0.061439864775713754}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 3.2398068718564623, "sim_physics": 0.05854279994964599, "survival_time": 14.950000000000076, "driven_lanedir": 2.8441958911345546, "sim_render-ego": 0.06155467748641968, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.06845241785049438, "deviation-heading": 4.547272668916105, "set_robot_commands": 0.07872933308283488, "deviation-center-line": 1.1177493172668571, "driven_lanedir_consec": 2.8441958911345546, "sim_compute_sim_state": 0.041437872250874835, "sim_compute_performance-ego": 0.06576830069224039, "sim_compute_robot_state-ego": 0.06277794281641642}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 3.105592957340592, "sim_physics": 0.05748632088513442, "survival_time": 14.200000000000069, "driven_lanedir": 2.655593735058696, "sim_render-ego": 0.06197273059630058, "in-drivable-lane": 1.550000000000014, "agent_compute-ego": 0.06845712074091737, "deviation-heading": 4.068120434142445, "set_robot_commands": 0.07518906660482917, "deviation-center-line": 1.1799241388583577, "driven_lanedir_consec": 2.655593735058696, "sim_compute_sim_state": 0.0415575386772693, "sim_compute_performance-ego": 0.06529840449212303, "sim_compute_robot_state-ego": 0.06220887412487621}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.769235521833912, "sim_physics": 0.05833670216747838, "survival_time": 11.700000000000031, "driven_lanedir": 2.3387914101267233, "sim_render-ego": 0.0640666260678544, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.07053609892853305, "deviation-heading": 3.1525974564118893, "set_robot_commands": 0.07854910997244027, "deviation-center-line": 0.6467165809533097, "driven_lanedir_consec": 2.3387914101267233, "sim_compute_sim_state": 0.042649201857738, "sim_compute_performance-ego": 0.06643843141376463, "sim_compute_robot_state-ego": 0.06421500087803246}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 4.0163449375348685, "sim_physics": 0.05776222785313924, "survival_time": 14.950000000000076, "driven_lanedir": 3.760656653783608, "sim_render-ego": 0.06303928772608439, "in-drivable-lane": 0.7499999999999991, "agent_compute-ego": 0.07281453212102254, "deviation-heading": 3.548099677181246, "set_robot_commands": 0.08001372257868448, "deviation-center-line": 1.2640807326914978, "driven_lanedir_consec": 3.760656653783608, "sim_compute_sim_state": 0.04185679276784261, "sim_compute_performance-ego": 0.06642955621083578, "sim_compute_robot_state-ego": 0.06325417359670003}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 3.587550788230466, "sim_physics": 0.05914424022038778, "survival_time": 14.950000000000076, "driven_lanedir": 3.325069880351011, "sim_render-ego": 0.06459617932637532, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.07062234004338583, "deviation-heading": 4.115107481306779, "set_robot_commands": 0.0784783911705017, "deviation-center-line": 1.246161810893253, "driven_lanedir_consec": 3.325069880351011, "sim_compute_sim_state": 0.0430078379313151, "sim_compute_performance-ego": 0.06714767297108969, "sim_compute_robot_state-ego": 0.06513854026794434}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 3.7721899115855138, "sim_physics": 0.057606915632883705, "survival_time": 14.950000000000076, "driven_lanedir": 3.400960433714849, "sim_render-ego": 0.06520011027654012, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.06996612469355265, "deviation-heading": 2.554411015337953, "set_robot_commands": 0.07790863355000814, "deviation-center-line": 1.0316177457796067, "driven_lanedir_consec": 3.400960433714849, "sim_compute_sim_state": 0.04184513250986735, "sim_compute_performance-ego": 0.06752372264862061, "sim_compute_robot_state-ego": 0.06446041266123453}}
set_robot_commands_max0.08639182062710032
set_robot_commands_mean0.07723144570129624
set_robot_commands_median0.07625590880711873
set_robot_commands_min0.07261339823404948
sim_compute_performance-ego_max0.06752372264862061
sim_compute_performance-ego_mean0.06410292417462599
sim_compute_performance-ego_median0.06529840449212303
sim_compute_performance-ego_min0.06000418186187744
sim_compute_robot_state-ego_max0.06513854026794434
sim_compute_robot_state-ego_mean0.06256880544770073
sim_compute_robot_state-ego_median0.06277794281641642
sim_compute_robot_state-ego_min0.06004502773284912
sim_compute_sim_state_max0.0430078379313151
sim_compute_sim_state_mean0.04056221649526255
sim_compute_sim_state_median0.041030218601226805
sim_compute_sim_state_min0.03736336363686456
sim_physics_max0.059421985149383544
sim_physics_mean0.05848661689393607
sim_physics_median0.05854279994964599
sim_physics_min0.05748632088513442
sim_render-ego_max0.06520011027654012
sim_render-ego_mean0.06028890972499586
sim_render-ego_median0.06155467748641968
sim_render-ego_min0.05606263478597005
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.163333333333394
survival_time_min1.7000000000000008
No reset possible
22225step1-simulationtimeoutyes1:05:12
I can see how the jo [...]
I can see how the job 22225 is timeout because passed 3912 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible