Duckietown Challenges Home Challenges Submissions

Submission 5136

Submission5136
Competingyes
Challengeaido3-LF-sim-validation
UserMoustafa Elarabi
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 28028
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

28028

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
28028step1-simulationsuccessyes0:07:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.700332745391772
survival_time_median14.800000000000075
deviation-center-line_median0.6847001287122529
in-drivable-lane_median0.14999999999999947


other stats
agent_compute-ego_max0.05314436674118042
agent_compute-ego_mean0.042557237184256594
agent_compute-ego_median0.04130912508283343
agent_compute-ego_min0.03615746131310096
deviation-center-line_max0.9697426028401006
deviation-center-line_mean0.5583728291074189
deviation-center-line_min0.1581839910604928
deviation-heading_max3.435555455067289
deviation-heading_mean2.2653317986419177
deviation-heading_median2.6987107440820455
deviation-heading_min0.7602430599175968
driven_any_max4.464994591622165
driven_any_mean3.0360232293566973
driven_any_median4.0372848533455254
driven_any_min1.0171489202590829
driven_lanedir_consec_max4.320709482569871
driven_lanedir_consec_mean2.7915934652240546
driven_lanedir_consec_min0.7523516535265435
driven_lanedir_max4.320709482569871
driven_lanedir_mean2.7915934652240546
driven_lanedir_median3.700332745391772
driven_lanedir_min0.7523516535265435
in-drivable-lane_max1.7000000000000135
in-drivable-lane_mean0.6400000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3241928570159978, "sim_physics": 0.07576537359328497, "survival_time": 5.249999999999989, "driven_lanedir": 1.286111135916502, "sim_render-ego": 0.013981285549345471, "in-drivable-lane": 0, "agent_compute-ego": 0.04130912508283343, "deviation-heading": 1.0141978083497274, "set_robot_commands": 0.010705053238641647, "deviation-center-line": 0.2922586796467632, "driven_lanedir_consec": 1.286111135916502, "sim_compute_sim_state": 0.0054853825342087515, "sim_compute_performance-ego": 0.008319141751243955, "sim_compute_robot_state-ego": 0.00998919577825637}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.0372848533455254, "sim_physics": 0.07808484633763631, "survival_time": 14.950000000000076, "driven_lanedir": 3.898462308715585, "sim_render-ego": 0.013651355902353925, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.05314436674118042, "deviation-heading": 2.6987107440820455, "set_robot_commands": 0.00956852436065674, "deviation-center-line": 0.6847001287122529, "driven_lanedir_consec": 3.898462308715585, "sim_compute_sim_state": 0.005669140021006267, "sim_compute_performance-ego": 0.00799045960108439, "sim_compute_robot_state-ego": 0.009746738274892173}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0171489202590829, "sim_physics": 0.0874695754968203, "survival_time": 5.1999999999999895, "driven_lanedir": 0.7523516535265435, "sim_render-ego": 0.01369586128454942, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.03615746131310096, "deviation-heading": 0.7602430599175968, "set_robot_commands": 0.008853247532477746, "deviation-center-line": 0.1581839910604928, "driven_lanedir_consec": 0.7523516535265435, "sim_compute_sim_state": 0.006150073730028593, "sim_compute_performance-ego": 0.008660437969061045, "sim_compute_robot_state-ego": 0.010234165650147658}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.464994591622165, "sim_physics": 0.0886786386773393, "survival_time": 14.800000000000075, "driven_lanedir": 4.320709482569871, "sim_render-ego": 0.014364186976407026, "in-drivable-lane": 0, "agent_compute-ego": 0.0385007423323554, "deviation-heading": 3.417951925792928, "set_robot_commands": 0.009910990257520931, "deviation-center-line": 0.9697426028401006, "driven_lanedir_consec": 4.320709482569871, "sim_compute_sim_state": 0.006525637330235662, "sim_compute_performance-ego": 0.008981400244944805, "sim_compute_robot_state-ego": 0.01064174803527626}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.336494924540715, "sim_physics": 0.08819744984308879, "survival_time": 14.950000000000076, "driven_lanedir": 3.700332745391772, "sim_render-ego": 0.014027314186096191, "in-drivable-lane": 1.7000000000000135, "agent_compute-ego": 0.04367449045181274, "deviation-heading": 3.435555455067289, "set_robot_commands": 0.009665400187174478, "deviation-center-line": 0.6869787432774851, "driven_lanedir_consec": 3.700332745391772, "sim_compute_sim_state": 0.006426146030426025, "sim_compute_performance-ego": 0.008583285808563233, "sim_compute_robot_state-ego": 0.010553518136342366}}
set_robot_commands_max0.010705053238641647
set_robot_commands_mean0.009740643115294307
set_robot_commands_median0.009665400187174478
set_robot_commands_min0.008853247532477746
sim_compute_performance-ego_max0.008981400244944805
sim_compute_performance-ego_mean0.008506945074979486
sim_compute_performance-ego_median0.008583285808563233
sim_compute_performance-ego_min0.00799045960108439
sim_compute_robot_state-ego_max0.01064174803527626
sim_compute_robot_state-ego_mean0.010233073174982964
sim_compute_robot_state-ego_median0.010234165650147658
sim_compute_robot_state-ego_min0.009746738274892173
sim_compute_sim_state_max0.006525637330235662
sim_compute_sim_state_mean0.00605127592918106
sim_compute_sim_state_median0.006150073730028593
sim_compute_sim_state_min0.0054853825342087515
sim_physics_max0.0886786386773393
sim_physics_mean0.08363917678963394
sim_physics_median0.0874695754968203
sim_physics_min0.07576537359328497
sim_render-ego_max0.014364186976407026
sim_render-ego_mean0.013944000779750406
sim_render-ego_median0.013981285549345471
sim_render-ego_min0.013651355902353925
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.03000000000004
survival_time_min5.1999999999999895
No reset possible
28027step1-simulationerroryes0:06:50
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible