Duckietown Challenges Home Challenges Submissions

Submission 3679

Submission3679
Competingyes
Challengeaido2-LF-sim-testing
UserTony Hsu 🇹🇼
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23548
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23548step1-simulationsuccessyes0:30:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6935805249478659
survival_time_median14.950000000000076
deviation-center-line_median0.13811270405225393
in-drivable-lane_median7.250000000000037


other stats
agent_compute-ego_max0.15933898687362671
agent_compute-ego_mean0.15797752710346122
agent_compute-ego_median0.15821378469467162
agent_compute-ego_min0.15302540196312797
deviation-center-line_max0.5247579329171296
deviation-center-line_mean0.2279084377875802
deviation-center-line_min0.038694648277245336
deviation-heading_max6.053631647519605
deviation-heading_mean4.3381373313945835
deviation-heading_median5.704071130785565
deviation-heading_min0.2698718914419194
driven_any_max2.185306548531152
driven_any_mean1.625802086819021
driven_any_median2.185306548531143
driven_any_min0.08532904011133041
driven_lanedir_consec_max0.6958089939919965
driven_lanedir_consec_mean0.5164610549083716
driven_lanedir_consec_min0.023144130689651377
driven_lanedir_max0.6958089939919965
driven_lanedir_mean0.5164610549083716
driven_lanedir_median0.6935805249478659
driven_lanedir_min0.023144130689651377
in-drivable-lane_max7.400000000000038
in-drivable-lane_mean5.436666666666693
in-drivable-lane_min0.2500000000000002
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.185306548531152, "sim_physics": 0.039283523559570314, "survival_time": 14.950000000000076, "driven_lanedir": 0.6935805249478659, "sim_render-ego": 0.03448126236597697, "in-drivable-lane": 7.300000000000036, "agent_compute-ego": 0.15933898687362671, "deviation-heading": 5.801699789039097, "set_robot_commands": 0.05379996379216512, "deviation-center-line": 0.42632647013358815, "driven_lanedir_consec": 0.6935805249478659, "sim_compute_sim_state": 0.022508841355641684, "sim_compute_performance-ego": 0.03749715805053711, "sim_compute_robot_state-ego": 0.04242408911387126}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1853065485311447, "sim_physics": 0.0397440505027771, "survival_time": 14.950000000000076, "driven_lanedir": 0.6945338083100598, "sim_render-ego": 0.034337681929270426, "in-drivable-lane": 7.350000000000037, "agent_compute-ego": 0.15785382350285848, "deviation-heading": 5.704071130785565, "set_robot_commands": 0.05418444474538167, "deviation-center-line": 0.09203990928853956, "driven_lanedir_consec": 0.6945338083100598, "sim_compute_sim_state": 0.022943864663441976, "sim_compute_performance-ego": 0.03786550839742025, "sim_compute_robot_state-ego": 0.04279261271158854}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.08532904011133041, "sim_physics": 0.04327666759490967, "survival_time": 0.9000000000000002, "driven_lanedir": 0.023144130689651377, "sim_render-ego": 0.03585749202304416, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.15838680002424452, "deviation-heading": 0.3584582273080204, "set_robot_commands": 0.05345202816857232, "deviation-center-line": 0.041663353925832584, "driven_lanedir_consec": 0.023144130689651377, "sim_compute_sim_state": 0.023923675219217937, "sim_compute_performance-ego": 0.04061571756998698, "sim_compute_robot_state-ego": 0.04394936561584473}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.185306548531149, "sim_physics": 0.04025985399881999, "survival_time": 14.950000000000076, "driven_lanedir": 0.6921605544021268, "sim_render-ego": 0.03448169469833374, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.15802271763483683, "deviation-heading": 5.725118401226187, "set_robot_commands": 0.05349369843800863, "deviation-center-line": 0.3235070869376339, "driven_lanedir_consec": 0.6921605544021268, "sim_compute_sim_state": 0.022332515716552735, "sim_compute_performance-ego": 0.038118801911671954, "sim_compute_robot_state-ego": 0.04273395776748657}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.18530654853115, "sim_physics": 0.037029492855072024, "survival_time": 14.950000000000076, "driven_lanedir": 0.6948995260115542, "sim_render-ego": 0.03383704582850138, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.15776660442352294, "deviation-heading": 5.610544076489624, "set_robot_commands": 0.05405068318049113, "deviation-center-line": 0.13576341190830038, "driven_lanedir_consec": 0.6948995260115542, "sim_compute_sim_state": 0.021787665685017905, "sim_compute_performance-ego": 0.0370750617980957, "sim_compute_robot_state-ego": 0.04220193068186442}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.18530654853114, "sim_physics": 0.03879992564519246, "survival_time": 14.950000000000076, "driven_lanedir": 0.6935576438398612, "sim_render-ego": 0.03467660586039225, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.15821378469467162, "deviation-heading": 6.053631647519605, "set_robot_commands": 0.05319578250249227, "deviation-center-line": 0.46569006797573825, "driven_lanedir_consec": 0.6935576438398612, "sim_compute_sim_state": 0.022146724859873453, "sim_compute_performance-ego": 0.03746253728866577, "sim_compute_robot_state-ego": 0.042493101755777994}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.185306548531143, "sim_physics": 0.039200963973999026, "survival_time": 14.950000000000076, "driven_lanedir": 0.6953333414337557, "sim_render-ego": 0.034529268741607666, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.1591520078976949, "deviation-heading": 5.874526439563811, "set_robot_commands": 0.05378411610921224, "deviation-center-line": 0.5247579329171296, "driven_lanedir_consec": 0.6953333414337557, "sim_compute_sim_state": 0.02271462599436442, "sim_compute_performance-ego": 0.03891139348347982, "sim_compute_robot_state-ego": 0.04268733898798625}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.08532904011133226, "sim_physics": 0.04181370470258925, "survival_time": 0.9000000000000002, "driven_lanedir": 0.023710002985235512, "sim_render-ego": 0.03321834405263265, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.15302540196312797, "deviation-heading": 0.3476484984306861, "set_robot_commands": 0.06430554389953613, "deviation-center-line": 0.038694648277245336, "driven_lanedir_consec": 0.023710002985235512, "sim_compute_sim_state": 0.021387471093071833, "sim_compute_performance-ego": 0.037261406580607094, "sim_compute_robot_state-ego": 0.04381538761986627}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.1853065485311474, "sim_physics": 0.03864828666051229, "survival_time": 14.950000000000076, "driven_lanedir": 0.693726533816768, "sim_render-ego": 0.034654221534729, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.157433230082194, "deviation-heading": 5.901771614359146, "set_robot_commands": 0.05313583453496297, "deviation-center-line": 0.1351465823580643, "driven_lanedir_consec": 0.693726533816768, "sim_compute_sim_state": 0.0229230801264445, "sim_compute_performance-ego": 0.03760641813278198, "sim_compute_robot_state-ego": 0.04265083392461141}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.185306548531149, "sim_physics": 0.0383633812268575, "survival_time": 14.950000000000076, "driven_lanedir": 0.6946567575492519, "sim_render-ego": 0.034336596330006915, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.15875677029291788, "deviation-heading": 5.862596978233645, "set_robot_commands": 0.053025810718536376, "deviation-center-line": 0.4400368985757062, "driven_lanedir_consec": 0.6946567575492519, "sim_compute_sim_state": 0.022499624888102213, "sim_compute_performance-ego": 0.03890157779057821, "sim_compute_robot_state-ego": 0.04237241029739379}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.09267214810871956, "sim_physics": 0.04465564928556744, "survival_time": 0.9500000000000004, "driven_lanedir": 0.032550922632334056, "sim_render-ego": 0.03487423846596166, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.15849286631533974, "deviation-heading": 0.2698718914419194, "set_robot_commands": 0.0542335635737369, "deviation-center-line": 0.04534215101103772, "driven_lanedir_consec": 0.032550922632334056, "sim_compute_sim_state": 0.024648704026874742, "sim_compute_performance-ego": 0.037455270164891294, "sim_compute_robot_state-ego": 0.04296640345924779}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.185306548531143, "sim_physics": 0.03881066083908081, "survival_time": 14.950000000000076, "driven_lanedir": 0.6958089939919965, "sim_render-ego": 0.03411954243977865, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.1585290789604187, "deviation-heading": 5.984218850284319, "set_robot_commands": 0.05329973300298055, "deviation-center-line": 0.34479124707378467, "driven_lanedir_consec": 0.6958089939919965, "sim_compute_sim_state": 0.02195420742034912, "sim_compute_performance-ego": 0.03725295861562093, "sim_compute_robot_state-ego": 0.04198444922765096}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.185306548531148, "sim_physics": 0.0374134635925293, "survival_time": 14.950000000000076, "driven_lanedir": 0.6932617575622324, "sim_render-ego": 0.03434733947118123, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.15921226421991985, "deviation-heading": 5.617488650083433, "set_robot_commands": 0.05295859177907307, "deviation-center-line": 0.2108984178734968, "driven_lanedir_consec": 0.6932617575622324, "sim_compute_sim_state": 0.02272683064142863, "sim_compute_performance-ego": 0.03834009250005086, "sim_compute_robot_state-ego": 0.04281677881876628}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.1853065485311327, "sim_physics": 0.03806484858194987, "survival_time": 14.950000000000076, "driven_lanedir": 0.6938456840605172, "sim_render-ego": 0.03399771769841512, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.15766629219055175, "deviation-heading": 5.688506307987748, "set_robot_commands": 0.05308113257090251, "deviation-center-line": 0.13811270405225393, "driven_lanedir_consec": 0.6938456840605172, "sim_compute_sim_state": 0.02228950579961141, "sim_compute_performance-ego": 0.03770959297815959, "sim_compute_robot_state-ego": 0.04221926212310791}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.085329040111332, "sim_physics": 0.04281024138132731, "survival_time": 0.9000000000000002, "driven_lanedir": 0.03214564139236442, "sim_render-ego": 0.034628205829196505, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.15781227747599283, "deviation-heading": 0.27190746816595013, "set_robot_commands": 0.053916864924960665, "deviation-center-line": 0.05585568450535137, "driven_lanedir_consec": 0.03214564139236442, "sim_compute_sim_state": 0.023171146710713703, "sim_compute_performance-ego": 0.039982583787706166, "sim_compute_robot_state-ego": 0.041894767019483775}}
set_robot_commands_max0.06430554389953613
set_robot_commands_mean0.054261186129400826
set_robot_commands_median0.05349369843800863
set_robot_commands_min0.05295859177907307
sim_compute_performance-ego_max0.04061571756998698
sim_compute_performance-ego_mean0.038137071936683586
sim_compute_performance-ego_median0.03770959297815959
sim_compute_performance-ego_min0.0370750617980957
sim_compute_robot_state-ego_max0.04394936561584473
sim_compute_robot_state-ego_mean0.042666845941636534
sim_compute_robot_state-ego_median0.04265083392461141
sim_compute_robot_state-ego_min0.041894767019483775
sim_compute_sim_state_max0.024648704026874742
sim_compute_sim_state_mean0.022663898946713744
sim_compute_sim_state_median0.022508841355641684
sim_compute_sim_state_min0.021387471093071833
sim_physics_max0.04465564928556744
sim_physics_mean0.03987831429338362
sim_physics_median0.039200963973999026
sim_physics_min0.037029492855072024
sim_render-ego_max0.03585749202304416
sim_render-ego_mean0.034425150484601895
sim_render-ego_median0.03448126236597697
sim_render-ego_min0.03321834405263265
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.206666666666724
survival_time_min0.9000000000000002
No reset possible
23547step1-simulationerroryes0:29:44
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible