Duckietown Challenges Home Challenges Submissions

Submission 3756

Submission3756
Competingyes
Challengeaido2-LF-sim-testing
UserJulian Zilly
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23753
Next
User labelBaseline-IL-logs-tensorflow
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23753step1-simulationsuccessyes0:27:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8605053945529373
survival_time_median8.199999999999982
deviation-center-line_median0.4284816689856757
in-drivable-lane_median0.7500000000000107


other stats
agent_compute-ego_max0.16972187902196983
agent_compute-ego_mean0.14700822547812206
agent_compute-ego_median0.1456793370070281
agent_compute-ego_min0.14332665935639413
deviation-center-line_max0.9377067510459244
deviation-center-line_mean0.4666614796552999
deviation-center-line_min0.15691199311338655
deviation-heading_max2.6261815932821584
deviation-heading_mean1.684490775852729
deviation-heading_median1.6703950288423113
deviation-heading_min0.7263219271699827
driven_any_max2.1194859126084085
driven_any_mean1.1000841952582758
driven_any_median1.084343189203209
driven_any_min0.17238861927854376
driven_lanedir_consec_max2.1022882531435827
driven_lanedir_consec_mean0.9099201794998024
driven_lanedir_consec_min0.14588991493061831
driven_lanedir_max2.1022882531435827
driven_lanedir_mean0.9101248105337606
driven_lanedir_median0.8605053945529373
driven_lanedir_min0.14588991493061831
in-drivable-lane_max3.600000000000014
in-drivable-lane_mean1.2166666666666734
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0938454824172383, "sim_physics": 0.06607889991275148, "survival_time": 8.649999999999988, "driven_lanedir": 0.611891091461279, "sim_render-ego": 0.04185521258095096, "in-drivable-lane": 3.0999999999999996, "agent_compute-ego": 0.16972187902196983, "deviation-heading": 2.0983871281975772, "set_robot_commands": 0.06445569110054501, "deviation-center-line": 0.2846449416875342, "driven_lanedir_consec": 0.6114035977157748, "sim_compute_sim_state": 0.02830498618197579, "sim_compute_performance-ego": 0.047502064291452394, "sim_compute_robot_state-ego": 0.04995979739062359}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.008397109780104, "sim_physics": 0.05609091172307174, "survival_time": 8.04999999999998, "driven_lanedir": 0.8711128463657983, "sim_render-ego": 0.03612128844172318, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.14632564894160868, "deviation-heading": 1.4178703440924447, "set_robot_commands": 0.05559168395048343, "deviation-center-line": 0.3619142911218178, "driven_lanedir_consec": 0.8711128463657983, "sim_compute_sim_state": 0.02483478836391283, "sim_compute_performance-ego": 0.04031941017008716, "sim_compute_robot_state-ego": 0.04328660787262532}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2228988880916096, "sim_physics": 0.05746679881523395, "survival_time": 2.8999999999999977, "driven_lanedir": 0.2013041894642975, "sim_render-ego": 0.03633856362309949, "in-drivable-lane": 0, "agent_compute-ego": 0.14679682665857777, "deviation-heading": 0.9493319100712676, "set_robot_commands": 0.055365369237702466, "deviation-center-line": 0.29489602677710536, "driven_lanedir_consec": 0.2013041894642975, "sim_compute_sim_state": 0.025335168016367947, "sim_compute_performance-ego": 0.04162258115308038, "sim_compute_robot_state-ego": 0.042678717909188105}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.610780595197223, "sim_physics": 0.05822342399537094, "survival_time": 12.700000000000044, "driven_lanedir": 1.275403856947916, "sim_render-ego": 0.03769256937222218, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.14690237251792368, "deviation-heading": 2.353079000127138, "set_robot_commands": 0.05581185667533574, "deviation-center-line": 0.5849775698525342, "driven_lanedir_consec": 1.275403856947916, "sim_compute_sim_state": 0.02468212664596678, "sim_compute_performance-ego": 0.039969760601914775, "sim_compute_robot_state-ego": 0.04324371420492337}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6708161724717208, "sim_physics": 0.05759167512257894, "survival_time": 14.950000000000076, "driven_lanedir": 1.1815126228815158, "sim_render-ego": 0.036998242537180585, "in-drivable-lane": 3.450000000000049, "agent_compute-ego": 0.1460672624905904, "deviation-heading": 2.1725617726432542, "set_robot_commands": 0.05696165641148885, "deviation-center-line": 0.5718483991001154, "driven_lanedir_consec": 1.1793940282152429, "sim_compute_sim_state": 0.02534637928009033, "sim_compute_performance-ego": 0.039831793308258055, "sim_compute_robot_state-ego": 0.043129664262135825}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0212459959181992, "sim_physics": 0.05791748108402375, "survival_time": 7.7499999999999805, "driven_lanedir": 0.8605053945529373, "sim_render-ego": 0.03570200858577605, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.14458382360396846, "deviation-heading": 1.58730987779609, "set_robot_commands": 0.05542582388847105, "deviation-center-line": 0.3528544268024153, "driven_lanedir_consec": 0.8605053945529373, "sim_compute_sim_state": 0.02508876246790732, "sim_compute_performance-ego": 0.04032363583964686, "sim_compute_robot_state-ego": 0.042285090108071605}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.093102997043642, "sim_physics": 0.058407400072235424, "survival_time": 9.700000000000005, "driven_lanedir": 0.5851422262789594, "sim_render-ego": 0.0358587515722845, "in-drivable-lane": 3.600000000000014, "agent_compute-ego": 0.14445632020222773, "deviation-heading": 1.957547627264358, "set_robot_commands": 0.05536251830071518, "deviation-center-line": 0.2999836945536121, "driven_lanedir_consec": 0.5846788491813659, "sim_compute_sim_state": 0.024651097268173376, "sim_compute_performance-ego": 0.040462539368069046, "sim_compute_robot_state-ego": 0.04244529586477378}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.17238861927854376, "sim_physics": 0.05890704603756175, "survival_time": 1.7000000000000008, "driven_lanedir": 0.14588991493061831, "sim_render-ego": 0.03600459940293256, "in-drivable-lane": 0, "agent_compute-ego": 0.14376436962800868, "deviation-heading": 0.7263219271699827, "set_robot_commands": 0.05551725275376264, "deviation-center-line": 0.15691199311338655, "driven_lanedir_consec": 0.14588991493061831, "sim_compute_sim_state": 0.024697058341082406, "sim_compute_performance-ego": 0.03975993745467242, "sim_compute_robot_state-ego": 0.0427328768898459}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.1194859126084085, "sim_physics": 0.054486523469289144, "survival_time": 14.950000000000076, "driven_lanedir": 2.1022882531435827, "sim_render-ego": 0.03670470873514811, "in-drivable-lane": 0, "agent_compute-ego": 0.1466171662012736, "deviation-heading": 1.6703950288423113, "set_robot_commands": 0.055381636619567874, "deviation-center-line": 0.7622804226516259, "driven_lanedir_consec": 2.1022882531435827, "sim_compute_sim_state": 0.025300673643747964, "sim_compute_performance-ego": 0.039624624252319336, "sim_compute_robot_state-ego": 0.04357287804285685}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0139819010556683, "sim_physics": 0.06034411787986755, "survival_time": 7.99999999999998, "driven_lanedir": 0.6749243393846884, "sim_render-ego": 0.03689815998077393, "in-drivable-lane": 2.3499999999999917, "agent_compute-ego": 0.1460781291127205, "deviation-heading": 1.413217466257884, "set_robot_commands": 0.055606669187545775, "deviation-center-line": 0.4284816689856757, "driven_lanedir_consec": 0.6749243393846884, "sim_compute_sim_state": 0.02470347136259079, "sim_compute_performance-ego": 0.04061070829629898, "sim_compute_robot_state-ego": 0.04288785755634308}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.084343189203209, "sim_physics": 0.06263273733633536, "survival_time": 8.09999999999998, "driven_lanedir": 1.021452258525948, "sim_render-ego": 0.037054972884095747, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.1456793370070281, "deviation-heading": 2.23346428532844, "set_robot_commands": 0.05654255107597069, "deviation-center-line": 0.5899400219243149, "driven_lanedir_consec": 1.021452258525948, "sim_compute_sim_state": 0.02456850622907097, "sim_compute_performance-ego": 0.040081826257117, "sim_compute_robot_state-ego": 0.04263128763363685}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.3820118485947917, "sim_physics": 0.05961457760103287, "survival_time": 3.099999999999997, "driven_lanedir": 0.3491038921960731, "sim_render-ego": 0.03768425603066721, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.14332665935639413, "deviation-heading": 0.8135970185022114, "set_robot_commands": 0.05612434110333843, "deviation-center-line": 0.2264263069260406, "driven_lanedir_consec": 0.3491038921960731, "sim_compute_sim_state": 0.02481385200254379, "sim_compute_performance-ego": 0.0400963714045863, "sim_compute_robot_state-ego": 0.04290964526514853}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0228940717203392, "sim_physics": 0.054273725910620255, "survival_time": 8.79999999999999, "driven_lanedir": 0.8539679509220175, "sim_render-ego": 0.03565216741778634, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.144891388036988, "deviation-heading": 2.3481358779824792, "set_robot_commands": 0.05511977591297843, "deviation-center-line": 0.43971620682490975, "driven_lanedir_consec": 0.8539679509220175, "sim_compute_sim_state": 0.024542999538508328, "sim_compute_performance-ego": 0.04094844514673406, "sim_compute_robot_state-ego": 0.04201463271271099}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.131907544833488, "sim_physics": 0.057473312063914976, "survival_time": 8.199999999999982, "driven_lanedir": 1.1082721120722303, "sim_render-ego": 0.03672641661108994, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.1449526780989112, "deviation-heading": 0.8999607802333351, "set_robot_commands": 0.05674009352195554, "deviation-center-line": 0.707339473462487, "driven_lanedir_consec": 1.1082721120722303, "sim_compute_sim_state": 0.024519510385466785, "sim_compute_performance-ego": 0.03983641106907914, "sim_compute_robot_state-ego": 0.043194622528262255}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.853162600659952, "sim_physics": 0.059381921291351315, "survival_time": 14.950000000000076, "driven_lanedir": 1.809101208878548, "sim_render-ego": 0.03726482232411703, "in-drivable-lane": 0, "agent_compute-ego": 0.14495952129364015, "deviation-heading": 2.6261815932821584, "set_robot_commands": 0.056208895047505696, "deviation-center-line": 0.9377067510459244, "driven_lanedir_consec": 1.809101208878548, "sim_compute_sim_state": 0.02480694850285848, "sim_compute_performance-ego": 0.03990188439687093, "sim_compute_robot_state-ego": 0.04341623385747274}}
set_robot_commands_max0.06445569110054501
set_robot_commands_mean0.05641438765249112
set_robot_commands_median0.055606669187545775
set_robot_commands_min0.05511977591297843
sim_compute_performance-ego_max0.047502064291452394
sim_compute_performance-ego_mean0.040726132867345784
sim_compute_performance-ego_median0.0400963714045863
sim_compute_performance-ego_min0.039624624252319336
sim_compute_robot_state-ego_max0.04995979739062359
sim_compute_robot_state-ego_mean0.04335926147324125
sim_compute_robot_state-ego_median0.04290964526514853
sim_compute_robot_state-ego_min0.04201463271271099
sim_compute_sim_state_max0.02830498618197579
sim_compute_sim_state_mean0.025079755215350923
sim_compute_sim_state_median0.02480694850285848
sim_compute_sim_state_min0.024519510385466785
sim_physics_max0.06607889991275148
sim_physics_mean0.05859270348768263
sim_physics_median0.05822342399537094
sim_physics_min0.054273725910620255
sim_render-ego_max0.04185521258095096
sim_render-ego_mean0.03697044933998985
sim_render-ego_median0.03672641661108994
sim_render-ego_min0.03565216741778634
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.833333333333345
survival_time_min1.7000000000000008
No reset possible
23752step1-simulationerroryes0:39:23
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible