Duckietown Challenges Home Challenges Submissions

Submission 4167

Submission4167
Competingyes
Challengeaido3-LFVI-sim-testing
UserTanli Chou 🇹🇼
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27696
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
27696step1-simulationsuccessyes0:15:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6510741719617279
survival_time_median2.5999999999999988
deviation-center-line_median0.13998987879563426
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.03141774629291735
agent_compute-ego_mean0.02170027756390236
agent_compute-ego_median0.021054698870732233
agent_compute-ego_min0.018857083078158105
deviation-center-line_max0.3036287511501312
deviation-center-line_mean0.15369769239159572
deviation-center-line_min0.05216491457142899
deviation-heading_max1.2179728408173982
deviation-heading_mean0.5261661462618537
deviation-heading_median0.39731350514028857
deviation-heading_min0.17653006715371072
driven_any_max2.224828697235836
driven_any_mean1.0945516051967747
driven_any_median1.035889090772785
driven_any_min0.28141737741661643
driven_lanedir_consec_max1.5148199711845598
driven_lanedir_consec_mean0.6776353875620368
driven_lanedir_consec_min0.2574360490463805
driven_lanedir_max1.5148389893669991
driven_lanedir_mean0.6987447229996103
driven_lanedir_median0.6625717078190373
driven_lanedir_min0.2574360490463805
in-drivable-lane_max2.449999999999994
in-drivable-lane_mean0.7399999999999982
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.120585162571246, "sim_physics": 0.20620354853178324, "survival_time": 2.849999999999998, "driven_lanedir": 1.0834331015849266, "sim_render-ego": 0.012089131171243233, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.022404281716597703, "deviation-heading": 0.41432780267306696, "set_robot_commands": 0.00789818429110343, "deviation-center-line": 0.13998987879563426, "driven_lanedir_consec": 1.0834331015849266, "sim_compute_sim_state": 0.004961561738399037, "sim_compute_performance-ego": 0.007044880013716848, "sim_compute_robot_state-ego": 0.00903127486245674, "sim_compute_robot_state-npc0": 0.008222550676580061, "sim_compute_robot_state-npc1": 0.008636658651786939, "sim_compute_robot_state-npc2": 0.00784327272783246, "sim_compute_robot_state-npc3": 0.007716613903380277}, "udem1-1-0": {"driven_any": 0.625093593968239, "sim_physics": 0.2039513383592878, "survival_time": 1.7500000000000009, "driven_lanedir": 0.6085670792754807, "sim_render-ego": 0.018516322544642857, "in-drivable-lane": 0, "agent_compute-ego": 0.01995805331638881, "deviation-heading": 0.32013156786773145, "set_robot_commands": 0.007934182030814035, "deviation-center-line": 0.09604910370355851, "driven_lanedir_consec": 0.6085670792754807, "sim_compute_sim_state": 0.005096973691667829, "sim_compute_performance-ego": 0.007338482992989676, "sim_compute_robot_state-ego": 0.008471087047031948, "sim_compute_robot_state-npc0": 0.008007655824933733, "sim_compute_robot_state-npc1": 0.008446700232369559, "sim_compute_robot_state-npc2": 0.008565943581717354, "sim_compute_robot_state-npc3": 0.008196462903703962}, "udem1-2-0": {"driven_any": 1.0646337119139948, "sim_physics": 0.1602585271552757, "survival_time": 2.6999999999999984, "driven_lanedir": 0.54057801494714, "sim_render-ego": 0.011797935874373824, "in-drivable-lane": 0.9500000000000006, "agent_compute-ego": 0.019830293125576444, "deviation-heading": 0.7806490469039062, "set_robot_commands": 0.007006592220730252, "deviation-center-line": 0.18907742227401345, "driven_lanedir_consec": 0.54057801494714, "sim_compute_sim_state": 0.007771633289478443, "sim_compute_performance-ego": 0.006817879500212493, "sim_compute_robot_state-ego": 0.008219891124301486, "sim_compute_robot_state-npc0": 0.007856616267451533, "sim_compute_robot_state-npc1": 0.007641602445531775, "sim_compute_robot_state-npc2": 0.008094067926760073, "sim_compute_robot_state-npc3": 0.008074248278582538}, "udem1-3-0": {"driven_any": 0.28141737741661643, "sim_physics": 0.2053166188691792, "survival_time": 0.9500000000000004, "driven_lanedir": 0.2574360490463805, "sim_render-ego": 0.01187570471512644, "in-drivable-lane": 0, "agent_compute-ego": 0.03141774629291735, "deviation-heading": 0.370261699898986, "set_robot_commands": 0.0076109861072741055, "deviation-center-line": 0.05216491457142899, "driven_lanedir_consec": 0.2574360490463805, "sim_compute_sim_state": 0.005059066571687397, "sim_compute_performance-ego": 0.006368486504805715, "sim_compute_robot_state-ego": 0.008323493756745992, "sim_compute_robot_state-npc0": 0.008152786054109273, "sim_compute_robot_state-npc1": 0.009079180265727797, "sim_compute_robot_state-npc2": 0.007624023839047081, "sim_compute_robot_state-npc3": 0.008550217277125308}, "udem1-4-0": {"driven_any": 1.4415883765088768, "sim_physics": 0.20263295778086488, "survival_time": 3.5499999999999954, "driven_lanedir": 0.5714453508506352, "sim_render-ego": 0.0113195130522822, "in-drivable-lane": 1.8499999999999943, "agent_compute-ego": 0.02067929254451268, "deviation-heading": 0.38647524317752424, "set_robot_commands": 0.007193491492472904, "deviation-center-line": 0.13680180419291485, "driven_lanedir_consec": 0.5714453508506352, "sim_compute_sim_state": 0.005512522979521416, "sim_compute_performance-ego": 0.00671131174329301, "sim_compute_robot_state-ego": 0.007860277740048691, "sim_compute_robot_state-npc0": 0.008092554522232271, "sim_compute_robot_state-npc1": 0.007852144644293986, "sim_compute_robot_state-npc2": 0.007848118392514512, "sim_compute_robot_state-npc3": 0.007777032717852525}, "udem1-5-0": {"driven_any": 1.0080391968248454, "sim_physics": 0.17386445632347694, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6704865591525617, "sim_render-ego": 0.012589665559621958, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.022511042081392728, "deviation-heading": 0.3922278328684869, "set_robot_commands": 0.008057864812704233, "deviation-center-line": 0.07771251037610638, "driven_lanedir_consec": 0.6704865591525617, "sim_compute_sim_state": 0.005372015329507681, "sim_compute_performance-ego": 0.008419756705944356, "sim_compute_robot_state-ego": 0.008892572843111478, "sim_compute_robot_state-npc0": 0.008794174744532658, "sim_compute_robot_state-npc1": 0.009090877496279202, "sim_compute_robot_state-npc2": 0.00826180439728957, "sim_compute_robot_state-npc3": 0.00888214661524846}, "udem1-6-0": {"driven_any": 1.0203763919640902, "sim_physics": 0.16955959796905518, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6885137224643074, "sim_render-ego": 0.011517666853391208, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.021703600883483887, "deviation-heading": 0.48275274423678327, "set_robot_commands": 0.007660599855276255, "deviation-center-line": 0.2218899592142332, "driven_lanedir_consec": 0.6510741719617279, "sim_compute_sim_state": 0.005847376126509447, "sim_compute_performance-ego": 0.007015993961921105, "sim_compute_robot_state-ego": 0.008616126500643216, "sim_compute_robot_state-npc0": 0.008371233940124512, "sim_compute_robot_state-npc1": 0.008829116821289062, "sim_compute_robot_state-npc2": 0.008156730578495907, "sim_compute_robot_state-npc3": 0.008399073894207295}, "udem1-7-0": {"driven_any": 1.518889572352387, "sim_physics": 0.22243381852973, "survival_time": 3.649999999999995, "driven_lanedir": 1.5148389893669991, "sim_render-ego": 0.012648451818178778, "in-drivable-lane": 0, "agent_compute-ego": 0.025220276558235905, "deviation-heading": 0.20977423156921973, "set_robot_commands": 0.008869843940212303, "deviation-center-line": 0.21770843077410823, "driven_lanedir_consec": 1.5148199711845598, "sim_compute_sim_state": 0.0060335903951566515, "sim_compute_performance-ego": 0.007692591784751578, "sim_compute_robot_state-ego": 0.009029728092559397, "sim_compute_robot_state-npc0": 0.00861056536844332, "sim_compute_robot_state-npc1": 0.00840668155722422, "sim_compute_robot_state-npc2": 0.008851335473256568, "sim_compute_robot_state-npc3": 0.008678684495899775}, "udem1-8-0": {"driven_any": 1.0327164362829535, "sim_physics": 0.1889461141366225, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8071665223942781, "sim_render-ego": 0.012139453337742733, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.02117009346301739, "deviation-heading": 0.7544988063126181, "set_robot_commands": 0.007966078244722806, "deviation-center-line": 0.25456483764263077, "driven_lanedir_consec": 0.7988277806254289, "sim_compute_sim_state": 0.005606463322272668, "sim_compute_performance-ego": 0.006876739171835093, "sim_compute_robot_state-ego": 0.008405538705679087, "sim_compute_robot_state-npc0": 0.00867619881263146, "sim_compute_robot_state-npc1": 0.00846398793734037, "sim_compute_robot_state-npc2": 0.008083004217881423, "sim_compute_robot_state-npc3": 0.00844499239554772}, "udem1-9-0": {"driven_any": 2.194603187711772, "sim_physics": 0.1891325391255892, "survival_time": 5.1999999999999895, "driven_lanedir": 0.9504366656971932, "sim_render-ego": 0.012040945199819712, "in-drivable-lane": 2.449999999999994, "agent_compute-ego": 0.021054698870732233, "deviation-heading": 1.2179728408173982, "set_robot_commands": 0.00784788911159222, "deviation-center-line": 0.3036287511501312, "driven_lanedir_consec": 0.891948749340645, "sim_compute_sim_state": 0.005271226167678833, "sim_compute_performance-ego": 0.007304562972142146, "sim_compute_robot_state-ego": 0.008558323750129113, "sim_compute_robot_state-npc0": 0.0085298098050631, "sim_compute_robot_state-npc1": 0.008462818769308237, "sim_compute_robot_state-npc2": 0.008031826752882738, "sim_compute_robot_state-npc3": 0.00818353432875413}, "udem1-10-0": {"driven_any": 0.289456859388621, "sim_physics": 0.1983768343925476, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2655179454616352, "sim_render-ego": 0.01139286756515503, "in-drivable-lane": 0, "agent_compute-ego": 0.01896524429321289, "deviation-heading": 0.36575855943077534, "set_robot_commands": 0.006726121902465821, "deviation-center-line": 0.06115233279890005, "driven_lanedir_consec": 0.2655179454616352, "sim_compute_sim_state": 0.00546187162399292, "sim_compute_performance-ego": 0.006270003318786621, "sim_compute_robot_state-ego": 0.008677232265472411, "sim_compute_robot_state-npc0": 0.007963228225708007, "sim_compute_robot_state-npc1": 0.007400166988372803, "sim_compute_robot_state-npc2": 0.00992180109024048, "sim_compute_robot_state-npc3": 0.008164596557617188}, "udem1-11-0": {"driven_any": 1.2100209344634405, "sim_physics": 0.16825921252622442, "survival_time": 2.9499999999999975, "driven_lanedir": 0.46508942212711313, "sim_render-ego": 0.011252544694027658, "in-drivable-lane": 1.599999999999997, "agent_compute-ego": 0.018857083078158105, "deviation-heading": 0.17653006715371072, "set_robot_commands": 0.007201518042612884, "deviation-center-line": 0.129995313593986, "driven_lanedir_consec": 0.46508942212711313, "sim_compute_sim_state": 0.005555633771217475, "sim_compute_performance-ego": 0.007092968892242949, "sim_compute_robot_state-ego": 0.008459709458431955, "sim_compute_robot_state-npc0": 0.008673627497786182, "sim_compute_robot_state-npc1": 0.008536726741467491, "sim_compute_robot_state-npc2": 0.0078427670365673, "sim_compute_robot_state-npc3": 0.007854461669921875}, "udem1-12-0": {"driven_any": 2.224828697235836, "sim_physics": 0.18369865646729103, "survival_time": 5.1999999999999895, "driven_lanedir": 1.0703777445593876, "sim_render-ego": 0.012002461231671847, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.021392162029559795, "deviation-heading": 0.9732612596020856, "set_robot_commands": 0.007607148243830754, "deviation-center-line": 0.1588932542141487, "driven_lanedir_consec": 0.861653506375097, "sim_compute_sim_state": 0.0055609964407407324, "sim_compute_performance-ego": 0.007112741470336914, "sim_compute_robot_state-ego": 0.008521623336351834, "sim_compute_robot_state-npc0": 0.008505915219967183, "sim_compute_robot_state-npc1": 0.00874288036273076, "sim_compute_robot_state-npc2": 0.008291395810934214, "sim_compute_robot_state-npc3": 0.008314678302178016}, "udem1-13-0": {"driven_any": 0.35013548857591936, "sim_physics": 0.22514843940734863, "survival_time": 1.1000000000000003, "driven_lanedir": 0.32471197024708154, "sim_render-ego": 0.011603344570506702, "in-drivable-lane": 0, "agent_compute-ego": 0.01934659481048584, "deviation-heading": 0.39731350514028857, "set_robot_commands": 0.007846561345187101, "deviation-center-line": 0.06622448803036315, "driven_lanedir_consec": 0.32471197024708154, "sim_compute_sim_state": 0.004954164678400213, "sim_compute_performance-ego": 0.006442611867731268, "sim_compute_robot_state-ego": 0.008107781410217285, "sim_compute_robot_state-npc0": 0.008613987402482466, "sim_compute_robot_state-npc1": 0.008211721073497425, "sim_compute_robot_state-npc2": 0.008913321928544478, "sim_compute_robot_state-npc3": 0.008038650859485973}, "udem1-14-0": {"driven_any": 1.035889090772785, "sim_physics": 0.2064876006199763, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6625717078190373, "sim_render-ego": 0.012106207700876089, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.020993700394263633, "deviation-heading": 0.6505569862752227, "set_robot_commands": 0.00741350192290086, "deviation-center-line": 0.1996123845417775, "driven_lanedir_consec": 0.6589411412501393, "sim_compute_sim_state": 0.004977088708143968, "sim_compute_performance-ego": 0.006779400201944204, "sim_compute_robot_state-ego": 0.008314366524036113, "sim_compute_robot_state-npc0": 0.00828016262788039, "sim_compute_robot_state-npc1": 0.008670375897334172, "sim_compute_robot_state-npc2": 0.007514811479128324, "sim_compute_robot_state-npc3": 0.008187326101156382}}
set_robot_commands_max0.008869843940212303
set_robot_commands_mean0.007656037570926665
set_robot_commands_median0.007660599855276255
set_robot_commands_min0.006726121902465821
sim_compute_performance-ego_max0.008419756705944356
sim_compute_performance-ego_mean0.007019227406843598
sim_compute_performance-ego_median0.007015993961921105
sim_compute_performance-ego_min0.006270003318786621
sim_compute_robot_state-ego_max0.00903127486245674
sim_compute_robot_state-ego_mean0.008499268494481118
sim_compute_robot_state-ego_median0.008471087047031948
sim_compute_robot_state-ego_min0.007860277740048691
sim_compute_robot_state-npc0_max0.008794174744532658
sim_compute_robot_state-npc0_mean0.00835673779932841
sim_compute_robot_state-npc0_median0.008371233940124512
sim_compute_robot_state-npc0_min0.007856616267451533
sim_compute_robot_state-npc1_max0.009090877496279202
sim_compute_robot_state-npc1_mean0.008431442658970252
sim_compute_robot_state-npc1_median0.00846398793734037
sim_compute_robot_state-npc1_min0.007400166988372803
sim_compute_robot_state-npc2_max0.00992180109024048
sim_compute_robot_state-npc2_mean0.008256281682206166
sim_compute_robot_state-npc2_median0.008094067926760073
sim_compute_robot_state-npc2_min0.007514811479128324
sim_compute_robot_state-npc3_max0.00888214661524846
sim_compute_robot_state-npc3_mean0.008230848020044096
sim_compute_robot_state-npc3_median0.008187326101156382
sim_compute_robot_state-npc3_min0.007716613903380277
sim_compute_sim_state_max0.007771633289478443
sim_compute_sim_state_mean0.00553614565562498
sim_compute_sim_state_median0.00546187162399292
sim_compute_sim_state_min0.004954164678400213
sim_physics_max0.22514843940734863
sim_physics_mean0.19361801734628348
sim_physics_median0.1983768343925476
sim_physics_min0.1602585271552757
sim_render-ego_max0.018516322544642857
sim_render-ego_mean0.012326147725910685
sim_render-ego_median0.012002461231671847
sim_render-ego_min0.011252544694027658
simulation-passed1
survival_time_max5.1999999999999895
survival_time_mean2.7533333333333307
survival_time_min0.9500000000000004
No reset possible
27694step1-simulationsuccessyes0:17:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25902step1-simulationsuccessno0:14:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24974step1-simulationerrorno0:03:20
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24351step1-simulationerrorno0:11:59
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24346step1-simulationerrorno0:13:05
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible