Duckietown Challenges Home Challenges Submissions

Submission 4394

Submission4394
Competingyes
Challengeaido3-LFVI-sim-testing
UserJeick Hincapie Barrera 🇨🇴
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27508
Next
User labelchallenge-aido_LF-template-ros - Template solution using ROS
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
27508step1-simulationsuccessyes0:16:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4378933478955715
survival_time_median3.099999999999997
deviation-center-line_median0.13908903563608688
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.03005633236449442
agent_compute-ego_mean0.02412727274725141
agent_compute-ego_median0.023074176576402452
agent_compute-ego_min0.02084908446645349
deviation-center-line_max0.532746324399545
deviation-center-line_mean0.18169206884848385
deviation-center-line_min0.0681161462163248
deviation-heading_max1.1901827219312813
deviation-heading_mean0.6415543546915703
deviation-heading_median0.5031825547422055
deviation-heading_min0.2060429950224342
driven_any_max1.8488671355040076
driven_any_mean0.8309001857913937
driven_any_median0.8893644944837463
driven_any_min0.22794626361561687
driven_lanedir_consec_max1.3664896815564729
driven_lanedir_consec_mean0.5839463445625489
driven_lanedir_consec_min0.1749357963148559
driven_lanedir_max1.807834195793656
driven_lanedir_mean0.6154689923102642
driven_lanedir_median0.4378933478955715
driven_lanedir_min0.1749357963148559
in-drivable-lane_max2.199999999999996
in-drivable-lane_mean0.5766666666666651
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2152514395156324, "sim_physics": 0.21185068426461057, "survival_time": 4.3499999999999925, "driven_lanedir": 1.1458081801121476, "sim_render-ego": 0.012343856109969915, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.0260251609758399, "deviation-heading": 1.1461887665248496, "set_robot_commands": 0.00817853554911997, "deviation-center-line": 0.3196271163955538, "driven_lanedir_consec": 1.1457079084309494, "sim_compute_sim_state": 0.004780996804949881, "sim_compute_performance-ego": 0.00680831931103235, "sim_compute_robot_state-ego": 0.00830667320339159, "sim_compute_robot_state-npc0": 0.007948404070974767, "sim_compute_robot_state-npc1": 0.00817534293251476, "sim_compute_robot_state-npc2": 0.008054031722847072, "sim_compute_robot_state-npc3": 0.007649884826835544}, "udem1-1-0": {"driven_any": 1.181685992599853, "sim_physics": 0.15785917891077247, "survival_time": 4.149999999999993, "driven_lanedir": 0.6522619080269556, "sim_render-ego": 0.014779268977153733, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.021198557083865244, "deviation-heading": 0.36240222968987695, "set_robot_commands": 0.007286867463445088, "deviation-center-line": 0.16820559038086544, "driven_lanedir_consec": 0.6522619080269556, "sim_compute_sim_state": 0.004356137241225645, "sim_compute_performance-ego": 0.006378486932042134, "sim_compute_robot_state-ego": 0.007702347743942077, "sim_compute_robot_state-npc0": 0.007487294185592468, "sim_compute_robot_state-npc1": 0.0071450514965746776, "sim_compute_robot_state-npc2": 0.007137338799166392, "sim_compute_robot_state-npc3": 0.007133440799023731}, "udem1-2-0": {"driven_any": 1.0118081524117453, "sim_physics": 0.15982903983141925, "survival_time": 3.699999999999995, "driven_lanedir": 0.9004425545660449, "sim_render-ego": 0.01107793563121074, "in-drivable-lane": 0, "agent_compute-ego": 0.023026169957341375, "deviation-heading": 1.152229849649838, "set_robot_commands": 0.007990917643985233, "deviation-center-line": 0.2913214072499907, "driven_lanedir_consec": 0.8690476242686972, "sim_compute_sim_state": 0.004525455268653664, "sim_compute_performance-ego": 0.0067962955784153295, "sim_compute_robot_state-ego": 0.008425142313982989, "sim_compute_robot_state-npc0": 0.007915735244750977, "sim_compute_robot_state-npc1": 0.007745903891486091, "sim_compute_robot_state-npc2": 0.007776733991262075, "sim_compute_robot_state-npc3": 0.0078517907374614}, "udem1-3-0": {"driven_any": 0.22794626361561687, "sim_physics": 0.2169793744881948, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1749357963148559, "sim_render-ego": 0.011718412240346272, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.02377935250600179, "deviation-heading": 0.6100530204931127, "set_robot_commands": 0.007957011461257935, "deviation-center-line": 0.0681161462163248, "driven_lanedir_consec": 0.1749357963148559, "sim_compute_sim_state": 0.0046152472496032715, "sim_compute_performance-ego": 0.006653696298599243, "sim_compute_robot_state-ego": 0.008165309826532999, "sim_compute_robot_state-npc0": 0.007865856091181437, "sim_compute_robot_state-npc1": 0.007682989041010539, "sim_compute_robot_state-npc2": 0.008035888274510702, "sim_compute_robot_state-npc3": 0.007564902305603027}, "udem1-4-0": {"driven_any": 1.8488671355040076, "sim_physics": 0.158903623984112, "survival_time": 6.149999999999986, "driven_lanedir": 1.807834195793656, "sim_render-ego": 0.01017701528905853, "in-drivable-lane": 0, "agent_compute-ego": 0.02084908446645349, "deviation-heading": 1.1901827219312813, "set_robot_commands": 0.00700918251905984, "deviation-center-line": 0.532746324399545, "driven_lanedir_consec": 1.3664896815564729, "sim_compute_sim_state": 0.004173472644836922, "sim_compute_performance-ego": 0.006021807833415706, "sim_compute_robot_state-ego": 0.007185811918925464, "sim_compute_robot_state-npc0": 0.00715073725072349, "sim_compute_robot_state-npc1": 0.007056808084007201, "sim_compute_robot_state-npc2": 0.006855135041523755, "sim_compute_robot_state-npc3": 0.007012481611918628}, "udem1-5-0": {"driven_any": 0.8893644944837463, "sim_physics": 0.14618780920582433, "survival_time": 3.099999999999997, "driven_lanedir": 0.4378933478955715, "sim_render-ego": 0.010812694026577856, "in-drivable-lane": 1.399999999999996, "agent_compute-ego": 0.02155242427702873, "deviation-heading": 0.413983013659317, "set_robot_commands": 0.007682996411477366, "deviation-center-line": 0.10744428364584496, "driven_lanedir_consec": 0.4378933478955715, "sim_compute_sim_state": 0.0045018619106661885, "sim_compute_performance-ego": 0.006085457340363533, "sim_compute_robot_state-ego": 0.007464085855791645, "sim_compute_robot_state-npc0": 0.0073513792407128116, "sim_compute_robot_state-npc1": 0.007275885151278588, "sim_compute_robot_state-npc2": 0.0070660960289739795, "sim_compute_robot_state-npc3": 0.007206720690573415}, "udem1-6-0": {"driven_any": 0.3217568213058035, "sim_physics": 0.15915270509390994, "survival_time": 1.4500000000000006, "driven_lanedir": 0.31142877744438513, "sim_render-ego": 0.010583581595585263, "in-drivable-lane": 0, "agent_compute-ego": 0.02277273967348296, "deviation-heading": 0.3179105481386682, "set_robot_commands": 0.007299883612271013, "deviation-center-line": 0.12787653843572008, "driven_lanedir_consec": 0.31142877744438513, "sim_compute_sim_state": 0.004090440684351428, "sim_compute_performance-ego": 0.00622533107626027, "sim_compute_robot_state-ego": 0.007353314037980704, "sim_compute_robot_state-npc0": 0.007525641342689251, "sim_compute_robot_state-npc1": 0.007288340864510372, "sim_compute_robot_state-npc2": 0.006900047433787379, "sim_compute_robot_state-npc3": 0.009815766893584151}, "udem1-7-0": {"driven_any": 0.422564670739684, "sim_physics": 0.22264282570944893, "survival_time": 1.800000000000001, "driven_lanedir": 0.41237875627155907, "sim_render-ego": 0.011226495107014976, "in-drivable-lane": 0, "agent_compute-ego": 0.023074176576402452, "deviation-heading": 0.2968053239062273, "set_robot_commands": 0.009885125690036347, "deviation-center-line": 0.13908903563608688, "driven_lanedir_consec": 0.41237875627155907, "sim_compute_sim_state": 0.004265977276696099, "sim_compute_performance-ego": 0.006250096691979302, "sim_compute_robot_state-ego": 0.008226580089992948, "sim_compute_robot_state-npc0": 0.007440825303395589, "sim_compute_robot_state-npc1": 0.006944563653733995, "sim_compute_robot_state-npc2": 0.007391399807400173, "sim_compute_robot_state-npc3": 0.0070170362790425616}, "udem1-8-0": {"driven_any": 1.0869893500063008, "sim_physics": 0.1792141184394742, "survival_time": 4.049999999999994, "driven_lanedir": 0.7141335869056502, "sim_render-ego": 0.011092168313485603, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.03005633236449442, "deviation-heading": 0.878889826365967, "set_robot_commands": 0.007813032762503919, "deviation-center-line": 0.20474526161428125, "driven_lanedir_consec": 0.7141335869056502, "sim_compute_sim_state": 0.004434673874466507, "sim_compute_performance-ego": 0.006529507813630281, "sim_compute_robot_state-ego": 0.008136319525447893, "sim_compute_robot_state-npc0": 0.00779316160413954, "sim_compute_robot_state-npc1": 0.00756882443840121, "sim_compute_robot_state-npc2": 0.007475876513822579, "sim_compute_robot_state-npc3": 0.007503547786194601}, "udem1-9-0": {"driven_any": 1.1424631314529632, "sim_physics": 0.23887352701983872, "survival_time": 3.949999999999994, "driven_lanedir": 0.3199264085960296, "sim_render-ego": 0.01273345947265625, "in-drivable-lane": 2.199999999999996, "agent_compute-ego": 0.02654710298852075, "deviation-heading": 1.1128298423206882, "set_robot_commands": 0.00847440731676319, "deviation-center-line": 0.17094642867950188, "driven_lanedir_consec": 0.3199264085960296, "sim_compute_sim_state": 0.004865429069422469, "sim_compute_performance-ego": 0.0076442368422882465, "sim_compute_robot_state-ego": 0.009121719794937326, "sim_compute_robot_state-npc0": 0.008504511434820634, "sim_compute_robot_state-npc1": 0.008160648466665534, "sim_compute_robot_state-npc2": 0.008374582363080375, "sim_compute_robot_state-npc3": 0.008255623563935485}, "udem1-10-0": {"driven_any": 1.0711610669051304, "sim_physics": 0.17114179929097492, "survival_time": 3.7499999999999942, "driven_lanedir": 0.3955395433982156, "sim_render-ego": 0.011688292821248373, "in-drivable-lane": 2.099999999999994, "agent_compute-ego": 0.029185880025227862, "deviation-heading": 0.49052382077367057, "set_robot_commands": 0.008006718953450521, "deviation-center-line": 0.07933265713998794, "driven_lanedir_consec": 0.3955395433982156, "sim_compute_sim_state": 0.004832611083984375, "sim_compute_performance-ego": 0.0071887016296386715, "sim_compute_robot_state-ego": 0.008395681381225586, "sim_compute_robot_state-npc0": 0.007930370966593424, "sim_compute_robot_state-npc1": 0.007476828893025716, "sim_compute_robot_state-npc2": 0.007755200068155925, "sim_compute_robot_state-npc3": 0.007487837473551432}, "udem1-11-0": {"driven_any": 0.8244210104658632, "sim_physics": 0.19305799468871085, "survival_time": 3.099999999999997, "driven_lanedir": 0.7829043398589945, "sim_render-ego": 0.011565662199451078, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.022814096943024668, "deviation-heading": 0.5031825547422055, "set_robot_commands": 0.007902879868784258, "deviation-center-line": 0.13572815870526408, "driven_lanedir_consec": 0.7829043398589945, "sim_compute_sim_state": 0.004681168063994377, "sim_compute_performance-ego": 0.006584079034866825, "sim_compute_robot_state-ego": 0.008085912273776147, "sim_compute_robot_state-npc0": 0.007858345585484658, "sim_compute_robot_state-npc1": 0.007567459537136939, "sim_compute_robot_state-npc2": 0.007535423001935405, "sim_compute_robot_state-npc3": 0.008005184511984549}, "udem1-12-0": {"driven_any": 0.563788053121494, "sim_physics": 0.1954833209514618, "survival_time": 2.000000000000001, "driven_lanedir": 0.5531138948568208, "sim_render-ego": 0.01190091371536255, "in-drivable-lane": 0, "agent_compute-ego": 0.024829429388046265, "deviation-heading": 0.3358737235304561, "set_robot_commands": 0.00877549648284912, "deviation-center-line": 0.14005637483483965, "driven_lanedir_consec": 0.5531138948568208, "sim_compute_sim_state": 0.004844075441360474, "sim_compute_performance-ego": 0.007198876142501831, "sim_compute_robot_state-ego": 0.008814239501953125, "sim_compute_robot_state-npc0": 0.008423000574111938, "sim_compute_robot_state-npc1": 0.008197706937789918, "sim_compute_robot_state-npc2": 0.008239811658859253, "sim_compute_robot_state-npc3": 0.00795682668685913}, "udem1-13-0": {"driven_any": 0.36238025749644254, "sim_physics": 0.2231220765547319, "survival_time": 1.6500000000000008, "driven_lanedir": 0.33545904027107065, "sim_render-ego": 0.011482137622255268, "in-drivable-lane": 0, "agent_compute-ego": 0.023552092638882725, "deviation-heading": 0.6062170836249625, "set_robot_commands": 0.008321205774943033, "deviation-center-line": 0.10444971478734522, "driven_lanedir_consec": 0.33545904027107065, "sim_compute_sim_state": 0.004726229291973692, "sim_compute_performance-ego": 0.006937604961973248, "sim_compute_robot_state-ego": 0.008544538960312351, "sim_compute_robot_state-npc0": 0.007621570066972213, "sim_compute_robot_state-npc1": 0.007711778987537731, "sim_compute_robot_state-npc2": 0.007644833940448183, "sim_compute_robot_state-npc3": 0.007144284970832594}, "udem1-14-0": {"driven_any": 0.2930549472466218, "sim_physics": 0.21541291016798753, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2879745543420047, "sim_render-ego": 0.012002697357764613, "in-drivable-lane": 0, "agent_compute-ego": 0.022646491344158467, "deviation-heading": 0.2060429950224342, "set_robot_commands": 0.007355442413916955, "deviation-center-line": 0.135695994606106, "driven_lanedir_consec": 0.2879745543420047, "sim_compute_sim_state": 0.0043010711669921875, "sim_compute_performance-ego": 0.006684028185330904, "sim_compute_robot_state-ego": 0.008449031756474422, "sim_compute_robot_state-npc0": 0.007543123685396635, "sim_compute_robot_state-npc1": 0.0074812540641197795, "sim_compute_robot_state-npc2": 0.007724202596224272, "sim_compute_robot_state-npc3": 0.00786883097428542}}
set_robot_commands_max0.009885125690036347
set_robot_commands_mean0.007995980261590919
set_robot_commands_median0.007957011461257935
set_robot_commands_min0.00700918251905984
sim_compute_performance-ego_max0.0076442368422882465
sim_compute_performance-ego_mean0.006665768378155858
sim_compute_performance-ego_median0.006653696298599243
sim_compute_performance-ego_min0.006021807833415706
sim_compute_robot_state-ego_max0.009121719794937326
sim_compute_robot_state-ego_mean0.00815844721231115
sim_compute_robot_state-ego_median0.008226580089992948
sim_compute_robot_state-ego_min0.007185811918925464
sim_compute_robot_state-npc0_max0.008504511434820634
sim_compute_robot_state-npc0_mean0.007757330443169322
sim_compute_robot_state-npc0_median0.00779316160413954
sim_compute_robot_state-npc0_min0.00715073725072349
sim_compute_robot_state-npc1_max0.008197706937789918
sim_compute_robot_state-npc1_mean0.007565292429319537
sim_compute_robot_state-npc1_median0.007567459537136939
sim_compute_robot_state-npc1_min0.006944563653733995
sim_compute_robot_state-npc2_max0.008374582363080375
sim_compute_robot_state-npc2_mean0.007597773416133169
sim_compute_robot_state-npc2_median0.007644833940448183
sim_compute_robot_state-npc2_min0.006855135041523755
sim_compute_robot_state-npc3_max0.009815766893584151
sim_compute_robot_state-npc3_mean0.007698277340779045
sim_compute_robot_state-npc3_median0.007564902305603027
sim_compute_robot_state-npc3_min0.007012481611918628
sim_compute_sim_state_max0.004865429069422469
sim_compute_sim_state_mean0.004532989804878478
sim_compute_sim_state_median0.004525455268653664
sim_compute_sim_state_min0.004090440684351428
sim_physics_max0.23887352701983872
sim_physics_mean0.18998073257343148
sim_physics_median0.19305799468871085
sim_physics_min0.14618780920582433
sim_render-ego_max0.014779268977153733
sim_render-ego_mean0.011678972698609402
sim_render-ego_median0.011565662199451078
sim_render-ego_min0.01017701528905853
simulation-passed1
survival_time_max6.149999999999986
survival_time_mean3.046666666666662
survival_time_min1.2000000000000004
No reset possible
25861step1-simulationsuccessno0:18:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25121step1-simulationsuccessno0:14:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25116step1-simulationhost-errorno0:03:03
Error while running [...]

stderr | Pulling evaluator      ... 
stderr | Pulling simulator      ... 
stderr | Pulling solution       ... done
stderr | 
stderr | ERROR: for scenario_maker  Cannot overwrite digest sha256:e973619acedfa53e32b44d07e5a03a07c60c7093402155ff75ec550e6a14bcbe
stderr | Cannot overwrite digest sha256:e973619acedfa53e32b44d07e5a03a07c60c7093402155ff75ec550e6a14bcbe
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible