Duckietown Challenges Home Challenges Submissions

Submission 2762

Submission2762
Competingyes
Challengeaido2-LFVI-sim-testing
UserBhairav Mehta
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22788
Next
User labelchallenge-aido_LF-template-ros - Template solution using ROS
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22788step1-simulationsuccessyes0:27:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2875407694053156
survival_time_median2.849999999999998
deviation-center-line_median0.11031194850197353
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.07896651540483747
agent_compute-ego_mean0.07181146799442485
agent_compute-ego_median0.07100734599800997
agent_compute-ego_min0.06494187272113303
deviation-center-line_max0.2701922695523504
deviation-center-line_mean0.13746050030700233
deviation-center-line_min0.07113819587235681
deviation-heading_max1.4854398920276677
deviation-heading_mean0.7236995121312619
deviation-heading_median0.6953408166028192
deviation-heading_min0.3118646573709166
driven_any_max1.934434121703833
driven_any_mean0.806757806634148
driven_any_median0.8072381933001392
driven_any_min0.20912585880423715
driven_lanedir_consec_max0.7222251056746308
driven_lanedir_consec_mean0.3962831867516217
driven_lanedir_consec_min0.1917983424483971
driven_lanedir_max0.7287863177121016
driven_lanedir_mean0.3975640776898326
driven_lanedir_median0.2875407694053156
driven_lanedir_min0.1917983424483971
in-drivable-lane_max4.04999999999999
in-drivable-lane_mean1.2133333333333305
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.20204872395618853, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.0651763720684741, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.07178879933184888, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.09836627201861646, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.04017742857875594, "sim_compute_performance-ego": 0.06978640786136489, "sim_compute_robot_state-ego": 0.07504281078476503, "sim_compute_robot_state-npc0": 0.07000184633645666, "sim_compute_robot_state-npc1": 0.06772332306367805, "sim_compute_robot_state-npc2": 0.07040316800037062, "sim_compute_robot_state-npc3": 0.07058901384652379}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.22285815521522803, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.06680311097039117, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07669409999140987, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.10174734504134568, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.04011226583410193, "sim_compute_performance-ego": 0.07145966423882379, "sim_compute_robot_state-ego": 0.08206405463042082, "sim_compute_robot_state-npc0": 0.07474356227450901, "sim_compute_robot_state-npc1": 0.07213204878347891, "sim_compute_robot_state-npc2": 0.07154488563537598, "sim_compute_robot_state-npc3": 0.06705939328228985}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.21712193427941737, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06466294557620318, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.07183351577856602, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.09992774021931183, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.03969674844008226, "sim_compute_performance-ego": 0.068390870705629, "sim_compute_robot_state-ego": 0.07745301112150535, "sim_compute_robot_state-npc0": 0.07039235494075677, "sim_compute_robot_state-npc1": 0.07024763180659367, "sim_compute_robot_state-npc2": 0.06891376238602859, "sim_compute_robot_state-npc3": 0.06908553685897435}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.2192864041579397, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.06466952123140034, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.07059550703617565, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.10006659072742129, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.03773498953434459, "sim_compute_performance-ego": 0.07217405135171455, "sim_compute_robot_state-ego": 0.08181639721519068, "sim_compute_robot_state-npc0": 0.06852327313339501, "sim_compute_robot_state-npc1": 0.06890869977181419, "sim_compute_robot_state-npc2": 0.06959770855150725, "sim_compute_robot_state-npc3": 0.07126471452545702}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.2051898085552713, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.06251264655071756, "in-drivable-lane": 0, "agent_compute-ego": 0.06494187272113303, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.09265865450320036, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.03647579317507536, "sim_compute_performance-ego": 0.0642768092777418, "sim_compute_robot_state-ego": 0.06978556384211002, "sim_compute_robot_state-npc0": 0.06858250369196353, "sim_compute_robot_state-npc1": 0.06930960779604704, "sim_compute_robot_state-npc2": 0.06530074451280676, "sim_compute_robot_state-npc3": 0.07012168220851732}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.20394384159761317, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.06126670977648567, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.07088074497148103, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.09907305240631104, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.037099144038032085, "sim_compute_performance-ego": 0.06549274453929826, "sim_compute_robot_state-ego": 0.07110434186224844, "sim_compute_robot_state-npc0": 0.06511369172264547, "sim_compute_robot_state-npc1": 0.06520662120744294, "sim_compute_robot_state-npc2": 0.06414706800498214, "sim_compute_robot_state-npc3": 0.0649484956965727}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.1919465218271528, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.06156472819192069, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.07038783686501639, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.09740570272718158, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.03904485872813634, "sim_compute_performance-ego": 0.06997947181974139, "sim_compute_robot_state-ego": 0.08045162303107126, "sim_compute_robot_state-npc0": 0.06859081302370344, "sim_compute_robot_state-npc1": 0.06980928182601928, "sim_compute_robot_state-npc2": 0.06975024257387434, "sim_compute_robot_state-npc3": 0.06922389779772077}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.2311331507277815, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.06745429561562734, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07482948041942021, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.10055807518632444, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.04053474452397595, "sim_compute_performance-ego": 0.07385609901114686, "sim_compute_robot_state-ego": 0.08200099370250963, "sim_compute_robot_state-npc0": 0.07359352503737358, "sim_compute_robot_state-npc1": 0.07074425645070533, "sim_compute_robot_state-npc2": 0.07110214233398438, "sim_compute_robot_state-npc3": 0.07169725143746154}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.1932825155036394, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06320269994957503, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.07097979479057845, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.09901137407435928, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.03971795425858608, "sim_compute_performance-ego": 0.07040950586629469, "sim_compute_robot_state-ego": 0.07359482521234556, "sim_compute_robot_state-npc0": 0.06891092865966088, "sim_compute_robot_state-npc1": 0.0703283853309099, "sim_compute_robot_state-npc2": 0.06695412480553915, "sim_compute_robot_state-npc3": 0.06928982291110726}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.2284791377874521, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.06219185315645658, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07221479599292462, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.09435411599966197, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.03921942527477558, "sim_compute_performance-ego": 0.06365133248842679, "sim_compute_robot_state-ego": 0.06851997742286095, "sim_compute_robot_state-npc0": 0.07126058064974271, "sim_compute_robot_state-npc1": 0.06773028006920448, "sim_compute_robot_state-npc2": 0.06825944093557504, "sim_compute_robot_state-npc3": 0.06579113923586331}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.201155055363973, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.06275772094726563, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07228992144266765, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.09600243886311847, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.037888774871826174, "sim_compute_performance-ego": 0.07443917592366536, "sim_compute_robot_state-ego": 0.07518325487772624, "sim_compute_robot_state-npc0": 0.06640404383341471, "sim_compute_robot_state-npc1": 0.06836644808451335, "sim_compute_robot_state-npc2": 0.06890768051147461, "sim_compute_robot_state-npc3": 0.06976501146952312}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.20981756846110025, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.06753140404110863, "in-drivable-lane": 0, "agent_compute-ego": 0.07051539421081543, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.09301380884079706, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.03786404927571615, "sim_compute_performance-ego": 0.06823468208312988, "sim_compute_robot_state-ego": 0.07301688194274902, "sim_compute_robot_state-npc0": 0.06502906481424968, "sim_compute_robot_state-npc1": 0.06629199073428199, "sim_compute_robot_state-npc2": 0.06412952286856514, "sim_compute_robot_state-npc3": 0.07053776014418829}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.20640211881593215, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.06247849797093591, "in-drivable-lane": 1.15, "agent_compute-ego": 0.07100734599800997, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.09526127992674362, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.04012624607529751, "sim_compute_performance-ego": 0.06491185898004576, "sim_compute_robot_state-ego": 0.07524762042733125, "sim_compute_robot_state-npc0": 0.07061430465343387, "sim_compute_robot_state-npc1": 0.0733237765556158, "sim_compute_robot_state-npc2": 0.07327283260434173, "sim_compute_robot_state-npc3": 0.07187013293421546}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.24764427968433925, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.06870360033852714, "in-drivable-lane": 0, "agent_compute-ego": 0.07896651540483747, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.1083064079284668, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.03962474209921701, "sim_compute_performance-ego": 0.07032129594257899, "sim_compute_robot_state-ego": 0.08333944422858101, "sim_compute_robot_state-npc0": 0.07508445637566703, "sim_compute_robot_state-npc1": 0.07525828054973058, "sim_compute_robot_state-npc2": 0.07346803801400321, "sim_compute_robot_state-npc3": 0.07470681837626866}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.20496670405069983, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.0638105027815875, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.06924639496148802, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.09632214845395556, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.037190577563117534, "sim_compute_performance-ego": 0.06788814301584281, "sim_compute_robot_state-ego": 0.06816423640531652, "sim_compute_robot_state-npc0": 0.06879525558621276, "sim_compute_robot_state-npc1": 0.06939285876704197, "sim_compute_robot_state-npc2": 0.07015331118714575, "sim_compute_robot_state-npc3": 0.06634978219574574}}
set_robot_commands_max0.1083064079284668
set_robot_commands_mean0.09813833379445436
set_robot_commands_median0.09836627201861646
set_robot_commands_min0.09265865450320036
sim_compute_performance-ego_max0.07443917592366536
sim_compute_performance-ego_mean0.06901814087369632
sim_compute_performance-ego_median0.06978640786136489
sim_compute_performance-ego_min0.06365133248842679
sim_compute_robot_state-ego_max0.08333944422858101
sim_compute_robot_state-ego_mean0.07578566911378214
sim_compute_robot_state-ego_median0.07518325487772624
sim_compute_robot_state-ego_min0.06816423640531652
sim_compute_robot_state-npc0_max0.07508445637566703
sim_compute_robot_state-npc0_mean0.06970934698221234
sim_compute_robot_state-npc0_median0.06891092865966088
sim_compute_robot_state-npc0_min0.06502906481424968
sim_compute_robot_state-npc1_max0.07525828054973058
sim_compute_robot_state-npc1_mean0.0696515660531385
sim_compute_robot_state-npc1_median0.06939285876704197
sim_compute_robot_state-npc1_min0.06520662120744294
sim_compute_robot_state-npc2_max0.07346803801400321
sim_compute_robot_state-npc2_mean0.06906031152837165
sim_compute_robot_state-npc2_median0.06959770855150725
sim_compute_robot_state-npc2_min0.06412952286856514
sim_compute_robot_state-npc3_max0.07470681837626866
sim_compute_robot_state-npc3_mean0.06948669686136194
sim_compute_robot_state-npc3_median0.06976501146952312
sim_compute_robot_state-npc3_min0.0649484956965727
sim_compute_sim_state_max0.04053474452397595
sim_compute_sim_state_mean0.038833849484736026
sim_compute_sim_state_median0.03921942527477558
sim_compute_sim_state_min0.03647579317507536
sim_physics_max0.24764427968433925
sim_physics_mean0.2123517279989152
sim_physics_median0.20640211881593215
sim_physics_min0.1919465218271528
sim_render-ego_max0.06870360033852714
sim_render-ego_mean0.06431910727777843
sim_render-ego_median0.0638105027815875
sim_render-ego_min0.06126670977648567
simulation-passed1
survival_time_max6.999999999999983
survival_time_mean3.043333333333329
survival_time_min1.0500000000000005
No reset possible
22786step1-simulationhost-erroryes0:00:06
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job22786-636773', 'pull']:

   >  Command '['docker-compose', '-p', 'job22786-636773', 'pull']' returned non-zero exit status 255.

stdout | 

stderr | [3499] Failed to execute script docker-compose
stderr | Traceback (most recent call last):
stderr |   File "bin/docker-compose", line 6, in <module>
stderr |   File "compose/cli/main.py", line 71, in main
stderr |   File "compose/cli/main.py", line 124, in perform_command
stderr |   File "compose/cli/command.py", line 41, in project_from_options
stderr |   File "compose/cli/command.py", line 109, in get_project
stderr |   File "compose/config/config.py", line 283, in find
stderr |   File "compose/config/config.py", line 310, in get_default_config_files
stderr |   File "compose/config/config.py", line 346, in find_candidates_in_parent_dirs
stderr |   File "posixpath.py", line 376, in abspath
stderr | FileNotFoundError: [Errno 2] No such file or directory
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible