Duckietown Challenges Home Challenges Submissions

Submission 4406

Submission4406
Competingyes
Challengeaido3-LFVI-sim-testing
UserAlex Deliyannis
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27456
Next
User labelchallenge-aido_LF-template-tensorflow
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
27456step1-simulationsuccessyes0:12:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2795551659985187
survival_time_median1.2000000000000004
deviation-center-line_median0.07618364157884978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04806144149215133
agent_compute-ego_mean0.030176879558999125
agent_compute-ego_median0.02832242033698342
agent_compute-ego_min0.023949066797892257
deviation-center-line_max0.11800383375771786
deviation-center-line_mean0.07773664056434156
deviation-center-line_min0.03455590973579467
deviation-heading_max0.6311515886396791
deviation-heading_mean0.4077517938757539
deviation-heading_median0.3646194906495098
deviation-heading_min0.22943698932236695
driven_any_max0.6705813795081413
driven_any_mean0.3387933925876979
driven_any_median0.3330011970388789
driven_any_min0.19030641371341508
driven_lanedir_consec_max0.639906024994362
driven_lanedir_consec_mean0.2964464452906377
driven_lanedir_consec_min0.14882044785362014
driven_lanedir_max0.639906024994362
driven_lanedir_mean0.2964464452906377
driven_lanedir_median0.2795551659985187
driven_lanedir_min0.14882044785362014
in-drivable-lane_max0.05000000000000005
in-drivable-lane_mean0.013333333333333345
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.3071272942136437, "sim_physics": 0.21235549891436545, "survival_time": 1.3500000000000003, "driven_lanedir": 0.25991488756390124, "sim_render-ego": 0.012934967323585792, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.04806144149215133, "deviation-heading": 0.4905994086628098, "set_robot_commands": 0.00882765981886122, "deviation-center-line": 0.05918729127145211, "driven_lanedir_consec": 0.25991488756390124, "sim_compute_sim_state": 0.005034225958364981, "sim_compute_performance-ego": 0.007466828381573713, "sim_compute_robot_state-ego": 0.009516106711493598, "sim_compute_robot_state-npc0": 0.009011922059235749, "sim_compute_robot_state-npc1": 0.008316260797006113, "sim_compute_robot_state-npc2": 0.008228434456719292, "sim_compute_robot_state-npc3": 0.007997980824223271}, "udem1-1-0": {"driven_any": 0.2544480531256927, "sim_physics": 0.1872285320645287, "survival_time": 1.0500000000000005, "driven_lanedir": 0.19337139559568595, "sim_render-ego": 0.012724513099307106, "in-drivable-lane": 0, "agent_compute-ego": 0.030206714357648577, "deviation-heading": 0.5131550223179785, "set_robot_commands": 0.009634596960885184, "deviation-center-line": 0.06694295127349545, "driven_lanedir_consec": 0.19337139559568595, "sim_compute_sim_state": 0.0051061539422898065, "sim_compute_performance-ego": 0.00715750739687965, "sim_compute_robot_state-ego": 0.00843351227896554, "sim_compute_robot_state-npc0": 0.009196315492902484, "sim_compute_robot_state-npc1": 0.008390506108601889, "sim_compute_robot_state-npc2": 0.008976232437860398, "sim_compute_robot_state-npc3": 0.008216142654418945}, "udem1-2-0": {"driven_any": 0.282860252789071, "sim_physics": 0.1471120896546737, "survival_time": 1.1500000000000004, "driven_lanedir": 0.19231705686451803, "sim_render-ego": 0.011460055475649626, "in-drivable-lane": 0, "agent_compute-ego": 0.025259225264839504, "deviation-heading": 0.6311515886396791, "set_robot_commands": 0.007923395737357761, "deviation-center-line": 0.0850196120688673, "driven_lanedir_consec": 0.19231705686451803, "sim_compute_sim_state": 0.004629352818364682, "sim_compute_performance-ego": 0.006694928459499193, "sim_compute_robot_state-ego": 0.007884087769881538, "sim_compute_robot_state-npc0": 0.008174595625504204, "sim_compute_robot_state-npc1": 0.007504546124002208, "sim_compute_robot_state-npc2": 0.007271984349126401, "sim_compute_robot_state-npc3": 0.007363588913627293}, "udem1-3-0": {"driven_any": 0.6705813795081413, "sim_physics": 0.17803614789789374, "survival_time": 2.2, "driven_lanedir": 0.639906024994362, "sim_render-ego": 0.013369170102206144, "in-drivable-lane": 0, "agent_compute-ego": 0.02832242033698342, "deviation-heading": 0.5938669384498377, "set_robot_commands": 0.00938060608777133, "deviation-center-line": 0.11800383375771786, "driven_lanedir_consec": 0.639906024994362, "sim_compute_sim_state": 0.004961517724123868, "sim_compute_performance-ego": 0.0079702843319286, "sim_compute_robot_state-ego": 0.008744093504819002, "sim_compute_robot_state-npc0": 0.009531931443647904, "sim_compute_robot_state-npc1": 0.008648688142949884, "sim_compute_robot_state-npc2": 0.008336701176383278, "sim_compute_robot_state-npc3": 0.008426709608598188}, "udem1-4-0": {"driven_any": 0.3489658697767026, "sim_physics": 0.18222174793481827, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3220103856144114, "sim_render-ego": 0.011793985962867737, "in-drivable-lane": 0, "agent_compute-ego": 0.02589987963438034, "deviation-heading": 0.4794786058228539, "set_robot_commands": 0.008340217173099518, "deviation-center-line": 0.06684673982237468, "driven_lanedir_consec": 0.3220103856144114, "sim_compute_sim_state": 0.005084052681922913, "sim_compute_performance-ego": 0.006728924810886383, "sim_compute_robot_state-ego": 0.008298568427562714, "sim_compute_robot_state-npc0": 0.008498229086399078, "sim_compute_robot_state-npc1": 0.00816076248884201, "sim_compute_robot_state-npc2": 0.007829181849956512, "sim_compute_robot_state-npc3": 0.007974006235599518}, "udem1-5-0": {"driven_any": 0.19250419004726904, "sim_physics": 0.200674401389228, "survival_time": 0.9000000000000002, "driven_lanedir": 0.14882044785362014, "sim_render-ego": 0.014785289764404295, "in-drivable-lane": 0, "agent_compute-ego": 0.02919128206041124, "deviation-heading": 0.3572465764031597, "set_robot_commands": 0.00989924536810981, "deviation-center-line": 0.03455590973579467, "driven_lanedir_consec": 0.14882044785362014, "sim_compute_sim_state": 0.005239658885531955, "sim_compute_performance-ego": 0.009675065676371256, "sim_compute_robot_state-ego": 0.00981797112358941, "sim_compute_robot_state-npc0": 0.009076250924004449, "sim_compute_robot_state-npc1": 0.008643097347683378, "sim_compute_robot_state-npc2": 0.009191526307000054, "sim_compute_robot_state-npc3": 0.009115470780266656}, "udem1-6-0": {"driven_any": 0.19030641371341508, "sim_physics": 0.18308267328474256, "survival_time": 0.9000000000000002, "driven_lanedir": 0.168104096229575, "sim_render-ego": 0.011394182840983072, "in-drivable-lane": 0, "agent_compute-ego": 0.023949066797892257, "deviation-heading": 0.34184386010074996, "set_robot_commands": 0.007882515589396158, "deviation-center-line": 0.08089575324626212, "driven_lanedir_consec": 0.168104096229575, "sim_compute_sim_state": 0.0044809447394477, "sim_compute_performance-ego": 0.006572326024373372, "sim_compute_robot_state-ego": 0.00779422124226888, "sim_compute_robot_state-npc0": 0.00849196645948622, "sim_compute_robot_state-npc1": 0.008234408166673448, "sim_compute_robot_state-npc2": 0.00740255249871148, "sim_compute_robot_state-npc3": 0.007984214358859591}, "udem1-7-0": {"driven_any": 0.4159976706245679, "sim_physics": 0.2187538941701253, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4027155018678994, "sim_render-ego": 0.012764515700163664, "in-drivable-lane": 0, "agent_compute-ego": 0.0417154453418873, "deviation-heading": 0.235850683338665, "set_robot_commands": 0.010420331248530637, "deviation-center-line": 0.097979707779112, "driven_lanedir_consec": 0.4027155018678994, "sim_compute_sim_state": 0.00546176345260055, "sim_compute_performance-ego": 0.007999870512220595, "sim_compute_robot_state-ego": 0.009317380410653574, "sim_compute_robot_state-npc0": 0.009494710851598668, "sim_compute_robot_state-npc1": 0.008656793170505099, "sim_compute_robot_state-npc2": 0.008190702508997035, "sim_compute_robot_state-npc3": 0.008381843566894531}, "udem1-8-0": {"driven_any": 0.3807571958621921, "sim_physics": 0.17735541783846345, "survival_time": 1.3000000000000005, "driven_lanedir": 0.31207888349116875, "sim_render-ego": 0.013310725872333232, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.02869560168339656, "deviation-heading": 0.44409873663062144, "set_robot_commands": 0.008777820147000827, "deviation-center-line": 0.09269907860089512, "driven_lanedir_consec": 0.31207888349116875, "sim_compute_sim_state": 0.004998390491192157, "sim_compute_performance-ego": 0.0076827727831327, "sim_compute_robot_state-ego": 0.00966789172245906, "sim_compute_robot_state-npc0": 0.008898780896113468, "sim_compute_robot_state-npc1": 0.009018127734844502, "sim_compute_robot_state-npc2": 0.008397212395301232, "sim_compute_robot_state-npc3": 0.00875091552734375}, "udem1-9-0": {"driven_any": 0.3330011970388789, "sim_physics": 0.19972631335258484, "survival_time": 1.2000000000000004, "driven_lanedir": 0.2795551659985187, "sim_render-ego": 0.013691633939743042, "in-drivable-lane": 0, "agent_compute-ego": 0.03102758526802063, "deviation-heading": 0.47750046377285704, "set_robot_commands": 0.010450581709543863, "deviation-center-line": 0.08108314376325604, "driven_lanedir_consec": 0.2795551659985187, "sim_compute_sim_state": 0.00505329171816508, "sim_compute_performance-ego": 0.00822332501411438, "sim_compute_robot_state-ego": 0.009812285502751667, "sim_compute_robot_state-npc0": 0.009342700242996216, "sim_compute_robot_state-npc1": 0.009109477202097574, "sim_compute_robot_state-npc2": 0.010000338157018026, "sim_compute_robot_state-npc3": 0.008637348810831705}, "udem1-10-0": {"driven_any": 0.2792534818738551, "sim_physics": 0.1743490319502981, "survival_time": 0.9500000000000004, "driven_lanedir": 0.23087785377771475, "sim_render-ego": 0.02504711402089972, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0259397029876709, "deviation-heading": 0.3559117935475423, "set_robot_commands": 0.008616786254079719, "deviation-center-line": 0.050965066350438896, "driven_lanedir_consec": 0.23087785377771475, "sim_compute_sim_state": 0.004997153031198602, "sim_compute_performance-ego": 0.0070877702612625925, "sim_compute_robot_state-ego": 0.008823419872083162, "sim_compute_robot_state-npc0": 0.008806052960847554, "sim_compute_robot_state-npc1": 0.008904030448512026, "sim_compute_robot_state-npc2": 0.007836781050029554, "sim_compute_robot_state-npc3": 0.008129634355243883}, "udem1-11-0": {"driven_any": 0.41915854899433874, "sim_physics": 0.18646467208862305, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3714197470746705, "sim_render-ego": 0.014174270629882812, "in-drivable-lane": 0, "agent_compute-ego": 0.027326984405517576, "deviation-heading": 0.3646194906495098, "set_robot_commands": 0.009091520309448242, "deviation-center-line": 0.07618364157884978, "driven_lanedir_consec": 0.3714197470746705, "sim_compute_sim_state": 0.004558353424072265, "sim_compute_performance-ego": 0.008293657302856446, "sim_compute_robot_state-ego": 0.009087104797363282, "sim_compute_robot_state-npc0": 0.009166393280029297, "sim_compute_robot_state-npc1": 0.00811823844909668, "sim_compute_robot_state-npc2": 0.007800827026367188, "sim_compute_robot_state-npc3": 0.007940454483032227}, "udem1-12-0": {"driven_any": 0.2405990946910299, "sim_physics": 0.1689403322007921, "survival_time": 0.9000000000000002, "driven_lanedir": 0.2182596317196777, "sim_render-ego": 0.013394382264879014, "in-drivable-lane": 0, "agent_compute-ego": 0.03233264552222358, "deviation-heading": 0.24449650562514685, "set_robot_commands": 0.010190142525566949, "deviation-center-line": 0.07324822794482395, "driven_lanedir_consec": 0.2182596317196777, "sim_compute_sim_state": 0.00486547417110867, "sim_compute_performance-ego": 0.007630361451043023, "sim_compute_robot_state-ego": 0.00948708587222629, "sim_compute_robot_state-npc0": 0.012080457475450303, "sim_compute_robot_state-npc1": 0.009604109658135308, "sim_compute_robot_state-npc2": 0.009032342169019911, "sim_compute_robot_state-npc3": 0.009903722339206273}, "udem1-13-0": {"driven_any": 0.3849724984887537, "sim_physics": 0.21770823001861572, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3642710662997448, "sim_render-ego": 0.015194253488020464, "in-drivable-lane": 0, "agent_compute-ego": 0.027940425005826084, "deviation-heading": 0.35702024485252987, "set_robot_commands": 0.008579709313132546, "deviation-center-line": 0.0689025737687907, "driven_lanedir_consec": 0.3642710662997448, "sim_compute_sim_state": 0.005079215223138983, "sim_compute_performance-ego": 0.00859998572956432, "sim_compute_robot_state-ego": 0.010086796500466087, "sim_compute_robot_state-npc0": 0.00882123817097057, "sim_compute_robot_state-npc1": 0.008051688020879572, "sim_compute_robot_state-npc2": 0.008423577655445446, "sim_compute_robot_state-npc3": 0.008668563582680443}, "udem1-14-0": {"driven_any": 0.3813677480679174, "sim_physics": 0.23518197624771683, "survival_time": 1.3500000000000003, "driven_lanedir": 0.34307453441409685, "sim_render-ego": 0.012769063313802084, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.026784773226137513, "deviation-heading": 0.22943698932236695, "set_robot_commands": 0.009247541427612305, "deviation-center-line": 0.11353607750299254, "driven_lanedir_consec": 0.34307453441409685, "sim_compute_sim_state": 0.005392781010380498, "sim_compute_performance-ego": 0.007993168301052518, "sim_compute_robot_state-ego": 0.008335837611445674, "sim_compute_robot_state-npc0": 0.008439938227335611, "sim_compute_robot_state-npc1": 0.008804859938444915, "sim_compute_robot_state-npc2": 0.009261722917909975, "sim_compute_robot_state-npc3": 0.007681051890055339}}
set_robot_commands_max0.010450581709543863
set_robot_commands_mean0.00915084464469307
set_robot_commands_median0.009091520309448242
set_robot_commands_min0.007882515589396158
sim_compute_performance-ego_max0.009675065676371256
sim_compute_performance-ego_mean0.007718451762450582
sim_compute_performance-ego_median0.0076827727831327
sim_compute_performance-ego_min0.006572326024373372
sim_compute_robot_state-ego_max0.010086796500466087
sim_compute_robot_state-ego_mean0.009007090889868634
sim_compute_robot_state-ego_median0.009087104797363282
sim_compute_robot_state-ego_min0.00779422124226888
sim_compute_robot_state-npc0_max0.012080457475450303
sim_compute_robot_state-npc0_mean0.009135432213101452
sim_compute_robot_state-npc0_median0.009011922059235749
sim_compute_robot_state-npc0_min0.008174595625504204
sim_compute_robot_state-npc1_max0.009604109658135308
sim_compute_robot_state-npc1_mean0.008544372919884973
sim_compute_robot_state-npc1_median0.008643097347683378
sim_compute_robot_state-npc1_min0.007504546124002208
sim_compute_robot_state-npc2_max0.010000338157018026
sim_compute_robot_state-npc2_mean0.008412007797056385
sim_compute_robot_state-npc2_median0.008336701176383278
sim_compute_robot_state-npc2_min0.007271984349126401
sim_compute_robot_state-npc3_max0.009903722339206273
sim_compute_robot_state-npc3_mean0.008344776528725442
sim_compute_robot_state-npc3_median0.008216142654418945
sim_compute_robot_state-npc3_min0.007363588913627293
sim_compute_sim_state_max0.00546176345260055
sim_compute_sim_state_mean0.004996155284793513
sim_compute_sim_state_median0.005034225958364981
sim_compute_sim_state_min0.0044809447394477
sim_physics_max0.23518197624771683
sim_physics_mean0.19127939726716467
sim_physics_median0.18646467208862305
sim_physics_min0.1471120896546737
sim_render-ego_max0.02504711402089972
sim_render-ego_mean0.013920541586581856
sim_render-ego_median0.013310725872333232
sim_render-ego_min0.011394182840983072
simulation-passed1
survival_time_max2.2
survival_time_mean1.2366666666666672
survival_time_min0.9000000000000002
No reset possible
27455step1-simulationsuccessyes0:11:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25855step1-simulationerrorno0:09:18
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25182step1-simulationsuccessno0:13:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible