AI Driving Olympics Home Challenges Submissions Jobs

Submission 2451

Submission2451
Competingyes
Challengeaido2-LFVI-sim-validation
Userenicky
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22965
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessing50
User priority

22965

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
229652451enickyBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationsuccessyes-0:35:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.339803295303147
survival_time_median14.950000000000076
deviation-center-line_median1.0021347592871723
in-drivable-lane_median4.050000000000024


other stats
agent_compute-ego_max0.16164000272750856
agent_compute-ego_mean0.15610354566574097
agent_compute-ego_median0.1540182638168335
agent_compute-ego_min0.1513586123784383
deviation-center-line_max1.5296442281508644
deviation-center-line_mean0.9253718574185378
deviation-center-line_min0.2826196070981827
deviation-heading_max8.558153948461719
deviation-heading_mean7.098260242116498
deviation-heading_median7.090641611385008
deviation-heading_min5.695926383403844
driven_any_max4.3785064440528245
driven_any_mean4.378506444052816
driven_any_median4.378506444052819
driven_any_min4.378506444052804
driven_lanedir_consec_max-1.272834629261013
driven_lanedir_consec_mean-1.3313573411979192
driven_lanedir_consec_min-1.3670060414727203
driven_lanedir_max-1.366266842110191
driven_lanedir_mean-2.078204689886424
driven_lanedir_median-2.260643253811775
driven_lanedir_min-2.710754983563031
in-drivable-lane_max7.400000000000039
in-drivable-lane_mean4.620000000000026
in-drivable-lane_min2.150000000000011
per-episodes
details{"udem1-0-0": {"driven_any": 4.378506444052811, "sim_physics": 0.16945639848709107, "survival_time": 14.950000000000076, "driven_lanedir": -2.710754983563031, "sim_render-ego": 0.05819206953048706, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.1513586123784383, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.08639689366022746, "deviation-center-line": 1.5195321584534802, "driven_lanedir_consec": -1.3108758978425243, "sim_compute_sim_state": 0.03571542819341024, "sim_compute_performance-ego": 0.06123533646265666, "sim_compute_robot_state-ego": 0.06555419365564982, "sim_compute_robot_state-npc0": 0.062415278752644854, "sim_compute_robot_state-npc1": 0.06303441445032755, "sim_compute_robot_state-npc2": 0.06254379431406656, "sim_compute_robot_state-npc3": 0.061077833970387775}, "udem1-1-0": {"driven_any": 4.3785064440528245, "sim_physics": 0.1963050842285156, "survival_time": 14.950000000000076, "driven_lanedir": -2.686352328474403, "sim_render-ego": 0.06244195063908895, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.16164000272750856, "deviation-heading": 8.558153948461719, "set_robot_commands": 0.09260231733322144, "deviation-center-line": 1.5296442281508644, "driven_lanedir_consec": -1.272834629261013, "sim_compute_sim_state": 0.03846120834350586, "sim_compute_performance-ego": 0.0677091670036316, "sim_compute_robot_state-ego": 0.07323710282643636, "sim_compute_robot_state-npc0": 0.06724067529042561, "sim_compute_robot_state-npc1": 0.06775244156519572, "sim_compute_robot_state-npc2": 0.06679384152094524, "sim_compute_robot_state-npc3": 0.06824360211690267}, "udem1-2-0": {"driven_any": 4.378506444052804, "sim_physics": 0.18989391009012857, "survival_time": 14.950000000000076, "driven_lanedir": -1.366266842110191, "sim_render-ego": 0.0632138458887736, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.16144652446111044, "deviation-heading": 5.773684892471283, "set_robot_commands": 0.08892913262049357, "deviation-center-line": 0.29292853410298886, "driven_lanedir_consec": -1.366266842110191, "sim_compute_sim_state": 0.03933207432428996, "sim_compute_performance-ego": 0.06654704729715984, "sim_compute_robot_state-ego": 0.0708387041091919, "sim_compute_robot_state-npc0": 0.06876530408859254, "sim_compute_robot_state-npc1": 0.06705504814783732, "sim_compute_robot_state-npc2": 0.06762919743855794, "sim_compute_robot_state-npc3": 0.06814869006474812}, "udem1-3-0": {"driven_any": 4.3785064440528245, "sim_physics": 0.18457745790481567, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670060414727203, "sim_render-ego": 0.05885006825129191, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.1540182638168335, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.0852444338798523, "deviation-center-line": 0.2826196070981827, "driven_lanedir_consec": -1.3670060414727203, "sim_compute_sim_state": 0.03720717748006185, "sim_compute_performance-ego": 0.06571757634480795, "sim_compute_robot_state-ego": 0.0673143990834554, "sim_compute_robot_state-npc0": 0.064660009543101, "sim_compute_robot_state-npc1": 0.06520589749018352, "sim_compute_robot_state-npc2": 0.06374581098556518, "sim_compute_robot_state-npc3": 0.06520259459813436}, "udem1-4-0": {"driven_any": 4.378506444052819, "sim_physics": 0.1780240519841512, "survival_time": 14.950000000000076, "driven_lanedir": -2.260643253811775, "sim_render-ego": 0.05824246724446615, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.15205432494481405, "deviation-heading": 7.090641611385008, "set_robot_commands": 0.08677097241083781, "deviation-center-line": 1.0021347592871723, "driven_lanedir_consec": -1.339803295303147, "sim_compute_sim_state": 0.03556403954823812, "sim_compute_performance-ego": 0.062419451872507734, "sim_compute_robot_state-ego": 0.06781713008880615, "sim_compute_robot_state-npc0": 0.06343355655670166, "sim_compute_robot_state-npc1": 0.06446100870768229, "sim_compute_robot_state-npc2": 0.0638701581954956, "sim_compute_robot_state-npc3": 0.06762945731480917}}
set_robot_commands_max0.09260231733322144
set_robot_commands_mean0.08798874998092651
set_robot_commands_median0.08677097241083781
set_robot_commands_min0.0852444338798523
sim_compute_performance-ego_max0.0677091670036316
sim_compute_performance-ego_mean0.06472571579615276
sim_compute_performance-ego_median0.06571757634480795
sim_compute_performance-ego_min0.06123533646265666
sim_compute_robot_state-ego_max0.07323710282643636
sim_compute_robot_state-ego_mean0.06895230595270793
sim_compute_robot_state-ego_median0.06781713008880615
sim_compute_robot_state-ego_min0.06555419365564982
sim_compute_robot_state-npc0_max0.06876530408859254
sim_compute_robot_state-npc0_mean0.06530296484629314
sim_compute_robot_state-npc0_median0.064660009543101
sim_compute_robot_state-npc0_min0.062415278752644854
sim_compute_robot_state-npc1_max0.06775244156519572
sim_compute_robot_state-npc1_mean0.06550176207224527
sim_compute_robot_state-npc1_median0.06520589749018352
sim_compute_robot_state-npc1_min0.06303441445032755
sim_compute_robot_state-npc2_max0.06762919743855794
sim_compute_robot_state-npc2_mean0.06491656049092612
sim_compute_robot_state-npc2_median0.0638701581954956
sim_compute_robot_state-npc2_min0.06254379431406656
sim_compute_robot_state-npc3_max0.06824360211690267
sim_compute_robot_state-npc3_mean0.06606043561299643
sim_compute_robot_state-npc3_median0.06762945731480917
sim_compute_robot_state-npc3_min0.061077833970387775
sim_compute_sim_state_max0.03933207432428996
sim_compute_sim_state_mean0.0372559855779012
sim_compute_sim_state_median0.03720717748006185
sim_compute_sim_state_min0.03556403954823812
sim_physics_max0.1963050842285156
sim_physics_mean0.1836513805389404
sim_physics_median0.18457745790481567
sim_physics_min0.16945639848709107
sim_render-ego_max0.0632138458887736
sim_render-ego_mean0.06018808031082153
sim_render-ego_median0.05885006825129191
sim_render-ego_min0.05819206953048706
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
212772451enickyBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationsuccessno-0:38:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.339803295303147
survival_time_median14.950000000000076
deviation-center-line_median1.0021347592871723
in-drivable-lane_median4.050000000000024


other stats
agent_compute-ego_max0.17758076747258503
agent_compute-ego_mean0.172267670472463
agent_compute-ego_median0.17029441833496095
agent_compute-ego_min0.16879486163457236
deviation-center-line_max1.5296442281508644
deviation-center-line_mean0.9253718574185378
deviation-center-line_min0.2826196070981827
deviation-heading_max8.558153948461719
deviation-heading_mean7.098260242116498
deviation-heading_median7.090641611385008
deviation-heading_min5.695926383403844
driven_any_max4.3785064440528245
driven_any_mean4.378506444052816
driven_any_median4.378506444052819
driven_any_min4.378506444052804
driven_lanedir_consec_max-1.272834629261013
driven_lanedir_consec_mean-1.3313573411979192
driven_lanedir_consec_min-1.3670060414727203
driven_lanedir_max-1.366266842110191
driven_lanedir_mean-2.078204689886424
driven_lanedir_median-2.260643253811775
driven_lanedir_min-2.710754983563031
in-drivable-lane_max7.400000000000039
in-drivable-lane_mean4.620000000000026
in-drivable-lane_min2.150000000000011
per-episodes
details{"udem1-0-0": {"driven_any": 4.378506444052811, "sim_physics": 0.203141983350118, "survival_time": 14.950000000000076, "driven_lanedir": -2.710754983563031, "sim_render-ego": 0.06208456516265869, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.16879486163457236, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.09466029485066732, "deviation-center-line": 1.5195321584534802, "driven_lanedir_consec": -1.3108758978425243, "sim_compute_sim_state": 0.037478826840718585, "sim_compute_performance-ego": 0.06770330746968588, "sim_compute_robot_state-ego": 0.07313406626383463, "sim_compute_robot_state-npc0": 0.06960581382115683, "sim_compute_robot_state-npc1": 0.06809587399164836, "sim_compute_robot_state-npc2": 0.06767730951309205, "sim_compute_robot_state-npc3": 0.06636643091837566}, "udem1-1-0": {"driven_any": 4.3785064440528245, "sim_physics": 0.203884060382843, "survival_time": 14.950000000000076, "driven_lanedir": -2.686352328474403, "sim_render-ego": 0.06407248099644978, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.17006123622258504, "deviation-heading": 8.558153948461719, "set_robot_commands": 0.09518556753794352, "deviation-center-line": 1.5296442281508644, "driven_lanedir_consec": -1.272834629261013, "sim_compute_sim_state": 0.03788942019144694, "sim_compute_performance-ego": 0.0678753678003947, "sim_compute_robot_state-ego": 0.07465665737787883, "sim_compute_robot_state-npc0": 0.06761240720748901, "sim_compute_robot_state-npc1": 0.06746689478556316, "sim_compute_robot_state-npc2": 0.06767552455266317, "sim_compute_robot_state-npc3": 0.06802085320154826}, "udem1-2-0": {"driven_any": 4.378506444052804, "sim_physics": 0.20752505222956336, "survival_time": 14.950000000000076, "driven_lanedir": -1.366266842110191, "sim_render-ego": 0.06365104993184408, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.1746070686976115, "deviation-heading": 5.773684892471283, "set_robot_commands": 0.09430215120315552, "deviation-center-line": 0.29292853410298886, "driven_lanedir_consec": -1.366266842110191, "sim_compute_sim_state": 0.038837127685546875, "sim_compute_performance-ego": 0.07072963078816731, "sim_compute_robot_state-ego": 0.07656989494959514, "sim_compute_robot_state-npc0": 0.06843528906504313, "sim_compute_robot_state-npc1": 0.06917525370915731, "sim_compute_robot_state-npc2": 0.06873882452646891, "sim_compute_robot_state-npc3": 0.06913760185241699}, "udem1-3-0": {"driven_any": 4.3785064440528245, "sim_physics": 0.21079436620076497, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670060414727203, "sim_render-ego": 0.06595102707544963, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.17758076747258503, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.09798405170440674, "deviation-center-line": 0.2826196070981827, "driven_lanedir_consec": -1.3670060414727203, "sim_compute_sim_state": 0.03944645484288534, "sim_compute_performance-ego": 0.0706774107615153, "sim_compute_robot_state-ego": 0.07665729920069377, "sim_compute_robot_state-npc0": 0.07009818871816, "sim_compute_robot_state-npc1": 0.07105316400527954, "sim_compute_robot_state-npc2": 0.06973730166753134, "sim_compute_robot_state-npc3": 0.0698374080657959}, "udem1-4-0": {"driven_any": 4.378506444052819, "sim_physics": 0.20174871603647868, "survival_time": 14.950000000000076, "driven_lanedir": -2.260643253811775, "sim_render-ego": 0.06294791062672933, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.17029441833496095, "deviation-heading": 7.090641611385008, "set_robot_commands": 0.09753276109695434, "deviation-center-line": 1.0021347592871723, "driven_lanedir_consec": -1.339803295303147, "sim_compute_sim_state": 0.04025226593017578, "sim_compute_performance-ego": 0.06899211883544921, "sim_compute_robot_state-ego": 0.07599391222000122, "sim_compute_robot_state-npc0": 0.06871889352798462, "sim_compute_robot_state-npc1": 0.06976297775904337, "sim_compute_robot_state-npc2": 0.07100912809371948, "sim_compute_robot_state-npc3": 0.07048407793045045}}
set_robot_commands_max0.09798405170440674
set_robot_commands_mean0.09593296527862548
set_robot_commands_median0.09518556753794352
set_robot_commands_min0.09430215120315552
sim_compute_performance-ego_max0.07072963078816731
sim_compute_performance-ego_mean0.06919556713104248
sim_compute_performance-ego_median0.06899211883544921
sim_compute_performance-ego_min0.06770330746968588
sim_compute_robot_state-ego_max0.07665729920069377
sim_compute_robot_state-ego_mean0.07540236600240072
sim_compute_robot_state-ego_median0.07599391222000122
sim_compute_robot_state-ego_min0.07313406626383463
sim_compute_robot_state-npc0_max0.07009818871816
sim_compute_robot_state-npc0_mean0.06889411846796671
sim_compute_robot_state-npc0_median0.06871889352798462
sim_compute_robot_state-npc0_min0.06761240720748901
sim_compute_robot_state-npc1_max0.07105316400527954
sim_compute_robot_state-npc1_mean0.06911083285013835
sim_compute_robot_state-npc1_median0.06917525370915731
sim_compute_robot_state-npc1_min0.06746689478556316
sim_compute_robot_state-npc2_max0.07100912809371948
sim_compute_robot_state-npc2_mean0.068967617670695
sim_compute_robot_state-npc2_median0.06873882452646891
sim_compute_robot_state-npc2_min0.06767552455266317
sim_compute_robot_state-npc3_max0.07048407793045045
sim_compute_robot_state-npc3_mean0.06876927439371745
sim_compute_robot_state-npc3_median0.06913760185241699
sim_compute_robot_state-npc3_min0.06636643091837566
sim_compute_sim_state_max0.04025226593017578
sim_compute_sim_state_mean0.0387808190981547
sim_compute_sim_state_median0.038837127685546875
sim_compute_sim_state_min0.037478826840718585
sim_physics_max0.21079436620076497
sim_physics_mean0.2054188356399536
sim_physics_median0.203884060382843
sim_physics_min0.20174871603647868
sim_render-ego_max0.06595102707544963
sim_render-ego_mean0.0637414067586263
sim_render-ego_median0.06365104993184408
sim_render-ego_min0.06208456516265869
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
212612451enickyBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationhost-errorno-0:30:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2451/step1-simulation-ip-172-31-42-167-7227-job21261/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
205532451enickyBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationsuccessno-0:37:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.3401138062222346
survival_time_median14.950000000000076
deviation-center-line_median1.0020906406379184
in-drivable-lane_median4.050000000000024


other stats
agent_compute-ego_max0.16332919279734293
agent_compute-ego_mean0.16154538631439208
agent_compute-ego_median0.16226433118184408
agent_compute-ego_min0.15904266436894737
deviation-center-line_max1.5200592903810726
deviation-center-line_mean0.9234183234449912
deviation-center-line_min0.28265732013386635
deviation-heading_max8.488415384770875
deviation-heading_mean7.083018992579007
deviation-heading_median7.089126128887597
deviation-heading_min5.694184625828925
driven_any_max4.378320939674843
driven_any_mean4.378320939674839
driven_any_median4.378320939674839
driven_any_min4.378320939674832
driven_lanedir_consec_max-1.2731239579032123
driven_lanedir_consec_mean-1.331671690718409
driven_lanedir_consec_min-1.3673592918445536
driven_lanedir_max-1.366645308459499
driven_lanedir_mean-2.07783178706321
driven_lanedir_median-2.2611460594308452
driven_lanedir_min-2.711272030505655
in-drivable-lane_max7.400000000000039
in-drivable-lane_mean4.630000000000026
in-drivable-lane_min2.150000000000011
per-episodes
details{"udem1-0-0": {"driven_any": 4.378320939674843, "sim_physics": 0.1953042960166931, "survival_time": 14.950000000000076, "driven_lanedir": -2.711272030505655, "sim_render-ego": 0.06107684850692749, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.16226433118184408, "deviation-heading": 8.371542541054898, "set_robot_commands": 0.09057140429814656, "deviation-center-line": 1.5194332899756515, "driven_lanedir_consec": -1.3111160891625455, "sim_compute_sim_state": 0.037815741697947186, "sim_compute_performance-ego": 0.06676226933797201, "sim_compute_robot_state-ego": 0.06868514855702718, "sim_compute_robot_state-npc0": 0.06540701150894165, "sim_compute_robot_state-npc1": 0.06587793906529744, "sim_compute_robot_state-npc2": 0.06587167819341024, "sim_compute_robot_state-npc3": 0.06642692724863689}, "udem1-1-0": {"driven_any": 4.378320939674842, "sim_physics": 0.20796398401260377, "survival_time": 14.950000000000076, "driven_lanedir": -2.682736245075499, "sim_render-ego": 0.060955193837483726, "in-drivable-lane": 2.2000000000000113, "agent_compute-ego": 0.16332919279734293, "deviation-heading": 8.488415384770875, "set_robot_commands": 0.09121515353520712, "deviation-center-line": 1.5200592903810726, "driven_lanedir_consec": -1.2731239579032123, "sim_compute_sim_state": 0.03795449813206991, "sim_compute_performance-ego": 0.0660978897412618, "sim_compute_robot_state-ego": 0.06918162743250529, "sim_compute_robot_state-npc0": 0.06606880346934, "sim_compute_robot_state-npc1": 0.06728325843811035, "sim_compute_robot_state-npc2": 0.06594645579655965, "sim_compute_robot_state-npc3": 0.06734838088353474}, "udem1-2-0": {"driven_any": 4.378320939674832, "sim_physics": 0.1894840915997823, "survival_time": 14.950000000000076, "driven_lanedir": -1.366645308459499, "sim_render-ego": 0.06135841210683187, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.16257554054260254, "deviation-heading": 5.771826282352732, "set_robot_commands": 0.09190938393274944, "deviation-center-line": 0.2928510760964476, "driven_lanedir_consec": -1.366645308459499, "sim_compute_sim_state": 0.04068568547566732, "sim_compute_performance-ego": 0.06690142790476482, "sim_compute_robot_state-ego": 0.07030516465504964, "sim_compute_robot_state-npc0": 0.06635961373647054, "sim_compute_robot_state-npc1": 0.06726239760716757, "sim_compute_robot_state-npc2": 0.06815449873606363, "sim_compute_robot_state-npc3": 0.06859435637791951}, "udem1-3-0": {"driven_any": 4.378320939674839, "sim_physics": 0.19944446245829264, "survival_time": 14.950000000000076, "driven_lanedir": -1.3673592918445536, "sim_render-ego": 0.06004930337270101, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.15904266436894737, "deviation-heading": 5.694184625828925, "set_robot_commands": 0.09189359982808432, "deviation-center-line": 0.28265732013386635, "driven_lanedir_consec": -1.3673592918445536, "sim_compute_sim_state": 0.03812280972798665, "sim_compute_performance-ego": 0.06684209108352661, "sim_compute_robot_state-ego": 0.07025696436564127, "sim_compute_robot_state-npc0": 0.0672758412361145, "sim_compute_robot_state-npc1": 0.066143426100413, "sim_compute_robot_state-npc2": 0.06565173784891765, "sim_compute_robot_state-npc3": 0.06572386741638184}, "udem1-4-0": {"driven_any": 4.378320939674835, "sim_physics": 0.20053547143936157, "survival_time": 14.950000000000076, "driven_lanedir": -2.2611460594308452, "sim_render-ego": 0.05961623112360637, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.16051520268122357, "deviation-heading": 7.089126128887597, "set_robot_commands": 0.09160345395406087, "deviation-center-line": 1.0020906406379184, "driven_lanedir_consec": -1.3401138062222346, "sim_compute_sim_state": 0.037382040023803714, "sim_compute_performance-ego": 0.06553608099619547, "sim_compute_robot_state-ego": 0.06881665865580242, "sim_compute_robot_state-npc0": 0.06712471882502238, "sim_compute_robot_state-npc1": 0.0665452774365743, "sim_compute_robot_state-npc2": 0.06711453119913736, "sim_compute_robot_state-npc3": 0.06685847997665405}}
set_robot_commands_max0.09190938393274944
set_robot_commands_mean0.09143859910964966
set_robot_commands_median0.09160345395406087
set_robot_commands_min0.09057140429814656
sim_compute_performance-ego_max0.06690142790476482
sim_compute_performance-ego_mean0.06642795181274415
sim_compute_performance-ego_median0.06676226933797201
sim_compute_performance-ego_min0.06553608099619547
sim_compute_robot_state-ego_max0.07030516465504964
sim_compute_robot_state-ego_mean0.06944911273320516
sim_compute_robot_state-ego_median0.06918162743250529
sim_compute_robot_state-ego_min0.06868514855702718
sim_compute_robot_state-npc0_max0.0672758412361145
sim_compute_robot_state-npc0_mean0.06644719775517782
sim_compute_robot_state-npc0_median0.06635961373647054
sim_compute_robot_state-npc0_min0.06540701150894165
sim_compute_robot_state-npc1_max0.06728325843811035
sim_compute_robot_state-npc1_mean0.06662245972951253
sim_compute_robot_state-npc1_median0.0665452774365743
sim_compute_robot_state-npc1_min0.06587793906529744
sim_compute_robot_state-npc2_max0.06815449873606363
sim_compute_robot_state-npc2_mean0.0665477803548177
sim_compute_robot_state-npc2_median0.06594645579655965
sim_compute_robot_state-npc2_min0.06565173784891765
sim_compute_robot_state-npc3_max0.06859435637791951
sim_compute_robot_state-npc3_mean0.06699040238062541
sim_compute_robot_state-npc3_median0.06685847997665405
sim_compute_robot_state-npc3_min0.06572386741638184
sim_compute_sim_state_max0.04068568547566732
sim_compute_sim_state_mean0.038392155011494955
sim_compute_sim_state_median0.03795449813206991
sim_compute_sim_state_min0.037382040023803714
sim_physics_max0.20796398401260377
sim_physics_mean0.19854646110534668
sim_physics_median0.19944446245829264
sim_physics_min0.1894840915997823
sim_render-ego_max0.06135841210683187
sim_render-ego_mean0.060611197789510095
sim_render-ego_median0.060955193837483726
sim_render-ego_min0.05961623112360637
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
196252451enickyBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationsuccessno-0:30:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.3614573264245535
survival_time_median14.950000000000076
deviation-center-line_median1.0119696714086834
in-drivable-lane_median4.050000000000022


other stats
agent_compute-ego_max0.15978973786036174
agent_compute-ego_mean0.1539401488304138
agent_compute-ego_median0.1585936721165975
agent_compute-ego_min0.14333485841751098
deviation-center-line_max1.0119699909612991
deviation-center-line_mean1.0119697191394268
deviation-center-line_min1.0119693200897382
deviation-heading_max6.81542792438532
deviation-heading_mean6.815427924385318
deviation-heading_median6.815427924385318
deviation-heading_min6.815427924385317
driven_any_max4.390824152784938
driven_any_mean4.3908241527849325
driven_any_median4.3908241527849325
driven_any_min4.390824152784927
driven_lanedir_consec_max-1.361452200425545
driven_lanedir_consec_mean-1.3614579701548792
driven_lanedir_consec_min-1.3614641213545289
driven_lanedir_max-2.315814608416598
driven_lanedir_mean-2.3158170164441083
driven_lanedir_median-2.3158169926021728
driven_lanedir_min-2.315819376788188
in-drivable-lane_max4.050000000000022
in-drivable-lane_mean4.050000000000022
in-drivable-lane_min4.050000000000022
per-episodes
details{"udem1-0-0": {"driven_any": 4.390824152784927, "sim_physics": 0.03454339345296224, "survival_time": 14.950000000000076, "driven_lanedir": -2.315816992602138, "sim_render-ego": 0.05300293842951457, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.14333485841751098, "deviation-heading": 6.815427924385318, "set_robot_commands": 0.0801870354016622, "deviation-center-line": 1.0119693200897382, "driven_lanedir_consec": -1.361457326424502, "sim_compute_sim_state": 0.03265999714533488, "sim_compute_performance-ego": 0.05693818966547648, "sim_compute_robot_state-ego": 0.05924538532892863, "sim_compute_robot_state-npc0": 0.05871898094813029, "sim_compute_robot_state-npc1": 0.057944931983947755, "sim_compute_robot_state-npc2": 0.060101405779520674, "sim_compute_robot_state-npc3": 0.05781794548034668}, "udem1-1-0": {"driven_any": 4.390824152784938, "sim_physics": 0.03794142882029215, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.05833721478780111, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.14913414478302, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.08493726730346679, "deviation-center-line": 1.0119699909612991, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.03508479913075765, "sim_compute_performance-ego": 0.06059404691060384, "sim_compute_robot_state-ego": 0.06188396453857422, "sim_compute_robot_state-npc0": 0.059488924344380696, "sim_compute_robot_state-npc1": 0.05991408507029215, "sim_compute_robot_state-npc2": 0.05952296257019043, "sim_compute_robot_state-npc3": 0.05998006502787272}, "udem1-2-0": {"driven_any": 4.390824152784927, "sim_physics": 0.0401725443204244, "survival_time": 14.950000000000076, "driven_lanedir": -2.315819376788188, "sim_render-ego": 0.0586224110921224, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.15978973786036174, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.0884242065747579, "deviation-center-line": 1.0119699909612945, "driven_lanedir_consec": -1.3614641213545289, "sim_compute_sim_state": 0.037602903048197425, "sim_compute_performance-ego": 0.06563498179117838, "sim_compute_robot_state-ego": 0.06790330489476522, "sim_compute_robot_state-npc0": 0.06445498625437418, "sim_compute_robot_state-npc1": 0.0649027419090271, "sim_compute_robot_state-npc2": 0.06509262482325236, "sim_compute_robot_state-npc3": 0.06623520930608114}, "udem1-3-0": {"driven_any": 4.3908241527849325, "sim_physics": 0.04144156773885091, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158169926021728, "sim_render-ego": 0.06005823532740275, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.15884833097457884, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.08460736115773519, "deviation-center-line": 1.0119696714086834, "driven_lanedir_consec": -1.3614573264245535, "sim_compute_sim_state": 0.0366555658976237, "sim_compute_performance-ego": 0.06461312214533488, "sim_compute_robot_state-ego": 0.0672348419825236, "sim_compute_robot_state-npc0": 0.0625877857208252, "sim_compute_robot_state-npc1": 0.06279491583506266, "sim_compute_robot_state-npc2": 0.06411834955215454, "sim_compute_robot_state-npc3": 0.06393815437952677}, "udem1-4-0": {"driven_any": 4.390824152784936, "sim_physics": 0.04059507052103679, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158171118114455, "sim_render-ego": 0.05852947473526001, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.1585936721165975, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.08769252459208171, "deviation-center-line": 1.0119696222761183, "driven_lanedir_consec": -1.3614588761452664, "sim_compute_sim_state": 0.03707576831181844, "sim_compute_performance-ego": 0.06360799153645834, "sim_compute_robot_state-ego": 0.06937423388163248, "sim_compute_robot_state-npc0": 0.06408322890599569, "sim_compute_robot_state-npc1": 0.06391634623209635, "sim_compute_robot_state-npc2": 0.06425059000651041, "sim_compute_robot_state-npc3": 0.06338868697484334}}
set_robot_commands_max0.0884242065747579
set_robot_commands_mean0.08516967900594076
set_robot_commands_median0.08493726730346679
set_robot_commands_min0.0801870354016622
sim_compute_performance-ego_max0.06563498179117838
sim_compute_performance-ego_mean0.06227766640981038
sim_compute_performance-ego_median0.06360799153645834
sim_compute_performance-ego_min0.05693818966547648
sim_compute_robot_state-ego_max0.06937423388163248
sim_compute_robot_state-ego_mean0.06512834612528483
sim_compute_robot_state-ego_median0.0672348419825236
sim_compute_robot_state-ego_min0.05924538532892863
sim_compute_robot_state-npc0_max0.06445498625437418
sim_compute_robot_state-npc0_mean0.06186678123474121
sim_compute_robot_state-npc0_median0.0625877857208252
sim_compute_robot_state-npc0_min0.05871898094813029
sim_compute_robot_state-npc1_max0.0649027419090271
sim_compute_robot_state-npc1_mean0.06189460420608521
sim_compute_robot_state-npc1_median0.06279491583506266
sim_compute_robot_state-npc1_min0.057944931983947755
sim_compute_robot_state-npc2_max0.06509262482325236
sim_compute_robot_state-npc2_mean0.06261718654632568
sim_compute_robot_state-npc2_median0.06411834955215454
sim_compute_robot_state-npc2_min0.05952296257019043
sim_compute_robot_state-npc3_max0.06623520930608114
sim_compute_robot_state-npc3_mean0.06227201223373413
sim_compute_robot_state-npc3_median0.06338868697484334
sim_compute_robot_state-npc3_min0.05781794548034668
sim_compute_sim_state_max0.037602903048197425
sim_compute_sim_state_mean0.03581580670674642
sim_compute_sim_state_median0.0366555658976237
sim_compute_sim_state_min0.03265999714533488
sim_physics_max0.04144156773885091
sim_physics_mean0.0389388009707133
sim_physics_median0.0401725443204244
sim_physics_min0.03454339345296224
sim_render-ego_max0.06005823532740275
sim_render-ego_mean0.05771005487442017
sim_render-ego_median0.05852947473526001
sim_render-ego_min0.05300293842951457
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
195902451enickyBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationhost-errorno-0:10:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19590-827658', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19590-827658', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19590-827658', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
188462451enickyBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationerrorno-0:21:33
Waited 1203 seconds [...]
Waited 1203 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
184892451enickyBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationerrorno-0:21:34
Waited 1203 seconds [...]
Waited 1203 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
179342451enickyBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationerrorno-0:20:43
Waited 1200 seconds [...]
Waited 1200 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
178512451enickyBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationerrorno-0:20:46
Waited 1200 seconds [...]
Waited 1200 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
178502451enickyBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationerrorno-0:20:59
Waited 1203 seconds [...]
Waited 1203 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
178222451enickyBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationtimeoutno-0:25:36
I can see how the jo [...]
I can see how the job 17822 is timeout because passed 1536 seconds and the timeout is 1200.0.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
178212451enickyBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationerrorno-0:21:23
Waited 1203 seconds [...]
Waited 1203 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
176292451enickyBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationerrorno-0:21:32
Waited 1203 seconds [...]
Waited 1203 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.