AI Driving Olympics Home Challenges Submissions Jobs

Submission 74

Submission74
Competingyes
Challengeaido1_LF1_r2-v3
UserAndrea Censi
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 244 step2-scoring: 250
Next
User labelRandom execution
Admin priority65
Blessing65
User priority

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
25074Andrea CensiRandom executionaido1_LF1_r2-v3step2-scoringsuccessyes-2:00:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean23.20707122186628
valid_direction_mean11.993333333333322


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.0535637301508105, "good_angle": 13.552013968782518, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.799999999999995}, "ep001": {"nsteps": 500, "reward": -1.9187823569476603, "good_angle": 6.18571844800465, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 9.36666666666667}, "ep002": {"nsteps": 500, "reward": -1.242627432912588, "good_angle": 76.05253361495349, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.76666666666663}, "ep003": {"nsteps": 500, "reward": -1.188151815056801, "good_angle": 6.074301128423805, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 9.499999999999996}, "ep004": {"nsteps": 500, "reward": -0.680690432714764, "good_angle": 14.17078894916694, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.53333333333332}}
good_angle_max76.05253361495349
good_angle_median13.552013968782518
good_angle_min6.074301128423805
reward_max-0.680690432714764
reward_mean-1.2167631535565246
reward_median-1.188151815056801
reward_min-1.9187823569476603
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.6
traveled_tiles_min1
valid_direction_max13.799999999999995
valid_direction_median13.53333333333332
valid_direction_min9.36666666666667
24974Andrea CensiRandom executionaido1_LF1_r2-v3step2-scoringsuccessyes-2:00:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean23.20707122186628
valid_direction_mean11.993333333333322


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.0535637301508105, "good_angle": 13.552013968782518, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.799999999999995}, "ep001": {"nsteps": 500, "reward": -1.9187823569476603, "good_angle": 6.18571844800465, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 9.36666666666667}, "ep002": {"nsteps": 500, "reward": -1.242627432912588, "good_angle": 76.05253361495349, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.76666666666663}, "ep003": {"nsteps": 500, "reward": -1.188151815056801, "good_angle": 6.074301128423805, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 9.499999999999996}, "ep004": {"nsteps": 500, "reward": -0.680690432714764, "good_angle": 14.17078894916694, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.53333333333332}}
good_angle_max76.05253361495349
good_angle_median13.552013968782518
good_angle_min6.074301128423805
reward_max-0.680690432714764
reward_mean-1.2167631535565246
reward_median-1.188151815056801
reward_min-1.9187823569476603
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.6
traveled_tiles_min1
valid_direction_max13.799999999999995
valid_direction_median13.53333333333332
valid_direction_min9.36666666666667
24874Andrea CensiRandom executionaido1_LF1_r2-v3step2-scoringerroryes-2:00:41
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 390, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job248-858', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job248-858', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
24774Andrea CensiRandom executionaido1_LF1_r2-v3step2-scoringsuccessyes-2:01:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean23.20707122186628
valid_direction_mean11.993333333333322


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.0535637301508105, "good_angle": 13.552013968782518, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.799999999999995}, "ep001": {"nsteps": 500, "reward": -1.9187823569476603, "good_angle": 6.18571844800465, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 9.36666666666667}, "ep002": {"nsteps": 500, "reward": -1.242627432912588, "good_angle": 76.05253361495349, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.76666666666663}, "ep003": {"nsteps": 500, "reward": -1.188151815056801, "good_angle": 6.074301128423805, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 9.499999999999996}, "ep004": {"nsteps": 500, "reward": -0.680690432714764, "good_angle": 14.17078894916694, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.53333333333332}}
good_angle_max76.05253361495349
good_angle_median13.552013968782518
good_angle_min6.074301128423805
reward_max-0.680690432714764
reward_mean-1.2167631535565246
reward_median-1.188151815056801
reward_min-1.9187823569476603
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.6
traveled_tiles_min1
valid_direction_max13.799999999999995
valid_direction_median13.53333333333332
valid_direction_min9.36666666666667
24674Andrea CensiRandom executionaido1_LF1_r2-v3step2-scoringsuccessyes-2:00:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean21.153485385500257
valid_direction_mean12.039999999999992


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.8591660871505737, "good_angle": 11.257293415724876, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 8.533333333333342}, "ep001": {"nsteps": 500, "reward": -1.6598995124697686, "good_angle": 46.93787052259383, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 13.566666666666656}, "ep002": {"nsteps": 500, "reward": -0.9550404280126096, "good_angle": 18.679399540854796, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 12.499999999999991}, "ep003": {"nsteps": 500, "reward": -1.2373386880159378, "good_angle": 20.944676094792023, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 15.499999999999986}, "ep004": {"nsteps": 500, "reward": -0.5126900258227252, "good_angle": 7.948187353535748, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 10.099999999999987}}
good_angle_max46.93787052259383
good_angle_median18.679399540854796
good_angle_min7.948187353535748
reward_max-0.5126900258227252
reward_mean-1.044826948294323
reward_median-0.9550404280126096
reward_min-1.6598995124697686
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max15.499999999999986
valid_direction_median12.499999999999991
valid_direction_min8.533333333333342
24574Andrea CensiRandom executionaido1_LF1_r2-v3step2-scoringsuccessyes-2:00:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean16.613333333333316
good_angle_mean24.321069173130446
valid_direction_mean12.939999999999989


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.384782737998059, "good_angle": 5.302062623203629, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 9.200000000000008}, "ep001": {"nsteps": 500, "reward": -1.8181573605537416, "good_angle": 41.58071516898813, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 15.099999999999984}, "ep002": {"nsteps": 500, "reward": -1.68496368095465, "good_angle": 46.651669523471675, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 14.999999999999988}, "ep003": {"nsteps": 500, "reward": -0.3886898622313747, "good_angle": 15.727589698195596, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 13.133333333333324}, "ep004": {"nsteps": 500, "reward": -0.8847563000619412, "good_angle": 12.34330885179318, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 12.26666666666664}}
good_angle_max46.651669523471675
good_angle_median15.727589698195596
good_angle_min5.302062623203629
reward_max-0.384782737998059
reward_mean-1.032269988359953
reward_median-0.8847563000619412
reward_min-1.8181573605537416
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_min1
valid_direction_max15.099999999999984
valid_direction_median13.133333333333324
valid_direction_min9.200000000000008
24474Andrea CensiRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes-2:01:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
24374Andrea CensiRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes-2:01:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
24274Andrea CensiRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes-2:01:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
24174Andrea CensiRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes-2:01:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
24074Andrea CensiRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes-2:01:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
23974Andrea CensiRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes-2:01:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
20374Andrea CensiRandom executionaido1_LF1_r2-v3step2-scoringabortedyes-0:01:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean16.613333333333316
good_angle_mean23.432233238060338
valid_direction_mean11.559999999999992


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.8830052211284637, "good_angle": 9.560625696442672, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.233333333333336}, "ep001": {"nsteps": 500, "reward": -1.292024236717727, "good_angle": 38.617643875411616, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 11.3}, "ep002": {"nsteps": 500, "reward": -1.5498077857494357, "good_angle": 37.16335017231948, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 11.166666666666664}, "ep003": {"nsteps": 500, "reward": -1.175085791170597, "good_angle": 18.324050322118843, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 12.499999999999991}, "ep004": {"nsteps": 500, "reward": -1.0901485322117803, "good_angle": 13.495496124009067, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 11.599999999999964}}
good_angle_max38.617643875411616
good_angle_median18.324050322118843
good_angle_min9.560625696442672
reward_max-0.8830052211284637
reward_mean-1.1980143133956007
reward_median-1.175085791170597
reward_min-1.5498077857494357
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_min1
valid_direction_max12.499999999999991
valid_direction_median11.3
valid_direction_min11.166666666666664
18474Andrea CensiRandom executionaido1_LF1_r2-v3step2-scoringabortedno-0:00:29
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/runner.py", line 370, in run
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/challenge_results.py", line 66, in read_challenge_results
    data = read_yaml_file(fn)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.27-py2.7.egg/duckietown_challenges/yaml_utils.py", line 17, in read_yaml_file
    return yaml.load(data, Loader=yaml.Loader)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/main.py", line 924, in load
    return loader._constructor.get_single_data()
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 108, in get_single_data
    return self.construct_document(node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 118, in construct_document
    for _dummy in generator:
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 672, in construct_yaml_map
    value = self.construct_mapping(node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 399, in construct_mapping
    return BaseConstructor.construct_mapping(self, node, deep=deep)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 242, in construct_mapping
    value = self.construct_object(value_node, deep=deep)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 166, in construct_object
    data = constructor(self, tag_suffix, node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 938, in construct_python_object_apply
    args = self.construct_sequence(node, deep=True)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 198, in construct_sequence
    return [self.construct_object(child, deep=deep) for child in node.value]
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 166, in construct_object
    data = constructor(self, tag_suffix, node)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 950, in construct_python_object_apply
    instance = self.make_python_instance(suffix, node, args, kwds, newobj)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 882, in make_python_instance
    cls = self.find_python_name(suffix, node.start_mark)
  File "/usr/local/lib/python2.7/dist-packages/ruamel/yaml/constructor.py", line 835, in find_python_name
    mark,
ConstructorError: while constructing a Python object
cannot find module 'numpy' (No module named numpy)
  in "<byte string>", line 6, column 9:
          - &id001 !!python/object/apply:num ... 
            ^ (line: 6)
Hidden. If you are the author, please login using the top-right link or use the dashboard.
17774Andrea CensiRandom executionaido1_LF1_r2-v3step1-simulationabortedyes-0:02:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
17674Andrea CensiRandom executionaido1_LF1_r2-v3step1-simulationabortedyes-0:01:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
12974Andrea CensiRandom executionaido1_LF1_r2-v3step2-scoringabortedno-0:00:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean4.622046586172948
valid_direction_mean11.759999999999994


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6687548997402191, "good_angle": 2.346875555585716, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 9.099999999999994}, "ep001": {"nsteps": 500, "reward": -2.053634369403124, "good_angle": 1.1012067416734153, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 6.933333333333344}, "ep002": {"nsteps": 500, "reward": -1.511635816635564, "good_angle": 11.962119726476049, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 14.399999999999984}, "ep003": {"nsteps": 500, "reward": -1.2118231953382492, "good_angle": 4.620920989414631, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.76666666666666}, "ep004": {"nsteps": 500, "reward": -0.47050132013599794, "good_angle": 3.07910991771493, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 14.599999999999987}}
good_angle_max11.962119726476049
good_angle_median3.07910991771493
good_angle_min1.1012067416734153
reward_max-0.47050132013599794
reward_mean-1.183269920250631
reward_median-1.2118231953382492
reward_min-2.053634369403124
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max14.599999999999987
valid_direction_median13.76666666666666
valid_direction_min6.933333333333344
12674Andrea CensiRandom executionaido1_LF1_r2-v3step2-scoringabortedno-0:00:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_mean16.613333333333316
good_angle_mean4.622046586172948
valid_direction_mean11.759999999999994


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6687548997402191, "good_angle": 2.346875555585716, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 9.099999999999994}, "ep001": {"nsteps": 500, "reward": -2.053634369403124, "good_angle": 1.1012067416734153, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 6.933333333333344}, "ep002": {"nsteps": 500, "reward": -1.511635816635564, "good_angle": 11.962119726476049, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 14.399999999999984}, "ep003": {"nsteps": 500, "reward": -1.2118231953382492, "good_angle": 4.620920989414631, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.76666666666666}, "ep004": {"nsteps": 500, "reward": -0.47050132013599794, "good_angle": 3.07910991771493, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 14.599999999999987}}
good_angle_max11.962119726476049
good_angle_median3.07910991771493
good_angle_min1.1012067416734153
reward_max-0.47050132013599794
reward_mean-1.183269920250631
reward_median-1.2118231953382492
reward_min-2.053634369403124
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
valid_direction_max14.599999999999987
valid_direction_median13.76666666666666
valid_direction_min6.933333333333344
12574Andrea CensiRandom executionaido1_LF1_r2-v3step1-simulationabortedno-0:01:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1