AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 80

evaluator80
ownerAndrea Censi
machinenutonomy-P50
processnutonomy-P50-30037
versionDC:3.1.41;DCR:3.2.3;DTS:3.0.24
first heard
last heard
statusinactive
# evaluating
# success22
# timeout
# failed5
# error3
# aborted1
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
PI Camera
# Duckiebots
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
447258PolyProgrammistSimple based on center pixelaido1_LF1_r2-v3step1-simulationsuccessyes800:01:14(hidden)
other stats
simulation-passed1
443255PolyProgrammistSimple based on center pixelaido1_LF1_r2-v3step2-scoringsuccessyes800:00:59(hidden)
traveled_tiles_median2
survival_time_mean2.373333333333332
good_angle_mean3.2448348216917005
valid_direction_mean0.7733333333333331


other stats
episodes
details{"ep000": {"nsteps": 60, "reward": -18.55895467996597, "good_angle": 8.631361811097454, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 1.4000000000000028}, "ep001": {"nsteps": 125, "reward": -8.8210487947464, "good_angle": 5.922127375530279, "survival_time": 4.166666666666662, "traveled_tiles": 3, "valid_direction": 1.399999999999995}, "ep002": {"nsteps": 40, "reward": -26.14327304959297, "good_angle": 1.60895172094825, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.066666666666667}, "ep003": {"nsteps": 15, "reward": -68.38100338776907, "good_angle": 0.017532853174180282, "survival_time": 0.49999999999999994, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 116, "reward": -9.494371339903566, "good_angle": 0.04420034770833667, "survival_time": 3.8666666666666623, "traveled_tiles": 4, "valid_direction": 0}}
good_angle_max8.631361811097454
good_angle_median1.60895172094825
good_angle_min0.017532853174180282
reward_max-8.8210487947464
reward_mean-26.279730250395595
reward_median-18.55895467996597
reward_min-68.38100338776907
survival_time_max4.166666666666662
survival_time_median2.0000000000000027
survival_time_min0.49999999999999994
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_min1
valid_direction_max1.4000000000000028
valid_direction_median1.066666666666667
valid_direction_min0
441254PolyProgrammistSimple based on center pixelaido1_LF1_r2-v3step1-simulationfailedyes800:00:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 475, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
global name 'dec' is not defined
(hidden)
438252MandanaSamieiRandom executionaido1_LF1_r2-v3step2-scoringsuccessyes800:01:24(hidden)
traveled_tiles_median2
survival_time_mean16.613333333333316
good_angle_mean27.075240205221593
valid_direction_mean13.846666666666655


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.036918387413025, "good_angle": 16.145241857243672, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.599999999999987}, "ep001": {"nsteps": 500, "reward": -0.480481212771032, "good_angle": 60.01806533463249, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 12.399999999999988}, "ep002": {"nsteps": 500, "reward": -1.0258958237012847, "good_angle": 29.53478474064314, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 15.033333333333315}, "ep003": {"nsteps": 500, "reward": -1.32253132340312, "good_angle": 11.06540188471044, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 12.09999999999999}, "ep004": {"nsteps": 500, "reward": -0.9973625722527504, "good_angle": 18.61270720887821, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 14.09999999999999}}
good_angle_max60.01806533463249
good_angle_median18.61270720887821
good_angle_min11.06540188471044
reward_max-0.480481212771032
reward_mean-0.9726378639082424
reward_median-1.0258958237012847
reward_min-1.32253132340312
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_min1
valid_direction_max15.599999999999987
valid_direction_median14.09999999999999
valid_direction_min12.09999999999999
437251DavidRandom executionaido1_LF1_r2-v3step2-scoringsuccessyes800:00:25(hidden)
traveled_tiles_median3
survival_time_mean9.60666666666665
good_angle_mean8.738932150305212
valid_direction_mean8.466666666666649


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.2727269411180169, "good_angle": 15.287022501700282, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.299999999999992}, "ep001": {"nsteps": 144, "reward": -9.042670455230915, "good_angle": 2.694384999070173, "survival_time": 4.733333333333326, "traveled_tiles": 3, "valid_direction": 4.099999999999993}, "ep002": {"nsteps": 500, "reward": -2.6643407019376757, "good_angle": 10.794727103782549, "survival_time": 4.699999999999993, "traveled_tiles": 3, "valid_direction": 10.166666666666636}, "ep003": {"nsteps": 259, "reward": -4.663204992467333, "good_angle": 3.2600758015141977, "survival_time": 8.633333333333313, "traveled_tiles": 1, "valid_direction": 5.633333333333321}, "ep004": {"nsteps": 500, "reward": -1.684873000945896, "good_angle": 11.658450345458862, "survival_time": 13.299999999999963, "traveled_tiles": 3, "valid_direction": 10.133333333333306}}
good_angle_max15.287022501700282
good_angle_median10.794727103782549
good_angle_min2.694384999070173
reward_max-1.2727269411180169
reward_mean-3.8655632183399673
reward_median-2.6643407019376757
reward_min-9.042670455230915
survival_time_max16.666666666666654
survival_time_median8.633333333333313
survival_time_min4.699999999999993
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_min1
valid_direction_max12.299999999999992
valid_direction_median10.133333333333306
valid_direction_min4.099999999999993
429247ikraSolution templateaido1_luck-v3step1successyes800:00:16(hidden)
score136.06772782578293


428246heyt0nyPyTorch DDPG templateaido1_LF1_r2-v3step1-simulationerroryes800:00:10
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 395, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job428-5559', 'pull']:

   >  Command '['docker-compose', '-p', 'job428-5559', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
(hidden)
427245heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrorno800:00:10
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 395, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job427-3725', 'pull']:

   >  Command '['docker-compose', '-p', 'job427-3725', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
(hidden)
423242BenjaminTemplate for ROS Submissionaido1_LF1_r2-v3step1-simulationerroryes800:00:33
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job423-5823', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job423-5823', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
(hidden)
421241emmasungRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes800:01:22(hidden)
other stats
simulation-passed1
419240emmasungRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes800:01:21(hidden)
other stats
simulation-passed1
417238heyt0nySolution templateaido1_luck-v3step1successyes800:00:34(hidden)
score133.38865473835884


416237JonTensorflow templateaido1_LF1_r2-v3step2-scoringsuccessyes800:00:23(hidden)
traveled_tiles_median3
survival_time_mean3.106666666666663
good_angle_mean0.8532457460036523
valid_direction_mean1.0799999999999996


other stats
episodes
details{"ep000": {"nsteps": 45, "reward": -22.730665498682193, "good_angle": 2.464011645649803, "survival_time": 1.500000000000001, "traveled_tiles": 3, "valid_direction": 1.400000000000001}, "ep001": {"nsteps": 108, "reward": -9.473568658999822, "good_angle": 0.21552867377610185, "survival_time": 3.599999999999997, "traveled_tiles": 2, "valid_direction": 0.5333333333333314}, "ep002": {"nsteps": 237, "reward": -4.432748170956362, "good_angle": 0.44670148280839816, "survival_time": 7.899999999999982, "traveled_tiles": 5, "valid_direction": 0.6666666666666666}, "ep003": {"nsteps": 40, "reward": -27.013019865751268, "good_angle": 0.3643350051548137, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 0.9333333333333336}, "ep004": {"nsteps": 111, "reward": -9.886567245438895, "good_angle": 0.7756519226291452, "survival_time": 1.2000000000000004, "traveled_tiles": 5, "valid_direction": 1.8666666666666651}}
good_angle_max2.464011645649803
good_angle_median0.44670148280839816
good_angle_min0.21552867377610185
reward_max-4.432748170956362
reward_mean-14.70731388796571
reward_median-9.886567245438895
reward_min-27.013019865751268
survival_time_max7.899999999999982
survival_time_median1.500000000000001
survival_time_min1.2000000000000004
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_min1
valid_direction_max1.8666666666666651
valid_direction_median0.9333333333333336
valid_direction_min0.5333333333333314
415237JonTensorflow templateaido1_LF1_r2-v3step1-simulationsuccessyes800:00:54(hidden)
other stats
simulation-passed1
414236JonRandom executionaido1_LF1_r2-v3step2-scoringsuccessyes800:00:29(hidden)
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean34.42087593116726
valid_direction_mean12.626666666666656


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.0002795575857162, "good_angle": 10.371212949210284, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.466666666666663}, "ep001": {"nsteps": 500, "reward": -1.6683495569229123, "good_angle": 51.155118401339, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 12.333333333333323}, "ep002": {"nsteps": 500, "reward": -1.2194725445508956, "good_angle": 81.25321589422992, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 14.799999999999988}, "ep003": {"nsteps": 500, "reward": -1.7070470515573395, "good_angle": 11.014429387179227, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 10.833333333333314}, "ep004": {"nsteps": 500, "reward": -1.227472954928875, "good_angle": 18.310403023877857, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 13.699999999999983}}
good_angle_max81.25321589422992
good_angle_median18.310403023877857
good_angle_min10.371212949210284
reward_max-1.0002795575857162
reward_mean-1.364524333109148
reward_median-1.227472954928875
reward_min-1.7070470515573395
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max14.799999999999988
valid_direction_median12.333333333333323
valid_direction_min10.833333333333314
413236JonRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes800:01:29(hidden)
other stats
simulation-passed1
412235JonSolution templateaido1_luck-v3step1successyes800:00:39(hidden)
score162.73035759266639


411234tongqiusuiSolution templateaido1_luck-v3step1successyes800:00:35(hidden)
score131.823068791052293


410233BenjaminTemplate for ROS Submissionaido1_LF1_r2-v3step2-scoringsuccessyes800:00:23(hidden)
traveled_tiles_median2
survival_time_mean3.2666666666666635
good_angle_mean5.573907592278874
valid_direction_mean1.8199999999999976


other stats
episodes
details{"ep000": {"nsteps": 128, "reward": -9.600020315963777, "good_angle": 21.134904899556435, "survival_time": 4.266666666666661, "traveled_tiles": 2, "valid_direction": 2.999999999999994}, "ep001": {"nsteps": 151, "reward": -6.600312632131575, "good_angle": 0.6683427249858845, "survival_time": 5.033333333333325, "traveled_tiles": 2, "valid_direction": 1.2666666666666626}, "ep002": {"nsteps": 99, "reward": -11.67629972653407, "good_angle": 5.470192592883934, "survival_time": 3.299999999999998, "traveled_tiles": 1, "valid_direction": 2.8333333333333313}, "ep003": {"nsteps": 32, "reward": -32.96746315062046, "good_angle": 0.028911937430508912, "survival_time": 1.0666666666666669, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 80, "reward": -14.745833478868008, "good_angle": 0.5671858065376111, "survival_time": 2.666666666666667, "traveled_tiles": 2, "valid_direction": 2}}
good_angle_max21.134904899556435
good_angle_median0.6683427249858845
good_angle_min0.028911937430508912
reward_max-6.600312632131575
reward_mean-15.117985860823577
reward_median-11.67629972653407
reward_min-32.96746315062046
survival_time_max5.033333333333325
survival_time_median3.299999999999998
survival_time_min1.0666666666666669
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_min1
valid_direction_max2.999999999999994
valid_direction_median2
valid_direction_min0
408232jlh457Random executionaido1_LF1_r2-v3step2-scoringsuccessyes800:00:25(hidden)
traveled_tiles_median3
survival_time_mean12.98666666666665
good_angle_mean11.380410969306974
valid_direction_mean9.419999999999977


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.7932140330076217, "good_angle": 9.664119232355455, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.066666666666654}, "ep001": {"nsteps": 500, "reward": -2.0966846167743207, "good_angle": 6.817795180734229, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 9.799999999999969}, "ep002": {"nsteps": 500, "reward": -1.0901086805462836, "good_angle": 24.289195995241908, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 12.333333333333302}, "ep003": {"nsteps": 380, "reward": -4.339734431369365, "good_angle": 15.073649274227854, "survival_time": 12.599999999999966, "traveled_tiles": 3, "valid_direction": 12.2333333333333}, "ep004": {"nsteps": 74, "reward": -16.259130494014638, "good_angle": 1.0572951639754211, "survival_time": 2.4666666666666677, "traveled_tiles": 1, "valid_direction": 1.6666666666666672}}
good_angle_max24.289195995241908
good_angle_median9.664119232355455
good_angle_min1.0572951639754211
reward_max-0.7932140330076217
reward_mean-4.915774451142445
reward_median-2.0966846167743207
reward_min-16.259130494014638
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min2.4666666666666677
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_min1
valid_direction_max12.333333333333302
valid_direction_median11.066666666666654
valid_direction_min1.6666666666666672
405230ih258Random executionaido1_LF1_r2-v3step2-scoringsuccessyes800:00:27(hidden)
traveled_tiles_median2
survival_time_mean16.613333333333316
good_angle_mean33.64367907193359
valid_direction_mean13.246666666666655


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.8292855309844017, "good_angle": 16.863279149834483, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.79999999999998}, "ep001": {"nsteps": 500, "reward": -1.5477754533533008, "good_angle": 30.128748653863212, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 9.766666666666664}, "ep002": {"nsteps": 500, "reward": -0.864044932126999, "good_angle": 96.11326191177496, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 15.56666666666665}, "ep003": {"nsteps": 500, "reward": -1.327184747636318, "good_angle": 12.938644771876024, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 14.49999999999999}, "ep004": {"nsteps": 500, "reward": -1.27256230892241, "good_angle": 12.174460872319257, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 12.599999999999996}}
good_angle_max96.11326191177496
good_angle_median16.863279149834483
good_angle_min12.174460872319257
reward_max-0.8292855309844017
reward_mean-1.168170594604686
reward_median-1.27256230892241
reward_min-1.5477754533533008
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_min1
valid_direction_max15.56666666666665
valid_direction_median13.79999999999998
valid_direction_min9.766666666666664
396224Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step2-scoringabortedno800:00:14(hidden)
survival_time_median16.333333333333304


other stats
episodes
details{"ep000": {"nsteps": 490, "reward": -4.171412545077655, "good_angle": 14.379182228026304, "survival_time": 16.333333333333304, "traveled_tiles": 3, "valid_direction": 6.066666666666664}, "ep001": {"nsteps": 500, "reward": -1.0339719699919223, "good_angle": 52.42523924297719, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 7.133333333333309}, "ep002": {"nsteps": 500, "reward": -1.4501068297624589, "good_angle": 74.28098761715059, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 7.899999999999977}, "ep003": {"nsteps": 246, "reward": -4.999525907684148, "good_angle": 1.22724322608484, "survival_time": 8.199999999999982, "traveled_tiles": 1, "valid_direction": 2.6666666666666647}, "ep004": {"nsteps": 163, "reward": -7.094105166571637, "good_angle": 0.711536075115334, "survival_time": 5.433333333333324, "traveled_tiles": 1, "valid_direction": 2.0666666666666673}}
good_angle_max74.28098761715059
good_angle_mean28.604837677870854
good_angle_median14.379182228026304
good_angle_min0.711536075115334
reward_max-1.0339719699919223
reward_mean-3.749824483817565
reward_median-4.171412545077655
reward_min-7.094105166571637
survival_time_max16.666666666666654
survival_time_mean12.659999999999984
survival_time_min5.433333333333324
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max7.899999999999977
valid_direction_mean5.166666666666656
valid_direction_median6.066666666666664
valid_direction_min2.0666666666666673
394223Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailedno800:02:18
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 480, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 107, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server

(hidden)
393222spetrykRandom executionaido1_LF1_r2-v3step2-scoringsuccessyes800:00:26(hidden)
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean11.285662849153288
valid_direction_mean11.546666666666656


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.4203298093047924, "good_angle": 7.890866130069249, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.533333333333337}, "ep001": {"nsteps": 500, "reward": -2.1653990453332663, "good_angle": 3.078885745446617, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 7.466666666666647}, "ep002": {"nsteps": 500, "reward": -1.2375537265070595, "good_angle": 19.325236491490884, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.833333333333318}, "ep003": {"nsteps": 500, "reward": -1.1455610923171042, "good_angle": 14.884935455392098, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.799999999999988}, "ep004": {"nsteps": 500, "reward": -0.7775738411396742, "good_angle": 11.248390423367594, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 11.09999999999999}}
good_angle_max19.325236491490884
good_angle_median11.248390423367594
good_angle_min3.078885745446617
reward_max-0.4203298093047924
reward_mean-1.1492835029203792
reward_median-1.1455610923171042
reward_min-2.1653990453332663
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.6
traveled_tiles_min1
valid_direction_max13.833333333333318
valid_direction_median11.533333333333337
valid_direction_min7.466666666666647
391221Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailedno800:00:21
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 480, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 107, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: frozen_graph.pb; No such file or directory

(hidden)
390220Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step3-videossuccessno800:00:47(hidden)
other stats
videos1
389220Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step2-scoringsuccessno800:00:15(hidden)
survival_time_median12.833333333333298


other stats
episodes
details{"ep000": {"nsteps": 253, "reward": -6.627978940255086, "good_angle": 1.280181574914256, "survival_time": 8.433333333333314, "traveled_tiles": 2, "valid_direction": 2.499999999999992}, "ep001": {"nsteps": 500, "reward": -0.3061336755362572, "good_angle": 24.901943926295687, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 5.033333333333316}, "ep002": {"nsteps": 500, "reward": -1.709346336841583, "good_angle": 90.00061748987427, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 10.86666666666663}, "ep003": {"nsteps": 385, "reward": -2.826298477887418, "good_angle": 0.5398567841255246, "survival_time": 12.833333333333298, "traveled_tiles": 1, "valid_direction": 0.7333333333333323}, "ep004": {"nsteps": 202, "reward": -5.356281492582495, "good_angle": 0.21214036967145497, "survival_time": 6.733333333333319, "traveled_tiles": 1, "valid_direction": 0}}
good_angle_max90.00061748987427
good_angle_mean23.38694802897624
good_angle_median1.280181574914256
good_angle_min0.21214036967145497
reward_max-0.3061336755362572
reward_mean-3.365207784620568
reward_median-2.826298477887418
reward_min-6.627978940255086
survival_time_max16.666666666666654
survival_time_mean12.266666666666648
survival_time_min6.733333333333319
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max10.86666666666663
valid_direction_mean3.826666666666654
valid_direction_median2.499999999999992
valid_direction_min0
388220Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationsuccessno800:02:47(hidden)
other stats
simulation-passed1
387219Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno800:00:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 480, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
(hidden)
382210Andrea CensiPython templateaido1_amod_service_quality_r1-v3step2-scoringsuccessyes800:01:28(hidden)
service_quality-32.75324003154215


other stats
efficiency-63.96424012616591
fleet_size-1000000000
379214Andrea CensiJava templateaido1_amod_fleet_size_r1-v3step1-simulationfailedno800:00:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Uncaught exception in solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 485, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 25, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-Xmx10000m', '-cp', 'aidamod-1.4.7.jar', 'aidamod.demo.AidoGuest', 'aido-host']' returned non-zero exit status 1

(hidden)