Duckietown Challenges Home Challenges Submissions

Evaluator 68

ID68
evaluatornutonomy-P50-29851
ownerAndrea Censi 🇨🇭
machinenutonomy-P50
processnutonomy-P50-29851
version3.0.36
first heard
last heard
statusinactive
# evaluating
# success20 234
# timeout
# failed4 278
# error9 269
# aborted1 303
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
373208Florian GolemoPyTorch DDPG templateaido1_LF1_r2-v3step2-scoringsuccessyesnutonomy-P50-298510:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean5.539999999999988
good_angle_mean7.160988653681653
valid_direction_mean5.613333333333317


other stats
episodes
details{"ep000": {"nsteps": 322, "reward": -4.225123972526422, "good_angle": 16.645429501859716, "survival_time": 10.733333333333306, "traveled_tiles": 3, "valid_direction": 9.933333333333309}, "ep001": {"nsteps": 47, "reward": -21.79166609936572, "good_angle": 0.11269989080727928, "survival_time": 1.5666666666666682, "traveled_tiles": 1, "valid_direction": 0.13333333333333375}, "ep002": {"nsteps": 165, "reward": -7.168349153202408, "good_angle": 5.933871829263301, "survival_time": 1.0666666666666669, "traveled_tiles": 2, "valid_direction": 3.733333333333327}, "ep003": {"nsteps": 500, "reward": -1.7081131277084352, "good_angle": 4.5907113753225115, "survival_time": 1.0333333333333332, "traveled_tiles": 5, "valid_direction": 4.499999999999984}, "ep004": {"nsteps": 399, "reward": -4.222238071633965, "good_angle": 8.52223067115546, "survival_time": 13.299999999999963, "traveled_tiles": 2, "valid_direction": 9.766666666666634}}
good_angle_max16.645429501859716
good_angle_median5.933871829263301
good_angle_min0.11269989080727928
reward_max-1.7081131277084352
reward_mean-7.823098084887391
reward_median-4.225123972526422
reward_min-21.79166609936572
survival_time_max13.299999999999963
survival_time_median1.5666666666666682
survival_time_min1.0333333333333332
traveled_tiles_max5
traveled_tiles_mean2.6
traveled_tiles_min1
valid_direction_max9.933333333333309
valid_direction_median4.499999999999984
valid_direction_min0.13333333333333375
No reset possible
372208Florian GolemoPyTorch DDPG templateaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-298510:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
371207Florian GolemoPyTorch DDPG templateaido1_LF1_r2-v3step1-simulationerroryesnutonomy-P50-298510:00:33
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 392, in run
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/challenge_results.py", line 65, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r2-v3/submission207/step1-simulation-nutonomy-P50-29851-job371/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
370206Vadim Volodin 🇷🇺Random executionaido1_LF1_r2-v3step2-scoringsuccessyesnutonomy-P50-298510:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean2.373333333333332
good_angle_mean3.2448348216917005
valid_direction_mean0.7733333333333331


other stats
episodes
details{"ep000": {"nsteps": 60, "reward": -18.55895467996597, "good_angle": 8.631361811097454, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 1.4000000000000028}, "ep001": {"nsteps": 125, "reward": -8.8210487947464, "good_angle": 5.922127375530279, "survival_time": 4.166666666666662, "traveled_tiles": 3, "valid_direction": 1.399999999999995}, "ep002": {"nsteps": 40, "reward": -26.14327304959297, "good_angle": 1.60895172094825, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.066666666666667}, "ep003": {"nsteps": 15, "reward": -68.38100338776907, "good_angle": 0.017532853174180282, "survival_time": 0.49999999999999994, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 116, "reward": -9.494371339903566, "good_angle": 0.04420034770833667, "survival_time": 3.8666666666666623, "traveled_tiles": 4, "valid_direction": 0}}
good_angle_max8.631361811097454
good_angle_median1.60895172094825
good_angle_min0.017532853174180282
reward_max-8.8210487947464
reward_mean-26.279730250395595
reward_median-18.55895467996597
reward_min-68.38100338776907
survival_time_max4.166666666666662
survival_time_median2.0000000000000027
survival_time_min0.49999999999999994
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_min1
valid_direction_max1.4000000000000028
valid_direction_median1.066666666666667
valid_direction_min0
No reset possible
367205Vadim Volodin 🇷🇺Random executionaido1_LF1_r2-v3step2-scoringsuccessyesnutonomy-P50-298510:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean2.373333333333332
good_angle_mean3.2448348216917005
valid_direction_mean0.7733333333333331


other stats
episodes
details{"ep000": {"nsteps": 60, "reward": -18.55895467996597, "good_angle": 8.631361811097454, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 1.4000000000000028}, "ep001": {"nsteps": 125, "reward": -8.8210487947464, "good_angle": 5.922127375530279, "survival_time": 4.166666666666662, "traveled_tiles": 3, "valid_direction": 1.399999999999995}, "ep002": {"nsteps": 40, "reward": -26.14327304959297, "good_angle": 1.60895172094825, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.066666666666667}, "ep003": {"nsteps": 15, "reward": -68.38100338776907, "good_angle": 0.017532853174180282, "survival_time": 0.49999999999999994, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 116, "reward": -9.494371339903566, "good_angle": 0.04420034770833667, "survival_time": 3.8666666666666623, "traveled_tiles": 4, "valid_direction": 0}}
good_angle_max8.631361811097454
good_angle_median1.60895172094825
good_angle_min0.017532853174180282
reward_max-8.8210487947464
reward_mean-26.279730250395595
reward_median-18.55895467996597
reward_min-68.38100338776907
survival_time_max4.166666666666662
survival_time_median2.0000000000000027
survival_time_min0.49999999999999994
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_min1
valid_direction_max1.4000000000000028
valid_direction_median1.066666666666667
valid_direction_min0
No reset possible
358200Vadim Volodin 🇷🇺Random executionaido1_LF1_r2-v3step1-simulationfailedyesnutonomy-P50-298510:00:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 475, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
no display name and no $DISPLAY environment variable
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357199Vadim Volodin 🇷🇺Random executionaido1_LF1_r2-v3step1-simulationerroryesnutonomy-P50-298510:00:26
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 390, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job357-3107', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job357-3107', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356198Vadim Volodin 🇷🇺Random executionaido1_LF1_r2-v3step1-simulationerroryesnutonomy-P50-298510:00:52
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 390, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job356-848', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job356-848', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
355197Valentina CavinatoSolution templateaido1_luck-v3step1successyesnutonomy-P50-298510:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score164.07209409824752


No reset possible
347192Florian GolemoPyTorch DDPG templateaido1_LF1_r2-v3step2-scoringsuccessyesnutonomy-P50-298510:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean6.079999999999986
good_angle_mean8.45617042428934
valid_direction_mean8.046666666666647


other stats
episodes
details{"ep000": {"nsteps": 394, "reward": -3.370693950449958, "good_angle": 11.343999880429273, "survival_time": 13.133333333333296, "traveled_tiles": 1, "valid_direction": 10.199999999999973}, "ep001": {"nsteps": 500, "reward": -1.25926672418043, "good_angle": 13.180552928645549, "survival_time": 13.099999999999964, "traveled_tiles": 4, "valid_direction": 13.69999999999996}, "ep002": {"nsteps": 86, "reward": -14.377910724906034, "good_angle": 2.5432345175564968, "survival_time": 2.8666666666666663, "traveled_tiles": 1, "valid_direction": 2.2666666666666657}, "ep003": {"nsteps": 42, "reward": -25.58774640091828, "good_angle": 2.191111047259704, "survival_time": 0.6666666666666666, "traveled_tiles": 2, "valid_direction": 1.233333333333333}, "ep004": {"nsteps": 500, "reward": -1.1381773105587345, "good_angle": 13.02195374755568, "survival_time": 0.6333333333333333, "traveled_tiles": 3, "valid_direction": 12.833333333333298}}
good_angle_max13.180552928645549
good_angle_median11.343999880429273
good_angle_min2.191111047259704
reward_max-1.1381773105587345
reward_mean-9.146759022202689
reward_median-3.370693950449958
reward_min-25.58774640091828
survival_time_max13.133333333333296
survival_time_median2.8666666666666663
survival_time_min0.6333333333333333
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_min1
valid_direction_max13.69999999999996
valid_direction_median10.199999999999973
valid_direction_min1.233333333333333
No reset possible
344190Florian GolemoPyTorch DDPG templateaido1_LF1_r2-v3step1-simulationerroryesnutonomy-P50-298510:00:30
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 392, in run
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/challenge_results.py", line 65, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r2-v3/submission190/step1-simulation-nutonomy-P50-29851-job344/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
343189Florian GolemoPyTorch DDPG templateaido1_LF1_r2-v3step1-simulationerroryesnutonomy-P50-298510:02:49
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 392, in run
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/challenge_results.py", line 65, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r2-v3/submission189/step1-simulation-nutonomy-P50-29851-job343/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
340187Brian Wang 🇺🇸ROS-based Lane Followingaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-298510:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
338186Christina ChangRandom executionaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-298510:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
337185Anna Tsalapova 🇷🇺Random executionaido1_LF1_r2-v3step1-simulationerroryesnutonomy-P50-298510:00:31
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 390, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job337-8405', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job337-8405', 'up', '--abort-on-container-exit']' returned non-zero exit status 2

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
333183Vadim Volodin 🇷🇺Random executionaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-298510:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
332182Martin Weiss 🇨🇦Tensorflow templateaido1_LF1_r2-v3step2-scoringsuccessyesnutonomy-P50-298510:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean3.0933333333333293
good_angle_mean0.8501688741545749
valid_direction_mean1.0799999999999996


other stats
episodes
details{"ep000": {"nsteps": 45, "reward": -22.730665498682193, "good_angle": 2.464011645649803, "survival_time": 1.500000000000001, "traveled_tiles": 3, "valid_direction": 1.400000000000001}, "ep001": {"nsteps": 108, "reward": -9.473568658999822, "good_angle": 0.21552867377610185, "survival_time": 3.599999999999997, "traveled_tiles": 2, "valid_direction": 0.5333333333333314}, "ep002": {"nsteps": 237, "reward": -4.432748170956362, "good_angle": 0.44670148280839816, "survival_time": 7.899999999999982, "traveled_tiles": 5, "valid_direction": 0.6666666666666666}, "ep003": {"nsteps": 39, "reward": -27.649678062934143, "good_angle": 0.3397014953042005, "survival_time": 1.3000000000000007, "traveled_tiles": 1, "valid_direction": 0.9000000000000002}, "ep004": {"nsteps": 111, "reward": -9.79464570846438, "good_angle": 0.7849010732343709, "survival_time": 1.166666666666667, "traveled_tiles": 5, "valid_direction": 1.899999999999998}}
good_angle_max2.464011645649803
good_angle_median0.44670148280839816
good_angle_min0.21552867377610185
reward_max-4.432748170956362
reward_mean-14.81626122000738
reward_median-9.79464570846438
reward_min-27.649678062934143
survival_time_max7.899999999999982
survival_time_median1.500000000000001
survival_time_min1.166666666666667
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_min1
valid_direction_max1.899999999999998
valid_direction_median0.9000000000000002
valid_direction_min0.5333333333333314
No reset possible
328179Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-298510:00:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 480, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
326178Florian GolemoTensorflow templateaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-298510:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
316170Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-298510:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
314169Dylan Chiu 🇺🇸Random executionaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-298510:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
305165Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-298512:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
303166Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step3-videosabortednonutonomy-P50-298512:02:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
299144Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-298512:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.8184365517195549, "good_angle": 50.795966412804106, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.033333333333324}, "ep001": {"nsteps": 500, "reward": -0.9623222973942755, "good_angle": 10.983964048937157, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.13333333333333}, "ep002": {"nsteps": 500, "reward": -0.6675195905930014, "good_angle": 40.925411343247376, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 15.266666666666657}, "ep003": {"nsteps": 500, "reward": -1.0838831386975945, "good_angle": 60.591540085165526, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 11.699999999999989}, "ep004": {"nsteps": 500, "reward": -0.22700107742531692, "good_angle": 13.626091124112616, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.433333333333332}}
good_angle_max60.591540085165526
good_angle_mean35.384594602853355
good_angle_median40.925411343247376
good_angle_min10.983964048937157
reward_max-0.22700107742531692
reward_mean-0.9518325311659488
reward_median-0.9623222973942755
reward_min-1.8184365517195549
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max15.266666666666657
valid_direction_mean12.913333333333329
valid_direction_median12.433333333333332
valid_direction_min11.699999999999989
No reset possible
279151Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r2-v3step1-simulationfailedyesnutonomy-P50-298512:00:21
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 475, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 575, in wrap_solution
    solution.run(cis)
  File "solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: The name 'x' looks like an (invalid) Operation name, not a Tensor. Tensor names must be of the form "<op_name>:<output_index>".
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
278150Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-298512:00:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 480, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 575, in wrap_solution
    solution.run(cis)
  File "solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
276148Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-298512:00:14
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 376, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job276-3393', 'pull']:

   >  Command '['docker-compose', '-p', 'job276-3393', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
274147Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-298512:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
272144Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-298512:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.699999999999976


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.0368080102205277, "good_angle": 9.42087440065101, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.16666666666666}, "ep001": {"nsteps": 291, "reward": -4.621755821700768, "good_angle": 7.638457668088401, "survival_time": 9.699999999999976, "traveled_tiles": 1, "valid_direction": 7.499999999999982}, "ep002": {"nsteps": 212, "reward": -6.904545187367234, "good_angle": 3.0420365784389394, "survival_time": 7.066666666666651, "traveled_tiles": 2, "valid_direction": 4.499999999999989}, "ep003": {"nsteps": 226, "reward": -6.114864278156145, "good_angle": 2.2360597559888977, "survival_time": 7.533333333333316, "traveled_tiles": 1, "valid_direction": 3.1666666666666594}, "ep004": {"nsteps": 500, "reward": -1.393642165839672, "good_angle": 24.11772828936881, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.333333333333323}}
good_angle_max24.11772828936881
good_angle_mean9.29103133850721
good_angle_median7.638457668088401
good_angle_min2.2360597559888977
reward_max-1.0368080102205277
reward_mean-4.014323092656869
reward_median-4.621755821700768
reward_min-6.904545187367234
survival_time_max16.666666666666654
survival_time_mean11.526666666666651
survival_time_min7.066666666666651
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.333333333333323
valid_direction_mean8.333333333333323
valid_direction_median7.499999999999982
valid_direction_min3.1666666666666594
No reset possible
271145Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r2-v3step1-simulationerroryesnutonomy-P50-298512:00:27
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 390, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job271-9270', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job271-9270', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
269143Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r2-v3step1-simulationerroryesnutonomy-P50-298512:01:13
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 390, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job269-1607', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job269-1607', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24574Andrea Censi 🇨🇭Random executionaido1_LF1_r2-v3step2-scoringsuccessyesnutonomy-P50-298512:00:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean16.613333333333316
good_angle_mean24.321069173130446
valid_direction_mean12.939999999999989


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.384782737998059, "good_angle": 5.302062623203629, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 9.200000000000008}, "ep001": {"nsteps": 500, "reward": -1.8181573605537416, "good_angle": 41.58071516898813, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 15.099999999999984}, "ep002": {"nsteps": 500, "reward": -1.68496368095465, "good_angle": 46.651669523471675, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 14.999999999999988}, "ep003": {"nsteps": 500, "reward": -0.3886898622313747, "good_angle": 15.727589698195596, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 13.133333333333324}, "ep004": {"nsteps": 500, "reward": -0.8847563000619412, "good_angle": 12.34330885179318, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 12.26666666666664}}
good_angle_max46.651669523471675
good_angle_median15.727589698195596
good_angle_min5.302062623203629
reward_max-0.384782737998059
reward_mean-1.032269988359953
reward_median-0.8847563000619412
reward_min-1.8181573605537416
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_min1
valid_direction_max15.099999999999984
valid_direction_median13.133333333333324
valid_direction_min9.200000000000008
No reset possible
24474Andrea Censi 🇨🇭Random executionaido1_LF1_r2-v3step1-simulationsuccessyesnutonomy-P50-298512:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
234125Andrea Censi 🇨🇭Solution templateaido1_luck-v3step1successyesnutonomy-P50-298512:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score113.972385273734917


No reset possible