Duckietown Challenges Home Challenges Submissions

Evaluator 1048

ID1048
evaluatorip-172-31-42-167-7194
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7194
versiond-c:4.0.28;d-c-r:4.0.39;d-s:4.0.21
first heard
last heard
statusinactive
# evaluating
# success1 21987
# timeout
# failed
# error
# aborted
# host-error1 21975
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
219873372Amaury Camus 🇨🇭challenge-aido_LF-template-randomaido2-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-42-167-71940:08:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.15267727275689444
agent_compute-ego_mean0.1454741796382541
agent_compute-ego_median0.14604452281322294
agent_compute-ego_min0.13142934015819005
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1933933873719807, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06134376646597174, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1455483074429669, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.0907490494885022, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.037408185910575, "sim_compute_performance-ego": 0.06600958787942235, "sim_compute_robot_state-ego": 0.06899155544329293, "sim_compute_robot_state-npc0": 0.06650278236292585, "sim_compute_robot_state-npc1": 0.07020902633666992, "sim_compute_robot_state-npc2": 0.06611486929881422, "sim_compute_robot_state-npc3": 0.06513085546372813}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.17969062498637609, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.05237506968634469, "in-drivable-lane": 0, "agent_compute-ego": 0.13142934015819005, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.08915302583149501, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.035370979990277975, "sim_compute_performance-ego": 0.05671955857958112, "sim_compute_robot_state-ego": 0.06209072044917515, "sim_compute_robot_state-npc0": 0.06602311134338379, "sim_compute_robot_state-npc1": 0.061875104904174805, "sim_compute_robot_state-npc2": 0.06090045826775687, "sim_compute_robot_state-npc3": 0.05991837808064052}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.17452095550240823, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.059395551681518555, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14604452281322294, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.09025384615925908, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03703044224711298, "sim_compute_performance-ego": 0.07572930530436987, "sim_compute_robot_state-ego": 0.0683454286704943, "sim_compute_robot_state-npc0": 0.06783724988548501, "sim_compute_robot_state-npc1": 0.06490196070624786, "sim_compute_robot_state-npc2": 0.06635062671402125, "sim_compute_robot_state-npc3": 0.06455164511226913}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2218214323123296, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.0678683469692866, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.15267727275689444, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.09488571186860402, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.039956693847974144, "sim_compute_performance-ego": 0.07116846243540446, "sim_compute_robot_state-ego": 0.0778955618540446, "sim_compute_robot_state-npc0": 0.07435158888498943, "sim_compute_robot_state-npc1": 0.07136772572994232, "sim_compute_robot_state-npc2": 0.06957089900970459, "sim_compute_robot_state-npc3": 0.07153470814228058}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1865890139625186, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06031613122849237, "in-drivable-lane": 0, "agent_compute-ego": 0.1516714550199963, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.08666941097804479, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03677881331670852, "sim_compute_performance-ego": 0.06451129913330078, "sim_compute_robot_state-ego": 0.07071071579342797, "sim_compute_robot_state-npc0": 0.06760413306100028, "sim_compute_robot_state-npc1": 0.07045818510509673, "sim_compute_robot_state-npc2": 0.07128590629214332, "sim_compute_robot_state-npc3": 0.06849785078139532}}
set_robot_commands_max0.09488571186860402
set_robot_commands_mean0.09034220886518105
set_robot_commands_median0.09025384615925908
set_robot_commands_min0.08666941097804479
sim_compute_performance-ego_max0.07572930530436987
sim_compute_performance-ego_mean0.06682764266641572
sim_compute_performance-ego_median0.06600958787942235
sim_compute_performance-ego_min0.05671955857958112
sim_compute_robot_state-ego_max0.0778955618540446
sim_compute_robot_state-ego_mean0.06960679644208699
sim_compute_robot_state-ego_median0.06899155544329293
sim_compute_robot_state-ego_min0.06209072044917515
sim_compute_robot_state-npc0_max0.07435158888498943
sim_compute_robot_state-npc0_mean0.06846377310755687
sim_compute_robot_state-npc0_median0.06760413306100028
sim_compute_robot_state-npc0_min0.06602311134338379
sim_compute_robot_state-npc1_max0.07136772572994232
sim_compute_robot_state-npc1_mean0.06776240055642632
sim_compute_robot_state-npc1_median0.07020902633666992
sim_compute_robot_state-npc1_min0.061875104904174805
sim_compute_robot_state-npc2_max0.07128590629214332
sim_compute_robot_state-npc2_mean0.06684455191648805
sim_compute_robot_state-npc2_median0.06635062671402125
sim_compute_robot_state-npc2_min0.06090045826775687
sim_compute_robot_state-npc3_max0.07153470814228058
sim_compute_robot_state-npc3_mean0.06592668751606273
sim_compute_robot_state-npc3_median0.06513085546372813
sim_compute_robot_state-npc3_min0.05991837808064052
sim_compute_sim_state_max0.039956693847974144
sim_compute_sim_state_mean0.03730902306252972
sim_compute_sim_state_median0.03703044224711298
sim_compute_sim_state_min0.035370979990277975
sim_physics_max0.2218214323123296
sim_physics_mean0.19120308282712264
sim_physics_median0.1865890139625186
sim_physics_min0.17452095550240823
sim_render-ego_max0.0678683469692866
sim_render-ego_mean0.060259773206322795
sim_render-ego_median0.06031613122849237
sim_render-ego_min0.05237506968634469
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
No reset possible
219753376Lei Chenchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationhost-errornoip-172-31-42-167-71940:04:53
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1066, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job21975-675463', 'down']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 535, in get_cr
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1071, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job21975-675463', 'down']:

   >  Command '['docker-compose', '-p', 'job21975-675463', 'down']' returned non-zero exit status 1.

stdout | 

stderr | 
stderr |         Can't find a suitable configuration file in this directory or any
stderr |         parent. Are you in the right directory?
stderr | 
stderr |         Supported filenames: docker-compose.yml, docker-compose.yaml
stderr | 
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible