Duckietown Challenges Home Challenges Submissions

Evaluator 448

ID448
evaluatornctuece-17200
ownerEric Lu
machinenctuece
processnctuece-17200
versionDC:3.1.58;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success11 16783
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
167932223Leul Shiferaw 🇩🇪Solution templateaido1_luck-v3step1successyesnctuece-172000:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score193.90596800208029


No reset possible
167922224Fábián Füleki 🇭🇺Solution templateaido1_luck-v3step1successyesnctuece-172000:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score170.5423610307709


No reset possible
167912225Michael Torku 🇬🇭Solution templateaido1_luck-v3step1successyesnctuece-172000:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score173.48394220991503


No reset possible
167902230Eric LuPyTorch DDPG templateaido1_LF1_r4_cont-v3step4-vizsuccessyesnctuece-172000:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.32853221949848965
deviation-center-line_median0.02334311930308497
in-drivable-lane_median0.26666666666666666


other stats
deviation-center-line_max0.028726704193768972
deviation-center-line_mean0.020256306749833173
deviation-center-line_min0
deviation-heading_max0.18488963209976303
deviation-heading_mean0.1336017068818251
deviation-heading_median0.14847681315848224
deviation-heading_min0
driven_any_max1.0077416576972456
driven_any_mean0.7019527847210575
driven_any_median0.6838246962945611
driven_any_min0.5227951292821877
driven_lanedir_consec_max0.3723001417651777
driven_lanedir_consec_mean0.2784186026056288
driven_lanedir_consec_min0
driven_lanedir_max0.3723001417651777
driven_lanedir_mean0.2784186026056288
driven_lanedir_median0.32853221949848965
driven_lanedir_min0
in-drivable-lane_max0.6333333333333332
in-drivable-lane_mean0.35238095238095235
in-drivable-lane_min0.26666666666666666
per-episodes
details{"ep000": {"driven_any": 0.5227951292821877, "driven_lanedir": 0, "in-drivable-lane": 0.5, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 0.6838246962945611, "driven_lanedir": 0.34659066866010235, "in-drivable-lane": 0.26666666666666666, "deviation-heading": 0.14847681315848224, "deviation-center-line": 0.02334311930308497, "driven_lanedir_consec": 0.34659066866010235}, "ep002": {"driven_any": 1.0077416576972456, "driven_lanedir": 0.27972031436770184, "in-drivable-lane": 0.6333333333333332, "deviation-heading": 0.13755141719877548, "deviation-center-line": 0.0182110672170524, "driven_lanedir_consec": 0.27972031436770184}, "ep003": {"driven_any": 0.6838246962945597, "driven_lanedir": 0.341257286844038, "in-drivable-lane": 0.26666666666666666, "deviation-heading": 0.1599600949114975, "deviation-center-line": 0.02503206591821061, "driven_lanedir_consec": 0.341257286844038}, "ep004": {"driven_any": 0.6838246962945619, "driven_lanedir": 0.32853221949848965, "in-drivable-lane": 0.26666666666666666, "deviation-heading": 0.18488963209976303, "deviation-center-line": 0.02864264336773884, "driven_lanedir_consec": 0.32853221949848965}, "ep005": {"driven_any": 0.7198154678680998, "driven_lanedir": 0.3723001417651777, "in-drivable-lane": 0.26666666666666666, "deviation-heading": 0.1702133096615694, "deviation-center-line": 0.028726704193768972, "driven_lanedir_consec": 0.3723001417651777}, "ep006": {"driven_any": 0.6118431493161868, "driven_lanedir": 0.280529587103892, "in-drivable-lane": 0.26666666666666666, "deviation-heading": 0.134120681142688, "deviation-center-line": 0.017838547248976423, "driven_lanedir_consec": 0.280529587103892}}
No reset possible
167892230Eric LuPyTorch DDPG templateaido1_LF1_r4_cont-v3step3-videossuccessyesnctuece-172000:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
167882230Eric LuPyTorch DDPG templateaido1_LF1_r4_cont-v3step2-scoringsuccessyesnctuece-172000:00:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.6666666666666666


other stats
episodes
details{"ep000": {"nsteps": 16, "reward": -63.79387430101633, "good_angle": 0.11997778164535244, "survival_time": 0.5333333333333333, "traveled_tiles": 1, "valid_direction": 0.26666666666666666}, "ep001": {"nsteps": 20, "reward": -50.31161011345685, "good_angle": 0.5192716811551052, "survival_time": 0.6666666666666666, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}, "ep002": {"nsteps": 29, "reward": -35.265372710623616, "good_angle": 0.29881233094038684, "survival_time": 0.9666666666666666, "traveled_tiles": 3, "valid_direction": 0.5999999999999999}, "ep003": {"nsteps": 20, "reward": -50.37483152616769, "good_angle": 0.5515131875305687, "survival_time": 0.6666666666666666, "traveled_tiles": 1, "valid_direction": 0.5333333333333332}, "ep004": {"nsteps": 20, "reward": -50.50922786220908, "good_angle": 0.6191891306005425, "survival_time": 0.6666666666666666, "traveled_tiles": 1, "valid_direction": 0.5333333333333332}, "ep005": {"nsteps": 21, "reward": -48.024203301895234, "good_angle": 0.5808302596162124, "survival_time": 0.7, "traveled_tiles": 2, "valid_direction": 0.5333333333333332}, "ep006": {"nsteps": 18, "reward": -55.55920394975692, "good_angle": 0.7382167392215803, "survival_time": 0.6, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}}
good_angle_max0.7382167392215803
good_angle_mean0.489687301529964
good_angle_median0.5515131875305687
good_angle_min0.11997778164535244
reward_max-35.265372710623616
reward_mean-50.54833196644653
reward_median-50.37483152616769
reward_min-63.79387430101633
survival_time_max0.9666666666666666
survival_time_mean0.6857142857142856
survival_time_min0.5333333333333333
traveled_tiles_max3
traveled_tiles_mean1.7142857142857142
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.5999999999999999
valid_direction_mean0.49523809523809514
valid_direction_median0.5333333333333332
valid_direction_min0.26666666666666666
No reset possible
167872230Eric LuPyTorch DDPG templateaido1_LF1_r4_cont-v3step1-simulationsuccessyesnctuece-172000:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
167862226Ka Yue Fung 🇭🇰Solution templateaido1_luck-v3step1successyesnctuece-172000:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score139.872882382609504


No reset possible
167852227Oleg SuzdalevSolution templateaido1_luck-v3step1successyesnctuece-172000:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score187.03897003606423


No reset possible
167842228Egor ZamotaevSolution templateaido1_luck-v3step1successyesnctuece-172000:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score18.477818623995802


No reset possible
167832229Peter Almasi 🇭🇺Solution templateaido1_luck-v3step1successyesnctuece-172000:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score162.074885877037374


No reset possible