Duckietown Challenges Home Challenges Submissions

Evaluator 2184

ID2184
evaluatormont04-2d53ef3af4c5-1
ownerI don't have one 😀
machineaido-ms-7b09
processmont04-2d53ef3af4c5-1
versiond-c:6.1.20;d-c-r:6.0.49
first heard
last heard
statusinactive
# evaluating
# success6 38002
# timeout
# failed1 37999
# error
# aborted
# host-error5 38106
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
381259367Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simhost-errornomont04-2d53ef3af4c5-10:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.49-py3.8.egg/duckietown_challenges_runner/runner.py", line 654, in get_cr
    os.makedirs(wd)
  File "/usr/lib/python3.8/os.py", line 213, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/usr/lib/python3.8/os.py", line 213, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/usr/lib/python3.8/os.py", line 223, in makedirs
    mkdir(name, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
381209362Philippe Reddy 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornomont04-2d53ef3af4c5-10:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.49-py3.8.egg/duckietown_challenges_runner/runner.py", line 654, in get_cr
    os.makedirs(wd)
  File "/usr/lib/python3.8/os.py", line 213, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/usr/lib/python3.8/os.py", line 213, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/usr/lib/python3.8/os.py", line 223, in makedirs
    mkdir(name, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
381169369Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornomont04-2d53ef3af4c5-10:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.49-py3.8.egg/duckietown_challenges_runner/runner.py", line 654, in get_cr
    os.makedirs(wd)
  File "/usr/lib/python3.8/os.py", line 213, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/usr/lib/python3.8/os.py", line 213, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/usr/lib/python3.8/os.py", line 223, in makedirs
    mkdir(name, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
381139370Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornomont04-2d53ef3af4c5-10:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.49-py3.8.egg/duckietown_challenges_runner/runner.py", line 654, in get_cr
    os.makedirs(wd)
  File "/usr/lib/python3.8/os.py", line 213, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/usr/lib/python3.8/os.py", line 213, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/usr/lib/python3.8/os.py", line 223, in makedirs
    mkdir(name, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
381069364Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornomont04-2d53ef3af4c5-10:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.49-py3.8.egg/duckietown_challenges_runner/runner.py", line 654, in get_cr
    os.makedirs(wd)
  File "/usr/lib/python3.8/os.py", line 213, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/usr/lib/python3.8/os.py", line 213, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/usr/lib/python3.8/os.py", line 223, in makedirs
    mkdir(name, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
380319779Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simsuccessnomont04-2d53ef3af4c5-10:11:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7344519650134542
survival_time_median12.100000000000035
deviation-center-line_median0.35599399877866755
in-drivable-lane_median3.4500000000000344


other stats
agent_compute-ego_max0.05167332321706444
agent_compute-ego_mean0.05077270132341551
agent_compute-ego_median0.05057844695966106
agent_compute-ego_min0.05026058815727549
complete-iteration_max0.22183829989315065
complete-iteration_mean0.21480774593309485
complete-iteration_median0.21313384268018937
complete-iteration_min0.21112499847885005
deviation-center-line_max0.41963626168104873
deviation-center-line_mean0.3582275436189119
deviation-center-line_min0.3012859152372636
deviation-heading_max1.585616433963709
deviation-heading_mean1.1054399239233672
deviation-heading_median0.992620054963364
deviation-heading_min0.8509031518030308
driven_any_max3.5737169185582354
driven_any_mean2.9163935625126265
driven_any_median2.876653530713091
driven_any_min2.3385502700660883
driven_lanedir_consec_max2.027263920244569
driven_lanedir_consec_mean1.6972118120868327
driven_lanedir_consec_min1.2926793980758542
driven_lanedir_max2.027263920244569
driven_lanedir_mean1.6972118120868327
driven_lanedir_median1.7344519650134542
driven_lanedir_min1.2926793980758542
get_duckie_state_max3.4107649621884684e-06
get_duckie_state_mean3.210152366820336e-06
get_duckie_state_median3.197111045690279e-06
get_duckie_state_min3.0356224137123184e-06
get_robot_state_max0.012685510847303605
get_robot_state_mean0.01261701074951389
get_robot_state_median0.012617947148882654
get_robot_state_min0.012546637852986651
get_state_dump_max0.013025130122161109
get_state_dump_mean0.012853166392574188
get_state_dump_median0.01286117952826704
get_state_dump_min0.012665176391601562
get_ui_image_max0.03301725546518962
get_ui_image_mean0.03247462484571669
get_ui_image_median0.03260060873898593
get_ui_image_min0.03168002643970528
in-drivable-lane_max9.000000000000044
in-drivable-lane_mean4.81250000000004
in-drivable-lane_min3.3500000000000476
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.3385502700660883, "get_ui_image": 0.03168002643970528, "step_physics": 0.06803253804794465, "survival_time": 9.900000000000006, "driven_lanedir": 1.451249530011392, "get_state_dump": 0.012851564571110889, "sim_render-ego": 0.005258849172881155, "get_robot_state": 0.012685510847303605, "get_duckie_state": 3.0356224137123184e-06, "in-drivable-lane": 3.5000000000000204, "agent_compute-ego": 0.05167332321706444, "deviation-heading": 0.9192021347883612, "complete-iteration": 0.21237439579433864, "set_robot_commands": 0.0045705720631763185, "deviation-center-line": 0.3012859152372636, "driven_lanedir_consec": 1.451249530011392, "sim_compute_sim_state": 0.02191523831300061, "sim_compute_performance-ego": 0.003565606444773048}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.8766520607434596, "get_ui_image": 0.03220240636305376, "step_physics": 0.06779870908122418, "survival_time": 12.100000000000035, "driven_lanedir": 2.027263920244569, "get_state_dump": 0.013025130122161109, "sim_render-ego": 0.0052663334145033654, "get_robot_state": 0.012588212312745654, "get_duckie_state": 3.2383548326728756e-06, "in-drivable-lane": 3.3500000000000476, "agent_compute-ego": 0.05026058815727549, "deviation-heading": 1.0660379751383668, "complete-iteration": 0.21112499847885005, "set_robot_commands": 0.004553001774244072, "deviation-center-line": 0.3572708818143829, "driven_lanedir_consec": 2.027263920244569, "sim_compute_sim_state": 0.021708131821687557, "sim_compute_performance-ego": 0.0035808559291618915}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.5737169185582354, "get_ui_image": 0.03301725546518962, "step_physics": 0.06894038279851278, "survival_time": 14.950000000000076, "driven_lanedir": 1.2926793980758542, "get_state_dump": 0.012665176391601562, "sim_render-ego": 0.005294725894927978, "get_robot_state": 0.012546637852986651, "get_duckie_state": 3.1558672587076822e-06, "in-drivable-lane": 9.000000000000044, "agent_compute-ego": 0.050613698959350584, "deviation-heading": 1.585616433963709, "complete-iteration": 0.21389328956604003, "set_robot_commands": 0.004621560573577881, "deviation-center-line": 0.41963626168104873, "driven_lanedir_consec": 1.2926793980758542, "sim_compute_sim_state": 0.02248704671859741, "sim_compute_performance-ego": 0.003564966519673666}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8766550006827223, "get_ui_image": 0.0329988111149181, "step_physics": 0.07452035442856718, "survival_time": 12.100000000000035, "driven_lanedir": 2.0176544000155165, "get_state_dump": 0.01287079448542319, "sim_render-ego": 0.005188042467290705, "get_robot_state": 0.012647681985019652, "get_duckie_state": 3.4107649621884684e-06, "in-drivable-lane": 3.4000000000000483, "agent_compute-ego": 0.05054319495997153, "deviation-heading": 0.8509031518030308, "complete-iteration": 0.22183829989315065, "set_robot_commands": 0.004570978732148478, "deviation-center-line": 0.3547171157429522, "driven_lanedir_consec": 2.0176544000155165, "sim_compute_sim_state": 0.024822223285012993, "sim_compute_performance-ego": 0.003530840243189788}}
set_robot_commands_max0.004621560573577881
set_robot_commands_mean0.004579028285786687
set_robot_commands_median0.004570775397662399
set_robot_commands_min0.004553001774244072
sim_compute_performance-ego_max0.0035808559291618915
sim_compute_performance-ego_mean0.0035605672841995985
sim_compute_performance-ego_median0.0035652864822233567
sim_compute_performance-ego_min0.003530840243189788
sim_compute_sim_state_max0.024822223285012993
sim_compute_sim_state_mean0.022733160034574644
sim_compute_sim_state_median0.02220114251579901
sim_compute_sim_state_min0.021708131821687557
sim_render-ego_max0.005294725894927978
sim_render-ego_mean0.0052519877374008015
sim_render-ego_median0.00526259129369226
sim_render-ego_min0.005188042467290705
simulation-passed1
step_physics_max0.07452035442856718
step_physics_mean0.0698229960890622
step_physics_median0.06848646042322871
step_physics_min0.06779870908122418
survival_time_max14.950000000000076
survival_time_mean12.262500000000038
survival_time_min9.900000000000006
No reset possible
3802910819Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnomont04-2d53ef3af4c5-10:08:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8815182792364649
survival_time_median14.950000000000076
deviation-center-line_median0.6034722855164533
in-drivable-lane_median0.6750000000000096


other stats
agent_compute-ego_max0.016997249921162923
agent_compute-ego_mean0.01692022681236267
agent_compute-ego_median0.01689755121866862
agent_compute-ego_min0.016888554890950522
complete-iteration_max0.19085183302561445
complete-iteration_mean0.18296918014685315
complete-iteration_median0.18134369095166525
complete-iteration_min0.17833750565846762
deviation-center-line_max0.7215922389315301
deviation-center-line_mean0.6043622841348152
deviation-center-line_min0.4889123265748239
deviation-heading_max3.990815539386788
deviation-heading_mean2.564858315955463
deviation-heading_median2.3604313618402752
deviation-heading_min1.5477550007545149
driven_any_max2.031166281768885
driven_any_mean2.0253879542440947
driven_any_median2.024757083050501
driven_any_min2.020871369106492
driven_lanedir_consec_max1.9567573946909609
driven_lanedir_consec_mean1.79455876089332
driven_lanedir_consec_min1.45844109040939
driven_lanedir_max1.9567573946909609
driven_lanedir_mean1.79455876089332
driven_lanedir_median1.8815182792364649
driven_lanedir_min1.45844109040939
get_duckie_state_max2.4708112080891927e-06
get_duckie_state_mean2.422134081522624e-06
get_duckie_state_median2.4453798929850263e-06
get_duckie_state_min2.32696533203125e-06
get_robot_state_max0.0129289444287618
get_robot_state_mean0.012755197882652284
get_robot_state_median0.0127827258904775
get_robot_state_min0.012526395320892334
get_state_dump_max0.012982505162556966
get_state_dump_mean0.012909294764200848
get_state_dump_median0.012936234474182127
get_state_dump_min0.01278220494588216
get_ui_image_max0.033629932403564454
get_ui_image_mean0.0328348445892334
get_ui_image_median0.03274398326873779
get_ui_image_min0.03222147941589355
in-drivable-lane_max3.0500000000000016
in-drivable-lane_mean1.150000000000006
in-drivable-lane_min0.20000000000000284
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.031166281768885, "get_ui_image": 0.03222147941589355, "step_physics": 0.06848950862884522, "survival_time": 14.950000000000076, "driven_lanedir": 1.819101609738433, "get_state_dump": 0.012949555714925133, "sim_render-ego": 0.005353247324625651, "get_robot_state": 0.012779916127522786, "get_duckie_state": 2.4708112080891927e-06, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.016997249921162923, "deviation-heading": 2.385441804854606, "complete-iteration": 0.17859930515289307, "set_robot_commands": 0.004408795833587647, "deviation-center-line": 0.6267808972865992, "driven_lanedir_consec": 1.819101609738433, "sim_compute_sim_state": 0.021587378978729248, "sim_compute_performance-ego": 0.003677675724029541}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.023425627085905, "get_ui_image": 0.03234123309453329, "step_physics": 0.06829620758692423, "survival_time": 14.950000000000076, "driven_lanedir": 1.9439349487344968, "get_state_dump": 0.012982505162556966, "sim_render-ego": 0.0054519255956014, "get_robot_state": 0.0129289444287618, "get_duckie_state": 2.4700164794921874e-06, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.016902701854705812, "deviation-heading": 2.3354209188259443, "complete-iteration": 0.17833750565846762, "set_robot_commands": 0.004547910690307617, "deviation-center-line": 0.4889123265748239, "driven_lanedir_consec": 1.9439349487344968, "sim_compute_sim_state": 0.021045185724894205, "sim_compute_performance-ego": 0.0037043102582295737}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.020871369106492, "get_ui_image": 0.0331467334429423, "step_physics": 0.07392772992451986, "survival_time": 14.950000000000076, "driven_lanedir": 1.45844109040939, "get_state_dump": 0.01278220494588216, "sim_render-ego": 0.005381805102030436, "get_robot_state": 0.012526395320892334, "get_duckie_state": 2.32696533203125e-06, "in-drivable-lane": 3.0500000000000016, "agent_compute-ego": 0.016888554890950522, "deviation-heading": 3.990815539386788, "complete-iteration": 0.18408807675043745, "set_robot_commands": 0.0045686093966166175, "deviation-center-line": 0.7215922389315301, "driven_lanedir_consec": 1.45844109040939, "sim_compute_sim_state": 0.021130483150482177, "sim_compute_performance-ego": 0.003598019282023112}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.0260885390150976, "get_ui_image": 0.033629932403564454, "step_physics": 0.07671515146891277, "survival_time": 14.950000000000076, "driven_lanedir": 1.9567573946909609, "get_state_dump": 0.012922913233439129, "sim_render-ego": 0.00530356486638387, "get_robot_state": 0.01278553565343221, "get_duckie_state": 2.420743306477865e-06, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.016892400582631428, "deviation-heading": 1.5477550007545149, "complete-iteration": 0.19085183302561445, "set_robot_commands": 0.004498465061187744, "deviation-center-line": 0.5801636737463073, "driven_lanedir_consec": 1.9567573946909609, "sim_compute_sim_state": 0.02433371941248576, "sim_compute_performance-ego": 0.003632168769836426}}
set_robot_commands_max0.0045686093966166175
set_robot_commands_mean0.004505945245424907
set_robot_commands_median0.004523187875747681
set_robot_commands_min0.004408795833587647
sim_compute_performance-ego_max0.0037043102582295737
sim_compute_performance-ego_mean0.003653043508529663
sim_compute_performance-ego_median0.0036549222469329833
sim_compute_performance-ego_min0.003598019282023112
sim_compute_sim_state_max0.02433371941248576
sim_compute_sim_state_mean0.022024191816647845
sim_compute_sim_state_median0.02135893106460571
sim_compute_sim_state_min0.021045185724894205
sim_render-ego_max0.0054519255956014
sim_render-ego_mean0.005372635722160339
sim_render-ego_median0.005367526213328044
sim_render-ego_min0.00530356486638387
simulation-passed1
step_physics_max0.07671515146891277
step_physics_mean0.07185714940230052
step_physics_median0.07120861927668254
step_physics_min0.06829620758692423
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3802610818Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnomont04-2d53ef3af4c5-10:08:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8075627140018825
survival_time_median14.950000000000076
deviation-center-line_median0.4239851063720234
in-drivable-lane_median10.42500000000006


other stats
agent_compute-ego_max0.01768954038619995
agent_compute-ego_mean0.017326715389887493
agent_compute-ego_median0.017303771177927654
agent_compute-ego_min0.01700977881749471
complete-iteration_max0.1921108595530192
complete-iteration_mean0.18358898560206097
complete-iteration_median0.1809243786334991
complete-iteration_min0.18039632558822633
deviation-center-line_max0.529885599509533
deviation-center-line_mean0.38916156251352874
deviation-center-line_min0.1787904378005351
deviation-heading_max2.0143022222442033
deviation-heading_mean1.398449906915612
deviation-heading_median1.4455720448196718
deviation-heading_min0.6883533157789009
driven_any_max3.0631333244185472
driven_any_mean3.0606167778492304
driven_any_median3.0631216175579756
driven_any_min3.0530905518624225
driven_lanedir_consec_max1.2002339179741597
driven_lanedir_consec_mean0.7961535792103911
driven_lanedir_consec_min0.36925497086364006
driven_lanedir_max1.2002339179741597
driven_lanedir_mean0.7961535792103911
driven_lanedir_median0.8075627140018825
driven_lanedir_min0.36925497086364006
get_duckie_state_max2.349217732747396e-06
get_duckie_state_mean2.233386039733887e-06
get_duckie_state_median2.220471700032552e-06
get_duckie_state_min2.143383026123047e-06
get_robot_state_max0.01285125732421875
get_robot_state_mean0.012665472428003949
get_robot_state_median0.01262867053349813
get_robot_state_min0.01255329132080078
get_state_dump_max0.013086320559183757
get_state_dump_mean0.012950054208437605
get_state_dump_median0.012919775247573852
get_state_dump_min0.012874345779418943
get_ui_image_max0.03402543942133585
get_ui_image_mean0.0329842879374822
get_ui_image_median0.03282616456349691
get_ui_image_min0.03225938320159912
in-drivable-lane_max12.700000000000076
in-drivable-lane_mean10.51250000000006
in-drivable-lane_min8.500000000000048
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.0530905518624225, "get_ui_image": 0.03225938320159912, "step_physics": 0.07044601202011108, "survival_time": 14.950000000000076, "driven_lanedir": 0.8529021393486591, "get_state_dump": 0.013086320559183757, "sim_render-ego": 0.005322652657826742, "get_robot_state": 0.01285125732421875, "get_duckie_state": 2.349217732747396e-06, "in-drivable-lane": 10.30000000000007, "agent_compute-ego": 0.017217488288879396, "deviation-heading": 1.1005997333873625, "complete-iteration": 0.18114840030670165, "set_robot_commands": 0.004370412031809489, "deviation-center-line": 0.4886654179466718, "driven_lanedir_consec": 0.8529021393486591, "sim_compute_sim_state": 0.02191260576248169, "sim_compute_performance-ego": 0.0035503236452738445}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.0631333244185472, "get_ui_image": 0.0327646549542745, "step_physics": 0.0696532662709554, "survival_time": 14.950000000000076, "driven_lanedir": 1.2002339179741597, "get_state_dump": 0.012945930957794187, "sim_render-ego": 0.005276821454366048, "get_robot_state": 0.012639095783233642, "get_duckie_state": 2.2824605305989585e-06, "in-drivable-lane": 8.500000000000048, "agent_compute-ego": 0.017390054066975913, "deviation-heading": 2.0143022222442033, "complete-iteration": 0.18039632558822633, "set_robot_commands": 0.004526524543762207, "deviation-center-line": 0.529885599509533, "driven_lanedir_consec": 1.2002339179741597, "sim_compute_sim_state": 0.021475218137105307, "sim_compute_performance-ego": 0.003587953249613444}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.063117610408127, "get_ui_image": 0.03288767417271932, "step_physics": 0.06978395064671834, "survival_time": 14.950000000000076, "driven_lanedir": 0.36925497086364006, "get_state_dump": 0.012874345779418943, "sim_render-ego": 0.005318593184153239, "get_robot_state": 0.01255329132080078, "get_duckie_state": 2.143383026123047e-06, "in-drivable-lane": 12.700000000000076, "agent_compute-ego": 0.01768954038619995, "deviation-heading": 0.6883533157789009, "complete-iteration": 0.18070035696029663, "set_robot_commands": 0.004421648979187012, "deviation-center-line": 0.1787904378005351, "driven_lanedir_consec": 0.36925497086364006, "sim_compute_sim_state": 0.02152438243230184, "sim_compute_performance-ego": 0.0035152077674865724}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.0631256247078245, "get_ui_image": 0.03402543942133585, "step_physics": 0.0770650863647461, "survival_time": 14.950000000000076, "driven_lanedir": 0.7622232886551059, "get_state_dump": 0.012893619537353516, "sim_render-ego": 0.005310455958048503, "get_robot_state": 0.012618245283762614, "get_duckie_state": 2.1584828694661457e-06, "in-drivable-lane": 10.550000000000049, "agent_compute-ego": 0.01700977881749471, "deviation-heading": 1.7905443562519816, "complete-iteration": 0.1921108595530192, "set_robot_commands": 0.004394529660542806, "deviation-center-line": 0.3593047947973751, "driven_lanedir_consec": 0.7622232886551059, "sim_compute_sim_state": 0.025052225589752196, "sim_compute_performance-ego": 0.003606038888295491}}
set_robot_commands_max0.004526524543762207
set_robot_commands_mean0.0044282788038253786
set_robot_commands_median0.004408089319864909
set_robot_commands_min0.004370412031809489
sim_compute_performance-ego_max0.003606038888295491
sim_compute_performance-ego_mean0.003564880887667338
sim_compute_performance-ego_median0.003569138447443644
sim_compute_performance-ego_min0.0035152077674865724
sim_compute_sim_state_max0.025052225589752196
sim_compute_sim_state_mean0.022491107980410256
sim_compute_sim_state_median0.02171849409739177
sim_compute_sim_state_min0.021475218137105307
sim_render-ego_max0.005322652657826742
sim_render-ego_mean0.005307130813598633
sim_render-ego_median0.005314524571100871
sim_render-ego_min0.005276821454366048
simulation-passed1
step_physics_max0.0770650863647461
step_physics_mean0.07173707882563274
step_physics_median0.0701149813334147
step_physics_min0.0696532662709554
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3802410813Francois Hebertsim-exercise-1aido5-LF-sim-validationLFv-simsuccessnomont04-2d53ef3af4c5-10:07:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.755034855000731
survival_time_median14.950000000000076
deviation-center-line_median0.7062953948997064
in-drivable-lane_median2.2250000000000316


other stats
agent_compute-ego_max0.017241461277008055
agent_compute-ego_mean0.017018136108788943
agent_compute-ego_median0.016983527987943284
agent_compute-ego_min0.01686402718226115
complete-iteration_max0.19138659477233888
complete-iteration_mean0.18210103121808335
complete-iteration_median0.1801562869548798
complete-iteration_min0.17670495619023513
deviation-center-line_max1.0460098488197442
deviation-center-line_mean0.6624258116667668
deviation-center-line_min0.19110260804791013
deviation-heading_max2.7933910341523687
deviation-heading_mean2.117428704708854
deviation-heading_median2.4083404992605413
deviation-heading_min0.8596427861619637
driven_any_max3.573582598347786
driven_any_mean3.258819924697409
driven_any_median3.573519170398842
driven_any_min2.3146587596441663
driven_lanedir_consec_max3.4893727396047547
driven_lanedir_consec_mean2.6139833506539074
driven_lanedir_consec_min1.456490953009412
driven_lanedir_max3.4893727396047547
driven_lanedir_mean2.6821021758858405
driven_lanedir_median2.891272505464597
driven_lanedir_min1.456490953009412
get_duckie_state_max2.4739901224772136e-06
get_duckie_state_mean2.372212418041455e-06
get_duckie_state_median2.388556798299154e-06
get_duckie_state_min2.2377459530903e-06
get_robot_state_max0.012723544438680012
get_robot_state_mean0.012535345601753132
get_robot_state_median0.012560402154922486
get_robot_state_min0.012297033658487545
get_state_dump_max0.012883525689442952
get_state_dump_mean0.012795966413823886
get_state_dump_median0.01279755701066677
get_state_dump_min0.012705225944519043
get_ui_image_max0.03353792905807495
get_ui_image_mean0.03266058195968569
get_ui_image_median0.03255651235580444
get_ui_image_min0.031991374069058956
in-drivable-lane_max3.40000000000002
in-drivable-lane_mean1.9625000000000208
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.3146587596441663, "get_ui_image": 0.031991374069058956, "step_physics": 0.06765387748098615, "survival_time": 9.850000000000003, "driven_lanedir": 1.456490953009412, "get_state_dump": 0.01280913014097262, "sim_render-ego": 0.005246759066121832, "get_robot_state": 0.012297033658487545, "get_duckie_state": 2.2377459530903e-06, "in-drivable-lane": 3.40000000000002, "agent_compute-ego": 0.017086141605667658, "deviation-heading": 0.8596427861619637, "complete-iteration": 0.17670495619023513, "set_robot_commands": 0.004525156795675984, "deviation-center-line": 0.19110260804791013, "driven_lanedir_consec": 1.456490953009412, "sim_compute_sim_state": 0.021392709712691717, "sim_compute_performance-ego": 0.0035650318649214537}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.573582598347786, "get_ui_image": 0.032365495363871254, "step_physics": 0.06859498103459676, "survival_time": 14.950000000000076, "driven_lanedir": 3.4893727396047547, "get_state_dump": 0.012705225944519043, "sim_render-ego": 0.0053017767270406085, "get_robot_state": 0.01256818135579427, "get_duckie_state": 2.3849805196126303e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01686402718226115, "deviation-heading": 2.386646259853092, "complete-iteration": 0.1779730232556661, "set_robot_commands": 0.0044542598724365235, "deviation-center-line": 0.8067769485173466, "driven_lanedir_consec": 3.4893727396047547, "sim_compute_sim_state": 0.02138672351837158, "sim_compute_performance-ego": 0.0035920159022013345}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.5735425082930683, "get_ui_image": 0.03274752934773763, "step_physics": 0.07113093137741089, "survival_time": 14.950000000000076, "driven_lanedir": 2.9894089883741684, "get_state_dump": 0.012883525689442952, "sim_render-ego": 0.005286826292673747, "get_robot_state": 0.012723544438680012, "get_duckie_state": 2.4739901224772136e-06, "in-drivable-lane": 2.050000000000029, "agent_compute-ego": 0.017241461277008055, "deviation-heading": 2.4300347386679904, "complete-iteration": 0.18233955065409344, "set_robot_commands": 0.004535086949666341, "deviation-center-line": 1.0460098488197442, "driven_lanedir_consec": 2.9894089883741684, "sim_compute_sim_state": 0.02208479166030884, "sim_compute_performance-ego": 0.0035625720024108887}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.5734958325046153, "get_ui_image": 0.03353792905807495, "step_physics": 0.07765691041946411, "survival_time": 14.950000000000076, "driven_lanedir": 2.7931360225550264, "get_state_dump": 0.012785983880360922, "sim_render-ego": 0.005226491292317708, "get_robot_state": 0.0125526229540507, "get_duckie_state": 2.392133076985677e-06, "in-drivable-lane": 2.400000000000034, "agent_compute-ego": 0.01688091437021891, "deviation-heading": 2.7933910341523687, "complete-iteration": 0.19138659477233888, "set_robot_commands": 0.00448564608891805, "deviation-center-line": 0.6058138412820662, "driven_lanedir_consec": 2.520660721627294, "sim_compute_sim_state": 0.02453888257344564, "sim_compute_performance-ego": 0.003575394153594971}}
set_robot_commands_max0.004535086949666341
set_robot_commands_mean0.004500037426674225
set_robot_commands_median0.004505401442297018
set_robot_commands_min0.0044542598724365235
sim_compute_performance-ego_max0.0035920159022013345
sim_compute_performance-ego_mean0.003573753480782162
sim_compute_performance-ego_median0.0035702130092582123
sim_compute_performance-ego_min0.0035625720024108887
sim_compute_sim_state_max0.02453888257344564
sim_compute_sim_state_mean0.022350776866204444
sim_compute_sim_state_median0.02173875068650028
sim_compute_sim_state_min0.02138672351837158
sim_render-ego_max0.0053017767270406085
sim_render-ego_mean0.005265463344538474
sim_render-ego_median0.005266792679397789
sim_render-ego_min0.005226491292317708
simulation-passed1
step_physics_max0.07765691041946411
step_physics_mean0.07125917507811448
step_physics_median0.06986295620600383
step_physics_min0.06765387748098615
survival_time_max14.950000000000076
survival_time_mean13.675000000000058
survival_time_min9.850000000000003
No reset possible
380139972Bea Baselines 🐤template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simsuccessnomont04-2d53ef3af4c5-10:25:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.17654906273525572
survival_time_median16.150000000000095
deviation-center-line_median0.08854055627930021
in-drivable-lane_median14.175000000000084


other stats
agent_compute-ego0_max0.019538266892813468
agent_compute-ego0_mean0.01884801000853616
agent_compute-ego0_median0.018653150682478865
agent_compute-ego0_min0.018352612450316143
agent_compute-ego1_max0.02032330943031545
agent_compute-ego1_mean0.019374704948499254
agent_compute-ego1_median0.019110780309986423
agent_compute-ego1_min0.01869002510519589
agent_compute-npc0_max0.04233108195790484
agent_compute-npc0_mean0.04148325507211042
agent_compute-npc0_median0.04136659567420547
agent_compute-npc0_min0.04075208758422096
agent_compute-npc1_max0.053076062465737935
agent_compute-npc1_mean0.04945479686194073
agent_compute-npc1_median0.04789058984936895
agent_compute-npc1_min0.04739773827071529
complete-iteration_max0.6818986725222114
complete-iteration_mean0.671943451076095
complete-iteration_median0.6710435272874059
complete-iteration_min0.6628881534186679
deviation-center-line_max0.6232715283947466
deviation-center-line_mean0.2379409133643312
deviation-center-line_min0.07351702383876668
deviation-heading_max5.138301725734727
deviation-heading_mean1.9741887227495667
deviation-heading_median0.7496904755179121
deviation-heading_min0.5833295862742058
driven_any_max7.316284648275778
driven_any_mean2.4711907587057724
driven_any_median1.728777669471162
driven_any_min0.2847228576197953
driven_lanedir_consec_max1.2316150940995525
driven_lanedir_consec_mean0.4823093660088402
driven_lanedir_consec_min0.1190109591781825
driven_lanedir_max1.2316150940995525
driven_lanedir_mean0.4823093660088402
driven_lanedir_median0.17654906273525572
driven_lanedir_min0.1190109591781825
get_duckie_state_max2.504200548739047e-06
get_duckie_state_mean2.473184432369526e-06
get_duckie_state_median2.4935219185483967e-06
get_duckie_state_min2.4218308298211347e-06
get_robot_state_max0.032264295896869494
get_robot_state_mean0.03121667164499493
get_robot_state_median0.03099289214288866
get_robot_state_min0.030392826895226634
get_state_dump_max0.023404961349042647
get_state_dump_mean0.02303789194610691
get_state_dump_median0.02286273259496541
get_state_dump_min0.022845981894312677
get_ui_image_max0.05411127329610819
get_ui_image_mean0.05374163953483949
get_ui_image_median0.05382189557359025
get_ui_image_min0.05329174973482003
in-drivable-lane_max31.250000000000284
in-drivable-lane_mean17.900000000000137
in-drivable-lane_min8.300000000000047
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego0": {"driven_any": 0.2847228576197953, "get_ui_image": 0.05329174973482003, "step_physics": 0.3556669657947096, "survival_time": 32.600000000000286, "driven_lanedir": 0.1190109591781825, "get_state_dump": 0.023404961349042647, "get_robot_state": 0.032264295896869494, "sim_render-ego0": 0.005391756815413025, "sim_render-ego1": 0.0055106797832652835, "sim_render-npc0": 0.005406525968773964, "sim_render-npc1": 0.005418920809505907, "get_duckie_state": 2.4935219185483967e-06, "in-drivable-lane": 31.250000000000284, "deviation-heading": 0.8214005415783973, "agent_compute-ego0": 0.019538266892813468, "agent_compute-ego1": 0.02032330943031545, "agent_compute-npc0": 0.04233108195790484, "agent_compute-npc1": 0.053076062465737935, "complete-iteration": 0.6818986725222114, "set_robot_commands": 0.0043277543015275265, "deviation-center-line": 0.09085732981531935, "driven_lanedir_consec": 0.1190109591781825, "sim_compute_sim_state": 0.02857477606439883, "sim_compute_performance-ego0": 0.003714765507750716, "sim_compute_performance-ego1": 0.003562457356716226, "sim_compute_performance-npc0": 0.003521481540305483, "sim_compute_performance-npc1": 0.0036663270435450266}, "ETHZ_autolab_technical_track-sc0-0-ego1": {"driven_any": 7.316284648275778, "get_ui_image": 0.05329174973482003, "step_physics": 0.3556669657947096, "survival_time": 32.600000000000286, "driven_lanedir": 0.176506200548197, "get_state_dump": 0.023404961349042647, "get_robot_state": 0.032264295896869494, "sim_render-ego0": 0.005391756815413025, "sim_render-ego1": 0.0055106797832652835, "sim_render-npc0": 0.005406525968773964, "sim_render-npc1": 0.005418920809505907, "get_duckie_state": 2.4935219185483967e-06, "in-drivable-lane": 31.150000000000286, "deviation-heading": 0.6779804094574269, "agent_compute-ego0": 0.019538266892813468, "agent_compute-ego1": 0.02032330943031545, "agent_compute-npc0": 0.04233108195790484, "agent_compute-npc1": 0.053076062465737935, "complete-iteration": 0.6818986725222114, "set_robot_commands": 0.0043277543015275265, "deviation-center-line": 0.07918409296743517, "driven_lanedir_consec": 0.176506200548197, "sim_compute_sim_state": 0.02857477606439883, "sim_compute_performance-ego0": 0.003714765507750716, "sim_compute_performance-ego1": 0.003562457356716226, "sim_compute_performance-npc0": 0.003521481540305483, "sim_compute_performance-npc1": 0.0036663270435450266}, "ETHZ_autolab_technical_track-sc0-1-ego0": {"driven_any": 0.32656701290116175, "get_ui_image": 0.05382189557359025, "step_physics": 0.34978022124316244, "survival_time": 14.800000000000075, "driven_lanedir": 0.17659192492231446, "get_state_dump": 0.022845981894312677, "get_robot_state": 0.03099289214288866, "sim_render-ego0": 0.005282284440221013, "sim_render-ego1": 0.005214887696343499, "sim_render-npc0": 0.005270366733138626, "sim_render-npc1": 0.005348206371874423, "get_duckie_state": 2.504200548739047e-06, "in-drivable-lane": 13.450000000000074, "deviation-heading": 0.5833295862742058, "agent_compute-ego0": 0.018352612450316143, "agent_compute-ego1": 0.019110780309986423, "agent_compute-npc0": 0.04136659567420547, "agent_compute-npc1": 0.04789058984936895, "complete-iteration": 0.6710435272874059, "set_robot_commands": 0.0043453686946147195, "deviation-center-line": 0.08622378274328105, "driven_lanedir_consec": 0.17659192492231446, "sim_compute_sim_state": 0.03475111803492984, "sim_compute_performance-ego0": 0.003617425222654601, "sim_compute_performance-ego1": 0.0034039229960054966, "sim_compute_performance-npc0": 0.0034536485736434523, "sim_compute_performance-npc1": 0.003600967091483038}, "ETHZ_autolab_technical_track-sc0-1-ego1": {"driven_any": 3.1309883260411624, "get_ui_image": 0.05382189557359025, "step_physics": 0.34978022124316244, "survival_time": 14.800000000000075, "driven_lanedir": 1.070322167657742, "get_state_dump": 0.022845981894312677, "get_robot_state": 0.03099289214288866, "sim_render-ego0": 0.005282284440221013, "sim_render-ego1": 0.005214887696343499, "sim_render-npc0": 0.005270366733138626, "sim_render-npc1": 0.005348206371874423, "get_duckie_state": 2.504200548739047e-06, "in-drivable-lane": 8.300000000000047, "deviation-heading": 3.969400682757283, "agent_compute-ego0": 0.018352612450316143, "agent_compute-ego1": 0.019110780309986423, "agent_compute-npc0": 0.04136659567420547, "agent_compute-npc1": 0.04789058984936895, "complete-iteration": 0.6710435272874059, "set_robot_commands": 0.0043453686946147195, "deviation-center-line": 0.4745917224264381, "driven_lanedir_consec": 1.070322167657742, "sim_compute_sim_state": 0.03475111803492984, "sim_compute_performance-ego0": 0.003617425222654601, "sim_compute_performance-ego1": 0.0034039229960054966, "sim_compute_performance-npc0": 0.0034536485736434523, "sim_compute_performance-npc1": 0.003600967091483038}, "ETHZ_autolab_technical_track-sc0-2-ego0": {"driven_any": 0.28557682819382396, "get_ui_image": 0.05411127329610819, "step_physics": 0.3436542598086614, "survival_time": 16.150000000000095, "driven_lanedir": 0.1198098496470532, "get_state_dump": 0.02286273259496541, "get_robot_state": 0.030392826895226634, "sim_render-ego0": 0.005159710952002935, "sim_render-ego1": 0.005233856177551458, "sim_render-npc0": 0.005258951393812434, "sim_render-npc1": 0.005239886027002482, "get_duckie_state": 2.4218308298211347e-06, "in-drivable-lane": 14.900000000000096, "deviation-heading": 0.6547193906953608, "agent_compute-ego0": 0.018653150682478865, "agent_compute-ego1": 0.01869002510519589, "agent_compute-npc0": 0.04075208758422096, "agent_compute-npc1": 0.04739773827071529, "complete-iteration": 0.6628881534186679, "set_robot_commands": 0.004278289275272712, "deviation-center-line": 0.07351702383876668, "driven_lanedir_consec": 0.1198098496470532, "sim_compute_sim_state": 0.03491987753947822, "sim_compute_performance-ego0": 0.00354674873706357, "sim_compute_performance-ego1": 0.0033934588771855497, "sim_compute_performance-npc0": 0.0033954754702446997, "sim_compute_performance-npc1": 0.0035565918075041872}, "ETHZ_autolab_technical_track-sc0-2-ego1": {"driven_any": 3.483004879202915, "get_ui_image": 0.05411127329610819, "step_physics": 0.3436542598086614, "survival_time": 16.150000000000095, "driven_lanedir": 1.2316150940995525, "get_state_dump": 0.02286273259496541, "get_robot_state": 0.030392826895226634, "sim_render-ego0": 0.005159710952002935, "sim_render-ego1": 0.005233856177551458, "sim_render-npc0": 0.005258951393812434, "sim_render-npc1": 0.005239886027002482, "get_duckie_state": 2.4218308298211347e-06, "in-drivable-lane": 8.350000000000046, "deviation-heading": 5.138301725734727, "agent_compute-ego0": 0.018653150682478865, "agent_compute-ego1": 0.01869002510519589, "agent_compute-npc0": 0.04075208758422096, "agent_compute-npc1": 0.04739773827071529, "complete-iteration": 0.6628881534186679, "set_robot_commands": 0.004278289275272712, "deviation-center-line": 0.6232715283947466, "driven_lanedir_consec": 1.2316150940995525, "sim_compute_sim_state": 0.03491987753947822, "sim_compute_performance-ego0": 0.00354674873706357, "sim_compute_performance-ego1": 0.0033934588771855497, "sim_compute_performance-npc0": 0.0033954754702446997, "sim_compute_performance-npc1": 0.0035565918075041872}}
set_robot_commands_max0.0043453686946147195
set_robot_commands_mean0.0043171374238049854
set_robot_commands_median0.0043277543015275265
set_robot_commands_min0.004278289275272712
sim_compute_performance-ego0_max0.003714765507750716
sim_compute_performance-ego0_mean0.0036263131558229617
sim_compute_performance-ego0_median0.003617425222654601
sim_compute_performance-ego0_min0.00354674873706357
sim_compute_performance-ego1_max0.003562457356716226
sim_compute_performance-ego1_mean0.0034532797433024236
sim_compute_performance-ego1_median0.0034039229960054966
sim_compute_performance-ego1_min0.0033934588771855497
sim_compute_performance-npc0_max0.003521481540305483
sim_compute_performance-npc0_mean0.003456868528064545
sim_compute_performance-npc0_median0.0034536485736434523
sim_compute_performance-npc0_min0.0033954754702446997
sim_compute_performance-npc1_max0.0036663270435450266
sim_compute_performance-npc1_mean0.003607961980844084
sim_compute_performance-npc1_median0.003600967091483038
sim_compute_performance-npc1_min0.0035565918075041872
sim_compute_sim_state_max0.03491987753947822
sim_compute_sim_state_mean0.03274859054626896
sim_compute_sim_state_median0.03475111803492984
sim_compute_sim_state_min0.02857477606439883
sim_render-ego0_max0.005391756815413025
sim_render-ego0_mean0.005277917402545657
sim_render-ego0_median0.005282284440221013
sim_render-ego0_min0.005159710952002935
sim_render-ego1_max0.0055106797832652835
sim_render-ego1_mean0.00531980788572008
sim_render-ego1_median0.005233856177551458
sim_render-ego1_min0.005214887696343499
sim_render-npc0_max0.005406525968773964
sim_render-npc0_mean0.005311948031908341
sim_render-npc0_median0.005270366733138626
sim_render-npc0_min0.005258951393812434
sim_render-npc1_max0.005418920809505907
sim_render-npc1_mean0.005335671069460937
sim_render-npc1_median0.005348206371874423
sim_render-npc1_min0.005239886027002482
simulation-passed1
step_physics_max0.3556669657947096
step_physics_mean0.3497004822821778
step_physics_median0.34978022124316244
step_physics_min0.3436542598086614
survival_time_max32.600000000000286
survival_time_mean21.183333333333483
survival_time_min14.800000000000075
No reset possible
3800210807Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnomont04-2d53ef3af4c5-10:09:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0443724843508155
survival_time_median14.950000000000076
deviation-center-line_median0.4518861084771509
in-drivable-lane_median3.250000000000046


other stats
agent_compute-ego_max0.01871911287307739
agent_compute-ego_mean0.018136777877807615
agent_compute-ego_median0.01813820163408915
agent_compute-ego_min0.017551595369974773
complete-iteration_max0.23833431005477904
complete-iteration_mean0.22184344271818796
complete-iteration_median0.22415139396985373
complete-iteration_min0.20073667287826535
deviation-center-line_max0.5184702688128414
deviation-center-line_mean0.45391485811576227
deviation-center-line_min0.3934169466959059
deviation-heading_max1.3918444602576232
deviation-heading_mean1.0402109516503442
deviation-heading_median1.0234259221480186
deviation-heading_min0.7221475020477158
driven_any_max2.6547327817256052
driven_any_mean2.6525535305015273
driven_any_median2.6547067611123354
driven_any_min2.6460678180558324
driven_lanedir_consec_max2.622994388192615
driven_lanedir_consec_mean2.174673509973924
driven_lanedir_consec_min1.98695468300145
driven_lanedir_max2.622994388192615
driven_lanedir_mean2.174673509973924
driven_lanedir_median2.0443724843508155
driven_lanedir_min1.98695468300145
get_duckie_state_max2.93731689453125e-06
get_duckie_state_mean2.7563174565633137e-06
get_duckie_state_median2.7418136596679688e-06
get_duckie_state_min2.604325612386068e-06
get_robot_state_max0.016850807666778565
get_robot_state_mean0.016316404541333516
get_robot_state_median0.016381169954935708
get_robot_state_min0.015652470588684082
get_state_dump_max0.014112793604532875
get_state_dump_mean0.013865797321001688
get_state_dump_median0.013850927750269571
get_state_dump_min0.013648540178934732
get_ui_image_max0.04326414108276367
get_ui_image_mean0.03913052956263224
get_ui_image_median0.03902728676795959
get_ui_image_min0.03520340363184611
in-drivable-lane_max3.600000000000051
in-drivable-lane_mean2.525000000000036
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.6460678180558324, "get_ui_image": 0.04326414108276367, "step_physics": 0.10141724904378256, "survival_time": 14.950000000000076, "driven_lanedir": 2.622994388192615, "get_state_dump": 0.014112793604532875, "sim_render-ego": 0.007170468171437581, "get_robot_state": 0.016647645632425944, "get_duckie_state": 2.8204917907714844e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.018599349657694497, "deviation-heading": 1.155958671987524, "complete-iteration": 0.23833431005477904, "set_robot_commands": 0.005182304382324219, "deviation-center-line": 0.5184702688128414, "driven_lanedir_consec": 2.622994388192615, "sim_compute_sim_state": 0.02698967297871907, "sim_compute_performance-ego": 0.004784644444783529}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.6547301356153747, "get_ui_image": 0.04206291516621907, "step_physics": 0.09958366870880128, "survival_time": 14.950000000000076, "driven_lanedir": 2.0967455190886377, "get_state_dump": 0.013991382122039797, "sim_render-ego": 0.0070965981483459475, "get_robot_state": 0.016850807666778565, "get_duckie_state": 2.93731689453125e-06, "in-drivable-lane": 3.000000000000042, "agent_compute-ego": 0.01871911287307739, "deviation-heading": 0.8908931723085131, "complete-iteration": 0.23477092345555625, "set_robot_commands": 0.005395116806030273, "deviation-center-line": 0.4040360938767847, "driven_lanedir_consec": 2.0967455190886377, "sim_compute_sim_state": 0.0261820920308431, "sim_compute_performance-ego": 0.004717365105946858}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.654683386609296, "get_ui_image": 0.03520340363184611, "step_physics": 0.07973224242528279, "survival_time": 14.950000000000076, "driven_lanedir": 1.9919994496129931, "get_state_dump": 0.013648540178934732, "sim_render-ego": 0.006162641048431397, "get_robot_state": 0.015652470588684082, "get_duckie_state": 2.663135528564453e-06, "in-drivable-lane": 3.5000000000000497, "agent_compute-ego": 0.017677053610483804, "deviation-heading": 1.3918444602576232, "complete-iteration": 0.20073667287826535, "set_robot_commands": 0.004835723241170247, "deviation-center-line": 0.3934169466959059, "driven_lanedir_consec": 1.9919994496129931, "sim_compute_sim_state": 0.023644564946492513, "sim_compute_performance-ego": 0.004023057619730631}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.6547327817256052, "get_ui_image": 0.035991658369700114, "step_physics": 0.08636588255564372, "survival_time": 14.950000000000076, "driven_lanedir": 1.98695468300145, "get_state_dump": 0.013710473378499347, "sim_render-ego": 0.006363773345947265, "get_robot_state": 0.016114694277445475, "get_duckie_state": 2.604325612386068e-06, "in-drivable-lane": 3.600000000000051, "agent_compute-ego": 0.017551595369974773, "deviation-heading": 0.7221475020477158, "complete-iteration": 0.2135318644841512, "set_robot_commands": 0.004808345635732015, "deviation-center-line": 0.4997361230775171, "driven_lanedir_consec": 1.98695468300145, "sim_compute_sim_state": 0.028308916091918945, "sim_compute_performance-ego": 0.004157753785451254}}
set_robot_commands_max0.005395116806030273
set_robot_commands_mean0.005055372516314188
set_robot_commands_median0.005009013811747233
set_robot_commands_min0.004808345635732015
sim_compute_performance-ego_max0.004784644444783529
sim_compute_performance-ego_mean0.004420705238978068
sim_compute_performance-ego_median0.004437559445699056
sim_compute_performance-ego_min0.004023057619730631
sim_compute_sim_state_max0.028308916091918945
sim_compute_sim_state_mean0.026281311511993408
sim_compute_sim_state_median0.026585882504781087
sim_compute_sim_state_min0.023644564946492513
sim_render-ego_max0.007170468171437581
sim_render-ego_mean0.006698370178540547
sim_render-ego_median0.006730185747146606
sim_render-ego_min0.006162641048431397
simulation-passed1
step_physics_max0.10141724904378256
step_physics_mean0.0917747606833776
step_physics_median0.09297477563222248
step_physics_min0.07973224242528279
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3799910812Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednomont04-2d53ef3af4c5-10:03:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 512, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 69 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 253, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 516, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible