Evaluator 1207

ID	1207
evaluator	`ip-172-31-40-253-3847`
owner	I don't have one 😀
machine	ip-172-31-40-253
process	ip-172-31-40-253-3847
version	d-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard	2019-05-16 22:27:07+00:00
last heard	2019-05-17 15:40:04+00:00
status	inactive
# evaluating
# success	14 `22546`
# timeout
# failed
# error	13 `22573`
# aborted
# host-error	1 `22786`
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

23078

3553

Amaury Camus 🇨🇭

Running the real lane following -- without challenge container

aido2-LFV-sim-testing

step1-simulation

error

yes

ip-172-31-40-253-3847

2019-05-17 09:53:51+00:00

2019-05-17 10:00:07+00:00

0:06:16

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23019

2377

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

aido2-LFV-sim-testing

step1-simulation

success

yes

ip-172-31-40-253-3847

2019-05-17 05:16:45+00:00

2019-05-17 05:46:12+00:00

0:29:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4295977528045558
survival_time_median	3.7499999999999942
deviation-center-line_median	0.16525966154163726
in-drivable-lane_median	0.9499999999999966

other stats

agent_compute-ego_max	0.06964980810880661
agent_compute-ego_mean	0.06370677889882928
agent_compute-ego_median	0.06426587525536032
agent_compute-ego_min	0.057423023240906854
deviation-center-line_max	0.44830395948846297
deviation-center-line_mean	0.17891237550140934
deviation-center-line_min	0.10012774388669717
deviation-heading_max	1.272726254754917
deviation-heading_mean	0.5883512828498624
deviation-heading_median	0.5156622477370731
deviation-heading_min	0.2495279988048577
driven_any_max	2.0298273185719493
driven_any_mean	1.0098349503422042
driven_any_median	1.0248273191286312
driven_any_min	0.3648701917101209
driven_lanedir_consec_max	1.211071354427033
driven_lanedir_consec_mean	0.6125599618319294
driven_lanedir_consec_min	0.32721267753615213
driven_lanedir_max	1.211071354427033
driven_lanedir_mean	0.6125599618319294
driven_lanedir_median	0.4295977528045558
driven_lanedir_min	0.32721267753615213
in-drivable-lane_max	4.249999999999985
in-drivable-lane_mean	1.2033333333333296
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.1771785461739318, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.06237254077441072, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.05988680826474543, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.09804084203014636, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.03707967718986616, "sim_compute_performance-ego": 0.06854550805810379, "sim_compute_robot_state-ego": 0.07130100302500268, "sim_compute_robot_state-npc0": 0.06536698014768835, "sim_compute_robot_state-npc1": 0.06764278019944282, "sim_compute_robot_state-npc2": 0.06680025139900103, "sim_compute_robot_state-npc3": 0.06765945316994026}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4548365617710475, "sim_physics": 0.15756037428572373, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295977528045558, "sim_render-ego": 0.057813180459512246, "in-drivable-lane": 0, "agent_compute-ego": 0.05954426043742412, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.0911558061032682, "deviation-center-line": 0.13177328856984177, "driven_lanedir_consec": 0.4295977528045558, "sim_compute_sim_state": 0.03551011472134977, "sim_compute_performance-ego": 0.06391222412521774, "sim_compute_robot_state-ego": 0.061564419720623945, "sim_compute_robot_state-npc0": 0.06724905967712402, "sim_compute_robot_state-npc1": 0.06741528253297548, "sim_compute_robot_state-npc2": 0.06371018048879262, "sim_compute_robot_state-npc3": 0.06160971280690786}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.57982731857201, "sim_physics": 0.15979171650750296, "survival_time": 5.599999999999988, "driven_lanedir": 1.2014595555356244, "sim_render-ego": 0.0552915803023747, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.057423023240906854, "deviation-heading": 0.5156622477370731, "set_robot_commands": 0.08544308585780007, "deviation-center-line": 0.2085822874042474, "driven_lanedir_consec": 1.2014595555356244, "sim_compute_sim_state": 0.035165171538080485, "sim_compute_performance-ego": 0.06372510748250144, "sim_compute_robot_state-ego": 0.06820572912693024, "sim_compute_robot_state-npc0": 0.0632713862827846, "sim_compute_robot_state-npc1": 0.06357124447822571, "sim_compute_robot_state-npc2": 0.06469536253384181, "sim_compute_robot_state-npc3": 0.06355673926217216}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5798273185720382, "sim_physics": 0.1658642590045929, "survival_time": 5.599999999999988, "driven_lanedir": 1.2017887891468408, "sim_render-ego": 0.06572959678513664, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06011446458952768, "deviation-heading": 0.5031987685845647, "set_robot_commands": 0.09424558069024767, "deviation-center-line": 0.2031955759348632, "driven_lanedir_consec": 1.2017887891468408, "sim_compute_sim_state": 0.03822559118270874, "sim_compute_performance-ego": 0.06436075695923396, "sim_compute_robot_state-ego": 0.0696533705507006, "sim_compute_robot_state-npc0": 0.06921209820679255, "sim_compute_robot_state-npc1": 0.06812990989003863, "sim_compute_robot_state-npc2": 0.06855521031788417, "sim_compute_robot_state-npc3": 0.06976360508373805}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3798605253583843, "sim_physics": 0.19080091267824173, "survival_time": 1.6000000000000008, "driven_lanedir": 0.366714522485295, "sim_render-ego": 0.06563552469015121, "in-drivable-lane": 0, "agent_compute-ego": 0.06964980810880661, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.10518090426921844, "deviation-center-line": 0.10686452122645386, "driven_lanedir_consec": 0.366714522485295, "sim_compute_sim_state": 0.04264979809522629, "sim_compute_performance-ego": 0.07319007068872452, "sim_compute_robot_state-ego": 0.08477694541215897, "sim_compute_robot_state-npc0": 0.07423854619264603, "sim_compute_robot_state-npc1": 0.07672356069087982, "sim_compute_robot_state-npc2": 0.07665587216615677, "sim_compute_robot_state-npc3": 0.07560074329376221}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0548273189057833, "sim_physics": 0.17475623279422908, "survival_time": 3.8499999999999943, "driven_lanedir": 0.3963714216744775, "sim_render-ego": 0.06475336830337326, "in-drivable-lane": 1.7499999999999971, "agent_compute-ego": 0.0659879833072811, "deviation-heading": 1.272726254754917, "set_robot_commands": 0.10176002205192268, "deviation-center-line": 0.20372147663934215, "driven_lanedir_consec": 0.3963714216744775, "sim_compute_sim_state": 0.038688953820761145, "sim_compute_performance-ego": 0.0734505219893022, "sim_compute_robot_state-ego": 0.07970291298705262, "sim_compute_robot_state-npc0": 0.07148391859872001, "sim_compute_robot_state-npc1": 0.0722972262989391, "sim_compute_robot_state-npc2": 0.07119433601181228, "sim_compute_robot_state-npc3": 0.06829344452201545}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9948273195001682, "sim_physics": 0.15652815609762114, "survival_time": 3.649999999999995, "driven_lanedir": 0.6530046235032079, "sim_render-ego": 0.06115302321029036, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.06394566248541009, "deviation-heading": 0.8187446392859457, "set_robot_commands": 0.09614379765236214, "deviation-center-line": 0.19436286934102945, "driven_lanedir_consec": 0.6530046235032079, "sim_compute_sim_state": 0.03885316195553296, "sim_compute_performance-ego": 0.0688059199346255, "sim_compute_robot_state-ego": 0.07318120786588486, "sim_compute_robot_state-npc0": 0.06661191051953459, "sim_compute_robot_state-npc1": 0.06965935393555524, "sim_compute_robot_state-npc2": 0.07111017997950723, "sim_compute_robot_state-npc3": 0.07129546060954055}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.0298273185719493, "sim_physics": 0.18736032700874436, "survival_time": 7.099999999999983, "driven_lanedir": 0.741234184731216, "sim_render-ego": 0.06407987399840019, "in-drivable-lane": 4.249999999999985, "agent_compute-ego": 0.06563132413676087, "deviation-heading": 0.5416787058937298, "set_robot_commands": 0.10116228083489646, "deviation-center-line": 0.21649269357451997, "driven_lanedir_consec": 0.741234184731216, "sim_compute_sim_state": 0.04147259953995826, "sim_compute_performance-ego": 0.0718407714870614, "sim_compute_robot_state-ego": 0.07872488297207254, "sim_compute_robot_state-npc0": 0.07170204713310994, "sim_compute_robot_state-npc1": 0.07100059952534421, "sim_compute_robot_state-npc2": 0.07251831847177424, "sim_compute_robot_state-npc3": 0.07284513997360015}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0248273191286528, "sim_physics": 0.15889360109965006, "survival_time": 3.7499999999999942, "driven_lanedir": 0.38223306402252977, "sim_render-ego": 0.0633326816558838, "in-drivable-lane": 2.099999999999994, "agent_compute-ego": 0.06563564618428548, "deviation-heading": 0.41826512024881946, "set_robot_commands": 0.09921127319335936, "deviation-center-line": 0.14440586530294292, "driven_lanedir_consec": 0.38223306402252977, "sim_compute_sim_state": 0.03951605478922526, "sim_compute_performance-ego": 0.0712567965189616, "sim_compute_robot_state-ego": 0.0756987476348877, "sim_compute_robot_state-npc0": 0.06900405883789062, "sim_compute_robot_state-npc1": 0.06913928667704264, "sim_compute_robot_state-npc2": 0.0713950252532959, "sim_compute_robot_state-npc3": 0.07011337916056315}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.4548365617710395, "sim_physics": 0.1733114139453785, "survival_time": 1.850000000000001, "driven_lanedir": 0.43889108545437505, "sim_render-ego": 0.0582147031217008, "in-drivable-lane": 0, "agent_compute-ego": 0.060069573892129434, "deviation-heading": 0.491310634741224, "set_robot_commands": 0.0996196849926098, "deviation-center-line": 0.11665316537398888, "driven_lanedir_consec": 0.43889108545437505, "sim_compute_sim_state": 0.039001426181277714, "sim_compute_performance-ego": 0.06872554083128234, "sim_compute_robot_state-ego": 0.07258920411805848, "sim_compute_robot_state-npc0": 0.0674774389009218, "sim_compute_robot_state-npc1": 0.06595929893287453, "sim_compute_robot_state-npc2": 0.06922377766789617, "sim_compute_robot_state-npc3": 0.06950911960086308}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3648701917101209, "sim_physics": 0.22243431306654407, "survival_time": 1.5500000000000007, "driven_lanedir": 0.34552145550754965, "sim_render-ego": 0.06407014016182191, "in-drivable-lane": 0, "agent_compute-ego": 0.06653946445834252, "deviation-heading": 0.5070424162880827, "set_robot_commands": 0.10276282987286968, "deviation-center-line": 0.10012774388669717, "driven_lanedir_consec": 0.34552145550754965, "sim_compute_sim_state": 0.04073271443766932, "sim_compute_performance-ego": 0.07401910135822912, "sim_compute_robot_state-ego": 0.0854919264393468, "sim_compute_robot_state-npc0": 0.07244193938470656, "sim_compute_robot_state-npc1": 0.0733921604771768, "sim_compute_robot_state-npc2": 0.0719542887903029, "sim_compute_robot_state-npc3": 0.06869043073346538}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4098472254790875, "sim_physics": 0.1617263064664953, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4054410153244894, "sim_render-ego": 0.06064285250271067, "in-drivable-lane": 0, "agent_compute-ego": 0.06426587525536032, "deviation-heading": 0.2495279988048577, "set_robot_commands": 0.09466158642488368, "deviation-center-line": 0.16731811540993266, "driven_lanedir_consec": 0.4054410153244894, "sim_compute_sim_state": 0.03822943743537454, "sim_compute_performance-ego": 0.06986604017369888, "sim_compute_robot_state-ego": 0.0754256528966567, "sim_compute_robot_state-npc0": 0.06775200366973877, "sim_compute_robot_state-npc1": 0.06844136294196634, "sim_compute_robot_state-npc2": 0.06934970967909869, "sim_compute_robot_state-npc3": 0.0722207041347728}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0248273191286312, "sim_physics": 0.1479312260945638, "survival_time": 3.7499999999999942, "driven_lanedir": 0.32721267753615213, "sim_render-ego": 0.05926061630249024, "in-drivable-lane": 2.299999999999994, "agent_compute-ego": 0.06370999018351237, "deviation-heading": 0.3112188917063982, "set_robot_commands": 0.09476211229960124, "deviation-center-line": 0.16525966154163726, "driven_lanedir_consec": 0.32721267753615213, "sim_compute_sim_state": 0.03852919896443685, "sim_compute_performance-ego": 0.06767628033955891, "sim_compute_robot_state-ego": 0.07201109250386556, "sim_compute_robot_state-npc0": 0.06804041862487793, "sim_compute_robot_state-npc1": 0.07024582227071126, "sim_compute_robot_state-npc2": 0.06791179974873861, "sim_compute_robot_state-npc3": 0.06832898457845052}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5798273185719856, "sim_physics": 0.1685384682246617, "survival_time": 5.599999999999988, "driven_lanedir": 1.211071354427033, "sim_render-ego": 0.06312943143504006, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.06784123820917946, "deviation-heading": 1.0143384205991224, "set_robot_commands": 0.09629139517034804, "deviation-center-line": 0.44830395948846297, "driven_lanedir_consec": 1.211071354427033, "sim_compute_sim_state": 0.03901236397879464, "sim_compute_performance-ego": 0.06798134318419866, "sim_compute_robot_state-ego": 0.07704817823001317, "sim_compute_robot_state-npc0": 0.06915429447378431, "sim_compute_robot_state-npc1": 0.06981987186840602, "sim_compute_robot_state-npc2": 0.06979520193168096, "sim_compute_robot_state-npc3": 0.06876347533294133}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.2198273185919868, "sim_physics": 0.2065768377347426, "survival_time": 4.399999999999992, "driven_lanedir": 0.41711373203649504, "sim_render-ego": 0.06569519909945401, "in-drivable-lane": 2.5999999999999917, "agent_compute-ego": 0.06535656072876671, "deviation-heading": 0.5811284097850438, "set_robot_commands": 0.10416370088403876, "deviation-center-line": 0.13226882250813252, "driven_lanedir_consec": 0.41711373203649504, "sim_compute_sim_state": 0.04150789705189792, "sim_compute_performance-ego": 0.07480762763456865, "sim_compute_robot_state-ego": 0.0860214585607702, "sim_compute_robot_state-npc0": 0.07220091332088817, "sim_compute_robot_state-npc1": 0.07444809783588756, "sim_compute_robot_state-npc2": 0.0753856518051841, "sim_compute_robot_state-npc3": 0.07300882718779823}}
set_robot_commands_max	0.10518090426921844
set_robot_commands_mean	0.09764032682183818
set_robot_commands_median	0.09804084203014636
set_robot_commands_min	0.08544308585780007
sim_compute_performance-ego_max	0.07480762763456865
sim_compute_performance-ego_mean	0.0694775740510179
sim_compute_performance-ego_median	0.0688059199346255
sim_compute_performance-ego_min	0.06372510748250144
sim_compute_robot_state-ego_max	0.0860214585607702
sim_compute_robot_state-ego_mean	0.075426448802935
sim_compute_robot_state-ego_median	0.0754256528966567
sim_compute_robot_state-ego_min	0.061564419720623945
sim_compute_robot_state-npc0_max	0.07423854619264603
sim_compute_robot_state-npc0_mean	0.06901380093141388
sim_compute_robot_state-npc0_median	0.06900405883789062
sim_compute_robot_state-npc0_min	0.0632713862827846
sim_compute_robot_state-npc1_max	0.07672356069087982
sim_compute_robot_state-npc1_mean	0.06985905723703106
sim_compute_robot_state-npc1_median	0.06965935393555524
sim_compute_robot_state-npc1_min	0.06357124447822571
sim_compute_robot_state-npc2_max	0.07665587216615677
sim_compute_robot_state-npc2_mean	0.07001701108299783
sim_compute_robot_state-npc2_median	0.06979520193168096
sim_compute_robot_state-npc2_min	0.06371018048879262
sim_compute_robot_state-npc3_max	0.07560074329376221
sim_compute_robot_state-npc3_mean	0.06941728129670208
sim_compute_robot_state-npc3_median	0.06950911960086308
sim_compute_robot_state-npc3_min	0.06160971280690786
sim_compute_sim_state_max	0.04264979809522629
sim_compute_sim_state_mean	0.03894494405881067
sim_compute_sim_state_median	0.03885316195553296
sim_compute_sim_state_min	0.035165171538080485
sim_physics_max	0.22243431306654407
sim_physics_mean	0.1739501794121749
sim_physics_median	0.1685384682246617
sim_physics_min	0.1479312260945638
sim_render-ego_max	0.06572959678513664
sim_render-ego_mean	0.062078287520183385
sim_render-ego_median	0.06312943143504006
sim_render-ego_min	0.0552915803023747
simulation-passed	1
survival_time_max	7.099999999999983
survival_time_mean	3.6999999999999944
survival_time_min	1.5500000000000007

No reset possible

23013

2386

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

aido2-LFV-sim-validation

step1-simulation

success

yes

ip-172-31-40-253-3847

2019-05-17 05:10:41+00:00

2019-05-17 05:16:37+00:00

0:05:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.10243356431880146
survival_time_median	1.2000000000000004
deviation-center-line_median	0.09139112657864563
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1808286820139204
agent_compute-ego_mean	0.17302257988876077
agent_compute-ego_median	0.17710119485855105
agent_compute-ego_min	0.16251902146772904
deviation-center-line_max	0.10065287437833442
deviation-center-line_mean	0.08036808080754614
deviation-center-line_min	0.05294630778405477
deviation-heading_max	0.8604781208701127
deviation-heading_mean	0.7000878458600679
deviation-heading_median	0.8421934669579203
deviation-heading_min	0.45821945989996904
driven_any_max	0.23210399873603735
driven_any_mean	0.17369759877143962
driven_any_median	0.1496532208666917
driven_any_min	0.13200129962281487
driven_lanedir_consec_max	0.1520497363763882
driven_lanedir_consec_mean	0.1069820585065818
driven_lanedir_consec_min	0.06838962042552188
driven_lanedir_max	0.1520497363763882
driven_lanedir_mean	0.1069820585065818
driven_lanedir_median	0.10243356431880146
driven_lanedir_min	0.06838962042552188
in-drivable-lane_max	0.5000000000000004
in-drivable-lane_mean	0.1100000000000001
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.23210399873603735, "sim_physics": 0.200907792363848, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1520497363763882, "sim_render-ego": 0.06342545577457973, "in-drivable-lane": 0, "agent_compute-ego": 0.1808286820139204, "deviation-heading": 0.8604781208701127, "set_robot_commands": 0.10670325585774013, "deviation-center-line": 0.09139112657864563, "driven_lanedir_consec": 0.1520497363763882, "sim_compute_sim_state": 0.04205132382256644, "sim_compute_performance-ego": 0.07077802079064506, "sim_compute_robot_state-ego": 0.08166083267756871, "sim_compute_robot_state-npc0": 0.07369688579014369, "sim_compute_robot_state-npc1": 0.07248187065124512, "sim_compute_robot_state-npc2": 0.07510006427764893, "sim_compute_robot_state-npc3": 0.07088339328765869}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.22071879784110057, "sim_physics": 0.17836886463743268, "survival_time": 1.6500000000000008, "driven_lanedir": 0.09305503935479333, "sim_render-ego": 0.06477712139938817, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.16740612550215286, "deviation-heading": 0.8448485042809317, "set_robot_commands": 0.09423562252160277, "deviation-center-line": 0.06281944109801588, "driven_lanedir_consec": 0.09305503935479333, "sim_compute_sim_state": 0.04083128408952193, "sim_compute_performance-ego": 0.07558307503208969, "sim_compute_robot_state-ego": 0.07522903789173473, "sim_compute_robot_state-npc0": 0.0733338486064564, "sim_compute_robot_state-npc1": 0.07154359962000992, "sim_compute_robot_state-npc2": 0.06824237650090997, "sim_compute_robot_state-npc3": 0.0687015201106216}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13200129962281487, "sim_physics": 0.1768371517008001, "survival_time": 1.1000000000000003, "driven_lanedir": 0.10243356431880146, "sim_render-ego": 0.05487381328235973, "in-drivable-lane": 0, "agent_compute-ego": 0.16251902146772904, "deviation-heading": 0.45821945989996904, "set_robot_commands": 0.0978654297915372, "deviation-center-line": 0.09403065419867994, "driven_lanedir_consec": 0.10243356431880146, "sim_compute_sim_state": 0.04089112715287642, "sim_compute_performance-ego": 0.07085185701196844, "sim_compute_robot_state-ego": 0.07382699576291171, "sim_compute_robot_state-npc0": 0.0687356645410711, "sim_compute_robot_state-npc1": 0.07203943079168146, "sim_compute_robot_state-npc2": 0.07016009634191339, "sim_compute_robot_state-npc3": 0.07000279426574707}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1496532208666917, "sim_physics": 0.20780510703722635, "survival_time": 1.2000000000000004, "driven_lanedir": 0.11898233205740416, "sim_render-ego": 0.06614850958188374, "in-drivable-lane": 0, "agent_compute-ego": 0.1772578756014506, "deviation-heading": 0.4946996772914054, "set_robot_commands": 0.09590362509091696, "deviation-center-line": 0.10065287437833442, "driven_lanedir_consec": 0.11898233205740416, "sim_compute_sim_state": 0.03983258207639059, "sim_compute_performance-ego": 0.07439212997754414, "sim_compute_robot_state-ego": 0.08086741964022319, "sim_compute_robot_state-npc0": 0.07047455509503682, "sim_compute_robot_state-npc1": 0.0720101793607076, "sim_compute_robot_state-npc2": 0.0734884242216746, "sim_compute_robot_state-npc3": 0.07002477844556172}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13401067679055356, "sim_physics": 0.20198566714922583, "survival_time": 1.2000000000000004, "driven_lanedir": 0.06838962042552188, "sim_render-ego": 0.06537866592407227, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17710119485855105, "deviation-heading": 0.8421934669579203, "set_robot_commands": 0.10286795099576314, "deviation-center-line": 0.05294630778405477, "driven_lanedir_consec": 0.06838962042552188, "sim_compute_sim_state": 0.04173702001571655, "sim_compute_performance-ego": 0.07035640875498454, "sim_compute_robot_state-ego": 0.07967092593510945, "sim_compute_robot_state-npc0": 0.07127020756403606, "sim_compute_robot_state-npc1": 0.06994714339574178, "sim_compute_robot_state-npc2": 0.0691079596678416, "sim_compute_robot_state-npc3": 0.0779515008131663}}
set_robot_commands_max	0.10670325585774013
set_robot_commands_mean	0.09951517685151204
set_robot_commands_median	0.0978654297915372
set_robot_commands_min	0.09423562252160277
sim_compute_performance-ego_max	0.07558307503208969
sim_compute_performance-ego_mean	0.07239229831344637
sim_compute_performance-ego_median	0.07085185701196844
sim_compute_performance-ego_min	0.07035640875498454
sim_compute_robot_state-ego_max	0.08166083267756871
sim_compute_robot_state-ego_mean	0.07825104238150955
sim_compute_robot_state-ego_median	0.07967092593510945
sim_compute_robot_state-ego_min	0.07382699576291171
sim_compute_robot_state-npc0_max	0.07369688579014369
sim_compute_robot_state-npc0_mean	0.07150223231934881
sim_compute_robot_state-npc0_median	0.07127020756403606
sim_compute_robot_state-npc0_min	0.0687356645410711
sim_compute_robot_state-npc1_max	0.07248187065124512
sim_compute_robot_state-npc1_mean	0.07160444476387717
sim_compute_robot_state-npc1_median	0.0720101793607076
sim_compute_robot_state-npc1_min	0.06994714339574178
sim_compute_robot_state-npc2_max	0.07510006427764893
sim_compute_robot_state-npc2_mean	0.0712197842019977
sim_compute_robot_state-npc2_median	0.07016009634191339
sim_compute_robot_state-npc2_min	0.06824237650090997
sim_compute_robot_state-npc3_max	0.0779515008131663
sim_compute_robot_state-npc3_mean	0.07151279738455107
sim_compute_robot_state-npc3_median	0.07002477844556172
sim_compute_robot_state-npc3_min	0.0687015201106216
sim_compute_sim_state_max	0.04205132382256644
sim_compute_sim_state_mean	0.041068667431414387
sim_compute_sim_state_median	0.04089112715287642
sim_compute_sim_state_min	0.03983258207639059
sim_physics_max	0.20780510703722635
sim_physics_mean	0.1931809165777066
sim_physics_median	0.200907792363848
sim_physics_min	0.1768371517008001
sim_render-ego_max	0.06614850958188374
sim_render-ego_mean	0.06292071319245672
sim_render-ego_median	0.06477712139938817
sim_render-ego_min	0.05487381328235973
simulation-passed	1
survival_time_max	1.6500000000000008
survival_time_mean	1.3100000000000005
survival_time_min	1.1000000000000003

No reset possible

23009

2392

Liam Paull 🇨🇦

random_agent

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-40-253-3847

2019-05-17 05:04:28+00:00

2019-05-17 05:10:07+00:00

0:05:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.147974910736084
agent_compute-ego_mean	0.1400220173585139
agent_compute-ego_median	0.13719997582612214
agent_compute-ego_min	0.134748052148258
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.12067676473546912, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06234610963750769, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.13719997582612214, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10635624991522896, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.039837554649070454, "sim_compute_performance-ego": 0.06790813251777932, "sim_compute_robot_state-ego": 0.07909512961352314}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12434901910669664, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06588711925581389, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14472055435180664, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10400188202951469, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.039982753641465134, "sim_compute_performance-ego": 0.07500831286112468, "sim_compute_robot_state-ego": 0.09299260027268354}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.1250608247869155, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06290493291967056, "in-drivable-lane": 0, "agent_compute-ego": 0.134748052148258, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10046989777508904, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04130216205821318, "sim_compute_performance-ego": 0.0716552033143885, "sim_compute_robot_state-ego": 0.08087672906763413}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.12533047676086426, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06287504196166992, "in-drivable-lane": 0, "agent_compute-ego": 0.147974910736084, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.0980360221862793, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.039474048614501954, "sim_compute_performance-ego": 0.07103989601135254, "sim_compute_robot_state-ego": 0.08389497756958007}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.09968359259110464, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06383277494696123, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1354665937302988, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.0965078571174718, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.037422952772695806, "sim_compute_performance-ego": 0.07034353666667696, "sim_compute_robot_state-ego": 0.0752665543858009}}
set_robot_commands_max	0.10635624991522896
set_robot_commands_mean	0.10107438180471676
set_robot_commands_median	0.10046989777508904
set_robot_commands_min	0.0965078571174718
sim_compute_performance-ego_max	0.07500831286112468
sim_compute_performance-ego_mean	0.0711910162742644
sim_compute_performance-ego_median	0.07103989601135254
sim_compute_performance-ego_min	0.06790813251777932
sim_compute_robot_state-ego_max	0.09299260027268354
sim_compute_robot_state-ego_mean	0.08242519818184435
sim_compute_robot_state-ego_median	0.08087672906763413
sim_compute_robot_state-ego_min	0.0752665543858009
sim_compute_sim_state_max	0.04130216205821318
sim_compute_sim_state_mean	0.039603894347189306
sim_compute_sim_state_median	0.039837554649070454
sim_compute_sim_state_min	0.037422952772695806
sim_physics_max	0.12533047676086426
sim_physics_mean	0.11902013559621
sim_physics_median	0.12434901910669664
sim_physics_min	0.09968359259110464
sim_render-ego_max	0.06588711925581389
sim_render-ego_mean	0.06356919574432465
sim_render-ego_median	0.06290493291967056
sim_render-ego_min	0.06234610963750769
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

22997

2407

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

aido2-LFVI-sim-validation

step1-simulation

error

yes

ip-172-31-40-253-3847

2019-05-17 04:57:09+00:00

2019-05-17 05:03:54+00:00

0:06:45

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22972

2443

Jacopo Tani

random_agent

aido2-LFVI-sim-testing

step1-simulation

success

yes

ip-172-31-40-253-3847

2019-05-17 04:25:39+00:00

2019-05-17 04:56:40+00:00

0:31:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6537162971975778
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14884708769804722
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.16722194506571844
agent_compute-ego_mean	0.156397677146723
agent_compute-ego_median	0.15397003330761874
agent_compute-ego_min	0.14718160846016623
deviation-center-line_max	0.5141120095458062
deviation-center-line_mean	0.1769000227005324
deviation-center-line_min	0.06216029860587694
deviation-heading_max	1.9929437250081896
deviation-heading_mean	0.692977823395608
deviation-heading_median	0.4928440244444201
deviation-heading_min	0.24234723632033853
driven_any_max	3.5343244022418343
driven_any_mean	1.3470385992234175
driven_any_median	1.001633421251194
driven_any_min	0.3412551960104244
driven_lanedir_consec_max	2.494308053441959
driven_lanedir_consec_mean	0.881391085527715
driven_lanedir_consec_min	0.3199180625488627
driven_lanedir_max	2.494308053441959
driven_lanedir_mean	0.8962528018383226
driven_lanedir_median	0.7206363324756615
driven_lanedir_min	0.3199180625488627
in-drivable-lane_max	3.549999999999991
in-drivable-lane_mean	0.839999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1842850944663905, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06257108797000933, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15397003330761874, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09476546396183062, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.035986658893054045, "sim_compute_performance-ego": 0.06804596623287926, "sim_compute_robot_state-ego": 0.07399900351898579, "sim_compute_robot_state-npc0": 0.06907651997819732, "sim_compute_robot_state-npc1": 0.07032777991475939, "sim_compute_robot_state-npc2": 0.06592767449873912, "sim_compute_robot_state-npc3": 0.06460548050795929}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2283307569367545, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06655513388769967, "in-drivable-lane": 0, "agent_compute-ego": 0.1666585717882429, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10015562602451868, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04201396022524152, "sim_compute_performance-ego": 0.0713720406804766, "sim_compute_robot_state-ego": 0.0824567334992545, "sim_compute_robot_state-npc0": 0.07094841344015938, "sim_compute_robot_state-npc1": 0.0742525543485369, "sim_compute_robot_state-npc2": 0.07209922586168561, "sim_compute_robot_state-npc3": 0.07609885931015015}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.19834946891636523, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.0695742472861577, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16305812122752367, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10040039692110228, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04040974320717229, "sim_compute_performance-ego": 0.07102754046616044, "sim_compute_robot_state-ego": 0.07676100267947299, "sim_compute_robot_state-npc0": 0.0719196009404451, "sim_compute_robot_state-npc1": 0.07141532944244089, "sim_compute_robot_state-npc2": 0.0726843296902851, "sim_compute_robot_state-npc3": 0.07345060468877404}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.1931402335564295, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.05889975527922312, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.15390782058238983, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.0977311929066976, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.038101136684417725, "sim_compute_performance-ego": 0.06988384823004405, "sim_compute_robot_state-ego": 0.07611844937006633, "sim_compute_robot_state-npc0": 0.06970613201459248, "sim_compute_robot_state-npc1": 0.07253833611806233, "sim_compute_robot_state-npc2": 0.06788947681585948, "sim_compute_robot_state-npc3": 0.06834089756011963}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1980260894412086, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06301837875729516, "in-drivable-lane": 0, "agent_compute-ego": 0.15897234280904135, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.095352570215861, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03782377924237933, "sim_compute_performance-ego": 0.07013080233619326, "sim_compute_robot_state-ego": 0.07363406817118327, "sim_compute_robot_state-npc0": 0.06980569022042411, "sim_compute_robot_state-npc1": 0.07261940411158971, "sim_compute_robot_state-npc2": 0.07008000782557897, "sim_compute_robot_state-npc3": 0.06836785588945661}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.203996215751785, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.06271861127750603, "in-drivable-lane": 2, "agent_compute-ego": 0.15800981892797047, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.09801517989107236, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.04001798030145154, "sim_compute_performance-ego": 0.07133056303698146, "sim_compute_robot_state-ego": 0.07863844511751643, "sim_compute_robot_state-npc0": 0.06905841827392578, "sim_compute_robot_state-npc1": 0.07078269712939234, "sim_compute_robot_state-npc2": 0.07079041646626182, "sim_compute_robot_state-npc3": 0.07250153804253676}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.2051212070057693, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.061628804623501975, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14925430816354104, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.09431846396436969, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.0382951278130985, "sim_compute_performance-ego": 0.06620945976775827, "sim_compute_robot_state-ego": 0.07352233395993131, "sim_compute_robot_state-npc0": 0.07672594125988413, "sim_compute_robot_state-npc1": 0.06772145021308973, "sim_compute_robot_state-npc2": 0.07151989797944004, "sim_compute_robot_state-npc3": 0.0694707620491102}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.20525562286376953, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.06102067947387695, "in-drivable-lane": 0, "agent_compute-ego": 0.151539306640625, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.09516477108001709, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03948815822601318, "sim_compute_performance-ego": 0.06630090236663819, "sim_compute_robot_state-ego": 0.07105167388916016, "sim_compute_robot_state-npc0": 0.06939900398254395, "sim_compute_robot_state-npc1": 0.06909412860870362, "sim_compute_robot_state-npc2": 0.06847365379333496, "sim_compute_robot_state-npc3": 0.06674327850341796}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.23332378038993248, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06745843703930195, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16722194506571844, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.10699975490570068, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.04192429322462816, "sim_compute_performance-ego": 0.07541423119031467, "sim_compute_robot_state-ego": 0.08770690514491154, "sim_compute_robot_state-npc0": 0.07367177192981426, "sim_compute_robot_state-npc1": 0.07333363478000347, "sim_compute_robot_state-npc2": 0.07281445539914645, "sim_compute_robot_state-npc3": 0.07466728870685284}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.2414106955895057, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06662397201244648, "in-drivable-lane": 0, "agent_compute-ego": 0.16252249020796555, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.09817108741173378, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.040324706297654375, "sim_compute_performance-ego": 0.07334412978245662, "sim_compute_robot_state-ego": 0.07767229813795823, "sim_compute_robot_state-npc0": 0.07155010333428016, "sim_compute_robot_state-npc1": 0.07578729666196383, "sim_compute_robot_state-npc2": 0.07444368875943698, "sim_compute_robot_state-npc3": 0.07069266759432279}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.2006264708258889, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06342648376118053, "in-drivable-lane": 0, "agent_compute-ego": 0.14718160846016623, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.10354530811309814, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.0380151705308394, "sim_compute_performance-ego": 0.07033882357857445, "sim_compute_robot_state-ego": 0.07408400015397505, "sim_compute_robot_state-npc0": 0.06580479578538374, "sim_compute_robot_state-npc1": 0.07109386270696466, "sim_compute_robot_state-npc2": 0.07200832800431685, "sim_compute_robot_state-npc3": 0.06819708780808882}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.17453941822052002, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06271063327789307, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1537902069091797, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.09294427871704102, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.037311339378356935, "sim_compute_performance-ego": 0.06797646045684815, "sim_compute_robot_state-ego": 0.07400153636932373, "sim_compute_robot_state-npc0": 0.06761928081512451, "sim_compute_robot_state-npc1": 0.06517164707183838, "sim_compute_robot_state-npc2": 0.06578044414520264, "sim_compute_robot_state-npc3": 0.06474825859069824}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.20067748363981855, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.061021272172319126, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.1514436716729022, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.09447940613361117, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.03998952977200772, "sim_compute_performance-ego": 0.06893517869584104, "sim_compute_robot_state-ego": 0.0750314453814892, "sim_compute_robot_state-npc0": 0.06744057320533915, "sim_compute_robot_state-npc1": 0.06684420971160239, "sim_compute_robot_state-npc2": 0.07023898337749725, "sim_compute_robot_state-npc3": 0.06872883502473222}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.2069228887557983, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06417755438731267, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1573143463868361, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.0968733659157386, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.04015142642534696, "sim_compute_performance-ego": 0.07060102774546696, "sim_compute_robot_state-ego": 0.0784544302867009, "sim_compute_robot_state-npc0": 0.07124351996641892, "sim_compute_robot_state-npc1": 0.07042103547316331, "sim_compute_robot_state-npc2": 0.06921963508312519, "sim_compute_robot_state-npc3": 0.07040005463820237}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.1793178263164702, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.061737046922956194, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.1511205650511242, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.0928757349650065, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.03913474082946777, "sim_compute_performance-ego": 0.06761943499247233, "sim_compute_robot_state-ego": 0.07170276187715076, "sim_compute_robot_state-npc0": 0.06691044171651205, "sim_compute_robot_state-npc1": 0.06895176115490141, "sim_compute_robot_state-npc2": 0.06869666235787528, "sim_compute_robot_state-npc3": 0.06877732503981818}}
set_robot_commands_max	0.10699975490570068
set_robot_commands_mean	0.09745284007515992
set_robot_commands_median	0.0968733659157386
set_robot_commands_min	0.0928757349650065
sim_compute_performance-ego_max	0.07541423119031467
sim_compute_performance-ego_mean	0.06990202730394038
sim_compute_performance-ego_median	0.07013080233619326
sim_compute_performance-ego_min	0.06620945976775827
sim_compute_robot_state-ego_max	0.08770690514491154
sim_compute_robot_state-ego_mean	0.07632233917047201
sim_compute_robot_state-ego_median	0.0750314453814892
sim_compute_robot_state-ego_min	0.07105167388916016
sim_compute_robot_state-npc0_max	0.07672594125988413
sim_compute_robot_state-npc0_mean	0.07005868045753633
sim_compute_robot_state-npc0_median	0.06970613201459248
sim_compute_robot_state-npc0_min	0.06580479578538374
sim_compute_robot_state-npc1_max	0.07578729666196383
sim_compute_robot_state-npc1_mean	0.07069034182980082
sim_compute_robot_state-npc1_median	0.07078269712939234
sim_compute_robot_state-npc1_min	0.06517164707183838
sim_compute_robot_state-npc2_max	0.07444368875943698
sim_compute_robot_state-npc2_mean	0.0701777920038524
sim_compute_robot_state-npc2_median	0.07023898337749725
sim_compute_robot_state-npc2_min	0.06578044414520264
sim_compute_robot_state-npc3_max	0.07609885931015015
sim_compute_robot_state-npc3_mean	0.06971938626361601
sim_compute_robot_state-npc3_median	0.06877732503981818
sim_compute_robot_state-npc3_min	0.06460548050795929
sim_compute_sim_state_max	0.04201396022524152
sim_compute_sim_state_mean	0.039265850070075305
sim_compute_sim_state_median	0.03948815822601318
sim_compute_sim_state_min	0.035986658893054045
sim_physics_max	0.2414106955895057
sim_physics_mean	0.2035548835117605
sim_physics_median	0.20067748363981855
sim_physics_min	0.17453941822052002
sim_render-ego_max	0.0695742472861577
sim_render-ego_mean	0.063542806541912
sim_render-ego_median	0.06271861127750603
sim_render-ego_min	0.05889975527922312
simulation-passed	1
survival_time_max	8.349999999999984
survival_time_mean	3.3333333333333286
survival_time_min	1.0500000000000005

No reset possible

22938

2499

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

aido2-LFVI-sim-testing

step1-simulation

success

yes

ip-172-31-40-253-3847

2019-05-17 04:06:23+00:00

2019-05-17 04:25:05+00:00

0:18:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.23356919140029575
survival_time_median	1.5500000000000007
deviation-center-line_median	0.1056904917896022
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.19315692901611328
agent_compute-ego_mean	0.1737490270390965
agent_compute-ego_median	0.17483253479003907
agent_compute-ego_min	0.1381561448497157
deviation-center-line_max	0.14784202605609845
deviation-center-line_mean	0.1016079030861103
deviation-center-line_min	0.05974673579480917
deviation-heading_max	1.0307177433761603
deviation-heading_mean	0.6222654881876274
deviation-heading_median	0.6903017356270803
deviation-heading_min	0.38203308049776047
driven_any_max	0.4279219069518986
driven_any_mean	0.2793720663780102
driven_any_median	0.2876357061084567
driven_any_min	0.16104946337865889
driven_lanedir_consec_max	0.34351695401031046
driven_lanedir_consec_mean	0.2327139818594781
driven_lanedir_consec_min	0.12786081395086368
driven_lanedir_max	0.34351695401031046
driven_lanedir_mean	0.2327139818594781
driven_lanedir_median	0.23356919140029575
driven_lanedir_min	0.12786081395086368
in-drivable-lane_max	0.05000000000000005
in-drivable-lane_mean	0.013333333333333345
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.29308239412902776, "sim_physics": 0.15178110522608604, "survival_time": 1.5500000000000007, "driven_lanedir": 0.23356919140029575, "sim_render-ego": 0.04900947693855532, "in-drivable-lane": 0, "agent_compute-ego": 0.1381561448497157, "deviation-heading": 0.7439854412495074, "set_robot_commands": 0.07121364531978484, "deviation-center-line": 0.1056904917896022, "driven_lanedir_consec": 0.23356919140029575, "sim_compute_sim_state": 0.0302642083937122, "sim_compute_performance-ego": 0.05538477436188729, "sim_compute_robot_state-ego": 0.05721196051566831, "sim_compute_robot_state-npc0": 0.053957085455617594, "sim_compute_robot_state-npc1": 0.05319519196787188, "sim_compute_robot_state-npc2": 0.053082681471301664, "sim_compute_robot_state-npc3": 0.05312667354460685}, "udem1-1-0": {"driven_any": 0.2284815620051714, "sim_physics": 0.2225224494934082, "survival_time": 1.2500000000000004, "driven_lanedir": 0.15821868998250865, "sim_render-ego": 0.06909192085266114, "in-drivable-lane": 0, "agent_compute-ego": 0.1816263866424561, "deviation-heading": 0.8174248432739096, "set_robot_commands": 0.09649744987487792, "deviation-center-line": 0.08450918276400904, "driven_lanedir_consec": 0.15821868998250865, "sim_compute_sim_state": 0.039737672805786134, "sim_compute_performance-ego": 0.06993693351745606, "sim_compute_robot_state-ego": 0.07385391235351563, "sim_compute_robot_state-npc0": 0.07545166969299316, "sim_compute_robot_state-npc1": 0.07532422065734863, "sim_compute_robot_state-npc2": 0.07405117034912109, "sim_compute_robot_state-npc3": 0.07711867332458495}, "udem1-2-0": {"driven_any": 0.26355228945583303, "sim_physics": 0.24589232740731076, "survival_time": 1.4500000000000006, "driven_lanedir": 0.2301646997373283, "sim_render-ego": 0.06320523393565211, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17011315247108197, "deviation-heading": 0.38203308049776047, "set_robot_commands": 0.09684808500881852, "deviation-center-line": 0.12401551369024284, "driven_lanedir_consec": 0.2301646997373283, "sim_compute_sim_state": 0.03904153560769969, "sim_compute_performance-ego": 0.06739442101840315, "sim_compute_robot_state-ego": 0.07309449130091174, "sim_compute_robot_state-npc0": 0.0728066954119452, "sim_compute_robot_state-npc1": 0.07532511908432533, "sim_compute_robot_state-npc2": 0.07289402238253889, "sim_compute_robot_state-npc3": 0.07165672039163523}, "udem1-3-0": {"driven_any": 0.2876357061084567, "sim_physics": 0.22014321050336283, "survival_time": 1.5500000000000007, "driven_lanedir": 0.25578312034093775, "sim_render-ego": 0.06620401720846852, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18328944329292543, "deviation-heading": 0.390587270603202, "set_robot_commands": 0.0965855352340206, "deviation-center-line": 0.1211910163215702, "driven_lanedir_consec": 0.25578312034093775, "sim_compute_sim_state": 0.037820285366427515, "sim_compute_performance-ego": 0.07151488334901872, "sim_compute_robot_state-ego": 0.07867107852812737, "sim_compute_robot_state-npc0": 0.06912718280669182, "sim_compute_robot_state-npc1": 0.06860716881290559, "sim_compute_robot_state-npc2": 0.07100420613442698, "sim_compute_robot_state-npc3": 0.06763729741496424}, "udem1-4-0": {"driven_any": 0.2322239410415205, "sim_physics": 0.20612090110778808, "survival_time": 1.2500000000000004, "driven_lanedir": 0.18608610279804896, "sim_render-ego": 0.06591239929199219, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.19315692901611328, "deviation-heading": 0.5694330133359564, "set_robot_commands": 0.10228744506835938, "deviation-center-line": 0.07334749754760075, "driven_lanedir_consec": 0.18608610279804896, "sim_compute_sim_state": 0.03869771957397461, "sim_compute_performance-ego": 0.07424585342407226, "sim_compute_robot_state-ego": 0.0864449405670166, "sim_compute_robot_state-npc0": 0.06945788383483886, "sim_compute_robot_state-npc1": 0.06712491989135742, "sim_compute_robot_state-npc2": 0.0689844799041748, "sim_compute_robot_state-npc3": 0.0685588264465332}, "udem1-5-0": {"driven_any": 0.4279219069518986, "sim_physics": 0.1786985009215599, "survival_time": 2.1500000000000004, "driven_lanedir": 0.34351695401031046, "sim_render-ego": 0.05645311710446379, "in-drivable-lane": 0, "agent_compute-ego": 0.165311430775842, "deviation-heading": 1.0307177433761603, "set_robot_commands": 0.0973985749621724, "deviation-center-line": 0.14784202605609845, "driven_lanedir_consec": 0.34351695401031046, "sim_compute_sim_state": 0.03771707623503929, "sim_compute_performance-ego": 0.06643812600956407, "sim_compute_robot_state-ego": 0.0688355800717376, "sim_compute_robot_state-npc0": 0.06621160063632699, "sim_compute_robot_state-npc1": 0.06224532460057458, "sim_compute_robot_state-npc2": 0.06674935651379962, "sim_compute_robot_state-npc3": 0.06371896765952886}, "udem1-6-0": {"driven_any": 0.32791765141157314, "sim_physics": 0.20442749559879303, "survival_time": 1.6000000000000008, "driven_lanedir": 0.2976733937831195, "sim_render-ego": 0.05369427055120468, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15281646698713303, "deviation-heading": 0.3942546474000477, "set_robot_commands": 0.08179318904876709, "deviation-center-line": 0.1297403120666079, "driven_lanedir_consec": 0.2976733937831195, "sim_compute_sim_state": 0.0409713014960289, "sim_compute_performance-ego": 0.06084734946489334, "sim_compute_robot_state-ego": 0.06588172167539597, "sim_compute_robot_state-npc0": 0.0634879544377327, "sim_compute_robot_state-npc1": 0.060547031462192535, "sim_compute_robot_state-npc2": 0.062170274555683136, "sim_compute_robot_state-npc3": 0.06109467148780823}, "udem1-7-0": {"driven_any": 0.29971256233919347, "sim_physics": 0.20614001967690207, "survival_time": 1.6500000000000008, "driven_lanedir": 0.27496127583922836, "sim_render-ego": 0.06523409034266617, "in-drivable-lane": 0, "agent_compute-ego": 0.187471071879069, "deviation-heading": 0.4837785304442438, "set_robot_commands": 0.09528779983520508, "deviation-center-line": 0.12453589118076168, "driven_lanedir_consec": 0.27496127583922836, "sim_compute_sim_state": 0.040794574853145714, "sim_compute_performance-ego": 0.07122788284764145, "sim_compute_robot_state-ego": 0.07654815731626569, "sim_compute_robot_state-npc0": 0.06592676133820505, "sim_compute_robot_state-npc1": 0.06942692669955167, "sim_compute_robot_state-npc2": 0.06921252337369052, "sim_compute_robot_state-npc3": 0.06927501794063684}, "udem1-8-0": {"driven_any": 0.35146341821273697, "sim_physics": 0.201917957615208, "survival_time": 1.850000000000001, "driven_lanedir": 0.2995063827009914, "sim_render-ego": 0.06301201356423868, "in-drivable-lane": 0, "agent_compute-ego": 0.17779716929873904, "deviation-heading": 0.7416122555313746, "set_robot_commands": 0.0966817366110312, "deviation-center-line": 0.08542788847761074, "driven_lanedir_consec": 0.2995063827009914, "sim_compute_sim_state": 0.03813396273432551, "sim_compute_performance-ego": 0.07025727710208378, "sim_compute_robot_state-ego": 0.0805643893576957, "sim_compute_robot_state-npc0": 0.06974825987944731, "sim_compute_robot_state-npc1": 0.07146040168968407, "sim_compute_robot_state-npc2": 0.07025064004434121, "sim_compute_robot_state-npc3": 0.06851888991690971}, "udem1-9-0": {"driven_any": 0.24672877535585777, "sim_physics": 0.22735318770775428, "survival_time": 1.3000000000000005, "driven_lanedir": 0.19458025238182872, "sim_render-ego": 0.06296314642979549, "in-drivable-lane": 0, "agent_compute-ego": 0.18431086723621076, "deviation-heading": 0.6903017356270803, "set_robot_commands": 0.09465212088364822, "deviation-center-line": 0.07463114417353597, "driven_lanedir_consec": 0.19458025238182872, "sim_compute_sim_state": 0.04153126936692458, "sim_compute_performance-ego": 0.07225681268251859, "sim_compute_robot_state-ego": 0.07885127801161546, "sim_compute_robot_state-npc0": 0.06738584775191087, "sim_compute_robot_state-npc1": 0.07496245090778057, "sim_compute_robot_state-npc2": 0.06989763333247258, "sim_compute_robot_state-npc3": 0.07143503886002761}, "udem1-10-0": {"driven_any": 0.18146533780324453, "sim_physics": 0.20863033377605936, "survival_time": 1.1500000000000004, "driven_lanedir": 0.12786081395086368, "sim_render-ego": 0.060758352279663086, "in-drivable-lane": 0, "agent_compute-ego": 0.16582918167114258, "deviation-heading": 0.7309471410531787, "set_robot_commands": 0.09323986716892407, "deviation-center-line": 0.05974673579480917, "driven_lanedir_consec": 0.12786081395086368, "sim_compute_sim_state": 0.03956064970596977, "sim_compute_performance-ego": 0.06477921942005986, "sim_compute_robot_state-ego": 0.07108133772145146, "sim_compute_robot_state-npc0": 0.06969419769618822, "sim_compute_robot_state-npc1": 0.06980616113413936, "sim_compute_robot_state-npc2": 0.07084088740141495, "sim_compute_robot_state-npc3": 0.06603725060172703}, "udem1-11-0": {"driven_any": 0.16104946337865889, "sim_physics": 0.18767731189727785, "survival_time": 1.0000000000000002, "driven_lanedir": 0.13489778064275493, "sim_render-ego": 0.06099039316177368, "in-drivable-lane": 0, "agent_compute-ego": 0.17483253479003907, "deviation-heading": 0.4069992131871475, "set_robot_commands": 0.0911582350730896, "deviation-center-line": 0.09231785175860296, "driven_lanedir_consec": 0.13489778064275493, "sim_compute_sim_state": 0.03781082630157471, "sim_compute_performance-ego": 0.0656701922416687, "sim_compute_robot_state-ego": 0.07020400762557984, "sim_compute_robot_state-npc0": 0.06629047393798829, "sim_compute_robot_state-npc1": 0.07088220119476318, "sim_compute_robot_state-npc2": 0.06545730829238891, "sim_compute_robot_state-npc3": 0.06628654003143311}, "udem1-12-0": {"driven_any": 0.32501390100994193, "sim_physics": 0.21169635908944265, "survival_time": 1.7500000000000009, "driven_lanedir": 0.26857354569688074, "sim_render-ego": 0.06142142159598214, "in-drivable-lane": 0, "agent_compute-ego": 0.1719043459211077, "deviation-heading": 0.771831903546438, "set_robot_commands": 0.09874271665300642, "deviation-center-line": 0.11733222491398004, "driven_lanedir_consec": 0.26857354569688074, "sim_compute_sim_state": 0.03743924413408552, "sim_compute_performance-ego": 0.06603930337088448, "sim_compute_robot_state-ego": 0.07026177133832659, "sim_compute_robot_state-npc0": 0.06925198010035924, "sim_compute_robot_state-npc1": 0.06869684628077916, "sim_compute_robot_state-npc2": 0.0698432377406529, "sim_compute_robot_state-npc3": 0.07042653220040458}, "udem1-13-0": {"driven_any": 0.2190551355517376, "sim_physics": 0.22305987431452823, "survival_time": 1.3000000000000005, "driven_lanedir": 0.19209629605724743, "sim_render-ego": 0.07014789031102107, "in-drivable-lane": 0, "agent_compute-ego": 0.19122484097113976, "deviation-heading": 0.4223293331536395, "set_robot_commands": 0.1044158752147968, "deviation-center-line": 0.10577969460776926, "driven_lanedir_consec": 0.19209629605724743, "sim_compute_sim_state": 0.041993911449725814, "sim_compute_performance-ego": 0.07708454132080078, "sim_compute_robot_state-ego": 0.08367727353022648, "sim_compute_robot_state-npc0": 0.07515120506286621, "sim_compute_robot_state-npc1": 0.07596665162306565, "sim_compute_robot_state-npc2": 0.07563622181232159, "sim_compute_robot_state-npc3": 0.07381323667672965}, "udem1-14-0": {"driven_any": 0.3452769509153013, "sim_physics": 0.18660100301106772, "survival_time": 1.800000000000001, "driven_lanedir": 0.29322122856982724, "sim_render-ego": 0.06274625990125868, "in-drivable-lane": 0, "agent_compute-ego": 0.1683954397837321, "deviation-heading": 0.7577461705347642, "set_robot_commands": 0.0965947111447652, "deviation-center-line": 0.0780110751488531, "driven_lanedir_consec": 0.29322122856982724, "sim_compute_sim_state": 0.038612584273020424, "sim_compute_performance-ego": 0.06677275233798557, "sim_compute_robot_state-ego": 0.07030588388442993, "sim_compute_robot_state-npc0": 0.06657452715767755, "sim_compute_robot_state-npc1": 0.06857308414247301, "sim_compute_robot_state-npc2": 0.06744116544723511, "sim_compute_robot_state-npc3": 0.065569625960456}}
set_robot_commands_max	0.1044158752147968
set_robot_commands_mean	0.09422646580675116
set_robot_commands_median	0.0965855352340206
set_robot_commands_min	0.07121364531978484
sim_compute_performance-ego_max	0.07708454132080078
sim_compute_performance-ego_mean	0.06799002149792921
sim_compute_performance-ego_median	0.06739442101840315
sim_compute_performance-ego_min	0.05538477436188729
sim_compute_robot_state-ego_max	0.0864449405670166
sim_compute_robot_state-ego_mean	0.07369918558653096
sim_compute_robot_state-ego_median	0.07309449130091174
sim_compute_robot_state-ego_min	0.05721196051566831
sim_compute_robot_state-npc0_max	0.07545166969299316
sim_compute_robot_state-npc0_mean	0.06803488834671927
sim_compute_robot_state-npc0_median	0.06912718280669182
sim_compute_robot_state-npc0_min	0.053957085455617594
sim_compute_robot_state-npc1_max	0.07596665162306565
sim_compute_robot_state-npc1_mean	0.06880958000992085
sim_compute_robot_state-npc1_median	0.06942692669955167
sim_compute_robot_state-npc1_min	0.05319519196787188
sim_compute_robot_state-npc2_max	0.07563622181232159
sim_compute_robot_state-npc2_mean	0.0685010539170376
sim_compute_robot_state-npc2_median	0.0698432377406529
sim_compute_robot_state-npc2_min	0.053082681471301664
sim_compute_robot_state-npc3_max	0.07711867332458495
sim_compute_robot_state-npc3_mean	0.06761826416386575
sim_compute_robot_state-npc3_median	0.06851888991690971
sim_compute_robot_state-npc3_min	0.05312667354460685
sim_compute_sim_state_max	0.041993911449725814
sim_compute_sim_state_mean	0.038675121486496024
sim_compute_sim_state_median	0.03869771957397461
sim_compute_sim_state_min	0.0302642083937122
sim_physics_max	0.24589232740731076
sim_physics_mean	0.2055108024897699
sim_physics_median	0.20614001967690207
sim_physics_min	0.15178110522608604
sim_render-ego_max	0.07014789031102107
sim_render-ego_mean	0.06205626689795979
sim_render-ego_median	0.06296314642979549
sim_render-ego_min	0.04900947693855532
simulation-passed	1
survival_time_max	2.1500000000000004
survival_time_mean	1.5066666666666673
survival_time_min	1.0000000000000002

No reset possible

22932

2508

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-40-253-3847

2019-05-17 04:05:30+00:00

2019-05-17 04:06:08+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22923

2517

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

aido2-LF-sim-validation

step1-simulation

error

yes

ip-172-31-40-253-3847

2019-05-17 04:04:31+00:00

2019-05-17 04:05:14+00:00

0:00:43

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22916

2525

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

aido2-LFVI-sim-validation

step1-simulation

error

yes

ip-172-31-40-253-3847

2019-05-17 04:01:21+00:00

2019-05-17 04:04:17+00:00

0:02:56

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22891

2564

Alexander Karavaev

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LFV-sim-testing

step1-simulation

error

yes

ip-172-31-40-253-3847

2019-05-17 03:42:14+00:00

2019-05-17 04:00:27+00:00

0:18:13

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22888

2573

Alexander Karavaev

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-40-253-3847

2019-05-17 03:39:58+00:00

2019-05-17 03:41:53+00:00

0:01:55

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22868

2604

Konstantin Chaika

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LF-sim-testing

step1-simulation

success

yes

ip-172-31-40-253-3847

2019-05-17 03:23:49+00:00

2019-05-17 03:39:51+00:00

0:16:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4126113388371666
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11871775985231396
in-drivable-lane_median	0.9499999999999976

other stats

agent_compute-ego_max	0.0796766482608419
agent_compute-ego_mean	0.06789568675222589
agent_compute-ego_median	0.07104745778170499
agent_compute-ego_min	0.0495123646476052
deviation-center-line_max	0.2616199012603187
deviation-center-line_mean	0.12663752615997417
deviation-center-line_min	0.07143676193760398
deviation-heading_max	1.4563581054905994
deviation-heading_mean	0.5551840294909584
deviation-heading_median	0.55940705176748
deviation-heading_min	0.2596285487829774
driven_any_max	1.6839250134630197
driven_any_mean	0.7327294413370017
driven_any_median	0.7309130538792373
driven_any_min	0.2364518949491652
driven_lanedir_consec_max	0.9416535020294268
driven_lanedir_consec_mean	0.4469104002974222
driven_lanedir_consec_min	0.2221238695940002
driven_lanedir_max	0.9416535020294268
driven_lanedir_mean	0.4469104002974222
driven_lanedir_median	0.4126113388371666
driven_lanedir_min	0.2221238695940002
in-drivable-lane_max	2.1499999999999924
in-drivable-lane_mean	0.8233333333333307
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.11975589940245722, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06626347756721604, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.0796766482608419, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.10430742989123708, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.04000649653689962, "sim_compute_performance-ego": 0.07626351168457891, "sim_compute_robot_state-ego": 0.08303544890712684}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.08541197379430135, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.05194445451100667, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.05810101826985677, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.07769948244094849, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.03186353842417399, "sim_compute_performance-ego": 0.0552812655766805, "sim_compute_robot_state-ego": 0.06294197638829549}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.07981392470273105, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.044191501357338646, "in-drivable-lane": 0, "agent_compute-ego": 0.0495123646476052, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.07222391258586537, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.031738996505737305, "sim_compute_performance-ego": 0.05027002638036555, "sim_compute_robot_state-ego": 0.05377158251675693}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.12398286163806917, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.06721216936906178, "in-drivable-lane": 0, "agent_compute-ego": 0.07331390678882599, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.103341743350029, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.04125900069872538, "sim_compute_performance-ego": 0.0780398299296697, "sim_compute_robot_state-ego": 0.08177986244360606}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.10326993983724844, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.05674744688946268, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.0669032801752505, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.09026097214740256, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.03578910102014956, "sim_compute_performance-ego": 0.06282088549240776, "sim_compute_robot_state-ego": 0.07019070438716722}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.32177231722795413, "sim_physics": 0.12008462349573772, "survival_time": 1.2000000000000004, "driven_lanedir": 0.259671941523266, "sim_render-ego": 0.06780778368314107, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07347775499025981, "deviation-heading": 0.55940705176748, "set_robot_commands": 0.10693439841270448, "deviation-center-line": 0.07983398841276981, "driven_lanedir_consec": 0.259671941523266, "sim_compute_sim_state": 0.04249215126037598, "sim_compute_performance-ego": 0.07368778189023335, "sim_compute_robot_state-ego": 0.07818615436553955}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9218874635466072, "sim_physics": 0.09764131215902476, "survival_time": 3.899999999999994, "driven_lanedir": 0.5450627289344152, "sim_render-ego": 0.060174266497294106, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.06931069875374818, "deviation-heading": 0.6586708623908946, "set_robot_commands": 0.09653771840609036, "deviation-center-line": 0.13114121213460145, "driven_lanedir_consec": 0.5450627289344152, "sim_compute_sim_state": 0.038412842995081194, "sim_compute_performance-ego": 0.06719597180684407, "sim_compute_robot_state-ego": 0.08073656986921261}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8035998912048764, "sim_physics": 0.0807397791317531, "survival_time": 2.799999999999998, "driven_lanedir": 0.4126113388371666, "sim_render-ego": 0.04874316709382193, "in-drivable-lane": 0.9999999999999972, "agent_compute-ego": 0.054390673126493184, "deviation-heading": 0.6465417997696941, "set_robot_commands": 0.07286905816623143, "deviation-center-line": 0.119844131874105, "driven_lanedir_consec": 0.4126113388371666, "sim_compute_sim_state": 0.03051134943962097, "sim_compute_performance-ego": 0.05292690226009914, "sim_compute_robot_state-ego": 0.05706801584788731}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.082025040886041, "sim_physics": 0.11125437144575448, "survival_time": 4.3499999999999925, "driven_lanedir": 0.4507633352947824, "sim_render-ego": 0.06258480028174389, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.07275818682265008, "deviation-heading": 0.6137519362826567, "set_robot_commands": 0.10032874414290505, "deviation-center-line": 0.11871775985231396, "driven_lanedir_consec": 0.4507633352947824, "sim_compute_sim_state": 0.0383841443335873, "sim_compute_performance-ego": 0.07169849571140333, "sim_compute_robot_state-ego": 0.08356809890133211}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6839250134630197, "sim_physics": 0.11403040452436967, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9416535020294268, "sim_render-ego": 0.06049831130287864, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.07162981033325196, "deviation-heading": 1.4563581054905994, "set_robot_commands": 0.09581118496981536, "deviation-center-line": 0.2616199012603187, "driven_lanedir_consec": 0.9416535020294268, "sim_compute_sim_state": 0.03934292576529763, "sim_compute_performance-ego": 0.06956261721524325, "sim_compute_robot_state-ego": 0.07572201815518466}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.2667775284624888, "sim_physics": 0.11251043279965718, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25235480657068055, "sim_render-ego": 0.058925857146581016, "in-drivable-lane": 0, "agent_compute-ego": 0.06425014138221741, "deviation-heading": 0.2735028974766809, "set_robot_commands": 0.08978629112243652, "deviation-center-line": 0.10630271043038582, "driven_lanedir_consec": 0.25235480657068055, "sim_compute_sim_state": 0.034360130627950035, "sim_compute_performance-ego": 0.06844439109166463, "sim_compute_robot_state-ego": 0.07043453057607015}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0389325864387626, "sim_physics": 0.10014026195971996, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4755729783153157, "sim_render-ego": 0.06122109797093776, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.07104745778170499, "deviation-heading": 0.521699236138543, "set_robot_commands": 0.0974467419958734, "deviation-center-line": 0.10517150645857888, "driven_lanedir_consec": 0.4755729783153157, "sim_compute_sim_state": 0.03925995393232866, "sim_compute_performance-ego": 0.06842124616944945, "sim_compute_robot_state-ego": 0.0755316870553153}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6835794874956865, "sim_physics": 0.11184316635131836, "survival_time": 2.499999999999999, "driven_lanedir": 0.6100305079584653, "sim_render-ego": 0.06458903312683105, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.07173400402069091, "deviation-heading": 0.4739455376152246, "set_robot_commands": 0.1030643892288208, "deviation-center-line": 0.12143860235134882, "driven_lanedir_consec": 0.6100305079584653, "sim_compute_sim_state": 0.03937092781066895, "sim_compute_performance-ego": 0.07258841037750244, "sim_compute_robot_state-ego": 0.08201473712921142}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.29517411990766207, "sim_physics": 0.11494285326737624, "survival_time": 1.3000000000000005, "driven_lanedir": 0.25251967754950355, "sim_render-ego": 0.0634382046186007, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0706115594277015, "deviation-heading": 0.466101326638835, "set_robot_commands": 0.09925077511714056, "deviation-center-line": 0.07143676193760398, "driven_lanedir_consec": 0.25251967754950355, "sim_compute_sim_state": 0.0395273520396306, "sim_compute_performance-ego": 0.0734861814058744, "sim_compute_robot_state-ego": 0.0823068435375507}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7309130538792373, "sim_physics": 0.11582197966399016, "survival_time": 2.6999999999999984, "driven_lanedir": 0.38087957155028906, "sim_render-ego": 0.06099980407290989, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.07171779650228995, "deviation-heading": 0.5607794956477159, "set_robot_commands": 0.09823369979858398, "deviation-center-line": 0.12406277512673576, "driven_lanedir_consec": 0.38087957155028906, "sim_compute_sim_state": 0.04044506284925672, "sim_compute_performance-ego": 0.07068993868651213, "sim_compute_robot_state-ego": 0.07903605037265354}}
set_robot_commands_max	0.10693439841270448
set_robot_commands_mean	0.09387310278507228
set_robot_commands_median	0.0974467419958734
set_robot_commands_min	0.07222391258586537
sim_compute_performance-ego_max	0.0780398299296697
sim_compute_performance-ego_mean	0.06742516371190191
sim_compute_performance-ego_median	0.06956261721524325
sim_compute_performance-ego_min	0.05027002638036555
sim_compute_robot_state-ego_max	0.08356809890133211
sim_compute_robot_state-ego_mean	0.07442161869686066
sim_compute_robot_state-ego_median	0.07818615436553955
sim_compute_robot_state-ego_min	0.05377158251675693
sim_compute_sim_state_max	0.04249215126037598
sim_compute_sim_state_mean	0.037517598282632264
sim_compute_sim_state_median	0.03925995393232866
sim_compute_sim_state_min	0.03051134943962097
sim_physics_max	0.12398286163806917
sim_physics_mean	0.1060829189449006
sim_physics_median	0.11184316635131836
sim_physics_min	0.07981392470273105
sim_render-ego_max	0.06780778368314107
sim_render-ego_mean	0.05968942503258839
sim_render-ego_median	0.06099980407290989
sim_render-ego_min	0.044191501357338646
simulation-passed	1
survival_time_max	5.4999999999999885
survival_time_mean	2.7766666666666637
survival_time_min	1.1000000000000003

No reset possible

22845

2632

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

aido2-LFV-sim-testing

step1-simulation

success

yes

ip-172-31-40-253-3847

2019-05-17 03:00:53+00:00

2019-05-17 03:22:48+00:00

0:21:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.47061816984274774
survival_time_median	2.4499999999999993
deviation-center-line_median	0.09047885846140293
in-drivable-lane_median	0.7999999999999974

other stats

agent_compute-ego_max	0.17054445743560792
agent_compute-ego_mean	0.15326900174606975
agent_compute-ego_median	0.15365346100019373
agent_compute-ego_min	0.1249864282487314
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.11122054568266285
deviation-center-line_min	0.05649185041622204
deviation-heading_max	0.8583234710357402
deviation-heading_mean	0.371509805944231
deviation-heading_median	0.3477435217829391
deviation-heading_min	0.1892537419842091
driven_any_max	1.6169932854589035
driven_any_mean	0.8549136794030617
driven_any_median	0.9441796518284096
driven_any_min	0.28668385087664994
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.5622432991481365
driven_lanedir_consec_min	0.24216121529728207
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.5622432991481365
driven_lanedir_median	0.47061816984274774
driven_lanedir_min	0.24216121529728207
in-drivable-lane_max	1.3499999999999996
in-drivable-lane_mean	0.5899999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.16348443649433278, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06416797637939453, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16034608417087132, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10043999000831888, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04100902875264486, "sim_compute_performance-ego": 0.07378695187745271, "sim_compute_robot_state-ego": 0.08079169856177436, "sim_compute_robot_state-npc0": 0.07089449299706353, "sim_compute_robot_state-npc1": 0.07239009715892651, "sim_compute_robot_state-npc2": 0.07412245980015507, "sim_compute_robot_state-npc3": 0.07327725710692229}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.16930325508117677, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06259916305541992, "in-drivable-lane": 0, "agent_compute-ego": 0.14750585556030274, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09780652046203614, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.03561881065368652, "sim_compute_performance-ego": 0.06515002250671387, "sim_compute_robot_state-ego": 0.06999045372009277, "sim_compute_robot_state-npc0": 0.06673898696899414, "sim_compute_robot_state-npc1": 0.0647242546081543, "sim_compute_robot_state-npc2": 0.06279389381408691, "sim_compute_robot_state-npc3": 0.06452648162841797}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17538484774137797, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06296993556775544, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.15589091024900736, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09442387129131116, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.04118630760594418, "sim_compute_performance-ego": 0.07120095428667571, "sim_compute_robot_state-ego": 0.07413538192447863, "sim_compute_robot_state-npc0": 0.0686658589463485, "sim_compute_robot_state-npc1": 0.06996680874573558, "sim_compute_robot_state-npc2": 0.06975354960090235, "sim_compute_robot_state-npc3": 0.07196068450024254}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.13972686212274094, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.048859578144701224, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1249864282487314, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.07220172580284408, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.029550923576837855, "sim_compute_performance-ego": 0.05181491224071647, "sim_compute_robot_state-ego": 0.05829531331605549, "sim_compute_robot_state-npc0": 0.05625427221950097, "sim_compute_robot_state-npc1": 0.0519520874264874, "sim_compute_robot_state-npc2": 0.05394067945359629, "sim_compute_robot_state-npc3": 0.052316529841362674}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1667208927018302, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.061234048434666226, "in-drivable-lane": 0, "agent_compute-ego": 0.15052098887307302, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0911848885672433, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.038007378578186035, "sim_compute_performance-ego": 0.07079241105488368, "sim_compute_robot_state-ego": 0.07859313488006592, "sim_compute_robot_state-npc0": 0.06840340580259051, "sim_compute_robot_state-npc1": 0.06475199971880231, "sim_compute_robot_state-npc2": 0.06608551740646362, "sim_compute_robot_state-npc3": 0.06706563064030238}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.16203442326298467, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.06320001460887768, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.15742290019989014, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.09993437925974528, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.03996821686073586, "sim_compute_performance-ego": 0.07102621926201715, "sim_compute_robot_state-ego": 0.07386537392934163, "sim_compute_robot_state-npc0": 0.07060350312127008, "sim_compute_robot_state-npc1": 0.07128676220222756, "sim_compute_robot_state-npc2": 0.07213054762946235, "sim_compute_robot_state-npc3": 0.06865302721659343}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.1622398164537218, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.062223076820373535, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.15244521918120207, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.0972786302919741, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.03803525589130543, "sim_compute_performance-ego": 0.06803182760874431, "sim_compute_robot_state-ego": 0.07395947421038593, "sim_compute_robot_state-npc0": 0.07038294827496563, "sim_compute_robot_state-npc1": 0.07271314550329137, "sim_compute_robot_state-npc2": 0.07147438437850387, "sim_compute_robot_state-npc3": 0.0707653628455268}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.20495394070943196, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.06384898821512858, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.14745496643914116, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.09754731390211316, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.04187631077236599, "sim_compute_performance-ego": 0.07063974804348416, "sim_compute_robot_state-ego": 0.077951357099745, "sim_compute_robot_state-npc0": 0.07152888509962294, "sim_compute_robot_state-npc1": 0.07113474739922418, "sim_compute_robot_state-npc2": 0.07200446658664279, "sim_compute_robot_state-npc3": 0.07075606452094184}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.1709906070128731, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.06162524741628896, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.15365346100019373, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.09675001579782236, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.03893574942713198, "sim_compute_performance-ego": 0.0710401846014935, "sim_compute_robot_state-ego": 0.0777132511138916, "sim_compute_robot_state-npc0": 0.06749173869257388, "sim_compute_robot_state-npc1": 0.06731511198956033, "sim_compute_robot_state-npc2": 0.07060890612394913, "sim_compute_robot_state-npc3": 0.06937271097432011}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.184713134765625, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.06288336753845215, "in-drivable-lane": 0, "agent_compute-ego": 0.15382501602172852, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.09075130462646484, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.039897584915161134, "sim_compute_performance-ego": 0.06748695850372315, "sim_compute_robot_state-ego": 0.07230766296386719, "sim_compute_robot_state-npc0": 0.06720998287200927, "sim_compute_robot_state-npc1": 0.0643012523651123, "sim_compute_robot_state-npc2": 0.06503701686859131, "sim_compute_robot_state-npc3": 0.07049318313598633}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.21479833126068115, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.06699057817459106, "in-drivable-lane": 0, "agent_compute-ego": 0.16798851490020753, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.09449297189712524, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.03875377178192139, "sim_compute_performance-ego": 0.08129211664199829, "sim_compute_robot_state-ego": 0.0838469386100769, "sim_compute_robot_state-npc0": 0.07304362058639527, "sim_compute_robot_state-npc1": 0.06919090747833252, "sim_compute_robot_state-npc2": 0.07149168252944946, "sim_compute_robot_state-npc3": 0.07332719564437866}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.16415821878533615, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.0613970254596911, "in-drivable-lane": 0, "agent_compute-ego": 0.14191298735769173, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.09167397649664628, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.04297247685884174, "sim_compute_performance-ego": 0.06953400059750206, "sim_compute_robot_state-ego": 0.07280958326239335, "sim_compute_robot_state-npc0": 0.06513826470626027, "sim_compute_robot_state-npc1": 0.06501465094716925, "sim_compute_robot_state-npc2": 0.0682814874147114, "sim_compute_robot_state-npc3": 0.06693343112343236}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.17449150562286378, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.06645752906799317, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.17054445743560792, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.10473747730255129, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.042783594131469725, "sim_compute_performance-ego": 0.07626745700836182, "sim_compute_robot_state-ego": 0.08475580215454101, "sim_compute_robot_state-npc0": 0.07400274276733398, "sim_compute_robot_state-npc1": 0.07219197273254395, "sim_compute_robot_state-npc2": 0.07308565616607667, "sim_compute_robot_state-npc3": 0.07276169776916504}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.2366520816629583, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.06544137001037598, "in-drivable-lane": 0, "agent_compute-ego": 0.1617100563916293, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.10754326256838712, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.04129770669070157, "sim_compute_performance-ego": 0.07317307862368497, "sim_compute_robot_state-ego": 0.08480786193500865, "sim_compute_robot_state-npc0": 0.06855694814161821, "sim_compute_robot_state-npc1": 0.0713449174707586, "sim_compute_robot_state-npc2": 0.07422280311584473, "sim_compute_robot_state-npc3": 0.07499588619578969}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.2032301766531808, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.06693460016834493, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.15282718016176808, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.09649444599540866, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.03975336405695701, "sim_compute_performance-ego": 0.067400937177697, "sim_compute_robot_state-ego": 0.07587818710171447, "sim_compute_robot_state-npc0": 0.06841966084071568, "sim_compute_robot_state-npc1": 0.06842096484437281, "sim_compute_robot_state-npc2": 0.07308107979443608, "sim_compute_robot_state-npc3": 0.0695439455460529}}
set_robot_commands_max	0.10754326256838712
set_robot_commands_mean	0.09555071828466614
set_robot_commands_median	0.09675001579782236
set_robot_commands_min	0.07220172580284408
sim_compute_performance-ego_max	0.08129211664199829
sim_compute_performance-ego_mean	0.06990918533567658
sim_compute_performance-ego_median	0.07079241105488368
sim_compute_performance-ego_min	0.05181491224071647
sim_compute_robot_state-ego_max	0.08480786193500865
sim_compute_robot_state-ego_mean	0.07598009831889553
sim_compute_robot_state-ego_median	0.07587818710171447
sim_compute_robot_state-ego_min	0.05829531331605549
sim_compute_robot_state-npc0_max	0.07400274276733398
sim_compute_robot_state-npc0_mean	0.06848902080248419
sim_compute_robot_state-npc0_median	0.06855694814161821
sim_compute_robot_state-npc0_min	0.05625427221950097
sim_compute_robot_state-npc1_max	0.07271314550329137
sim_compute_robot_state-npc1_mean	0.06777997870604661
sim_compute_robot_state-npc1_median	0.06919090747833252
sim_compute_robot_state-npc1_min	0.0519520874264874
sim_compute_robot_state-npc2_max	0.07422280311584473
sim_compute_robot_state-npc2_mean	0.06920760871219148
sim_compute_robot_state-npc2_median	0.07147438437850387
sim_compute_robot_state-npc2_min	0.05394067945359629
sim_compute_robot_state-npc3_max	0.07499588619578969
sim_compute_robot_state-npc3_mean	0.06911660591262898
sim_compute_robot_state-npc3_median	0.07049318313598633
sim_compute_robot_state-npc3_min	0.052316529841362674
sim_compute_sim_state_max	0.04297247685884174
sim_compute_sim_state_mean	0.03930976537025942
sim_compute_sim_state_median	0.039897584915161134
sim_compute_sim_state_min	0.029550923576837855
sim_physics_max	0.2366520816629583
sim_physics_mean	0.1795255020220744
sim_physics_median	0.1709906070128731
sim_physics_min	0.13972686212274094
sim_render-ego_max	0.06699057817459106
sim_render-ego_mean	0.06272216660413696
sim_render-ego_median	0.06296993556775544
sim_render-ego_min	0.048859578144701224
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2366666666666655
survival_time_min	0.9500000000000004

No reset possible

22825

2690

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-40-253-3847

2019-05-17 02:26:36+00:00

2019-05-17 03:00:24+00:00

0:33:48

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22790

2758

Bhairav Mehta

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LFV-sim-testing

step1-simulation

success

yes

ip-172-31-40-253-3847

2019-05-17 02:00:22+00:00

2019-05-17 02:26:01+00:00

0:25:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.30314311735235044
survival_time_median	2.6499999999999986
deviation-center-line_median	0.1192462800776758
in-drivable-lane_median	0.9499999999999966

other stats

agent_compute-ego_max	0.07432775884061246
agent_compute-ego_mean	0.06975004347226439
agent_compute-ego_median	0.06882601724544042
agent_compute-ego_min	0.06565781270176911
deviation-center-line_max	0.2294363663374862
deviation-center-line_mean	0.12653708755488874
deviation-center-line_min	0.06426934298501713
deviation-heading_max	0.6986268167330368
deviation-heading_mean	0.44799520296706863
deviation-heading_median	0.41847631252347706
deviation-heading_min	0.2596285487829774
driven_any_max	1.599733354117788
driven_any_mean	0.8095342605803044
driven_any_median	0.7336463183586153
driven_any_min	0.26903550091980144
driven_lanedir_consec_max	1.021002447119848
driven_lanedir_consec_mean	0.448904809024379
driven_lanedir_consec_min	0.2407721645627201
driven_lanedir_max	1.021002447119848
driven_lanedir_mean	0.448904809024379
driven_lanedir_median	0.30314311735235044
driven_lanedir_min	0.2407721645627201
in-drivable-lane_max	4.799999999999986
in-drivable-lane_mean	1.1466666666666634
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.1540208265814983, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.05997373688388878, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.06882601724544042, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09592004225287638, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.03983219240752744, "sim_compute_performance-ego": 0.06814802532464685, "sim_compute_robot_state-ego": 0.07158260949900452, "sim_compute_robot_state-npc0": 0.07195853179609271, "sim_compute_robot_state-npc1": 0.06645745962438449, "sim_compute_robot_state-npc2": 0.07073905770207795, "sim_compute_robot_state-npc3": 0.06792111463949714}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.18080736696720123, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.0596233531832695, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.06865407526493073, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.09778907895088196, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.04177996516227722, "sim_compute_performance-ego": 0.06946403533220291, "sim_compute_robot_state-ego": 0.07639049738645554, "sim_compute_robot_state-npc0": 0.07028883695602417, "sim_compute_robot_state-npc1": 0.07002780586481094, "sim_compute_robot_state-npc2": 0.07062426209449768, "sim_compute_robot_state-npc3": 0.0713689923286438}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.17743856173295242, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.06101412498033964, "in-drivable-lane": 0, "agent_compute-ego": 0.06756363923733051, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.09201855384386502, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.039723061598264255, "sim_compute_performance-ego": 0.06740517341173612, "sim_compute_robot_state-ego": 0.06961554747361404, "sim_compute_robot_state-npc0": 0.07009500723618728, "sim_compute_robot_state-npc1": 0.0695504225217379, "sim_compute_robot_state-npc2": 0.06943411551989041, "sim_compute_robot_state-npc3": 0.06916749935883743}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.18078195664190477, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.0632013479868571, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0690075735892019, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.09663544675355316, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.04020143324329007, "sim_compute_performance-ego": 0.06882720608865062, "sim_compute_robot_state-ego": 0.0734566257845971, "sim_compute_robot_state-npc0": 0.07140036808547154, "sim_compute_robot_state-npc1": 0.0715378253690658, "sim_compute_robot_state-npc2": 0.07095216679316695, "sim_compute_robot_state-npc3": 0.07208017892734979}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.16157871200924828, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.06246841521490188, "in-drivable-lane": 0, "agent_compute-ego": 0.07285218011765253, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.09561602274576823, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.0383491629645938, "sim_compute_performance-ego": 0.06572297641209193, "sim_compute_robot_state-ego": 0.07067956243242536, "sim_compute_robot_state-npc0": 0.0666666030883789, "sim_compute_robot_state-npc1": 0.07030345144725982, "sim_compute_robot_state-npc2": 0.0674788270677839, "sim_compute_robot_state-npc3": 0.06575374376206171}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.599733354117788, "sim_physics": 0.15671748169197525, "survival_time": 6.0499999999999865, "driven_lanedir": 0.26415979567759074, "sim_render-ego": 0.056938742803148, "in-drivable-lane": 4.799999999999986, "agent_compute-ego": 0.06565781270176911, "deviation-heading": 0.39392468133084674, "set_robot_commands": 0.08969351279834085, "deviation-center-line": 0.1277842828221673, "driven_lanedir_consec": 0.26415979567759074, "sim_compute_sim_state": 0.03472676355976704, "sim_compute_performance-ego": 0.06353610803273098, "sim_compute_robot_state-ego": 0.06892952643150141, "sim_compute_robot_state-npc0": 0.06311877305842628, "sim_compute_robot_state-npc1": 0.06125996723647945, "sim_compute_robot_state-npc2": 0.061518511496299555, "sim_compute_robot_state-npc3": 0.06377241237104432}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0951392646085512, "sim_physics": 0.15509009077435448, "survival_time": 4.199999999999993, "driven_lanedir": 0.5659790827231905, "sim_render-ego": 0.060111681620279946, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.0679771587962196, "deviation-heading": 0.5971215168818823, "set_robot_commands": 0.09259143329802014, "deviation-center-line": 0.11288019725884578, "driven_lanedir_consec": 0.5659790827231905, "sim_compute_sim_state": 0.03744381098520188, "sim_compute_performance-ego": 0.06857428664252871, "sim_compute_robot_state-ego": 0.07153810773577009, "sim_compute_robot_state-npc0": 0.06985156592868623, "sim_compute_robot_state-npc1": 0.06849339746293567, "sim_compute_robot_state-npc2": 0.06984922999427431, "sim_compute_robot_state-npc3": 0.0720046843801226}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0452441176451972, "sim_physics": 0.19648959185626055, "survival_time": 3.699999999999995, "driven_lanedir": 1.021002447119848, "sim_render-ego": 0.06424295580064929, "in-drivable-lane": 0, "agent_compute-ego": 0.07432775884061246, "deviation-heading": 0.6206310196168163, "set_robot_commands": 0.10320934089454444, "deviation-center-line": 0.14363020423695483, "driven_lanedir_consec": 1.021002447119848, "sim_compute_sim_state": 0.03856238158973488, "sim_compute_performance-ego": 0.0739033351073394, "sim_compute_robot_state-ego": 0.08515744595914274, "sim_compute_robot_state-npc0": 0.07339002312840642, "sim_compute_robot_state-npc1": 0.07267796026693808, "sim_compute_robot_state-npc2": 0.07246800048931225, "sim_compute_robot_state-npc3": 0.07285673231691928}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0535850482576197, "sim_physics": 0.17439686258633932, "survival_time": 3.599999999999995, "driven_lanedir": 0.30314311735235044, "sim_render-ego": 0.06420793135960896, "in-drivable-lane": 2.2999999999999945, "agent_compute-ego": 0.07364252540800306, "deviation-heading": 0.40636604380954594, "set_robot_commands": 0.10411360528733996, "deviation-center-line": 0.10907487511555897, "driven_lanedir_consec": 0.30314311735235044, "sim_compute_sim_state": 0.03990657130877177, "sim_compute_performance-ego": 0.07189069191614787, "sim_compute_robot_state-ego": 0.08072119620111254, "sim_compute_robot_state-npc0": 0.07177453570895725, "sim_compute_robot_state-npc1": 0.07211274902025859, "sim_compute_robot_state-npc2": 0.06965064340167576, "sim_compute_robot_state-npc3": 0.07236040963066949}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.4799799001882503, "sim_physics": 0.20863887751213855, "survival_time": 5.349999999999989, "driven_lanedir": 0.5481518397312493, "sim_render-ego": 0.0636183168286475, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.07071336407527745, "deviation-heading": 0.5514444521435958, "set_robot_commands": 0.09759873764537204, "deviation-center-line": 0.10072735470855042, "driven_lanedir_consec": 0.5481518397312493, "sim_compute_sim_state": 0.036861475383009865, "sim_compute_performance-ego": 0.07197020878301602, "sim_compute_robot_state-ego": 0.07690778179703472, "sim_compute_robot_state-npc0": 0.06816396980642159, "sim_compute_robot_state-npc1": 0.06920572753264526, "sim_compute_robot_state-npc2": 0.07026394282545999, "sim_compute_robot_state-npc3": 0.06869303400271407}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.29610946631760215, "sim_physics": 0.21313930440832068, "survival_time": 1.3500000000000003, "driven_lanedir": 0.27060744077321397, "sim_render-ego": 0.058762938887984666, "in-drivable-lane": 0, "agent_compute-ego": 0.06730907051651566, "deviation-heading": 0.5373504765871612, "set_robot_commands": 0.09256628707603172, "deviation-center-line": 0.08269292286428997, "driven_lanedir_consec": 0.27060744077321397, "sim_compute_sim_state": 0.04048465799402307, "sim_compute_performance-ego": 0.0655067143616853, "sim_compute_robot_state-ego": 0.0721876444639983, "sim_compute_robot_state-npc0": 0.0649390662157977, "sim_compute_robot_state-npc1": 0.06510766347249348, "sim_compute_robot_state-npc2": 0.06521411295290347, "sim_compute_robot_state-npc3": 0.06896437538994683}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.27791471406425977, "sim_physics": 0.15246843338012694, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2638710416011838, "sim_render-ego": 0.06276453018188477, "in-drivable-lane": 0, "agent_compute-ego": 0.06786126136779785, "deviation-heading": 0.3105689945980953, "set_robot_commands": 0.0901283359527588, "deviation-center-line": 0.1192462800776758, "driven_lanedir_consec": 0.2638710416011838, "sim_compute_sim_state": 0.037719135284423826, "sim_compute_performance-ego": 0.0628310775756836, "sim_compute_robot_state-ego": 0.06911808967590333, "sim_compute_robot_state-npc0": 0.06791640281677246, "sim_compute_robot_state-npc1": 0.06374403953552246, "sim_compute_robot_state-npc2": 0.06541704177856446, "sim_compute_robot_state-npc3": 0.06672852516174316}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7174039891727135, "sim_physics": 0.1762189190342741, "survival_time": 2.6499999999999986, "driven_lanedir": 0.29766819613667395, "sim_render-ego": 0.06442303477593188, "in-drivable-lane": 1.249999999999998, "agent_compute-ego": 0.07290980950841364, "deviation-heading": 0.3122593881578996, "set_robot_commands": 0.10194483343160378, "deviation-center-line": 0.14209620948179827, "driven_lanedir_consec": 0.29766819613667395, "sim_compute_sim_state": 0.03994434284714033, "sim_compute_performance-ego": 0.07450340828805599, "sim_compute_robot_state-ego": 0.0804070031867837, "sim_compute_robot_state-npc0": 0.07229701078163003, "sim_compute_robot_state-npc1": 0.07149638769761571, "sim_compute_robot_state-npc2": 0.07093394927258762, "sim_compute_robot_state-npc3": 0.07184551796823177}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3170173854101942, "sim_physics": 0.1800591253465222, "survival_time": 1.5500000000000007, "driven_lanedir": 0.30712670008511367, "sim_render-ego": 0.06275711521025627, "in-drivable-lane": 0, "agent_compute-ego": 0.06881255488241872, "deviation-heading": 0.2996283459319333, "set_robot_commands": 0.09695117704329952, "deviation-center-line": 0.13363659833059607, "driven_lanedir_consec": 0.30712670008511367, "sim_compute_sim_state": 0.03855878306973365, "sim_compute_performance-ego": 0.06869995978570753, "sim_compute_robot_state-ego": 0.07127148105252173, "sim_compute_robot_state-npc0": 0.0685418882677632, "sim_compute_robot_state-npc1": 0.07089544880774713, "sim_compute_robot_state-npc2": 0.07301961991094774, "sim_compute_robot_state-npc3": 0.06938422879865093}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6739360049522848, "sim_physics": 0.19452392353731043, "survival_time": 2.549999999999999, "driven_lanedir": 0.27812483555624423, "sim_render-ego": 0.06313891971812528, "in-drivable-lane": 1.2499999999999984, "agent_compute-ego": 0.07013585053238214, "deviation-heading": 0.550481042305602, "set_robot_commands": 0.09775773684183756, "deviation-center-line": 0.07768321004180687, "driven_lanedir_consec": 0.27812483555624423, "sim_compute_sim_state": 0.040839466394162645, "sim_compute_performance-ego": 0.06529936135983934, "sim_compute_robot_state-ego": 0.07334041595458984, "sim_compute_robot_state-npc0": 0.06933931275910023, "sim_compute_robot_state-npc1": 0.071853894813388, "sim_compute_robot_state-npc2": 0.06977493155236338, "sim_compute_robot_state-npc3": 0.06770693554597743}}
set_robot_commands_max	0.10411360528733996
set_robot_commands_mean	0.0963022763210729
set_robot_commands_median	0.09663544675355316
set_robot_commands_min	0.08969351279834085
sim_compute_performance-ego_max	0.07450340828805599
sim_compute_performance-ego_mean	0.06841883789480421
sim_compute_performance-ego_median	0.06857428664252871
sim_compute_performance-ego_min	0.0628310775756836
sim_compute_robot_state-ego_max	0.08515744595914274
sim_compute_robot_state-ego_mean	0.07408690233563033
sim_compute_robot_state-ego_median	0.0721876444639983
sim_compute_robot_state-ego_min	0.06892952643150141
sim_compute_robot_state-npc0_max	0.07339002312840642
sim_compute_robot_state-npc0_mean	0.06931612637560773
sim_compute_robot_state-npc0_median	0.06985156592868623
sim_compute_robot_state-npc0_min	0.06311877305842628
sim_compute_robot_state-npc1_max	0.07267796026693808
sim_compute_robot_state-npc1_mean	0.06898161337821886
sim_compute_robot_state-npc1_median	0.07002780586481094
sim_compute_robot_state-npc1_min	0.06125996723647945
sim_compute_robot_state-npc2_max	0.07301961991094774
sim_compute_robot_state-npc2_mean	0.06915589419012035
sim_compute_robot_state-npc2_median	0.06984922999427431
sim_compute_robot_state-npc2_min	0.061518511496299555
sim_compute_robot_state-npc3_max	0.07285673231691928
sim_compute_robot_state-npc3_mean	0.069373892305494
sim_compute_robot_state-npc3_median	0.06916749935883743
sim_compute_robot_state-npc3_min	0.06377241237104432
sim_compute_sim_state_max	0.04177996516227722
sim_compute_sim_state_mean	0.038995546919461464
sim_compute_sim_state_median	0.039723061598264255
sim_compute_sim_state_min	0.03472676355976704
sim_physics_max	0.21313930440832068
sim_physics_mean	0.17749133560402847
sim_physics_median	0.17743856173295242
sim_physics_min	0.15246843338012694
sim_render-ego_max	0.06442303477593188
sim_render-ego_mean	0.061816476362384895
sim_render-ego_median	0.06275711521025627
sim_render-ego_min	0.056938742803148
simulation-passed	1
survival_time_max	6.0499999999999865
survival_time_mean	3.046666666666663
survival_time_min	1.0500000000000005

No reset possible

22786

2762

Bhairav Mehta

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LFVI-sim-testing

step1-simulation

host-error

yes

ip-172-31-40-253-3847

2019-05-17 02:00:01+00:00

2019-05-17 02:00:07+00:00

0:00:06

Error while running [...]

Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job22786-636773', 'pull']:

   >  Command '['docker-compose', '-p', 'job22786-636773', 'pull']' returned non-zero exit status 255.

stdout | 

stderr | [3499] Failed to execute script docker-compose
stderr | Traceback (most recent call last):
stderr |   File "bin/docker-compose", line 6, in <module>
stderr |   File "compose/cli/main.py", line 71, in main
stderr |   File "compose/cli/main.py", line 124, in perform_command
stderr |   File "compose/cli/command.py", line 41, in project_from_options
stderr |   File "compose/cli/command.py", line 109, in get_project
stderr |   File "compose/config/config.py", line 283, in find
stderr |   File "compose/config/config.py", line 310, in get_default_config_files
stderr |   File "compose/config/config.py", line 346, in find_candidates_in_parent_dirs
stderr |   File "posixpath.py", line 376, in abspath
stderr | FileNotFoundError: [Errno 2] No such file or directory
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22753

2826

Liam Paull 🇨🇦

challenge-aido_LF-template-random

aido2-LFVI-sim-testing

step1-simulation

success

yes

ip-172-31-40-253-3847

2019-05-17 01:26:56+00:00

2019-05-17 01:59:31+00:00

0:32:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6537162971975778
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14884708769804722
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.17503853142261505
agent_compute-ego_mean	0.1616996486587731
agent_compute-ego_median	0.16267921707846902
agent_compute-ego_min	0.14329748153686522
deviation-center-line_max	0.5141120095458062
deviation-center-line_mean	0.1769000227005324
deviation-center-line_min	0.06216029860587694
deviation-heading_max	1.9929437250081896
deviation-heading_mean	0.692977823395608
deviation-heading_median	0.4928440244444201
deviation-heading_min	0.24234723632033853
driven_any_max	3.5343244022418343
driven_any_mean	1.3470385992234175
driven_any_median	1.001633421251194
driven_any_min	0.3412551960104244
driven_lanedir_consec_max	2.494308053441959
driven_lanedir_consec_mean	0.881391085527715
driven_lanedir_consec_min	0.3199180625488627
driven_lanedir_max	2.494308053441959
driven_lanedir_mean	0.8962528018383226
driven_lanedir_median	0.7206363324756615
driven_lanedir_min	0.3199180625488627
in-drivable-lane_max	3.549999999999991
in-drivable-lane_mean	0.839999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.24190238155896152, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06837659847887256, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.16933427883099905, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.1078747163845014, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.04059939746615253, "sim_compute_performance-ego": 0.07509958593151238, "sim_compute_robot_state-ego": 0.08658451973637447, "sim_compute_robot_state-npc0": 0.07452456558806987, "sim_compute_robot_state-npc1": 0.07428433019903642, "sim_compute_robot_state-npc2": 0.07502128504499604, "sim_compute_robot_state-npc3": 0.07359993306896355}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2213175126484462, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06724798679351807, "in-drivable-lane": 0, "agent_compute-ego": 0.17040954317365373, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10447372709001812, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04100292069571359, "sim_compute_performance-ego": 0.07221246617180961, "sim_compute_robot_state-ego": 0.08044728210994176, "sim_compute_robot_state-npc0": 0.07470400844301496, "sim_compute_robot_state-npc1": 0.07312654597418648, "sim_compute_robot_state-npc2": 0.0715107832636152, "sim_compute_robot_state-npc3": 0.07234995705740792}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.2089520658104165, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06708352311143598, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16503314138616174, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10455103522365532, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04099220905489134, "sim_compute_performance-ego": 0.0739899028852148, "sim_compute_robot_state-ego": 0.08472587992844072, "sim_compute_robot_state-npc0": 0.07468117788000014, "sim_compute_robot_state-npc1": 0.07381924842167827, "sim_compute_robot_state-npc2": 0.07324514574217565, "sim_compute_robot_state-npc3": 0.07409904998483009}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.24297440548737845, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.0673045168320338, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.17503853142261505, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.10869709153970082, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.04334000746409098, "sim_compute_performance-ego": 0.07461315393447876, "sim_compute_robot_state-ego": 0.08880828817685445, "sim_compute_robot_state-npc0": 0.07520978649457295, "sim_compute_robot_state-npc1": 0.07805013656616211, "sim_compute_robot_state-npc2": 0.07355680068333943, "sim_compute_robot_state-npc3": 0.07453201214472453}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.23331678481329057, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06787588482811338, "in-drivable-lane": 0, "agent_compute-ego": 0.174367280233474, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.11362730889093307, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.043800456183297296, "sim_compute_performance-ego": 0.07624313944862002, "sim_compute_robot_state-ego": 0.08888275282723564, "sim_compute_robot_state-npc0": 0.07780563263666063, "sim_compute_robot_state-npc1": 0.07789668582734607, "sim_compute_robot_state-npc2": 0.08009172621227446, "sim_compute_robot_state-npc3": 0.07440700985136486}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.2296221427574843, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.06651998993879307, "in-drivable-lane": 2, "agent_compute-ego": 0.1661674176861426, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.10541931455006856, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.041540832576637494, "sim_compute_performance-ego": 0.07415972641128266, "sim_compute_robot_state-ego": 0.08228771700830517, "sim_compute_robot_state-npc0": 0.07411146449471662, "sim_compute_robot_state-npc1": 0.07392770658710046, "sim_compute_robot_state-npc2": 0.07286546330252093, "sim_compute_robot_state-npc3": 0.0739904663519945}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.211460134358082, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.0629593307532153, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15849983807906365, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.09656974644336884, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.042041077197176736, "sim_compute_performance-ego": 0.07118459812645773, "sim_compute_robot_state-ego": 0.07727286422136918, "sim_compute_robot_state-npc0": 0.06916949124012178, "sim_compute_robot_state-npc1": 0.06975884576445644, "sim_compute_robot_state-npc2": 0.06833722521957841, "sim_compute_robot_state-npc3": 0.07080699170677407}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.21209826946258545, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.06312098026275635, "in-drivable-lane": 0, "agent_compute-ego": 0.14329748153686522, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.09266141891479492, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03849190711975098, "sim_compute_performance-ego": 0.06596234798431397, "sim_compute_robot_state-ego": 0.06990399837493896, "sim_compute_robot_state-npc0": 0.0662151288986206, "sim_compute_robot_state-npc1": 0.0689169979095459, "sim_compute_robot_state-npc2": 0.0704302453994751, "sim_compute_robot_state-npc3": 0.06821877479553223}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.1861679508135869, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06302736355708195, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15932984077013457, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.0985938677420983, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.03962328342291025, "sim_compute_performance-ego": 0.06916679785801814, "sim_compute_robot_state-ego": 0.07313522467246422, "sim_compute_robot_state-npc0": 0.07074390924893893, "sim_compute_robot_state-npc1": 0.07074678402680618, "sim_compute_robot_state-npc2": 0.07216124351208027, "sim_compute_robot_state-npc3": 0.06717104178208572}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.22933509716620812, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06367901655343863, "in-drivable-lane": 0, "agent_compute-ego": 0.15621323768909162, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.09923061957726112, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.04063542072589581, "sim_compute_performance-ego": 0.06412511605482835, "sim_compute_robot_state-ego": 0.0736994926746075, "sim_compute_robot_state-npc0": 0.06700860537015475, "sim_compute_robot_state-npc1": 0.07145221416766827, "sim_compute_robot_state-npc2": 0.06968254309434158, "sim_compute_robot_state-npc3": 0.07190390733572152}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.20011992888017135, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06140307946638627, "in-drivable-lane": 0, "agent_compute-ego": 0.16267921707846902, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.09430048682472925, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.03961896896362305, "sim_compute_performance-ego": 0.06663214076649059, "sim_compute_robot_state-ego": 0.0740671157836914, "sim_compute_robot_state-npc0": 0.06950640678405762, "sim_compute_robot_state-npc1": 0.06467446413907138, "sim_compute_robot_state-npc2": 0.0688620155507868, "sim_compute_robot_state-npc3": 0.07256188175894997}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.2167334890365601, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06541077613830566, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16791627883911134, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.10590073585510254, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.04037092685699463, "sim_compute_performance-ego": 0.07113199710845947, "sim_compute_robot_state-ego": 0.08040196895599365, "sim_compute_robot_state-npc0": 0.07548116207122803, "sim_compute_robot_state-npc1": 0.07278655052185058, "sim_compute_robot_state-npc2": 0.07131700992584228, "sim_compute_robot_state-npc3": 0.07201198577880859}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.2003512940508254, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.0630185325094994, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.15175351183465186, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.098077581283894, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.039169882206206624, "sim_compute_performance-ego": 0.0710801418791426, "sim_compute_robot_state-ego": 0.07393046642871613, "sim_compute_robot_state-npc0": 0.06866304164237165, "sim_compute_robot_state-npc1": 0.07016004400050387, "sim_compute_robot_state-npc2": 0.06939416996976162, "sim_compute_robot_state-npc3": 0.07023952108748416}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.1976577639579773, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.0623513597708482, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14942414943988508, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.0986908353292025, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.03967227844091562, "sim_compute_performance-ego": 0.06678574818831223, "sim_compute_robot_state-ego": 0.0733109712600708, "sim_compute_robot_state-npc0": 0.06788832866228543, "sim_compute_robot_state-npc1": 0.07110820366786076, "sim_compute_robot_state-npc2": 0.0679028584406926, "sim_compute_robot_state-npc3": 0.06762800308374259}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.18841309320359004, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06030330657958984, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.1560309818812779, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.09567794572739374, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.03802407128470285, "sim_compute_performance-ego": 0.07011439232599168, "sim_compute_robot_state-ego": 0.07565754027593703, "sim_compute_robot_state-npc0": 0.0696953432900565, "sim_compute_robot_state-npc1": 0.06885545594351632, "sim_compute_robot_state-npc2": 0.06692738305954705, "sim_compute_robot_state-npc3": 0.06964860870724633}}
set_robot_commands_max	0.11362730889093307
set_robot_commands_mean	0.1016230954251148
set_robot_commands_median	0.09923061957726112
set_robot_commands_min	0.09266141891479492
sim_compute_performance-ego_max	0.07624313944862002
sim_compute_performance-ego_mean	0.07083341700499554
sim_compute_performance-ego_median	0.07113199710845947
sim_compute_performance-ego_min	0.06412511605482835
sim_compute_robot_state-ego_max	0.08888275282723564
sim_compute_robot_state-ego_mean	0.07887440549566273
sim_compute_robot_state-ego_median	0.07727286422136918
sim_compute_robot_state-ego_min	0.06990399837493896
sim_compute_robot_state-npc0_max	0.07780563263666063
sim_compute_robot_state-npc0_mean	0.07169387018299136
sim_compute_robot_state-npc0_median	0.07074390924893893
sim_compute_robot_state-npc0_min	0.0662151288986206
sim_compute_robot_state-npc1_max	0.07805013656616211
sim_compute_robot_state-npc1_mean	0.0719709475811193
sim_compute_robot_state-npc1_median	0.07145221416766827
sim_compute_robot_state-npc1_min	0.06467446413907138
sim_compute_robot_state-npc2_max	0.08009172621227446
sim_compute_robot_state-npc2_mean	0.07142039322806851
sim_compute_robot_state-npc2_median	0.07131700992584228
sim_compute_robot_state-npc2_min	0.06692738305954705
sim_compute_robot_state-npc3_max	0.07453201214472453
sim_compute_robot_state-npc3_mean	0.07154460963304204
sim_compute_robot_state-npc3_median	0.07201198577880859
sim_compute_robot_state-npc3_min	0.06717104178208572
sim_compute_sim_state_max	0.043800456183297296
sim_compute_sim_state_mean	0.04059490931059732
sim_compute_sim_state_median	0.04059939746615253
sim_compute_sim_state_min	0.03802407128470285
sim_physics_max	0.24297440548737845
sim_physics_mean	0.2146948209337043
sim_physics_median	0.21209826946258545
sim_physics_min	0.1861679508135869
sim_render-ego_max	0.06837659847887256
sim_render-ego_mean	0.06464548303825922
sim_render-ego_median	0.06367901655343863
sim_render-ego_min	0.06030330657958984
simulation-passed	1
survival_time_max	8.349999999999984
survival_time_mean	3.3333333333333286
survival_time_min	1.0500000000000005

No reset possible

22750

2831

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-40-253-3847

2019-05-17 01:26:02+00:00

2019-05-17 01:26:37+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22746

2836

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-40-253-3847

2019-05-17 01:25:16+00:00

2019-05-17 01:25:53+00:00

0:00:37

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22721

2910

FANG MEIYI 🇸🇬

test

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-40-253-3847

2019-05-17 01:01:02+00:00

2019-05-17 01:24:35+00:00

0:23:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.2065315568472017
survival_time_median	14.950000000000076
deviation-center-line_median	0.6608662324231004
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1776868895198522
agent_compute-ego_mean	0.16642249273271598
agent_compute-ego_median	0.16349775314331055
agent_compute-ego_min	0.15786476055781046
deviation-center-line_max	0.8947094063964482
deviation-center-line_mean	0.5601569562906171
deviation-center-line_min	0.24879541822873455
deviation-heading_max	3.316687353563192
deviation-heading_mean	2.197042721001047
deviation-heading_median	2.533543265062995
deviation-heading_min	0.9274711434407208
driven_any_max	3.553873881851535
driven_any_mean	2.912025450197535
driven_any_median	3.3353525505639396
driven_any_min	0.9590752174546616
driven_lanedir_consec_max	3.5420373155740235
driven_lanedir_consec_mean	2.7261508561196304
driven_lanedir_consec_min	0.9330035469255824
driven_lanedir_max	3.5420373155740235
driven_lanedir_mean	2.7261508561196304
driven_lanedir_median	3.2065315568472017
driven_lanedir_min	0.9330035469255824
in-drivable-lane_max	2.4000000000000012
in-drivable-lane_mean	0.48000000000000026
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.328490288240608, "sim_physics": 0.10597785631815591, "survival_time": 14.950000000000076, "driven_lanedir": 2.6351257552160514, "sim_render-ego": 0.061685988903045656, "in-drivable-lane": 2.4000000000000012, "agent_compute-ego": 0.15912100632985432, "deviation-heading": 3.316687353563192, "set_robot_commands": 0.09200509468714396, "deviation-center-line": 0.6608662324231004, "driven_lanedir_consec": 2.6351257552160514, "sim_compute_sim_state": 0.03743572155634562, "sim_compute_performance-ego": 0.06813088099161783, "sim_compute_robot_state-ego": 0.07354091882705688}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.553873881851535, "sim_physics": 0.09959388573964437, "survival_time": 14.950000000000076, "driven_lanedir": 3.5420373155740235, "sim_render-ego": 0.06009815295537313, "in-drivable-lane": 0, "agent_compute-ego": 0.15786476055781046, "deviation-heading": 1.0286281516695048, "set_robot_commands": 0.0938202182451884, "deviation-center-line": 0.3039988426937896, "driven_lanedir_consec": 3.5420373155740235, "sim_compute_sim_state": 0.03835430463155111, "sim_compute_performance-ego": 0.06861550410588582, "sim_compute_robot_state-ego": 0.0735232694943746}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.38333531287693, "sim_physics": 0.1142594067255656, "survival_time": 14.950000000000076, "driven_lanedir": 3.3140561060352924, "sim_render-ego": 0.06249160528182984, "in-drivable-lane": 0, "agent_compute-ego": 0.16349775314331055, "deviation-heading": 2.533543265062995, "set_robot_commands": 0.09754361391067504, "deviation-center-line": 0.6924148817110127, "driven_lanedir_consec": 3.3140561060352924, "sim_compute_sim_state": 0.041495993932088214, "sim_compute_performance-ego": 0.07120678345362345, "sim_compute_robot_state-ego": 0.07796769301096598}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9590752174546616, "sim_physics": 0.11875482355610709, "survival_time": 4.449999999999992, "driven_lanedir": 0.9330035469255824, "sim_render-ego": 0.06857802894678008, "in-drivable-lane": 0, "agent_compute-ego": 0.1776868895198522, "deviation-heading": 0.9274711434407208, "set_robot_commands": 0.1040013050765134, "deviation-center-line": 0.24879541822873455, "driven_lanedir_consec": 0.9330035469255824, "sim_compute_sim_state": 0.04247332690806871, "sim_compute_performance-ego": 0.07492650492807452, "sim_compute_robot_state-ego": 0.08257946807346987}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.3353525505639396, "sim_physics": 0.11430821180343628, "survival_time": 14.950000000000076, "driven_lanedir": 3.2065315568472017, "sim_render-ego": 0.0674154019355774, "in-drivable-lane": 0, "agent_compute-ego": 0.1739420541127523, "deviation-heading": 3.1788836912688234, "set_robot_commands": 0.10545117378234864, "deviation-center-line": 0.8947094063964482, "driven_lanedir_consec": 3.2065315568472017, "sim_compute_sim_state": 0.04174989620844523, "sim_compute_performance-ego": 0.07373270034790039, "sim_compute_robot_state-ego": 0.08126854260762532}}
set_robot_commands_max	0.10545117378234864
set_robot_commands_mean	0.09856428114037388
set_robot_commands_median	0.09754361391067504
set_robot_commands_min	0.09200509468714396
sim_compute_performance-ego_max	0.07492650492807452
sim_compute_performance-ego_mean	0.07132247476542039
sim_compute_performance-ego_median	0.07120678345362345
sim_compute_performance-ego_min	0.06813088099161783
sim_compute_robot_state-ego_max	0.08257946807346987
sim_compute_robot_state-ego_mean	0.07777597840269854
sim_compute_robot_state-ego_median	0.07796769301096598
sim_compute_robot_state-ego_min	0.0735232694943746
sim_compute_sim_state_max	0.04247332690806871
sim_compute_sim_state_mean	0.04030184864729978
sim_compute_sim_state_median	0.041495993932088214
sim_compute_sim_state_min	0.03743572155634562
sim_physics_max	0.11875482355610709
sim_physics_mean	0.11057883682858186
sim_physics_median	0.1142594067255656
sim_physics_min	0.09959388573964437
sim_render-ego_max	0.06857802894678008
sim_render-ego_mean	0.06405383560452123
sim_render-ego_median	0.06249160528182984
sim_render-ego_min	0.06009815295537313
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.85000000000006
survival_time_min	4.449999999999992

No reset possible

22696

2952

Bhairav Mehta

Baseline solution using reinforcement learning

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-40-253-3847

2019-05-17 00:38:17+00:00

2019-05-17 01:00:20+00:00

0:22:03

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22634

3063

Andrea Censi 🇨🇭

rotation

aido2-LFVI-sim-validation

step1-simulation

success

yes

ip-172-31-40-253-3847

2019-05-17 00:00:44+00:00

2019-05-17 00:37:49+00:00

0:37:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.000305044676884636
survival_time_median	14.950000000000076
deviation-center-line_median	0.4891046565937845
in-drivable-lane_median	7.600000000000043

other stats

agent_compute-ego_max	0.15654685099919638
agent_compute-ego_mean	0.15515980195999146
agent_compute-ego_median	0.15556374073028564
agent_compute-ego_min	0.1525131313006083
deviation-center-line_max	0.6113246250082045
deviation-center-line_mean	0.4225460275157091
deviation-center-line_min	0.020737627062439232
deviation-heading_max	5.830135897709594
deviation-heading_mean	5.684570550707688
deviation-heading_median	5.657649106857694
deviation-heading_min	5.536662996854866
driven_any_max	0.02647867283405392
driven_any_mean	0.024864239592253624
driven_any_median	0.02593019554120814
driven_any_min	0.02216545266138003
driven_lanedir_consec_max	0.002162616049345756
driven_lanedir_consec_mean	-0.0004886462276792348
driven_lanedir_consec_min	-0.0036402347654349576
driven_lanedir_max	0.002162616049345756
driven_lanedir_mean	-0.0004886462276792348
driven_lanedir_median	0.000305044676884636
driven_lanedir_min	-0.0036402347654349576
in-drivable-lane_max	7.650000000000043
in-drivable-lane_mean	7.600000000000042
in-drivable-lane_min	7.550000000000044
per-episodes	details {"udem1-0-0": {"driven_any": 0.02647867283405392, "sim_physics": 0.19089327017466223, "survival_time": 14.950000000000076, "driven_lanedir": 0.002162616049345756, "sim_render-ego": 0.06302229086558024, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.15556374073028564, "deviation-heading": 5.657649106857694, "set_robot_commands": 0.09884076515833536, "deviation-center-line": 0.561012181201902, "driven_lanedir_consec": 0.002162616049345756, "sim_compute_sim_state": 0.039439262549082435, "sim_compute_performance-ego": 0.06963777860005696, "sim_compute_robot_state-ego": 0.074398725827535, "sim_compute_robot_state-npc0": 0.06983048597971599, "sim_compute_robot_state-npc1": 0.06944490591684978, "sim_compute_robot_state-npc2": 0.06962353150049845, "sim_compute_robot_state-npc3": 0.06919933398564657}, "udem1-1-0": {"driven_any": 0.02593019554120814, "sim_physics": 0.20286035776138303, "survival_time": 14.950000000000076, "driven_lanedir": -0.0036402347654349576, "sim_render-ego": 0.06266499201456706, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.15478568871815998, "deviation-heading": 5.795316370396738, "set_robot_commands": 0.09711106459299725, "deviation-center-line": 0.6113246250082045, "driven_lanedir_consec": -0.0036402347654349576, "sim_compute_sim_state": 0.038844245274861654, "sim_compute_performance-ego": 0.06830163399378458, "sim_compute_robot_state-ego": 0.07329256534576416, "sim_compute_robot_state-npc0": 0.06876020113627115, "sim_compute_robot_state-npc1": 0.06832564353942872, "sim_compute_robot_state-npc2": 0.06931315739949544, "sim_compute_robot_state-npc3": 0.06895219405492146}, "udem1-2-0": {"driven_any": 0.02380440467243486, "sim_physics": 0.18972459316253665, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017436411031614971, "sim_render-ego": 0.06299083471298218, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.1525131313006083, "deviation-heading": 5.6030883817195525, "set_robot_commands": 0.0960243574778239, "deviation-center-line": 0.4891046565937845, "driven_lanedir_consec": 0.0017436411031614971, "sim_compute_sim_state": 0.039229941368103025, "sim_compute_performance-ego": 0.06829575777053833, "sim_compute_robot_state-ego": 0.07406152486801147, "sim_compute_robot_state-npc0": 0.06943959792455037, "sim_compute_robot_state-npc1": 0.06908557812372844, "sim_compute_robot_state-npc2": 0.06909600734710693, "sim_compute_robot_state-npc3": 0.07063842535018922}, "udem1-3-0": {"driven_any": 0.02216545266138003, "sim_physics": 0.19260472615559895, "survival_time": 14.950000000000076, "driven_lanedir": -0.003014298202353105, "sim_render-ego": 0.0632344675064087, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.15654685099919638, "deviation-heading": 5.536662996854866, "set_robot_commands": 0.1002322467168172, "deviation-center-line": 0.4305510477122152, "driven_lanedir_consec": -0.003014298202353105, "sim_compute_sim_state": 0.03851029396057129, "sim_compute_performance-ego": 0.06892403920491537, "sim_compute_robot_state-ego": 0.07397625048955282, "sim_compute_robot_state-npc0": 0.06884946743647258, "sim_compute_robot_state-npc1": 0.06806499083836873, "sim_compute_robot_state-npc2": 0.0688560422261556, "sim_compute_robot_state-npc3": 0.06886681715647379}, "udem1-4-0": {"driven_any": 0.02594247225219117, "sim_physics": 0.1980738425254822, "survival_time": 14.950000000000076, "driven_lanedir": 0.000305044676884636, "sim_render-ego": 0.0619713028271993, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.15638959805170696, "deviation-heading": 5.830135897709594, "set_robot_commands": 0.0978343677520752, "deviation-center-line": 0.020737627062439232, "driven_lanedir_consec": 0.000305044676884636, "sim_compute_sim_state": 0.03804886817932129, "sim_compute_performance-ego": 0.06796612977981567, "sim_compute_robot_state-ego": 0.0746860162417094, "sim_compute_robot_state-npc0": 0.0698667558034261, "sim_compute_robot_state-npc1": 0.06989970842997233, "sim_compute_robot_state-npc2": 0.06904610951741537, "sim_compute_robot_state-npc3": 0.06942482550938923}}
set_robot_commands_max	0.1002322467168172
set_robot_commands_mean	0.09800856033960978
set_robot_commands_median	0.0978343677520752
set_robot_commands_min	0.0960243574778239
sim_compute_performance-ego_max	0.06963777860005696
sim_compute_performance-ego_mean	0.06862506786982218
sim_compute_performance-ego_median	0.06830163399378458
sim_compute_performance-ego_min	0.06796612977981567
sim_compute_robot_state-ego_max	0.0746860162417094
sim_compute_robot_state-ego_mean	0.07408301655451457
sim_compute_robot_state-ego_median	0.07406152486801147
sim_compute_robot_state-ego_min	0.07329256534576416
sim_compute_robot_state-npc0_max	0.0698667558034261
sim_compute_robot_state-npc0_mean	0.06934930165608724
sim_compute_robot_state-npc0_median	0.06943959792455037
sim_compute_robot_state-npc0_min	0.06876020113627115
sim_compute_robot_state-npc1_max	0.06989970842997233
sim_compute_robot_state-npc1_mean	0.0689641653696696
sim_compute_robot_state-npc1_median	0.06908557812372844
sim_compute_robot_state-npc1_min	0.06806499083836873
sim_compute_robot_state-npc2_max	0.06962353150049845
sim_compute_robot_state-npc2_mean	0.06918696959813435
sim_compute_robot_state-npc2_median	0.06909600734710693
sim_compute_robot_state-npc2_min	0.0688560422261556
sim_compute_robot_state-npc3_max	0.07063842535018922
sim_compute_robot_state-npc3_mean	0.06941631921132405
sim_compute_robot_state-npc3_median	0.06919933398564657
sim_compute_robot_state-npc3_min	0.06886681715647379
sim_compute_sim_state_max	0.039439262549082435
sim_compute_sim_state_mean	0.038814522266387944
sim_compute_sim_state_median	0.038844245274861654
sim_compute_sim_state_min	0.03804886817932129
sim_physics_max	0.20286035776138303
sim_physics_mean	0.19483135795593265
sim_physics_median	0.19260472615559895
sim_physics_min	0.18972459316253665
sim_render-ego_max	0.0632344675064087
sim_render-ego_mean	0.0627767775853475
sim_render-ego_median	0.06299083471298218
sim_render-ego_min	0.0619713028271993
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

22620

3099

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-40-253-3847

2019-05-16 23:41:10+00:00

2019-05-17 00:00:17+00:00

0:19:07

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22599

3120

Rami Al-Naim 🇷🇺

v_d_1.75_no_cache

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-40-253-3847

2019-05-16 23:18:24+00:00

2019-05-16 23:40:54+00:00

0:22:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.775474084857974
survival_time_median	10.95000000000002
deviation-center-line_median	0.7810550239043568
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1619716180513983
agent_compute-ego_mean	0.1520702888423573
agent_compute-ego_median	0.1493155574798584
agent_compute-ego_min	0.14219609604162328
deviation-center-line_max	0.99646481510951
deviation-center-line_mean	0.8354176220802868
deviation-center-line_min	0.7516347002825855
deviation-heading_max	3.6960886554507417
deviation-heading_mean	2.0010681997366953
deviation-heading_median	1.6404488404498012
deviation-heading_min	0.7114199227459679
driven_any_max	1.342392432966991
driven_any_mean	0.9970974806463052
driven_any_median	0.9749991436488198
driven_any_min	0.5938700805453045
driven_lanedir_consec_max	1.2738787058522747
driven_lanedir_consec_mean	0.8571951711124779
driven_lanedir_consec_min	0.5901381226082245
driven_lanedir_max	1.2738787058522747
driven_lanedir_mean	0.8571951711124779
driven_lanedir_median	0.775474084857974
driven_lanedir_min	0.5901381226082245
in-drivable-lane_max	6.050000000000075
in-drivable-lane_mean	1.210000000000015
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3380029733210768, "sim_physics": 0.14030089298884074, "survival_time": 14.950000000000076, "driven_lanedir": 1.2738787058522747, "sim_render-ego": 0.06913095871607462, "in-drivable-lane": 0, "agent_compute-ego": 0.16096760193506876, "deviation-heading": 3.6960886554507417, "set_robot_commands": 0.11329406261444092, "deviation-center-line": 0.8879413316290364, "driven_lanedir_consec": 1.2738787058522747, "sim_compute_sim_state": 0.043373262882232665, "sim_compute_performance-ego": 0.077909521261851, "sim_compute_robot_state-ego": 0.09150251706441244}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.342392432966991, "sim_physics": 0.12280195713043213, "survival_time": 14.950000000000076, "driven_lanedir": 0.775474084857974, "sim_render-ego": 0.06911956151326497, "in-drivable-lane": 6.050000000000075, "agent_compute-ego": 0.1493155574798584, "deviation-heading": 1.2951030177081482, "set_robot_commands": 0.11386958519617715, "deviation-center-line": 0.99646481510951, "driven_lanedir_consec": 0.775474084857974, "sim_compute_sim_state": 0.04334999163945516, "sim_compute_performance-ego": 0.0779108730951945, "sim_compute_robot_state-ego": 0.08930564959843953}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5938700805453045, "sim_physics": 0.1268334564040689, "survival_time": 6.799999999999984, "driven_lanedir": 0.5901381226082245, "sim_render-ego": 0.07101171682862674, "in-drivable-lane": 0, "agent_compute-ego": 0.14219609604162328, "deviation-heading": 0.7114199227459679, "set_robot_commands": 0.11524311759892632, "deviation-center-line": 0.7810550239043568, "driven_lanedir_consec": 0.5901381226082245, "sim_compute_sim_state": 0.044344523373772114, "sim_compute_performance-ego": 0.07985785428215475, "sim_compute_robot_state-ego": 0.09269376887994654}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7362227727493343, "sim_physics": 0.1322120549436101, "survival_time": 8.349999999999984, "driven_lanedir": 0.717290350525492, "sim_render-ego": 0.06743864384953847, "in-drivable-lane": 0, "agent_compute-ego": 0.1459005707038377, "deviation-heading": 1.6404488404498012, "set_robot_commands": 0.11484419371553524, "deviation-center-line": 0.7516347002825855, "driven_lanedir_consec": 0.717290350525492, "sim_compute_sim_state": 0.04237748762804591, "sim_compute_performance-ego": 0.07733697662810365, "sim_compute_robot_state-ego": 0.08948739274533209}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9749991436488198, "sim_physics": 0.1286920717317764, "survival_time": 10.95000000000002, "driven_lanedir": 0.9291945917184248, "sim_render-ego": 0.06885966644983858, "in-drivable-lane": 0, "agent_compute-ego": 0.1619716180513983, "deviation-heading": 2.6622805623288164, "set_robot_commands": 0.11571303459062968, "deviation-center-line": 0.7599922394759461, "driven_lanedir_consec": 0.9291945917184248, "sim_compute_sim_state": 0.043516589081995016, "sim_compute_performance-ego": 0.07901111367630632, "sim_compute_robot_state-ego": 0.08838755572767562}}
set_robot_commands_max	0.11571303459062968
set_robot_commands_mean	0.11459279874314184
set_robot_commands_median	0.11484419371553524
set_robot_commands_min	0.11329406261444092
sim_compute_performance-ego_max	0.07985785428215475
sim_compute_performance-ego_mean	0.07840526778872203
sim_compute_performance-ego_median	0.0779108730951945
sim_compute_performance-ego_min	0.07733697662810365
sim_compute_robot_state-ego_max	0.09269376887994654
sim_compute_robot_state-ego_mean	0.09027537680316124
sim_compute_robot_state-ego_median	0.08948739274533209
sim_compute_robot_state-ego_min	0.08838755572767562
sim_compute_sim_state_max	0.044344523373772114
sim_compute_sim_state_mean	0.043392370921100175
sim_compute_sim_state_median	0.043373262882232665
sim_compute_sim_state_min	0.04237748762804591
sim_physics_max	0.14030089298884074
sim_physics_mean	0.13016808663974566
sim_physics_median	0.1286920717317764
sim_physics_min	0.12280195713043213
sim_render-ego_max	0.07101171682862674
sim_render-ego_mean	0.06911210947146867
sim_render-ego_median	0.06911956151326497
sim_render-ego_min	0.06743864384953847
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.200000000000028
survival_time_min	6.799999999999984

No reset possible

22589

3137

Amaury Camus 🇨🇭

challenge-aido_LF-template-random

aido2-LF-sim-testing

step1-simulation

success

yes

ip-172-31-40-253-3847

2019-05-16 23:01:24+00:00

2019-05-16 23:18:07+00:00

0:16:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.17335511105401177
agent_compute-ego_mean	0.15376529396208896
agent_compute-ego_median	0.1524055367809231
agent_compute-ego_min	0.1414956064785228
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1242155498928494, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06364086822227195, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1638414285801075, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10853796535068087, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04129158567499231, "sim_compute_performance-ego": 0.07105420695410834, "sim_compute_robot_state-ego": 0.08210468733752216}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12541752703049602, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06261356204163794, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14944739435233323, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09704104591818416, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03872296856898887, "sim_compute_performance-ego": 0.07813531744713877, "sim_compute_robot_state-ego": 0.0957640806833903}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.11495736066032858, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05809750276453355, "in-drivable-lane": 0, "agent_compute-ego": 0.1414956064785228, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.09549302213332232, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03979281818165498, "sim_compute_performance-ego": 0.06030897533192354, "sim_compute_robot_state-ego": 0.06912690050461713}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.11823034286499023, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06256624221801758, "in-drivable-lane": 0, "agent_compute-ego": 0.15992749214172364, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.1007875919342041, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03790072441101074, "sim_compute_performance-ego": 0.06395463943481446, "sim_compute_robot_state-ego": 0.07066272735595704}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11699467671068409, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06050107448915892, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1460556893409053, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.095206423650814, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.0393148102337801, "sim_compute_performance-ego": 0.06728532646275774, "sim_compute_robot_state-ego": 0.07481198371211185}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.10400509834289552, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06105700804262745, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.14333908411921287, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.09537667157698652, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.04067074036111637, "sim_compute_performance-ego": 0.06970146237587442, "sim_compute_robot_state-ego": 0.0706079979332126}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.10527022395815168, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06367439883095878, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.15896413581711905, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10328155755996704, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.03976139851978847, "sim_compute_performance-ego": 0.07059121557644435, "sim_compute_robot_state-ego": 0.08154147437640599}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.12855256171453566, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06765676680065337, "in-drivable-lane": 0, "agent_compute-ego": 0.16141257967267716, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.09653306007385254, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.04060963221958706, "sim_compute_performance-ego": 0.07659353528703962, "sim_compute_robot_state-ego": 0.08238611902509417}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.11313754421169477, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.0637434417918577, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1524055367809231, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.09773703752937964, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.03793848167031498, "sim_compute_performance-ego": 0.07025647567490399, "sim_compute_robot_state-ego": 0.07342722052234714}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.10374163280833852, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.05997933040965687, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.14949938600713555, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.096788874539462, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.03805180029435591, "sim_compute_performance-ego": 0.06623237783258612, "sim_compute_robot_state-ego": 0.07023194486444646}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.11421982653729328, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.061444338265951574, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15193747235583022, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.0948496607991008, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.037667314727585034, "sim_compute_performance-ego": 0.06769664566238205, "sim_compute_robot_state-ego": 0.07406222046195686}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.12755405051367624, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06628790072032384, "in-drivable-lane": 0, "agent_compute-ego": 0.17335511105401177, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.10736215966088432, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.040863752365112305, "sim_compute_performance-ego": 0.08554095881325859, "sim_compute_robot_state-ego": 0.08128868682043892}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.10712395929822736, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.061010342018277035, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.15401280160043754, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.09963655004314348, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.039110179040946214, "sim_compute_performance-ego": 0.06956085971757478, "sim_compute_robot_state-ego": 0.07696016162049536}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.11799439677485714, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.06246961487664117, "in-drivable-lane": 0, "agent_compute-ego": 0.14635705947875977, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.09339225733721698, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.0395704640282525, "sim_compute_performance-ego": 0.06627070462262188, "sim_compute_robot_state-ego": 0.0739807817671034}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.10938513746448592, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06165069926018808, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.15442863165163526, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.09540804928424312, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.03764773116392248, "sim_compute_performance-ego": 0.06796481796339446, "sim_compute_robot_state-ego": 0.07404388165941425}}
set_robot_commands_max	0.10853796535068087
set_robot_commands_mean	0.09849546182609611
set_robot_commands_median	0.096788874539462
set_robot_commands_min	0.09339225733721698
sim_compute_performance-ego_max	0.08554095881325859
sim_compute_performance-ego_mean	0.07007650127712155
sim_compute_performance-ego_median	0.06956085971757478
sim_compute_performance-ego_min	0.06030897533192354
sim_compute_robot_state-ego_max	0.0957640806833903
sim_compute_robot_state-ego_mean	0.07673339124296757
sim_compute_robot_state-ego_median	0.07406222046195686
sim_compute_robot_state-ego_min	0.06912690050461713
sim_compute_sim_state_max	0.04129158567499231
sim_compute_sim_state_mean	0.039260960097427224
sim_compute_sim_state_median	0.0393148102337801
sim_compute_sim_state_min	0.03764773116392248
sim_physics_max	0.12855256171453566
sim_physics_mean	0.11538665925223364
sim_physics_median	0.11495736066032858
sim_physics_min	0.10374163280833852
sim_render-ego_max	0.06765676680065337
sim_render-ego_mean	0.06242620605018371
sim_render-ego_median	0.06246961487664117
sim_render-ego_min	0.05809750276453355
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

22573

3147

Artem Ioselevskii

challenge-aido_LF-baseline-duckietown

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-40-253-3847

2019-05-16 22:53:11+00:00

2019-05-16 23:00:39+00:00

0:07:28

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22546

3191

Anastasiya Nikolskaya 🇷🇺

NN Solution

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-40-253-3847

2019-05-16 22:27:29+00:00

2019-05-16 22:52:38+00:00

0:25:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.1708335723068592
survival_time_median	14.250000000000068
deviation-center-line_median	1.0389498111637927
in-drivable-lane_median	1.7999999999999936

other stats

agent_compute-ego_max	0.11866572499275208
agent_compute-ego_mean	0.11471965528606576
agent_compute-ego_median	0.11485828349464818
agent_compute-ego_min	0.1120895783106486
deviation-center-line_max	1.3034136170074382
deviation-center-line_mean	0.8649059552944497
deviation-center-line_min	0.30560295173824253
deviation-heading_max	4.244823401816831
deviation-heading_mean	2.616382895653051
deviation-heading_median	3.3887263474007976
deviation-heading_min	0.5624650684792731
driven_any_max	3.2172569004844633
driven_any_mean	2.4469524260866984
driven_any_median	3.052674868905486
driven_any_min	1.0600995571912413
driven_lanedir_consec_max	2.84775760347489
driven_lanedir_consec_mean	1.9192590939809429
driven_lanedir_consec_min	0.7301108080299653
driven_lanedir_max	2.84775760347489
driven_lanedir_mean	1.9192590939809429
driven_lanedir_median	2.1708335723068592
driven_lanedir_min	0.7301108080299653
in-drivable-lane_max	3.1500000000000306
in-drivable-lane_mean	1.8000000000000074
in-drivable-lane_min	0.8500000000000103
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.052674868905486, "sim_physics": 0.13458379193356165, "survival_time": 14.250000000000068, "driven_lanedir": 2.1708335723068592, "sim_render-ego": 0.07107344928540682, "in-drivable-lane": 3.1500000000000306, "agent_compute-ego": 0.11485828349464818, "deviation-heading": 3.3887263474007976, "set_robot_commands": 0.1119780230940434, "deviation-center-line": 1.0389498111637927, "driven_lanedir_consec": 2.1708335723068592, "sim_compute_sim_state": 0.04375335961057429, "sim_compute_performance-ego": 0.07942509818495366, "sim_compute_robot_state-ego": 0.0878397406193248}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0600995571912413, "sim_physics": 0.1272796265129904, "survival_time": 5.14999999999999, "driven_lanedir": 0.7301108080299653, "sim_render-ego": 0.07025377958723643, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.11258075769665173, "deviation-heading": 1.2337705208397771, "set_robot_commands": 0.11390015453968232, "deviation-center-line": 0.30560295173824253, "driven_lanedir_consec": 0.7301108080299653, "sim_compute_sim_state": 0.04539679092110939, "sim_compute_performance-ego": 0.08060153711189344, "sim_compute_robot_state-ego": 0.08881969822263255}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6874755091997962, "sim_physics": 0.1337814971804619, "survival_time": 7.99999999999998, "driven_lanedir": 1.2812903679150107, "sim_render-ego": 0.07144222855567932, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.11866572499275208, "deviation-heading": 0.5624650684792731, "set_robot_commands": 0.11813805103302004, "deviation-center-line": 0.5990251535460138, "driven_lanedir_consec": 1.2812903679150107, "sim_compute_sim_state": 0.04444717019796371, "sim_compute_performance-ego": 0.07993469089269638, "sim_compute_robot_state-ego": 0.0924945130944252}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.2172569004844633, "sim_physics": 0.13283394575119015, "survival_time": 14.950000000000076, "driven_lanedir": 2.566303118177988, "sim_render-ego": 0.07139572540918986, "in-drivable-lane": 2.000000000000008, "agent_compute-ego": 0.1120895783106486, "deviation-heading": 4.244823401816831, "set_robot_commands": 0.10878412326176962, "deviation-center-line": 1.077538243016761, "driven_lanedir_consec": 2.566303118177988, "sim_compute_sim_state": 0.043628947734832765, "sim_compute_performance-ego": 0.07915256341298421, "sim_compute_robot_state-ego": 0.08799504121144612}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.217255294652504, "sim_physics": 0.12066758553187051, "survival_time": 14.950000000000076, "driven_lanedir": 2.84775760347489, "sim_render-ego": 0.07091130256652832, "in-drivable-lane": 0.8500000000000103, "agent_compute-ego": 0.11540393193562826, "deviation-heading": 3.652129139728575, "set_robot_commands": 0.11360753854115804, "deviation-center-line": 1.3034136170074382, "driven_lanedir_consec": 2.84775760347489, "sim_compute_sim_state": 0.04315538962682088, "sim_compute_performance-ego": 0.07984337091445923, "sim_compute_robot_state-ego": 0.09003039360046387}}
set_robot_commands_max	0.11813805103302004
set_robot_commands_mean	0.11328157809393467
set_robot_commands_median	0.11360753854115804
set_robot_commands_min	0.10878412326176962
sim_compute_performance-ego_max	0.08060153711189344
sim_compute_performance-ego_mean	0.07979145210339737
sim_compute_performance-ego_median	0.07984337091445923
sim_compute_performance-ego_min	0.07915256341298421
sim_compute_robot_state-ego_max	0.0924945130944252
sim_compute_robot_state-ego_mean	0.08943587734965851
sim_compute_robot_state-ego_median	0.08881969822263255
sim_compute_robot_state-ego_min	0.0878397406193248
sim_compute_sim_state_max	0.04539679092110939
sim_compute_sim_state_mean	0.0440763316182602
sim_compute_sim_state_median	0.04375335961057429
sim_compute_sim_state_min	0.04315538962682088
sim_physics_max	0.13458379193356165
sim_physics_mean	0.1298292893820149
sim_physics_median	0.13283394575119015
sim_physics_min	0.12066758553187051
sim_render-ego_max	0.07144222855567932
sim_render-ego_mean	0.07101529708080816
sim_render-ego_median	0.07107344928540682
sim_render-ego_min	0.07025377958723643
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.460000000000036
survival_time_min	5.14999999999999

No reset possible