Evaluator 1211

ID	1211
evaluator	`ip-172-31-38-104-25436`
owner	I don't have one 😀
machine	ip-172-31-38-104
process	ip-172-31-38-104-25436
version	d-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard	2019-05-16 22:34:01+00:00
last heard	2019-05-17 15:36:43+00:00
status	inactive
# evaluating
# success	16 `22556`
# timeout
# failed	2 `22795`
# error	22 `22571`
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

23069

3551

Amaury Camus 🇨🇭

Running the real lane following -- without challenge container

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-25436

2019-05-17 09:53:02+00:00

2019-05-17 09:58:55+00:00

0:05:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.17151485443115233
agent_compute-ego_mean	0.15816657344068244
agent_compute-ego_median	0.1546058234046487
agent_compute-ego_min	0.15236477057139078
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11781007713741726, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06095874751055682, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15236477057139078, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10338166466465702, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04021387188522904, "sim_compute_performance-ego": 0.07121863188566985, "sim_compute_robot_state-ego": 0.08136621669486717}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.13165891871732824, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.0666034548890357, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15861909062254662, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10346272412468405, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04247463918199726, "sim_compute_performance-ego": 0.0716241341011197, "sim_compute_robot_state-ego": 0.08153079070296942}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.14546986187205596, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0608369462630328, "in-drivable-lane": 0, "agent_compute-ego": 0.1546058234046487, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.09948372840881348, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04000097162583295, "sim_compute_performance-ego": 0.07118561688591452, "sim_compute_robot_state-ego": 0.0814358346602496}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1368940830230713, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06941596984863281, "in-drivable-lane": 0, "agent_compute-ego": 0.17151485443115233, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09899954795837404, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.0409217643737793, "sim_compute_performance-ego": 0.07501967430114746, "sim_compute_robot_state-ego": 0.08324394226074219}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11840898779374134, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06570545932914637, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1537283281736736, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09881572783747808, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03918239134776441, "sim_compute_performance-ego": 0.07114281835435313, "sim_compute_robot_state-ego": 0.07748969295356847}}
set_robot_commands_max	0.10346272412468405
set_robot_commands_mean	0.10082867859880132
set_robot_commands_median	0.09948372840881348
set_robot_commands_min	0.09881572783747808
sim_compute_performance-ego_max	0.07501967430114746
sim_compute_performance-ego_mean	0.07203817510564092
sim_compute_performance-ego_median	0.07121863188566985
sim_compute_performance-ego_min	0.07114281835435313
sim_compute_robot_state-ego_max	0.08324394226074219
sim_compute_robot_state-ego_mean	0.08101329545447937
sim_compute_robot_state-ego_median	0.0814358346602496
sim_compute_robot_state-ego_min	0.07748969295356847
sim_compute_sim_state_max	0.04247463918199726
sim_compute_sim_state_mean	0.04055872768292059
sim_compute_sim_state_median	0.04021387188522904
sim_compute_sim_state_min	0.03918239134776441
sim_physics_max	0.14546986187205596
sim_physics_mean	0.13004838570872282
sim_physics_median	0.13165891871732824
sim_physics_min	0.11781007713741726
sim_render-ego_max	0.06941596984863281
sim_render-ego_mean	0.0647041155680809
sim_render-ego_median	0.06570545932914637
sim_render-ego_min	0.0608369462630328
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

23025

2371

Liam Paull 🇨🇦

minimal_agent (Python 3)

aido2-LFV-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 05:25:28+00:00

2019-05-17 06:01:08+00:00

0:35:40

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23021

2376

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-25436

2019-05-17 05:18:35+00:00

2019-05-17 05:25:19+00:00

0:06:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6707441932890994
survival_time_median	3.649999999999995
deviation-center-line_median	0.14435558631904788
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.10330638369998416
agent_compute-ego_mean	0.0730399656397981
agent_compute-ego_median	0.06630580167512636
agent_compute-ego_min	0.05951234485421862
deviation-center-line_max	0.4005818627784723
deviation-center-line_mean	0.21811977533890275
deviation-center-line_min	0.12422801598242109
deviation-heading_max	1.047774623333474
deviation-heading_mean	0.5589514876466882
deviation-heading_median	0.5590533399929921
deviation-heading_min	0.3001803644882976
driven_any_max	1.5798273185719856
driven_any_mean	0.8628689511998026
driven_any_median	0.9948273195001778
driven_any_min	0.2750262368649079
driven_lanedir_consec_max	1.1257539445961453
driven_lanedir_consec_mean	0.6746052985515076
driven_lanedir_consec_min	0.2671322113623069
driven_lanedir_max	1.1257539445961453
driven_lanedir_mean	0.6746052985515076
driven_lanedir_median	0.6707441932890994
driven_lanedir_min	0.2671322113623069
in-drivable-lane_max	1.499999999999995
in-drivable-lane_mean	0.5299999999999981
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.11752730852937043, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.06040501594543457, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06520777859099924, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.09689946697182852, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.04019765004719773, "sim_compute_performance-ego": 0.07158105667323282, "sim_compute_robot_state-ego": 0.08183016189157147}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.009827319290899, "sim_physics": 0.1191596018301474, "survival_time": 3.699999999999995, "driven_lanedir": 0.8760331754635476, "sim_render-ego": 0.06101691722869873, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.06630580167512636, "deviation-heading": 1.047774623333474, "set_robot_commands": 0.09721854892936913, "deviation-center-line": 0.29642020115014733, "driven_lanedir_consec": 0.8760331754635476, "sim_compute_sim_state": 0.03990922103057037, "sim_compute_performance-ego": 0.06766995868167362, "sim_compute_robot_state-ego": 0.07713592052459717}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2750262368649079, "sim_physics": 0.11967157363891602, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2671322113623069, "sim_render-ego": 0.06231942176818848, "in-drivable-lane": 0, "agent_compute-ego": 0.0708675193786621, "deviation-heading": 0.3001803644882976, "set_robot_commands": 0.1018745517730713, "deviation-center-line": 0.12422801598242109, "driven_lanedir_consec": 0.2671322113623069, "sim_compute_sim_state": 0.04149534225463867, "sim_compute_performance-ego": 0.0661995792388916, "sim_compute_robot_state-ego": 0.07496262550354003}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4548365617710419, "sim_physics": 0.13220611778465477, "survival_time": 1.850000000000001, "driven_lanedir": 0.4333629680464388, "sim_render-ego": 0.05905739681140797, "in-drivable-lane": 0, "agent_compute-ego": 0.10330638369998416, "deviation-heading": 0.5707543029776994, "set_robot_commands": 0.09621416555868612, "deviation-center-line": 0.12501321046442526, "driven_lanedir_consec": 0.4333629680464388, "sim_compute_sim_state": 0.040423045287261136, "sim_compute_performance-ego": 0.06858272165865512, "sim_compute_robot_state-ego": 0.07596042993906382}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5798273185719856, "sim_physics": 0.09852853417396544, "survival_time": 5.599999999999988, "driven_lanedir": 1.1257539445961453, "sim_render-ego": 0.05698726858411517, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.05951234485421862, "deviation-heading": 0.31699480744097813, "set_robot_commands": 0.08880752750805446, "deviation-center-line": 0.4005818627784723, "driven_lanedir_consec": 1.1257539445961453, "sim_compute_sim_state": 0.035407375012125285, "sim_compute_performance-ego": 0.06425119936466217, "sim_compute_robot_state-ego": 0.06861248186656407}}
set_robot_commands_max	0.1018745517730713
set_robot_commands_mean	0.0962028521482019
set_robot_commands_median	0.09689946697182852
set_robot_commands_min	0.08880752750805446
sim_compute_performance-ego_max	0.07158105667323282
sim_compute_performance-ego_mean	0.06765690312342307
sim_compute_performance-ego_median	0.06766995868167362
sim_compute_performance-ego_min	0.06425119936466217
sim_compute_robot_state-ego_max	0.08183016189157147
sim_compute_robot_state-ego_mean	0.07570032394506732
sim_compute_robot_state-ego_median	0.07596042993906382
sim_compute_robot_state-ego_min	0.06861248186656407
sim_compute_sim_state_max	0.04149534225463867
sim_compute_sim_state_mean	0.039486526726358634
sim_compute_sim_state_median	0.04019765004719773
sim_compute_sim_state_min	0.035407375012125285
sim_physics_max	0.13220611778465477
sim_physics_mean	0.11741862719141084
sim_physics_median	0.1191596018301474
sim_physics_min	0.09852853417396544
sim_render-ego_max	0.06231942176818848
sim_render-ego_mean	0.05995720406756898
sim_render-ego_median	0.06040501594543457
sim_render-ego_min	0.05698726858411517
simulation-passed	1
survival_time_max	5.599999999999988
survival_time_mean	3.209999999999996
survival_time_min	1.2500000000000004

No reset possible

23004

2406

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

aido2-LFVI-sim-testing

step1-simulation

success

yes

ip-172-31-38-104-25436

2019-05-17 05:00:52+00:00

2019-05-17 05:18:21+00:00

0:17:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.09804494095325178
survival_time_median	1.3000000000000005
deviation-center-line_median	0.09278251685775844
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.2105862299601237
agent_compute-ego_mean	0.18224737943180416
agent_compute-ego_median	0.18185271887943663
agent_compute-ego_min	0.15127026729094675
deviation-center-line_max	0.11574478552824671
deviation-center-line_mean	0.08336764241835702
deviation-center-line_min	0.05724883314758254
deviation-heading_max	1.0449336509635698
deviation-heading_mean	0.7523264835999015
deviation-heading_median	0.7708762564433059
deviation-heading_min	0.552182245701715
driven_any_max	0.24180034977820256
driven_any_mean	0.17153282663687375
driven_any_median	0.16089791000050985
driven_any_min	0.10535491668777
driven_lanedir_consec_max	0.13095689902377705
driven_lanedir_consec_mean	0.10289348756736148
driven_lanedir_consec_min	0.06928505461617851
driven_lanedir_max	0.13095689902377705
driven_lanedir_mean	0.10289348756736148
driven_lanedir_median	0.09804494095325178
driven_lanedir_min	0.06928505461617851
in-drivable-lane_max	0.6000000000000005
in-drivable-lane_mean	0.14000000000000012
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.2117461509615564, "sim_physics": 0.20380358014787947, "survival_time": 1.7500000000000009, "driven_lanedir": 0.07467686707379517, "sim_render-ego": 0.05933527946472168, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17442770004272462, "deviation-heading": 0.8423879734501307, "set_robot_commands": 0.09745347840445384, "deviation-center-line": 0.06783694630943402, "driven_lanedir_consec": 0.07467686707379517, "sim_compute_sim_state": 0.03777140208653041, "sim_compute_performance-ego": 0.06857247352600097, "sim_compute_robot_state-ego": 0.07524324144635881, "sim_compute_robot_state-npc0": 0.06982983861650739, "sim_compute_robot_state-npc1": 0.07242324692862374, "sim_compute_robot_state-npc2": 0.06908041409083775, "sim_compute_robot_state-npc3": 0.06947552817208426}, "udem1-1-0": {"driven_any": 0.20894009005462233, "sim_physics": 0.22175272579850824, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1254756872696592, "sim_render-ego": 0.06868207043614881, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17714288316923996, "deviation-heading": 1.0449336509635698, "set_robot_commands": 0.09738243859389732, "deviation-center-line": 0.09559318451693756, "driven_lanedir_consec": 0.1254756872696592, "sim_compute_sim_state": 0.03912361736955314, "sim_compute_performance-ego": 0.06974142173240924, "sim_compute_robot_state-ego": 0.07823953957393251, "sim_compute_robot_state-npc0": 0.07267491570834456, "sim_compute_robot_state-npc1": 0.07340959844918087, "sim_compute_robot_state-npc2": 0.0708811776391391, "sim_compute_robot_state-npc3": 0.0678466352923163}, "udem1-2-0": {"driven_any": 0.10535491668777, "sim_physics": 0.27427087659421173, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06928505461617851, "sim_render-ego": 0.06038083200869353, "in-drivable-lane": 0, "agent_compute-ego": 0.19220430954642917, "deviation-heading": 0.5818784056896614, "set_robot_commands": 0.10143436556277068, "deviation-center-line": 0.09913396124662992, "driven_lanedir_consec": 0.06928505461617851, "sim_compute_sim_state": 0.04192916206691576, "sim_compute_performance-ego": 0.06933264110399329, "sim_compute_robot_state-ego": 0.07702052074929942, "sim_compute_robot_state-npc0": 0.07442145762236221, "sim_compute_robot_state-npc1": 0.08066561947698178, "sim_compute_robot_state-npc2": 0.07233582372250764, "sim_compute_robot_state-npc3": 0.06925116414609163}, "udem1-3-0": {"driven_any": 0.12290507717709089, "sim_physics": 0.2391032079855601, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08316133596757291, "sim_render-ego": 0.06827053427696228, "in-drivable-lane": 0, "agent_compute-ego": 0.1873746116956075, "deviation-heading": 0.5998308086861903, "set_robot_commands": 0.09851179520289104, "deviation-center-line": 0.10056605466412988, "driven_lanedir_consec": 0.08316133596757291, "sim_compute_sim_state": 0.040619611740112305, "sim_compute_performance-ego": 0.0786159336566925, "sim_compute_robot_state-ego": 0.0689033567905426, "sim_compute_robot_state-npc0": 0.07529917359352112, "sim_compute_robot_state-npc1": 0.07195469737052917, "sim_compute_robot_state-npc2": 0.07281378904978435, "sim_compute_robot_state-npc3": 0.07223832607269287}, "udem1-4-0": {"driven_any": 0.14558881105318014, "sim_physics": 0.22322537588036576, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0945349628376586, "sim_render-ego": 0.05928803526836893, "in-drivable-lane": 0, "agent_compute-ego": 0.17485897437385892, "deviation-heading": 0.755318806272474, "set_robot_commands": 0.09689114404761272, "deviation-center-line": 0.05724883314758254, "driven_lanedir_consec": 0.0945349628376586, "sim_compute_sim_state": 0.03996116182078486, "sim_compute_performance-ego": 0.06758803906648056, "sim_compute_robot_state-ego": 0.07991752417191215, "sim_compute_robot_state-npc0": 0.06945834989133089, "sim_compute_robot_state-npc1": 0.07271786358045496, "sim_compute_robot_state-npc2": 0.07350642784782078, "sim_compute_robot_state-npc3": 0.0711207389831543}, "udem1-5-0": {"driven_any": 0.24180034977820256, "sim_physics": 0.16636611865117, "survival_time": 1.950000000000001, "driven_lanedir": 0.10983523072031565, "sim_render-ego": 0.05738533460176908, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15127026729094675, "deviation-heading": 0.8393964030240664, "set_robot_commands": 0.08014867244622646, "deviation-center-line": 0.0650284283186453, "driven_lanedir_consec": 0.10983523072031565, "sim_compute_sim_state": 0.0337378673064403, "sim_compute_performance-ego": 0.05890417710328714, "sim_compute_robot_state-ego": 0.06321366628011067, "sim_compute_robot_state-npc0": 0.059686740239461265, "sim_compute_robot_state-npc1": 0.056836977983132385, "sim_compute_robot_state-npc2": 0.06291401691925831, "sim_compute_robot_state-npc3": 0.06174383407984024}, "udem1-6-0": {"driven_any": 0.13370828371113996, "sim_physics": 0.2702126701672872, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09617762850568656, "sim_render-ego": 0.06866225600242615, "in-drivable-lane": 0, "agent_compute-ego": 0.2105862299601237, "deviation-heading": 0.6559000790917711, "set_robot_commands": 0.09677446881930034, "deviation-center-line": 0.09278251685775844, "driven_lanedir_consec": 0.09617762850568656, "sim_compute_sim_state": 0.042075673739115395, "sim_compute_performance-ego": 0.07906338572502136, "sim_compute_robot_state-ego": 0.07907808820406596, "sim_compute_robot_state-npc0": 0.07414512832959493, "sim_compute_robot_state-npc1": 0.07380911707878113, "sim_compute_robot_state-npc2": 0.07592472434043884, "sim_compute_robot_state-npc3": 0.07332466046015422}, "udem1-7-0": {"driven_any": 0.16089791000050985, "sim_physics": 0.23515562827770525, "survival_time": 1.3000000000000005, "driven_lanedir": 0.12684350544592515, "sim_render-ego": 0.06267006580646221, "in-drivable-lane": 0, "agent_compute-ego": 0.18322553084446833, "deviation-heading": 0.5688046386417113, "set_robot_commands": 0.09918248653411864, "deviation-center-line": 0.09847860929448742, "driven_lanedir_consec": 0.12684350544592515, "sim_compute_sim_state": 0.03904804816612831, "sim_compute_performance-ego": 0.07091660682971661, "sim_compute_robot_state-ego": 0.07236458705021785, "sim_compute_robot_state-npc0": 0.06909518975477952, "sim_compute_robot_state-npc1": 0.07047086495619553, "sim_compute_robot_state-npc2": 0.07256035621349628, "sim_compute_robot_state-npc3": 0.06746564461634709}, "udem1-8-0": {"driven_any": 0.21838351439014325, "sim_physics": 0.19781967840696635, "survival_time": 1.900000000000001, "driven_lanedir": 0.11442493508345164, "sim_render-ego": 0.06103132273021497, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.177540754017077, "deviation-heading": 0.8888091546266096, "set_robot_commands": 0.09525425183145624, "deviation-center-line": 0.05774930799614544, "driven_lanedir_consec": 0.11442493508345164, "sim_compute_sim_state": 0.04117239148993241, "sim_compute_performance-ego": 0.07166031787269994, "sim_compute_robot_state-ego": 0.07324913300965961, "sim_compute_robot_state-npc0": 0.07000424987391422, "sim_compute_robot_state-npc1": 0.06852254742070248, "sim_compute_robot_state-npc2": 0.06796047562047054, "sim_compute_robot_state-npc3": 0.07109509643755461}, "udem1-9-0": {"driven_any": 0.17205707268454873, "sim_physics": 0.24596581635651765, "survival_time": 1.3500000000000003, "driven_lanedir": 0.09804494095325178, "sim_render-ego": 0.05904001659817166, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1741472703439218, "deviation-heading": 0.9518047165869516, "set_robot_commands": 0.09307999081081814, "deviation-center-line": 0.06904280433646588, "driven_lanedir_consec": 0.09804494095325178, "sim_compute_sim_state": 0.04214230290165654, "sim_compute_performance-ego": 0.07245135307312012, "sim_compute_robot_state-ego": 0.08084710439046223, "sim_compute_robot_state-npc0": 0.06990850413287128, "sim_compute_robot_state-npc1": 0.07204716293900101, "sim_compute_robot_state-npc2": 0.07269820460566769, "sim_compute_robot_state-npc3": 0.07173366016811794}, "udem1-10-0": {"driven_any": 0.1819034111690669, "sim_physics": 0.2028204110952524, "survival_time": 1.3000000000000005, "driven_lanedir": 0.13095689902377705, "sim_render-ego": 0.06477080858670749, "in-drivable-lane": 0, "agent_compute-ego": 0.17998002125666693, "deviation-heading": 0.827436807550515, "set_robot_commands": 0.09073302379021278, "deviation-center-line": 0.06895780794610369, "driven_lanedir_consec": 0.13095689902377705, "sim_compute_sim_state": 0.03523370852837196, "sim_compute_performance-ego": 0.06735972257760856, "sim_compute_robot_state-ego": 0.07193417732532208, "sim_compute_robot_state-npc0": 0.06667719437525822, "sim_compute_robot_state-npc1": 0.06399292212266189, "sim_compute_robot_state-npc2": 0.06654423933762771, "sim_compute_robot_state-npc3": 0.06512696926410382}, "udem1-11-0": {"driven_any": 0.1547021330324159, "sim_physics": 0.2426952620347341, "survival_time": 1.2000000000000004, "driven_lanedir": 0.12668955339971788, "sim_render-ego": 0.06506852308909099, "in-drivable-lane": 0, "agent_compute-ego": 0.19084563851356504, "deviation-heading": 0.552182245701715, "set_robot_commands": 0.10118688146273296, "deviation-center-line": 0.11574478552824671, "driven_lanedir_consec": 0.12668955339971788, "sim_compute_sim_state": 0.042798380057017006, "sim_compute_performance-ego": 0.07474282383918762, "sim_compute_robot_state-ego": 0.08702335755030315, "sim_compute_robot_state-npc0": 0.07403618097305298, "sim_compute_robot_state-npc1": 0.06924365957578023, "sim_compute_robot_state-npc2": 0.07254776358604431, "sim_compute_robot_state-npc3": 0.07238268852233887}, "udem1-12-0": {"driven_any": 0.23013734624138155, "sim_physics": 0.2394107855283297, "survival_time": 1.950000000000001, "driven_lanedir": 0.0938825515952464, "sim_render-ego": 0.06574635627942207, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.18259583375392816, "deviation-heading": 0.7708762564433059, "set_robot_commands": 0.09889487119821402, "deviation-center-line": 0.07059735132156827, "driven_lanedir_consec": 0.0938825515952464, "sim_compute_sim_state": 0.04035804210565029, "sim_compute_performance-ego": 0.07074358524420322, "sim_compute_robot_state-ego": 0.07094446206704164, "sim_compute_robot_state-npc0": 0.06934082202422313, "sim_compute_robot_state-npc1": 0.0734857534750914, "sim_compute_robot_state-npc2": 0.07257361289782402, "sim_compute_robot_state-npc3": 0.07057945544903095}, "udem1-13-0": {"driven_any": 0.1345664476043814, "sim_physics": 0.22826427998750107, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09739890151551124, "sim_render-ego": 0.06742145704186481, "in-drivable-lane": 0, "agent_compute-ego": 0.1956579477890678, "deviation-heading": 0.5671138342930585, "set_robot_commands": 0.102741293285204, "deviation-center-line": 0.09405404469829896, "driven_lanedir_consec": 0.09739890151551124, "sim_compute_sim_state": 0.03911198740420134, "sim_compute_performance-ego": 0.07617155365321947, "sim_compute_robot_state-ego": 0.0838591015857199, "sim_compute_robot_state-npc0": 0.06707397751186205, "sim_compute_robot_state-npc1": 0.06891801046288532, "sim_compute_robot_state-npc2": 0.06638215935748557, "sim_compute_robot_state-npc3": 0.07095870764359184}, "udem1-14-0": {"driven_any": 0.1503008850070965, "sim_physics": 0.21051829436729697, "survival_time": 1.4500000000000006, "driven_lanedir": 0.10201425950267452, "sim_render-ego": 0.05925248409139699, "in-drivable-lane": 0, "agent_compute-ego": 0.18185271887943663, "deviation-heading": 0.8382234729767911, "set_robot_commands": 0.09473027031997154, "deviation-center-line": 0.0977000000929214, "driven_lanedir_consec": 0.10201425950267452, "sim_compute_sim_state": 0.039134995690707504, "sim_compute_performance-ego": 0.06583405363148656, "sim_compute_robot_state-ego": 0.07419788426366346, "sim_compute_robot_state-npc0": 0.06904740169130523, "sim_compute_robot_state-npc1": 0.0749528983543659, "sim_compute_robot_state-npc2": 0.0737288080412766, "sim_compute_robot_state-npc3": 0.07091684177004058}}
set_robot_commands_max	0.102741293285204
set_robot_commands_mean	0.0962932954873254
set_robot_commands_median	0.09738243859389732
set_robot_commands_min	0.08014867244622646
sim_compute_performance-ego_max	0.07906338572502136
sim_compute_performance-ego_mean	0.07077987257567515
sim_compute_performance-ego_median	0.07074358524420322
sim_compute_performance-ego_min	0.05890417710328714
sim_compute_robot_state-ego_max	0.08702335755030315
sim_compute_robot_state-ego_mean	0.0757357162972408
sim_compute_robot_state-ego_median	0.07524324144635881
sim_compute_robot_state-ego_min	0.06321366628011067
sim_compute_robot_state-npc0_max	0.07529917359352112
sim_compute_robot_state-npc0_mean	0.07004660828922593
sim_compute_robot_state-npc0_median	0.06982983861650739
sim_compute_robot_state-npc0_min	0.059686740239461265
sim_compute_robot_state-npc1_max	0.08066561947698178
sim_compute_robot_state-npc1_mean	0.07089672934495786
sim_compute_robot_state-npc1_median	0.07204716293900101
sim_compute_robot_state-npc1_min	0.056836977983132385
sim_compute_robot_state-npc2_max	0.07592472434043884
sim_compute_robot_state-npc2_mean	0.07083013288464529
sim_compute_robot_state-npc2_median	0.07254776358604431
sim_compute_robot_state-npc2_min	0.06291401691925831
sim_compute_robot_state-npc3_max	0.07332466046015422
sim_compute_robot_state-npc3_mean	0.06968399673849729
sim_compute_robot_state-npc3_median	0.07091684177004058
sim_compute_robot_state-npc3_min	0.06174383407984024
sim_compute_sim_state_max	0.042798380057017006
sim_compute_sim_state_mean	0.03961455683154117
sim_compute_sim_state_median	0.03996116182078486
sim_compute_sim_state_min	0.0337378673064403
sim_physics_max	0.27427087659421173
sim_physics_mean	0.2267589807519524
sim_physics_median	0.22826427998750107
sim_physics_min	0.16636611865117
sim_render-ego_max	0.06868207043614881
sim_render-ego_mean	0.06313369175216145
sim_render-ego_median	0.06267006580646221
sim_render-ego_min	0.05738533460176908
simulation-passed	1
survival_time_max	1.950000000000001
survival_time_mean	1.4300000000000004
survival_time_min	1.1500000000000004

No reset possible

22970

2446

Nicky Eichmann

Baseline solution using reinforcement learning

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 04:18:55+00:00

2019-05-17 05:00:23+00:00

0:41:28

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22951

2476

Liam Paull 🇨🇦

challenge-aido_LF-template-random

aido2-LFVI-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-25436

2019-05-17 04:08:09+00:00

2019-05-17 04:18:10+00:00

0:10:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.16622229984828404
agent_compute-ego_mean	0.15950964505636234
agent_compute-ego_median	0.16006820714926415
agent_compute-ego_min	0.1532143365989611
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.13547481992266058
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314897
deviation-heading_mean	0.49959867397150787
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000694
driven_any_mean	1.1068208197848532
driven_any_median	0.9410513078477724
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.826231945363564
driven_lanedir_consec_mean	0.804744013449103
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.826231945363564
driven_lanedir_mean	0.804828147320482
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.21211269837391528, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06389497201653975, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.16006820714926415, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09740174872965753, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.038397855396512186, "sim_compute_performance-ego": 0.07008296024950245, "sim_compute_robot_state-ego": 0.07337343240086036, "sim_compute_robot_state-npc0": 0.07088000261330907, "sim_compute_robot_state-npc1": 0.0703567009937914, "sim_compute_robot_state-npc2": 0.06877282299572908, "sim_compute_robot_state-npc3": 0.06931182100803038}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.22395586967468264, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06900025265557426, "in-drivable-lane": 0, "agent_compute-ego": 0.16622229984828404, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10966482332774571, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.041750703539167135, "sim_compute_performance-ego": 0.07568677834102086, "sim_compute_robot_state-ego": 0.08603425536836896, "sim_compute_robot_state-npc0": 0.07943786893572126, "sim_compute_robot_state-npc1": 0.0726914746420724, "sim_compute_robot_state-npc2": 0.07176736422947474, "sim_compute_robot_state-npc3": 0.07399249076843262}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.20530264585920907, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06299996607511946, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1532143365989611, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.09937334523617644, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.039288011569421265, "sim_compute_performance-ego": 0.0697079954795467, "sim_compute_robot_state-ego": 0.07389046150503807, "sim_compute_robot_state-npc0": 0.07244809391429123, "sim_compute_robot_state-npc1": 0.06945309361207833, "sim_compute_robot_state-npc2": 0.06914716090970827, "sim_compute_robot_state-npc3": 0.07051661176588929}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.25331426163514453, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06755570073922475, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.16404678920904794, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.13494417071342468, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.05351060132185618, "sim_compute_performance-ego": 0.07378218571345012, "sim_compute_robot_state-ego": 0.07737891872723897, "sim_compute_robot_state-npc0": 0.07482354839642842, "sim_compute_robot_state-npc1": 0.07881005605061848, "sim_compute_robot_state-npc2": 0.07414799928665161, "sim_compute_robot_state-npc3": 0.07335797945658366}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.22898034822373164, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06264560563223702, "in-drivable-lane": 0, "agent_compute-ego": 0.1539965924762544, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.0922544797261556, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.0386166459038144, "sim_compute_performance-ego": 0.07091610772269112, "sim_compute_robot_state-ego": 0.07547643071129209, "sim_compute_robot_state-npc0": 0.06825040635608491, "sim_compute_robot_state-npc1": 0.07406174568902879, "sim_compute_robot_state-npc2": 0.07030699366614931, "sim_compute_robot_state-npc3": 0.06833615757170178}}
set_robot_commands_max	0.13494417071342468
set_robot_commands_mean	0.106727713546632
set_robot_commands_median	0.09937334523617644
set_robot_commands_min	0.0922544797261556
sim_compute_performance-ego_max	0.07568677834102086
sim_compute_performance-ego_mean	0.07203520550124225
sim_compute_performance-ego_median	0.07091610772269112
sim_compute_performance-ego_min	0.0697079954795467
sim_compute_robot_state-ego_max	0.08603425536836896
sim_compute_robot_state-ego_mean	0.0772306997425597
sim_compute_robot_state-ego_median	0.07547643071129209
sim_compute_robot_state-ego_min	0.07337343240086036
sim_compute_robot_state-npc0_max	0.07943786893572126
sim_compute_robot_state-npc0_mean	0.07316798404316698
sim_compute_robot_state-npc0_median	0.07244809391429123
sim_compute_robot_state-npc0_min	0.06825040635608491
sim_compute_robot_state-npc1_max	0.07881005605061848
sim_compute_robot_state-npc1_mean	0.07307461419751789
sim_compute_robot_state-npc1_median	0.0726914746420724
sim_compute_robot_state-npc1_min	0.06945309361207833
sim_compute_robot_state-npc2_max	0.07414799928665161
sim_compute_robot_state-npc2_mean	0.0708284682175426
sim_compute_robot_state-npc2_median	0.07030699366614931
sim_compute_robot_state-npc2_min	0.06877282299572908
sim_compute_robot_state-npc3_max	0.07399249076843262
sim_compute_robot_state-npc3_mean	0.07110301211412755
sim_compute_robot_state-npc3_median	0.07051661176588929
sim_compute_robot_state-npc3_min	0.06833615757170178
sim_compute_sim_state_max	0.05351060132185618
sim_compute_sim_state_mean	0.04231276354615423
sim_compute_sim_state_median	0.039288011569421265
sim_compute_sim_state_min	0.038397855396512186
sim_physics_max	0.25331426163514453
sim_physics_mean	0.2247331647533366
sim_physics_median	0.22395586967468264
sim_physics_min	0.20530264585920907
sim_render-ego_max	0.06900025265557426
sim_render-ego_mean	0.06521929942373905
sim_render-ego_median	0.06389497201653975
sim_render-ego_min	0.06264560563223702
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

22945

2488

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

aido2-LFVI-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 04:06:52+00:00

2019-05-17 04:07:50+00:00

0:00:58

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22926

2512

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 04:04:48+00:00

2019-05-17 04:06:37+00:00

0:01:49

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22913

2529

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

aido2-LF-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 04:00:36+00:00

2019-05-17 04:04:34+00:00

0:03:58

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22903

2543

Liam Paull 🇨🇦

challenge-aido_LF-template-random

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 03:56:24+00:00

2019-05-17 04:00:13+00:00

0:03:49

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22898

2552

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LFV-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-25436

2019-05-17 03:47:15+00:00

2019-05-17 03:56:08+00:00

0:08:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.36592094708219225
survival_time_median	2.5999999999999988
deviation-center-line_median	0.16987818035809085
in-drivable-lane_median	0.05000000000000005

other stats

agent_compute-ego_max	0.0762818232178688
agent_compute-ego_mean	0.07328183877427943
agent_compute-ego_median	0.07281883863302377
agent_compute-ego_min	0.0698111511412121
deviation-center-line_max	0.2294363663374862
deviation-center-line_mean	0.14972083567701736
deviation-center-line_min	0.06426934298501713
deviation-heading_max	0.6986268167330368
deviation-heading_mean	0.4280304166285303
deviation-heading_median	0.41847631252347706
deviation-heading_min	0.2596285487829774
driven_any_max	1.2972979671834337
driven_any_mean	0.7173901327940211
driven_any_median	0.7336463183586153
driven_any_min	0.26903550091980144
driven_lanedir_consec_max	0.97716132702229
driven_lanedir_consec_mean	0.5227475277218055
driven_lanedir_consec_min	0.2407721645627201
driven_lanedir_max	0.97716132702229
driven_lanedir_mean	0.5227475277218055
driven_lanedir_median	0.36592094708219225
driven_lanedir_min	0.2407721645627201
in-drivable-lane_max	1.8999999999999944
in-drivable-lane_mean	0.5799999999999983
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.16790470942645006, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06398701667785645, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07269075219060334, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.1019065816637496, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.04016376884890274, "sim_compute_performance-ego": 0.07107244746785768, "sim_compute_robot_state-ego": 0.07459398390541613, "sim_compute_robot_state-npc0": 0.0697092741308078, "sim_compute_robot_state-npc1": 0.07085325012744313, "sim_compute_robot_state-npc2": 0.07021664229916855, "sim_compute_robot_state-npc3": 0.07076960550227636}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.1983885020017624, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.06307482719421387, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0762818232178688, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.10721927136182784, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.04130175709724426, "sim_compute_performance-ego": 0.06920463591814041, "sim_compute_robot_state-ego": 0.07577533274888992, "sim_compute_robot_state-npc0": 0.0737895518541336, "sim_compute_robot_state-npc1": 0.07350768148899078, "sim_compute_robot_state-npc2": 0.07081571966409683, "sim_compute_robot_state-npc3": 0.07213827967643738}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.20334953986681423, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.06313011737970206, "in-drivable-lane": 0, "agent_compute-ego": 0.07281883863302377, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.09964406490325928, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.04003007595355694, "sim_compute_performance-ego": 0.06959507557062003, "sim_compute_robot_state-ego": 0.07696419954299927, "sim_compute_robot_state-npc0": 0.0726391810637254, "sim_compute_robot_state-npc1": 0.07128890661092904, "sim_compute_robot_state-npc2": 0.07209319793261014, "sim_compute_robot_state-npc3": 0.07011556625366211}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.18926947347579465, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.06355859130941412, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0748066286886892, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.10087595447417227, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.04180564931643906, "sim_compute_performance-ego": 0.07237376192564605, "sim_compute_robot_state-ego": 0.0792810070899225, "sim_compute_robot_state-npc0": 0.0747543893834596, "sim_compute_robot_state-npc1": 0.0706971614591537, "sim_compute_robot_state-npc2": 0.07420600101511965, "sim_compute_robot_state-npc3": 0.0709845507016746}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.18232426189240955, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.060373328980945405, "in-drivable-lane": 0, "agent_compute-ego": 0.0698111511412121, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.10987062681288946, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.04169996579488119, "sim_compute_performance-ego": 0.06816932133265904, "sim_compute_robot_state-ego": 0.07201845305306571, "sim_compute_robot_state-npc0": 0.06596843401590984, "sim_compute_robot_state-npc1": 0.06978980700174968, "sim_compute_robot_state-npc2": 0.06770663034348261, "sim_compute_robot_state-npc3": 0.07213173593793597}}
set_robot_commands_max	0.10987062681288946
set_robot_commands_mean	0.1039032998431797
set_robot_commands_median	0.1019065816637496
set_robot_commands_min	0.09964406490325928
sim_compute_performance-ego_max	0.07237376192564605
sim_compute_performance-ego_mean	0.07008304844298466
sim_compute_performance-ego_median	0.06959507557062003
sim_compute_performance-ego_min	0.06816932133265904
sim_compute_robot_state-ego_max	0.0792810070899225
sim_compute_robot_state-ego_mean	0.07572659526805871
sim_compute_robot_state-ego_median	0.07577533274888992
sim_compute_robot_state-ego_min	0.07201845305306571
sim_compute_robot_state-npc0_max	0.0747543893834596
sim_compute_robot_state-npc0_mean	0.07137216608960725
sim_compute_robot_state-npc0_median	0.0726391810637254
sim_compute_robot_state-npc0_min	0.06596843401590984
sim_compute_robot_state-npc1_max	0.07350768148899078
sim_compute_robot_state-npc1_mean	0.07122736133765327
sim_compute_robot_state-npc1_median	0.07085325012744313
sim_compute_robot_state-npc1_min	0.06978980700174968
sim_compute_robot_state-npc2_max	0.07420600101511965
sim_compute_robot_state-npc2_mean	0.07100763825089555
sim_compute_robot_state-npc2_median	0.07081571966409683
sim_compute_robot_state-npc2_min	0.06770663034348261
sim_compute_robot_state-npc3_max	0.07213827967643738
sim_compute_robot_state-npc3_mean	0.07122794761439728
sim_compute_robot_state-npc3_median	0.0709845507016746
sim_compute_robot_state-npc3_min	0.07011556625366211
sim_compute_sim_state_max	0.04180564931643906
sim_compute_sim_state_mean	0.04100024340220484
sim_compute_sim_state_median	0.04130175709724426
sim_compute_sim_state_min	0.04003007595355694
sim_physics_max	0.20334953986681423
sim_physics_mean	0.18824729733264617
sim_physics_median	0.18926947347579465
sim_physics_min	0.16790470942645006
sim_render-ego_max	0.06398701667785645
sim_render-ego_mean	0.06282477630842638
sim_render-ego_median	0.06313011737970206
sim_render-ego_min	0.060373328980945405
simulation-passed	1
survival_time_max	4.6499999999999915
survival_time_mean	2.6899999999999973
survival_time_min	1.0500000000000005

No reset possible

22896

2557

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 03:46:24+00:00

2019-05-17 03:47:01+00:00

0:00:37

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22866

2608

Konstantin Chaika

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LFV-sim-testing

step1-simulation

success

yes

ip-172-31-38-104-25436

2019-05-17 03:20:07+00:00

2019-05-17 03:46:15+00:00

0:26:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.30314311735235044
survival_time_median	2.6499999999999986
deviation-center-line_median	0.1192462800776758
in-drivable-lane_median	0.9499999999999966

other stats

agent_compute-ego_max	0.07598071373425998
agent_compute-ego_mean	0.07157388914380029
agent_compute-ego_median	0.07181255022684734
agent_compute-ego_min	0.06586734921324487
deviation-center-line_max	0.2294363663374862
deviation-center-line_mean	0.12653708755488874
deviation-center-line_min	0.06426934298501713
deviation-heading_max	0.6986268167330368
deviation-heading_mean	0.44799520296706863
deviation-heading_median	0.41847631252347706
deviation-heading_min	0.2596285487829774
driven_any_max	1.599733354117788
driven_any_mean	0.8095342605803044
driven_any_median	0.7336463183586153
driven_any_min	0.26903550091980144
driven_lanedir_consec_max	1.021002447119848
driven_lanedir_consec_mean	0.448904809024379
driven_lanedir_consec_min	0.2407721645627201
driven_lanedir_max	1.021002447119848
driven_lanedir_mean	0.448904809024379
driven_lanedir_median	0.30314311735235044
driven_lanedir_min	0.2407721645627201
in-drivable-lane_max	4.799999999999986
in-drivable-lane_mean	1.1466666666666634
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.17790579460036587, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06599681813951949, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07527728147909675, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.10218494039186288, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.041508983558332414, "sim_compute_performance-ego": 0.07322247263411401, "sim_compute_robot_state-ego": 0.08121262469761809, "sim_compute_robot_state-npc0": 0.07128298114722884, "sim_compute_robot_state-npc1": 0.07164493413038657, "sim_compute_robot_state-npc2": 0.07118532019601741, "sim_compute_robot_state-npc3": 0.0698850154876709}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.1969302743673325, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.06070700287818909, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.069203220307827, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.09782613813877106, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.04052477329969406, "sim_compute_performance-ego": 0.06818988919258118, "sim_compute_robot_state-ego": 0.07434327900409698, "sim_compute_robot_state-npc0": 0.06914889067411423, "sim_compute_robot_state-npc1": 0.06941241770982742, "sim_compute_robot_state-npc2": 0.06752005964517593, "sim_compute_robot_state-npc3": 0.07101272791624069}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.20366047437374407, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.06709105234879714, "in-drivable-lane": 0, "agent_compute-ego": 0.07598071373425998, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.10007033898280215, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.04040709825662466, "sim_compute_performance-ego": 0.0750968731366671, "sim_compute_robot_state-ego": 0.08269796921656682, "sim_compute_robot_state-npc0": 0.07210063017331637, "sim_compute_robot_state-npc1": 0.07029875425192025, "sim_compute_robot_state-npc2": 0.07320343072597797, "sim_compute_robot_state-npc3": 0.07333630781907302}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.19285789869164907, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.06403279048140331, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07181255022684734, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.09942010141188098, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.04061746084561912, "sim_compute_performance-ego": 0.07199180767100344, "sim_compute_robot_state-ego": 0.0763579773646529, "sim_compute_robot_state-npc0": 0.07097344757408224, "sim_compute_robot_state-npc1": 0.07114245045569635, "sim_compute_robot_state-npc2": 0.07030116870839109, "sim_compute_robot_state-npc3": 0.0708130072521907}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.1621681395031157, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.06505999110993885, "in-drivable-lane": 0, "agent_compute-ego": 0.06932466370718819, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.09251716023399716, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.03537971632821219, "sim_compute_performance-ego": 0.067108949025472, "sim_compute_robot_state-ego": 0.06542071842011951, "sim_compute_robot_state-npc0": 0.06712694395156134, "sim_compute_robot_state-npc1": 0.06346086093357631, "sim_compute_robot_state-npc2": 0.0670271600995745, "sim_compute_robot_state-npc3": 0.0635772773197719}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.599733354117788, "sim_physics": 0.1563308948327687, "survival_time": 6.0499999999999865, "driven_lanedir": 0.26415979567759074, "sim_render-ego": 0.06505114973084, "in-drivable-lane": 4.799999999999986, "agent_compute-ego": 0.06767090490041686, "deviation-heading": 0.39392468133084674, "set_robot_commands": 0.0858512456752052, "deviation-center-line": 0.1277842828221673, "driven_lanedir_consec": 0.26415979567759074, "sim_compute_sim_state": 0.035458489883044536, "sim_compute_performance-ego": 0.061369141271291686, "sim_compute_robot_state-ego": 0.06663859974254262, "sim_compute_robot_state-npc0": 0.06273405611022445, "sim_compute_robot_state-npc1": 0.06289172172546387, "sim_compute_robot_state-npc2": 0.06169039749902142, "sim_compute_robot_state-npc3": 0.0611401687968861}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0951392646085512, "sim_physics": 0.16973566157477243, "survival_time": 4.199999999999993, "driven_lanedir": 0.5659790827231905, "sim_render-ego": 0.06095896732239496, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.07458756083533877, "deviation-heading": 0.5971215168818823, "set_robot_commands": 0.1009211568605332, "deviation-center-line": 0.11288019725884578, "driven_lanedir_consec": 0.5659790827231905, "sim_compute_sim_state": 0.03830744822820028, "sim_compute_performance-ego": 0.06979384876432873, "sim_compute_robot_state-ego": 0.07384598538989112, "sim_compute_robot_state-npc0": 0.0677955633118039, "sim_compute_robot_state-npc1": 0.06839470636276972, "sim_compute_robot_state-npc2": 0.06855923788888114, "sim_compute_robot_state-npc3": 0.07066713344483148}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0452441176451972, "sim_physics": 0.1913647426141275, "survival_time": 3.699999999999995, "driven_lanedir": 1.021002447119848, "sim_render-ego": 0.06608001605884449, "in-drivable-lane": 0, "agent_compute-ego": 0.07544406362482019, "deviation-heading": 0.6206310196168163, "set_robot_commands": 0.10026367934974464, "deviation-center-line": 0.14363020423695483, "driven_lanedir_consec": 1.021002447119848, "sim_compute_sim_state": 0.04097475554492023, "sim_compute_performance-ego": 0.06947028314745105, "sim_compute_robot_state-ego": 0.07662349133878141, "sim_compute_robot_state-npc0": 0.07509284083907669, "sim_compute_robot_state-npc1": 0.07568524012694487, "sim_compute_robot_state-npc2": 0.0721378551947104, "sim_compute_robot_state-npc3": 0.07242814270225731}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0535850482576197, "sim_physics": 0.1726762851079305, "survival_time": 3.599999999999995, "driven_lanedir": 0.30314311735235044, "sim_render-ego": 0.06385178367296855, "in-drivable-lane": 2.2999999999999945, "agent_compute-ego": 0.06971031096246508, "deviation-heading": 0.40636604380954594, "set_robot_commands": 0.09917943345175848, "deviation-center-line": 0.10907487511555897, "driven_lanedir_consec": 0.30314311735235044, "sim_compute_sim_state": 0.03764798574977451, "sim_compute_performance-ego": 0.06784274843004015, "sim_compute_robot_state-ego": 0.07644206947750515, "sim_compute_robot_state-npc0": 0.07157939672470093, "sim_compute_robot_state-npc1": 0.07018242941962348, "sim_compute_robot_state-npc2": 0.07035383250978258, "sim_compute_robot_state-npc3": 0.06835058662626478}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.4799799001882503, "sim_physics": 0.22602363835985417, "survival_time": 5.349999999999989, "driven_lanedir": 0.5481518397312493, "sim_render-ego": 0.06446901214457004, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.07424623052650522, "deviation-heading": 0.5514444521435958, "set_robot_commands": 0.10175731694586924, "deviation-center-line": 0.10072735470855042, "driven_lanedir_consec": 0.5481518397312493, "sim_compute_sim_state": 0.03882212282341217, "sim_compute_performance-ego": 0.07343430385411343, "sim_compute_robot_state-ego": 0.07976296237695997, "sim_compute_robot_state-npc0": 0.07008897478335371, "sim_compute_robot_state-npc1": 0.07167925567270439, "sim_compute_robot_state-npc2": 0.0713164383005873, "sim_compute_robot_state-npc3": 0.0715497453636098}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.29610946631760215, "sim_physics": 0.20917342327259209, "survival_time": 1.3500000000000003, "driven_lanedir": 0.27060744077321397, "sim_render-ego": 0.061451964908176, "in-drivable-lane": 0, "agent_compute-ego": 0.0708331443645336, "deviation-heading": 0.5373504765871612, "set_robot_commands": 0.09875242798416704, "deviation-center-line": 0.08269292286428997, "driven_lanedir_consec": 0.27060744077321397, "sim_compute_sim_state": 0.0371595753563775, "sim_compute_performance-ego": 0.06567626529269749, "sim_compute_robot_state-ego": 0.071870900966503, "sim_compute_robot_state-npc0": 0.07151754697163899, "sim_compute_robot_state-npc1": 0.07321791295652036, "sim_compute_robot_state-npc2": 0.07210534590261954, "sim_compute_robot_state-npc3": 0.06945041373923973}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.27791471406425977, "sim_physics": 0.1770508861541748, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2638710416011838, "sim_render-ego": 0.0661042308807373, "in-drivable-lane": 0, "agent_compute-ego": 0.07245863914489746, "deviation-heading": 0.3105689945980953, "set_robot_commands": 0.1010330295562744, "deviation-center-line": 0.1192462800776758, "driven_lanedir_consec": 0.2638710416011838, "sim_compute_sim_state": 0.038801956176757815, "sim_compute_performance-ego": 0.06499267578125, "sim_compute_robot_state-ego": 0.07016545295715332, "sim_compute_robot_state-npc0": 0.07524209976196289, "sim_compute_robot_state-npc1": 0.07222199440002441, "sim_compute_robot_state-npc2": 0.07155335426330567, "sim_compute_robot_state-npc3": 0.07196145057678223}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7174039891727135, "sim_physics": 0.17776868028460807, "survival_time": 2.6499999999999986, "driven_lanedir": 0.29766819613667395, "sim_render-ego": 0.062206713658458784, "in-drivable-lane": 1.249999999999998, "agent_compute-ego": 0.0737289752600328, "deviation-heading": 0.3122593881578996, "set_robot_commands": 0.1030506412937956, "deviation-center-line": 0.14209620948179827, "driven_lanedir_consec": 0.29766819613667395, "sim_compute_sim_state": 0.0390731118760019, "sim_compute_performance-ego": 0.06925577037739304, "sim_compute_robot_state-ego": 0.07704734352399718, "sim_compute_robot_state-npc0": 0.0664913609342755, "sim_compute_robot_state-npc1": 0.06528207491028984, "sim_compute_robot_state-npc2": 0.06859666896316241, "sim_compute_robot_state-npc3": 0.06786111165892403}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3170173854101942, "sim_physics": 0.20063021106104695, "survival_time": 1.5500000000000007, "driven_lanedir": 0.30712670008511367, "sim_render-ego": 0.0634944362025107, "in-drivable-lane": 0, "agent_compute-ego": 0.06746272886953046, "deviation-heading": 0.2996283459319333, "set_robot_commands": 0.09710262667748236, "deviation-center-line": 0.13363659833059607, "driven_lanedir_consec": 0.30712670008511367, "sim_compute_sim_state": 0.04135862473518618, "sim_compute_performance-ego": 0.07061746812635852, "sim_compute_robot_state-ego": 0.07818825014175908, "sim_compute_robot_state-npc0": 0.06498882078355359, "sim_compute_robot_state-npc1": 0.06445282505404565, "sim_compute_robot_state-npc2": 0.06637400196444604, "sim_compute_robot_state-npc3": 0.0732005565397201}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6739360049522848, "sim_physics": 0.19378946809207692, "survival_time": 2.549999999999999, "driven_lanedir": 0.27812483555624423, "sim_render-ego": 0.05650463758730421, "in-drivable-lane": 1.2499999999999984, "agent_compute-ego": 0.06586734921324487, "deviation-heading": 0.550481042305602, "set_robot_commands": 0.11454082470314177, "deviation-center-line": 0.07768321004180687, "driven_lanedir_consec": 0.27812483555624423, "sim_compute_sim_state": 0.03850349257974064, "sim_compute_performance-ego": 0.06301177249235265, "sim_compute_robot_state-ego": 0.06696006363513422, "sim_compute_robot_state-npc0": 0.06522477374357336, "sim_compute_robot_state-npc1": 0.09332939222747204, "sim_compute_robot_state-npc2": 0.06262338395212211, "sim_compute_robot_state-npc3": 0.06244872598087087}}
set_robot_commands_max	0.11454082470314177
set_robot_commands_mean	0.09963140411048577
set_robot_commands_median	0.10007033898280215
set_robot_commands_min	0.0858512456752052
sim_compute_performance-ego_max	0.0750968731366671
sim_compute_performance-ego_mean	0.06873828461314097
sim_compute_performance-ego_median	0.06925577037739304
sim_compute_performance-ego_min	0.061369141271291686
sim_compute_robot_state-ego_max	0.08269796921656682
sim_compute_robot_state-ego_mean	0.07450517921688543
sim_compute_robot_state-ego_median	0.0763579773646529
sim_compute_robot_state-ego_min	0.06542071842011951
sim_compute_robot_state-npc0_max	0.07524209976196289
sim_compute_robot_state-npc0_mean	0.06942588849896447
sim_compute_robot_state-npc0_median	0.07008897478335371
sim_compute_robot_state-npc0_min	0.06273405611022445
sim_compute_robot_state-npc1_max	0.09332939222747204
sim_compute_robot_state-npc1_mean	0.07088646468915104
sim_compute_robot_state-npc1_median	0.07029875425192025
sim_compute_robot_state-npc1_min	0.06289172172546387
sim_compute_robot_state-npc2_max	0.07320343072597797
sim_compute_robot_state-npc2_mean	0.06896984372091837
sim_compute_robot_state-npc2_median	0.07030116870839109
sim_compute_robot_state-npc2_min	0.06169039749902142
sim_compute_robot_state-npc3_max	0.07333630781907302
sim_compute_robot_state-npc3_mean	0.06917882474828892
sim_compute_robot_state-npc3_median	0.07066713344483148
sim_compute_robot_state-npc3_min	0.0611401687968861
sim_compute_sim_state_max	0.041508983558332414
sim_compute_sim_state_mean	0.03896970634945987
sim_compute_sim_state_median	0.03882212282341217
sim_compute_sim_state_min	0.03537971632821219
sim_physics_max	0.22602363835985417
sim_physics_mean	0.18720443152601063
sim_physics_median	0.1913647426141275
sim_physics_min	0.1563308948327687
sim_render-ego_max	0.06709105234879714
sim_render-ego_mean	0.06353737114164353
sim_render-ego_median	0.06403279048140331
sim_render-ego_min	0.05650463758730421
simulation-passed	1
survival_time_max	6.0499999999999865
survival_time_mean	3.046666666666663
survival_time_min	1.0500000000000005

No reset possible

22861

2617

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-25436

2019-05-17 03:13:47+00:00

2019-05-17 03:19:53+00:00

0:06:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.1811964511871338
agent_compute-ego_mean	0.16299136576712098
agent_compute-ego_median	0.15954547458224827
agent_compute-ego_min	0.1551376417571423
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11171599670692726, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06467902660369873, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15954547458224827, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.1004607809914483, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.040539414794356736, "sim_compute_performance-ego": 0.07129705393755878, "sim_compute_robot_state-ego": 0.07973128777963144}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11917340521718942, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.060784470801259954, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1551376417571423, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09917072688832004, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04001842760572247, "sim_compute_performance-ego": 0.07003413462171368, "sim_compute_robot_state-ego": 0.07471105631660013}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.12535534185521743, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07055836565354291, "in-drivable-lane": 0, "agent_compute-ego": 0.1811964511871338, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.11221962816574994, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.043404284645529354, "sim_compute_performance-ego": 0.07204386767219095, "sim_compute_robot_state-ego": 0.08334067288567037}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.12082608222961426, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06257658958435058, "in-drivable-lane": 0, "agent_compute-ego": 0.1621165657043457, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09061009407043458, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.037924585342407224, "sim_compute_performance-ego": 0.07156325340270996, "sim_compute_robot_state-ego": 0.06723594665527344}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11690500114537491, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06735065617138826, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.15696069560473477, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09913440595699262, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04034721096859702, "sim_compute_performance-ego": 0.06778946405724634, "sim_compute_robot_state-ego": 0.07527373410478423}}
set_robot_commands_max	0.11221962816574994
set_robot_commands_mean	0.10031912721458908
set_robot_commands_median	0.09917072688832004
set_robot_commands_min	0.09061009407043458
sim_compute_performance-ego_max	0.07204386767219095
sim_compute_performance-ego_mean	0.07054555473828394
sim_compute_performance-ego_median	0.07129705393755878
sim_compute_performance-ego_min	0.06778946405724634
sim_compute_robot_state-ego_max	0.08334067288567037
sim_compute_robot_state-ego_mean	0.07605853954839192
sim_compute_robot_state-ego_median	0.07527373410478423
sim_compute_robot_state-ego_min	0.06723594665527344
sim_compute_sim_state_max	0.043404284645529354
sim_compute_sim_state_mean	0.04044678467132256
sim_compute_sim_state_median	0.04034721096859702
sim_compute_sim_state_min	0.037924585342407224
sim_physics_max	0.12535534185521743
sim_physics_mean	0.11879516543086466
sim_physics_median	0.11917340521718942
sim_physics_min	0.11171599670692726
sim_render-ego_max	0.07055836565354291
sim_render-ego_mean	0.06518982176284809
sim_render-ego_median	0.06467902660369873
sim_render-ego_min	0.060784470801259954
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

22855

2625

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

aido2-LFVI-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-25436

2019-05-17 03:03:59+00:00

2019-05-17 03:13:38+00:00

0:09:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.16266158719857535
agent_compute-ego_mean	0.15034973373759572
agent_compute-ego_median	0.1529214722769601
agent_compute-ego_min	0.13102327925818308
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.13547481992266058
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314897
deviation-heading_mean	0.49959867397150787
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000694
driven_any_mean	1.1068208197848532
driven_any_median	0.9410513078477724
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.826231945363564
driven_lanedir_consec_mean	0.804744013449103
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.826231945363564
driven_lanedir_mean	0.804828147320482
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.20836124239088613, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06484607805179644, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15527279769318014, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09688771525515784, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.04012216797357873, "sim_compute_performance-ego": 0.07154659983478015, "sim_compute_robot_state-ego": 0.07601306106470808, "sim_compute_robot_state-npc0": 0.07148981094360352, "sim_compute_robot_state-npc1": 0.07322679592084282, "sim_compute_robot_state-npc2": 0.06930153882956203, "sim_compute_robot_state-npc3": 0.06997405426411689}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.1573260256222316, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.05101928540638515, "in-drivable-lane": 0, "agent_compute-ego": 0.13102327925818308, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.07882205077580043, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.032162300177982876, "sim_compute_performance-ego": 0.052779563835689, "sim_compute_robot_state-ego": 0.058325733457292826, "sim_compute_robot_state-npc0": 0.05826860666275024, "sim_compute_robot_state-npc1": 0.054249107837677, "sim_compute_robot_state-npc2": 0.0617557338305882, "sim_compute_robot_state-npc3": 0.05353937830243792}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.1935065070402275, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06003514539848254, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14986953226107996, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.09574630885448272, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.038156849666706565, "sim_compute_performance-ego": 0.06762054360028609, "sim_compute_robot_state-ego": 0.07325616855065799, "sim_compute_robot_state-npc0": 0.06785619837566487, "sim_compute_robot_state-npc1": 0.07091041213100396, "sim_compute_robot_state-npc2": 0.06681208008701361, "sim_compute_robot_state-npc3": 0.066977218516822}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2415866504112879, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06595099965731303, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.16266158719857535, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.10127607981363931, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03903608520825704, "sim_compute_performance-ego": 0.072536105910937, "sim_compute_robot_state-ego": 0.08166064818700154, "sim_compute_robot_state-npc0": 0.07286717494328816, "sim_compute_robot_state-npc1": 0.07142981886863708, "sim_compute_robot_state-npc2": 0.0697359840075175, "sim_compute_robot_state-npc3": 0.07062114775180817}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1994596549442836, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06284428778148833, "in-drivable-lane": 0, "agent_compute-ego": 0.1529214722769601, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.10077248300824848, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.04088632265726725, "sim_compute_performance-ego": 0.07030359903971355, "sim_compute_robot_state-ego": 0.07456142561776298, "sim_compute_robot_state-npc0": 0.07103270576113746, "sim_compute_robot_state-npc1": 0.07378513472420829, "sim_compute_robot_state-npc2": 0.07186973662603469, "sim_compute_robot_state-npc3": 0.07127397400992257}}
set_robot_commands_max	0.10127607981363931
set_robot_commands_mean	0.09470092754146577
set_robot_commands_median	0.09688771525515784
set_robot_commands_min	0.07882205077580043
sim_compute_performance-ego_max	0.072536105910937
sim_compute_performance-ego_mean	0.06695728244428116
sim_compute_performance-ego_median	0.07030359903971355
sim_compute_performance-ego_min	0.052779563835689
sim_compute_robot_state-ego_max	0.08166064818700154
sim_compute_robot_state-ego_mean	0.07276340737548467
sim_compute_robot_state-ego_median	0.07456142561776298
sim_compute_robot_state-ego_min	0.058325733457292826
sim_compute_robot_state-npc0_max	0.07286717494328816
sim_compute_robot_state-npc0_mean	0.06830289933728885
sim_compute_robot_state-npc0_median	0.07103270576113746
sim_compute_robot_state-npc0_min	0.05826860666275024
sim_compute_robot_state-npc1_max	0.07378513472420829
sim_compute_robot_state-npc1_mean	0.06872025389647382
sim_compute_robot_state-npc1_median	0.07142981886863708
sim_compute_robot_state-npc1_min	0.054249107837677
sim_compute_robot_state-npc2_max	0.07186973662603469
sim_compute_robot_state-npc2_mean	0.0678950146761432
sim_compute_robot_state-npc2_median	0.06930153882956203
sim_compute_robot_state-npc2_min	0.0617557338305882
sim_compute_robot_state-npc3_max	0.07127397400992257
sim_compute_robot_state-npc3_mean	0.06647715456902151
sim_compute_robot_state-npc3_median	0.06997405426411689
sim_compute_robot_state-npc3_min	0.05353937830243792
sim_compute_sim_state_max	0.04088632265726725
sim_compute_sim_state_mean	0.0380727451367585
sim_compute_sim_state_median	0.03903608520825704
sim_compute_sim_state_min	0.032162300177982876
sim_physics_max	0.2415866504112879
sim_physics_mean	0.20004801608178333
sim_physics_median	0.1994596549442836
sim_physics_min	0.1573260256222316
sim_render-ego_max	0.06595099965731303
sim_render-ego_mean	0.0609391592590931
sim_render-ego_median	0.06284428778148833
sim_render-ego_min	0.05101928540638515
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

22839

2657

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 02:44:51+00:00

2019-05-17 03:03:16+00:00

0:18:25

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22837

2665

Rami Al-Naim 🇷🇺

Modidfied config

aido2-LF-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 02:43:35+00:00

2019-05-17 02:44:13+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22835

2669

Rami Al-Naim 🇷🇺

Modidfied config

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 02:42:47+00:00

2019-05-17 02:43:28+00:00

0:00:41

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22820

2695

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

aido2-LFV-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-25436

2019-05-17 02:08:08+00:00

2019-05-17 02:40:54+00:00

0:32:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9610795312415754
survival_time_median	9.45
deviation-center-line_median	0.5348310604710581
in-drivable-lane_median	0.2499999999999991

other stats

agent_compute-ego_max	0.10250977675120036
agent_compute-ego_mean	0.09671888396916568
agent_compute-ego_median	0.094945600827535
agent_compute-ego_min	0.09352538108825684
deviation-center-line_max	1.1012172250964996
deviation-center-line_mean	0.6687496131229519
deviation-center-line_min	0.30116006899187303
deviation-heading_max	6.931034191218573
deviation-heading_mean	3.870927690903215
deviation-heading_median	2.8441969762475727
deviation-heading_min	1.4433360005402749
driven_any_max	2.348862066253963
driven_any_mean	1.5869479903088886
driven_any_median	1.465012154529943
driven_any_min	0.5723469732840017
driven_lanedir_consec_max	2.0828140489109273
driven_lanedir_consec_mean	1.0766431140521635
driven_lanedir_consec_min	0.46851368412724925
driven_lanedir_max	2.0828140489109273
driven_lanedir_mean	1.1458209933161416
driven_lanedir_median	1.0910179472978878
driven_lanedir_min	0.46851368412724925
in-drivable-lane_max	3.70000000000001
in-drivable-lane_mean	1.4900000000000042
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5723469732840017, "sim_physics": 0.24818537533283233, "survival_time": 3.999999999999994, "driven_lanedir": 0.46851368412724925, "sim_render-ego": 0.07830760180950165, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.09851055443286896, "deviation-heading": 1.4433360005402749, "set_robot_commands": 0.13371923565864563, "deviation-center-line": 0.30116006899187303, "driven_lanedir_consec": 0.46851368412724925, "sim_compute_sim_state": 0.04880336821079254, "sim_compute_performance-ego": 0.08769749402999878, "sim_compute_robot_state-ego": 0.10355721414089204, "sim_compute_robot_state-npc0": 0.08873523473739624, "sim_compute_robot_state-npc1": 0.08707996308803559, "sim_compute_robot_state-npc2": 0.08527807593345642, "sim_compute_robot_state-npc3": 0.08681955635547638}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.465012154529943, "sim_physics": 0.2435916428843503, "survival_time": 9.45, "driven_lanedir": 0.7797903586831767, "sim_render-ego": 0.07612128484816778, "in-drivable-lane": 3.350000000000013, "agent_compute-ego": 0.09410310674596715, "deviation-heading": 2.8441969762475727, "set_robot_commands": 0.12261841410682314, "deviation-center-line": 0.31634983472205064, "driven_lanedir_consec": 0.7797903586831767, "sim_compute_sim_state": 0.04604751849300647, "sim_compute_performance-ego": 0.08603922526041667, "sim_compute_robot_state-ego": 0.10051321857190006, "sim_compute_robot_state-npc0": 0.0857466806179632, "sim_compute_robot_state-npc1": 0.08567612133328877, "sim_compute_robot_state-npc2": 0.08474315537346734, "sim_compute_robot_state-npc3": 0.08642233742607965}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.348862066253963, "sim_physics": 0.2338076400756836, "survival_time": 14.950000000000076, "driven_lanedir": 2.0828140489109273, "sim_render-ego": 0.07789263566335042, "in-drivable-lane": 0, "agent_compute-ego": 0.094945600827535, "deviation-heading": 5.975064417581533, "set_robot_commands": 0.12253775119781496, "deviation-center-line": 1.1012172250964996, "driven_lanedir_consec": 2.0828140489109273, "sim_compute_sim_state": 0.047439726988474526, "sim_compute_performance-ego": 0.08631606578826904, "sim_compute_robot_state-ego": 0.09869846979777018, "sim_compute_robot_state-npc0": 0.08396138509114583, "sim_compute_robot_state-npc1": 0.08365522464116415, "sim_compute_robot_state-npc2": 0.08408379554748535, "sim_compute_robot_state-npc3": 0.08503528118133545}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3485586125818445, "sim_physics": 0.23549894173940025, "survival_time": 14.950000000000076, "driven_lanedir": 1.306968927561467, "sim_render-ego": 0.07571255842844646, "in-drivable-lane": 3.70000000000001, "agent_compute-ego": 0.09352538108825684, "deviation-heading": 6.931034191218573, "set_robot_commands": 0.12489957809448242, "deviation-center-line": 1.0901898763332782, "driven_lanedir_consec": 0.9610795312415754, "sim_compute_sim_state": 0.04621693690617879, "sim_compute_performance-ego": 0.08418471733729045, "sim_compute_robot_state-ego": 0.09866856654485066, "sim_compute_robot_state-npc0": 0.08451938231786092, "sim_compute_robot_state-npc1": 0.08295609712600709, "sim_compute_robot_state-npc2": 0.08352339744567872, "sim_compute_robot_state-npc3": 0.08309133450190226}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.199960144894691, "sim_physics": 0.23194052775700888, "survival_time": 7.79999999999998, "driven_lanedir": 1.0910179472978878, "sim_render-ego": 0.07733278091137226, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.10250977675120036, "deviation-heading": 2.1610068689281268, "set_robot_commands": 0.12842466892340246, "deviation-center-line": 0.5348310604710581, "driven_lanedir_consec": 1.0910179472978878, "sim_compute_sim_state": 0.047752189330565624, "sim_compute_performance-ego": 0.08542900819044846, "sim_compute_robot_state-ego": 0.10062148632147372, "sim_compute_robot_state-npc0": 0.08829678938939022, "sim_compute_robot_state-npc1": 0.08712591421909821, "sim_compute_robot_state-npc2": 0.08578253556520511, "sim_compute_robot_state-npc3": 0.08731305140715379}}
set_robot_commands_max	0.13371923565864563
set_robot_commands_mean	0.1264399295962337
set_robot_commands_median	0.12489957809448242
set_robot_commands_min	0.12253775119781496
sim_compute_performance-ego_max	0.08769749402999878
sim_compute_performance-ego_mean	0.08593330212128468
sim_compute_performance-ego_median	0.08603922526041667
sim_compute_performance-ego_min	0.08418471733729045
sim_compute_robot_state-ego_max	0.10355721414089204
sim_compute_robot_state-ego_mean	0.10041179107537734
sim_compute_robot_state-ego_median	0.10051321857190006
sim_compute_robot_state-ego_min	0.09866856654485066
sim_compute_robot_state-npc0_max	0.08873523473739624
sim_compute_robot_state-npc0_mean	0.08625189443075129
sim_compute_robot_state-npc0_median	0.0857466806179632
sim_compute_robot_state-npc0_min	0.08396138509114583
sim_compute_robot_state-npc1_max	0.08712591421909821
sim_compute_robot_state-npc1_mean	0.08529866408151876
sim_compute_robot_state-npc1_median	0.08567612133328877
sim_compute_robot_state-npc1_min	0.08295609712600709
sim_compute_robot_state-npc2_max	0.08578253556520511
sim_compute_robot_state-npc2_mean	0.08468219197305858
sim_compute_robot_state-npc2_median	0.08474315537346734
sim_compute_robot_state-npc2_min	0.08352339744567872
sim_compute_robot_state-npc3_max	0.08731305140715379
sim_compute_robot_state-npc3_mean	0.08573631217438951
sim_compute_robot_state-npc3_median	0.08642233742607965
sim_compute_robot_state-npc3_min	0.08309133450190226
sim_compute_sim_state_max	0.04880336821079254
sim_compute_sim_state_mean	0.04725194798580359
sim_compute_sim_state_median	0.047439726988474526
sim_compute_sim_state_min	0.04604751849300647
sim_physics_max	0.24818537533283233
sim_physics_mean	0.23860482555785503
sim_physics_median	0.23549894173940025
sim_physics_min	0.23194052775700888
sim_render-ego_max	0.07830760180950165
sim_render-ego_mean	0.07707337233216771
sim_render-ego_median	0.07733278091137226
sim_render-ego_min	0.07571255842844646
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.230000000000029
survival_time_min	3.999999999999994

No reset possible

22807

2716

jiang peng

test for ppo

aido2-LF-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 02:06:07+00:00

2019-05-17 02:07:53+00:00

0:01:46

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22800

2735

Bhairav Mehta

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LFV-sim-validation

step1-simulation

failed

yes

ip-172-31-38-104-25436

2019-05-17 02:03:42+00:00

2019-05-17 02:05:25+00:00

0:01:43

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22795

2750

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

aido2-LFVI-sim-testing

step1-simulation

failed

yes

ip-172-31-38-104-25436

2019-05-17 02:00:54+00:00

2019-05-17 02:03:08+00:00

0:02:14

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22781

2770

Bhairav Mehta

challenge-aido_LF-baseline-duckietown

aido2-LFV-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 01:53:40+00:00

2019-05-17 02:00:40+00:00

0:07:00

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22775

2786

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 01:51:58+00:00

2019-05-17 01:52:40+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22772

2787

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LFVI-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 01:51:15+00:00

2019-05-17 01:51:50+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22756

2822

Liam Paull 🇨🇦

challenge-aido_LF-template-random

aido2-LFV-sim-testing

step1-simulation

success

yes

ip-172-31-38-104-25436

2019-05-17 01:27:17+00:00

2019-05-17 01:50:57+00:00

0:23:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.47061816984274774
survival_time_median	2.4499999999999993
deviation-center-line_median	0.09047885846140293
in-drivable-lane_median	0.7999999999999974

other stats

agent_compute-ego_max	0.17804396152496338
agent_compute-ego_mean	0.16134232074052346
agent_compute-ego_median	0.16489270977351975
agent_compute-ego_min	0.12738270418984549
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.11122054568266285
deviation-center-line_min	0.05649185041622204
deviation-heading_max	0.8583234710357402
deviation-heading_mean	0.371509805944231
deviation-heading_median	0.3477435217829391
deviation-heading_min	0.1892537419842091
driven_any_max	1.6169932854589035
driven_any_mean	0.8549136794030617
driven_any_median	0.9441796518284096
driven_any_min	0.28668385087664994
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.5622432991481365
driven_lanedir_consec_min	0.24216121529728207
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.5622432991481365
driven_lanedir_median	0.47061816984274774
driven_lanedir_min	0.24216121529728207
in-drivable-lane_max	1.3499999999999996
in-drivable-lane_mean	0.5899999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.18432490913956256, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.09406113624572754, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.17419473771695737, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.1078723050929882, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04122885951289424, "sim_compute_performance-ego": 0.0764017590770015, "sim_compute_robot_state-ego": 0.0818281924283063, "sim_compute_robot_state-npc0": 0.07437475522359212, "sim_compute_robot_state-npc1": 0.07866052786509196, "sim_compute_robot_state-npc2": 0.0755544900894165, "sim_compute_robot_state-npc3": 0.07629237351594148}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.2217206478118897, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.0723819923400879, "in-drivable-lane": 0, "agent_compute-ego": 0.1710111141204834, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.10460871696472168, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.04781355857849121, "sim_compute_performance-ego": 0.07596755027770996, "sim_compute_robot_state-ego": 0.08548420906066895, "sim_compute_robot_state-npc0": 0.07493066787719727, "sim_compute_robot_state-npc1": 0.07528391838073731, "sim_compute_robot_state-npc2": 0.07781516075134277, "sim_compute_robot_state-npc3": 0.08285624504089356}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.19450183918601588, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06921499967575073, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.16622257546374672, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.1055918994702791, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.042517743612590586, "sim_compute_performance-ego": 0.07700797444895695, "sim_compute_robot_state-ego": 0.08236294357400191, "sim_compute_robot_state-npc0": 0.07972167981298346, "sim_compute_robot_state-npc1": 0.07643724115271318, "sim_compute_robot_state-npc2": 0.07736216407073171, "sim_compute_robot_state-npc3": 0.08203672107897307}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.22430556031722057, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.07123112074936493, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1765969403182404, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.10972868641720544, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.042533572716049, "sim_compute_performance-ego": 0.0779858721962458, "sim_compute_robot_state-ego": 0.08834710000436517, "sim_compute_robot_state-npc0": 0.07677173010910614, "sim_compute_robot_state-npc1": 0.07735657088364227, "sim_compute_robot_state-npc2": 0.07508740244032461, "sim_compute_robot_state-npc3": 0.07631780226019365}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.15033882004874094, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05292353459766933, "in-drivable-lane": 0, "agent_compute-ego": 0.12738270418984549, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.07937862191881452, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.031051933765411377, "sim_compute_performance-ego": 0.05757501295634678, "sim_compute_robot_state-ego": 0.06619958366666522, "sim_compute_robot_state-npc0": 0.06089659248079572, "sim_compute_robot_state-npc1": 0.05797089849199567, "sim_compute_robot_state-npc2": 0.05777186155319214, "sim_compute_robot_state-npc3": 0.05906363895961216}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.1414017544852363, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.0918467398043032, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.13761175561834266, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.0869012232179995, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.03278636932373047, "sim_compute_performance-ego": 0.05812780503873472, "sim_compute_robot_state-ego": 0.0618477220888491, "sim_compute_robot_state-npc0": 0.06155445399107756, "sim_compute_robot_state-npc1": 0.061987051257380736, "sim_compute_robot_state-npc2": 0.0581010933275576, "sim_compute_robot_state-npc3": 0.05880141699755633}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.18117505974239773, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.06514152774104366, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.15900099277496338, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.10398834281497532, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.038610957286976, "sim_compute_performance-ego": 0.06806243790520562, "sim_compute_robot_state-ego": 0.07789606518215603, "sim_compute_robot_state-npc0": 0.07499674514487938, "sim_compute_robot_state-npc1": 0.07260073555840386, "sim_compute_robot_state-npc2": 0.07125764864462393, "sim_compute_robot_state-npc3": 0.06976822129002323}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.25350616772969564, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.06590144369337293, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.16924878756205242, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.10284892717997234, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.04281474219428168, "sim_compute_performance-ego": 0.07933618227640787, "sim_compute_robot_state-ego": 0.08404492802090115, "sim_compute_robot_state-npc0": 0.07747004297044542, "sim_compute_robot_state-npc1": 0.07918969790140788, "sim_compute_robot_state-npc2": 0.07726577123006186, "sim_compute_robot_state-npc3": 0.07257379425896539}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.1945751490800277, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.07238949900088103, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.16489270977351975, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.10486426560775092, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.04221529027690058, "sim_compute_performance-ego": 0.07407817633255669, "sim_compute_robot_state-ego": 0.0798185856445976, "sim_compute_robot_state-npc0": 0.0741314058718474, "sim_compute_robot_state-npc1": 0.07539461488309114, "sim_compute_robot_state-npc2": 0.07457460009533426, "sim_compute_robot_state-npc3": 0.07397917560909105}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.21322027683258055, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.06446676254272461, "in-drivable-lane": 0, "agent_compute-ego": 0.1575537157058716, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.1037330961227417, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.04201097011566162, "sim_compute_performance-ego": 0.07272381305694581, "sim_compute_robot_state-ego": 0.07660789489746093, "sim_compute_robot_state-npc0": 0.07445834159851074, "sim_compute_robot_state-npc1": 0.0708820104598999, "sim_compute_robot_state-npc2": 0.07253391742706299, "sim_compute_robot_state-npc3": 0.07274217128753663}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.23273856639862064, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.07029606103897094, "in-drivable-lane": 0, "agent_compute-ego": 0.17087869644165038, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.11405445337295532, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.04327456951141358, "sim_compute_performance-ego": 0.08075703382492065, "sim_compute_robot_state-ego": 0.07866243124008179, "sim_compute_robot_state-npc0": 0.0745125651359558, "sim_compute_robot_state-npc1": 0.07960749864578247, "sim_compute_robot_state-npc2": 0.07425998449325562, "sim_compute_robot_state-npc3": 0.07298808097839356}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.19740325526187297, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.06908423022220009, "in-drivable-lane": 0, "agent_compute-ego": 0.16184341280083908, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.1043297617059005, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.04412829248528732, "sim_compute_performance-ego": 0.07556896460683722, "sim_compute_robot_state-ego": 0.08212773423445852, "sim_compute_robot_state-npc0": 0.07696339958592464, "sim_compute_robot_state-npc1": 0.07180533911052503, "sim_compute_robot_state-npc2": 0.07611998758817974, "sim_compute_robot_state-npc3": 0.07406539666025262}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.1879551649093628, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.06495951652526856, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.17804396152496338, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.10969108581542968, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.04318830966949463, "sim_compute_performance-ego": 0.07832196712493897, "sim_compute_robot_state-ego": 0.0826219892501831, "sim_compute_robot_state-npc0": 0.07680761337280273, "sim_compute_robot_state-npc1": 0.07668012142181396, "sim_compute_robot_state-npc2": 0.07519168376922608, "sim_compute_robot_state-npc3": 0.07417574405670166}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.24295217340642755, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.0700564601204612, "in-drivable-lane": 0, "agent_compute-ego": 0.16327286850322376, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.1049966812133789, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.04421794414520264, "sim_compute_performance-ego": 0.07886907187375156, "sim_compute_robot_state-ego": 0.07887324419888583, "sim_compute_robot_state-npc0": 0.0759681138125333, "sim_compute_robot_state-npc1": 0.06989536502144554, "sim_compute_robot_state-npc2": 0.07487557151100853, "sim_compute_robot_state-npc3": 0.07314776290546764}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.18940251700732172, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.05990849222455706, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.1423798385931521, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.08830860682896205, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.036712179378587374, "sim_compute_performance-ego": 0.0641657576269033, "sim_compute_robot_state-ego": 0.06916449994457011, "sim_compute_robot_state-npc0": 0.062023824574996014, "sim_compute_robot_state-npc1": 0.06571797935330138, "sim_compute_robot_state-npc2": 0.06662825175694057, "sim_compute_robot_state-npc3": 0.06406708152926698}}
set_robot_commands_max	0.11405445337295532
set_robot_commands_mean	0.102059778249605
set_robot_commands_median	0.10460871696472168
set_robot_commands_min	0.07937862191881452
sim_compute_performance-ego_max	0.08075703382492065
sim_compute_performance-ego_mean	0.07299662524156421
sim_compute_performance-ego_median	0.07596755027770996
sim_compute_performance-ego_min	0.05757501295634678
sim_compute_robot_state-ego_max	0.08834710000436517
sim_compute_robot_state-ego_mean	0.07839247489574344
sim_compute_robot_state-ego_median	0.0798185856445976
sim_compute_robot_state-ego_min	0.0618477220888491
sim_compute_robot_state-npc0_max	0.07972167981298346
sim_compute_robot_state-npc0_mean	0.07303879543750984
sim_compute_robot_state-npc0_median	0.07493066787719727
sim_compute_robot_state-npc0_min	0.06089659248079572
sim_compute_robot_state-npc1_max	0.07960749864578247
sim_compute_robot_state-npc1_mean	0.07263130469248216
sim_compute_robot_state-npc1_median	0.07528391838073731
sim_compute_robot_state-npc1_min	0.05797089849199567
sim_compute_robot_state-npc2_max	0.07781516075134277
sim_compute_robot_state-npc2_mean	0.0722933059165506
sim_compute_robot_state-npc2_median	0.07487557151100853
sim_compute_robot_state-npc2_min	0.05777186155319214
sim_compute_robot_state-npc3_max	0.08285624504089356
sim_compute_robot_state-npc3_mean	0.07219170842859127
sim_compute_robot_state-npc3_median	0.07314776290546764
sim_compute_robot_state-npc3_min	0.05880141699755633
sim_compute_sim_state_max	0.04781355857849121
sim_compute_sim_state_mean	0.04100701950486482
sim_compute_sim_state_median	0.042517743612590586
sim_compute_sim_state_min	0.031051933765411377
sim_physics_max	0.25350616772969564
sim_physics_mean	0.2006347907571316
sim_physics_median	0.1945751490800277
sim_physics_min	0.1414017544852363
sim_render-ego_max	0.09406113624572754
sim_render-ego_mean	0.07025756776815892
sim_render-ego_median	0.06921499967575073
sim_render-ego_min	0.05292353459766933
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2366666666666655
survival_time_min	0.9500000000000004

No reset possible

22717

2908

Julian Zilly

Baseline-IL-logs-tensorflow

aido2-LFVI-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-25436

2019-05-17 01:00:57+00:00

2019-05-17 01:26:54+00:00

0:25:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.3409298277229755
survival_time_median	8.04999999999998
deviation-center-line_median	0.5103278674258119
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.2641640585296008
agent_compute-ego_mean	0.24861624744933525
agent_compute-ego_median	0.25395866562338437
agent_compute-ego_min	0.23328539420818464
deviation-center-line_max	1.068005975951497
deviation-center-line_mean	0.5190410035862187
deviation-center-line_min	0.17497068978210834
deviation-heading_max	0.9833929029998222
deviation-heading_mean	0.8274012119935247
deviation-heading_median	0.8527139166077414
deviation-heading_min	0.6524331044587797
driven_any_max	2.553475024775104
driven_any_mean	1.3777238580592794
driven_any_median	1.348024291469244
driven_any_min	0.36968771707772213
driven_lanedir_consec_max	2.319984631553871
driven_lanedir_consec_mean	1.242599273441558
driven_lanedir_consec_min	0.35661432194998266
driven_lanedir_max	2.3200102575826382
driven_lanedir_mean	1.242694699713852
driven_lanedir_median	1.3413559428451771
driven_lanedir_min	0.35661432194998266
in-drivable-lane_max	2.2000000000000313
in-drivable-lane_mean	0.70000000000001
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.348024291469244, "sim_physics": 0.2022931516540717, "survival_time": 8.04999999999998, "driven_lanedir": 1.3413559428451771, "sim_render-ego": 0.06322773939334088, "in-drivable-lane": 0, "agent_compute-ego": 0.2340443267585328, "deviation-heading": 0.7840706232299429, "set_robot_commands": 0.09470361063939443, "deviation-center-line": 0.5103278674258119, "driven_lanedir_consec": 1.3409298277229755, "sim_compute_sim_state": 0.03881514738805546, "sim_compute_performance-ego": 0.068331639959205, "sim_compute_robot_state-ego": 0.07152012564380716, "sim_compute_robot_state-npc0": 0.06922150694805643, "sim_compute_robot_state-npc1": 0.06833453208022977, "sim_compute_robot_state-npc2": 0.06851644249436278, "sim_compute_robot_state-npc3": 0.06982227734157018}, "udem1-1-0": {"driven_any": 0.448303843834458, "sim_physics": 0.21469199246373669, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4226838409112528, "sim_render-ego": 0.05994570255279541, "in-drivable-lane": 0, "agent_compute-ego": 0.23328539420818464, "deviation-heading": 0.9833929029998222, "set_robot_commands": 0.10504553646876894, "deviation-center-line": 0.2083847947879002, "driven_lanedir_consec": 0.4226838409112528, "sim_compute_sim_state": 0.04317945858527874, "sim_compute_performance-ego": 0.06994552858944597, "sim_compute_robot_state-ego": 0.07372817499884243, "sim_compute_robot_state-npc0": 0.069832234547056, "sim_compute_robot_state-npc1": 0.06996320444962074, "sim_compute_robot_state-npc2": 0.07194240750937626, "sim_compute_robot_state-npc3": 0.07270253115686877}, "udem1-2-0": {"driven_any": 2.1691284131398683, "sim_physics": 0.20791709750306372, "survival_time": 12.750000000000046, "driven_lanedir": 1.772809135280209, "sim_render-ego": 0.06650947963490206, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.25395866562338437, "deviation-heading": 0.8643955126713374, "set_robot_commands": 0.10325216031542012, "deviation-center-line": 0.6335156899837757, "driven_lanedir_consec": 1.772783745069709, "sim_compute_sim_state": 0.04087965815675025, "sim_compute_performance-ego": 0.0735168831021178, "sim_compute_robot_state-ego": 0.07939875453126197, "sim_compute_robot_state-npc0": 0.07405837844399844, "sim_compute_robot_state-npc1": 0.0732139736998315, "sim_compute_robot_state-npc2": 0.07304632242988138, "sim_compute_robot_state-npc3": 0.07423497274810192}, "udem1-3-0": {"driven_any": 2.553475024775104, "sim_physics": 0.21532156229019164, "survival_time": 14.950000000000076, "driven_lanedir": 2.3200102575826382, "sim_render-ego": 0.06630218187967936, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.2576287921269735, "deviation-heading": 0.8527139166077414, "set_robot_commands": 0.10845433076222738, "deviation-center-line": 1.068005975951497, "driven_lanedir_consec": 2.319984631553871, "sim_compute_sim_state": 0.0415227746963501, "sim_compute_performance-ego": 0.07377074241638183, "sim_compute_robot_state-ego": 0.08141256809234619, "sim_compute_robot_state-npc0": 0.07471463203430176, "sim_compute_robot_state-npc1": 0.07390512386957804, "sim_compute_robot_state-npc2": 0.07413098494211832, "sim_compute_robot_state-npc3": 0.07364471515019734}, "udem1-4-0": {"driven_any": 0.36968771707772213, "sim_physics": 0.2126080405955412, "survival_time": 2.4499999999999993, "driven_lanedir": 0.35661432194998266, "sim_render-ego": 0.07424893184584014, "in-drivable-lane": 0, "agent_compute-ego": 0.2641640585296008, "deviation-heading": 0.6524331044587797, "set_robot_commands": 0.11423541088493502, "deviation-center-line": 0.17497068978210834, "driven_lanedir_consec": 0.35661432194998266, "sim_compute_sim_state": 0.04378365497199856, "sim_compute_performance-ego": 0.07851992821206852, "sim_compute_robot_state-ego": 0.0803770045844876, "sim_compute_robot_state-npc0": 0.07787506920950753, "sim_compute_robot_state-npc1": 0.07758606210046885, "sim_compute_robot_state-npc2": 0.07549539877443898, "sim_compute_robot_state-npc3": 0.07567847991476254}}
set_robot_commands_max	0.11423541088493502
set_robot_commands_mean	0.1051382098141492
set_robot_commands_median	0.10504553646876894
set_robot_commands_min	0.09470361063939443
sim_compute_performance-ego_max	0.07851992821206852
sim_compute_performance-ego_mean	0.07281694445584382
sim_compute_performance-ego_median	0.0735168831021178
sim_compute_performance-ego_min	0.068331639959205
sim_compute_robot_state-ego_max	0.08141256809234619
sim_compute_robot_state-ego_mean	0.07728732557014907
sim_compute_robot_state-ego_median	0.07939875453126197
sim_compute_robot_state-ego_min	0.07152012564380716
sim_compute_robot_state-npc0_max	0.07787506920950753
sim_compute_robot_state-npc0_mean	0.07314036423658404
sim_compute_robot_state-npc0_median	0.07405837844399844
sim_compute_robot_state-npc0_min	0.06922150694805643
sim_compute_robot_state-npc1_max	0.07758606210046885
sim_compute_robot_state-npc1_mean	0.07260057923994578
sim_compute_robot_state-npc1_median	0.0732139736998315
sim_compute_robot_state-npc1_min	0.06833453208022977
sim_compute_robot_state-npc2_max	0.07549539877443898
sim_compute_robot_state-npc2_mean	0.07262631123003553
sim_compute_robot_state-npc2_median	0.07304632242988138
sim_compute_robot_state-npc2_min	0.06851644249436278
sim_compute_robot_state-npc3_max	0.07567847991476254
sim_compute_robot_state-npc3_mean	0.07321659526230015
sim_compute_robot_state-npc3_median	0.07364471515019734
sim_compute_robot_state-npc3_min	0.06982227734157018
sim_compute_sim_state_max	0.04378365497199856
sim_compute_sim_state_mean	0.04163613875968662
sim_compute_sim_state_median	0.0415227746963501
sim_compute_sim_state_min	0.03881514738805546
sim_physics_max	0.21532156229019164
sim_physics_mean	0.210566368901321
sim_physics_median	0.2126080405955412
sim_physics_min	0.2022931516540717
sim_render-ego_max	0.07424893184584014
sim_render-ego_mean	0.06604680706131157
sim_render-ego_median	0.06630218187967936
sim_render-ego_min	0.05994570255279541
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.220000000000022
survival_time_min	2.4499999999999993

No reset possible

22711

2924

Bhairav Mehta

challenge-aido_LF-template-pytorch

aido2-LFV-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 00:54:35+00:00

2019-05-17 01:00:16+00:00

0:05:41

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22697

2949

Bhairav Mehta

Baseline solution using reinforcement learning

aido2-LFV-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-25436

2019-05-17 00:46:02+00:00

2019-05-17 00:54:00+00:00

0:07:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.163604398982641
survival_time_median	1.5000000000000009
deviation-center-line_median	0.09579847314098731
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.18060112744569776
agent_compute-ego_mean	0.17177333173843531
agent_compute-ego_median	0.18000463644663492
agent_compute-ego_min	0.13946028550465903
deviation-center-line_max	0.13381802379655708
deviation-center-line_mean	0.10300460699497752
deviation-center-line_min	0.06601698356407831
deviation-heading_max	0.9971699705631802
deviation-heading_mean	0.67324594959502
deviation-heading_median	0.7111998506944579
deviation-heading_min	0.38395928010523667
driven_any_max	0.29274076716950953
driven_any_mean	0.2315392285052092
driven_any_median	0.23637186528415663
driven_any_min	0.17388732399702533
driven_lanedir_consec_max	0.2684027050558697
driven_lanedir_consec_mean	0.17906076936425236
driven_lanedir_consec_min	0.11716108079363076
driven_lanedir_max	0.2684027050558697
driven_lanedir_mean	0.17906076936425236
driven_lanedir_median	0.163604398982641
driven_lanedir_min	0.11716108079363076
in-drivable-lane_max	0.05000000000000005
in-drivable-lane_mean	0.010000000000000007
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.23637186528415663, "sim_physics": 0.1930864651997884, "survival_time": 1.5000000000000009, "driven_lanedir": 0.163604398982641, "sim_render-ego": 0.06633690198262533, "in-drivable-lane": 0, "agent_compute-ego": 0.18000463644663492, "deviation-heading": 0.8449920887982111, "set_robot_commands": 0.1271302382151286, "deviation-center-line": 0.09579847314098731, "driven_lanedir_consec": 0.163604398982641, "sim_compute_sim_state": 0.03924293518066406, "sim_compute_performance-ego": 0.07442054748535157, "sim_compute_robot_state-ego": 0.08107892672220866, "sim_compute_robot_state-npc0": 0.07472850481669108, "sim_compute_robot_state-npc1": 0.07197636763254801, "sim_compute_robot_state-npc2": 0.07059069474538167, "sim_compute_robot_state-npc3": 0.0701322873433431}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2053777259801511, "sim_physics": 0.18744240357325628, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11716108079363076, "sim_render-ego": 0.06872872205880973, "in-drivable-lane": 0, "agent_compute-ego": 0.1786218239710881, "deviation-heading": 0.9971699705631802, "set_robot_commands": 0.10780618740962102, "deviation-center-line": 0.08947016465572744, "driven_lanedir_consec": 0.11716108079363076, "sim_compute_sim_state": 0.04078368040231558, "sim_compute_performance-ego": 0.07057432027963492, "sim_compute_robot_state-ego": 0.07553525154407208, "sim_compute_robot_state-npc0": 0.07326798255626972, "sim_compute_robot_state-npc1": 0.07475427480844352, "sim_compute_robot_state-npc2": 0.06821684653942402, "sim_compute_robot_state-npc3": 0.06739990527813251}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2493184600952033, "sim_physics": 0.19130910237630208, "survival_time": 1.5000000000000009, "driven_lanedir": 0.2211412916933417, "sim_render-ego": 0.06651566823323568, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18017878532409667, "deviation-heading": 0.38395928010523667, "set_robot_commands": 0.10330251057942708, "deviation-center-line": 0.12991938981753748, "driven_lanedir_consec": 0.2211412916933417, "sim_compute_sim_state": 0.04136319955190023, "sim_compute_performance-ego": 0.07071698506673177, "sim_compute_robot_state-ego": 0.07891220251719157, "sim_compute_robot_state-npc0": 0.07408109505971273, "sim_compute_robot_state-npc1": 0.07813762029012045, "sim_compute_robot_state-npc2": 0.07240445613861084, "sim_compute_robot_state-npc3": 0.0691280444463094}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.29274076716950953, "sim_physics": 0.20686931163072583, "survival_time": 1.6000000000000008, "driven_lanedir": 0.2684027050558697, "sim_render-ego": 0.06298047304153442, "in-drivable-lane": 0, "agent_compute-ego": 0.18060112744569776, "deviation-heading": 0.4289085578140139, "set_robot_commands": 0.10424558818340302, "deviation-center-line": 0.13381802379655708, "driven_lanedir_consec": 0.2684027050558697, "sim_compute_sim_state": 0.042085886001586914, "sim_compute_performance-ego": 0.07125004380941391, "sim_compute_robot_state-ego": 0.07583676278591156, "sim_compute_robot_state-npc0": 0.07907591015100479, "sim_compute_robot_state-npc1": 0.07431445270776749, "sim_compute_robot_state-npc2": 0.0735379233956337, "sim_compute_robot_state-npc3": 0.07383336126804352}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.17388732399702533, "sim_physics": 0.13479351997375488, "survival_time": 1.2000000000000004, "driven_lanedir": 0.12499437029577865, "sim_render-ego": 0.05394488573074341, "in-drivable-lane": 0, "agent_compute-ego": 0.13946028550465903, "deviation-heading": 0.7111998506944579, "set_robot_commands": 0.08008929093678792, "deviation-center-line": 0.06601698356407831, "driven_lanedir_consec": 0.12499437029577865, "sim_compute_sim_state": 0.032174875338872276, "sim_compute_performance-ego": 0.05659369627634684, "sim_compute_robot_state-ego": 0.059748450915018715, "sim_compute_robot_state-npc0": 0.07492154836654663, "sim_compute_robot_state-npc1": 0.05563080310821533, "sim_compute_robot_state-npc2": 0.05696608622868856, "sim_compute_robot_state-npc3": 0.05733171105384827}}
set_robot_commands_max	0.1271302382151286
set_robot_commands_mean	0.10451476306487352
set_robot_commands_median	0.10424558818340302
set_robot_commands_min	0.08008929093678792
sim_compute_performance-ego_max	0.07442054748535157
sim_compute_performance-ego_mean	0.0687111185834958
sim_compute_performance-ego_median	0.07071698506673177
sim_compute_performance-ego_min	0.05659369627634684
sim_compute_robot_state-ego_max	0.08107892672220866
sim_compute_robot_state-ego_mean	0.07422231889688052
sim_compute_robot_state-ego_median	0.07583676278591156
sim_compute_robot_state-ego_min	0.059748450915018715
sim_compute_robot_state-npc0_max	0.07907591015100479
sim_compute_robot_state-npc0_mean	0.07521500819004498
sim_compute_robot_state-npc0_median	0.07472850481669108
sim_compute_robot_state-npc0_min	0.07326798255626972
sim_compute_robot_state-npc1_max	0.07813762029012045
sim_compute_robot_state-npc1_mean	0.07096270370941896
sim_compute_robot_state-npc1_median	0.07431445270776749
sim_compute_robot_state-npc1_min	0.05563080310821533
sim_compute_robot_state-npc2_max	0.0735379233956337
sim_compute_robot_state-npc2_mean	0.06834320140954775
sim_compute_robot_state-npc2_median	0.07059069474538167
sim_compute_robot_state-npc2_min	0.05696608622868856
sim_compute_robot_state-npc3_max	0.07383336126804352
sim_compute_robot_state-npc3_mean	0.06756506187793536
sim_compute_robot_state-npc3_median	0.0691280444463094
sim_compute_robot_state-npc3_min	0.05733171105384827
sim_compute_sim_state_max	0.042085886001586914
sim_compute_sim_state_mean	0.03913011529506781
sim_compute_sim_state_median	0.04078368040231558
sim_compute_sim_state_min	0.032174875338872276
sim_physics_max	0.20686931163072583
sim_physics_mean	0.1827001605507655
sim_physics_median	0.19130910237630208
sim_physics_min	0.13479351997375488
sim_render-ego_max	0.06872872205880973
sim_render-ego_mean	0.06370133020938971
sim_render-ego_median	0.06633690198262533
sim_render-ego_min	0.05394488573074341
simulation-passed	1
survival_time_max	1.6000000000000008
survival_time_mean	1.4200000000000004
survival_time_min	1.2000000000000004

No reset possible

22682

2978

Julian Zilly

Baseline-IL-logs-tensorflow

aido2-LFV-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-25436

2019-05-17 00:14:10+00:00

2019-05-17 00:45:54+00:00

0:31:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.0912065172125716
survival_time_median	11.300000000000026
deviation-center-line_median	0.5728899720137351
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.22768182168572637
agent_compute-ego_mean	0.2237895417348
agent_compute-ego_median	0.22632998913790273
agent_compute-ego_min	0.2170424899041365
deviation-center-line_max	0.8884858215677255
deviation-center-line_mean	0.6404178975847715
deviation-center-line_min	0.5307966628937019
deviation-heading_max	5.226687826404727
deviation-heading_mean	1.8753431975084656
deviation-heading_median	1.0764189930612722
deviation-heading_min	0.8682830145870736
driven_any_max	1.3628176190590888
driven_any_mean	1.1494297660257269
driven_any_median	1.1032128388028015
driven_any_min	1.0678695930870414
driven_lanedir_consec_max	1.355065874689569
driven_lanedir_consec_mean	1.051187858855247
driven_lanedir_consec_min	0.645810345777929
driven_lanedir_max	1.355065874689569
driven_lanedir_mean	1.064556349916797
driven_lanedir_median	1.0912065172125716
driven_lanedir_min	0.7126528010856776
in-drivable-lane_max	1.950000000000025
in-drivable-lane_mean	0.390000000000005
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0971059932607643, "sim_physics": 0.18486751843306976, "survival_time": 11.800000000000033, "driven_lanedir": 0.7126528010856776, "sim_render-ego": 0.06453141822653302, "in-drivable-lane": 1.950000000000025, "agent_compute-ego": 0.22768182168572637, "deviation-heading": 5.226687826404727, "set_robot_commands": 0.09898247355121675, "deviation-center-line": 0.5728899720137351, "driven_lanedir_consec": 0.645810345777929, "sim_compute_sim_state": 0.039887791973049355, "sim_compute_performance-ego": 0.07216193817429624, "sim_compute_robot_state-ego": 0.07952207124839394, "sim_compute_robot_state-npc0": 0.0728100649381088, "sim_compute_robot_state-npc1": 0.07357099803827577, "sim_compute_robot_state-npc2": 0.07124533390594741, "sim_compute_robot_state-npc3": 0.07202021045199895}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3628176190590888, "sim_physics": 0.17713499069213867, "survival_time": 14.950000000000076, "driven_lanedir": 1.355065874689569, "sim_render-ego": 0.0631898307800293, "in-drivable-lane": 0, "agent_compute-ego": 0.2208692844708761, "deviation-heading": 0.9467512204637168, "set_robot_commands": 0.09702895402908324, "deviation-center-line": 0.5307966628937019, "driven_lanedir_consec": 1.355065874689569, "sim_compute_sim_state": 0.04034854571024577, "sim_compute_performance-ego": 0.06756295442581177, "sim_compute_robot_state-ego": 0.07767857551574707, "sim_compute_robot_state-npc0": 0.07066342671712239, "sim_compute_robot_state-npc1": 0.0711920722325643, "sim_compute_robot_state-npc2": 0.06985329627990723, "sim_compute_robot_state-npc3": 0.07057087182998657}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0678695930870414, "sim_physics": 0.1828650829296757, "survival_time": 10.350000000000012, "driven_lanedir": 1.0592579489291998, "sim_render-ego": 0.06422527285589688, "in-drivable-lane": 0, "agent_compute-ego": 0.2170424899041365, "deviation-heading": 0.8682830145870736, "set_robot_commands": 0.0974272092183431, "deviation-center-line": 0.8884858215677255, "driven_lanedir_consec": 1.0592579489291998, "sim_compute_sim_state": 0.03939229393926796, "sim_compute_performance-ego": 0.06907679608478638, "sim_compute_robot_state-ego": 0.0731757931087328, "sim_compute_robot_state-npc0": 0.06973848250753062, "sim_compute_robot_state-npc1": 0.06919305796784479, "sim_compute_robot_state-npc2": 0.06900132105546297, "sim_compute_robot_state-npc3": 0.07077750606813292}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1032128388028015, "sim_physics": 0.18541068107158215, "survival_time": 11.100000000000025, "driven_lanedir": 1.0912065172125716, "sim_render-ego": 0.06358397006988525, "in-drivable-lane": 0, "agent_compute-ego": 0.2270241234753583, "deviation-heading": 1.0764189930612722, "set_robot_commands": 0.09683559391949628, "deviation-center-line": 0.6554282147082855, "driven_lanedir_consec": 1.0912065172125716, "sim_compute_sim_state": 0.04092708471659068, "sim_compute_performance-ego": 0.07072593499948313, "sim_compute_robot_state-ego": 0.07633054149043453, "sim_compute_robot_state-npc0": 0.07156679651758692, "sim_compute_robot_state-npc1": 0.07097552810703311, "sim_compute_robot_state-npc2": 0.07081165614428821, "sim_compute_robot_state-npc3": 0.07230148122117326}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.116142785918938, "sim_physics": 0.1776436831043885, "survival_time": 11.300000000000026, "driven_lanedir": 1.104598607666966, "sim_render-ego": 0.06393197257961847, "in-drivable-lane": 0, "agent_compute-ego": 0.22632998913790273, "deviation-heading": 1.2585749330255385, "set_robot_commands": 0.0987909209411756, "deviation-center-line": 0.5544888167404097, "driven_lanedir_consec": 1.104598607666966, "sim_compute_sim_state": 0.038995204773624385, "sim_compute_performance-ego": 0.07077686871047568, "sim_compute_robot_state-ego": 0.07628688875552828, "sim_compute_robot_state-npc0": 0.071001258571591, "sim_compute_robot_state-npc1": 0.07094656471657541, "sim_compute_robot_state-npc2": 0.07456079521010407, "sim_compute_robot_state-npc3": 0.07035004670641064}}
set_robot_commands_max	0.09898247355121675
set_robot_commands_mean	0.097813030331863
set_robot_commands_median	0.0974272092183431
set_robot_commands_min	0.09683559391949628
sim_compute_performance-ego_max	0.07216193817429624
sim_compute_performance-ego_mean	0.07006089847897065
sim_compute_performance-ego_median	0.07072593499948313
sim_compute_performance-ego_min	0.06756295442581177
sim_compute_robot_state-ego_max	0.07952207124839394
sim_compute_robot_state-ego_mean	0.07659877402376732
sim_compute_robot_state-ego_median	0.07633054149043453
sim_compute_robot_state-ego_min	0.0731757931087328
sim_compute_robot_state-npc0_max	0.0728100649381088
sim_compute_robot_state-npc0_mean	0.07115600585038795
sim_compute_robot_state-npc0_median	0.071001258571591
sim_compute_robot_state-npc0_min	0.06973848250753062
sim_compute_robot_state-npc1_max	0.07357099803827577
sim_compute_robot_state-npc1_mean	0.07117564421245867
sim_compute_robot_state-npc1_median	0.07097552810703311
sim_compute_robot_state-npc1_min	0.06919305796784479
sim_compute_robot_state-npc2_max	0.07456079521010407
sim_compute_robot_state-npc2_mean	0.07109448051914198
sim_compute_robot_state-npc2_median	0.07081165614428821
sim_compute_robot_state-npc2_min	0.06900132105546297
sim_compute_robot_state-npc3_max	0.07230148122117326
sim_compute_robot_state-npc3_mean	0.07120402325554047
sim_compute_robot_state-npc3_median	0.07077750606813292
sim_compute_robot_state-npc3_min	0.07035004670641064
sim_compute_sim_state_max	0.04092708471659068
sim_compute_sim_state_mean	0.039910184222555635
sim_compute_sim_state_median	0.039887791973049355
sim_compute_sim_state_min	0.038995204773624385
sim_physics_max	0.18541068107158215
sim_physics_mean	0.18158439124617096
sim_physics_median	0.1828650829296757
sim_physics_min	0.17713499069213867
sim_render-ego_max	0.06453141822653302
sim_render-ego_mean	0.06389249290239259
sim_render-ego_median	0.06393197257961847
sim_render-ego_min	0.0631898307800293
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.900000000000034
survival_time_min	10.350000000000012

No reset possible

22676

2986

Maxim Scherbakov

challenge-aido_LF-template-tensorflow

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 00:09:45+00:00

2019-05-17 00:13:14+00:00

0:03:29

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22672

3002

Manfred Diaz

challenge-aido_LF-template-tensorflow

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 00:08:41+00:00

2019-05-17 00:09:17+00:00

0:00:36

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22665

3011

Manfred Diaz

challenge-aido_LF-template-pytorch

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 00:07:49+00:00

2019-05-17 00:08:24+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22653

3023

Manfred Diaz

challenge-aido_LF-template-pytorch

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 00:05:47+00:00

2019-05-17 00:07:20+00:00

0:01:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22641

3047

Manfred Diaz

challenge-aido_LF-template-tensorflow

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-17 00:01:49+00:00

2019-05-17 00:05:25+00:00

0:03:36

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22629

3074

Julian Zilly

Baseline-IL-logs-tensorflow

aido2-LFV-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-16 23:57:01+00:00

2019-05-17 00:01:41+00:00

0:04:40

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22611

3111

Angel Woo 🇭🇰

HKU Duckietown Project

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-25436

2019-05-16 23:29:55+00:00

2019-05-16 23:56:39+00:00

0:26:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.016842142970773466
survival_time_median	14.950000000000076
deviation-center-line_median	0.431912765720167
in-drivable-lane_median	2.10000000000003

other stats

agent_compute-ego_max	0.23614804744720455
agent_compute-ego_mean	0.23050313981374107
agent_compute-ego_median	0.2279948441187541
agent_compute-ego_min	0.22756263256073
deviation-center-line_max	2.0390534285512034
deviation-center-line_mean	0.7769388115645113
deviation-center-line_min	0.3483640100523865
deviation-heading_max	16.664027142404265
deviation-heading_mean	11.58680094468854
deviation-heading_median	12.321437478949052
deviation-heading_min	5.398038311253559
driven_any_max	0.20695766382949507
driven_any_mean	0.14715260525415225
driven_any_median	0.1607774166169904
driven_any_min	0.10330661429799864
driven_lanedir_consec_max	0.03318627605543112
driven_lanedir_consec_mean	0.004983169661941922
driven_lanedir_consec_min	-0.039414506762275536
driven_lanedir_max	0.03318627605543112
driven_lanedir_mean	0.004983169661941922
driven_lanedir_median	0.016842142970773466
driven_lanedir_min	-0.039414506762275536
in-drivable-lane_max	8.650000000000091
in-drivable-lane_mean	3.3500000000000414
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1035820940187242, "sim_physics": 0.11453744014104209, "survival_time": 14.950000000000076, "driven_lanedir": 0.03318627605543112, "sim_render-ego": 0.06378506104151407, "in-drivable-lane": 0, "agent_compute-ego": 0.23322076638539632, "deviation-heading": 12.321437478949052, "set_robot_commands": 0.0999561047554016, "deviation-center-line": 2.0390534285512034, "driven_lanedir_consec": 0.03318627605543112, "sim_compute_sim_state": 0.04063070297241211, "sim_compute_performance-ego": 0.07197563648223877, "sim_compute_robot_state-ego": 0.07803175528844197}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.10330661429799864, "sim_physics": 0.128889373143514, "survival_time": 14.950000000000076, "driven_lanedir": 0.016842142970773466, "sim_render-ego": 0.06514248132705688, "in-drivable-lane": 0, "agent_compute-ego": 0.2279948441187541, "deviation-heading": 16.664027142404265, "set_robot_commands": 0.10151649872461954, "deviation-center-line": 0.4150220175438876, "driven_lanedir_consec": 0.016842142970773466, "sim_compute_sim_state": 0.04147993087768555, "sim_compute_performance-ego": 0.07295028924942017, "sim_compute_robot_state-ego": 0.07867373069127401}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.16113923750755282, "sim_physics": 0.11955686648686728, "survival_time": 14.950000000000076, "driven_lanedir": -0.0031045123123143448, "sim_render-ego": 0.06430535872777303, "in-drivable-lane": 8.650000000000091, "agent_compute-ego": 0.22758940855662027, "deviation-heading": 5.398038311253559, "set_robot_commands": 0.10186277866363526, "deviation-center-line": 0.3483640100523865, "driven_lanedir_consec": -0.0031045123123143448, "sim_compute_sim_state": 0.04019283135732015, "sim_compute_performance-ego": 0.07218131621678671, "sim_compute_robot_state-ego": 0.07629409313201904}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1607774166169904, "sim_physics": 0.11948569456736248, "survival_time": 14.950000000000076, "driven_lanedir": -0.039414506762275536, "sim_render-ego": 0.06517244656880697, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.23614804744720455, "deviation-heading": 14.624722527993471, "set_robot_commands": 0.10234228769938152, "deviation-center-line": 0.6503418359549121, "driven_lanedir_consec": -0.039414506762275536, "sim_compute_sim_state": 0.04139829715092977, "sim_compute_performance-ego": 0.07327139933904012, "sim_compute_robot_state-ego": 0.0844703483581543}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.20695766382949507, "sim_physics": 0.11391170819600424, "survival_time": 14.950000000000076, "driven_lanedir": 0.017406448358094906, "sim_render-ego": 0.06389719883600871, "in-drivable-lane": 6.000000000000085, "agent_compute-ego": 0.22756263256073, "deviation-heading": 8.925779262842351, "set_robot_commands": 0.10507654984792074, "deviation-center-line": 0.431912765720167, "driven_lanedir_consec": 0.017406448358094906, "sim_compute_sim_state": 0.04045167605082194, "sim_compute_performance-ego": 0.07087013880411784, "sim_compute_robot_state-ego": 0.07590251207351685}}
set_robot_commands_max	0.10507654984792074
set_robot_commands_mean	0.10215084393819174
set_robot_commands_median	0.10186277866363526
set_robot_commands_min	0.0999561047554016
sim_compute_performance-ego_max	0.07327139933904012
sim_compute_performance-ego_mean	0.07224975601832073
sim_compute_performance-ego_median	0.07218131621678671
sim_compute_performance-ego_min	0.07087013880411784
sim_compute_robot_state-ego_max	0.0844703483581543
sim_compute_robot_state-ego_mean	0.07867448790868123
sim_compute_robot_state-ego_median	0.07803175528844197
sim_compute_robot_state-ego_min	0.07590251207351685
sim_compute_sim_state_max	0.04147993087768555
sim_compute_sim_state_mean	0.040830687681833906
sim_compute_sim_state_median	0.04063070297241211
sim_compute_sim_state_min	0.04019283135732015
sim_physics_max	0.128889373143514
sim_physics_mean	0.119276216506958
sim_physics_median	0.11948569456736248
sim_physics_min	0.11391170819600424
sim_render-ego_max	0.06517244656880697
sim_render-ego_mean	0.06446050930023194
sim_render-ego_median	0.06430535872777303
sim_render-ego_min	0.06378506104151407
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

22587

3131

FANG MEIYI 🇸🇬

test

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-25436

2019-05-16 23:01:20+00:00

2019-05-16 23:29:48+00:00

0:28:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.315265364207768
survival_time_median	14.950000000000076
deviation-center-line_median	0.645084154280886
in-drivable-lane_median	1.2499999999999956

other stats

agent_compute-ego_max	0.19669767459233603
agent_compute-ego_mean	0.1889546364264477
agent_compute-ego_median	0.19328641414642336
agent_compute-ego_min	0.1681822117169698
deviation-center-line_max	0.7436731376617259
deviation-center-line_mean	0.5622071184125856
deviation-center-line_min	0.2573565490578468
deviation-heading_max	3.0894476740948207
deviation-heading_mean	2.2265340955476836
deviation-heading_median	2.280856374789894
deviation-heading_min	1.2253263778543693
driven_any_max	3.8525786486978553
driven_any_mean	3.3347834973595822
driven_any_median	3.731249318449806
driven_any_min	1.633204167593702
driven_lanedir_consec_max	3.819521483865236
driven_lanedir_consec_mean	2.9564984926070084
driven_lanedir_consec_min	1.2521895544657502
driven_lanedir_max	3.819521483865236
driven_lanedir_mean	2.9564984926070084
driven_lanedir_median	3.315265364207768
driven_lanedir_min	1.2521895544657502
in-drivable-lane_max	3.250000000000009
in-drivable-lane_mean	1.18
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.7078364277549767, "sim_physics": 0.12148287137349446, "survival_time": 14.950000000000076, "driven_lanedir": 2.729647891948438, "sim_render-ego": 0.06459908803304036, "in-drivable-lane": 3.250000000000009, "agent_compute-ego": 0.1681822117169698, "deviation-heading": 3.0894476740948207, "set_robot_commands": 0.10422446012496948, "deviation-center-line": 0.645084154280886, "driven_lanedir_consec": 2.729647891948438, "sim_compute_sim_state": 0.04014764308929444, "sim_compute_performance-ego": 0.07289893547693889, "sim_compute_robot_state-ego": 0.08052346309026083}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.8525786486978553, "sim_physics": 0.1364769426981608, "survival_time": 14.950000000000076, "driven_lanedir": 3.819521483865236, "sim_render-ego": 0.07237938006718954, "in-drivable-lane": 0, "agent_compute-ego": 0.19326557079950968, "deviation-heading": 1.6984683528616544, "set_robot_commands": 0.11758800586064656, "deviation-center-line": 0.43064698696338305, "driven_lanedir_consec": 3.819521483865236, "sim_compute_sim_state": 0.04509796142578125, "sim_compute_performance-ego": 0.08198724428812663, "sim_compute_robot_state-ego": 0.092545379002889}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.731249318449806, "sim_physics": 0.14940171798070273, "survival_time": 14.950000000000076, "driven_lanedir": 3.6658681685478496, "sim_render-ego": 0.07586989084879557, "in-drivable-lane": 0, "agent_compute-ego": 0.19328641414642336, "deviation-heading": 2.280856374789894, "set_robot_commands": 0.11845540285110472, "deviation-center-line": 0.7436731376617259, "driven_lanedir_consec": 3.6658681685478496, "sim_compute_sim_state": 0.04478787978490194, "sim_compute_performance-ego": 0.0823922872543335, "sim_compute_robot_state-ego": 0.09407267888387044}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.633204167593702, "sim_physics": 0.1418941125382472, "survival_time": 6.849999999999984, "driven_lanedir": 1.2521895544657502, "sim_render-ego": 0.07260098074474473, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.19334131087699943, "deviation-heading": 1.2253263778543693, "set_robot_commands": 0.11736569961492165, "deviation-center-line": 0.2573565490578468, "driven_lanedir_consec": 1.2521895544657502, "sim_compute_sim_state": 0.045319806050210104, "sim_compute_performance-ego": 0.08258138259832007, "sim_compute_robot_state-ego": 0.09553834817705364}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.7490489243015697, "sim_physics": 0.14441792011260987, "survival_time": 14.950000000000076, "driven_lanedir": 3.315265364207768, "sim_render-ego": 0.07171858151753743, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.19669767459233603, "deviation-heading": 2.83857169813768, "set_robot_commands": 0.11638211250305176, "deviation-center-line": 0.7342747640990868, "driven_lanedir_consec": 3.315265364207768, "sim_compute_sim_state": 0.04417848587036133, "sim_compute_performance-ego": 0.0794790800412496, "sim_compute_robot_state-ego": 0.094729855855306}}
set_robot_commands_max	0.11845540285110472
set_robot_commands_mean	0.11480313619093882
set_robot_commands_median	0.11736569961492165
set_robot_commands_min	0.10422446012496948
sim_compute_performance-ego_max	0.08258138259832007
sim_compute_performance-ego_mean	0.07986778593179374
sim_compute_performance-ego_median	0.08198724428812663
sim_compute_performance-ego_min	0.07289893547693889
sim_compute_robot_state-ego_max	0.09553834817705364
sim_compute_robot_state-ego_mean	0.09148194500187598
sim_compute_robot_state-ego_median	0.09407267888387044
sim_compute_robot_state-ego_min	0.08052346309026083
sim_compute_sim_state_max	0.045319806050210104
sim_compute_sim_state_mean	0.04390635524410981
sim_compute_sim_state_median	0.04478787978490194
sim_compute_sim_state_min	0.04014764308929444
sim_physics_max	0.14940171798070273
sim_physics_mean	0.13873471294064302
sim_physics_median	0.1418941125382472
sim_physics_min	0.12148287137349446
sim_render-ego_max	0.07586989084879557
sim_render-ego_mean	0.07143358424226154
sim_render-ego_median	0.07237938006718954
sim_render-ego_min	0.06459908803304036
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.33000000000006
survival_time_min	6.849999999999984

No reset possible

22571

3152

Po Sheng Ser 🇹🇼

challenge-aido_LF-baseline-duckietown

aido2-LF-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-25436

2019-05-16 22:49:36+00:00

2019-05-16 23:00:52+00:00

0:11:16

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22556

3183

jiang peng

Baseline solution using reinforcement learning

aido2-LF-sim-testing

step1-simulation

success

yes

ip-172-31-38-104-25436

2019-05-16 22:34:48+00:00

2019-05-16 22:48:30+00:00

0:13:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.09951492570308897
survival_time_median	1.3000000000000005
deviation-center-line_median	0.08340454590060091
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.2006724238395691
agent_compute-ego_mean	0.17047270241512733
agent_compute-ego_median	0.1781483107599719
agent_compute-ego_min	0.1350623369216919
deviation-center-line_max	0.10369076443849204
deviation-center-line_mean	0.08156244590943386
deviation-center-line_min	0.05905491633257325
deviation-heading_max	0.9882965247040016
deviation-heading_mean	0.7207667228373993
deviation-heading_median	0.7390018248625377
deviation-heading_min	0.4235779341658162
driven_any_max	0.2388667418835813
driven_any_mean	0.16881070979740623
driven_any_median	0.1779002691975213
driven_any_min	0.10886897245278544
driven_lanedir_consec_max	0.1668399825903819
driven_lanedir_consec_mean	0.11127546195495992
driven_lanedir_consec_min	0.06510205009529546
driven_lanedir_max	0.1668399825903819
driven_lanedir_mean	0.11127546195495992
driven_lanedir_median	0.09951492570308897
driven_lanedir_min	0.06510205009529546
in-drivable-lane_max	0.5500000000000005
in-drivable-lane_mean	0.06000000000000005
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.23122557142729544, "sim_physics": 0.10168667741723962, "survival_time": 1.850000000000001, "driven_lanedir": 0.09914702824426593, "sim_render-ego": 0.05085132573101971, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1516879313700908, "deviation-heading": 0.8196937758364218, "set_robot_commands": 0.07910020286972458, "deviation-center-line": 0.06943967848631825, "driven_lanedir_consec": 0.09914702824426593, "sim_compute_sim_state": 0.03384470295261692, "sim_compute_performance-ego": 0.05522006911200446, "sim_compute_robot_state-ego": 0.05834584622769742}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.18405980992465149, "sim_physics": 0.15405838830130442, "survival_time": 1.4000000000000006, "driven_lanedir": 0.12169659348926364, "sim_render-ego": 0.06338330677577428, "in-drivable-lane": 0, "agent_compute-ego": 0.1634121537208557, "deviation-heading": 0.8458213914740209, "set_robot_commands": 0.09253237928662982, "deviation-center-line": 0.06502194789066337, "driven_lanedir_consec": 0.12169659348926364, "sim_compute_sim_state": 0.03835071836199079, "sim_compute_performance-ego": 0.07202130556106567, "sim_compute_robot_state-ego": 0.08248448371887207}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12223544481846586, "sim_physics": 0.129679536819458, "survival_time": 1.0000000000000002, "driven_lanedir": 0.09464508604356414, "sim_render-ego": 0.06589213609695435, "in-drivable-lane": 0, "agent_compute-ego": 0.2006724238395691, "deviation-heading": 0.5288820420898147, "set_robot_commands": 0.10543372631072996, "deviation-center-line": 0.09364755753898686, "driven_lanedir_consec": 0.09464508604356414, "sim_compute_sim_state": 0.04126549959182739, "sim_compute_performance-ego": 0.07459805011749268, "sim_compute_robot_state-ego": 0.07929152250289917}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18864885409559468, "sim_physics": 0.1411865004177751, "survival_time": 1.4500000000000006, "driven_lanedir": 0.09951492570308897, "sim_render-ego": 0.07366946647907126, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.1781483107599719, "deviation-heading": 0.9118057765614428, "set_robot_commands": 0.10245292762230182, "deviation-center-line": 0.06662455736119749, "driven_lanedir_consec": 0.09951492570308897, "sim_compute_sim_state": 0.04302327386264143, "sim_compute_performance-ego": 0.07196253743664972, "sim_compute_robot_state-ego": 0.0812265133035594}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2388667418835813, "sim_physics": 0.12727907932165897, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1668399825903819, "sim_render-ego": 0.06276246995636911, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16595568078936954, "deviation-heading": 0.8422895314635719, "set_robot_commands": 0.09352851636482008, "deviation-center-line": 0.07573161811107137, "driven_lanedir_consec": 0.1668399825903819, "sim_compute_sim_state": 0.03800095933856386, "sim_compute_performance-ego": 0.0681731195160837, "sim_compute_robot_state-ego": 0.0764986312750614}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.22036521655702485, "sim_physics": 0.13364959557851155, "survival_time": 1.5000000000000009, "driven_lanedir": 0.13193823529090265, "sim_render-ego": 0.06228717168172201, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.182930858929952, "deviation-heading": 0.9882965247040016, "set_robot_commands": 0.09448737303415934, "deviation-center-line": 0.08470308653596659, "driven_lanedir_consec": 0.13193823529090265, "sim_compute_sim_state": 0.03835695584615072, "sim_compute_performance-ego": 0.07307862440745036, "sim_compute_robot_state-ego": 0.08560528755187988}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.1779002691975213, "sim_physics": 0.1393915194052237, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1439963372853752, "sim_render-ego": 0.062166452407836914, "in-drivable-lane": 0, "agent_compute-ego": 0.17853430465415673, "deviation-heading": 0.5908929055165867, "set_robot_commands": 0.10476839983904804, "deviation-center-line": 0.09897059349409258, "driven_lanedir_consec": 0.1439963372853752, "sim_compute_sim_state": 0.04053469057436342, "sim_compute_performance-ego": 0.06995938442371509, "sim_compute_robot_state-ego": 0.08036712363914207}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.128774614217463, "sim_physics": 0.11153723001480102, "survival_time": 1.0000000000000002, "driven_lanedir": 0.09842868103656732, "sim_render-ego": 0.06581412553787232, "in-drivable-lane": 0, "agent_compute-ego": 0.17130166292190552, "deviation-heading": 0.5142740321511632, "set_robot_commands": 0.09838942289352418, "deviation-center-line": 0.08811475912927241, "driven_lanedir_consec": 0.09842868103656732, "sim_compute_sim_state": 0.03880442380905151, "sim_compute_performance-ego": 0.07846838235855103, "sim_compute_robot_state-ego": 0.08069531917572022}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.1967881844304574, "sim_physics": 0.13157949997828558, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1519910552628163, "sim_render-ego": 0.06213848407451923, "in-drivable-lane": 0, "agent_compute-ego": 0.1801975598702064, "deviation-heading": 0.6561744928837632, "set_robot_commands": 0.10369173380044792, "deviation-center-line": 0.067567511474205, "driven_lanedir_consec": 0.1519910552628163, "sim_compute_sim_state": 0.04319492670205923, "sim_compute_performance-ego": 0.07143235206604004, "sim_compute_robot_state-ego": 0.08011419956500714}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.11696292990933864, "sim_physics": 0.09167710940043132, "survival_time": 1.2000000000000004, "driven_lanedir": 0.06510205009529546, "sim_render-ego": 0.04954757293065389, "in-drivable-lane": 0, "agent_compute-ego": 0.1350623369216919, "deviation-heading": 0.7390018248625377, "set_robot_commands": 0.06941765546798706, "deviation-center-line": 0.08423029652260929, "driven_lanedir_consec": 0.06510205009529546, "sim_compute_sim_state": 0.032810866832733154, "sim_compute_performance-ego": 0.053027947743733726, "sim_compute_robot_state-ego": 0.062009602785110474}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1295774571500019, "sim_physics": 0.0966787338256836, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09822339593430184, "sim_render-ego": 0.04879306753476461, "in-drivable-lane": 0, "agent_compute-ego": 0.13663658499717712, "deviation-heading": 0.5114265023360587, "set_robot_commands": 0.07393563787142436, "deviation-center-line": 0.10206208899716, "driven_lanedir_consec": 0.09822339593430184, "sim_compute_sim_state": 0.03179435928662618, "sim_compute_performance-ego": 0.052272140979766846, "sim_compute_robot_state-ego": 0.0557038684686025}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.1499305224686156, "sim_physics": 0.13594624519348145, "survival_time": 1.2500000000000004, "driven_lanedir": 0.10819924314016494, "sim_render-ego": 0.0624439811706543, "in-drivable-lane": 0, "agent_compute-ego": 0.15454269409179688, "deviation-heading": 0.7118637687536413, "set_robot_commands": 0.08736650466918945, "deviation-center-line": 0.08340454590060091, "driven_lanedir_consec": 0.10819924314016494, "sim_compute_sim_state": 0.03827798843383789, "sim_compute_performance-ego": 0.06576247215270996, "sim_compute_robot_state-ego": 0.06993064880371094}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.19493325623815735, "sim_physics": 0.12972302272402006, "survival_time": 1.4500000000000006, "driven_lanedir": 0.12056463466986612, "sim_render-ego": 0.06836302527065935, "in-drivable-lane": 0, "agent_compute-ego": 0.19681974937175883, "deviation-heading": 0.9168126679998808, "set_robot_commands": 0.10610603464060817, "deviation-center-line": 0.08117276642829833, "driven_lanedir_consec": 0.12056463466986612, "sim_compute_sim_state": 0.04259842839734307, "sim_compute_performance-ego": 0.07457499668515961, "sim_compute_robot_state-ego": 0.0875132577172641}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.14302280219013863, "sim_physics": 0.11273627479871114, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08696534689019764, "sim_render-ego": 0.06180484096209208, "in-drivable-lane": 0, "agent_compute-ego": 0.17926456530888876, "deviation-heading": 0.8106876717622677, "set_robot_commands": 0.09810051321983336, "deviation-center-line": 0.05905491633257325, "driven_lanedir_consec": 0.08696534689019764, "sim_compute_sim_state": 0.03622307380040487, "sim_compute_performance-ego": 0.06831323107083638, "sim_compute_robot_state-ego": 0.0767190953095754}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.10886897245278544, "sim_physics": 0.12568721317109607, "survival_time": 1.0500000000000005, "driven_lanedir": 0.08187933364834699, "sim_render-ego": 0.0632409481775193, "in-drivable-lane": 0, "agent_compute-ego": 0.18192371867951893, "deviation-heading": 0.4235779341658162, "set_robot_commands": 0.10118428866068524, "deviation-center-line": 0.10369076443849204, "driven_lanedir_consec": 0.08187933364834699, "sim_compute_sim_state": 0.0430456797281901, "sim_compute_performance-ego": 0.06989796956380208, "sim_compute_robot_state-ego": 0.07242113067990258}}
set_robot_commands_max	0.10610603464060817
set_robot_commands_mean	0.09403302110340755
set_robot_commands_median	0.09810051321983336
set_robot_commands_min	0.06941765546798706
sim_compute_performance-ego_max	0.07846838235855103
sim_compute_performance-ego_mean	0.06791750554633742
sim_compute_performance-ego_median	0.06995938442371509
sim_compute_performance-ego_min	0.052272140979766846
sim_compute_robot_state-ego_max	0.0875132577172641
sim_compute_robot_state-ego_mean	0.07526176871493365
sim_compute_robot_state-ego_median	0.07929152250289917
sim_compute_robot_state-ego_min	0.0557038684686025
sim_compute_sim_state_max	0.04319492670205923
sim_compute_sim_state_mean	0.03867510316789337
sim_compute_sim_state_median	0.03835695584615072
sim_compute_sim_state_min	0.03179435928662618
sim_physics_max	0.15405838830130442
sim_physics_mean	0.12416644175784544
sim_physics_median	0.129679536819458
sim_physics_min	0.09167710940043132
sim_render-ego_max	0.07366946647907126
sim_render-ego_mean	0.06154389165249885
sim_render-ego_median	0.0624439811706543
sim_render-ego_min	0.04879306753476461
simulation-passed	1
survival_time_max	1.850000000000001
survival_time_mean	1.323333333333334
survival_time_min	1.0000000000000002

No reset possible