Evaluator 1729

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

32975

6640

Anthony Courchesne 🇨🇦

challenge-aido_LF-baseline-behavior-cloning

aido3-off-LF-sim-validation

step1-simulation

error

yes

p-1

2020-07-10 15:56:43+00:00

2020-07-10 15:58:10+00:00

0:01:27

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32972

6638

Anthony Courchesne 🇨🇦

baseline-IL-sim-tensorflow

aido3-off-LF-sim-validation

step1-simulation

success

yes

p-1

2020-07-08 20:23:36+00:00

2020-07-08 20:35:11+00:00

0:11:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-0.06571390440846248
survival_time_median	14.950000000000076
deviation-center-line_median	0.8544902037707562
in-drivable-lane_median	1.2500000000000089

other stats

agent_compute-ego_max	0.04685425202051798
agent_compute-ego_mean	0.04560579467001762
agent_compute-ego_median	0.04544702450434367
agent_compute-ego_min	0.04501798788706462
deviation-center-line_max	1.3370617571467551
deviation-center-line_mean	0.8907679611735382
deviation-center-line_min	0.6245366874748685
deviation-heading_max	9.766068460268638
deviation-heading_mean	9.023183525717318
deviation-heading_median	9.4914156598526
deviation-heading_min	7.201885762042185
driven_any_max	3.088032600676043
driven_any_mean	2.6252675927049127
driven_any_median	2.4928335957478316
driven_any_min	2.2091748468845487
driven_lanedir_consec_max	0.29333840723551097
driven_lanedir_consec_mean	-0.20099855233124703
driven_lanedir_consec_min	-0.7659261690896615
driven_lanedir_max	0.1772516371426054
driven_lanedir_mean	-0.47841773256138787
driven_lanedir_median	-0.10543436511595194
driven_lanedir_min	-1.6125533058413866
in-drivable-lane_max	4.050000000000015
in-drivable-lane_mean	1.5000000000000062
in-drivable-lane_min	0.09999999999999964
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.088032600676043, "sim_physics": 0.05780987024307251, "survival_time": 14.950000000000076, "driven_lanedir": -1.6125533058413866, "sim_render-ego": 0.01202064037322998, "in-drivable-lane": 4.050000000000015, "agent_compute-ego": 0.04518483877182007, "deviation-heading": 7.201885762042185, "set_robot_commands": 0.006803589661916097, "deviation-center-line": 1.3370617571467551, "driven_lanedir_consec": -0.7659261690896615, "sim_compute_sim_state": 0.004032425085703532, "sim_compute_performance-ego": 0.007122824192047119, "sim_compute_robot_state-ego": 0.009505163033803304}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.884223998004709, "sim_physics": 0.05847068707148234, "survival_time": 14.950000000000076, "driven_lanedir": 0.1772516371426054, "sim_render-ego": 0.012187450726826986, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.04501798788706462, "deviation-heading": 9.72749091043598, "set_robot_commands": 0.006774548689524333, "deviation-center-line": 0.6616163318911766, "driven_lanedir_consec": 0.29333840723551097, "sim_compute_sim_state": 0.00403505007425944, "sim_compute_performance-ego": 0.007019556363423665, "sim_compute_robot_state-ego": 0.009353849093119305}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.452072922211431, "sim_physics": 0.058629613717397056, "survival_time": 14.950000000000076, "driven_lanedir": -0.10543436511595194, "sim_render-ego": 0.01224499781926473, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.04544702450434367, "deviation-heading": 8.929056835987188, "set_robot_commands": 0.006767514546712239, "deviation-center-line": 0.976134825584135, "driven_lanedir_consec": -0.06571390440846248, "sim_compute_sim_state": 0.0040538160006205245, "sim_compute_performance-ego": 0.007099777857462565, "sim_compute_robot_state-ego": 0.00953567902247111}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.2091748468845487, "sim_physics": 0.05822019085629296, "survival_time": 13.100000000000051, "driven_lanedir": 0.005038998077467438, "sim_render-ego": 0.012098446147132466, "in-drivable-lane": 1.5499999999999998, "agent_compute-ego": 0.04552487016634177, "deviation-heading": 9.4914156598526, "set_robot_commands": 0.006800702509989265, "deviation-center-line": 0.6245366874748685, "driven_lanedir_consec": 0.02442888163562107, "sim_compute_sim_state": 0.004020080311607769, "sim_compute_performance-ego": 0.007064747446365939, "sim_compute_robot_state-ego": 0.009459944171759918}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.4928335957478316, "sim_physics": 0.059118508497873944, "survival_time": 14.950000000000076, "driven_lanedir": -0.8563916270696736, "sim_render-ego": 0.012185029983520508, "in-drivable-lane": 1.2500000000000089, "agent_compute-ego": 0.04685425202051798, "deviation-heading": 9.766068460268638, "set_robot_commands": 0.006787472565968831, "deviation-center-line": 0.8544902037707562, "driven_lanedir_consec": -0.49111997702924337, "sim_compute_sim_state": 0.004082741737365722, "sim_compute_performance-ego": 0.00715000867843628, "sim_compute_robot_state-ego": 0.009498618443806964}}
set_robot_commands_max	0.006803589661916097
set_robot_commands_mean	0.006786765594822153
set_robot_commands_median	0.006787472565968831
set_robot_commands_min	0.006767514546712239
sim_compute_performance-ego_max	0.00715000867843628
sim_compute_performance-ego_mean	0.007091382907547112
sim_compute_performance-ego_median	0.007099777857462565
sim_compute_performance-ego_min	0.007019556363423665
sim_compute_robot_state-ego_max	0.00953567902247111
sim_compute_robot_state-ego_mean	0.00947065075299212
sim_compute_robot_state-ego_median	0.009498618443806964
sim_compute_robot_state-ego_min	0.009353849093119305
sim_compute_sim_state_max	0.004082741737365722
sim_compute_sim_state_mean	0.004044822641911397
sim_compute_sim_state_median	0.00403505007425944
sim_compute_sim_state_min	0.004020080311607769
sim_physics_max	0.059118508497873944
sim_physics_mean	0.05844977407722376
sim_physics_median	0.05847068707148234
sim_physics_min	0.05780987024307251
sim_render-ego_max	0.01224499781926473
sim_render-ego_mean	0.012147313009994934
sim_render-ego_median	0.012185029983520508
sim_render-ego_min	0.01202064037322998
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.580000000000071
survival_time_min	13.100000000000051

No reset possible

32964

6633

Anthony Courchesne 🇨🇦

baseline-IL-sim-tensorflow

aido3-off-LF-sim-validation

step1-simulation

error

yes

p-1

2020-07-08 19:26:30+00:00

2020-07-08 19:29:18+00:00

0:02:48

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32961

6631

Anthony Courchesne 🇨🇦

baseline-IL-sim-tensorflow

aido3-off-LF-sim-validation

step1-simulation

error

yes

p-1

2020-07-08 16:19:01+00:00

2020-07-08 16:20:40+00:00

0:01:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

32942

6622

Frank (Chude) Qian 🇨🇦

FrankNet-V2-2020_05_20_SS

aido3-off-LF-sim-validation

step1-simulation

success

yes

p-1

2020-05-20 19:03:44+00:00

2020-05-20 19:12:38+00:00

0:08:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	4.253053186304777
survival_time_median	14.950000000000076
deviation-center-line_median	0.6977819990085188
in-drivable-lane_median	2.2000000000000313

other stats

agent_compute-ego_max	0.08928125738676361
agent_compute-ego_mean	0.0869730540902932
agent_compute-ego_median	0.08683231989542643
agent_compute-ego_min	0.08483455101648966
deviation-center-line_max	0.9857435045899718
deviation-center-line_mean	0.7054769700877361
deviation-center-line_min	0.4718530953072106
deviation-heading_max	2.7790024090677674
deviation-heading_mean	2.1035766051662934
deviation-heading_median	2.121900605616963
deviation-heading_min	1.2241127199357265
driven_any_max	6.119629664089625
driven_any_mean	4.7282951510581475
driven_any_median	5.227980731859651
driven_any_min	2.594372907487565
driven_lanedir_consec_max	4.945510443903839
driven_lanedir_consec_mean	4.036585088691784
driven_lanedir_consec_min	2.532478566471577
driven_lanedir_max	4.945510443903839
driven_lanedir_mean	4.036585088691784
driven_lanedir_median	4.253053186304777
driven_lanedir_min	2.532478566471577
in-drivable-lane_max	4.600000000000015
in-drivable-lane_mean	1.8700000000000088
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.332475912867661, "sim_physics": 0.06185881240629055, "survival_time": 14.150000000000066, "driven_lanedir": 4.253053186304777, "sim_render-ego": 0.012182944233762923, "in-drivable-lane": 0, "agent_compute-ego": 0.08928125738676361, "deviation-heading": 2.121900605616963, "set_robot_commands": 0.008011871850111459, "deviation-center-line": 0.7104719924587259, "driven_lanedir_consec": 4.253053186304777, "sim_compute_sim_state": 0.006075731014615655, "sim_compute_performance-ego": 0.007163916375527534, "sim_compute_robot_state-ego": 0.00942698721329652}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.594372907487565, "sim_physics": 0.06260463429821862, "survival_time": 7.199999999999982, "driven_lanedir": 2.532478566471577, "sim_render-ego": 0.01220049626297421, "in-drivable-lane": 0, "agent_compute-ego": 0.08745895822842915, "deviation-heading": 1.2241127199357265, "set_robot_commands": 0.007991348703702291, "deviation-center-line": 0.4718530953072106, "driven_lanedir_consec": 2.532478566471577, "sim_compute_sim_state": 0.006106257438659668, "sim_compute_performance-ego": 0.007221319609218174, "sim_compute_robot_state-ego": 0.009401677383316888}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 6.119629664089625, "sim_physics": 0.06100954612096151, "survival_time": 14.950000000000076, "driven_lanedir": 4.945510443903839, "sim_render-ego": 0.012017081578572592, "in-drivable-lane": 2.549999999999999, "agent_compute-ego": 0.0864581839243571, "deviation-heading": 1.7174693226470612, "set_robot_commands": 0.007862074375152588, "deviation-center-line": 0.9857435045899718, "driven_lanedir_consec": 4.945510443903839, "sim_compute_sim_state": 0.006113598346710205, "sim_compute_performance-ego": 0.007004360357920329, "sim_compute_robot_state-ego": 0.00932002544403076}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.227980731859651, "sim_physics": 0.061992081006368, "survival_time": 14.950000000000076, "driven_lanedir": 3.784191423391987, "sim_render-ego": 0.011972145239512124, "in-drivable-lane": 4.600000000000015, "agent_compute-ego": 0.08483455101648966, "deviation-heading": 2.7790024090677674, "set_robot_commands": 0.008004355430603027, "deviation-center-line": 0.6615342590742538, "driven_lanedir_consec": 3.784191423391987, "sim_compute_sim_state": 0.006041525999704997, "sim_compute_performance-ego": 0.007055222988128662, "sim_compute_robot_state-ego": 0.009192457993825277}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.367016538986238, "sim_physics": 0.061446059544881186, "survival_time": 14.950000000000076, "driven_lanedir": 4.66769182338674, "sim_render-ego": 0.012241931756337483, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.08683231989542643, "deviation-heading": 2.675397968563949, "set_robot_commands": 0.007881581783294678, "deviation-center-line": 0.6977819990085188, "driven_lanedir_consec": 4.66769182338674, "sim_compute_sim_state": 0.006040441989898682, "sim_compute_performance-ego": 0.007112288475036621, "sim_compute_robot_state-ego": 0.009272399743398031}}
set_robot_commands_max	0.008011871850111459
set_robot_commands_mean	0.007950246428572807
set_robot_commands_median	0.007991348703702291
set_robot_commands_min	0.007862074375152588
sim_compute_performance-ego_max	0.007221319609218174
sim_compute_performance-ego_mean	0.007111421561166264
sim_compute_performance-ego_median	0.007112288475036621
sim_compute_performance-ego_min	0.007004360357920329
sim_compute_robot_state-ego_max	0.00942698721329652
sim_compute_robot_state-ego_mean	0.009322709555573495
sim_compute_robot_state-ego_median	0.00932002544403076
sim_compute_robot_state-ego_min	0.009192457993825277
sim_compute_sim_state_max	0.006113598346710205
sim_compute_sim_state_mean	0.006075510957917841
sim_compute_sim_state_median	0.006075731014615655
sim_compute_sim_state_min	0.006040441989898682
sim_physics_max	0.06260463429821862
sim_physics_mean	0.06178222667534398
sim_physics_median	0.06185881240629055
sim_physics_min	0.06100954612096151
sim_render-ego_max	0.012241931756337483
sim_render-ego_mean	0.012122919814231864
sim_render-ego_median	0.012182944233762923
sim_render-ego_min	0.011972145239512124
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.240000000000055
survival_time_min	7.199999999999982

No reset possible

32940

6621

Frank (Chude) Qian 🇨🇦

FrankNet-V2-2020_05_20

aido3-off-LF-sim-validation

step1-simulation

success

yes

p-1

2020-05-20 18:47:24+00:00

2020-05-20 18:54:15+00:00

0:06:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.426765386633715
survival_time_median	6.0499999999999865
deviation-center-line_median	0.24140297879774456
in-drivable-lane_median	1.0499999999999965

other stats

agent_compute-ego_max	0.08923582794252506
agent_compute-ego_mean	0.08766708658964403
agent_compute-ego_median	0.08767170349756877
agent_compute-ego_min	0.08632644732793172
deviation-center-line_max	0.930391674212644
deviation-center-line_mean	0.4640310313187433
deviation-center-line_min	0.17091470899015407
deviation-heading_max	2.9969869554418604
deviation-heading_mean	1.5742182413523365
deviation-heading_median	0.8348144990537572
deviation-heading_min	0.6385329881137966
driven_any_max	5.61283225953687
driven_any_mean	3.4954025715765495
driven_any_median	2.8383046215694487
driven_any_min	1.630545790317806
driven_lanedir_consec_max	4.9383447288101845
driven_lanedir_consec_mean	3.0209150334440964
driven_lanedir_consec_min	1.2272803404043853
driven_lanedir_max	4.9383447288101845
driven_lanedir_mean	3.021765149019042
driven_lanedir_median	2.426765386633715
driven_lanedir_min	1.2315309182791108
in-drivable-lane_max	3.4499999999999886
in-drivable-lane_mean	1.159999999999996
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 5.061456205507777, "sim_physics": 0.06142332951227824, "survival_time": 14.950000000000076, "driven_lanedir": 4.9383447288101845, "sim_render-ego": 0.01192081371943156, "in-drivable-lane": 0, "agent_compute-ego": 0.08767170349756877, "deviation-heading": 2.9969869554418604, "set_robot_commands": 0.008034974733988443, "deviation-center-line": 0.930391674212644, "driven_lanedir_consec": 4.9383447288101845, "sim_compute_sim_state": 0.0059702475865681965, "sim_compute_performance-ego": 0.007162502606709798, "sim_compute_robot_state-ego": 0.009320844014485677}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.61283225953687, "sim_physics": 0.062046780586242675, "survival_time": 14.950000000000076, "driven_lanedir": 4.261539591940344, "sim_render-ego": 0.012336288293202718, "in-drivable-lane": 3.4499999999999886, "agent_compute-ego": 0.08632644732793172, "deviation-heading": 2.670775924051269, "set_robot_commands": 0.007932447592417399, "deviation-center-line": 0.7555447224994729, "driven_lanedir_consec": 4.261539591940344, "sim_compute_sim_state": 0.005962669054667155, "sim_compute_performance-ego": 0.007235527038574219, "sim_compute_robot_state-ego": 0.00930463711420695}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.333873980950846, "sim_physics": 0.062349172738882214, "survival_time": 5.1999999999999895, "driven_lanedir": 2.250645119431853, "sim_render-ego": 0.012343278298011191, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.0878307567192958, "deviation-heading": 0.7299808401009987, "set_robot_commands": 0.008084994096022386, "deviation-center-line": 0.22190107209370125, "driven_lanedir_consec": 2.250645119431853, "sim_compute_sim_state": 0.006060836406854482, "sim_compute_performance-ego": 0.007160296806922326, "sim_compute_robot_state-ego": 0.009376028409371007}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.630545790317806, "sim_physics": 0.06230637695215925, "survival_time": 3.949999999999994, "driven_lanedir": 1.2315309182791108, "sim_render-ego": 0.012271304673786404, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.08727069746089887, "deviation-heading": 0.6385329881137966, "set_robot_commands": 0.008095032052148747, "deviation-center-line": 0.17091470899015407, "driven_lanedir_consec": 1.2272803404043853, "sim_compute_sim_state": 0.006139323681215697, "sim_compute_performance-ego": 0.007076927378207822, "sim_compute_robot_state-ego": 0.009361460239072387}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.8383046215694487, "sim_physics": 0.06105558143174353, "survival_time": 6.0499999999999865, "driven_lanedir": 2.426765386633715, "sim_render-ego": 0.01248753760471817, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.08923582794252506, "deviation-heading": 0.8348144990537572, "set_robot_commands": 0.007979501377452503, "deviation-center-line": 0.24140297879774456, "driven_lanedir_consec": 2.426765386633715, "sim_compute_sim_state": 0.0061265062694707195, "sim_compute_performance-ego": 0.007127050525885968, "sim_compute_robot_state-ego": 0.00943511970772231}}
set_robot_commands_max	0.008095032052148747
set_robot_commands_mean	0.008025389970405897
set_robot_commands_median	0.008034974733988443
set_robot_commands_min	0.007932447592417399
sim_compute_performance-ego_max	0.007235527038574219
sim_compute_performance-ego_mean	0.007152460871260027
sim_compute_performance-ego_median	0.007160296806922326
sim_compute_performance-ego_min	0.007076927378207822
sim_compute_robot_state-ego_max	0.00943511970772231
sim_compute_robot_state-ego_mean	0.009359617896971668
sim_compute_robot_state-ego_median	0.009361460239072387
sim_compute_robot_state-ego_min	0.00930463711420695
sim_compute_sim_state_max	0.006139323681215697
sim_compute_sim_state_mean	0.00605191659975525
sim_compute_sim_state_median	0.006060836406854482
sim_compute_sim_state_min	0.005962669054667155
sim_physics_max	0.062349172738882214
sim_physics_mean	0.06183624824426117
sim_physics_median	0.062046780586242675
sim_physics_min	0.06105558143174353
sim_render-ego_max	0.01248753760471817
sim_render-ego_mean	0.012271844517830009
sim_render-ego_median	0.012336288293202718
sim_render-ego_min	0.01192081371943156
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.020000000000024
survival_time_min	3.949999999999994

No reset possible

32931

6617

Charlie Gauthier 🇨🇦

Baseline solution using reinforcement learning

aido3-off-LF-sim-validation

step1-simulation

success

yes

p-1

2020-05-07 16:19:07+00:00

2020-05-07 16:22:29+00:00

0:03:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.09291727296657191
survival_time_median	1.3000000000000005
deviation-center-line_median	0.071074493431066
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.5082478237152099
agent_compute-ego_mean	0.3418581422309134
agent_compute-ego_median	0.3287603197426632
agent_compute-ego_min	0.24073752073141244
deviation-center-line_max	0.07922867380829339
deviation-center-line_mean	0.06773609887018966
deviation-center-line_min	0.041513585982916795
deviation-heading_max	0.9731553487410952
deviation-heading_mean	0.8113665657186591
deviation-heading_median	0.8358557173421256
deviation-heading_min	0.6244213415305281
driven_any_max	0.24833209227235467
driven_any_mean	0.17300000083168138
driven_any_median	0.16808333136948217
driven_any_min	0.10863812325718354
driven_lanedir_consec_max	0.20522123633364345
driven_lanedir_consec_mean	0.1070739033447268
driven_lanedir_consec_min	0.06250922618491472
driven_lanedir_max	0.20522123633364345
driven_lanedir_mean	0.1070739033447268
driven_lanedir_median	0.09291727296657191
driven_lanedir_min	0.06250922618491472
in-drivable-lane_max	0.15000000000000013
in-drivable-lane_mean	0.04000000000000003
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.14775341612113846, "sim_physics": 0.06222743254441481, "survival_time": 1.3000000000000005, "driven_lanedir": 0.06815540249411844, "sim_render-ego": 0.012416252723106973, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.24073752073141244, "deviation-heading": 0.8358557173421256, "set_robot_commands": 0.005892515182495117, "deviation-center-line": 0.041513585982916795, "driven_lanedir_consec": 0.06815540249411844, "sim_compute_sim_state": 0.0036334899755624626, "sim_compute_performance-ego": 0.007711327992952787, "sim_compute_robot_state-ego": 0.009111963785611668}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.10863812325718354, "sim_physics": 0.05870087146759033, "survival_time": 1.0000000000000002, "driven_lanedir": 0.06250922618491472, "sim_render-ego": 0.012319540977478028, "in-drivable-lane": 0, "agent_compute-ego": 0.2714504599571228, "deviation-heading": 0.6601433026866548, "set_robot_commands": 0.005277025699615479, "deviation-center-line": 0.0766651326585052, "driven_lanedir_consec": 0.06250922618491472, "sim_compute_sim_state": 0.00336989164352417, "sim_compute_performance-ego": 0.006474435329437256, "sim_compute_robot_state-ego": 0.009197056293487549}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1921930411382481, "sim_physics": 0.060817184119388974, "survival_time": 1.4500000000000006, "driven_lanedir": 0.10656637874438556, "sim_render-ego": 0.011626646436493972, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.3287603197426632, "deviation-heading": 0.963257118292892, "set_robot_commands": 0.006117820739746094, "deviation-center-line": 0.07922867380829339, "driven_lanedir_consec": 0.10656637874438556, "sim_compute_sim_state": 0.00350402963572535, "sim_compute_performance-ego": 0.0068010461741480335, "sim_compute_robot_state-ego": 0.008809434956517714}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.24833209227235467, "sim_physics": 0.05871266523996989, "survival_time": 1.5000000000000009, "driven_lanedir": 0.20522123633364345, "sim_render-ego": 0.011784633000691732, "in-drivable-lane": 0, "agent_compute-ego": 0.3600945870081584, "deviation-heading": 0.6244213415305281, "set_robot_commands": 0.005459801355997721, "deviation-center-line": 0.071074493431066, "driven_lanedir_consec": 0.20522123633364345, "sim_compute_sim_state": 0.003187235196431478, "sim_compute_performance-ego": 0.006557766596476237, "sim_compute_robot_state-ego": 0.008178504308064778}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16808333136948217, "sim_physics": 0.06719083786010742, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09291727296657191, "sim_render-ego": 0.011731681823730468, "in-drivable-lane": 0, "agent_compute-ego": 0.5082478237152099, "deviation-heading": 0.9731553487410952, "set_robot_commands": 0.006027889251708984, "deviation-center-line": 0.07019860847016697, "driven_lanedir_consec": 0.09291727296657191, "sim_compute_sim_state": 0.0034319114685058593, "sim_compute_performance-ego": 0.0066846275329589845, "sim_compute_robot_state-ego": 0.00849848747253418}}
set_robot_commands_max	0.006117820739746094
set_robot_commands_mean	0.005755010445912679
set_robot_commands_median	0.005892515182495117
set_robot_commands_min	0.005277025699615479
sim_compute_performance-ego_max	0.007711327992952787
sim_compute_performance-ego_mean	0.00684584072519466
sim_compute_performance-ego_median	0.0066846275329589845
sim_compute_performance-ego_min	0.006474435329437256
sim_compute_robot_state-ego_max	0.009197056293487549
sim_compute_robot_state-ego_mean	0.008759089363243178
sim_compute_robot_state-ego_median	0.008809434956517714
sim_compute_robot_state-ego_min	0.008178504308064778
sim_compute_sim_state_max	0.0036334899755624626
sim_compute_sim_state_mean	0.0034253115839498636
sim_compute_sim_state_median	0.0034319114685058593
sim_compute_sim_state_min	0.003187235196431478
sim_physics_max	0.06719083786010742
sim_physics_mean	0.06152979824629429
sim_physics_median	0.060817184119388974
sim_physics_min	0.05870087146759033
sim_render-ego_max	0.012416252723106973
sim_render-ego_mean	0.011975750992300234
sim_render-ego_median	0.011784633000691732
sim_render-ego_min	0.011626646436493972
simulation-passed	1
survival_time_max	1.5000000000000009
survival_time_mean	1.3000000000000005
survival_time_min	1.0000000000000002

No reset possible

32928

6615

Diego Charrez 🇵🇪

Baseline solution using reinforcement learning

aido3-off-LF-sim-validation

step1-simulation

success

yes

p-1

2020-04-26 23:52:24+00:00

2020-04-27 00:00:58+00:00

0:08:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.032834701315573867
survival_time_median	14.950000000000076
deviation-center-line_median	0.22603300850982153
in-drivable-lane_median	7.450000000000041

other stats

agent_compute-ego_max	0.20235657771428425
agent_compute-ego_mean	0.09194383978250607
agent_compute-ego_median	0.05342114130655924
agent_compute-ego_min	0.037852840423583986
deviation-center-line_max	0.5070462812054469
deviation-center-line_mean	0.30258234292379294
deviation-center-line_min	0.1600455628100333
deviation-heading_max	5.919535408646731
deviation-heading_mean	5.355449024771847
deviation-heading_median	5.621958056898286
deviation-heading_min	4.0102381748383005
driven_any_max	0.2973552447856686
driven_any_mean	0.2616427940682816
driven_any_median	0.2718130274921768
driven_any_min	0.1929748734005603
driven_lanedir_consec_max	0.06209368167871876
driven_lanedir_consec_mean	0.036678949203591896
driven_lanedir_consec_min	0.02300110286591983
driven_lanedir_max	0.06209368167871876
driven_lanedir_mean	0.036678949203591896
driven_lanedir_median	0.032834701315573867
driven_lanedir_min	0.02300110286591983
in-drivable-lane_max	7.650000000000045
in-drivable-lane_mean	6.920000000000033
in-drivable-lane_min	4.850000000000003
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2973552447856686, "sim_physics": 0.05716945171356201, "survival_time": 14.950000000000076, "driven_lanedir": 0.032834701315573867, "sim_render-ego": 0.01208681583404541, "in-drivable-lane": 7.050000000000034, "agent_compute-ego": 0.20235657771428425, "deviation-heading": 5.919535408646731, "set_robot_commands": 0.005681440830230713, "deviation-center-line": 0.4560558353806685, "driven_lanedir_consec": 0.032834701315573867, "sim_compute_sim_state": 0.003442973295847575, "sim_compute_performance-ego": 0.007257760365804037, "sim_compute_robot_state-ego": 0.008812331358591715}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1929748734005603, "sim_physics": 0.05880024777122991, "survival_time": 10.050000000000008, "driven_lanedir": 0.030190992013701567, "sim_render-ego": 0.012493038651955068, "in-drivable-lane": 4.850000000000003, "agent_compute-ego": 0.12747391658042795, "deviation-heading": 4.0102381748383005, "set_robot_commands": 0.006184529309249043, "deviation-center-line": 0.5070462812054469, "driven_lanedir_consec": 0.030190992013701567, "sim_compute_sim_state": 0.003854368456560581, "sim_compute_performance-ego": 0.007223421068333868, "sim_compute_robot_state-ego": 0.009486143861837056}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2772015718359469, "sim_physics": 0.0591789444287618, "survival_time": 14.950000000000076, "driven_lanedir": 0.03527426814404544, "sim_render-ego": 0.013140515486399332, "in-drivable-lane": 7.600000000000041, "agent_compute-ego": 0.05342114130655924, "deviation-heading": 5.621958056898286, "set_robot_commands": 0.006663813591003418, "deviation-center-line": 0.22603300850982153, "driven_lanedir_consec": 0.03527426814404544, "sim_compute_sim_state": 0.004236955642700196, "sim_compute_performance-ego": 0.007446398735046387, "sim_compute_robot_state-ego": 0.009993249575297038}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2688692528270556, "sim_physics": 0.06028248230616252, "survival_time": 14.950000000000076, "driven_lanedir": 0.02300110286591983, "sim_render-ego": 0.013049771785736084, "in-drivable-lane": 7.650000000000045, "agent_compute-ego": 0.038614722887674965, "deviation-heading": 5.35979209835435, "set_robot_commands": 0.006799915631612142, "deviation-center-line": 0.1600455628100333, "driven_lanedir_consec": 0.02300110286591983, "sim_compute_sim_state": 0.004336976210276286, "sim_compute_performance-ego": 0.00753108024597168, "sim_compute_robot_state-ego": 0.00988948424657186}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2718130274921768, "sim_physics": 0.05975876490275065, "survival_time": 14.950000000000076, "driven_lanedir": 0.06209368167871876, "sim_render-ego": 0.013092602888743084, "in-drivable-lane": 7.450000000000041, "agent_compute-ego": 0.037852840423583986, "deviation-heading": 5.865721385121568, "set_robot_commands": 0.006793669064839681, "deviation-center-line": 0.1637310267129944, "driven_lanedir_consec": 0.06209368167871876, "sim_compute_sim_state": 0.004283026854197184, "sim_compute_performance-ego": 0.007442830403645833, "sim_compute_robot_state-ego": 0.009885415236155192}}
set_robot_commands_max	0.006799915631612142
set_robot_commands_mean	0.006424673685387
set_robot_commands_median	0.006663813591003418
set_robot_commands_min	0.005681440830230713
sim_compute_performance-ego_max	0.00753108024597168
sim_compute_performance-ego_mean	0.007380298163760362
sim_compute_performance-ego_median	0.007442830403645833
sim_compute_performance-ego_min	0.007223421068333868
sim_compute_robot_state-ego_max	0.009993249575297038
sim_compute_robot_state-ego_mean	0.009613324855690572
sim_compute_robot_state-ego_median	0.009885415236155192
sim_compute_robot_state-ego_min	0.008812331358591715
sim_compute_sim_state_max	0.004336976210276286
sim_compute_sim_state_mean	0.004030860091916364
sim_compute_sim_state_median	0.004236955642700196
sim_compute_sim_state_min	0.003442973295847575
sim_physics_max	0.06028248230616252
sim_physics_mean	0.05903797822449338
sim_physics_median	0.0591789444287618
sim_physics_min	0.05716945171356201
sim_render-ego_max	0.013140515486399332
sim_render-ego_mean	0.012772548929375797
sim_render-ego_median	0.013049771785736084
sim_render-ego_min	0.01208681583404541
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.97000000000006
survival_time_min	10.050000000000008

No reset possible

ID	1729
evaluator	`p-1`
owner	I don't have one 😀
machine	fb2fa6930b5e
process	p-1
version	d-c:5.1.1;d-c-r:5.0.12;d-s:5.1.2
first heard	2020-03-23 17:44:06+00:00
last heard	2020-07-21 15:43:13+00:00
status	inactive
# evaluating
# success	5 `32928`
# timeout
# failed
# error	3 `32961`
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator 1729

Evaluator jobs