Evaluator 1173

ID	1173
evaluator	`ip-172-31-25-98-2470`
owner	I don't have one 😀
machine	ip-172-31-25-98
process	ip-172-31-25-98-2470
version	d-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard	2019-05-16 13:48:39+00:00
last heard	2019-05-17 15:38:25+00:00
status	inactive
# evaluating
# success	21 `22241`
# timeout
# failed	5 `22280`
# error	23 `22232`
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

23073

3556

Amaury Camus 🇨🇭

Running the real lane following -- without challenge container

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-17 09:53:13+00:00

2019-05-17 10:00:33+00:00

0:07:20

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23034

2362

Andrea Censi 🇨🇭

random_agent

aido2-LF-sim-testing

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-17 05:41:59+00:00

2019-05-17 05:55:46+00:00

0:13:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.15090447443502922
agent_compute-ego_mean	0.1185937108788488
agent_compute-ego_median	0.11471947917231808
agent_compute-ego_min	0.10792909883985333
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.14575827563250507, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06721985340118408, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15090447443502922, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10496150564264368, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.042100495762295194, "sim_compute_performance-ego": 0.07518159018622504, "sim_compute_robot_state-ego": 0.082623525902077}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.13575011141159954, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06697481753779393, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14235472211650774, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10425767711564608, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04311568129296396, "sim_compute_performance-ego": 0.07202337302413642, "sim_compute_robot_state-ego": 0.07715502439760695}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.10163391337675208, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05093003721798167, "in-drivable-lane": 0, "agent_compute-ego": 0.1196116699891932, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.07140541076660156, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.034301042556762695, "sim_compute_performance-ego": 0.05468103464911966, "sim_compute_robot_state-ego": 0.05828595161437988}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.09659196853637696, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.05043734550476074, "in-drivable-lane": 0, "agent_compute-ego": 0.1200883960723877, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.07468162536621094, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03173317909240723, "sim_compute_performance-ego": 0.05517707824707031, "sim_compute_robot_state-ego": 0.06198554039001465}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.09147591832317883, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05097987380208848, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.10953628865978386, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.07502088365675527, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03169364868840085, "sim_compute_performance-ego": 0.05431608006924014, "sim_compute_robot_state-ego": 0.058266736284086976}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.10383771390331034, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.05735231418998874, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.12016099813033124, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.08892883573259626, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.03668774877275739, "sim_compute_performance-ego": 0.06286044023474868, "sim_compute_robot_state-ego": 0.06655040079233598}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.09533847655568804, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.05303770729473659, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.11249248470578876, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.07974953736577715, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.035365172794887, "sim_compute_performance-ego": 0.05876902597291129, "sim_compute_robot_state-ego": 0.06006761533873422}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.10192236446198964, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.05386279878162202, "in-drivable-lane": 0, "agent_compute-ego": 0.1160418533143543, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.07715914362952822, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.032301164808727446, "sim_compute_performance-ego": 0.05783438682556152, "sim_compute_robot_state-ego": 0.06083822250366211}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.10251569747924805, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.055562294135659426, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.11843008106037722, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.08356470980886686, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.034590397850941805, "sim_compute_performance-ego": 0.06167299464597541, "sim_compute_robot_state-ego": 0.06451574826644639}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.09720675295049494, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.05151456052606756, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.11249506256797095, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.07748713926835493, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.03275138248096813, "sim_compute_performance-ego": 0.05666275024414062, "sim_compute_robot_state-ego": 0.06259374618530274}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.09313075573413404, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.05267805248111874, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1123316814373066, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.07948744142210329, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.03343233504852691, "sim_compute_performance-ego": 0.058415341686892816, "sim_compute_robot_state-ego": 0.0680083485392781}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.09729539496558053, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.05622054849352155, "in-drivable-lane": 0, "agent_compute-ego": 0.11167140517915998, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.07437019688742501, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.03305073295320783, "sim_compute_performance-ego": 0.06264271054949079, "sim_compute_robot_state-ego": 0.06445302282060895}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.08797407150268555, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.05096001251071107, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.10792909883985333, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.07537156460331935, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.032886201260136624, "sim_compute_performance-ego": 0.0555724957410027, "sim_compute_robot_state-ego": 0.058497227874456666}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.09035390394705312, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.050094560340598775, "in-drivable-lane": 0, "agent_compute-ego": 0.11471947917231808, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.07509509722391765, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.031841534155386465, "sim_compute_performance-ego": 0.05636458926730686, "sim_compute_robot_state-ego": 0.05948119693332248}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.0846933640685736, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.050951639811197914, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.1101379675023696, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.07592467934477563, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.0314552059360579, "sim_compute_performance-ego": 0.05633037931778852, "sim_compute_robot_state-ego": 0.06016798346650367}}
set_robot_commands_max	0.10496150564264368
set_robot_commands_mean	0.08116436318896812
set_robot_commands_median	0.07715914362952822
set_robot_commands_min	0.07140541076660156
sim_compute_performance-ego_max	0.07518159018622504
sim_compute_performance-ego_mean	0.05990028471077404
sim_compute_performance-ego_median	0.05783438682556152
sim_compute_performance-ego_min	0.05431608006924014
sim_compute_robot_state-ego_max	0.082623525902077
sim_compute_robot_state-ego_mean	0.06423268608725445
sim_compute_robot_state-ego_median	0.06198554039001465
sim_compute_robot_state-ego_min	0.058266736284086976
sim_compute_sim_state_max	0.04311568129296396
sim_compute_sim_state_mean	0.0344870615636285
sim_compute_sim_state_median	0.03305073295320783
sim_compute_sim_state_min	0.0314552059360579
sim_physics_max	0.14575827563250507
sim_physics_mean	0.10169857885661136
sim_physics_median	0.09720675295049494
sim_physics_min	0.0846933640685736
sim_render-ego_max	0.06721985340118408
sim_render-ego_mean	0.05458509440193541
sim_render-ego_median	0.05267805248111874
sim_render-ego_min	0.050094560340598775
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

23022

2375

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

aido2-LF-sim-testing

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-17 05:20:23+00:00

2019-05-17 05:40:43+00:00

0:20:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6560989890090594
survival_time_median	3.649999999999995
deviation-center-line_median	0.14678748740599404
in-drivable-lane_median	0.34999999999999876

other stats

agent_compute-ego_max	0.07209179825978736
agent_compute-ego_mean	0.06758519305273342
agent_compute-ego_median	0.06859314228807177
agent_compute-ego_min	0.051842579970488675
deviation-center-line_max	0.4005818627784723
deviation-center-line_mean	0.19535396696552737
deviation-center-line_min	0.12422801598242109
deviation-heading_max	1.0645521116851462
deviation-heading_mean	0.5821209778469638
deviation-heading_median	0.5423458590238992
deviation-heading_min	0.29987290367335917
driven_any_max	2.1648273185719797
driven_any_mean	0.9348502469008624
driven_any_median	0.9948273195001768
driven_any_min	0.2750262368649079
driven_lanedir_consec_max	2.0050790504729665
driven_lanedir_consec_mean	0.738495147174259
driven_lanedir_consec_min	0.2671322113623069
driven_lanedir_max	2.0050790504729665
driven_lanedir_mean	0.738495147174259
driven_lanedir_median	0.6560989890090594
driven_lanedir_min	0.2671322113623069
in-drivable-lane_max	1.5499999999999945
in-drivable-lane_mean	0.5433333333333313
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.12533506301984396, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.06623670499618739, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0707444426131575, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.10569999969168883, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.0417018034686781, "sim_compute_performance-ego": 0.07593215654974114, "sim_compute_robot_state-ego": 0.08581738929225974}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.009827319290899, "sim_physics": 0.111672221003352, "survival_time": 3.699999999999995, "driven_lanedir": 0.8760331754635476, "sim_render-ego": 0.06383419036865234, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.06460965001905286, "deviation-heading": 1.047774623333474, "set_robot_commands": 0.0966546277742128, "deviation-center-line": 0.29642020115014733, "driven_lanedir_consec": 0.8760331754635476, "sim_compute_sim_state": 0.04164726991911192, "sim_compute_performance-ego": 0.0712896069964847, "sim_compute_robot_state-ego": 0.0771898063453468}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2750262368649079, "sim_physics": 0.13439103126525878, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2671322113623069, "sim_render-ego": 0.06533352851867676, "in-drivable-lane": 0, "agent_compute-ego": 0.06736084938049317, "deviation-heading": 0.3001803644882976, "set_robot_commands": 0.09313840866088868, "deviation-center-line": 0.12422801598242109, "driven_lanedir_consec": 0.2671322113623069, "sim_compute_sim_state": 0.03871442794799805, "sim_compute_performance-ego": 0.07005731582641601, "sim_compute_robot_state-ego": 0.07454339981079101}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4548365617710419, "sim_physics": 0.1236608479474042, "survival_time": 1.850000000000001, "driven_lanedir": 0.4333629680464388, "sim_render-ego": 0.061958061682211386, "in-drivable-lane": 0, "agent_compute-ego": 0.06768019134933884, "deviation-heading": 0.5707543029776994, "set_robot_commands": 0.09602139447186445, "deviation-center-line": 0.12501321046442526, "driven_lanedir_consec": 0.4333629680464388, "sim_compute_sim_state": 0.041993353817913984, "sim_compute_performance-ego": 0.07078346046241554, "sim_compute_robot_state-ego": 0.07428789783168484}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5798273185719856, "sim_physics": 0.12039540920938764, "survival_time": 5.599999999999988, "driven_lanedir": 1.1257539445961453, "sim_render-ego": 0.06481583416461945, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.06859314228807177, "deviation-heading": 0.31699480744097813, "set_robot_commands": 0.099961485181536, "deviation-center-line": 0.4005818627784723, "driven_lanedir_consec": 1.1257539445961453, "sim_compute_sim_state": 0.04112331782068525, "sim_compute_performance-ego": 0.07156882115772792, "sim_compute_robot_state-ego": 0.07865693739482335}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.454836561771035, "sim_physics": 0.14149695473748283, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295977528045558, "sim_render-ego": 0.0682466610057934, "in-drivable-lane": 0, "agent_compute-ego": 0.06962898615244273, "deviation-heading": 0.6191860504142409, "set_robot_commands": 0.10470951570046914, "deviation-center-line": 0.13177329190693754, "driven_lanedir_consec": 0.4295977528045558, "sim_compute_sim_state": 0.04156313715754328, "sim_compute_performance-ego": 0.07380382434741871, "sim_compute_robot_state-ego": 0.07786806854041847}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0248273191286392, "sim_physics": 0.1286488978068034, "survival_time": 3.7499999999999942, "driven_lanedir": 0.5418367454355217, "sim_render-ego": 0.06740750948588053, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.07059236208597819, "deviation-heading": 0.5423458590238992, "set_robot_commands": 0.09984731356302898, "deviation-center-line": 0.14678748740599404, "driven_lanedir_consec": 0.5418367454355217, "sim_compute_sim_state": 0.042226123809814456, "sim_compute_performance-ego": 0.07454467455546061, "sim_compute_robot_state-ego": 0.0785951042175293}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3049465552081734, "sim_physics": 0.12590600826122142, "survival_time": 1.3500000000000003, "driven_lanedir": 0.29745564201515107, "sim_render-ego": 0.06826369850723832, "in-drivable-lane": 0, "agent_compute-ego": 0.06691541495146575, "deviation-heading": 0.29987290367335917, "set_robot_commands": 0.10202311586450648, "deviation-center-line": 0.1306820468362013, "driven_lanedir_consec": 0.29745564201515107, "sim_compute_sim_state": 0.040814744101630315, "sim_compute_performance-ego": 0.07954993954411259, "sim_compute_robot_state-ego": 0.0890966256459554}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.7098274382089755, "sim_physics": 0.12025599126462584, "survival_time": 2.6999999999999984, "driven_lanedir": 0.7032085791835883, "sim_render-ego": 0.06493922957667599, "in-drivable-lane": 0, "agent_compute-ego": 0.0695848994784885, "deviation-heading": 0.36899467884091897, "set_robot_commands": 0.0996176799138387, "deviation-center-line": 0.18371297048277177, "driven_lanedir_consec": 0.7032085791835883, "sim_compute_sim_state": 0.04079538804513437, "sim_compute_performance-ego": 0.07327796353234185, "sim_compute_robot_state-ego": 0.07564389705657959}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9948273195001768, "sim_physics": 0.13081961135341696, "survival_time": 3.649999999999995, "driven_lanedir": 0.6560989890090594, "sim_render-ego": 0.06792803986431802, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.06745528848203894, "deviation-heading": 0.6658599650846626, "set_robot_commands": 0.10067318563591944, "deviation-center-line": 0.1561741058626541, "driven_lanedir_consec": 0.6560989890090594, "sim_compute_sim_state": 0.041726102567698854, "sim_compute_performance-ego": 0.07684120413375227, "sim_compute_robot_state-ego": 0.08318378827343248}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5798273185720009, "sim_physics": 0.12437527520315989, "survival_time": 5.599999999999988, "driven_lanedir": 1.2014600726933682, "sim_render-ego": 0.0656459629535675, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06711894273757935, "deviation-heading": 0.5156620482368139, "set_robot_commands": 0.09772745413439614, "deviation-center-line": 0.20858216306835017, "driven_lanedir_consec": 1.2014600726933682, "sim_compute_sim_state": 0.04127084357397897, "sim_compute_performance-ego": 0.07285428898675102, "sim_compute_robot_state-ego": 0.0795153294290815}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0098273192909009, "sim_physics": 0.08866000497663343, "survival_time": 3.699999999999995, "driven_lanedir": 0.6405535448452877, "sim_render-ego": 0.0508708889419968, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.051842579970488675, "deviation-heading": 1.0645521116851462, "set_robot_commands": 0.07455145346151816, "deviation-center-line": 0.2228681204106694, "driven_lanedir_consec": 0.6405535448452877, "sim_compute_sim_state": 0.030837854823550663, "sim_compute_performance-ego": 0.05634660656387742, "sim_compute_robot_state-ego": 0.05690912620441334}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9948273195001752, "sim_physics": 0.11515083704909232, "survival_time": 3.649999999999995, "driven_lanedir": 0.7695653387571403, "sim_render-ego": 0.06251164658428872, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.07209179825978736, "deviation-heading": 0.4813700122068389, "set_robot_commands": 0.09772268060135517, "deviation-center-line": 0.1442443284046606, "driven_lanedir_consec": 0.7695653387571403, "sim_compute_sim_state": 0.03991619854757231, "sim_compute_performance-ego": 0.06994176890752087, "sim_compute_robot_state-ego": 0.0747600744848382}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.4698344777618675, "sim_physics": 0.14442910646137438, "survival_time": 1.900000000000001, "driven_lanedir": 0.4595449996397094, "sim_render-ego": 0.06771891368062873, "in-drivable-lane": 0, "agent_compute-ego": 0.07054565454784192, "deviation-heading": 0.398367781186276, "set_robot_commands": 0.10598785626260858, "deviation-center-line": 0.1252701007981349, "driven_lanedir_consec": 0.4595449996397094, "sim_compute_sim_state": 0.042283171101620325, "sim_compute_performance-ego": 0.08167983356275056, "sim_compute_robot_state-ego": 0.0916382764515124}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1648273185719797, "sim_physics": 0.12519784636844863, "survival_time": 7.549999999999981, "driven_lanedir": 2.0050790504729665, "sim_render-ego": 0.06655987524828375, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.06901369347477591, "deviation-heading": 0.9808458191188588, "set_robot_commands": 0.1024602675280034, "deviation-center-line": 0.3896160126120228, "driven_lanedir_consec": 2.0050790504729665, "sim_compute_sim_state": 0.04174732056674579, "sim_compute_performance-ego": 0.07515954813420378, "sim_compute_robot_state-ego": 0.08142730573944698}}
set_robot_commands_max	0.10598785626260858
set_robot_commands_mean	0.098453095896389
set_robot_commands_median	0.09984731356302898
set_robot_commands_min	0.07455145346151816
sim_compute_performance-ego_max	0.08167983356275056
sim_compute_performance-ego_mean	0.07290873421739835
sim_compute_performance-ego_median	0.07327796353234185
sim_compute_performance-ego_min	0.05634660656387742
sim_compute_robot_state-ego_max	0.0916382764515124
sim_compute_robot_state-ego_mean	0.07860886844787424
sim_compute_robot_state-ego_median	0.0785951042175293
sim_compute_robot_state-ego_min	0.05690912620441334
sim_compute_sim_state_max	0.042283171101620325
sim_compute_sim_state_mean	0.04055740381797844
sim_compute_sim_state_median	0.04156313715754328
sim_compute_sim_state_min	0.030837854823550663
sim_physics_max	0.14442910646137438
sim_physics_mean	0.12402634039516704
sim_physics_median	0.12519784636844863
sim_physics_min	0.08866000497663343
sim_render-ego_max	0.06826369850723832
sim_render-ego_mean	0.06481804970526796
sim_render-ego_median	0.0656459629535675
sim_render-ego_min	0.0508708889419968
simulation-passed	1
survival_time_max	7.549999999999981
survival_time_mean	3.4499999999999957
survival_time_min	1.2500000000000004

No reset possible

23016

2384

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-17 05:13:16+00:00

2019-05-17 05:19:33+00:00

0:06:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.13345567761525645
survival_time_median	1.4500000000000006
deviation-center-line_median	0.07994867355059224
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.20640527407328288
agent_compute-ego_mean	0.1858920439042135
agent_compute-ego_median	0.18367331027984615
agent_compute-ego_min	0.1754624679170806
deviation-center-line_max	0.09414146261203196
deviation-center-line_mean	0.07965280017659804
deviation-center-line_min	0.06429098237112439
deviation-heading_max	1.040571163828749
deviation-heading_mean	0.8224223998869524
deviation-heading_median	0.8075766753179461
deviation-heading_min	0.5452065286724291
driven_any_max	0.22865938272464795
driven_any_mean	0.1895107621062161
driven_any_median	0.1939187946716417
driven_any_min	0.12385415773979284
driven_lanedir_consec_max	0.15130782181678004
driven_lanedir_consec_mean	0.12257042208901904
driven_lanedir_consec_min	0.0921415187824457
driven_lanedir_max	0.15130782181678004
driven_lanedir_mean	0.12257042208901904
driven_lanedir_median	0.13345567761525645
driven_lanedir_min	0.0921415187824457
in-drivable-lane_max	0.10000000000000007
in-drivable-lane_mean	0.020000000000000014
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22865938272464795, "sim_physics": 0.14211754645070723, "survival_time": 1.5500000000000007, "driven_lanedir": 0.13345567761525645, "sim_render-ego": 0.06898718495522776, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.18595345558658724, "deviation-heading": 0.9186906071993328, "set_robot_commands": 0.09925514651883031, "deviation-center-line": 0.0877966996808764, "driven_lanedir_consec": 0.13345567761525645, "sim_compute_sim_state": 0.041593213235178304, "sim_compute_performance-ego": 0.07702749006209834, "sim_compute_robot_state-ego": 0.08907461166381836}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1939187946716417, "sim_physics": 0.12360713399689773, "survival_time": 1.4500000000000006, "driven_lanedir": 0.13350899521061765, "sim_render-ego": 0.0654771245759109, "in-drivable-lane": 0, "agent_compute-ego": 0.1754624679170806, "deviation-heading": 0.8075766753179461, "set_robot_commands": 0.09932811506863298, "deviation-center-line": 0.06429098237112439, "driven_lanedir_consec": 0.13350899521061765, "sim_compute_sim_state": 0.04154490602427516, "sim_compute_performance-ego": 0.07495494546561406, "sim_compute_robot_state-ego": 0.07884983358712032}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12385415773979284, "sim_physics": 0.13712034225463868, "survival_time": 1.0000000000000002, "driven_lanedir": 0.0921415187824457, "sim_render-ego": 0.06819539070129395, "in-drivable-lane": 0, "agent_compute-ego": 0.18367331027984615, "deviation-heading": 0.5452065286724291, "set_robot_commands": 0.10622103214263916, "deviation-center-line": 0.09414146261203196, "driven_lanedir_consec": 0.0921415187824457, "sim_compute_sim_state": 0.04230225086212158, "sim_compute_performance-ego": 0.07826724052429199, "sim_compute_robot_state-ego": 0.07937324047088623}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18470139300616736, "sim_physics": 0.14238509425410517, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1024380970199954, "sim_render-ego": 0.06310428513420953, "in-drivable-lane": 0, "agent_compute-ego": 0.17796571166427047, "deviation-heading": 1.040571163828749, "set_robot_commands": 0.10401185353597003, "deviation-center-line": 0.07994867355059224, "driven_lanedir_consec": 0.1024380970199954, "sim_compute_sim_state": 0.04191563747547291, "sim_compute_performance-ego": 0.06937212414211696, "sim_compute_robot_state-ego": 0.08047486234594274}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2164200823888306, "sim_physics": 0.15296494166056315, "survival_time": 1.5000000000000009, "driven_lanedir": 0.15130782181678004, "sim_render-ego": 0.07161684036254883, "in-drivable-lane": 0, "agent_compute-ego": 0.20640527407328288, "deviation-heading": 0.800067024416305, "set_robot_commands": 0.11073330243428547, "deviation-center-line": 0.07208618266836517, "driven_lanedir_consec": 0.15130782181678004, "sim_compute_sim_state": 0.04479451974232992, "sim_compute_performance-ego": 0.08233864307403564, "sim_compute_robot_state-ego": 0.09976640542348228}}
set_robot_commands_max	0.11073330243428547
set_robot_commands_mean	0.1039098899400716
set_robot_commands_median	0.10401185353597003
set_robot_commands_min	0.09925514651883031
sim_compute_performance-ego_max	0.08233864307403564
sim_compute_performance-ego_mean	0.0763920886536314
sim_compute_performance-ego_median	0.07702749006209834
sim_compute_performance-ego_min	0.06937212414211696
sim_compute_robot_state-ego_max	0.09976640542348228
sim_compute_robot_state-ego_mean	0.08550779069824999
sim_compute_robot_state-ego_median	0.08047486234594274
sim_compute_robot_state-ego_min	0.07884983358712032
sim_compute_sim_state_max	0.04479451974232992
sim_compute_sim_state_mean	0.04243010546787558
sim_compute_sim_state_median	0.04191563747547291
sim_compute_sim_state_min	0.04154490602427516
sim_physics_max	0.15296494166056315
sim_physics_mean	0.1396390117233824
sim_physics_median	0.14211754645070723
sim_physics_min	0.12360713399689773
sim_render-ego_max	0.07161684036254883
sim_render-ego_mean	0.0674761651458382
sim_render-ego_median	0.06819539070129395
sim_render-ego_min	0.06310428513420953
simulation-passed	1
survival_time_max	1.5500000000000007
survival_time_mean	1.3700000000000006
survival_time_min	1.0000000000000002

No reset possible

23007

2396

Liam Paull 🇨🇦

random_agent

aido2-LFV-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-17 05:03:16+00:00

2019-05-17 05:12:35+00:00

0:09:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.15397053956985474
agent_compute-ego_mean	0.1480917702151118
agent_compute-ego_median	0.14782419083993645
agent_compute-ego_min	0.13978649139404298
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.12651756552531995
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599273
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811214
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589035
driven_any_mean	1.0272530755098266
driven_any_median	1.0243289631429708
driven_any_min	0.4119037580118998
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.18380938635932076, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.0684723280094288, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14674325784047446, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.101191485369647, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0430073031672725, "sim_compute_performance-ego": 0.07618929721690991, "sim_compute_robot_state-ego": 0.08006982450132016, "sim_compute_robot_state-npc0": 0.07376652735250967, "sim_compute_robot_state-npc1": 0.07581934222468624, "sim_compute_robot_state-npc2": 0.07599559978202537, "sim_compute_robot_state-npc3": 0.07800661192999946}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.2189486503601074, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06621910095214843, "in-drivable-lane": 0, "agent_compute-ego": 0.13978649139404298, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.10495659828186037, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.044588470458984376, "sim_compute_performance-ego": 0.07639209747314453, "sim_compute_robot_state-ego": 0.07870147705078125, "sim_compute_robot_state-npc0": 0.07579483032226562, "sim_compute_robot_state-npc1": 0.07830813407897949, "sim_compute_robot_state-npc2": 0.07472768783569336, "sim_compute_robot_state-npc3": 0.07954666137695313}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.18910220735951477, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06501994634929456, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.15213437143125033, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.1013270428306178, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.04057472944259643, "sim_compute_performance-ego": 0.07470105510008962, "sim_compute_robot_state-ego": 0.07754342493258025, "sim_compute_robot_state-npc0": 0.07065721562034205, "sim_compute_robot_state-npc1": 0.07254885999779952, "sim_compute_robot_state-npc2": 0.07330545939897236, "sim_compute_robot_state-npc3": 0.07025598224840666}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.2117893575113031, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.0669332274907752, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.14782419083993645, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.10539818111854264, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04455892043777659, "sim_compute_performance-ego": 0.07426412196099004, "sim_compute_robot_state-ego": 0.08008031905451908, "sim_compute_robot_state-npc0": 0.07798314396339127, "sim_compute_robot_state-npc1": 0.07417843009852156, "sim_compute_robot_state-npc2": 0.07611581645434416, "sim_compute_robot_state-npc3": 0.07669291918790794}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.18715801409312657, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06525789839880806, "in-drivable-lane": 0, "agent_compute-ego": 0.15397053956985474, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0991625019482204, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04875373840332031, "sim_compute_performance-ego": 0.07301745244434901, "sim_compute_robot_state-ego": 0.07318781954901558, "sim_compute_robot_state-npc0": 0.07049942016601562, "sim_compute_robot_state-npc1": 0.07682983364377703, "sim_compute_robot_state-npc2": 0.07074805668422154, "sim_compute_robot_state-npc3": 0.07320293358394078}}
set_robot_commands_max	0.10539818111854264
set_robot_commands_mean	0.10240716190977764
set_robot_commands_median	0.1013270428306178
set_robot_commands_min	0.0991625019482204
sim_compute_performance-ego_max	0.07639209747314453
sim_compute_performance-ego_mean	0.07491280483909661
sim_compute_performance-ego_median	0.07470105510008962
sim_compute_performance-ego_min	0.07301745244434901
sim_compute_robot_state-ego_max	0.08008031905451908
sim_compute_robot_state-ego_mean	0.07791657301764326
sim_compute_robot_state-ego_median	0.07870147705078125
sim_compute_robot_state-ego_min	0.07318781954901558
sim_compute_robot_state-npc0_max	0.07798314396339127
sim_compute_robot_state-npc0_mean	0.07374022748490486
sim_compute_robot_state-npc0_median	0.07376652735250967
sim_compute_robot_state-npc0_min	0.07049942016601562
sim_compute_robot_state-npc1_max	0.07830813407897949
sim_compute_robot_state-npc1_mean	0.07553692000875277
sim_compute_robot_state-npc1_median	0.07581934222468624
sim_compute_robot_state-npc1_min	0.07254885999779952
sim_compute_robot_state-npc2_max	0.07611581645434416
sim_compute_robot_state-npc2_mean	0.07417852403105137
sim_compute_robot_state-npc2_median	0.07472768783569336
sim_compute_robot_state-npc2_min	0.07074805668422154
sim_compute_robot_state-npc3_max	0.07954666137695313
sim_compute_robot_state-npc3_mean	0.07554102166544159
sim_compute_robot_state-npc3_median	0.07669291918790794
sim_compute_robot_state-npc3_min	0.07025598224840666
sim_compute_sim_state_max	0.04875373840332031
sim_compute_sim_state_mean	0.04429663238199004
sim_compute_sim_state_median	0.04455892043777659
sim_compute_sim_state_min	0.04057472944259643
sim_physics_max	0.2189486503601074
sim_physics_mean	0.1981615231366745
sim_physics_median	0.18910220735951477
sim_physics_min	0.18380938635932076
sim_render-ego_max	0.0684723280094288
sim_render-ego_mean	0.06638050024009101
sim_render-ego_median	0.06621910095214843
sim_render-ego_min	0.06501994634929456
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

22998

2401

Bhairav Mehta

Baseline solution using reinforcement learning

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-17 05:00:46+00:00

2019-05-17 05:03:09+00:00

0:02:23

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22989

2416

Andrea Censi 🇨🇭

random_agent

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-17 04:45:48+00:00

2019-05-17 05:00:20+00:00

0:14:32

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22941

2495

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

aido2-LFV-sim-testing

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-17 04:06:36+00:00

2019-05-17 04:45:24+00:00

0:38:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.07747938604551896
survival_time_median	1.3500000000000003
deviation-center-line_median	0.08012762737867413
in-drivable-lane_median	0.5000000000000003

other stats

agent_compute-ego_max	0.19768870960582385
agent_compute-ego_mean	0.18391978152032523
agent_compute-ego_median	0.18595918794957603
agent_compute-ego_min	0.16714428600512052
deviation-center-line_max	0.26764706895424334
deviation-center-line_mean	0.09892298731481676
deviation-center-line_min	0.01596034418031461
deviation-heading_max	5.746287474145587
deviation-heading_mean	1.7474152676408718
deviation-heading_median	0.6244120074871434
deviation-heading_min	0.556360458241233
driven_any_max	1.9105257574081151
driven_any_mean	0.5204301356756763
driven_any_median	0.14775404939067294
driven_any_min	0.09491011852482067
driven_lanedir_consec_max	0.5797874990727049
driven_lanedir_consec_mean	0.17657576916996626
driven_lanedir_consec_min	0.03185865739585836
driven_lanedir_max	0.5797874990727049
driven_lanedir_mean	0.17657576916996626
driven_lanedir_median	0.07747938604551896
driven_lanedir_min	0.03185865739585836
in-drivable-lane_max	7.650000000000046
in-drivable-lane_mean	1.803333333333338
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8125453060005968, "sim_physics": 0.18946108634655293, "survival_time": 6.499999999999985, "driven_lanedir": 0.23295727174882064, "sim_render-ego": 0.06698947503016545, "in-drivable-lane": 3.099999999999993, "agent_compute-ego": 0.1775752434363732, "deviation-heading": 2.484000414490917, "set_robot_commands": 0.10326110949883094, "deviation-center-line": 0.11225721075228522, "driven_lanedir_consec": 0.23295727174882064, "sim_compute_sim_state": 0.04214162459740272, "sim_compute_performance-ego": 0.0757259882413424, "sim_compute_robot_state-ego": 0.07796965195582463, "sim_compute_robot_state-npc0": 0.07504650262685922, "sim_compute_robot_state-npc1": 0.07409081459045411, "sim_compute_robot_state-npc2": 0.07356112736922044, "sim_compute_robot_state-npc3": 0.07210290615375226}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9105257574081151, "sim_physics": 0.1897528696060181, "survival_time": 14.950000000000076, "driven_lanedir": 0.5359469381589506, "sim_render-ego": 0.06812834660212198, "in-drivable-lane": 7.650000000000046, "agent_compute-ego": 0.19047377030054727, "deviation-heading": 5.716395317359476, "set_robot_commands": 0.10679940621058148, "deviation-center-line": 0.26764706895424334, "driven_lanedir_consec": 0.5359469381589506, "sim_compute_sim_state": 0.04420488119125366, "sim_compute_performance-ego": 0.07589302062988282, "sim_compute_robot_state-ego": 0.08092097759246826, "sim_compute_robot_state-npc0": 0.07723594586054484, "sim_compute_robot_state-npc1": 0.07699877738952637, "sim_compute_robot_state-npc2": 0.07732738892237345, "sim_compute_robot_state-npc3": 0.07758488655090331}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12186283048239266, "sim_physics": 0.2060719780299975, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08152245913707912, "sim_render-ego": 0.06874700214551843, "in-drivable-lane": 0, "agent_compute-ego": 0.18280097712641177, "deviation-heading": 0.60805542812822, "set_robot_commands": 0.10275263371674911, "deviation-center-line": 0.10002498519153764, "driven_lanedir_consec": 0.08152245913707912, "sim_compute_sim_state": 0.03764275882555091, "sim_compute_performance-ego": 0.07412350696066151, "sim_compute_robot_state-ego": 0.08174225558405337, "sim_compute_robot_state-npc0": 0.0722242023633874, "sim_compute_robot_state-npc1": 0.07242910758308742, "sim_compute_robot_state-npc2": 0.07103681564331055, "sim_compute_robot_state-npc3": 0.07046475617781929}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1096505794606759, "sim_physics": 0.23558158459870712, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06591303796149584, "sim_render-ego": 0.07026445347329845, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1878960858220639, "deviation-heading": 0.5826505957021297, "set_robot_commands": 0.11243750738060992, "deviation-center-line": 0.08612738661087094, "driven_lanedir_consec": 0.06591303796149584, "sim_compute_sim_state": 0.0444120220516039, "sim_compute_performance-ego": 0.0772280796714451, "sim_compute_robot_state-ego": 0.08108203307442043, "sim_compute_robot_state-npc0": 0.07706709530042566, "sim_compute_robot_state-npc1": 0.07651058487270189, "sim_compute_robot_state-npc2": 0.0758443604344907, "sim_compute_robot_state-npc3": 0.07648922049480936}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13212638995757575, "sim_physics": 0.19457278428254304, "survival_time": 1.3500000000000003, "driven_lanedir": 0.03185865739585836, "sim_render-ego": 0.07110494154470938, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.17744504963910138, "deviation-heading": 0.5714445655196122, "set_robot_commands": 0.10240563639888058, "deviation-center-line": 0.01596034418031461, "driven_lanedir_consec": 0.03185865739585836, "sim_compute_sim_state": 0.04319332264087818, "sim_compute_performance-ego": 0.07587944136725532, "sim_compute_robot_state-ego": 0.0768341753217909, "sim_compute_robot_state-npc0": 0.0736699104309082, "sim_compute_robot_state-npc1": 0.07583853050514504, "sim_compute_robot_state-npc2": 0.07739180105703848, "sim_compute_robot_state-npc3": 0.08122226927015516}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.227318431583332, "sim_physics": 0.19688463735056447, "survival_time": 9.099999999999994, "driven_lanedir": 0.4040506441542848, "sim_render-ego": 0.0675744198180817, "in-drivable-lane": 4.149999999999995, "agent_compute-ego": 0.1889851132592002, "deviation-heading": 3.6321707476180993, "set_robot_commands": 0.10316097343360985, "deviation-center-line": 0.1699630807386648, "driven_lanedir_consec": 0.4040506441542848, "sim_compute_sim_state": 0.0434291205563388, "sim_compute_performance-ego": 0.07552723963182051, "sim_compute_robot_state-ego": 0.08093870079124367, "sim_compute_robot_state-npc0": 0.07565631316258357, "sim_compute_robot_state-npc1": 0.07672495370382791, "sim_compute_robot_state-npc2": 0.07709550857543945, "sim_compute_robot_state-npc3": 0.0764523718383286}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.1259841048287071, "sim_physics": 0.2190963185351828, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07747938604551896, "sim_render-ego": 0.06740273600039275, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.18079036215077277, "deviation-heading": 0.5804520714526401, "set_robot_commands": 0.10621191107708476, "deviation-center-line": 0.07186138979928677, "driven_lanedir_consec": 0.07747938604551896, "sim_compute_sim_state": 0.04514845557834791, "sim_compute_performance-ego": 0.075637382009755, "sim_compute_robot_state-ego": 0.08022546768188477, "sim_compute_robot_state-npc0": 0.07511418798695439, "sim_compute_robot_state-npc1": 0.07454083276831586, "sim_compute_robot_state-npc2": 0.07681825886601987, "sim_compute_robot_state-npc3": 0.07684741849484651}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.12080946159662352, "sim_physics": 0.2046347459157308, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07183818651401719, "sim_render-ego": 0.06739167372385661, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.19025630752245584, "deviation-heading": 0.5681618230948698, "set_robot_commands": 0.1054520805676778, "deviation-center-line": 0.07707356937266277, "driven_lanedir_consec": 0.07183818651401719, "sim_compute_sim_state": 0.04470046361287435, "sim_compute_performance-ego": 0.07370941837628682, "sim_compute_robot_state-ego": 0.08030962944030762, "sim_compute_robot_state-npc0": 0.07789459824562073, "sim_compute_robot_state-npc1": 0.07753158609072368, "sim_compute_robot_state-npc2": 0.07675110300381978, "sim_compute_robot_state-npc3": 0.07543663183848064}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.17893108339554176, "sim_physics": 0.19760633917415843, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06423603911087872, "sim_render-ego": 0.06665580412920784, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.17798740022322712, "deviation-heading": 0.6244120074871434, "set_robot_commands": 0.0998909824034747, "deviation-center-line": 0.025616944470912253, "driven_lanedir_consec": 0.06423603911087872, "sim_compute_sim_state": 0.04059644306407256, "sim_compute_performance-ego": 0.07306265830993652, "sim_compute_robot_state-ego": 0.0752643487032722, "sim_compute_robot_state-npc0": 0.0749122325111838, "sim_compute_robot_state-npc1": 0.07242602460524615, "sim_compute_robot_state-npc2": 0.06814304520102109, "sim_compute_robot_state-npc3": 0.07037496566772461}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1650976122533161, "sim_physics": 0.1943700075149536, "survival_time": 1.5000000000000009, "driven_lanedir": 0.05479947579063449, "sim_render-ego": 0.06773896217346191, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.18953791459401448, "deviation-heading": 0.7129354217901177, "set_robot_commands": 0.1049622694651286, "deviation-center-line": 0.03241938543719766, "driven_lanedir_consec": 0.05479947579063449, "sim_compute_sim_state": 0.04402178923288981, "sim_compute_performance-ego": 0.0761418104171753, "sim_compute_robot_state-ego": 0.07688210010528565, "sim_compute_robot_state-npc0": 0.07049748897552491, "sim_compute_robot_state-npc1": 0.07232046127319336, "sim_compute_robot_state-npc2": 0.07355143229166666, "sim_compute_robot_state-npc3": 0.07663530508677165}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.7266383640667734, "sim_physics": 0.1968812806819513, "survival_time": 6.149999999999986, "driven_lanedir": 0.2276491349259513, "sim_render-ego": 0.07042902271922041, "in-drivable-lane": 2.899999999999994, "agent_compute-ego": 0.18595918794957603, "deviation-heading": 2.5108750894652907, "set_robot_commands": 0.10684181228885806, "deviation-center-line": 0.07388166607042239, "driven_lanedir_consec": 0.2276491349259513, "sim_compute_sim_state": 0.04372213332633662, "sim_compute_performance-ego": 0.07729434385532286, "sim_compute_robot_state-ego": 0.08607351683019622, "sim_compute_robot_state-npc0": 0.07895123861669524, "sim_compute_robot_state-npc1": 0.0800205420672409, "sim_compute_robot_state-npc2": 0.07757161109428096, "sim_compute_robot_state-npc3": 0.07627677917480469}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.09491011852482067, "sim_physics": 0.1940527087763736, "survival_time": 0.9500000000000004, "driven_lanedir": 0.06041677623030939, "sim_render-ego": 0.0665666053169652, "in-drivable-lane": 0, "agent_compute-ego": 0.16714428600512052, "deviation-heading": 0.556360458241233, "set_robot_commands": 0.1041871246538664, "deviation-center-line": 0.08086698235780822, "driven_lanedir_consec": 0.06041677623030939, "sim_compute_sim_state": 0.04470650773299368, "sim_compute_performance-ego": 0.0763886853268272, "sim_compute_robot_state-ego": 0.07958547692549856, "sim_compute_robot_state-npc0": 0.0776610625417609, "sim_compute_robot_state-npc1": 0.07690674380252235, "sim_compute_robot_state-npc2": 0.0773645325710899, "sim_compute_robot_state-npc3": 0.07846986620049727}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.821091365056958, "sim_physics": 0.19273135979970296, "survival_time": 14.950000000000076, "driven_lanedir": 0.5797874990727049, "sim_render-ego": 0.06805762688318888, "in-drivable-lane": 7.350000000000041, "agent_compute-ego": 0.18748445431391397, "deviation-heading": 5.746287474145587, "set_robot_commands": 0.10386247158050538, "deviation-center-line": 0.2130982328679214, "driven_lanedir_consec": 0.5797874990727049, "sim_compute_sim_state": 0.04193278074264526, "sim_compute_performance-ego": 0.07635297934214275, "sim_compute_robot_state-ego": 0.08139209826787312, "sim_compute_robot_state-npc0": 0.07414632479349773, "sim_compute_robot_state-npc1": 0.07464426358540853, "sim_compute_robot_state-npc2": 0.07550154209136963, "sim_compute_robot_state-npc3": 0.07503323078155517}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.1112065811290438, "sim_physics": 0.2267783988605846, "survival_time": 1.1000000000000003, "driven_lanedir": 0.06468192083880897, "sim_render-ego": 0.07000098445198753, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.19768870960582385, "deviation-heading": 0.6130335284038151, "set_robot_commands": 0.11040575937791304, "deviation-center-line": 0.08012762737867413, "driven_lanedir_consec": 0.06468192083880897, "sim_compute_sim_state": 0.04573578184301203, "sim_compute_performance-ego": 0.0780661864714189, "sim_compute_robot_state-ego": 0.08896324851296165, "sim_compute_robot_state-npc0": 0.07473857836289839, "sim_compute_robot_state-npc1": 0.07424600557847456, "sim_compute_robot_state-npc2": 0.07579501108689742, "sim_compute_robot_state-npc3": 0.07678629051555287}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.14775404939067294, "sim_physics": 0.21834095624776984, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09549911046418068, "sim_render-ego": 0.06637399930220383, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1767718608562763, "deviation-heading": 0.7039940717139285, "set_robot_commands": 0.1035766784961407, "deviation-center-line": 0.07691893553944887, "driven_lanedir_consec": 0.09549911046418068, "sim_compute_sim_state": 0.04615496672116793, "sim_compute_performance-ego": 0.07729663298680232, "sim_compute_robot_state-ego": 0.08159997830024132, "sim_compute_robot_state-npc0": 0.07271623611450195, "sim_compute_robot_state-npc1": 0.0768450590280386, "sim_compute_robot_state-npc2": 0.07807817825904259, "sim_compute_robot_state-npc3": 0.08006267364208515}}
set_robot_commands_max	0.11243750738060992
set_robot_commands_mean	0.10508055710332743
set_robot_commands_median	0.1041871246538664
set_robot_commands_min	0.0998909824034747
sim_compute_performance-ego_max	0.0780661864714189
sim_compute_performance-ego_mean	0.07588849157320503
sim_compute_performance-ego_median	0.07589302062988282
sim_compute_performance-ego_min	0.07306265830993652
sim_compute_robot_state-ego_max	0.08896324851296165
sim_compute_robot_state-ego_mean	0.08065224393915482
sim_compute_robot_state-ego_median	0.08092097759246826
sim_compute_robot_state-ego_min	0.0752643487032722
sim_compute_robot_state-npc0_max	0.07895123861669524
sim_compute_robot_state-npc0_mean	0.07516879452622313
sim_compute_robot_state-npc0_median	0.07504650262685922
sim_compute_robot_state-npc0_min	0.07049748897552491
sim_compute_robot_state-npc1_max	0.0800205420672409
sim_compute_robot_state-npc1_mean	0.07547161916292712
sim_compute_robot_state-npc1_median	0.07583853050514504
sim_compute_robot_state-npc1_min	0.07232046127319336
sim_compute_robot_state-npc2_max	0.07807817825904259
sim_compute_robot_state-npc2_mean	0.07545544776447206
sim_compute_robot_state-npc2_median	0.07675110300381978
sim_compute_robot_state-npc2_min	0.06814304520102109
sim_compute_robot_state-npc3_max	0.08122226927015516
sim_compute_robot_state-npc3_mean	0.07601597145920576
sim_compute_robot_state-npc3_median	0.07648922049480936
sim_compute_robot_state-npc3_min	0.07037496566772461
sim_compute_sim_state_max	0.04615496672116793
sim_compute_sim_state_mean	0.04344953678115789
sim_compute_sim_state_median	0.04402178923288981
sim_compute_sim_state_min	0.03764275882555091
sim_physics_max	0.23558158459870712
sim_physics_mean	0.2037878037147194
sim_physics_median	0.19688463735056447
sim_physics_min	0.18946108634655293
sim_render-ego_max	0.07110494154470938
sim_render-ego_mean	0.06822840355429201
sim_render-ego_median	0.06773896217346191
sim_render-ego_min	0.06637399930220383
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	4.280000000000009
survival_time_min	0.9500000000000004

No reset possible

22924

2511

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-17 04:04:32+00:00

2019-05-17 04:06:28+00:00

0:01:56

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22911

2541

jiang peng

test for ppo

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-17 04:00:35+00:00

2019-05-17 04:04:05+00:00

0:03:30

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22904

2547

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-17 03:56:36+00:00

2019-05-17 04:00:19+00:00

0:03:43

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22881

2583

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

aido2-LF-sim-testing

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-17 03:35:45+00:00

2019-05-17 03:56:18+00:00

0:20:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4126113388371666
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11871775985231396
in-drivable-lane_median	0.9499999999999976

other stats

agent_compute-ego_max	0.08501674731572469
agent_compute-ego_mean	0.08222175518542342
agent_compute-ego_median	0.08155857831582256
agent_compute-ego_min	0.07933632930119833
deviation-center-line_max	0.2616199012603187
deviation-center-line_mean	0.12663752615997417
deviation-center-line_min	0.07143676193760398
deviation-heading_max	1.4563581054905994
deviation-heading_mean	0.5551840294909584
deviation-heading_median	0.55940705176748
deviation-heading_min	0.2596285487829774
driven_any_max	1.6839250134630197
driven_any_mean	0.7327294413370017
driven_any_median	0.7309130538792373
driven_any_min	0.2364518949491652
driven_lanedir_consec_max	0.9416535020294268
driven_lanedir_consec_mean	0.4469104002974222
driven_lanedir_consec_min	0.2221238695940002
driven_lanedir_max	0.9416535020294268
driven_lanedir_mean	0.4469104002974222
driven_lanedir_median	0.4126113388371666
driven_lanedir_min	0.2221238695940002
in-drivable-lane_max	2.1499999999999924
in-drivable-lane_mean	0.8233333333333307
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.12772823387468366, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.07068801933610944, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.08084280725935815, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.1118769108409613, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.042226002249919195, "sim_compute_performance-ego": 0.08192246396776656, "sim_compute_robot_state-ego": 0.08775093857671173}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.13990646203358967, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.07181057532628378, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.07933632930119833, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.11756959358851114, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.04525506099065145, "sim_compute_performance-ego": 0.07810460329055786, "sim_compute_robot_state-ego": 0.09077967007954917}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.14286446571350098, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.06944042986089533, "in-drivable-lane": 0, "agent_compute-ego": 0.08131275393746117, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.11181486736644398, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.04451837322928689, "sim_compute_performance-ego": 0.08247455683621494, "sim_compute_robot_state-ego": 0.08971503647890958}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.1490403562784195, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.07249829669793446, "in-drivable-lane": 0, "agent_compute-ego": 0.08501674731572469, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.11718463897705078, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.04552719493707021, "sim_compute_performance-ego": 0.08293392757574718, "sim_compute_robot_state-ego": 0.09979074199994405}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.14522402701170548, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.06855520994766899, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.08370138769564421, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.1176827731339828, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.04515364895696226, "sim_compute_performance-ego": 0.08172072016674539, "sim_compute_robot_state-ego": 0.08619689423104991}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.32177231722795413, "sim_physics": 0.15455801288286844, "survival_time": 1.2000000000000004, "driven_lanedir": 0.259671941523266, "sim_render-ego": 0.07542885343233745, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08487162987391154, "deviation-heading": 0.55940705176748, "set_robot_commands": 0.11541347702344258, "deviation-center-line": 0.07983398841276981, "driven_lanedir_consec": 0.259671941523266, "sim_compute_sim_state": 0.04539750019709269, "sim_compute_performance-ego": 0.08128162225087483, "sim_compute_robot_state-ego": 0.08907001217206319}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9218874635466072, "sim_physics": 0.1311097359045958, "survival_time": 3.899999999999994, "driven_lanedir": 0.5450627289344152, "sim_render-ego": 0.07311499118804932, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.08123742922758445, "deviation-heading": 0.6586708623908946, "set_robot_commands": 0.11288857154357128, "deviation-center-line": 0.13114121213460145, "driven_lanedir_consec": 0.5450627289344152, "sim_compute_sim_state": 0.04426098786867582, "sim_compute_performance-ego": 0.07859897919190235, "sim_compute_robot_state-ego": 0.08550719725779998}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8035998912048764, "sim_physics": 0.154040732554027, "survival_time": 2.799999999999998, "driven_lanedir": 0.4126113388371666, "sim_render-ego": 0.07224335840770177, "in-drivable-lane": 0.9999999999999972, "agent_compute-ego": 0.08323578749384199, "deviation-heading": 0.6465417997696941, "set_robot_commands": 0.11849223715918404, "deviation-center-line": 0.119844131874105, "driven_lanedir_consec": 0.4126113388371666, "sim_compute_sim_state": 0.047930427959987094, "sim_compute_performance-ego": 0.0850326589175633, "sim_compute_robot_state-ego": 0.10118287801742554}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.082025040886041, "sim_physics": 0.1387672479125275, "survival_time": 4.3499999999999925, "driven_lanedir": 0.4507633352947824, "sim_render-ego": 0.07587988623257341, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.08155857831582256, "deviation-heading": 0.6137519362826567, "set_robot_commands": 0.11271509082838035, "deviation-center-line": 0.11871775985231396, "driven_lanedir_consec": 0.4507633352947824, "sim_compute_sim_state": 0.04508152775380803, "sim_compute_performance-ego": 0.08075896624861092, "sim_compute_robot_state-ego": 0.08846398605697456}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6839250134630197, "sim_physics": 0.14158985398032448, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9416535020294268, "sim_render-ego": 0.07019334489648993, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.08133185776797208, "deviation-heading": 1.4563581054905994, "set_robot_commands": 0.11206286387010056, "deviation-center-line": 0.2616199012603187, "driven_lanedir_consec": 0.9416535020294268, "sim_compute_sim_state": 0.04491037888960405, "sim_compute_performance-ego": 0.07935681776566939, "sim_compute_robot_state-ego": 0.08890111229636452}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.2667775284624888, "sim_physics": 0.1514892578125, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25235480657068055, "sim_render-ego": 0.07391544183095296, "in-drivable-lane": 0, "agent_compute-ego": 0.08124428987503052, "deviation-heading": 0.2735028974766809, "set_robot_commands": 0.10587815443674724, "deviation-center-line": 0.10630271043038582, "driven_lanedir_consec": 0.25235480657068055, "sim_compute_sim_state": 0.04377479354540507, "sim_compute_performance-ego": 0.08441593249638875, "sim_compute_robot_state-ego": 0.0889841119448344}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0389325864387626, "sim_physics": 0.14718539993484298, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4755729783153157, "sim_render-ego": 0.07317643970638127, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.08403977790436187, "deviation-heading": 0.521699236138543, "set_robot_commands": 0.12008295121131005, "deviation-center-line": 0.10517150645857888, "driven_lanedir_consec": 0.4755729783153157, "sim_compute_sim_state": 0.04497563993775999, "sim_compute_performance-ego": 0.08474390537707836, "sim_compute_robot_state-ego": 0.10080960199430392}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6835794874956865, "sim_physics": 0.1471712827682495, "survival_time": 2.499999999999999, "driven_lanedir": 0.6100305079584653, "sim_render-ego": 0.07252418518066406, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.08419474601745605, "deviation-heading": 0.4739455376152246, "set_robot_commands": 0.12182199001312256, "deviation-center-line": 0.12143860235134882, "driven_lanedir_consec": 0.6100305079584653, "sim_compute_sim_state": 0.04707977294921875, "sim_compute_performance-ego": 0.08396644115447999, "sim_compute_robot_state-ego": 0.095107684135437}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.29517411990766207, "sim_physics": 0.14539944208585298, "survival_time": 1.3000000000000005, "driven_lanedir": 0.25251967754950355, "sim_render-ego": 0.07461980672983023, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08158237200516921, "deviation-heading": 0.466101326638835, "set_robot_commands": 0.11239901872781607, "deviation-center-line": 0.07143676193760398, "driven_lanedir_consec": 0.25251967754950355, "sim_compute_sim_state": 0.045100890673123874, "sim_compute_performance-ego": 0.0807405893619244, "sim_compute_robot_state-ego": 0.08903550184690036}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7309130538792373, "sim_physics": 0.14059040281507704, "survival_time": 2.6999999999999984, "driven_lanedir": 0.38087957155028906, "sim_render-ego": 0.07227526329181812, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.07981983379081443, "deviation-heading": 0.5607794956477159, "set_robot_commands": 0.1129052859765512, "deviation-center-line": 0.12406277512673576, "driven_lanedir_consec": 0.38087957155028906, "sim_compute_sim_state": 0.04434386006108037, "sim_compute_performance-ego": 0.08264000327498824, "sim_compute_robot_state-ego": 0.08936200318513093}}
set_robot_commands_max	0.12182199001312256
set_robot_commands_mean	0.11471922831314504
set_robot_commands_median	0.1129052859765512
set_robot_commands_min	0.10587815443674724
sim_compute_performance-ego_max	0.0850326589175633
sim_compute_performance-ego_mean	0.08191281252510083
sim_compute_performance-ego_median	0.08192246396776656
sim_compute_performance-ego_min	0.07810460329055786
sim_compute_robot_state-ego_max	0.10118287801742554
sim_compute_robot_state-ego_mean	0.0913771580182266
sim_compute_robot_state-ego_median	0.08907001217206319
sim_compute_robot_state-ego_min	0.08550719725779998
sim_compute_sim_state_max	0.047930427959987094
sim_compute_sim_state_mean	0.04503573734664304
sim_compute_sim_state_median	0.04508152775380803
sim_compute_sim_state_min	0.042226002249919195
sim_physics_max	0.15455801288286844
sim_physics_mean	0.1437776609041843
sim_physics_median	0.14522402701170548
sim_physics_min	0.12772823387468366
sim_render-ego_max	0.07587988623257341
sim_render-ego_mean	0.07242427347104605
sim_render-ego_median	0.07249829669793446
sim_render-ego_min	0.06855520994766899
simulation-passed	1
survival_time_max	5.4999999999999885
survival_time_mean	2.7766666666666637
survival_time_min	1.1000000000000003

No reset possible

22860

2620

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

aido2-LFV-sim-testing

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-17 03:12:13+00:00

2019-05-17 03:35:12+00:00

0:22:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.47061816984274774
survival_time_median	2.4499999999999993
deviation-center-line_median	0.09047885846140293
in-drivable-lane_median	0.7999999999999974

other stats

agent_compute-ego_max	0.17894554138183594
agent_compute-ego_mean	0.1641043366789378
agent_compute-ego_median	0.16484166446485018
agent_compute-ego_min	0.13732937335968018
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.11122054568266285
deviation-center-line_min	0.05649185041622204
deviation-heading_max	0.8583234710357402
deviation-heading_mean	0.371509805944231
deviation-heading_median	0.3477435217829391
deviation-heading_min	0.1892537419842091
driven_any_max	1.6169932854589035
driven_any_mean	0.8549136794030617
driven_any_median	0.9441796518284096
driven_any_min	0.28668385087664994
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.5622432991481365
driven_lanedir_consec_min	0.24216121529728207
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.5622432991481365
driven_lanedir_median	0.47061816984274774
driven_lanedir_min	0.24216121529728207
in-drivable-lane_max	1.3499999999999996
in-drivable-lane_mean	0.5899999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.17371439492260968, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06479727780377423, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16340051315448903, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10212986999087864, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04277892465944643, "sim_compute_performance-ego": 0.07574394897178367, "sim_compute_robot_state-ego": 0.08133443196614583, "sim_compute_robot_state-npc0": 0.07413212458292644, "sim_compute_robot_state-npc1": 0.07219793178417065, "sim_compute_robot_state-npc2": 0.07486850685543484, "sim_compute_robot_state-npc3": 0.07215634540275291}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.19436711311340332, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06822267532348633, "in-drivable-lane": 0, "agent_compute-ego": 0.1728217887878418, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.1066957950592041, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.04175745964050293, "sim_compute_performance-ego": 0.07350690841674805, "sim_compute_robot_state-ego": 0.07627725601196289, "sim_compute_robot_state-npc0": 0.07333404541015626, "sim_compute_robot_state-npc1": 0.0748359203338623, "sim_compute_robot_state-npc2": 0.07040090560913086, "sim_compute_robot_state-npc3": 0.07229434013366699}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.19041339347237035, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06651949568798668, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.16991090774536133, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.10567270768316168, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.041699807894857305, "sim_compute_performance-ego": 0.0752334845693488, "sim_compute_robot_state-ego": 0.07783845223878559, "sim_compute_robot_state-npc0": 0.07516330166866905, "sim_compute_robot_state-npc1": 0.07505862963827033, "sim_compute_robot_state-npc2": 0.0751759692242271, "sim_compute_robot_state-npc3": 0.07388115242907875}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.2180070273483856, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06817852394490302, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.172997197018394, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.1029549912561344, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04225815096987954, "sim_compute_performance-ego": 0.07349309740187246, "sim_compute_robot_state-ego": 0.0825493275364743, "sim_compute_robot_state-npc0": 0.07476439657090586, "sim_compute_robot_state-npc1": 0.0763187046292462, "sim_compute_robot_state-npc2": 0.07414486438413209, "sim_compute_robot_state-npc3": 0.07406338257125661}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.15257720436368669, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05375839982713971, "in-drivable-lane": 0, "agent_compute-ego": 0.14962342807224818, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.08765157631465367, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03689245666776385, "sim_compute_performance-ego": 0.06272843054362706, "sim_compute_robot_state-ego": 0.07990742581231254, "sim_compute_robot_state-npc0": 0.06349331140518188, "sim_compute_robot_state-npc1": 0.06205776759556362, "sim_compute_robot_state-npc2": 0.061711677483149936, "sim_compute_robot_state-npc3": 0.06129346575055804}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.16708012863441749, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.06694951763859501, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.1610933542251587, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.10173903571234807, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.03866135191034387, "sim_compute_performance-ego": 0.0715486694265295, "sim_compute_robot_state-ego": 0.0743307802412245, "sim_compute_robot_state-npc0": 0.0729471798296328, "sim_compute_robot_state-npc1": 0.07234976026746961, "sim_compute_robot_state-npc2": 0.07224173457534225, "sim_compute_robot_state-npc3": 0.06947841026164868}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.18203629829265452, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.06544323320742007, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.16610019736819798, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.09870035118526882, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.04008539076204653, "sim_compute_performance-ego": 0.07326321690170853, "sim_compute_robot_state-ego": 0.07892675752992984, "sim_compute_robot_state-npc0": 0.0694817613672327, "sim_compute_robot_state-npc1": 0.07031623963956479, "sim_compute_robot_state-npc2": 0.07198989391326904, "sim_compute_robot_state-npc3": 0.0718754839014124}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.21048988766140408, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.06630934609307183, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.16197489102681478, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.09950100051032172, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.03946984608968099, "sim_compute_performance-ego": 0.07030756208631728, "sim_compute_robot_state-ego": 0.07948763635423449, "sim_compute_robot_state-npc0": 0.0705475648244222, "sim_compute_robot_state-npc1": 0.06998089684380425, "sim_compute_robot_state-npc2": 0.07085490226745605, "sim_compute_robot_state-npc3": 0.07088179058498806}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.18042054901952329, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.06546001848967178, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.16413276091865872, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.10471918790236764, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.04275917488595714, "sim_compute_performance-ego": 0.07256140916243843, "sim_compute_robot_state-ego": 0.07817485539809517, "sim_compute_robot_state-npc0": 0.06970430457073709, "sim_compute_robot_state-npc1": 0.07105791050454845, "sim_compute_robot_state-npc2": 0.07054999600286069, "sim_compute_robot_state-npc3": 0.0719522704248843}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.1876191759109497, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.06084162712097168, "in-drivable-lane": 0, "agent_compute-ego": 0.1529305934906006, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.09340126991271971, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.03685147762298584, "sim_compute_performance-ego": 0.06588932514190673, "sim_compute_robot_state-ego": 0.07032912254333495, "sim_compute_robot_state-npc0": 0.07005438804626465, "sim_compute_robot_state-npc1": 0.06868003368377686, "sim_compute_robot_state-npc2": 0.06537526130676269, "sim_compute_robot_state-npc3": 0.06860183238983154}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.22837001085281372, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.06616885662078857, "in-drivable-lane": 0, "agent_compute-ego": 0.17004724740982055, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.11261087656021118, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.04823462963104248, "sim_compute_performance-ego": 0.07118991613388062, "sim_compute_robot_state-ego": 0.07813155651092529, "sim_compute_robot_state-npc0": 0.06611161231994629, "sim_compute_robot_state-npc1": 0.0787489652633667, "sim_compute_robot_state-npc2": 0.07429895401000977, "sim_compute_robot_state-npc3": 0.07396798133850098}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.20675666708695264, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.06942469195315712, "in-drivable-lane": 0, "agent_compute-ego": 0.16484166446485018, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.10268550170095345, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.04100787012200607, "sim_compute_performance-ego": 0.07530987890143144, "sim_compute_robot_state-ego": 0.07726994313691792, "sim_compute_robot_state-npc0": 0.13167216903284976, "sim_compute_robot_state-npc1": 0.07441158043710809, "sim_compute_robot_state-npc2": 0.08237955444737484, "sim_compute_robot_state-npc3": 0.07376685895417866}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.15116815090179445, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.05518273830413818, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.13732937335968018, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.08283607959747315, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.035532684326171876, "sim_compute_performance-ego": 0.06148674964904785, "sim_compute_robot_state-ego": 0.06379637241363526, "sim_compute_robot_state-npc0": 0.06174159049987793, "sim_compute_robot_state-npc1": 0.05965864658355713, "sim_compute_robot_state-npc2": 0.0606095027923584, "sim_compute_robot_state-npc3": 0.05984580039978027}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.23858028108423407, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.06597398627888072, "in-drivable-lane": 0, "agent_compute-ego": 0.1754155917601152, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.1083473725752397, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.04624971476468173, "sim_compute_performance-ego": 0.07481390779668634, "sim_compute_robot_state-ego": 0.08294003660028632, "sim_compute_robot_state-npc0": 0.07842193950306285, "sim_compute_robot_state-npc1": 0.07629722898656671, "sim_compute_robot_state-npc2": 0.07531619071960449, "sim_compute_robot_state-npc3": 0.07790307565168901}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.23718067091338488, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.06976325657902932, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.17894554138183594, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.11036939523657974, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.04402072089059012, "sim_compute_performance-ego": 0.07998849907699897, "sim_compute_robot_state-ego": 0.0848091086562799, "sim_compute_robot_state-npc0": 0.07924294471740723, "sim_compute_robot_state-npc1": 0.08094671307777872, "sim_compute_robot_state-npc2": 0.07911173664793676, "sim_compute_robot_state-npc3": 0.07891803858231525}}
set_robot_commands_max	0.11261087656021118
set_robot_commands_mean	0.10133433407983436
set_robot_commands_median	0.10268550170095345
set_robot_commands_min	0.08283607959747315
sim_compute_performance-ego_max	0.07998849907699897
sim_compute_performance-ego_mean	0.07180433361202172
sim_compute_performance-ego_median	0.07326321690170853
sim_compute_performance-ego_min	0.06148674964904785
sim_compute_robot_state-ego_max	0.0848091086562799
sim_compute_robot_state-ego_mean	0.077740204196703
sim_compute_robot_state-ego_median	0.07817485539809517
sim_compute_robot_state-ego_min	0.06379637241363526
sim_compute_robot_state-npc0_max	0.13167216903284976
sim_compute_robot_state-npc0_mean	0.07538750895661821
sim_compute_robot_state-npc0_median	0.0729471798296328
sim_compute_robot_state-npc0_min	0.06174159049987793
sim_compute_robot_state-npc1_max	0.08094671307777872
sim_compute_robot_state-npc1_mean	0.07219446195124363
sim_compute_robot_state-npc1_median	0.07234976026746961
sim_compute_robot_state-npc1_min	0.05965864658355713
sim_compute_robot_state-npc2_max	0.08237955444737484
sim_compute_robot_state-npc2_mean	0.07193531001593666
sim_compute_robot_state-npc2_median	0.07224173457534225
sim_compute_robot_state-npc2_min	0.0606095027923584
sim_compute_robot_state-npc3_max	0.07891803858231525
sim_compute_robot_state-npc3_mean	0.0713920152517695
sim_compute_robot_state-npc3_median	0.07215634540275291
sim_compute_robot_state-npc3_min	0.05984580039978027
sim_compute_sim_state_max	0.04823462963104248
sim_compute_sim_state_mean	0.04121731072253045
sim_compute_sim_state_median	0.041699807894857305
sim_compute_sim_state_min	0.035532684326171876
sim_physics_max	0.23858028108423407
sim_physics_mean	0.19458539690523896
sim_physics_median	0.19041339347237035
sim_physics_min	0.15116815090179445
sim_render-ego_max	0.06976325657902932
sim_render-ego_mean	0.06486624299153429
sim_render-ego_median	0.06616885662078857
sim_render-ego_min	0.05375839982713971
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2366666666666655
survival_time_min	0.9500000000000004

No reset possible

22844

2637

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

aido2-LFVI-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-17 03:00:53+00:00

2019-05-17 03:11:37+00:00

0:10:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.17673830758957637
agent_compute-ego_mean	0.16762479697077787
agent_compute-ego_median	0.1648905790304836
agent_compute-ego_min	0.16171585662024365
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.13547481992266058
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314897
deviation-heading_mean	0.49959867397150787
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000694
driven_any_mean	1.1068208197848532
driven_any_median	0.9410513078477724
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.826231945363564
driven_lanedir_consec_mean	0.804744013449103
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.826231945363564
driven_lanedir_mean	0.804828147320482
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.2224725439578672, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06505466714690003, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1648905790304836, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10464615761479244, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.04293983193892467, "sim_compute_performance-ego": 0.07435587388050707, "sim_compute_robot_state-ego": 0.07775033576579034, "sim_compute_robot_state-npc0": 0.07306730596325066, "sim_compute_robot_state-npc1": 0.07342689550375636, "sim_compute_robot_state-npc2": 0.07193746747849863, "sim_compute_robot_state-npc3": 0.07483788381648969}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.23810440301895144, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06949561834335327, "in-drivable-lane": 0, "agent_compute-ego": 0.16171585662024365, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10622424738747734, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04189591748373849, "sim_compute_performance-ego": 0.07581346375601632, "sim_compute_robot_state-ego": 0.08009161267961774, "sim_compute_robot_state-npc0": 0.07443892955780029, "sim_compute_robot_state-npc1": 0.07795044354030065, "sim_compute_robot_state-npc2": 0.07600026471274239, "sim_compute_robot_state-npc3": 0.07640754325049263}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.2146683086469335, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06503073914537152, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1622748861035097, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10349648670085423, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04168602563802478, "sim_compute_performance-ego": 0.07352561163670808, "sim_compute_robot_state-ego": 0.07762907083752085, "sim_compute_robot_state-npc0": 0.07268203577949005, "sim_compute_robot_state-npc1": 0.0737385842406634, "sim_compute_robot_state-npc2": 0.07401721917309807, "sim_compute_robot_state-npc3": 0.07278293776280671}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.24045948684215543, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06785645584265391, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.1725043555100759, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.10584088166554768, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.042349850138028465, "sim_compute_performance-ego": 0.07496668895085652, "sim_compute_robot_state-ego": 0.0836743712425232, "sim_compute_robot_state-npc0": 0.07504473626613617, "sim_compute_robot_state-npc1": 0.07639263570308685, "sim_compute_robot_state-npc2": 0.07685925563176473, "sim_compute_robot_state-npc3": 0.0752473771572113}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.249216670081729, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06826709565662202, "in-drivable-lane": 0, "agent_compute-ego": 0.17673830758957637, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.10612329982575916, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.043867088499523345, "sim_compute_performance-ego": 0.07355475425720215, "sim_compute_robot_state-ego": 0.08150423140752883, "sim_compute_robot_state-npc0": 0.07465748559860956, "sim_compute_robot_state-npc1": 0.07808980487641834, "sim_compute_robot_state-npc2": 0.08144522848583403, "sim_compute_robot_state-npc3": 0.0784686633518764}}
set_robot_commands_max	0.10622424738747734
set_robot_commands_mean	0.10526621463888616
set_robot_commands_median	0.10584088166554768
set_robot_commands_min	0.10349648670085423
sim_compute_performance-ego_max	0.07581346375601632
sim_compute_performance-ego_mean	0.07444327849625802
sim_compute_performance-ego_median	0.07435587388050707
sim_compute_performance-ego_min	0.07352561163670808
sim_compute_robot_state-ego_max	0.0836743712425232
sim_compute_robot_state-ego_mean	0.08012992438659619
sim_compute_robot_state-ego_median	0.08009161267961774
sim_compute_robot_state-ego_min	0.07762907083752085
sim_compute_robot_state-npc0_max	0.07504473626613617
sim_compute_robot_state-npc0_mean	0.07397809863305735
sim_compute_robot_state-npc0_median	0.07443892955780029
sim_compute_robot_state-npc0_min	0.07268203577949005
sim_compute_robot_state-npc1_max	0.07808980487641834
sim_compute_robot_state-npc1_mean	0.07591967277284513
sim_compute_robot_state-npc1_median	0.07639263570308685
sim_compute_robot_state-npc1_min	0.07342689550375636
sim_compute_robot_state-npc2_max	0.08144522848583403
sim_compute_robot_state-npc2_mean	0.07605188709638756
sim_compute_robot_state-npc2_median	0.07600026471274239
sim_compute_robot_state-npc2_min	0.07193746747849863
sim_compute_robot_state-npc3_max	0.0784686633518764
sim_compute_robot_state-npc3_mean	0.07554888106777535
sim_compute_robot_state-npc3_median	0.0752473771572113
sim_compute_robot_state-npc3_min	0.07278293776280671
sim_compute_sim_state_max	0.043867088499523345
sim_compute_sim_state_mean	0.042547742739647954
sim_compute_sim_state_median	0.042349850138028465
sim_compute_sim_state_min	0.04168602563802478
sim_physics_max	0.249216670081729
sim_physics_mean	0.23298428250952732
sim_physics_median	0.23810440301895144
sim_physics_min	0.2146683086469335
sim_render-ego_max	0.06949561834335327
sim_render-ego_mean	0.06714091522698015
sim_render-ego_median	0.06785645584265391
sim_render-ego_min	0.06503073914537152
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

22816

2703

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-17 02:07:49+00:00

2019-05-17 03:00:23+00:00

0:52:34

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22813

2723

jiang peng

test for ppo

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-17 02:06:27+00:00

2019-05-17 02:07:35+00:00

0:01:08

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22806

2730

Bhairav Mehta

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LF-sim-testing

step1-simulation

failed

yes

ip-172-31-25-98-2470

2019-05-17 02:04:32+00:00

2019-05-17 02:06:12+00:00

0:01:40

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22799

2739

Bhairav Mehta

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LFVI-sim-validation

step1-simulation

failed

yes

ip-172-31-25-98-2470

2019-05-17 02:02:42+00:00

2019-05-17 02:04:25+00:00

0:01:43

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22722

2884

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-17 01:01:33+00:00

2019-05-17 02:02:18+00:00

1:00:45

Waited 3602 seconds [...]

Waited 3602 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22687

2973

Julian Zilly

Baseline-IL-logs-tensorflow

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-17 00:20:38+00:00

2019-05-17 01:01:03+00:00

0:40:25

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22639

3065

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-17 00:00:47+00:00

2019-05-17 00:20:00+00:00

0:19:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6656866409578315
survival_time_median	12.500000000000044
deviation-center-line_median	0.5737017841765135
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.2762987094166678
agent_compute-ego_mean	0.2510839712351444
agent_compute-ego_median	0.2506047407786051
agent_compute-ego_min	0.2253457307815552
deviation-center-line_max	0.767466606623434
deviation-center-line_mean	0.5876338145110176
deviation-center-line_min	0.41174842148952034
deviation-heading_max	3.683891883563336
deviation-heading_mean	2.1667806060200228
deviation-heading_median	1.8155446801013535
deviation-heading_min	0.8274931740634461
driven_any_max	1.202912493143561
driven_any_mean	0.7926719940279552
driven_any_median	0.9924787975530256
driven_any_min	0.27473659216578417
driven_lanedir_consec_max	1.177922047403134
driven_lanedir_consec_mean	0.6726702317379225
driven_lanedir_consec_min	0.26795810676711973
driven_lanedir_max	1.177922047403134
driven_lanedir_mean	0.6726702317379225
driven_lanedir_median	0.6656866409578315
driven_lanedir_min	0.26795810676711973
in-drivable-lane_max	3.250000000000046
in-drivable-lane_mean	0.980000000000014
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0247936270904303, "sim_physics": 0.12431348529771144, "survival_time": 12.850000000000048, "driven_lanedir": 0.6656866409578315, "sim_render-ego": 0.07104914104892122, "in-drivable-lane": 3.250000000000046, "agent_compute-ego": 0.2762987094166678, "deviation-heading": 3.683891883563336, "set_robot_commands": 0.10718970168889264, "deviation-center-line": 0.5737017841765135, "driven_lanedir_consec": 0.6656866409578315, "sim_compute_sim_state": 0.0407493773137549, "sim_compute_performance-ego": 0.07409856569906154, "sim_compute_robot_state-ego": 0.0861862206737355}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9924787975530256, "sim_physics": 0.118212459564209, "survival_time": 12.500000000000044, "driven_lanedir": 0.8040312315210123, "sim_render-ego": 0.062088015556335446, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.25002087020874025, "deviation-heading": 2.7088997053474864, "set_robot_commands": 0.1010106725692749, "deviation-center-line": 0.767466606623434, "driven_lanedir_consec": 0.8040312315210123, "sim_compute_sim_state": 0.03941000461578369, "sim_compute_performance-ego": 0.07202931308746338, "sim_compute_robot_state-ego": 0.07624594211578369}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.27473659216578417, "sim_physics": 0.12546847025553384, "survival_time": 3.7499999999999942, "driven_lanedir": 0.26795810676711973, "sim_render-ego": 0.06914704004923503, "in-drivable-lane": 0, "agent_compute-ego": 0.2506047407786051, "deviation-heading": 0.8274931740634461, "set_robot_commands": 0.09625272750854492, "deviation-center-line": 0.41174842148952034, "driven_lanedir_consec": 0.26795810676711973, "sim_compute_sim_state": 0.03957120895385742, "sim_compute_performance-ego": 0.06820454279581706, "sim_compute_robot_state-ego": 0.07804643630981445}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4684384601869749, "sim_physics": 0.1307098471428737, "survival_time": 6.0499999999999865, "driven_lanedir": 0.4477531320405155, "sim_render-ego": 0.06634721480125239, "in-drivable-lane": 0, "agent_compute-ego": 0.25314980499015366, "deviation-heading": 1.7980735870244908, "set_robot_commands": 0.10120408002995264, "deviation-center-line": 0.44966413762168134, "driven_lanedir_consec": 0.4477531320405155, "sim_compute_sim_state": 0.04086342330806512, "sim_compute_performance-ego": 0.07578231874576286, "sim_compute_robot_state-ego": 0.08461610147775697}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.202912493143561, "sim_physics": 0.12177783727645874, "survival_time": 14.950000000000076, "driven_lanedir": 1.177922047403134, "sim_render-ego": 0.0652017052968343, "in-drivable-lane": 0, "agent_compute-ego": 0.2253457307815552, "deviation-heading": 1.8155446801013535, "set_robot_commands": 0.10375556230545044, "deviation-center-line": 0.7355881226439384, "driven_lanedir_consec": 1.177922047403134, "sim_compute_sim_state": 0.04120668570200602, "sim_compute_performance-ego": 0.07164891242980957, "sim_compute_robot_state-ego": 0.07811266501744588}}
set_robot_commands_max	0.10718970168889264
set_robot_commands_mean	0.10188254882042312
set_robot_commands_median	0.10120408002995264
set_robot_commands_min	0.09625272750854492
sim_compute_performance-ego_max	0.07578231874576286
sim_compute_performance-ego_mean	0.07235273055158288
sim_compute_performance-ego_median	0.07202931308746338
sim_compute_performance-ego_min	0.06820454279581706
sim_compute_robot_state-ego_max	0.0861862206737355
sim_compute_robot_state-ego_mean	0.0806414731189073
sim_compute_robot_state-ego_median	0.07811266501744588
sim_compute_robot_state-ego_min	0.07624594211578369
sim_compute_sim_state_max	0.04120668570200602
sim_compute_sim_state_mean	0.040360139978693435
sim_compute_sim_state_median	0.0407493773137549
sim_compute_sim_state_min	0.03941000461578369
sim_physics_max	0.1307098471428737
sim_physics_mean	0.12409641990735734
sim_physics_median	0.12431348529771144
sim_physics_min	0.118212459564209
sim_render-ego_max	0.07104914104892122
sim_render-ego_mean	0.06676662335051568
sim_render-ego_median	0.06634721480125239
sim_render-ego_min	0.062088015556335446
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.02000000000003
survival_time_min	3.7499999999999942

No reset possible

22622

3096

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

aido2-LF-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-16 23:44:36+00:00

2019-05-17 00:00:32+00:00

0:15:56

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22597

3122

Rami Al-Naim 🇷🇺

v_d_1_K_t_-0.75_no_cache

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-16 23:16:33+00:00

2019-05-16 23:43:37+00:00

0:27:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.0209445678394986
survival_time_median	14.950000000000076
deviation-center-line_median	0.7978157548664855
in-drivable-lane_median	0.05000000000000071

other stats

agent_compute-ego_max	0.09690726778723976
agent_compute-ego_mean	0.0949707413893344
agent_compute-ego_median	0.09506109476089478
agent_compute-ego_min	0.0930866157735577
deviation-center-line_max	1.095828319228905
deviation-center-line_mean	0.8777006615143632
deviation-center-line_min	0.6827363998990178
deviation-heading_max	4.150200990931879
deviation-heading_mean	2.654712818795084
deviation-heading_median	2.6851101280559875
deviation-heading_min	1.3155495864300994
driven_any_max	2.3491592048951646
driven_any_mean	2.1611685943990544
driven_any_median	2.349105290150827
driven_any_min	1.7142954296317223
driven_lanedir_consec_max	2.23196398101339
driven_lanedir_consec_mean	2.002142034112217
driven_lanedir_consec_min	1.6913792515829655
driven_lanedir_max	2.23196398101339
driven_lanedir_mean	2.002142034112217
driven_lanedir_median	2.0209445678394986
driven_lanedir_min	1.6913792515829655
in-drivable-lane_max	1.4500000000000206
in-drivable-lane_mean	0.5400000000000034
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0441350273697214, "sim_physics": 0.14423362626374223, "survival_time": 13.100000000000051, "driven_lanedir": 1.9836059850170649, "sim_render-ego": 0.07249300716487506, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.0930866157735577, "deviation-heading": 2.2594281032928314, "set_robot_commands": 0.12167522652458598, "deviation-center-line": 0.7978157548664855, "driven_lanedir_consec": 1.9836059850170649, "sim_compute_sim_state": 0.04441483694178457, "sim_compute_performance-ego": 0.08060153386065068, "sim_compute_robot_state-ego": 0.09392984768816531}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3491592048951646, "sim_physics": 0.13488590161005656, "survival_time": 14.950000000000076, "driven_lanedir": 2.082816385108168, "sim_render-ego": 0.07217058181762695, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.09455448706944784, "deviation-heading": 2.6851101280559875, "set_robot_commands": 0.12125032504399616, "deviation-center-line": 1.0262424859047878, "driven_lanedir_consec": 2.082816385108168, "sim_compute_sim_state": 0.04557413498560588, "sim_compute_performance-ego": 0.08031420230865478, "sim_compute_robot_state-ego": 0.09111506064732867}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3491480199478376, "sim_physics": 0.1334115203221639, "survival_time": 14.950000000000076, "driven_lanedir": 2.0209445678394986, "sim_render-ego": 0.07121443510055542, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.09524424155553182, "deviation-heading": 2.863275285264622, "set_robot_commands": 0.11613889535268147, "deviation-center-line": 1.095828319228905, "driven_lanedir_consec": 2.0209445678394986, "sim_compute_sim_state": 0.04414666652679443, "sim_compute_performance-ego": 0.07824541648228964, "sim_compute_robot_state-ego": 0.08870995283126831}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.349105290150827, "sim_physics": 0.1368888012568156, "survival_time": 14.950000000000076, "driven_lanedir": 2.23196398101339, "sim_render-ego": 0.07203126271565755, "in-drivable-lane": 0, "agent_compute-ego": 0.09506109476089478, "deviation-heading": 4.150200990931879, "set_robot_commands": 0.12241665681203208, "deviation-center-line": 0.78588034767262, "driven_lanedir_consec": 2.23196398101339, "sim_compute_sim_state": 0.04490001916885376, "sim_compute_performance-ego": 0.08229249080022176, "sim_compute_robot_state-ego": 0.09045494079589844}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7142954296317223, "sim_physics": 0.14445859627290206, "survival_time": 11.00000000000002, "driven_lanedir": 1.6913792515829655, "sim_render-ego": 0.07218800999901512, "in-drivable-lane": 0, "agent_compute-ego": 0.09690726778723976, "deviation-heading": 1.3155495864300994, "set_robot_commands": 0.12179921215230768, "deviation-center-line": 0.6827363998990178, "driven_lanedir_consec": 1.6913792515829655, "sim_compute_sim_state": 0.045395295186476274, "sim_compute_performance-ego": 0.08537744717164474, "sim_compute_robot_state-ego": 0.0890639229254289}}
set_robot_commands_max	0.12241665681203208
set_robot_commands_mean	0.12065606317712067
set_robot_commands_median	0.12167522652458598
set_robot_commands_min	0.11613889535268147
sim_compute_performance-ego_max	0.08537744717164474
sim_compute_performance-ego_mean	0.08136621812469233
sim_compute_performance-ego_median	0.08060153386065068
sim_compute_performance-ego_min	0.07824541648228964
sim_compute_robot_state-ego_max	0.09392984768816531
sim_compute_robot_state-ego_mean	0.09065474497761794
sim_compute_robot_state-ego_median	0.09045494079589844
sim_compute_robot_state-ego_min	0.08870995283126831
sim_compute_sim_state_max	0.04557413498560588
sim_compute_sim_state_mean	0.04488619056190298
sim_compute_sim_state_median	0.04490001916885376
sim_compute_sim_state_min	0.04414666652679443
sim_physics_max	0.14445859627290206
sim_physics_mean	0.13877568914513608
sim_physics_median	0.1368888012568156
sim_physics_min	0.1334115203221639
sim_render-ego_max	0.07249300716487506
sim_render-ego_mean	0.07201945935954601
sim_render-ego_median	0.07217058181762695
sim_render-ego_min	0.07121443510055542
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.79000000000006
survival_time_min	11.00000000000002

No reset possible

22583

3130

Alexander Karavaev

test

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-16 23:00:36+00:00

2019-05-16 23:15:51+00:00

0:15:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9221394331500324
survival_time_median	6.149999999999986
deviation-center-line_median	0.4226862984983189
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.11781038210063638
agent_compute-ego_mean	0.11142841017281048
agent_compute-ego_median	0.11065754294395448
agent_compute-ego_min	0.10752142735613072
deviation-center-line_max	0.6951430902366791
deviation-center-line_mean	0.4388432062203975
deviation-center-line_min	0.19467892430488812
deviation-heading_max	2.3674462508475824
deviation-heading_mean	1.5459877064107794
deviation-heading_median	1.3045578283954786
deviation-heading_min	0.9292287122039666
driven_any_max	1.2883041900232195
driven_any_mean	0.894629152250439
driven_any_median	0.934779392424075
driven_any_min	0.5168419197383907
driven_lanedir_consec_max	1.1194072319537969
driven_lanedir_consec_mean	0.7623114540758053
driven_lanedir_consec_min	0.1982626620490111
driven_lanedir_max	1.1194072319537969
driven_lanedir_mean	0.7732286949614735
driven_lanedir_median	0.9221394331500324
driven_lanedir_min	0.25284886647735216
in-drivable-lane_max	1.1999999999999966
in-drivable-lane_mean	0.36999999999999994
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7743219983875073, "sim_physics": 0.14190215101608863, "survival_time": 5.1999999999999895, "driven_lanedir": 0.6306078328295646, "sim_render-ego": 0.07910280732008126, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.11065754294395448, "deviation-heading": 2.057643717504747, "set_robot_commands": 0.11015061461008512, "deviation-center-line": 0.3138611195856906, "driven_lanedir_consec": 0.6306078328295646, "sim_compute_sim_state": 0.0441336058653318, "sim_compute_performance-ego": 0.07905893371655391, "sim_compute_robot_state-ego": 0.08329962767087497}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5168419197383907, "sim_physics": 0.15258930098842566, "survival_time": 3.5499999999999954, "driven_lanedir": 0.25284886647735216, "sim_render-ego": 0.07310131234182439, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.11221699983301298, "deviation-heading": 1.3045578283954786, "set_robot_commands": 0.11413730701930086, "deviation-center-line": 0.19467892430488812, "driven_lanedir_consec": 0.1982626620490111, "sim_compute_sim_state": 0.04355610592264525, "sim_compute_performance-ego": 0.08157729430937431, "sim_compute_robot_state-ego": 0.09279083198224994}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.934779392424075, "sim_physics": 0.14471169409713125, "survival_time": 6.149999999999986, "driven_lanedir": 0.9221394331500324, "sim_render-ego": 0.07163887295296521, "in-drivable-lane": 0, "agent_compute-ego": 0.10752142735613072, "deviation-heading": 0.9292287122039666, "set_robot_commands": 0.1144604663538739, "deviation-center-line": 0.6951430902366791, "driven_lanedir_consec": 0.9221394331500324, "sim_compute_sim_state": 0.04413312237437179, "sim_compute_performance-ego": 0.08185324242444543, "sim_compute_robot_state-ego": 0.08958624630439573}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9588982606790024, "sim_physics": 0.14207042588127983, "survival_time": 6.299999999999986, "driven_lanedir": 0.9411401103966216, "sim_render-ego": 0.07139614271739173, "in-drivable-lane": 0, "agent_compute-ego": 0.1089356986303178, "deviation-heading": 1.071062023102122, "set_robot_commands": 0.11016838891165597, "deviation-center-line": 0.567846598476411, "driven_lanedir_consec": 0.9411401103966216, "sim_compute_sim_state": 0.04470344006069123, "sim_compute_performance-ego": 0.08112561324286083, "sim_compute_robot_state-ego": 0.08675991164313422}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2883041900232195, "sim_physics": 0.14253605197289743, "survival_time": 8.349999999999984, "driven_lanedir": 1.1194072319537969, "sim_render-ego": 0.07212043236829564, "in-drivable-lane": 0.4500000000000038, "agent_compute-ego": 0.11781038210063638, "deviation-heading": 2.3674462508475824, "set_robot_commands": 0.11471227828614013, "deviation-center-line": 0.4226862984983189, "driven_lanedir_consec": 1.1194072319537969, "sim_compute_sim_state": 0.04473019788365165, "sim_compute_performance-ego": 0.08378471157507981, "sim_compute_robot_state-ego": 0.09208942030718228}}
set_robot_commands_max	0.11471227828614013
set_robot_commands_mean	0.1127258110362112
set_robot_commands_median	0.11413730701930086
set_robot_commands_min	0.11015061461008512
sim_compute_performance-ego_max	0.08378471157507981
sim_compute_performance-ego_mean	0.08147995905366287
sim_compute_performance-ego_median	0.08157729430937431
sim_compute_performance-ego_min	0.07905893371655391
sim_compute_robot_state-ego_max	0.09279083198224994
sim_compute_robot_state-ego_mean	0.08890520758156742
sim_compute_robot_state-ego_median	0.08958624630439573
sim_compute_robot_state-ego_min	0.08329962767087497
sim_compute_sim_state_max	0.04473019788365165
sim_compute_sim_state_mean	0.04425129442133834
sim_compute_sim_state_median	0.0441336058653318
sim_compute_sim_state_min	0.04355610592264525
sim_physics_max	0.15258930098842566
sim_physics_mean	0.14476192479116456
sim_physics_median	0.14253605197289743
sim_physics_min	0.14190215101608863
sim_render-ego_max	0.07910280732008126
sim_render-ego_mean	0.07347191354011165
sim_render-ego_median	0.07212043236829564
sim_render-ego_min	0.07139614271739173
simulation-passed	1
survival_time_max	8.349999999999984
survival_time_mean	5.909999999999988
survival_time_min	3.5499999999999954

No reset possible

22572

3149

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

aido2-LFV-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-16 22:52:16+00:00

2019-05-16 23:00:15+00:00

0:07:59

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22550

3186

Anastasiya Nikolskaya 🇷🇺

Classic Solution

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-16 22:31:05+00:00

2019-05-16 22:51:02+00:00

0:19:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.63683426109741
survival_time_median	8.999999999999993
deviation-center-line_median	0.7891185844877303
in-drivable-lane_median	0.20000000000000284

other stats

agent_compute-ego_max	0.10385393142700196
agent_compute-ego_mean	0.1006180878513894
agent_compute-ego_median	0.10013501242835925
agent_compute-ego_min	0.0993986513879564
deviation-center-line_max	1.3375306497912882
deviation-center-line_mean	0.7435349820923572
deviation-center-line_min	0.3085782189431001
deviation-heading_max	4.198149059634222
deviation-heading_mean	1.8897504826405216
deviation-heading_median	1.5441279320903545
deviation-heading_min	0.35750273278405753
driven_any_max	3.217251631374429
driven_any_mean	1.839437816309339
driven_any_median	1.9075780772347368
driven_any_min	0.8840437115100436
driven_lanedir_consec_max	2.984920210872019
driven_lanedir_consec_mean	1.6247945527169292
driven_lanedir_consec_min	0.7745462501573668
driven_lanedir_max	2.984920210872019
driven_lanedir_mean	1.6247945527169292
driven_lanedir_median	1.63683426109741
driven_lanedir_min	0.7745462501573668
in-drivable-lane_max	1.7000000000000242
in-drivable-lane_mean	0.5800000000000047
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.139211902813034, "sim_physics": 0.14860411799780213, "survival_time": 10.100000000000009, "driven_lanedir": 1.63683426109741, "sim_render-ego": 0.07467902060782555, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.10013501242835925, "deviation-heading": 2.198325187634419, "set_robot_commands": 0.12913430209207064, "deviation-center-line": 0.7891185844877303, "driven_lanedir_consec": 1.63683426109741, "sim_compute_sim_state": 0.04748519458393059, "sim_compute_performance-ego": 0.08334336068370554, "sim_compute_robot_state-ego": 0.09475858966902932}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0491037586144512, "sim_physics": 0.14906653469684078, "survival_time": 5.09999999999999, "driven_lanedir": 0.7745462501573668, "sim_render-ego": 0.0784168523900649, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.09955410863838944, "deviation-heading": 1.1506475010595554, "set_robot_commands": 0.13205131596209957, "deviation-center-line": 0.3085782189431001, "driven_lanedir_consec": 0.7745462501573668, "sim_compute_sim_state": 0.04881675570618873, "sim_compute_performance-ego": 0.08826027430740058, "sim_compute_robot_state-ego": 0.09641889731089276}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8840437115100436, "sim_physics": 0.15212083684987035, "survival_time": 4.3499999999999925, "driven_lanedir": 0.8805765668258019, "sim_render-ego": 0.07553533301956353, "in-drivable-lane": 0, "agent_compute-ego": 0.10014873537523993, "deviation-heading": 0.35750273278405753, "set_robot_commands": 0.13290145753443927, "deviation-center-line": 0.4441333553678831, "driven_lanedir_consec": 0.8805765668258019, "sim_compute_sim_state": 0.04720453010208305, "sim_compute_performance-ego": 0.0843494020659348, "sim_compute_robot_state-ego": 0.09898578435525128}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.217251631374429, "sim_physics": 0.14963438351949057, "survival_time": 14.950000000000076, "driven_lanedir": 2.984920210872019, "sim_render-ego": 0.07560775677363078, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.10385393142700196, "deviation-heading": 4.198149059634222, "set_robot_commands": 0.133002454439799, "deviation-center-line": 1.3375306497912882, "driven_lanedir_consec": 2.984920210872019, "sim_compute_sim_state": 0.04738007307052612, "sim_compute_performance-ego": 0.08596426169077555, "sim_compute_robot_state-ego": 0.1023242155710856}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.9075780772347368, "sim_physics": 0.13693388832939996, "survival_time": 8.999999999999993, "driven_lanedir": 1.8470954746320496, "sim_render-ego": 0.07290152443779839, "in-drivable-lane": 0, "agent_compute-ego": 0.0993986513879564, "deviation-heading": 1.5441279320903545, "set_robot_commands": 0.13362863461176555, "deviation-center-line": 0.8383141018717849, "driven_lanedir_consec": 1.8470954746320496, "sim_compute_sim_state": 0.047003801663716635, "sim_compute_performance-ego": 0.0810058421558804, "sim_compute_robot_state-ego": 0.09689898755815296}}
set_robot_commands_max	0.13362863461176555
set_robot_commands_mean	0.1321436329280348
set_robot_commands_median	0.13290145753443927
set_robot_commands_min	0.12913430209207064
sim_compute_performance-ego_max	0.08826027430740058
sim_compute_performance-ego_mean	0.08458462818073938
sim_compute_performance-ego_median	0.0843494020659348
sim_compute_performance-ego_min	0.0810058421558804
sim_compute_robot_state-ego_max	0.1023242155710856
sim_compute_robot_state-ego_mean	0.09787729489288235
sim_compute_robot_state-ego_median	0.09689898755815296
sim_compute_robot_state-ego_min	0.09475858966902932
sim_compute_sim_state_max	0.04881675570618873
sim_compute_sim_state_mean	0.04757807102528903
sim_compute_sim_state_median	0.04738007307052612
sim_compute_sim_state_min	0.047003801663716635
sim_physics_max	0.15212083684987035
sim_physics_mean	0.14727195227868073
sim_physics_median	0.14906653469684078
sim_physics_min	0.13693388832939996
sim_render-ego_max	0.0784168523900649
sim_render-ego_mean	0.07542809744577664
sim_render-ego_median	0.07553533301956353
sim_render-ego_min	0.07290152443779839
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.700000000000014
survival_time_min	4.3499999999999925

No reset possible

22535

3204

Masaya Kambara 🇯🇵

challenge-aido_LF-template-random

aido2-LF-sim-testing

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-16 22:12:07+00:00

2019-05-16 22:30:30+00:00

0:18:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.18169727979921824
agent_compute-ego_mean	0.1642292053799184
agent_compute-ego_median	0.16811397496391745
agent_compute-ego_min	0.1274084764368394
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.12139668729570176, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06387933536812111, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16726740642830176, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10325252568280256, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0422751991837113, "sim_compute_performance-ego": 0.07316480742560492, "sim_compute_robot_state-ego": 0.07617596785227458}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11776093875660616, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06628950904397403, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16811397496391745, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10140700433768478, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.040118624182308424, "sim_compute_performance-ego": 0.07441339773290298, "sim_compute_robot_state-ego": 0.08266441027323405}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.14180289997774012, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07834578962887034, "in-drivable-lane": 0, "agent_compute-ego": 0.1719377040863037, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10269441324121811, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.042913296643425435, "sim_compute_performance-ego": 0.0887893227969899, "sim_compute_robot_state-ego": 0.08065436868106618}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1527792263031006, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06857512474060058, "in-drivable-lane": 0, "agent_compute-ego": 0.1806163215637207, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.10692331314086914, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04467643737792969, "sim_compute_performance-ego": 0.0791408920288086, "sim_compute_robot_state-ego": 0.09058552742004394}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.12249544300610506, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06788170186779167, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.16596452797515482, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10181911685798742, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.041172305239906795, "sim_compute_performance-ego": 0.07186893269985536, "sim_compute_robot_state-ego": 0.08100567588323279}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.1210155097805724, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06618699735524702, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.15865744863237655, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.10100227472733478, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.04216818906822983, "sim_compute_performance-ego": 0.07351519623581244, "sim_compute_robot_state-ego": 0.07543303042042013}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.12615340948104858, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06168767809867859, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.15554833837917872, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.09826154794011796, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.03967119114739554, "sim_compute_performance-ego": 0.06934647474970136, "sim_compute_robot_state-ego": 0.07436878766332354}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.13017397835141137, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.0658066953931536, "in-drivable-lane": 0, "agent_compute-ego": 0.17348827634538924, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.1052124954405285, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.045558986209687735, "sim_compute_performance-ego": 0.07440816788446336, "sim_compute_robot_state-ego": 0.08297051702226911}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.14209580421447754, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.0691768234058962, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.17417817600702834, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.1130948511220641, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.043609077647580936, "sim_compute_performance-ego": 0.07907074184741004, "sim_compute_robot_state-ego": 0.09444994441533491}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.144734204899181, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06692264296791771, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.16873235269026324, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.10843240131031384, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.04258943904529918, "sim_compute_performance-ego": 0.07510320056568492, "sim_compute_robot_state-ego": 0.08360488631508567}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.11580434093227636, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06662423270089286, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1593662825497714, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.10147833824157716, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.04159300048629959, "sim_compute_performance-ego": 0.07511273297396573, "sim_compute_robot_state-ego": 0.07761597633361816}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.1028469545500619, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.05843456302370344, "in-drivable-lane": 0, "agent_compute-ego": 0.13005702836172922, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.08163196699959892, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.03551065921783447, "sim_compute_performance-ego": 0.0611465403011867, "sim_compute_robot_state-ego": 0.0598530684198652}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.08876889827204686, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.048465850306492225, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1274084764368394, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.0790728587730258, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.033731540044148765, "sim_compute_performance-ego": 0.054988468394559974, "sim_compute_robot_state-ego": 0.05792700543123133}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.14550623187312373, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.07199581464131673, "in-drivable-lane": 0, "agent_compute-ego": 0.1804044864795826, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.11610176828172472, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04418421674657751, "sim_compute_performance-ego": 0.08083064467818649, "sim_compute_robot_state-ego": 0.09463861253526476}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.14527413424323588, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.07155240049549177, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.18169727979921824, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.1149051493289424, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.04855263934415929, "sim_compute_performance-ego": 0.08193532392090443, "sim_compute_robot_state-ego": 0.09349943142311246}}
set_robot_commands_max	0.11610176828172472
set_robot_commands_mean	0.10235266836171932
set_robot_commands_median	0.10269441324121811
set_robot_commands_min	0.0790728587730258
sim_compute_performance-ego_max	0.0887893227969899
sim_compute_performance-ego_mean	0.0741889896157358
sim_compute_performance-ego_median	0.07441339773290298
sim_compute_performance-ego_min	0.054988468394559974
sim_compute_robot_state-ego_max	0.09463861253526476
sim_compute_robot_state-ego_mean	0.0803631473392918
sim_compute_robot_state-ego_median	0.08100567588323279
sim_compute_robot_state-ego_min	0.05792700543123133
sim_compute_sim_state_max	0.04855263934415929
sim_compute_sim_state_mean	0.04188832010563296
sim_compute_sim_state_median	0.0422751991837113
sim_compute_sim_state_min	0.033731540044148765
sim_physics_max	0.1527792263031006
sim_physics_mean	0.1279072441291126
sim_physics_median	0.12615340948104858
sim_physics_min	0.08876889827204686
sim_render-ego_max	0.07834578962887034
sim_render-ego_mean	0.06612167726920987
sim_render-ego_median	0.06662423270089286
sim_render-ego_min	0.048465850306492225
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

22529

3217

Amaury Camus 🇨🇭

challenge-aido_LF-template-random

aido2-LFV-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-16 22:00:59+00:00

2019-05-16 22:10:39+00:00

0:09:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.16960412043112297
agent_compute-ego_mean	0.16272230503646004
agent_compute-ego_median	0.16020859228937248
agent_compute-ego_min	0.15842097997665405
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.12651756552531995
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599273
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811214
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589035
driven_any_mean	1.0272530755098266
driven_any_median	1.0243289631429708
driven_any_min	0.4119037580118998
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.19278050352025916, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06967858914975766, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16960412043112297, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.11111669628708452, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.044088889051366736, "sim_compute_performance-ego": 0.07431769812548603, "sim_compute_robot_state-ego": 0.0828135543399387, "sim_compute_robot_state-npc0": 0.0784455935160319, "sim_compute_robot_state-npc1": 0.07790264376887569, "sim_compute_robot_state-npc2": 0.07752743032243517, "sim_compute_robot_state-npc3": 0.07853579962695087}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.2099982738494873, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06280896186828613, "in-drivable-lane": 0, "agent_compute-ego": 0.15911054611206055, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09826977729797363, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.03958884239196778, "sim_compute_performance-ego": 0.06969070434570312, "sim_compute_robot_state-ego": 0.07864206314086913, "sim_compute_robot_state-npc0": 0.07177302360534668, "sim_compute_robot_state-npc1": 0.07212893486022949, "sim_compute_robot_state-npc2": 0.07362256050109864, "sim_compute_robot_state-npc3": 0.07610066413879395}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.19516359191191823, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06551161565278706, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.16020859228937248, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.1024097392433568, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.042794839331978245, "sim_compute_performance-ego": 0.07331327388161107, "sim_compute_robot_state-ego": 0.07995269800487317, "sim_compute_robot_state-npc0": 0.07587302358526933, "sim_compute_robot_state-npc1": 0.07561360848577399, "sim_compute_robot_state-npc2": 0.07680526218916241, "sim_compute_robot_state-npc3": 0.07427901343295448}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.2014664517173284, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06634330749511719, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.16626728637309013, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.10428974900064587, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04332833652254901, "sim_compute_performance-ego": 0.0736569422709791, "sim_compute_robot_state-ego": 0.08045134061499487, "sim_compute_robot_state-npc0": 0.07533746731432178, "sim_compute_robot_state-npc1": 0.0740653321712832, "sim_compute_robot_state-npc2": 0.07273855390427988, "sim_compute_robot_state-npc3": 0.073751977727383}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1881226556641715, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06362409251076835, "in-drivable-lane": 0, "agent_compute-ego": 0.15842097997665405, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.10260948964527676, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04536546979631696, "sim_compute_performance-ego": 0.07334284271512713, "sim_compute_robot_state-ego": 0.07527423756463188, "sim_compute_robot_state-npc0": 0.07385186638150897, "sim_compute_robot_state-npc1": 0.07276292358125959, "sim_compute_robot_state-npc2": 0.07241382769175939, "sim_compute_robot_state-npc3": 0.07523634604045323}}
set_robot_commands_max	0.11111669628708452
set_robot_commands_mean	0.10373909029486753
set_robot_commands_median	0.10260948964527676
set_robot_commands_min	0.09826977729797363
sim_compute_performance-ego_max	0.07431769812548603
sim_compute_performance-ego_mean	0.0728642922677813
sim_compute_performance-ego_median	0.07334284271512713
sim_compute_performance-ego_min	0.06969070434570312
sim_compute_robot_state-ego_max	0.0828135543399387
sim_compute_robot_state-ego_mean	0.07942677873306156
sim_compute_robot_state-ego_median	0.07995269800487317
sim_compute_robot_state-ego_min	0.07527423756463188
sim_compute_robot_state-npc0_max	0.0784455935160319
sim_compute_robot_state-npc0_mean	0.07505619488049572
sim_compute_robot_state-npc0_median	0.07533746731432178
sim_compute_robot_state-npc0_min	0.07177302360534668
sim_compute_robot_state-npc1_max	0.07790264376887569
sim_compute_robot_state-npc1_mean	0.07449468857348439
sim_compute_robot_state-npc1_median	0.0740653321712832
sim_compute_robot_state-npc1_min	0.07212893486022949
sim_compute_robot_state-npc2_max	0.07752743032243517
sim_compute_robot_state-npc2_mean	0.0746215269217471
sim_compute_robot_state-npc2_median	0.07362256050109864
sim_compute_robot_state-npc2_min	0.07241382769175939
sim_compute_robot_state-npc3_max	0.07853579962695087
sim_compute_robot_state-npc3_mean	0.0755807601933071
sim_compute_robot_state-npc3_median	0.07523634604045323
sim_compute_robot_state-npc3_min	0.073751977727383
sim_compute_sim_state_max	0.04536546979631696
sim_compute_sim_state_mean	0.04303327541883575
sim_compute_sim_state_median	0.04332833652254901
sim_compute_sim_state_min	0.03958884239196778
sim_physics_max	0.2099982738494873
sim_physics_mean	0.19750629533263292
sim_physics_median	0.19516359191191823
sim_physics_min	0.1881226556641715
sim_render-ego_max	0.06967858914975766
sim_render-ego_mean	0.06559331333534327
sim_render-ego_median	0.06551161565278706
sim_render-ego_min	0.06280896186828613
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

22514

3225

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

aido2-LF-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-16 21:52:33+00:00

2019-05-16 22:00:21+00:00

0:07:48

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22478

3269

jiang peng

First test - TH

aido2-LFVI-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-16 21:02:02+00:00

2019-05-16 21:45:11+00:00

0:43:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.1928627733177803
survival_time_median	14.950000000000076
deviation-center-line_median	1.1297102345353156
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.2079839245478312
agent_compute-ego_mean	0.19514523347218832
agent_compute-ego_median	0.19732200304667155
agent_compute-ego_min	0.1745238161087036
deviation-center-line_max	1.2984984168083928
deviation-center-line_mean	1.1400954475767242
deviation-center-line_min	0.920973641706334
deviation-heading_max	8.912481499087207
deviation-heading_mean	3.9627203809520735
deviation-heading_median	2.9925279061212793
deviation-heading_min	2.149066894730949
driven_any_max	4.747063545019325
driven_any_mean	3.694730054188277
driven_any_median	4.429396121543521
driven_any_min	0.6029833071425168
driven_lanedir_consec_max	4.166887183074564
driven_lanedir_consec_mean	2.982007677042271
driven_lanedir_consec_min	0.5956261393744722
driven_lanedir_max	4.167033237939997
driven_lanedir_mean	2.9821559319242583
driven_lanedir_median	3.193318419631921
driven_lanedir_min	0.5956261393744722
in-drivable-lane_max	4.300000000000035
in-drivable-lane_mean	1.8900000000000137
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 4.686055497549962, "sim_physics": 0.21097280899683635, "survival_time": 14.950000000000076, "driven_lanedir": 4.167033237939997, "sim_render-ego": 0.0679859749476115, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.19972487449645995, "deviation-heading": 2.9925279061212793, "set_robot_commands": 0.10377381086349488, "deviation-center-line": 1.1297102345353156, "driven_lanedir_consec": 4.166887183074564, "sim_compute_sim_state": 0.042455898920694984, "sim_compute_performance-ego": 0.07368861834208171, "sim_compute_robot_state-ego": 0.07952031453450521, "sim_compute_robot_state-npc0": 0.07603556474049886, "sim_compute_robot_state-npc1": 0.07492805163065593, "sim_compute_robot_state-npc2": 0.0741956361134847, "sim_compute_robot_state-npc3": 0.07471672455469767}, "udem1-1-0": {"driven_any": 0.6029833071425168, "sim_physics": 0.21542454719543455, "survival_time": 14.950000000000076, "driven_lanedir": 0.5956261393744722, "sim_render-ego": 0.06651774644851685, "in-drivable-lane": 0, "agent_compute-ego": 0.1961715491612752, "deviation-heading": 8.912481499087207, "set_robot_commands": 0.10470554987589518, "deviation-center-line": 1.2879434971893793, "driven_lanedir_consec": 0.5956261393744722, "sim_compute_sim_state": 0.043823493321736656, "sim_compute_performance-ego": 0.07483383178710938, "sim_compute_robot_state-ego": 0.08134915033976237, "sim_compute_robot_state-npc0": 0.0773846975962321, "sim_compute_robot_state-npc1": 0.07506900707880657, "sim_compute_robot_state-npc2": 0.07553852558135986, "sim_compute_robot_state-npc3": 0.07659899791081747}, "udem1-2-0": {"driven_any": 4.429396121543521, "sim_physics": 0.21626497189203897, "survival_time": 14.950000000000076, "driven_lanedir": 3.193318419631921, "sim_render-ego": 0.06271966536839803, "in-drivable-lane": 4.300000000000035, "agent_compute-ego": 0.1745238161087036, "deviation-heading": 3.1827753581112717, "set_robot_commands": 0.09222187121709188, "deviation-center-line": 0.920973641706334, "driven_lanedir_consec": 3.1928627733177803, "sim_compute_sim_state": 0.03859273036321005, "sim_compute_performance-ego": 0.07032028913497924, "sim_compute_robot_state-ego": 0.07235512097676595, "sim_compute_robot_state-npc0": 0.06822649319966634, "sim_compute_robot_state-npc1": 0.06763775825500488, "sim_compute_robot_state-npc2": 0.06794969956080119, "sim_compute_robot_state-npc3": 0.06927379767100016}, "udem1-3-0": {"driven_any": 4.747063545019325, "sim_physics": 0.23000691811243693, "survival_time": 14.950000000000076, "driven_lanedir": 3.141748953177258, "sim_render-ego": 0.07314892053604126, "in-drivable-lane": 4.250000000000031, "agent_compute-ego": 0.19732200304667155, "deviation-heading": 2.576750246709662, "set_robot_commands": 0.10507477045059203, "deviation-center-line": 1.0633514476441996, "driven_lanedir_consec": 3.1416093799468965, "sim_compute_sim_state": 0.04192545652389526, "sim_compute_performance-ego": 0.07542896270751953, "sim_compute_robot_state-ego": 0.08101131836573283, "sim_compute_robot_state-npc0": 0.07587045590082804, "sim_compute_robot_state-npc1": 0.07493554830551147, "sim_compute_robot_state-npc2": 0.07319547176361084, "sim_compute_robot_state-npc3": 0.07258665720621744}, "udem1-4-0": {"driven_any": 4.008151799686058, "sim_physics": 0.24317551374435423, "survival_time": 14.950000000000076, "driven_lanedir": 3.8130529094976415, "sim_render-ego": 0.07025822877883911, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.2079839245478312, "deviation-heading": 2.149066894730949, "set_robot_commands": 0.10837629238764444, "deviation-center-line": 1.2984984168083928, "driven_lanedir_consec": 3.8130529094976415, "sim_compute_sim_state": 0.043574086030324304, "sim_compute_performance-ego": 0.07784417470296225, "sim_compute_robot_state-ego": 0.08486685991287231, "sim_compute_robot_state-npc0": 0.07758621215820312, "sim_compute_robot_state-npc1": 0.07805768569310506, "sim_compute_robot_state-npc2": 0.07967583735783895, "sim_compute_robot_state-npc3": 0.077426704565684}}
set_robot_commands_max	0.10837629238764444
set_robot_commands_mean	0.10283045895894367
set_robot_commands_median	0.10470554987589518
set_robot_commands_min	0.09222187121709188
sim_compute_performance-ego_max	0.07784417470296225
sim_compute_performance-ego_mean	0.07442317533493041
sim_compute_performance-ego_median	0.07483383178710938
sim_compute_performance-ego_min	0.07032028913497924
sim_compute_robot_state-ego_max	0.08486685991287231
sim_compute_robot_state-ego_mean	0.07982055282592773
sim_compute_robot_state-ego_median	0.08101131836573283
sim_compute_robot_state-ego_min	0.07235512097676595
sim_compute_robot_state-npc0_max	0.07758621215820312
sim_compute_robot_state-npc0_mean	0.07502068471908568
sim_compute_robot_state-npc0_median	0.07603556474049886
sim_compute_robot_state-npc0_min	0.06822649319966634
sim_compute_robot_state-npc1_max	0.07805768569310506
sim_compute_robot_state-npc1_mean	0.07412561019261679
sim_compute_robot_state-npc1_median	0.07493554830551147
sim_compute_robot_state-npc1_min	0.06763775825500488
sim_compute_robot_state-npc2_max	0.07967583735783895
sim_compute_robot_state-npc2_mean	0.07411103407541911
sim_compute_robot_state-npc2_median	0.0741956361134847
sim_compute_robot_state-npc2_min	0.06794969956080119
sim_compute_robot_state-npc3_max	0.077426704565684
sim_compute_robot_state-npc3_mean	0.07412057638168335
sim_compute_robot_state-npc3_median	0.07471672455469767
sim_compute_robot_state-npc3_min	0.06927379767100016
sim_compute_sim_state_max	0.043823493321736656
sim_compute_sim_state_mean	0.04207433303197225
sim_compute_sim_state_median	0.042455898920694984
sim_compute_sim_state_min	0.03859273036321005
sim_physics_max	0.24317551374435423
sim_physics_mean	0.2231689519882202
sim_physics_median	0.21626497189203897
sim_physics_min	0.21097280899683635
sim_render-ego_max	0.07314892053604126
sim_render-ego_mean	0.06812610721588135
sim_render-ego_median	0.0679859749476115
sim_render-ego_min	0.06271966536839803
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

22476

3271

jiang peng

RL - TH -hhk

aido2-LF-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-16 21:01:09+00:00

2019-05-16 21:01:47+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22466

3284

Angel Woo 🇭🇰

Roasted duck

aido2-LF-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-16 20:49:43+00:00

2019-05-16 21:00:42+00:00

0:10:59

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22464

3532

Nicky Eichmann

Baseline solution using reinforcement learning

aido2-LF-sim-validation

step1-simulation

failed

yes

ip-172-31-25-98-2470

2019-05-16 20:48:24+00:00

2019-05-16 20:49:36+00:00

0:01:12

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 296, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 37, in on_received_observations
               ||     self.current_image = self.preprocessor.preprocess(obs)
               ||   File "/workspace/wrappers.py", line 32, in preprocess
               ||     transposed = stacked.transpose(2, 0, 1)
               || AttributeError: 'LazyFrames' object has no attribute 'transpose'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22449

3293

Artem Ioselevskii

SSegm

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-16 20:34:28+00:00

2019-05-16 20:48:06+00:00

0:13:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6474900641025108
survival_time_median	4.749999999999991
deviation-center-line_median	0.33565629269996433
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.11920460259042136
agent_compute-ego_mean	0.1086390019595158
agent_compute-ego_median	0.1133997985294887
agent_compute-ego_min	0.08548246489630805
deviation-center-line_max	1.0744932491828372
deviation-center-line_mean	0.4492548033576746
deviation-center-line_min	0.1921050629001626
deviation-heading_max	1.7972466264678248
deviation-heading_mean	0.8267172986742448
deviation-heading_median	0.6372237793231156
deviation-heading_min	0.32153251851024206
driven_any_max	3.574793749267016
driven_any_mean	1.3688119323631849
driven_any_median	1.0684491397062577
driven_any_min	0.4197309915310667
driven_lanedir_consec_max	2.126015779518985
driven_lanedir_consec_mean	0.9855135048765432
driven_lanedir_consec_min	0.41529450228339737
driven_lanedir_max	2.126015779518985
driven_lanedir_mean	0.9855135048765432
driven_lanedir_median	0.6474900641025108
driven_lanedir_min	0.41529450228339737
in-drivable-lane_max	5.600000000000037
in-drivable-lane_mean	1.4600000000000062
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0684491397062577, "sim_physics": 0.1452962122465435, "survival_time": 4.749999999999991, "driven_lanedir": 0.6474900641025108, "sim_render-ego": 0.07039427757263184, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.10873950908058568, "deviation-heading": 0.33705040119769464, "set_robot_commands": 0.11274378174229673, "deviation-center-line": 0.33565629269996433, "driven_lanedir_consec": 0.6474900641025108, "sim_compute_sim_state": 0.043956681301719265, "sim_compute_performance-ego": 0.08084755696748433, "sim_compute_robot_state-ego": 0.08787464091652318}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2023777606814428, "sim_physics": 0.14002584048679895, "survival_time": 5.249999999999989, "driven_lanedir": 1.1752965882464843, "sim_render-ego": 0.07274792762029739, "in-drivable-lane": 0, "agent_compute-ego": 0.1133997985294887, "deviation-heading": 1.0405331678723466, "set_robot_commands": 0.12157671792166572, "deviation-center-line": 0.4319777220833764, "driven_lanedir_consec": 1.1752965882464843, "sim_compute_sim_state": 0.044494674319312685, "sim_compute_performance-ego": 0.0838318597702753, "sim_compute_robot_state-ego": 0.10121594837733676}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4197309915310667, "sim_physics": 0.1592885168587289, "survival_time": 2.0500000000000007, "driven_lanedir": 0.41529450228339737, "sim_render-ego": 0.07180794855443443, "in-drivable-lane": 0, "agent_compute-ego": 0.11920460259042136, "deviation-heading": 0.32153251851024206, "set_robot_commands": 0.12202472221560597, "deviation-center-line": 0.21204168992203268, "driven_lanedir_consec": 0.41529450228339737, "sim_compute_sim_state": 0.045939747880144814, "sim_compute_performance-ego": 0.08374766605656321, "sim_compute_robot_state-ego": 0.08917169454621106}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5787080206301412, "sim_physics": 0.10233709547254774, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5634705902313382, "sim_render-ego": 0.05546299174979881, "in-drivable-lane": 0, "agent_compute-ego": 0.08548246489630805, "deviation-heading": 0.6372237793231156, "set_robot_commands": 0.08253048084400318, "deviation-center-line": 0.1921050629001626, "driven_lanedir_consec": 0.5634705902313382, "sim_compute_sim_state": 0.03575546211666531, "sim_compute_performance-ego": 0.061019478020844634, "sim_compute_robot_state-ego": 0.06334575017293294}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.574793749267016, "sim_physics": 0.1390359377861023, "survival_time": 14.950000000000076, "driven_lanedir": 2.126015779518985, "sim_render-ego": 0.07120784997940063, "in-drivable-lane": 5.600000000000037, "agent_compute-ego": 0.11636863470077514, "deviation-heading": 1.7972466264678248, "set_robot_commands": 0.11487708568572998, "deviation-center-line": 1.0744932491828372, "driven_lanedir_consec": 2.126015779518985, "sim_compute_sim_state": 0.044561075369517006, "sim_compute_performance-ego": 0.08002107699712117, "sim_compute_robot_state-ego": 0.08819350639979044}}
set_robot_commands_max	0.12202472221560597
set_robot_commands_mean	0.1107505576818603
set_robot_commands_median	0.11487708568572998
set_robot_commands_min	0.08253048084400318
sim_compute_performance-ego_max	0.0838318597702753
sim_compute_performance-ego_mean	0.07789352756245774
sim_compute_performance-ego_median	0.08084755696748433
sim_compute_performance-ego_min	0.061019478020844634
sim_compute_robot_state-ego_max	0.10121594837733676
sim_compute_robot_state-ego_mean	0.08596030808255888
sim_compute_robot_state-ego_median	0.08819350639979044
sim_compute_robot_state-ego_min	0.06334575017293294
sim_compute_sim_state_max	0.045939747880144814
sim_compute_sim_state_mean	0.042941528197471816
sim_compute_sim_state_median	0.044494674319312685
sim_compute_sim_state_min	0.03575546211666531
sim_physics_max	0.1592885168587289
sim_physics_mean	0.13719672057014426
sim_physics_median	0.14002584048679895
sim_physics_min	0.10233709547254774
sim_render-ego_max	0.07274792762029739
sim_render-ego_mean	0.06832419909531262
sim_render-ego_median	0.07120784997940063
sim_render-ego_min	0.05546299174979881
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	5.940000000000011
survival_time_min	2.0500000000000007

No reset possible

22436

3304

Artem Ioselevskii

SSegm

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-16 20:17:27+00:00

2019-05-16 20:34:13+00:00

0:16:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.585814050064153
survival_time_median	8.449999999999985
deviation-center-line_median	0.6945783246660406
in-drivable-lane_median	0.7999999999999972

other stats

agent_compute-ego_max	0.11147217496612367
agent_compute-ego_mean	0.11049735826940732
agent_compute-ego_median	0.11091874748147944
agent_compute-ego_min	0.10882794654975504
deviation-center-line_max	0.7831976112958157
deviation-center-line_mean	0.5759121265211511
deviation-center-line_min	0.30014005440258074
deviation-heading_max	2.4611290983058187
deviation-heading_mean	1.470387017678365
deviation-heading_median	1.4836971398603878
deviation-heading_min	0.3111561495444794
driven_any_max	2.1078690473318824
driven_any_mean	1.5620085182730947
driven_any_median	1.985011652852886
driven_any_min	0.6398534714319227
driven_lanedir_consec_max	1.7605066508868576
driven_lanedir_consec_mean	1.296562464930877
driven_lanedir_consec_min	0.6360814836473065
driven_lanedir_max	1.7605066508868576
driven_lanedir_mean	1.296562464930877
driven_lanedir_median	1.585814050064153
driven_lanedir_min	0.6360814836473065
in-drivable-lane_max	1.6000000000000112
in-drivable-lane_mean	0.7700000000000008
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1078690473318824, "sim_physics": 0.14142253796259563, "survival_time": 8.999999999999993, "driven_lanedir": 1.585814050064153, "sim_render-ego": 0.07024775346120199, "in-drivable-lane": 1.6000000000000112, "agent_compute-ego": 0.11119043032328288, "deviation-heading": 2.042516060420421, "set_robot_commands": 0.11366219653023614, "deviation-center-line": 0.7623956573587894, "driven_lanedir_consec": 1.585814050064153, "sim_compute_sim_state": 0.04453906483120389, "sim_compute_performance-ego": 0.08078281217151217, "sim_compute_robot_state-ego": 0.08628807465235393}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0556153953187335, "sim_physics": 0.13226024053430044, "survival_time": 4.6499999999999915, "driven_lanedir": 0.8109259234389695, "sim_render-ego": 0.0725913457973029, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.11091874748147944, "deviation-heading": 1.0534366402607187, "set_robot_commands": 0.1192703631616408, "deviation-center-line": 0.30014005440258074, "driven_lanedir_consec": 0.8109259234389695, "sim_compute_sim_state": 0.04458159016024682, "sim_compute_performance-ego": 0.08111626358442409, "sim_compute_robot_state-ego": 0.09499919029974167}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6398534714319227, "sim_physics": 0.13321974317906266, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6360814836473065, "sim_render-ego": 0.06968779078984665, "in-drivable-lane": 0, "agent_compute-ego": 0.10882794654975504, "deviation-heading": 0.3111561495444794, "set_robot_commands": 0.11129761550386072, "deviation-center-line": 0.3392489848825288, "driven_lanedir_consec": 0.6360814836473065, "sim_compute_sim_state": 0.045363785856861176, "sim_compute_performance-ego": 0.07880105810650324, "sim_compute_robot_state-ego": 0.08399496644230212}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.985011652852886, "sim_physics": 0.13514755322383, "survival_time": 8.449999999999985, "driven_lanedir": 1.689484216617097, "sim_render-ego": 0.07268298730342346, "in-drivable-lane": 0.6499999999999986, "agent_compute-ego": 0.11147217496612367, "deviation-heading": 2.4611290983058187, "set_robot_commands": 0.11298693002328364, "deviation-center-line": 0.6945783246660406, "driven_lanedir_consec": 1.689484216617097, "sim_compute_sim_state": 0.04323593963532758, "sim_compute_performance-ego": 0.08114923104731994, "sim_compute_robot_state-ego": 0.08756366001783743}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.0216930244300477, "sim_physics": 0.13919835589652838, "survival_time": 8.599999999999987, "driven_lanedir": 1.7605066508868576, "sim_render-ego": 0.0714399537374807, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.11007749202639558, "deviation-heading": 1.4836971398603878, "set_robot_commands": 0.11095704588779184, "deviation-center-line": 0.7831976112958157, "driven_lanedir_consec": 1.7605066508868576, "sim_compute_sim_state": 0.04288572766060053, "sim_compute_performance-ego": 0.08045643290808034, "sim_compute_robot_state-ego": 0.08852879807006481}}
set_robot_commands_max	0.1192703631616408
set_robot_commands_mean	0.11363483022136264
set_robot_commands_median	0.11298693002328364
set_robot_commands_min	0.11095704588779184
sim_compute_performance-ego_max	0.08114923104731994
sim_compute_performance-ego_mean	0.08046115956356796
sim_compute_performance-ego_median	0.08078281217151217
sim_compute_performance-ego_min	0.07880105810650324
sim_compute_robot_state-ego_max	0.09499919029974167
sim_compute_robot_state-ego_mean	0.08827493789646
sim_compute_robot_state-ego_median	0.08756366001783743
sim_compute_robot_state-ego_min	0.08399496644230212
sim_compute_sim_state_max	0.045363785856861176
sim_compute_sim_state_mean	0.044121221628848
sim_compute_sim_state_median	0.04453906483120389
sim_compute_sim_state_min	0.04288572766060053
sim_physics_max	0.14142253796259563
sim_physics_mean	0.13624968615926342
sim_physics_median	0.13514755322383
sim_physics_min	0.13226024053430044
sim_render-ego_max	0.07268298730342346
sim_render-ego_mean	0.07132996621785115
sim_render-ego_median	0.0714399537374807
sim_render-ego_min	0.06968779078984665
simulation-passed	1
survival_time_max	8.999999999999993
survival_time_mean	6.72999999999999
survival_time_min	2.9499999999999975

No reset possible

22414

3323

Angel Woo 🇭🇰

Roasted duck

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-16 20:01:12+00:00

2019-05-16 20:16:46+00:00

0:15:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.34867936245282793
survival_time_median	5.299999999999989
deviation-center-line_median	0.2934686035974634
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.28643586380141123
agent_compute-ego_mean	0.24371015025212311
agent_compute-ego_median	0.23221382779895133
agent_compute-ego_min	0.20901274998982747
deviation-center-line_max	0.931295408698229
deviation-center-line_mean	0.43319994920444793
deviation-center-line_min	0.2809808935661084
deviation-heading_max	3.123522371554975
deviation-heading_mean	1.934967277176832
deviation-heading_median	1.8910957430500857
deviation-heading_min	0.8723893592808807
driven_any_max	1.1261113914474283
driven_any_mean	0.5778791222379572
driven_any_median	0.39690676077647
driven_any_min	0.22655508516986425
driven_lanedir_consec_max	1.0516826212414383
driven_lanedir_consec_mean	0.5063918311771854
driven_lanedir_consec_min	0.21413722520459633
driven_lanedir_max	1.0516826212414383
driven_lanedir_mean	0.5063918311771854
driven_lanedir_median	0.34867936245282793
driven_lanedir_min	0.21413722520459633
in-drivable-lane_max	1.6000000000000227
in-drivable-lane_mean	0.5000000000000059
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1261113914474283, "sim_physics": 0.10345728635787964, "survival_time": 14.950000000000076, "driven_lanedir": 1.0516826212414383, "sim_render-ego": 0.05658898671468099, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.20901274998982747, "deviation-heading": 3.123522371554975, "set_robot_commands": 0.08797706127166748, "deviation-center-line": 0.931295408698229, "driven_lanedir_consec": 1.0516826212414383, "sim_compute_sim_state": 0.03548858404159546, "sim_compute_performance-ego": 0.06236563682556152, "sim_compute_robot_state-ego": 0.07084330717722574}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8368599895065473, "sim_physics": 0.12224361730176347, "survival_time": 10.750000000000018, "driven_lanedir": 0.6727050688733841, "sim_render-ego": 0.06464313130046045, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.22647221254747968, "deviation-heading": 1.8910957430500857, "set_robot_commands": 0.1034938512846481, "deviation-center-line": 0.36985823194129736, "driven_lanedir_consec": 0.6727050688733841, "sim_compute_sim_state": 0.04071777698605559, "sim_compute_performance-ego": 0.07256083599356718, "sim_compute_robot_state-ego": 0.07790304228316906}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22655508516986425, "sim_physics": 0.11723788721220832, "survival_time": 2.799999999999998, "driven_lanedir": 0.21413722520459633, "sim_render-ego": 0.0695404154913766, "in-drivable-lane": 0, "agent_compute-ego": 0.28643586380141123, "deviation-heading": 0.8723893592808807, "set_robot_commands": 0.11563728962625776, "deviation-center-line": 0.2934686035974634, "driven_lanedir_consec": 0.21413722520459633, "sim_compute_sim_state": 0.04349963579859052, "sim_compute_performance-ego": 0.08074690188680377, "sim_compute_robot_state-ego": 0.09283004914011274}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3029623842894765, "sim_physics": 0.12322334006980612, "survival_time": 4.049999999999994, "driven_lanedir": 0.24475487811368035, "sim_render-ego": 0.0675804497283182, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.2644160971229459, "deviation-heading": 1.9973464709795616, "set_robot_commands": 0.10580044322543676, "deviation-center-line": 0.2809808935661084, "driven_lanedir_consec": 0.24475487811368035, "sim_compute_sim_state": 0.04342655193658523, "sim_compute_performance-ego": 0.07549200234589754, "sim_compute_robot_state-ego": 0.08676922468491542}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.39690676077647, "sim_physics": 0.1345306972287736, "survival_time": 5.299999999999989, "driven_lanedir": 0.34867936245282793, "sim_render-ego": 0.06758539631681622, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.23221382779895133, "deviation-heading": 1.790482441018658, "set_robot_commands": 0.1082571452518679, "deviation-center-line": 0.2903966082191415, "driven_lanedir_consec": 0.34867936245282793, "sim_compute_sim_state": 0.04261259987669171, "sim_compute_performance-ego": 0.07458914675802555, "sim_compute_robot_state-ego": 0.08073814410083699}}
set_robot_commands_max	0.11563728962625776
set_robot_commands_mean	0.1042331581319756
set_robot_commands_median	0.10580044322543676
set_robot_commands_min	0.08797706127166748
sim_compute_performance-ego_max	0.08074690188680377
sim_compute_performance-ego_mean	0.0731509047619711
sim_compute_performance-ego_median	0.07458914675802555
sim_compute_performance-ego_min	0.06236563682556152
sim_compute_robot_state-ego_max	0.09283004914011274
sim_compute_robot_state-ego_mean	0.081816753477252
sim_compute_robot_state-ego_median	0.08073814410083699
sim_compute_robot_state-ego_min	0.07084330717722574
sim_compute_sim_state_max	0.04349963579859052
sim_compute_sim_state_mean	0.0411490297279037
sim_compute_sim_state_median	0.04261259987669171
sim_compute_sim_state_min	0.03548858404159546
sim_physics_max	0.1345306972287736
sim_physics_mean	0.12013856563408624
sim_physics_median	0.12224361730176347
sim_physics_min	0.10345728635787964
sim_render-ego_max	0.0695404154913766
sim_render-ego_mean	0.06518767591033049
sim_render-ego_median	0.0675804497283182
sim_render-ego_min	0.05658898671468099
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.5700000000000145
survival_time_min	2.799999999999998

No reset possible

22385

3345

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-16 19:01:31+00:00

2019-05-16 20:00:55+00:00

0:59:24

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22360

3385

jiang peng

RL-TH-shi

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-16 18:04:04+00:00

2019-05-16 19:00:44+00:00

0:56:40

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22355

3388

Liam Paull 🇨🇦

duckietown lane following demo

aido2-LF-sim-testing

step1-simulation

failed

yes

ip-172-31-25-98-2470

2019-05-16 18:01:09+00:00

2019-05-16 18:03:26+00:00

0:02:17

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22348

3392

jiang peng

RL-TH-shi

aido2-LFVI-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-16 17:45:04+00:00

2019-05-16 18:00:29+00:00

0:15:25

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22334

3405

jiang peng

RL-TH-shi

aido2-LFVI-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-16 17:00:46+00:00

2019-05-16 17:44:10+00:00

0:43:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.895438432333787
survival_time_median	14.950000000000076
deviation-center-line_median	0.9081057233870096
in-drivable-lane_median	1.200000000000017

other stats

agent_compute-ego_max	0.19882818380991615
agent_compute-ego_mean	0.19312283356984455
agent_compute-ego_median	0.19410307804743449
agent_compute-ego_min	0.18387902895609537
deviation-center-line_max	1.3722764209981286
deviation-center-line_mean	0.8483095932199228
deviation-center-line_min	0.3571308712923124
deviation-heading_max	9.43962199445413
deviation-heading_mean	4.44821196422196
deviation-heading_median	3.7501851641523376
deviation-heading_min	2.1518183611185044
driven_any_max	3.920723750849042
driven_any_mean	3.1051417202302565
driven_any_median	3.173667004830464
driven_any_min	1.9125998381922429
driven_lanedir_consec_max	3.4378303357486875
driven_lanedir_consec_mean	2.723868247415728
driven_lanedir_consec_min	1.344143753118271
driven_lanedir_max	3.846682384129047
driven_lanedir_mean	2.9463737870664333
driven_lanedir_median	3.0935160818430028
driven_lanedir_min	1.79042255999514
in-drivable-lane_max	2.10000000000003
in-drivable-lane_mean	0.9700000000000136
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 3.369127165280359, "sim_physics": 0.20355485280354815, "survival_time": 14.950000000000076, "driven_lanedir": 2.8958943603088123, "sim_render-ego": 0.06391871213912964, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.18387902895609537, "deviation-heading": 3.7501851641523376, "set_robot_commands": 0.0991329042116801, "deviation-center-line": 1.0659166859025444, "driven_lanedir_consec": 2.895438432333787, "sim_compute_sim_state": 0.04104787667592367, "sim_compute_performance-ego": 0.07054557005564371, "sim_compute_robot_state-ego": 0.07623035589853923, "sim_compute_robot_state-npc0": 0.07105382283528645, "sim_compute_robot_state-npc1": 0.07021361271540325, "sim_compute_robot_state-npc2": 0.07028861204783121, "sim_compute_robot_state-npc3": 0.0700760022799174}, "udem1-1-0": {"driven_any": 3.1495908419991783, "sim_physics": 0.21848936239878336, "survival_time": 14.950000000000076, "driven_lanedir": 3.1053535490561623, "sim_render-ego": 0.06863030195236205, "in-drivable-lane": 0, "agent_compute-ego": 0.19882818380991615, "deviation-heading": 2.4614994871951357, "set_robot_commands": 0.10406065543492636, "deviation-center-line": 0.5381182645196196, "driven_lanedir_consec": 3.105262282735925, "sim_compute_sim_state": 0.04291326602300008, "sim_compute_performance-ego": 0.07811745723088583, "sim_compute_robot_state-ego": 0.08173092444737752, "sim_compute_robot_state-npc0": 0.0746874753634135, "sim_compute_robot_state-npc1": 0.07503856420516967, "sim_compute_robot_state-npc2": 0.0766793942451477, "sim_compute_robot_state-npc3": 0.07524564981460571}, "udem1-2-0": {"driven_any": 1.9125998381922429, "sim_physics": 0.21581990003585816, "survival_time": 14.950000000000076, "driven_lanedir": 1.79042255999514, "sim_render-ego": 0.06911102374394734, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.19406306743621823, "deviation-heading": 9.43962199445413, "set_robot_commands": 0.10739981333414714, "deviation-center-line": 1.3722764209981286, "driven_lanedir_consec": 1.344143753118271, "sim_compute_sim_state": 0.04336446444193522, "sim_compute_performance-ego": 0.07705564101537068, "sim_compute_robot_state-ego": 0.08156484444936117, "sim_compute_robot_state-npc0": 0.07527540445327759, "sim_compute_robot_state-npc1": 0.0781474264462789, "sim_compute_robot_state-npc2": 0.0759609850247701, "sim_compute_robot_state-npc3": 0.0756653094291687}, "udem1-3-0": {"driven_any": 3.920723750849042, "sim_physics": 0.21475159962972004, "survival_time": 14.950000000000076, "driven_lanedir": 3.846682384129047, "sim_render-ego": 0.06684284130732218, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.1947408095995585, "deviation-heading": 2.1518183611185044, "set_robot_commands": 0.10385061820348104, "deviation-center-line": 0.3571308712923124, "driven_lanedir_consec": 3.4378303357486875, "sim_compute_sim_state": 0.04184169928232829, "sim_compute_performance-ego": 0.07504610220591228, "sim_compute_robot_state-ego": 0.0802005116144816, "sim_compute_robot_state-npc0": 0.07525452693303426, "sim_compute_robot_state-npc1": 0.07470487753550212, "sim_compute_robot_state-npc2": 0.07370225667953491, "sim_compute_robot_state-npc3": 0.07394418557484944}, "udem1-4-0": {"driven_any": 3.173667004830464, "sim_physics": 0.21256491820017495, "survival_time": 14.950000000000076, "driven_lanedir": 3.0935160818430028, "sim_render-ego": 0.0691185736656189, "in-drivable-lane": 0, "agent_compute-ego": 0.19410307804743449, "deviation-heading": 4.437934814189693, "set_robot_commands": 0.10484605471293132, "deviation-center-line": 0.9081057233870096, "driven_lanedir_consec": 2.8366664331419704, "sim_compute_sim_state": 0.04166354179382324, "sim_compute_performance-ego": 0.07553735335667928, "sim_compute_robot_state-ego": 0.07953561067581177, "sim_compute_robot_state-npc0": 0.0734898320833842, "sim_compute_robot_state-npc1": 0.07472980976104736, "sim_compute_robot_state-npc2": 0.07264341831207276, "sim_compute_robot_state-npc3": 0.07406253894170126}}
set_robot_commands_max	0.10739981333414714
set_robot_commands_mean	0.1038580091794332
set_robot_commands_median	0.10406065543492636
set_robot_commands_min	0.0991329042116801
sim_compute_performance-ego_max	0.07811745723088583
sim_compute_performance-ego_mean	0.07526042477289835
sim_compute_performance-ego_median	0.07553735335667928
sim_compute_performance-ego_min	0.07054557005564371
sim_compute_robot_state-ego_max	0.08173092444737752
sim_compute_robot_state-ego_mean	0.07985244941711425
sim_compute_robot_state-ego_median	0.0802005116144816
sim_compute_robot_state-ego_min	0.07623035589853923
sim_compute_robot_state-npc0_max	0.07527540445327759
sim_compute_robot_state-npc0_mean	0.07395221233367918
sim_compute_robot_state-npc0_median	0.0746874753634135
sim_compute_robot_state-npc0_min	0.07105382283528645
sim_compute_robot_state-npc1_max	0.0781474264462789
sim_compute_robot_state-npc1_mean	0.07456685813268026
sim_compute_robot_state-npc1_median	0.07472980976104736
sim_compute_robot_state-npc1_min	0.07021361271540325
sim_compute_robot_state-npc2_max	0.0766793942451477
sim_compute_robot_state-npc2_mean	0.07385493326187134
sim_compute_robot_state-npc2_median	0.07370225667953491
sim_compute_robot_state-npc2_min	0.07028861204783121
sim_compute_robot_state-npc3_max	0.0756653094291687
sim_compute_robot_state-npc3_mean	0.0737987372080485
sim_compute_robot_state-npc3_median	0.07406253894170126
sim_compute_robot_state-npc3_min	0.0700760022799174
sim_compute_sim_state_max	0.04336446444193522
sim_compute_sim_state_mean	0.0421661696434021
sim_compute_sim_state_median	0.04184169928232829
sim_compute_sim_state_min	0.04104787667592367
sim_physics_max	0.21848936239878336
sim_physics_mean	0.21303612661361693
sim_physics_median	0.21475159962972004
sim_physics_min	0.20355485280354815
sim_render-ego_max	0.0691185736656189
sim_render-ego_mean	0.06752429056167603
sim_render-ego_median	0.06863030195236205
sim_render-ego_min	0.06391871213912964
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

22308

3488

FANG MEIYI 🇸🇬

test

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-16 16:01:05+00:00

2019-05-16 17:00:24+00:00

0:59:19

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22305

3428

jiang peng

RL-TH-shi

aido2-LFVI-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-16 15:48:50+00:00

2019-05-16 16:00:35+00:00

0:11:45

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22304

3430

jiang peng

RL - TH -hhk

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-16 15:47:43+00:00

2019-05-16 15:48:22+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22280

3452

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

aido2-LFVI-sim-validation

step1-simulation

failed

yes

ip-172-31-25-98-2470

2019-05-16 15:02:12+00:00

2019-05-17 18:13:27+00:00

1 day, 3:11:15

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.894634354252406
survival_time_median	14.950000000000076
deviation-center-line_median	1.0750269113686055
in-drivable-lane_median	1.7500000000000249

other stats

agent_compute-ego_max	0.21811933914820353
agent_compute-ego_mean	0.12223773339283037
agent_compute-ego_median	0.08779063940048218
agent_compute-ego_min	0.084898746157267
deviation-center-line_max	1.2961775979669246
deviation-center-line_mean	0.9937003543566776
deviation-center-line_min	0.4412642023290711
deviation-heading_max	4.623851797560124
deviation-heading_mean	3.681972142004979
deviation-heading_median	3.831121292519462
deviation-heading_min	2.415804935060974
driven_any_max	3.6902566655861566
driven_any_mean	3.1199339744598955
driven_any_median	3.419418874509516
driven_any_min	1.6694894924348076
driven_lanedir_consec_max	2.948195558631825
driven_lanedir_consec_mean	2.400817074981129
driven_lanedir_consec_min	0.875744873385248
driven_lanedir_max	3.170424746784956
driven_lanedir_mean	2.5236350213527956
driven_lanedir_median	2.926415292065797
driven_lanedir_min	0.9321966990147958
in-drivable-lane_max	3.4499999999999975
in-drivable-lane_mean	2.160000000000005
in-drivable-lane_min	0.9500000000000136
per-episodes	details {"udem1-0-0": {"driven_any": 3.6902566655861566, "sim_physics": 0.2959579602877299, "survival_time": 14.950000000000076, "driven_lanedir": 3.157838132598873, "sim_render-ego": 0.08020962238311767, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.21811933914820353, "deviation-heading": 3.831121292519462, "set_robot_commands": 0.14027276992797852, "deviation-center-line": 1.2961775979669246, "driven_lanedir_consec": 2.894634354252406, "sim_compute_sim_state": 0.049777410825093585, "sim_compute_performance-ego": 0.08999715487162273, "sim_compute_robot_state-ego": 0.11034743944803874, "sim_compute_robot_state-npc0": 0.0922820512453715, "sim_compute_robot_state-npc1": 0.0907405916849772, "sim_compute_robot_state-npc2": 0.08952558120091757, "sim_compute_robot_state-npc3": 0.08917390743891399}, "udem1-1-0": {"driven_any": 3.419418874509516, "sim_physics": 0.2673739417394002, "survival_time": 14.950000000000076, "driven_lanedir": 2.926415292065797, "sim_render-ego": 0.07168716589609782, "in-drivable-lane": 1.5000000000000018, "agent_compute-ego": 0.13428436199824015, "deviation-heading": 4.623851797560124, "set_robot_commands": 0.124509113629659, "deviation-center-line": 0.924642188180164, "driven_lanedir_consec": 2.926415292065797, "sim_compute_sim_state": 0.04650932947794596, "sim_compute_performance-ego": 0.07997717857360839, "sim_compute_robot_state-ego": 0.09376842419306436, "sim_compute_robot_state-npc0": 0.08685780207316081, "sim_compute_robot_state-npc1": 0.08518275101979574, "sim_compute_robot_state-npc2": 0.08465395927429199, "sim_compute_robot_state-npc3": 0.08592929363250733}, "udem1-2-0": {"driven_any": 3.268606159461751, "sim_physics": 0.24375551621119185, "survival_time": 14.950000000000076, "driven_lanedir": 2.4313002362995566, "sim_render-ego": 0.06500558853149414, "in-drivable-lane": 3.4499999999999975, "agent_compute-ego": 0.0860955802599589, "deviation-heading": 3.5659669410336807, "set_robot_commands": 0.11262636264165242, "deviation-center-line": 1.0750269113686055, "driven_lanedir_consec": 2.3590952965703686, "sim_compute_sim_state": 0.044104844729105634, "sim_compute_performance-ego": 0.07310290257136028, "sim_compute_robot_state-ego": 0.0788605268796285, "sim_compute_robot_state-npc0": 0.07910483837127685, "sim_compute_robot_state-npc1": 0.08250422080357869, "sim_compute_robot_state-npc2": 0.08026126543680827, "sim_compute_robot_state-npc3": 0.07905077219009399}, "udem1-3-0": {"driven_any": 1.6694894924348076, "sim_physics": 0.22845309039196335, "survival_time": 8.299999999999983, "driven_lanedir": 0.9321966990147958, "sim_render-ego": 0.062130093574523926, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.084898746157267, "deviation-heading": 2.415804935060974, "set_robot_commands": 0.10662843951259753, "deviation-center-line": 0.4412642023290711, "driven_lanedir_consec": 0.875744873385248, "sim_compute_sim_state": 0.04304432150829269, "sim_compute_performance-ego": 0.06898655517991767, "sim_compute_robot_state-ego": 0.07582767900214138, "sim_compute_robot_state-npc0": 0.07690930510141764, "sim_compute_robot_state-npc1": 0.07611721682261272, "sim_compute_robot_state-npc2": 0.07426904770265143, "sim_compute_robot_state-npc3": 0.07520913216004889}, "udem1-4-0": {"driven_any": 3.551898680307246, "sim_physics": 0.2245457355181376, "survival_time": 14.950000000000076, "driven_lanedir": 3.170424746784956, "sim_render-ego": 0.06650614817937216, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.08779063940048218, "deviation-heading": 3.973115743850656, "set_robot_commands": 0.1186728811264038, "deviation-center-line": 1.2313908719386224, "driven_lanedir_consec": 2.948195558631825, "sim_compute_sim_state": 0.044820773601531985, "sim_compute_performance-ego": 0.07430827299753825, "sim_compute_robot_state-ego": 0.08149157524108887, "sim_compute_robot_state-npc0": 0.08018644332885742, "sim_compute_robot_state-npc1": 0.08007022937138876, "sim_compute_robot_state-npc2": 0.08002737840016683, "sim_compute_robot_state-npc3": 0.0802197249730428}}
set_robot_commands_max	0.14027276992797852
set_robot_commands_mean	0.12054191336765828
set_robot_commands_median	0.1186728811264038
set_robot_commands_min	0.10662843951259753
sim_compute_performance-ego_max	0.08999715487162273
sim_compute_performance-ego_mean	0.07727441283880947
sim_compute_performance-ego_median	0.07430827299753825
sim_compute_performance-ego_min	0.06898655517991767
sim_compute_robot_state-ego_max	0.11034743944803874
sim_compute_robot_state-ego_mean	0.08805912895279237
sim_compute_robot_state-ego_median	0.08149157524108887
sim_compute_robot_state-ego_min	0.07582767900214138
sim_compute_robot_state-npc0_max	0.0922820512453715
sim_compute_robot_state-npc0_mean	0.08306808802401686
sim_compute_robot_state-npc0_median	0.08018644332885742
sim_compute_robot_state-npc0_min	0.07690930510141764
sim_compute_robot_state-npc1_max	0.0907405916849772
sim_compute_robot_state-npc1_mean	0.08292300194047061
sim_compute_robot_state-npc1_median	0.08250422080357869
sim_compute_robot_state-npc1_min	0.07611721682261272
sim_compute_robot_state-npc2_max	0.08952558120091757
sim_compute_robot_state-npc2_mean	0.08174744640296722
sim_compute_robot_state-npc2_median	0.08026126543680827
sim_compute_robot_state-npc2_min	0.07426904770265143
sim_compute_robot_state-npc3_max	0.08917390743891399
sim_compute_robot_state-npc3_mean	0.0819165660789214
sim_compute_robot_state-npc3_median	0.0802197249730428
sim_compute_robot_state-npc3_min	0.07520913216004889
sim_compute_sim_state_max	0.049777410825093585
sim_compute_sim_state_mean	0.045651336028393975
sim_compute_sim_state_median	0.044820773601531985
sim_compute_sim_state_min	0.04304432150829269
sim_physics_max	0.2959579602877299
sim_physics_mean	0.2520172488296846
sim_physics_median	0.24375551621119185
sim_physics_min	0.2245457355181376
sim_render-ego_max	0.08020962238311767
sim_render-ego_mean	0.06910772371292115
sim_render-ego_median	0.06650614817937216
sim_render-ego_min	0.062130093574523926
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.620000000000058
survival_time_min	8.299999999999983

No reset possible

22274

2900

Julian Zilly

Baseline-IL-logs-tensorflow

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-16 14:58:58+00:00

2019-05-17 18:38:07+00:00

1 day, 3:39:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.014153126632891588
survival_time_median	14.950000000000076
deviation-center-line_median	0.7898355240733801
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.22012690385182695
agent_compute-ego_mean	0.19721003452936808
agent_compute-ego_median	0.1996445695559184
agent_compute-ego_min	0.1789864699045817
deviation-center-line_max	1.2009756349810214
deviation-center-line_mean	0.8285856056078391
deviation-center-line_min	0.29107787745678954
deviation-heading_max	2.9543062367096833
deviation-heading_mean	2.2741240040463353
deviation-heading_median	2.773779582167287
deviation-heading_min	1.139092276096771
driven_any_max	0.1530701089737989
driven_any_mean	0.05239024471432976
driven_any_median	0.014620597197404267
driven_any_min	6.488430468599491e-10
driven_lanedir_consec_max	0.1482204280117566
driven_lanedir_consec_mean	0.05105148472341077
driven_lanedir_consec_min	9.611373119611245e-08
driven_lanedir_max	0.1482204280117566
driven_lanedir_mean	0.05105148472341077
driven_lanedir_median	0.014153126632891588
driven_lanedir_min	9.611373119611245e-08
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 6.488430468599491e-10, "sim_physics": 0.09905982255935668, "survival_time": 14.950000000000076, "driven_lanedir": 9.611373119611245e-08, "sim_render-ego": 0.05529319047927857, "in-drivable-lane": 0, "agent_compute-ego": 0.1996445695559184, "deviation-heading": 1.139092276096771, "set_robot_commands": 0.07619497934977214, "deviation-center-line": 1.151825929742214, "driven_lanedir_consec": 9.611373119611245e-08, "sim_compute_sim_state": 0.033606650034586585, "sim_compute_performance-ego": 0.06000881830851237, "sim_compute_robot_state-ego": 0.05957587480545043, "sim_compute_robot_state-npc0": 0.06672125736872356, "sim_compute_robot_state-npc1": 0.062466530005137126, "sim_compute_robot_state-npc2": 0.060866579214731854, "sim_compute_robot_state-npc3": 0.0605119252204895}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.00025705682862230855, "sim_physics": 0.10722790241241456, "survival_time": 14.950000000000076, "driven_lanedir": 0.00026604136049934723, "sim_render-ego": 0.05540128548940023, "in-drivable-lane": 0, "agent_compute-ego": 0.22012690385182695, "deviation-heading": 1.6519737747575856, "set_robot_commands": 0.07384052912394205, "deviation-center-line": 1.2009756349810214, "driven_lanedir_consec": 0.00026604136049934723, "sim_compute_sim_state": 0.03457663218180339, "sim_compute_performance-ego": 0.05948817729949951, "sim_compute_robot_state-ego": 0.059676925341288246, "sim_compute_robot_state-npc0": 0.06495744466781617, "sim_compute_robot_state-npc1": 0.06118116776148478, "sim_compute_robot_state-npc2": 0.06030144055684408, "sim_compute_robot_state-npc3": 0.06106625239054362}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09400345992298027, "sim_physics": 0.0957134715716044, "survival_time": 14.950000000000076, "driven_lanedir": 0.0926177314981751, "sim_render-ego": 0.0569412366549174, "in-drivable-lane": 0, "agent_compute-ego": 0.2053216814994812, "deviation-heading": 2.9543062367096833, "set_robot_commands": 0.07416459480921428, "deviation-center-line": 0.7092130617857902, "driven_lanedir_consec": 0.0926177314981751, "sim_compute_sim_state": 0.03462218523025513, "sim_compute_performance-ego": 0.06223118464152018, "sim_compute_robot_state-ego": 0.060729050636291505, "sim_compute_robot_state-npc0": 0.06635567347208658, "sim_compute_robot_state-npc1": 0.06281123638153076, "sim_compute_robot_state-npc2": 0.061650660832722984, "sim_compute_robot_state-npc3": 0.06195184787114461}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.014620597197404267, "sim_physics": 0.10068351030349731, "survival_time": 14.950000000000076, "driven_lanedir": 0.014153126632891588, "sim_render-ego": 0.061393614610036215, "in-drivable-lane": 0, "agent_compute-ego": 0.1789864699045817, "deviation-heading": 2.773779582167287, "set_robot_commands": 0.07620085875193278, "deviation-center-line": 0.7898355240733801, "driven_lanedir_consec": 0.014153126632891588, "sim_compute_sim_state": 0.0366976793607076, "sim_compute_performance-ego": 0.06519332806269328, "sim_compute_robot_state-ego": 0.061956516106923425, "sim_compute_robot_state-npc0": 0.0715393074353536, "sim_compute_robot_state-npc1": 0.06659596840540569, "sim_compute_robot_state-npc2": 0.0657312281926473, "sim_compute_robot_state-npc3": 0.06552310705184937}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1530701089737989, "sim_physics": 0.1095709196726481, "survival_time": 14.950000000000076, "driven_lanedir": 0.1482204280117566, "sim_render-ego": 0.06391940037409465, "in-drivable-lane": 0, "agent_compute-ego": 0.18197054783503216, "deviation-heading": 2.8514681505003487, "set_robot_commands": 0.07631253719329834, "deviation-center-line": 0.29107787745678954, "driven_lanedir_consec": 0.1482204280117566, "sim_compute_sim_state": 0.037587746779123944, "sim_compute_performance-ego": 0.06442023436228435, "sim_compute_robot_state-ego": 0.06352957804997762, "sim_compute_robot_state-npc0": 0.07211492538452148, "sim_compute_robot_state-npc1": 0.06699676672617594, "sim_compute_robot_state-npc2": 0.06702185074488322, "sim_compute_robot_state-npc3": 0.06692738930384318}}
set_robot_commands_max	0.07631253719329834
set_robot_commands_mean	0.07534269984563191
set_robot_commands_median	0.07619497934977214
set_robot_commands_min	0.07384052912394205
sim_compute_performance-ego_max	0.06519332806269328
sim_compute_performance-ego_mean	0.06226834853490194
sim_compute_performance-ego_median	0.06223118464152018
sim_compute_performance-ego_min	0.05948817729949951
sim_compute_robot_state-ego_max	0.06352957804997762
sim_compute_robot_state-ego_mean	0.061093588987986246
sim_compute_robot_state-ego_median	0.060729050636291505
sim_compute_robot_state-ego_min	0.05957587480545043
sim_compute_robot_state-npc0_max	0.07211492538452148
sim_compute_robot_state-npc0_mean	0.06833772166570026
sim_compute_robot_state-npc0_median	0.06672125736872356
sim_compute_robot_state-npc0_min	0.06495744466781617
sim_compute_robot_state-npc1_max	0.06699676672617594
sim_compute_robot_state-npc1_mean	0.06401033385594686
sim_compute_robot_state-npc1_median	0.06281123638153076
sim_compute_robot_state-npc1_min	0.06118116776148478
sim_compute_robot_state-npc2_max	0.06702185074488322
sim_compute_robot_state-npc2_mean	0.06311435190836588
sim_compute_robot_state-npc2_median	0.061650660832722984
sim_compute_robot_state-npc2_min	0.06030144055684408
sim_compute_robot_state-npc3_max	0.06692738930384318
sim_compute_robot_state-npc3_mean	0.06319610436757406
sim_compute_robot_state-npc3_median	0.06195184787114461
sim_compute_robot_state-npc3_min	0.0605119252204895
sim_compute_sim_state_max	0.037587746779123944
sim_compute_sim_state_mean	0.03541817871729533
sim_compute_sim_state_median	0.03462218523025513
sim_compute_sim_state_min	0.033606650034586585
sim_physics_max	0.1095709196726481
sim_physics_mean	0.1024511253039042
sim_physics_median	0.10068351030349731
sim_physics_min	0.0957134715716044
sim_render-ego_max	0.06391940037409465
sim_render-ego_mean	0.05858974552154541
sim_render-ego_median	0.0569412366549174
sim_render-ego_min	0.05529319047927857
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

22241

2903

Julian Zilly

Baseline-IL-logs-tensorflow

aido2-LFV-sim-testing

step1-simulation

success

yes

ip-172-31-25-98-2470

2019-05-16 14:00:30+00:00

2019-05-16 14:58:15+00:00

0:57:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.42268512184741613
survival_time_median	6.0499999999999865
deviation-center-line_median	0.26382620092389064
in-drivable-lane_median	1.649999999999994

other stats

agent_compute-ego_max	0.2952283582379741
agent_compute-ego_mean	0.27860418223860334
agent_compute-ego_median	0.2799435320908461
agent_compute-ego_min	0.2654079856543705
deviation-center-line_max	0.5482731370249143
deviation-center-line_mean	0.27970629944020925
deviation-center-line_min	0.16594201256993027
deviation-heading_max	2.0585788051039957
deviation-heading_mean	0.8733071979721564
deviation-heading_median	0.8728869101979354
deviation-heading_min	0.3832841635997995
driven_any_max	2.2826853671387837
driven_any_mean	0.982895062196348
driven_any_median	0.9986182840357908
driven_any_min	0.3609526399832052
driven_lanedir_consec_max	1.219236377094861
driven_lanedir_consec_mean	0.5955274453741635
driven_lanedir_consec_min	0.32724437951201
driven_lanedir_max	1.219236377094861
driven_lanedir_mean	0.5955274453741635
driven_lanedir_median	0.42268512184741613
driven_lanedir_min	0.32724437951201
in-drivable-lane_max	8.600000000000065
in-drivable-lane_mean	2.0500000000000025
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9986182840357908, "sim_physics": 0.20365397398136864, "survival_time": 6.0499999999999865, "driven_lanedir": 0.6700897498550087, "sim_render-ego": 0.07270081575251808, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.27163728012526334, "deviation-heading": 0.958197991454477, "set_robot_commands": 0.10974685022653628, "deviation-center-line": 0.2291605169804977, "driven_lanedir_consec": 0.6700897498550087, "sim_compute_sim_state": 0.04489953261761626, "sim_compute_performance-ego": 0.07969357356552251, "sim_compute_robot_state-ego": 0.0865848399390859, "sim_compute_robot_state-npc0": 0.0793345900606518, "sim_compute_robot_state-npc1": 0.080011225928945, "sim_compute_robot_state-npc2": 0.0798237658729238, "sim_compute_robot_state-npc3": 0.07868212707771742}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4483038438674713, "sim_physics": 0.23116037352331753, "survival_time": 2.8999999999999977, "driven_lanedir": 0.42268512184741613, "sim_render-ego": 0.07223625429745378, "in-drivable-lane": 0, "agent_compute-ego": 0.2753002068092083, "deviation-heading": 0.9833216678109886, "set_robot_commands": 0.1198066966287021, "deviation-center-line": 0.2083085090808469, "driven_lanedir_consec": 0.42268512184741613, "sim_compute_sim_state": 0.04546296185460584, "sim_compute_performance-ego": 0.08357341536160173, "sim_compute_robot_state-ego": 0.09076808649918128, "sim_compute_robot_state-npc0": 0.08066652972122719, "sim_compute_robot_state-npc1": 0.08108519685679469, "sim_compute_robot_state-npc2": 0.081011019904038, "sim_compute_robot_state-npc3": 0.08159367380471065}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.583873348985929, "sim_physics": 0.2045671394530763, "survival_time": 9.4, "driven_lanedir": 1.2124450237594109, "sim_render-ego": 0.07007352341996863, "in-drivable-lane": 2.000000000000017, "agent_compute-ego": 0.2657179426639638, "deviation-heading": 0.88860498747709, "set_robot_commands": 0.11150278816831873, "deviation-center-line": 0.3284959110452216, "driven_lanedir_consec": 1.2124450237594109, "sim_compute_sim_state": 0.046610674959547974, "sim_compute_performance-ego": 0.08121436707516934, "sim_compute_robot_state-ego": 0.08874131390388976, "sim_compute_robot_state-npc0": 0.07760747696490998, "sim_compute_robot_state-npc1": 0.08154281783611217, "sim_compute_robot_state-npc2": 0.08182022419381649, "sim_compute_robot_state-npc3": 0.07966343519535471}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5751381976553396, "sim_physics": 0.21060333022459304, "survival_time": 9.349999999999998, "driven_lanedir": 1.219236377094861, "sim_render-ego": 0.06947225427882557, "in-drivable-lane": 1.9000000000000163, "agent_compute-ego": 0.2686136393623556, "deviation-heading": 0.8946459419026215, "set_robot_commands": 0.11058741074832364, "deviation-center-line": 0.32187540256872404, "driven_lanedir_consec": 1.219236377094861, "sim_compute_sim_state": 0.04502393727634042, "sim_compute_performance-ego": 0.0790082949368074, "sim_compute_robot_state-ego": 0.08590131264956877, "sim_compute_robot_state-npc0": 0.0777007169264523, "sim_compute_robot_state-npc1": 0.07996283367993359, "sim_compute_robot_state-npc2": 0.07531241299634311, "sim_compute_robot_state-npc3": 0.07810711733160172}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3696877168049223, "sim_physics": 0.21183321913894343, "survival_time": 2.4499999999999993, "driven_lanedir": 0.35646194001664067, "sim_render-ego": 0.06925800381874551, "in-drivable-lane": 0, "agent_compute-ego": 0.275586123369178, "deviation-heading": 0.6557832522317952, "set_robot_commands": 0.104971389381253, "deviation-center-line": 0.1757450176688906, "driven_lanedir_consec": 0.35646194001664067, "sim_compute_sim_state": 0.04584434567665567, "sim_compute_performance-ego": 0.08161554044606734, "sim_compute_robot_state-ego": 0.0857935195066491, "sim_compute_robot_state-npc0": 0.07735414894259705, "sim_compute_robot_state-npc1": 0.08155661213154695, "sim_compute_robot_state-npc2": 0.08164791185028698, "sim_compute_robot_state-npc3": 0.08221401000509457}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0422940346266416, "sim_physics": 0.21547759714580716, "survival_time": 6.299999999999986, "driven_lanedir": 0.39808052540220645, "sim_render-ego": 0.07179069897485157, "in-drivable-lane": 2.94999999999999, "agent_compute-ego": 0.28163842170957537, "deviation-heading": 2.0585788051039957, "set_robot_commands": 0.11231833412533716, "deviation-center-line": 0.333224649165744, "driven_lanedir_consec": 0.39808052540220645, "sim_compute_sim_state": 0.04418645018622989, "sim_compute_performance-ego": 0.08008541190435016, "sim_compute_robot_state-ego": 0.08747892341916523, "sim_compute_robot_state-npc0": 0.07931242670331683, "sim_compute_robot_state-npc1": 0.08075362349313403, "sim_compute_robot_state-npc2": 0.07844318851592048, "sim_compute_robot_state-npc3": 0.07982960390666174}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.998618283896706, "sim_physics": 0.20947030556103416, "survival_time": 6.0499999999999865, "driven_lanedir": 0.6496299160093346, "sim_render-ego": 0.07056572023502067, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.2905049737819955, "deviation-heading": 1.39052277098926, "set_robot_commands": 0.11197092119327262, "deviation-center-line": 0.32466946712990735, "driven_lanedir_consec": 0.6496299160093346, "sim_compute_sim_state": 0.045321001494226375, "sim_compute_performance-ego": 0.08048905419909265, "sim_compute_robot_state-ego": 0.08808279234515734, "sim_compute_robot_state-npc0": 0.07900416752523627, "sim_compute_robot_state-npc1": 0.07990321246060458, "sim_compute_robot_state-npc2": 0.08064222926935874, "sim_compute_robot_state-npc3": 0.080081703249088}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.2826853671387837, "sim_physics": 0.2145667832289169, "survival_time": 13.400000000000055, "driven_lanedir": 0.7674599643858637, "sim_render-ego": 0.07233559284637224, "in-drivable-lane": 8.600000000000065, "agent_compute-ego": 0.2842928411355659, "deviation-heading": 0.8728869101979354, "set_robot_commands": 0.11367912612744233, "deviation-center-line": 0.3738918141114238, "driven_lanedir_consec": 0.7674599643858637, "sim_compute_sim_state": 0.04679369748528324, "sim_compute_performance-ego": 0.08135821748135695, "sim_compute_robot_state-ego": 0.08962280892614108, "sim_compute_robot_state-npc0": 0.07977130341885695, "sim_compute_robot_state-npc1": 0.08032867890685352, "sim_compute_robot_state-npc2": 0.07971543518464956, "sim_compute_robot_state-npc3": 0.08113254717926481}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.024823734546153, "sim_physics": 0.20188916690887945, "survival_time": 6.199999999999986, "driven_lanedir": 0.3833952133784786, "sim_render-ego": 0.07103168772112939, "in-drivable-lane": 3.599999999999987, "agent_compute-ego": 0.2952283582379741, "deviation-heading": 0.6555999650593177, "set_robot_commands": 0.1179240922774038, "deviation-center-line": 0.2438696148108803, "driven_lanedir_consec": 0.3833952133784786, "sim_compute_sim_state": 0.046616140873201435, "sim_compute_performance-ego": 0.08067221987632013, "sim_compute_robot_state-ego": 0.09154637013712236, "sim_compute_robot_state-npc0": 0.07932123830241541, "sim_compute_robot_state-npc1": 0.08047363834996377, "sim_compute_robot_state-npc2": 0.07847167599585748, "sim_compute_robot_state-npc3": 0.07992408737059563}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.4483038427000898, "sim_physics": 0.21069273455389617, "survival_time": 2.8999999999999977, "driven_lanedir": 0.431677868485592, "sim_render-ego": 0.07016110831293566, "in-drivable-lane": 0, "agent_compute-ego": 0.2654079856543705, "deviation-heading": 0.7893522695301236, "set_robot_commands": 0.10777592658996582, "deviation-center-line": 0.1937393447124377, "driven_lanedir_consec": 0.431677868485592, "sim_compute_sim_state": 0.04593525672781056, "sim_compute_performance-ego": 0.08102610604516391, "sim_compute_robot_state-ego": 0.0905951713693553, "sim_compute_robot_state-npc0": 0.07731405208850729, "sim_compute_robot_state-npc1": 0.08034677752133074, "sim_compute_robot_state-npc2": 0.07764708995819092, "sim_compute_robot_state-npc3": 0.07807921952214734}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3609526399832052, "sim_physics": 0.2335863411426544, "survival_time": 2.3999999999999995, "driven_lanedir": 0.34163263053442794, "sim_render-ego": 0.07385123769442241, "in-drivable-lane": 0, "agent_compute-ego": 0.2809873123963674, "deviation-heading": 0.7882650167735434, "set_robot_commands": 0.11798356473445892, "deviation-center-line": 0.16594201256993027, "driven_lanedir_consec": 0.34163263053442794, "sim_compute_sim_state": 0.04418668647607168, "sim_compute_performance-ego": 0.07846870521704356, "sim_compute_robot_state-ego": 0.08433151245117188, "sim_compute_robot_state-npc0": 0.07808920741081238, "sim_compute_robot_state-npc1": 0.08139187097549438, "sim_compute_robot_state-npc2": 0.07849142948786418, "sim_compute_robot_state-npc3": 0.07899543146292369}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.395893032841066, "sim_physics": 0.20427735493733332, "survival_time": 2.5999999999999988, "driven_lanedir": 0.39129427766673874, "sim_render-ego": 0.06880690042789166, "in-drivable-lane": 0, "agent_compute-ego": 0.2731595360315763, "deviation-heading": 0.39449765617613486, "set_robot_commands": 0.10817478711788472, "deviation-center-line": 0.26382620092389064, "driven_lanedir_consec": 0.39129427766673874, "sim_compute_sim_state": 0.04257508424612192, "sim_compute_performance-ego": 0.08131655362936166, "sim_compute_robot_state-ego": 0.0884473598920382, "sim_compute_robot_state-npc0": 0.07896370612657987, "sim_compute_robot_state-npc1": 0.0823587912779588, "sim_compute_robot_state-npc2": 0.08250767451066238, "sim_compute_robot_state-npc3": 0.07944269363696758}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0160885839792275, "sim_physics": 0.1948697508835211, "survival_time": 6.149999999999986, "driven_lanedir": 0.32724437951201, "sim_render-ego": 0.07128306326827383, "in-drivable-lane": 3.899999999999986, "agent_compute-ego": 0.2799435320908461, "deviation-heading": 0.4781414169326147, "set_robot_commands": 0.11159314954183935, "deviation-center-line": 0.26646699462378176, "driven_lanedir_consec": 0.32724437951201, "sim_compute_sim_state": 0.04535350760793298, "sim_compute_performance-ego": 0.0809010974759978, "sim_compute_robot_state-ego": 0.09058043433398737, "sim_compute_robot_state-npc0": 0.08079899423490695, "sim_compute_robot_state-npc1": 0.08001473861012032, "sim_compute_robot_state-npc2": 0.07859344986396108, "sim_compute_robot_state-npc3": 0.08095052377964423}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.9462073813541644, "sim_physics": 0.22090191633804984, "survival_time": 5.749999999999988, "driven_lanedir": 0.9440451317345278, "sim_render-ego": 0.07222063852393108, "in-drivable-lane": 0, "agent_compute-ego": 0.28293111013329547, "deviation-heading": 0.3832841635997995, "set_robot_commands": 0.10983856035315472, "deviation-center-line": 0.5482731370249143, "driven_lanedir_consec": 0.9440451317345278, "sim_compute_sim_state": 0.044697873488716455, "sim_compute_performance-ego": 0.07795570414999257, "sim_compute_robot_state-ego": 0.08914058934087339, "sim_compute_robot_state-npc0": 0.08028882275456968, "sim_compute_robot_state-npc1": 0.08076015969981318, "sim_compute_robot_state-npc2": 0.08034852069357167, "sim_compute_robot_state-npc3": 0.0791076597960099}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.2519376405297284, "sim_physics": 0.23133044242858888, "survival_time": 7.499999999999981, "driven_lanedir": 0.41753356092993377, "sim_render-ego": 0.07093436241149903, "in-drivable-lane": 4.6499999999999835, "agent_compute-ego": 0.28811347007751464, "deviation-heading": 0.9079251543426464, "set_robot_commands": 0.11090541521708172, "deviation-center-line": 0.21810589918604828, "driven_lanedir_consec": 0.41753356092993377, "sim_compute_sim_state": 0.04485701402028402, "sim_compute_performance-ego": 0.07955329577128092, "sim_compute_robot_state-ego": 0.08977976799011231, "sim_compute_robot_state-npc0": 0.07673563639322917, "sim_compute_robot_state-npc1": 0.07893452326456706, "sim_compute_robot_state-npc2": 0.07927311897277832, "sim_compute_robot_state-npc3": 0.0788733418782552}}
set_robot_commands_max	0.1198066966287021
set_robot_commands_mean	0.11191860082873165
set_robot_commands_median	0.11150278816831873
set_robot_commands_min	0.104971389381253
sim_compute_performance-ego_max	0.08357341536160173
sim_compute_performance-ego_mean	0.08046210380900858
sim_compute_performance-ego_median	0.08067221987632013
sim_compute_performance-ego_min	0.07795570414999257
sim_compute_robot_state-ego_max	0.09154637013712236
sim_compute_robot_state-ego_mean	0.08849298684689995
sim_compute_robot_state-ego_median	0.08874131390388976
sim_compute_robot_state-ego_min	0.08433151245117188
sim_compute_robot_state-npc0_max	0.08079899423490695
sim_compute_robot_state-npc0_mean	0.07881753450495128
sim_compute_robot_state-npc0_median	0.07900416752523627
sim_compute_robot_state-npc0_min	0.07673563639322917
sim_compute_robot_state-npc1_max	0.0823587912779588
sim_compute_robot_state-npc1_mean	0.08062831339954485
sim_compute_robot_state-npc1_median	0.08047363834996377
sim_compute_robot_state-npc1_min	0.07893452326456706
sim_compute_robot_state-npc2_max	0.08250767451066238
sim_compute_robot_state-npc2_mean	0.07958327648468154
sim_compute_robot_state-npc2_median	0.07971543518464956
sim_compute_robot_state-npc2_min	0.07531241299634311
sim_compute_robot_state-npc3_max	0.08221401000509457
sim_compute_robot_state-npc3_mean	0.07977847834640248
sim_compute_robot_state-npc3_median	0.07966343519535471
sim_compute_robot_state-npc3_min	0.07807921952214734
sim_compute_sim_state_max	0.04679369748528324
sim_compute_sim_state_mean	0.04522427766604298
sim_compute_sim_state_median	0.045321001494226375
sim_compute_sim_state_min	0.04257508424612192
sim_physics_max	0.2335863411426544
sim_physics_mean	0.21325869529666533
sim_physics_median	0.21069273455389617
sim_physics_min	0.1948697508835211
sim_render-ego_max	0.07385123769442241
sim_render-ego_mean	0.07111479079892262
sim_render-ego_median	0.07103168772112939
sim_render-ego_min	0.06880690042789166
simulation-passed	1
survival_time_max	13.400000000000055
survival_time_mean	5.959999999999996
survival_time_min	2.3999999999999995

No reset possible

22239

2904

Julian Zilly

Baseline-IL-logs-tensorflow

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-16 13:59:03+00:00

2019-05-16 14:00:15+00:00

0:01:12

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22232

3492

Julian Zilly

Baseline-IL-logs-tensorflow

aido2-LF-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2470

2019-05-16 13:49:29+00:00

2019-05-16 13:51:46+00:00

0:02:17

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible