Evaluator 1213

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

23079

3556

Amaury Camus 🇨🇭

Running the real lane following -- without challenge container

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-17 09:54:01+00:00

2019-05-17 10:00:09+00:00

0:06:08

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23033

2363

Andrea Censi 🇨🇭

random_agent

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-8195

2019-05-17 05:38:21+00:00

2019-05-17 05:44:17+00:00

0:05:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.15006619341233196
agent_compute-ego_mean	0.14343341082011188
agent_compute-ego_median	0.1450942778119854
agent_compute-ego_min	0.13367055892944335
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11903659944181089, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06955913702646892, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14839313648365163, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10206421216328938, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04027606381310357, "sim_compute_performance-ego": 0.07560572800812898, "sim_compute_robot_state-ego": 0.08021349818618209}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12309939253563974, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06459709242278454, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1450942778119854, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10183055728089575, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0390624859753777, "sim_compute_performance-ego": 0.07442263995899874, "sim_compute_robot_state-ego": 0.08414821531258378}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13938103002660415, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07061178543988396, "in-drivable-lane": 0, "agent_compute-ego": 0.15006619341233196, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10892089675454532, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04283452033996582, "sim_compute_performance-ego": 0.07742735918830423, "sim_compute_robot_state-ego": 0.09894107369815602}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.12547676086425782, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.05916295051574707, "in-drivable-lane": 0, "agent_compute-ego": 0.13367055892944335, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09414573669433594, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.038179454803466795, "sim_compute_performance-ego": 0.0642255687713623, "sim_compute_robot_state-ego": 0.06817862510681152}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11373938789850548, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06255127206633362, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13994288746314712, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10125677495063104, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03916616681255872, "sim_compute_performance-ego": 0.06759551808803896, "sim_compute_robot_state-ego": 0.0725643031204803}}
set_robot_commands_max	0.10892089675454532
set_robot_commands_mean	0.1016436355687395
set_robot_commands_median	0.10183055728089575
set_robot_commands_min	0.09414573669433594
sim_compute_performance-ego_max	0.07742735918830423
sim_compute_performance-ego_mean	0.07185536280296664
sim_compute_performance-ego_median	0.07442263995899874
sim_compute_performance-ego_min	0.0642255687713623
sim_compute_robot_state-ego_max	0.09894107369815602
sim_compute_robot_state-ego_mean	0.08080914308484274
sim_compute_robot_state-ego_median	0.08021349818618209
sim_compute_robot_state-ego_min	0.06817862510681152
sim_compute_sim_state_max	0.04283452033996582
sim_compute_sim_state_mean	0.03990373834889452
sim_compute_sim_state_median	0.03916616681255872
sim_compute_sim_state_min	0.038179454803466795
sim_physics_max	0.13938103002660415
sim_physics_mean	0.12414663415336362
sim_physics_median	0.12309939253563974
sim_physics_min	0.11373938789850548
sim_render-ego_max	0.07061178543988396
sim_render-ego_mean	0.06529644749424361
sim_render-ego_median	0.06459709242278454
sim_render-ego_min	0.05916295051574707
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

23026

2370

Liam Paull 🇨🇦

minimal_agent (Python 3)

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-8195

2019-05-17 05:25:29+00:00

2019-05-17 05:37:54+00:00

0:12:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6257610897668884
survival_time_median	6.949999999999983
deviation-center-line_median	0.36802347786147127
in-drivable-lane_median	0.34999999999999876

other stats

agent_compute-ego_max	0.1676728538104466
agent_compute-ego_mean	0.1591684149664418
agent_compute-ego_median	0.15787039900855196
agent_compute-ego_min	0.15448516607284546
deviation-center-line_max	0.49658151961950325
deviation-center-line_mean	0.37927296243083847
deviation-center-line_min	0.23430699853227116
deviation-heading_max	1.7338651399303977
deviation-heading_mean	0.9312492766179612
deviation-heading_median	0.801279189692507
deviation-heading_min	0.5056416838713088
driven_any_max	1.5927758413436612
driven_any_mean	0.9016551802808824
driven_any_median	0.9900915586687412
driven_any_min	0.278862430643389
driven_lanedir_consec_max	0.8945129127998346
driven_lanedir_consec_mean	0.6133119330362337
driven_lanedir_consec_min	0.2720172605900939
driven_lanedir_max	0.8945129127998346
driven_lanedir_mean	0.6133119330362337
driven_lanedir_median	0.6257610897668884
driven_lanedir_min	0.2720172605900939
in-drivable-lane_max	6.400000000000029
in-drivable-lane_mean	1.7500000000000042
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.10707411491613594, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.06440702788263773, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15787039900855196, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.0962685595313422, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.039828446271608205, "sim_compute_performance-ego": 0.07125317107001655, "sim_compute_robot_state-ego": 0.0744371071136255}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0058141307648691, "sim_physics": 0.12706812279564994, "survival_time": 6.999999999999983, "driven_lanedir": 0.8945129127998346, "sim_render-ego": 0.06894632748195104, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.1676728538104466, "deviation-heading": 1.7338651399303977, "set_robot_commands": 0.10565553222383772, "deviation-center-line": 0.49658151961950325, "driven_lanedir_consec": 0.8945129127998346, "sim_compute_sim_state": 0.041544829096112935, "sim_compute_performance-ego": 0.07672397749764578, "sim_compute_robot_state-ego": 0.08976400068828037}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.278862430643389, "sim_physics": 0.13615507549709743, "survival_time": 2.25, "driven_lanedir": 0.2720172605900939, "sim_render-ego": 0.06578494707743326, "in-drivable-lane": 0, "agent_compute-ego": 0.1595464865366618, "deviation-heading": 0.5056416838713088, "set_robot_commands": 0.10313701099819608, "deviation-center-line": 0.23430699853227116, "driven_lanedir_consec": 0.2720172605900939, "sim_compute_sim_state": 0.04015471670362685, "sim_compute_performance-ego": 0.07306964662339953, "sim_compute_robot_state-ego": 0.08784819708930122}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6407319399837514, "sim_physics": 0.11520176089328268, "survival_time": 4.599999999999992, "driven_lanedir": 0.6257610897668884, "sim_render-ego": 0.06599845834400343, "in-drivable-lane": 0, "agent_compute-ego": 0.15448516607284546, "deviation-heading": 0.9772760265854514, "set_robot_commands": 0.09875434118768445, "deviation-center-line": 0.36802347786147127, "driven_lanedir_consec": 0.6257610897668884, "sim_compute_sim_state": 0.03955485509789508, "sim_compute_performance-ego": 0.07276587382606838, "sim_compute_robot_state-ego": 0.0767678307450336}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5927758413436612, "sim_physics": 0.1265901800704329, "survival_time": 10.95000000000002, "driven_lanedir": 0.6151282935769209, "sim_render-ego": 0.06355365552858674, "in-drivable-lane": 6.400000000000029, "agent_compute-ego": 0.15626716940370325, "deviation-heading": 0.638184343010141, "set_robot_commands": 0.10186769755463622, "deviation-center-line": 0.4584544318695165, "driven_lanedir_consec": 0.6151282935769209, "sim_compute_sim_state": 0.04033115029879357, "sim_compute_performance-ego": 0.07290311491108376, "sim_compute_robot_state-ego": 0.08102462498564698}}
set_robot_commands_max	0.10565553222383772
set_robot_commands_mean	0.10113662829913934
set_robot_commands_median	0.10186769755463622
set_robot_commands_min	0.0962685595313422
sim_compute_performance-ego_max	0.07672397749764578
sim_compute_performance-ego_mean	0.0733431567856428
sim_compute_performance-ego_median	0.07290311491108376
sim_compute_performance-ego_min	0.07125317107001655
sim_compute_robot_state-ego_max	0.08976400068828037
sim_compute_robot_state-ego_mean	0.08196835212437754
sim_compute_robot_state-ego_median	0.08102462498564698
sim_compute_robot_state-ego_min	0.0744371071136255
sim_compute_sim_state_max	0.041544829096112935
sim_compute_sim_state_mean	0.04028279949360732
sim_compute_sim_state_median	0.04015471670362685
sim_compute_sim_state_min	0.03955485509789508
sim_physics_max	0.13615507549709743
sim_physics_mean	0.12241785083451975
sim_physics_median	0.1265901800704329
sim_physics_min	0.10707411491613594
sim_render-ego_max	0.06894632748195104
sim_render-ego_mean	0.06573808326292244
sim_render-ego_median	0.06578494707743326
sim_render-ego_min	0.06355365552858674
simulation-passed	1
survival_time_max	10.95000000000002
survival_time_mean	6.349999999999996
survival_time_min	2.25

No reset possible

23012

2387

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

aido2-LFVI-sim-testing

step1-simulation

success

yes

ip-172-31-38-104-8195

2019-05-17 05:08:20+00:00

2019-05-17 05:25:04+00:00

0:16:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.14523351468985934
survival_time_median	1.4000000000000006
deviation-center-line_median	0.08497713018479955
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.18725702592304777
agent_compute-ego_mean	0.17567452989060445
agent_compute-ego_median	0.180315993048928
agent_compute-ego_min	0.14577611287434897
deviation-center-line_max	0.126934975442118
deviation-center-line_mean	0.08525081949317097
deviation-center-line_min	0.04858696627920683
deviation-heading_max	1.033819055483286
deviation-heading_mean	0.6765089999820442
deviation-heading_median	0.7312061793015299
deviation-heading_min	0.3939765693483576
driven_any_max	0.3526677570839242
driven_any_mean	0.2128572173226389
driven_any_median	0.20436390945672597
driven_any_min	0.1477013427501714
driven_lanedir_consec_max	0.29929259841296796
driven_lanedir_consec_mean	0.15770514620743484
driven_lanedir_consec_min	0.08407039710299014
driven_lanedir_max	0.29929259841296796
driven_lanedir_mean	0.15770514620743484
driven_lanedir_median	0.14523351468985934
driven_lanedir_min	0.08407039710299014
in-drivable-lane_max	0.20000000000000015
in-drivable-lane_mean	0.02666666666666669
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.22323844186245775, "sim_physics": 0.19766045411427816, "survival_time": 1.5000000000000009, "driven_lanedir": 0.14019536993983284, "sim_render-ego": 0.06592878500620523, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1835347334543864, "deviation-heading": 0.8357187579461436, "set_robot_commands": 0.10422461827596027, "deviation-center-line": 0.08550713097523943, "driven_lanedir_consec": 0.14019536993983284, "sim_compute_sim_state": 0.041216190656026205, "sim_compute_performance-ego": 0.06867361863454183, "sim_compute_robot_state-ego": 0.07402807871500651, "sim_compute_robot_state-npc0": 0.07172816594441732, "sim_compute_robot_state-npc1": 0.06997857093811036, "sim_compute_robot_state-npc2": 0.07103020350138346, "sim_compute_robot_state-npc3": 0.07106603781382242}, "udem1-1-0": {"driven_any": 0.18012995616110353, "sim_physics": 0.23936511039733888, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08407039710299014, "sim_render-ego": 0.07072819709777832, "in-drivable-lane": 0, "agent_compute-ego": 0.1769804859161377, "deviation-heading": 1.033819055483286, "set_robot_commands": 0.10455557823181152, "deviation-center-line": 0.08162634830061137, "driven_lanedir_consec": 0.08407039710299014, "sim_compute_sim_state": 0.03940306663513184, "sim_compute_performance-ego": 0.07518525123596191, "sim_compute_robot_state-ego": 0.07947986602783202, "sim_compute_robot_state-npc0": 0.0730130672454834, "sim_compute_robot_state-npc1": 0.07171165466308593, "sim_compute_robot_state-npc2": 0.07157830238342285, "sim_compute_robot_state-npc3": 0.07082037925720215}, "udem1-2-0": {"driven_any": 0.250471755422026, "sim_physics": 0.27827554089682444, "survival_time": 1.4000000000000006, "driven_lanedir": 0.2281620942726299, "sim_render-ego": 0.06667562893458776, "in-drivable-lane": 0, "agent_compute-ego": 0.18725702592304777, "deviation-heading": 0.3939765693483576, "set_robot_commands": 0.10474030460630145, "deviation-center-line": 0.126934975442118, "driven_lanedir_consec": 0.2281620942726299, "sim_compute_sim_state": 0.043453412396567206, "sim_compute_performance-ego": 0.07771669115339007, "sim_compute_robot_state-ego": 0.08003389835357666, "sim_compute_robot_state-npc0": 0.07430659021650042, "sim_compute_robot_state-npc1": 0.07002839020320348, "sim_compute_robot_state-npc2": 0.07195189169475011, "sim_compute_robot_state-npc3": 0.07111591952187675}, "udem1-3-0": {"driven_any": 0.25261300258240266, "sim_physics": 0.20352717103629275, "survival_time": 1.4500000000000006, "driven_lanedir": 0.22515444372813945, "sim_render-ego": 0.06048565075315278, "in-drivable-lane": 0, "agent_compute-ego": 0.17132508343663708, "deviation-heading": 0.4268127941473753, "set_robot_commands": 0.09689487259963464, "deviation-center-line": 0.11739770828591332, "driven_lanedir_consec": 0.22515444372813945, "sim_compute_sim_state": 0.0390486635010818, "sim_compute_performance-ego": 0.0674538201299207, "sim_compute_robot_state-ego": 0.06924776373238399, "sim_compute_robot_state-npc0": 0.06668769080063393, "sim_compute_robot_state-npc1": 0.07080064970871498, "sim_compute_robot_state-npc2": 0.06878680196301691, "sim_compute_robot_state-npc3": 0.074057019990066}, "udem1-4-0": {"driven_any": 0.1477013427501714, "sim_physics": 0.1939692043122791, "survival_time": 1.0500000000000005, "driven_lanedir": 0.09754920975519132, "sim_render-ego": 0.0567583924248105, "in-drivable-lane": 0, "agent_compute-ego": 0.14999411219642275, "deviation-heading": 0.652922639023533, "set_robot_commands": 0.09229127566019694, "deviation-center-line": 0.04858696627920683, "driven_lanedir_consec": 0.09754920975519132, "sim_compute_sim_state": 0.03588951201665969, "sim_compute_performance-ego": 0.06631424313499815, "sim_compute_robot_state-ego": 0.07062849544343494, "sim_compute_robot_state-npc0": 0.0710958753313337, "sim_compute_robot_state-npc1": 0.0685850325084868, "sim_compute_robot_state-npc2": 0.06773336728413899, "sim_compute_robot_state-npc3": 0.06418541499546596}, "udem1-5-0": {"driven_any": 0.24615540760076915, "sim_physics": 0.20518101964678084, "survival_time": 1.7500000000000009, "driven_lanedir": 0.1507164284825966, "sim_render-ego": 0.0607144832611084, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.1775348254612514, "deviation-heading": 0.8964526573143058, "set_robot_commands": 0.10329758780343191, "deviation-center-line": 0.07681729198409296, "driven_lanedir_consec": 0.1507164284825966, "sim_compute_sim_state": 0.04161548614501953, "sim_compute_performance-ego": 0.0646083150591169, "sim_compute_robot_state-ego": 0.07477055277143206, "sim_compute_robot_state-npc0": 0.07292981147766113, "sim_compute_robot_state-npc1": 0.07240567888532366, "sim_compute_robot_state-npc2": 0.06957259859357562, "sim_compute_robot_state-npc3": 0.07308523314339774}, "udem1-6-0": {"driven_any": 0.15333606025511992, "sim_physics": 0.23998095772483133, "survival_time": 1.1000000000000003, "driven_lanedir": 0.11929183405305156, "sim_render-ego": 0.06640114567496559, "in-drivable-lane": 0, "agent_compute-ego": 0.180315993048928, "deviation-heading": 0.4912747985844088, "set_robot_commands": 0.10748335448178378, "deviation-center-line": 0.08069394423003465, "driven_lanedir_consec": 0.11929183405305156, "sim_compute_sim_state": 0.039895187724720345, "sim_compute_performance-ego": 0.0735530203038996, "sim_compute_robot_state-ego": 0.07648320631547408, "sim_compute_robot_state-npc0": 0.07308147170326927, "sim_compute_robot_state-npc1": 0.07896590232849121, "sim_compute_robot_state-npc2": 0.07044253566048363, "sim_compute_robot_state-npc3": 0.06907225738872182}, "udem1-7-0": {"driven_any": 0.3526677570839242, "sim_physics": 0.2249833784605327, "survival_time": 1.900000000000001, "driven_lanedir": 0.29929259841296796, "sim_render-ego": 0.08263530229267321, "in-drivable-lane": 0, "agent_compute-ego": 0.18696998295031095, "deviation-heading": 0.7444837771663263, "set_robot_commands": 0.1000728732661197, "deviation-center-line": 0.08497713018479955, "driven_lanedir_consec": 0.29929259841296796, "sim_compute_sim_state": 0.03726961738184879, "sim_compute_performance-ego": 0.07718517905787418, "sim_compute_robot_state-ego": 0.07641659912310149, "sim_compute_robot_state-npc0": 0.07437463183152049, "sim_compute_robot_state-npc1": 0.07248008251190186, "sim_compute_robot_state-npc2": 0.06906144869954962, "sim_compute_robot_state-npc3": 0.06865576066468891}, "udem1-8-0": {"driven_any": 0.2372517209062659, "sim_physics": 0.1988253116607666, "survival_time": 1.5000000000000009, "driven_lanedir": 0.18298050574022895, "sim_render-ego": 0.05840079784393311, "in-drivable-lane": 0, "agent_compute-ego": 0.1712867816289266, "deviation-heading": 0.7312061793015299, "set_robot_commands": 0.09620696703592936, "deviation-center-line": 0.06781389732873722, "driven_lanedir_consec": 0.18298050574022895, "sim_compute_sim_state": 0.0375299612681071, "sim_compute_performance-ego": 0.06407826741536458, "sim_compute_robot_state-ego": 0.06659525235493978, "sim_compute_robot_state-npc0": 0.06913192272186279, "sim_compute_robot_state-npc1": 0.06530350844065348, "sim_compute_robot_state-npc2": 0.06991778214772543, "sim_compute_robot_state-npc3": 0.06722100575764973}, "udem1-9-0": {"driven_any": 0.17415719061358204, "sim_physics": 0.20092302560806272, "survival_time": 1.2000000000000004, "driven_lanedir": 0.11310527977275942, "sim_render-ego": 0.054279992977778115, "in-drivable-lane": 0, "agent_compute-ego": 0.14577611287434897, "deviation-heading": 0.7855761619095886, "set_robot_commands": 0.09289162357648212, "deviation-center-line": 0.060580475542081624, "driven_lanedir_consec": 0.11310527977275942, "sim_compute_sim_state": 0.03403161962827047, "sim_compute_performance-ego": 0.057645956675211586, "sim_compute_robot_state-ego": 0.06122162938117981, "sim_compute_robot_state-npc0": 0.05876157681147257, "sim_compute_robot_state-npc1": 0.06015729904174805, "sim_compute_robot_state-npc2": 0.062277386585871376, "sim_compute_robot_state-npc3": 0.06622812151908875}, "udem1-10-0": {"driven_any": 0.1775376408210182, "sim_physics": 0.2206935187180837, "survival_time": 1.2000000000000004, "driven_lanedir": 0.12381222931095914, "sim_render-ego": 0.06753432750701904, "in-drivable-lane": 0, "agent_compute-ego": 0.18400327364603675, "deviation-heading": 0.7708886854166557, "set_robot_commands": 0.10112765431404114, "deviation-center-line": 0.062021067259149576, "driven_lanedir_consec": 0.12381222931095914, "sim_compute_sim_state": 0.03997581203778585, "sim_compute_performance-ego": 0.06960904598236084, "sim_compute_robot_state-ego": 0.07437817255655925, "sim_compute_robot_state-npc0": 0.07178406914075215, "sim_compute_robot_state-npc1": 0.07006735603014629, "sim_compute_robot_state-npc2": 0.0692408283551534, "sim_compute_robot_state-npc3": 0.07510911424954732}, "udem1-11-0": {"driven_any": 0.1794310167596238, "sim_physics": 0.2290826141834259, "survival_time": 1.2000000000000004, "driven_lanedir": 0.14568196093737473, "sim_render-ego": 0.06957744558652242, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18094202876091003, "deviation-heading": 0.4482060771664075, "set_robot_commands": 0.10366002718607584, "deviation-center-line": 0.10656259478632273, "driven_lanedir_consec": 0.14568196093737473, "sim_compute_sim_state": 0.0417493482430776, "sim_compute_performance-ego": 0.07357832789421082, "sim_compute_robot_state-ego": 0.07852040727933247, "sim_compute_robot_state-npc0": 0.0737403432528178, "sim_compute_robot_state-npc1": 0.07384456197420756, "sim_compute_robot_state-npc2": 0.07205276687939961, "sim_compute_robot_state-npc3": 0.07278125484784444}, "udem1-12-0": {"driven_any": 0.22965941428413308, "sim_physics": 0.2604655186335246, "survival_time": 1.5000000000000009, "driven_lanedir": 0.14238482842007372, "sim_render-ego": 0.064309557278951, "in-drivable-lane": 0, "agent_compute-ego": 0.1840127070744832, "deviation-heading": 0.9103947187317212, "set_robot_commands": 0.1070529063542684, "deviation-center-line": 0.09694679977669649, "driven_lanedir_consec": 0.14238482842007372, "sim_compute_sim_state": 0.04143364429473877, "sim_compute_performance-ego": 0.0719437837600708, "sim_compute_robot_state-ego": 0.08220643202463786, "sim_compute_robot_state-npc0": 0.07656638622283936, "sim_compute_robot_state-npc1": 0.07322540283203124, "sim_compute_robot_state-npc2": 0.07516391277313232, "sim_compute_robot_state-npc3": 0.07450987497965494}, "udem1-13-0": {"driven_any": 0.18414364328026048, "sim_physics": 0.23552048206329343, "survival_time": 1.2000000000000004, "driven_lanedir": 0.14523351468985934, "sim_render-ego": 0.0629586676756541, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18709927797317505, "deviation-heading": 0.427058333848968, "set_robot_commands": 0.10191234946250916, "deviation-center-line": 0.09424601893995624, "driven_lanedir_consec": 0.14523351468985934, "sim_compute_sim_state": 0.04154495398203532, "sim_compute_performance-ego": 0.06965481241544087, "sim_compute_robot_state-ego": 0.08094162742296855, "sim_compute_robot_state-npc0": 0.0719952682654063, "sim_compute_robot_state-npc1": 0.06954748431841533, "sim_compute_robot_state-npc2": 0.07010817527770996, "sim_compute_robot_state-npc3": 0.0769634743531545}, "udem1-14-0": {"driven_any": 0.20436390945672597, "sim_physics": 0.21701391254152572, "survival_time": 1.4000000000000006, "driven_lanedir": 0.16794649849286758, "sim_render-ego": 0.06366738251277379, "in-drivable-lane": 0, "agent_compute-ego": 0.16808552401406424, "deviation-heading": 0.5988437943420544, "set_robot_commands": 0.09359755686351232, "deviation-center-line": 0.0880499430826044, "driven_lanedir_consec": 0.16794649849286758, "sim_compute_sim_state": 0.04059592315128872, "sim_compute_performance-ego": 0.0699651667049953, "sim_compute_robot_state-ego": 0.07955270154135567, "sim_compute_robot_state-npc0": 0.07301721402576991, "sim_compute_robot_state-npc1": 0.07220934970038277, "sim_compute_robot_state-npc2": 0.07139637640544347, "sim_compute_robot_state-npc3": 0.07405575684138707}}
set_robot_commands_max	0.10748335448178378
set_robot_commands_mean	0.10066730331453724
set_robot_commands_median	0.10191234946250916
set_robot_commands_min	0.09229127566019694
sim_compute_performance-ego_max	0.07771669115339007
sim_compute_performance-ego_mean	0.06981103330382386
sim_compute_performance-ego_median	0.06965481241544087
sim_compute_performance-ego_min	0.057645956675211586
sim_compute_robot_state-ego_max	0.08220643202463786
sim_compute_robot_state-ego_mean	0.07496697886954769
sim_compute_robot_state-ego_median	0.07641659912310149
sim_compute_robot_state-ego_min	0.06122162938117981
sim_compute_robot_state-npc0_max	0.07656638622283936
sim_compute_robot_state-npc0_mean	0.07148093899944936
sim_compute_robot_state-npc0_median	0.07292981147766113
sim_compute_robot_state-npc0_min	0.05876157681147257
sim_compute_robot_state-npc1_max	0.07896590232849121
sim_compute_robot_state-npc1_mean	0.07062072827232686
sim_compute_robot_state-npc1_median	0.07080064970871498
sim_compute_robot_state-npc1_min	0.06015729904174805
sim_compute_robot_state-npc2_max	0.07516391277313232
sim_compute_robot_state-npc2_mean	0.07002095854698379
sim_compute_robot_state-npc2_median	0.07010817527770996
sim_compute_robot_state-npc2_min	0.062277386585871376
sim_compute_robot_state-npc3_max	0.0769634743531545
sim_compute_robot_state-npc3_mean	0.07126177502157123
sim_compute_robot_state-npc3_median	0.07111591952187675
sim_compute_robot_state-npc3_min	0.06418541499546596
sim_compute_sim_state_max	0.043453412396567206
sim_compute_sim_state_mean	0.03964349327082394
sim_compute_sim_state_median	0.03997581203778585
sim_compute_sim_state_min	0.03403161962827047
sim_physics_max	0.27827554089682444
sim_physics_mean	0.22303114799985607
sim_physics_median	0.2206935187180837
sim_physics_min	0.1939692043122791
sim_render-ego_max	0.08263530229267321
sim_render-ego_mean	0.06473705045519423
sim_render-ego_median	0.064309557278951
sim_render-ego_min	0.054279992977778115
simulation-passed	1
survival_time_max	1.900000000000001
survival_time_mean	1.373333333333334
survival_time_min	1.0500000000000005

No reset possible

23003

2405

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

aido2-LFV-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-8195

2019-05-17 05:00:51+00:00

2019-05-17 05:07:38+00:00

0:06:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08295465149570713
survival_time_median	1.4500000000000006
deviation-center-line_median	0.06277375403301895
in-drivable-lane_median	0.5000000000000003

other stats

agent_compute-ego_max	0.18837308883666992
agent_compute-ego_mean	0.17988281487432886
agent_compute-ego_median	0.181734385697738
agent_compute-ego_min	0.17015775044759116
deviation-center-line_max	0.09957682327513508
deviation-center-line_mean	0.06729691584535673
deviation-center-line_min	0.020064566684709892
deviation-heading_max	0.8430170856354483
deviation-heading_mean	0.6870205041363253
deviation-heading_median	0.6799047212370172
deviation-heading_min	0.561400307555411
driven_any_max	0.231151974590952
driven_any_mean	0.15894769941283104
driven_any_median	0.14037503640177698
driven_any_min	0.11683748518145104
driven_lanedir_consec_max	0.09486485261273714
driven_lanedir_consec_mean	0.0679606664755437
driven_lanedir_consec_min	0.030791954448936565
driven_lanedir_max	0.09486485261273714
driven_lanedir_mean	0.0679606664755437
driven_lanedir_median	0.08295465149570713
driven_lanedir_min	0.030791954448936565
in-drivable-lane_max	0.6000000000000005
in-drivable-lane_mean	0.3400000000000003
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.231151974590952, "sim_physics": 0.20455938416558345, "survival_time": 1.850000000000001, "driven_lanedir": 0.09486485261273714, "sim_render-ego": 0.06650712683394149, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.18837308883666992, "deviation-heading": 0.7470782146486059, "set_robot_commands": 0.10501072213456436, "deviation-center-line": 0.06277375403301895, "driven_lanedir_consec": 0.09486485261273714, "sim_compute_sim_state": 0.04090743451505094, "sim_compute_performance-ego": 0.07509816659463418, "sim_compute_robot_state-ego": 0.07948331575135927, "sim_compute_robot_state-npc0": 0.07606447709573282, "sim_compute_robot_state-npc1": 0.07526832013516813, "sim_compute_robot_state-npc2": 0.07295622052373113, "sim_compute_robot_state-npc3": 0.0724016202462686}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1843597084287652, "sim_physics": 0.16988340291109952, "survival_time": 1.6500000000000008, "driven_lanedir": 0.04595826042970552, "sim_render-ego": 0.06021240263274222, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.1743101351188891, "deviation-heading": 0.8430170856354483, "set_robot_commands": 0.09901488188541296, "deviation-center-line": 0.05690052954563344, "driven_lanedir_consec": 0.04595826042970552, "sim_compute_sim_state": 0.03824317094051477, "sim_compute_performance-ego": 0.06676631985288678, "sim_compute_robot_state-ego": 0.07398787411776456, "sim_compute_robot_state-npc0": 0.07075933254126346, "sim_compute_robot_state-npc1": 0.06757190010764381, "sim_compute_robot_state-npc2": 0.06861153515902432, "sim_compute_robot_state-npc3": 0.06930677818529533}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11683748518145104, "sim_physics": 0.19329424526380456, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08295465149570713, "sim_render-ego": 0.06578412263289742, "in-drivable-lane": 0, "agent_compute-ego": 0.181734385697738, "deviation-heading": 0.561400307555411, "set_robot_commands": 0.09439356430717136, "deviation-center-line": 0.09716890568828628, "driven_lanedir_consec": 0.08295465149570713, "sim_compute_sim_state": 0.04081196370332137, "sim_compute_performance-ego": 0.07067396329796832, "sim_compute_robot_state-ego": 0.07987070083618164, "sim_compute_robot_state-npc0": 0.07041861699975055, "sim_compute_robot_state-npc1": 0.07587117734162704, "sim_compute_robot_state-npc2": 0.07164349763289742, "sim_compute_robot_state-npc3": 0.07420969009399414}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.12201429246121004, "sim_physics": 0.2022804617881775, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08523361339063218, "sim_render-ego": 0.06105198462804159, "in-drivable-lane": 0, "agent_compute-ego": 0.17015775044759116, "deviation-heading": 0.6037021916051436, "set_robot_commands": 0.09960295756657918, "deviation-center-line": 0.09957682327513508, "driven_lanedir_consec": 0.08523361339063218, "sim_compute_sim_state": 0.04031566778818766, "sim_compute_performance-ego": 0.06812494993209839, "sim_compute_robot_state-ego": 0.0763998031616211, "sim_compute_robot_state-npc0": 0.06947017709414165, "sim_compute_robot_state-npc1": 0.06700467069943745, "sim_compute_robot_state-npc2": 0.0703542133172353, "sim_compute_robot_state-npc3": 0.07263609766960144}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14037503640177698, "sim_physics": 0.18296916731472673, "survival_time": 1.4500000000000006, "driven_lanedir": 0.030791954448936565, "sim_render-ego": 0.059226290933017074, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.18483871427075615, "deviation-heading": 0.6799047212370172, "set_robot_commands": 0.10294536064411032, "deviation-center-line": 0.020064566684709892, "driven_lanedir_consec": 0.030791954448936565, "sim_compute_sim_state": 0.040062394635430695, "sim_compute_performance-ego": 0.07047692660627694, "sim_compute_robot_state-ego": 0.07116429559115706, "sim_compute_robot_state-npc0": 0.07218979144918508, "sim_compute_robot_state-npc1": 0.06995942674834153, "sim_compute_robot_state-npc2": 0.07188386752687652, "sim_compute_robot_state-npc3": 0.07320482155372357}}
set_robot_commands_max	0.10501072213456436
set_robot_commands_mean	0.10019349730756764
set_robot_commands_median	0.09960295756657918
set_robot_commands_min	0.09439356430717136
sim_compute_performance-ego_max	0.07509816659463418
sim_compute_performance-ego_mean	0.07022806525677291
sim_compute_performance-ego_median	0.07047692660627694
sim_compute_performance-ego_min	0.06676631985288678
sim_compute_robot_state-ego_max	0.07987070083618164
sim_compute_robot_state-ego_mean	0.07618119789161673
sim_compute_robot_state-ego_median	0.0763998031616211
sim_compute_robot_state-ego_min	0.07116429559115706
sim_compute_robot_state-npc0_max	0.07606447709573282
sim_compute_robot_state-npc0_mean	0.07178047903601471
sim_compute_robot_state-npc0_median	0.07075933254126346
sim_compute_robot_state-npc0_min	0.06947017709414165
sim_compute_robot_state-npc1_max	0.07587117734162704
sim_compute_robot_state-npc1_mean	0.0711350990064436
sim_compute_robot_state-npc1_median	0.06995942674834153
sim_compute_robot_state-npc1_min	0.06700467069943745
sim_compute_robot_state-npc2_max	0.07295622052373113
sim_compute_robot_state-npc2_mean	0.07108986683195294
sim_compute_robot_state-npc2_median	0.07164349763289742
sim_compute_robot_state-npc2_min	0.06861153515902432
sim_compute_robot_state-npc3_max	0.07420969009399414
sim_compute_robot_state-npc3_mean	0.0723518015497766
sim_compute_robot_state-npc3_median	0.07263609766960144
sim_compute_robot_state-npc3_min	0.06930677818529533
sim_compute_sim_state_max	0.04090743451505094
sim_compute_sim_state_mean	0.040068126316501085
sim_compute_sim_state_median	0.04031566778818766
sim_compute_sim_state_min	0.03824317094051477
sim_physics_max	0.20455938416558345
sim_physics_mean	0.1905973322886783
sim_physics_median	0.19329424526380456
sim_physics_min	0.16988340291109952
sim_render-ego_max	0.06650712683394149
sim_render-ego_mean	0.06255638553212794
sim_render-ego_median	0.06105198462804159
sim_render-ego_min	0.059226290933017074
simulation-passed	1
survival_time_max	1.850000000000001
survival_time_mean	1.4600000000000004
survival_time_min	1.1500000000000004

No reset possible

22985

2424

Andrea Censi 🇨🇭

random_agent

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-17 04:37:10+00:00

2019-05-17 05:00:23+00:00

0:23:13

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22983

2428

Andrea Censi 🇨🇭

random_agent

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-17 04:36:11+00:00

2019-05-17 04:36:45+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22981

2429

Andrea Censi 🇨🇭

random_agent

aido2-LF-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-17 04:34:49+00:00

2019-05-17 04:35:22+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22980

2432

Andrea Censi 🇨🇭

random_agent

aido2-LFV-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-17 04:33:52+00:00

2019-05-17 04:34:28+00:00

0:00:36

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22979

2433

Andrea Censi 🇨🇭

random_agent

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-17 04:32:38+00:00

2019-05-17 04:33:11+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22978

2436

Andrea Censi 🇨🇭

random_agent

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-17 04:31:14+00:00

2019-05-17 04:31:47+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22977

2437

Andrea Censi 🇨🇭

random_agent

aido2-LFVI-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-17 04:30:11+00:00

2019-05-17 04:31:07+00:00

0:00:56

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22971

2444

Jacopo Tani

random_agent

aido2-LFVI-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-8195

2019-05-17 04:19:54+00:00

2019-05-17 04:30:03+00:00

0:10:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.17048288243157522
agent_compute-ego_mean	0.15960002402231888
agent_compute-ego_median	0.15708462397257486
agent_compute-ego_min	0.15541604161262512
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.13547481992266058
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314897
deviation-heading_mean	0.49959867397150787
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000694
driven_any_mean	1.1068208197848532
driven_any_median	0.9410513078477724
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.826231945363564
driven_lanedir_consec_mean	0.804744013449103
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.826231945363564
driven_lanedir_mean	0.804828147320482
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.2178357884853701, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06552296952356267, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15821532056301454, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10205837141109418, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.04137729391267028, "sim_compute_performance-ego": 0.07199225848234153, "sim_compute_robot_state-ego": 0.08304874806464473, "sim_compute_robot_state-npc0": 0.0722465213341049, "sim_compute_robot_state-npc1": 0.07363585278957704, "sim_compute_robot_state-npc2": 0.07268159298957148, "sim_compute_robot_state-npc3": 0.07386917705777325}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2562669175011771, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06798212017331805, "in-drivable-lane": 0, "agent_compute-ego": 0.17048288243157522, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10050207376480104, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04157194920948574, "sim_compute_performance-ego": 0.07608881167003087, "sim_compute_robot_state-ego": 0.08950325420924596, "sim_compute_robot_state-npc0": 0.07084948675973075, "sim_compute_robot_state-npc1": 0.07331403664180211, "sim_compute_robot_state-npc2": 0.07479562078203474, "sim_compute_robot_state-npc3": 0.07380859340940203}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.20428892709676505, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.062260051375453915, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.15680125153180466, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10158487662528325, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04344079563918623, "sim_compute_performance-ego": 0.07111561414107535, "sim_compute_robot_state-ego": 0.07650315877303336, "sim_compute_robot_state-npc0": 0.07291740815616349, "sim_compute_robot_state-npc1": 0.07123122631924823, "sim_compute_robot_state-npc2": 0.06960797309875488, "sim_compute_robot_state-npc3": 0.07227968938142351}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.22287070751190183, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06381108860174815, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.15541604161262512, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.09541623791058858, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03916416565577189, "sim_compute_performance-ego": 0.0696339209874471, "sim_compute_robot_state-ego": 0.07935616374015808, "sim_compute_robot_state-npc0": 0.07095393538475037, "sim_compute_robot_state-npc1": 0.07111405332883199, "sim_compute_robot_state-npc2": 0.07226763168970744, "sim_compute_robot_state-npc3": 0.07107387979825337}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.2139339901152111, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06631766046796526, "in-drivable-lane": 0, "agent_compute-ego": 0.15708462397257486, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.10039934657868883, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.04151311374845959, "sim_compute_performance-ego": 0.0750502518245152, "sim_compute_robot_state-ego": 0.07292606717064268, "sim_compute_robot_state-npc0": 0.07088905289059594, "sim_compute_robot_state-npc1": 0.07236727078755696, "sim_compute_robot_state-npc2": 0.06825242723737444, "sim_compute_robot_state-npc3": 0.07494154430571057}}
set_robot_commands_max	0.10205837141109418
set_robot_commands_mean	0.09999218125809116
set_robot_commands_median	0.10050207376480104
set_robot_commands_min	0.09541623791058858
sim_compute_performance-ego_max	0.07608881167003087
sim_compute_performance-ego_mean	0.072776171421082
sim_compute_performance-ego_median	0.07199225848234153
sim_compute_performance-ego_min	0.0696339209874471
sim_compute_robot_state-ego_max	0.08950325420924596
sim_compute_robot_state-ego_mean	0.08026747839154495
sim_compute_robot_state-ego_median	0.07935616374015808
sim_compute_robot_state-ego_min	0.07292606717064268
sim_compute_robot_state-npc0_max	0.07291740815616349
sim_compute_robot_state-npc0_mean	0.07157128090506909
sim_compute_robot_state-npc0_median	0.07095393538475037
sim_compute_robot_state-npc0_min	0.07084948675973075
sim_compute_robot_state-npc1_max	0.07363585278957704
sim_compute_robot_state-npc1_mean	0.07233248797340326
sim_compute_robot_state-npc1_median	0.07236727078755696
sim_compute_robot_state-npc1_min	0.07111405332883199
sim_compute_robot_state-npc2_max	0.07479562078203474
sim_compute_robot_state-npc2_mean	0.0715210491594886
sim_compute_robot_state-npc2_median	0.07226763168970744
sim_compute_robot_state-npc2_min	0.06825242723737444
sim_compute_robot_state-npc3_max	0.07494154430571057
sim_compute_robot_state-npc3_mean	0.07319457679051256
sim_compute_robot_state-npc3_median	0.07380859340940203
sim_compute_robot_state-npc3_min	0.07107387979825337
sim_compute_sim_state_max	0.04344079563918623
sim_compute_sim_state_mean	0.041413463633114746
sim_compute_sim_state_median	0.04151311374845959
sim_compute_sim_state_min	0.03916416565577189
sim_physics_max	0.2562669175011771
sim_physics_mean	0.22303926614208505
sim_physics_median	0.2178357884853701
sim_physics_min	0.20428892709676505
sim_render-ego_max	0.06798212017331805
sim_render-ego_mean	0.06517877802840961
sim_render-ego_median	0.06552296952356267
sim_render-ego_min	0.062260051375453915
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

22946

2491

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

aido2-LF-sim-testing

step1-simulation

success

yes

ip-172-31-38-104-8195

2019-05-17 04:06:57+00:00

2019-05-17 04:19:25+00:00

0:12:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08640361514352035
survival_time_median	1.4000000000000006
deviation-center-line_median	0.06635074501404782
in-drivable-lane_median	0.15000000000000013

other stats

agent_compute-ego_max	0.22860918173918857
agent_compute-ego_mean	0.17869276380287352
agent_compute-ego_median	0.17680590994217815
agent_compute-ego_min	0.14445193914266732
deviation-center-line_max	0.12856130834507953
deviation-center-line_mean	0.07611573274329787
deviation-center-line_min	0.042213934330711606
deviation-heading_max	0.977681533352802
deviation-heading_mean	0.7286214898125742
deviation-heading_median	0.7386285679299449
deviation-heading_min	0.47326769891937337
driven_any_max	0.22281708077894652
driven_any_mean	0.16262558882013897
driven_any_median	0.1576534600377105
driven_any_min	0.10863970855978448
driven_lanedir_consec_max	0.12776546085110496
driven_lanedir_consec_mean	0.08988090896737676
driven_lanedir_consec_min	0.05190753214383692
driven_lanedir_max	0.12776546085110496
driven_lanedir_mean	0.08988090896737676
driven_lanedir_median	0.08640361514352035
driven_lanedir_min	0.05190753214383692
in-drivable-lane_max	0.7000000000000006
in-drivable-lane_mean	0.2033333333333335
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22281708077894652, "sim_physics": 0.1514135180292903, "survival_time": 1.850000000000001, "driven_lanedir": 0.08211766887852612, "sim_render-ego": 0.06887012559014398, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.22860918173918857, "deviation-heading": 0.779610662494816, "set_robot_commands": 0.10759550816303975, "deviation-center-line": 0.06484673401804057, "driven_lanedir_consec": 0.08211766887852612, "sim_compute_sim_state": 0.04359045544186154, "sim_compute_performance-ego": 0.0790024319210568, "sim_compute_robot_state-ego": 0.09320550351529508}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16086647288164516, "sim_physics": 0.11665822613623834, "survival_time": 1.5500000000000007, "driven_lanedir": 0.06933993401712446, "sim_render-ego": 0.06366456708600444, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.20784443424594015, "deviation-heading": 0.842709147987467, "set_robot_commands": 0.10017298883007418, "deviation-center-line": 0.042213934330711606, "driven_lanedir_consec": 0.06933993401712446, "sim_compute_sim_state": 0.04066416525071667, "sim_compute_performance-ego": 0.07308790760655556, "sim_compute_robot_state-ego": 0.08784868640284385}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.10863970855978448, "sim_physics": 0.12013435363769533, "survival_time": 1.0000000000000002, "driven_lanedir": 0.07856244104893584, "sim_render-ego": 0.06089894771575928, "in-drivable-lane": 0, "agent_compute-ego": 0.17454099655151367, "deviation-heading": 0.5652530266471216, "set_robot_commands": 0.10111981630325316, "deviation-center-line": 0.09101992822585762, "driven_lanedir_consec": 0.07856244104893584, "sim_compute_sim_state": 0.036918675899505614, "sim_compute_performance-ego": 0.06530725955963135, "sim_compute_robot_state-ego": 0.0713607907295227}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.193049624774873, "sim_physics": 0.13476999600728354, "survival_time": 1.800000000000001, "driven_lanedir": 0.05190753214383692, "sim_render-ego": 0.06459628211127387, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.1852556268374125, "deviation-heading": 0.8167494077309024, "set_robot_commands": 0.10565404097239176, "deviation-center-line": 0.04362925885151699, "driven_lanedir_consec": 0.05190753214383692, "sim_compute_sim_state": 0.04078662395477295, "sim_compute_performance-ego": 0.0753893189960056, "sim_compute_robot_state-ego": 0.08440066046184963}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.20545694882889756, "sim_physics": 0.1221224746188602, "survival_time": 1.850000000000001, "driven_lanedir": 0.08600319451782834, "sim_render-ego": 0.06417818327207823, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16905033266222155, "deviation-heading": 0.6964917008723044, "set_robot_commands": 0.09420594653567751, "deviation-center-line": 0.04317943630463744, "driven_lanedir_consec": 0.08600319451782834, "sim_compute_sim_state": 0.03850996172105944, "sim_compute_performance-ego": 0.06824160266566921, "sim_compute_robot_state-ego": 0.07178439965119233}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.19259631332732485, "sim_physics": 0.1362181082367897, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07513008837772661, "sim_render-ego": 0.0678052008152008, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.17928334325551987, "deviation-heading": 0.977681533352802, "set_robot_commands": 0.10708226263523102, "deviation-center-line": 0.06635074501404782, "driven_lanedir_consec": 0.07513008837772661, "sim_compute_sim_state": 0.043240584433078766, "sim_compute_performance-ego": 0.07425419241189957, "sim_compute_robot_state-ego": 0.08387758582830429}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.1474537207236626, "sim_physics": 0.13373800686427526, "survival_time": 1.4000000000000006, "driven_lanedir": 0.10839753309475864, "sim_render-ego": 0.06330904790333339, "in-drivable-lane": 0, "agent_compute-ego": 0.18098529747554232, "deviation-heading": 0.7141210836349968, "set_robot_commands": 0.10300959859575544, "deviation-center-line": 0.10685917929923484, "driven_lanedir_consec": 0.10839753309475864, "sim_compute_sim_state": 0.04122894150870187, "sim_compute_performance-ego": 0.07415127754211426, "sim_compute_robot_state-ego": 0.08339237315314156}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.12492140348148636, "sim_physics": 0.1181531385941939, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09415971965681312, "sim_render-ego": 0.0588745962489735, "in-drivable-lane": 0, "agent_compute-ego": 0.15829141573472458, "deviation-heading": 0.6078145278803093, "set_robot_commands": 0.09577210382981734, "deviation-center-line": 0.10141448997413167, "driven_lanedir_consec": 0.09415971965681312, "sim_compute_sim_state": 0.0404229922728105, "sim_compute_performance-ego": 0.06733086976138028, "sim_compute_robot_state-ego": 0.08030073209242387}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.1615566925573285, "sim_physics": 0.12308287620544434, "survival_time": 1.4500000000000006, "driven_lanedir": 0.09188720248676852, "sim_render-ego": 0.0641839915308459, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.17143661400367474, "deviation-heading": 0.765389895661156, "set_robot_commands": 0.1014101423066238, "deviation-center-line": 0.04899914251663055, "driven_lanedir_consec": 0.09188720248676852, "sim_compute_sim_state": 0.03976719132785139, "sim_compute_performance-ego": 0.07449692693249933, "sim_compute_robot_state-ego": 0.08200534458818107}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.13860873325043632, "sim_physics": 0.1448080348968506, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09778190186495994, "sim_render-ego": 0.06452523231506348, "in-drivable-lane": 0, "agent_compute-ego": 0.1811499118804932, "deviation-heading": 0.6688318951212475, "set_robot_commands": 0.09803586006164552, "deviation-center-line": 0.094302433369792, "driven_lanedir_consec": 0.09778190186495994, "sim_compute_sim_state": 0.042474489212036136, "sim_compute_performance-ego": 0.07562697410583497, "sim_compute_robot_state-ego": 0.08923229217529297}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1246472210559533, "sim_physics": 0.119951810836792, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08640361514352035, "sim_render-ego": 0.06104984283447266, "in-drivable-lane": 0, "agent_compute-ego": 0.1697737979888916, "deviation-heading": 0.6202265972788448, "set_robot_commands": 0.092268705368042, "deviation-center-line": 0.1082429596194482, "driven_lanedir_consec": 0.08640361514352035, "sim_compute_sim_state": 0.03809969902038574, "sim_compute_performance-ego": 0.08277992248535156, "sim_compute_robot_state-ego": 0.06783964157104493}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.1576534600377105, "sim_physics": 0.1409362921347985, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11274803341793004, "sim_render-ego": 0.07465854057898888, "in-drivable-lane": 0, "agent_compute-ego": 0.1975252628326416, "deviation-heading": 0.7386285679299449, "set_robot_commands": 0.10459745847261868, "deviation-center-line": 0.08758905900015328, "driven_lanedir_consec": 0.11274803341793004, "sim_compute_sim_state": 0.041622666212228626, "sim_compute_performance-ego": 0.08575224876403809, "sim_compute_robot_state-ego": 0.07851929848010723}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.2083845740731888, "sim_physics": 0.12496521192438462, "survival_time": 1.7000000000000008, "driven_lanedir": 0.11310747004767084, "sim_render-ego": 0.0594565658008351, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.17680590994217815, "deviation-heading": 0.8243591273320593, "set_robot_commands": 0.10116502116708194, "deviation-center-line": 0.06305206124061209, "driven_lanedir_consec": 0.11310747004767084, "sim_compute_sim_state": 0.039574812440311205, "sim_compute_performance-ego": 0.0679480047786937, "sim_compute_robot_state-ego": 0.07698465094846837}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.1405318893490984, "sim_physics": 0.1165849456080684, "survival_time": 1.3500000000000003, "driven_lanedir": 0.07290183896314684, "sim_render-ego": 0.05804232314780906, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1553873927504928, "deviation-heading": 0.8381874743452686, "set_robot_commands": 0.0876066419813368, "deviation-center-line": 0.05147532103957365, "driven_lanedir_consec": 0.07290183896314684, "sim_compute_sim_state": 0.03680224771852846, "sim_compute_performance-ego": 0.06346368789672852, "sim_compute_robot_state-ego": 0.07165818744235569}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.15219998862174788, "sim_physics": 0.09482369056114784, "survival_time": 1.3000000000000005, "driven_lanedir": 0.12776546085110496, "sim_render-ego": 0.05209779739379883, "in-drivable-lane": 0, "agent_compute-ego": 0.14445193914266732, "deviation-heading": 0.47326769891937337, "set_robot_commands": 0.07615157274099496, "deviation-center-line": 0.12856130834507953, "driven_lanedir_consec": 0.12776546085110496, "sim_compute_sim_state": 0.03247185853811411, "sim_compute_performance-ego": 0.05824205508598915, "sim_compute_robot_state-ego": 0.06286184604351337}}
set_robot_commands_max	0.10759550816303975
set_robot_commands_mean	0.0983898445309056
set_robot_commands_median	0.10111981630325316
set_robot_commands_min	0.07615157274099496
sim_compute_performance-ego_max	0.08575224876403809
sim_compute_performance-ego_mean	0.07233831203422987
sim_compute_performance-ego_median	0.07415127754211426
sim_compute_performance-ego_min	0.05824205508598915
sim_compute_robot_state-ego_max	0.09320550351529508
sim_compute_robot_state-ego_mean	0.07901813287223577
sim_compute_robot_state-ego_median	0.08030073209242387
sim_compute_robot_state-ego_min	0.06286184604351337
sim_compute_sim_state_max	0.04359045544186154
sim_compute_sim_state_mean	0.039745024330130864
sim_compute_sim_state_median	0.0404229922728105
sim_compute_sim_state_min	0.03247185853811411
sim_physics_max	0.1514135180292903
sim_physics_mean	0.12655737895280753
sim_physics_median	0.12308287620544434
sim_physics_min	0.09482369056114784
sim_render-ego_max	0.07465854057898888
sim_render-ego_mean	0.0630807496229721
sim_render-ego_median	0.06366456708600444
sim_render-ego_min	0.05209779739379883
simulation-passed	1
survival_time_max	1.850000000000001
survival_time_mean	1.4500000000000006
survival_time_min	1.0000000000000002

No reset possible

22921

2521

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-17 04:04:30+00:00

2019-05-17 04:06:37+00:00

0:02:07

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22912

2540

jiang peng

test for ppo

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-17 04:00:36+00:00

2019-05-17 04:03:39+00:00

0:03:03

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22895

2560

Alexander Karavaev

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-17 03:45:31+00:00

2019-05-17 04:00:26+00:00

0:14:55

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22875

2595

Julian Zilly

baseline-IL-logs-tensorflow

aido2-LFVI-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-8195

2019-05-17 03:29:22+00:00

2019-05-17 03:44:50+00:00

0:15:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2283515026798144
survival_time_median	5.1999999999999895
deviation-center-line_median	0.35626461238242635
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.2618635478227035
agent_compute-ego_mean	0.2456517816457484
agent_compute-ego_median	0.24633452067008385
agent_compute-ego_min	0.22934332101241403
deviation-center-line_max	0.47242986495682426
deviation-center-line_mean	0.3633183644689159
deviation-center-line_min	0.2467717733295576
deviation-heading_max	2.864461931873328
deviation-heading_mean	2.215741670802444
deviation-heading_median	1.985474733710013
deviation-heading_min	1.6967768501888538
driven_any_max	0.31415897865019304
driven_any_mean	0.2576496598328312
driven_any_median	0.2574669129952571
driven_any_min	0.20208859850424543
driven_lanedir_consec_max	0.2569697105660693
driven_lanedir_consec_mean	0.21656036317518756
driven_lanedir_consec_min	0.16356855402594994
driven_lanedir_max	0.2569697105660693
driven_lanedir_mean	0.21656036317518756
driven_lanedir_median	0.2283515026798144
driven_lanedir_min	0.16356855402594994
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.31415897865019304, "sim_physics": 0.1888973629992941, "survival_time": 5.749999999999988, "driven_lanedir": 0.2569697105660693, "sim_render-ego": 0.05919716876486073, "in-drivable-lane": 0, "agent_compute-ego": 0.22934332101241403, "deviation-heading": 2.864461931873328, "set_robot_commands": 0.09836223021797512, "deviation-center-line": 0.35626461238242635, "driven_lanedir_consec": 0.2569697105660693, "sim_compute_sim_state": 0.037279636963554054, "sim_compute_performance-ego": 0.06720904681993567, "sim_compute_robot_state-ego": 0.07339699164680813, "sim_compute_robot_state-npc0": 0.0679067321445631, "sim_compute_robot_state-npc1": 0.06798898862755817, "sim_compute_robot_state-npc2": 0.06661979219187861, "sim_compute_robot_state-npc3": 0.06715574057205864}, "udem1-1-0": {"driven_any": 0.2614172885223014, "sim_physics": 0.20774011767428857, "survival_time": 4.599999999999992, "driven_lanedir": 0.20056610975336, "sim_render-ego": 0.06773415855739427, "in-drivable-lane": 0, "agent_compute-ego": 0.2618635478227035, "deviation-heading": 2.8301948472935288, "set_robot_commands": 0.106083069158637, "deviation-center-line": 0.2995992192347941, "driven_lanedir_consec": 0.20056610975336, "sim_compute_sim_state": 0.04334002733230591, "sim_compute_performance-ego": 0.0719364803770314, "sim_compute_robot_state-ego": 0.0773924796477608, "sim_compute_robot_state-npc0": 0.0735425353050232, "sim_compute_robot_state-npc1": 0.0722191256025563, "sim_compute_robot_state-npc2": 0.07236730534097423, "sim_compute_robot_state-npc3": 0.07318366092184315}, "udem1-2-0": {"driven_any": 0.2574669129952571, "sim_physics": 0.23082758830143857, "survival_time": 5.1999999999999895, "driven_lanedir": 0.23334593885074417, "sim_render-ego": 0.06484328095729534, "in-drivable-lane": 0, "agent_compute-ego": 0.2474434948884524, "deviation-heading": 1.7017999909464965, "set_robot_commands": 0.10455566415419944, "deviation-center-line": 0.47242986495682426, "driven_lanedir_consec": 0.23334593885074417, "sim_compute_sim_state": 0.04275382482088529, "sim_compute_performance-ego": 0.07347406790806697, "sim_compute_robot_state-ego": 0.07841891050338745, "sim_compute_robot_state-npc0": 0.07353762709177457, "sim_compute_robot_state-npc1": 0.07475793361663818, "sim_compute_robot_state-npc2": 0.0719376802444458, "sim_compute_robot_state-npc3": 0.07271917508198665}, "udem1-3-0": {"driven_any": 0.253116520492159, "sim_physics": 0.21347766197644744, "survival_time": 5.1999999999999895, "driven_lanedir": 0.2283515026798144, "sim_render-ego": 0.0656497638959151, "in-drivable-lane": 0, "agent_compute-ego": 0.24633452067008385, "deviation-heading": 1.6967768501888538, "set_robot_commands": 0.10098607265032254, "deviation-center-line": 0.4415263524409771, "driven_lanedir_consec": 0.2283515026798144, "sim_compute_sim_state": 0.039425363907447226, "sim_compute_performance-ego": 0.07168955298570487, "sim_compute_robot_state-ego": 0.07581980870320247, "sim_compute_robot_state-npc0": 0.07343127865057725, "sim_compute_robot_state-npc1": 0.07015924499585079, "sim_compute_robot_state-npc2": 0.07097951953227703, "sim_compute_robot_state-npc3": 0.07067941014583294}, "udem1-4-0": {"driven_any": 0.20208859850424543, "sim_physics": 0.20304822585952115, "survival_time": 3.5499999999999954, "driven_lanedir": 0.16356855402594994, "sim_render-ego": 0.06318643395329865, "in-drivable-lane": 0, "agent_compute-ego": 0.24327402383508817, "deviation-heading": 1.985474733710013, "set_robot_commands": 0.10070670490533531, "deviation-center-line": 0.2467717733295576, "driven_lanedir_consec": 0.16356855402594994, "sim_compute_sim_state": 0.040903383577373664, "sim_compute_performance-ego": 0.07142750981827857, "sim_compute_robot_state-ego": 0.0788443256431902, "sim_compute_robot_state-npc0": 0.07119774146818779, "sim_compute_robot_state-npc1": 0.07221164837689467, "sim_compute_robot_state-npc2": 0.07363401668172487, "sim_compute_robot_state-npc3": 0.07125689613987023}}
set_robot_commands_max	0.106083069158637
set_robot_commands_mean	0.10213874821729388
set_robot_commands_median	0.10098607265032254
set_robot_commands_min	0.09836223021797512
sim_compute_performance-ego_max	0.07347406790806697
sim_compute_performance-ego_mean	0.0711473315818035
sim_compute_performance-ego_median	0.07168955298570487
sim_compute_performance-ego_min	0.06720904681993567
sim_compute_robot_state-ego_max	0.0788443256431902
sim_compute_robot_state-ego_mean	0.07677450322886982
sim_compute_robot_state-ego_median	0.0773924796477608
sim_compute_robot_state-ego_min	0.07339699164680813
sim_compute_robot_state-npc0_max	0.0735425353050232
sim_compute_robot_state-npc0_mean	0.07192318293202518
sim_compute_robot_state-npc0_median	0.07343127865057725
sim_compute_robot_state-npc0_min	0.0679067321445631
sim_compute_robot_state-npc1_max	0.07475793361663818
sim_compute_robot_state-npc1_mean	0.07146738824389962
sim_compute_robot_state-npc1_median	0.07221164837689467
sim_compute_robot_state-npc1_min	0.06798898862755817
sim_compute_robot_state-npc2_max	0.07363401668172487
sim_compute_robot_state-npc2_mean	0.07110766279826011
sim_compute_robot_state-npc2_median	0.0719376802444458
sim_compute_robot_state-npc2_min	0.06661979219187861
sim_compute_robot_state-npc3_max	0.07318366092184315
sim_compute_robot_state-npc3_mean	0.07099897657231832
sim_compute_robot_state-npc3_median	0.07125689613987023
sim_compute_robot_state-npc3_min	0.06715574057205864
sim_compute_sim_state_max	0.04334002733230591
sim_compute_sim_state_mean	0.040740447320313226
sim_compute_sim_state_median	0.040903383577373664
sim_compute_sim_state_min	0.037279636963554054
sim_physics_max	0.23082758830143857
sim_physics_mean	0.20879819136219796
sim_physics_median	0.20774011767428857
sim_physics_min	0.1888973629992941
sim_render-ego_max	0.06773415855739427
sim_render-ego_mean	0.06412216122575282
sim_render-ego_median	0.06484328095729534
sim_render-ego_min	0.05919716876486073
simulation-passed	1
survival_time_max	5.749999999999988
survival_time_mean	4.8599999999999905
survival_time_min	3.5499999999999954

No reset possible

22851

2648

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LFVI-sim-testing

step1-simulation

success

yes

ip-172-31-38-104-8195

2019-05-17 03:00:57+00:00

2019-05-17 03:28:36+00:00

0:27:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2875407694053156
survival_time_median	2.849999999999998
deviation-center-line_median	0.11031194850197353
in-drivable-lane_median	0.9499999999999966

other stats

agent_compute-ego_max	0.08632995771325153
agent_compute-ego_mean	0.07258555104347192
agent_compute-ego_median	0.07364971497479607
agent_compute-ego_min	0.05682149268033212
deviation-center-line_max	0.2701922695523504
deviation-center-line_mean	0.13746050030700233
deviation-center-line_min	0.07113819587235681
deviation-heading_max	1.4854398920276677
deviation-heading_mean	0.7236995121312619
deviation-heading_median	0.6953408166028192
deviation-heading_min	0.3118646573709166
driven_any_max	1.934434121703833
driven_any_mean	0.806757806634148
driven_any_median	0.8072381933001392
driven_any_min	0.20912585880423715
driven_lanedir_consec_max	0.7222251056746308
driven_lanedir_consec_mean	0.3962831867516217
driven_lanedir_consec_min	0.1917983424483971
driven_lanedir_max	0.7287863177121016
driven_lanedir_mean	0.3975640776898326
driven_lanedir_median	0.2875407694053156
driven_lanedir_min	0.1917983424483971
in-drivable-lane_max	4.04999999999999
in-drivable-lane_mean	1.2133333333333305
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.2208167673593544, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.06268394711505935, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.07430597672979515, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.09781136282955308, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.03910027354596609, "sim_compute_performance-ego": 0.07030214459063058, "sim_compute_robot_state-ego": 0.07872608483555806, "sim_compute_robot_state-npc0": 0.07072179863251836, "sim_compute_robot_state-npc1": 0.07518886945333826, "sim_compute_robot_state-npc2": 0.06789047746773226, "sim_compute_robot_state-npc3": 0.06894940066050334}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.19459955780594437, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.06086780406810619, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0828678254727964, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.09315087177135328, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.03666593410350658, "sim_compute_performance-ego": 0.06677443892867477, "sim_compute_robot_state-ego": 0.07142140247203686, "sim_compute_robot_state-npc0": 0.06709367257577402, "sim_compute_robot_state-npc1": 0.06923399148163972, "sim_compute_robot_state-npc2": 0.06727996578922978, "sim_compute_robot_state-npc3": 0.0709986686706543}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.21615739663441977, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06561717314597888, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.07435044875511757, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.10027464230855306, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.04094785910386305, "sim_compute_performance-ego": 0.07206605642269819, "sim_compute_robot_state-ego": 0.07668853111756153, "sim_compute_robot_state-npc0": 0.07139811454675137, "sim_compute_robot_state-npc1": 0.07054560612409543, "sim_compute_robot_state-npc2": 0.06968988516391852, "sim_compute_robot_state-npc3": 0.0709447524486444}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.16530179140860574, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.05005222036127459, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.05682149268033212, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.07452575365702312, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.03095547776473196, "sim_compute_performance-ego": 0.05155316570348907, "sim_compute_robot_state-ego": 0.05490991525482713, "sim_compute_robot_state-npc0": 0.05414606813798871, "sim_compute_robot_state-npc1": 0.052671875870018675, "sim_compute_robot_state-npc2": 0.05361538602594744, "sim_compute_robot_state-npc3": 0.052708458482173454}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.26057151089543884, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.07012398346610692, "in-drivable-lane": 0, "agent_compute-ego": 0.08632995771325153, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.11307873933211617, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.04470136891240659, "sim_compute_performance-ego": 0.08233482941337254, "sim_compute_robot_state-ego": 0.09955243442369544, "sim_compute_robot_state-npc0": 0.07949352264404297, "sim_compute_robot_state-npc1": 0.0775585589201554, "sim_compute_robot_state-npc2": 0.0762957179028055, "sim_compute_robot_state-npc3": 0.07926375969596532}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.21686979602364936, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.06413366981581145, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.07361782064624861, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.10138054688771564, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.04110824360566981, "sim_compute_performance-ego": 0.0718316540998571, "sim_compute_robot_state-ego": 0.07901183062908697, "sim_compute_robot_state-npc0": 0.07137980180628159, "sim_compute_robot_state-npc1": 0.07280653598261815, "sim_compute_robot_state-npc2": 0.07223974255954518, "sim_compute_robot_state-npc3": 0.0718833184709736}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.20806645495550977, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.06182538781847272, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.07366857528686524, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.09940426009041922, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.03839561939239502, "sim_compute_performance-ego": 0.06624725546155658, "sim_compute_robot_state-ego": 0.07188105583190918, "sim_compute_robot_state-npc0": 0.07021537167685372, "sim_compute_robot_state-npc1": 0.06950015681130546, "sim_compute_robot_state-npc2": 0.07012502806527274, "sim_compute_robot_state-npc3": 0.06942883389336722}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.20894192342888815, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.06547255058811136, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07543560250164712, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.10080540996708282, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.03899189217449867, "sim_compute_performance-ego": 0.07018102685066119, "sim_compute_robot_state-ego": 0.07711496745070366, "sim_compute_robot_state-npc0": 0.07080989667814072, "sim_compute_robot_state-npc1": 0.07297921507325891, "sim_compute_robot_state-npc2": 0.06947513149209218, "sim_compute_robot_state-npc3": 0.07072316783748261}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.20094177889269452, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06345253766969193, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.07120721839195074, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.09992891134217728, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.03913887156996616, "sim_compute_performance-ego": 0.0688749912173249, "sim_compute_robot_state-ego": 0.07422647365303926, "sim_compute_robot_state-npc0": 0.07162331425866415, "sim_compute_robot_state-npc1": 0.07215206013169399, "sim_compute_robot_state-npc2": 0.07188758461974389, "sim_compute_robot_state-npc3": 0.07284548393515654}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.18085241317749023, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.049974294809194714, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.05692987258617695, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.07175432718717135, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.029191081340496357, "sim_compute_performance-ego": 0.051044161503131576, "sim_compute_robot_state-ego": 0.056077269407419056, "sim_compute_robot_state-npc0": 0.05365423972790058, "sim_compute_robot_state-npc1": 0.05320336268498348, "sim_compute_robot_state-npc2": 0.05419428531940167, "sim_compute_robot_state-npc3": 0.05005870415614201}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.2004930019378662, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.06235786437988281, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0715472380320231, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.09738000869750976, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.03913875579833984, "sim_compute_performance-ego": 0.06630342483520507, "sim_compute_robot_state-ego": 0.0718217118581136, "sim_compute_robot_state-npc0": 0.06972095171610514, "sim_compute_robot_state-npc1": 0.06911776224772136, "sim_compute_robot_state-npc2": 0.07022971153259278, "sim_compute_robot_state-npc3": 0.07081513086954752}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.2173393340337844, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.06691268512180873, "in-drivable-lane": 0, "agent_compute-ego": 0.07051161357334682, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.0989178702944801, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.039454108192807154, "sim_compute_performance-ego": 0.06593296641395205, "sim_compute_robot_state-ego": 0.06990030833653041, "sim_compute_robot_state-npc0": 0.07706495693751744, "sim_compute_robot_state-npc1": 0.0714270727975028, "sim_compute_robot_state-npc2": 0.0713616893405006, "sim_compute_robot_state-npc3": 0.07125240280514672}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.24641562617102333, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.06505821471990542, "in-drivable-lane": 1.15, "agent_compute-ego": 0.07174383207809093, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.10319226287132086, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.04028874219850053, "sim_compute_performance-ego": 0.07326821948206702, "sim_compute_robot_state-ego": 0.08584097374317258, "sim_compute_robot_state-npc0": 0.0761379086694052, "sim_compute_robot_state-npc1": 0.07427073079486225, "sim_compute_robot_state-npc2": 0.0721655058306317, "sim_compute_robot_state-npc3": 0.07203166429386583}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.23354137795312063, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.06516517911638532, "in-drivable-lane": 0, "agent_compute-ego": 0.07579607622964042, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.10159674712589808, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.04076665639877319, "sim_compute_performance-ego": 0.0705450006893703, "sim_compute_robot_state-ego": 0.0794705833707537, "sim_compute_robot_state-npc0": 0.07439419201442174, "sim_compute_robot_state-npc1": 0.07362354653222221, "sim_compute_robot_state-npc2": 0.07857108967644828, "sim_compute_robot_state-npc3": 0.07626925195966448}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.2203141988492479, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.06269790612015069, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.07364971497479607, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.09741551735821892, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.042307619955025466, "sim_compute_performance-ego": 0.07099174050723805, "sim_compute_robot_state-ego": 0.06981645378411985, "sim_compute_robot_state-npc0": 0.07214664945415422, "sim_compute_robot_state-npc1": 0.07022865145814185, "sim_compute_robot_state-npc2": 0.0721892001582127, "sim_compute_robot_state-npc3": 0.07289977634654325}}
set_robot_commands_max	0.11307873933211617
set_robot_commands_mean	0.09670781544803952
set_robot_commands_median	0.09940426009041922
set_robot_commands_min	0.07175432718717135
sim_compute_performance-ego_max	0.08233482941337254
sim_compute_performance-ego_mean	0.06788340507461528
sim_compute_performance-ego_median	0.07018102685066119
sim_compute_performance-ego_min	0.051044161503131576
sim_compute_robot_state-ego_max	0.09955243442369544
sim_compute_robot_state-ego_mean	0.07443066641123515
sim_compute_robot_state-ego_median	0.07422647365303926
sim_compute_robot_state-ego_min	0.05490991525482713
sim_compute_robot_state-npc0_max	0.07949352264404297
sim_compute_robot_state-npc0_mean	0.07000003063176802
sim_compute_robot_state-npc0_median	0.07137980180628159
sim_compute_robot_state-npc0_min	0.05365423972790058
sim_compute_robot_state-npc1_max	0.0775585589201554
sim_compute_robot_state-npc1_mean	0.0696338664242372
sim_compute_robot_state-npc1_median	0.0714270727975028
sim_compute_robot_state-npc1_min	0.052671875870018675
sim_compute_robot_state-npc2_max	0.07857108967644828
sim_compute_robot_state-npc2_mean	0.06914736006293834
sim_compute_robot_state-npc2_median	0.07022971153259278
sim_compute_robot_state-npc2_min	0.05361538602594744
sim_compute_robot_state-npc3_max	0.07926375969596532
sim_compute_robot_state-npc3_mean	0.06940485163505537
sim_compute_robot_state-npc3_median	0.0709986686706543
sim_compute_robot_state-npc3_min	0.05005870415614201
sim_compute_sim_state_max	0.04470136891240659
sim_compute_sim_state_mean	0.0387435002704631
sim_compute_sim_state_median	0.03913887156996616
sim_compute_sim_state_min	0.029191081340496357
sim_physics_max	0.26057151089543884
sim_physics_mean	0.21274819530180253
sim_physics_median	0.21615739663441977
sim_physics_min	0.16530179140860574
sim_render-ego_max	0.07012398346610692
sim_render-ego_mean	0.06242636122106273
sim_render-ego_median	0.06345253766969193
sim_render-ego_min	0.049974294809194714
simulation-passed	1
survival_time_max	6.999999999999983
survival_time_mean	3.043333333333329
survival_time_min	1.0500000000000005

No reset possible

22819

2698

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-17 02:08:08+00:00

2019-05-17 03:00:50+00:00

0:52:42

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22811

2724

jiang peng

test for ppo

aido2-LFVI-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-17 02:06:12+00:00

2019-05-17 02:07:53+00:00

0:01:41

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22802

2731

Bhairav Mehta

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LF-sim-validation

step1-simulation

failed

yes

ip-172-31-38-104-8195

2019-05-17 02:03:44+00:00

2019-05-17 02:05:32+00:00

0:01:48

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22794

2747

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

aido2-LFV-sim-validation

step1-simulation

failed

yes

ip-172-31-38-104-8195

2019-05-17 02:00:52+00:00

2019-05-17 02:02:56+00:00

0:02:04

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22776

2774

Bhairav Mehta

challenge-aido_LF-baseline-duckietown

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-17 01:52:34+00:00

2019-05-17 02:00:36+00:00

0:08:02

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22737

2856

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

aido2-LF-sim-testing

step1-simulation

success

yes

ip-172-31-38-104-8195

2019-05-17 01:17:29+00:00

2019-05-17 01:52:28+00:00

0:34:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2506382951605066
survival_time_median	4.799999999999991
deviation-center-line_median	0.2084327403075257
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.11953585530504768
agent_compute-ego_mean	0.1073600371497808
agent_compute-ego_median	0.10810404045637265
agent_compute-ego_min	0.09325301079522996
deviation-center-line_max	0.34032468935256244
deviation-center-line_mean	0.20945039143379293
deviation-center-line_min	0.07549656914488843
deviation-heading_max	2.2702669924732906
deviation-heading_mean	1.666058580625534
deviation-heading_median	1.6898654544228242
deviation-heading_min	1.0089346537032806
driven_any_max	1.174538089426396
driven_any_mean	0.508103765596656
driven_any_median	0.358881432506834
driven_any_min	0.14594095312198974
driven_lanedir_consec_max	0.5145104630569763
driven_lanedir_consec_mean	0.31666408287668574
driven_lanedir_consec_min	0.10339599919686993
driven_lanedir_max	0.5145104630569763
driven_lanedir_mean	0.31666408287668574
driven_lanedir_median	0.2506382951605066
driven_lanedir_min	0.10339599919686993
in-drivable-lane_max	8.800000000000091
in-drivable-lane_mean	1.8266666666666849
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1707120947128424, "sim_physics": 0.1267444626490275, "survival_time": 14.950000000000076, "driven_lanedir": 0.5145104630569763, "sim_render-ego": 0.06865200519561768, "in-drivable-lane": 7.600000000000096, "agent_compute-ego": 0.11372513771057129, "deviation-heading": 2.0224655390890365, "set_robot_commands": 0.10873793681462604, "deviation-center-line": 0.34032468935256244, "driven_lanedir_consec": 0.5145104630569763, "sim_compute_sim_state": 0.04407287359237671, "sim_compute_performance-ego": 0.07576136509577433, "sim_compute_robot_state-ego": 0.08394577344258626}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19815766139498991, "sim_physics": 0.13110584446362086, "survival_time": 2.799999999999998, "driven_lanedir": 0.10339599919686993, "sim_render-ego": 0.0653134116104671, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.10455174105507987, "deviation-heading": 1.2604517984795416, "set_robot_commands": 0.10567751952580044, "deviation-center-line": 0.07549656914488843, "driven_lanedir_consec": 0.10339599919686993, "sim_compute_sim_state": 0.04115228567804609, "sim_compute_performance-ego": 0.07448898042951312, "sim_compute_robot_state-ego": 0.07938354781695775}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14594095312198974, "sim_physics": 0.12636830085931822, "survival_time": 2.1500000000000004, "driven_lanedir": 0.12180489336724332, "sim_render-ego": 0.06778058894844942, "in-drivable-lane": 0, "agent_compute-ego": 0.10447256509647812, "deviation-heading": 1.0089346537032806, "set_robot_commands": 0.11214071650837742, "deviation-center-line": 0.20509776381830788, "driven_lanedir_consec": 0.12180489336724332, "sim_compute_sim_state": 0.04452327794806902, "sim_compute_performance-ego": 0.07436132985492085, "sim_compute_robot_state-ego": 0.08156596782595613}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5477429518756478, "sim_physics": 0.12734883148353415, "survival_time": 7.149999999999983, "driven_lanedir": 0.4807143964063374, "sim_render-ego": 0.06393375596800051, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.10689336603338068, "deviation-heading": 2.039336227550392, "set_robot_commands": 0.10442412983287463, "deviation-center-line": 0.22455249635290225, "driven_lanedir_consec": 0.4807143964063374, "sim_compute_sim_state": 0.04026778094418399, "sim_compute_performance-ego": 0.07307632819755927, "sim_compute_robot_state-ego": 0.0807385878129439}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.539700175382884, "sim_physics": 0.13639997759609357, "survival_time": 7.049999999999983, "driven_lanedir": 0.4430532861735075, "sim_render-ego": 0.07008454647470028, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.11250782351121837, "deviation-heading": 1.6898654544228242, "set_robot_commands": 0.11280946021384382, "deviation-center-line": 0.2009608928383967, "driven_lanedir_consec": 0.4430532861735075, "sim_compute_sim_state": 0.04202535304617375, "sim_compute_performance-ego": 0.07588424242980091, "sim_compute_robot_state-ego": 0.09255181982162151}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.358881432506834, "sim_physics": 0.12563508252302805, "survival_time": 4.799999999999991, "driven_lanedir": 0.24996581983127353, "sim_render-ego": 0.06692049652338028, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.11225420236587524, "deviation-heading": 1.726371760301949, "set_robot_commands": 0.10355283071597415, "deviation-center-line": 0.2084327403075257, "driven_lanedir_consec": 0.24996581983127353, "sim_compute_sim_state": 0.04189896583557129, "sim_compute_performance-ego": 0.07695648322502772, "sim_compute_robot_state-ego": 0.08144701768954594}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.174538089426396, "sim_physics": 0.12492018461227417, "survival_time": 14.950000000000076, "driven_lanedir": 0.4834346220808072, "sim_render-ego": 0.06658458789189657, "in-drivable-lane": 7.750000000000095, "agent_compute-ego": 0.114366131623586, "deviation-heading": 2.2702669924732906, "set_robot_commands": 0.11149310906728108, "deviation-center-line": 0.2743815030349422, "driven_lanedir_consec": 0.4834346220808072, "sim_compute_sim_state": 0.043011268774668376, "sim_compute_performance-ego": 0.07786723613739013, "sim_compute_robot_state-ego": 0.08638458410898844}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.22630502192271323, "sim_physics": 0.11194834255036852, "survival_time": 3.149999999999997, "driven_lanedir": 0.20617849289485157, "sim_render-ego": 0.058874330823383635, "in-drivable-lane": 0, "agent_compute-ego": 0.09551143267798046, "deviation-heading": 1.087255853236586, "set_robot_commands": 0.09287117776416597, "deviation-center-line": 0.3065823317153645, "driven_lanedir_consec": 0.20617849289485157, "sim_compute_sim_state": 0.037994134993780224, "sim_compute_performance-ego": 0.06479831725832015, "sim_compute_robot_state-ego": 0.07105127970377605}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.1745254111500234, "sim_physics": 0.11504963954289754, "survival_time": 14.950000000000076, "driven_lanedir": 0.4238096941710188, "sim_render-ego": 0.06144462108612061, "in-drivable-lane": 8.800000000000091, "agent_compute-ego": 0.10136522928873698, "deviation-heading": 1.798260683612272, "set_robot_commands": 0.09529559373855592, "deviation-center-line": 0.2257290346540354, "driven_lanedir_consec": 0.4238096941710188, "sim_compute_sim_state": 0.03769586165746053, "sim_compute_performance-ego": 0.07238796234130859, "sim_compute_robot_state-ego": 0.0757396936416626}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.2986203233908063, "sim_physics": 0.129703692447992, "survival_time": 4.049999999999994, "driven_lanedir": 0.2448157841802927, "sim_render-ego": 0.06892095966103637, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.11953585530504768, "deviation-heading": 1.566234589636264, "set_robot_commands": 0.11034879566710672, "deviation-center-line": 0.16339096533809297, "driven_lanedir_consec": 0.2448157841802927, "sim_compute_sim_state": 0.041597999172446165, "sim_compute_performance-ego": 0.07827583654427234, "sim_compute_robot_state-ego": 0.08336916970617977}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.5155985329149106, "sim_physics": 0.13794118210121437, "survival_time": 6.749999999999984, "driven_lanedir": 0.4491283199122199, "sim_render-ego": 0.06592200950339988, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.1107838895585802, "deviation-heading": 1.993315826634416, "set_robot_commands": 0.10637820031907824, "deviation-center-line": 0.2274651292636858, "driven_lanedir_consec": 0.4491283199122199, "sim_compute_sim_state": 0.04021088105660898, "sim_compute_performance-ego": 0.07363427303455494, "sim_compute_robot_state-ego": 0.08256285455491807}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4191766131754861, "sim_physics": 0.13334951314840232, "survival_time": 5.549999999999988, "driven_lanedir": 0.3844029845816549, "sim_render-ego": 0.06612631866523812, "in-drivable-lane": 0, "agent_compute-ego": 0.11098115079037778, "deviation-heading": 1.6242636432739648, "set_robot_commands": 0.10500492491163647, "deviation-center-line": 0.2473430511466462, "driven_lanedir_consec": 0.3844029845816549, "sim_compute_sim_state": 0.04124582780374063, "sim_compute_performance-ego": 0.07233163043185398, "sim_compute_robot_state-ego": 0.07826708028982352}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.22227672727917808, "sim_physics": 0.11454647971737768, "survival_time": 3.099999999999997, "driven_lanedir": 0.1437249104087437, "sim_render-ego": 0.0626580253724129, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.10209498097819666, "deviation-heading": 1.559514169617989, "set_robot_commands": 0.09887941037454911, "deviation-center-line": 0.1233476366123096, "driven_lanedir_consec": 0.1437249104087437, "sim_compute_sim_state": 0.03905685870878158, "sim_compute_performance-ego": 0.06966256710790819, "sim_compute_robot_state-ego": 0.07346145952901532}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3106729758488854, "sim_physics": 0.1021024017106919, "survival_time": 4.199999999999993, "driven_lanedir": 0.2506382951605066, "sim_render-ego": 0.058990810598645894, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.09325301079522996, "deviation-heading": 1.4826504230190012, "set_robot_commands": 0.08735046500251406, "deviation-center-line": 0.11769296843007047, "driven_lanedir_consec": 0.2506382951605066, "sim_compute_sim_state": 0.03624081895464942, "sim_compute_performance-ego": 0.0640290720122201, "sim_compute_robot_state-ego": 0.06922773803983416}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.31870751984625395, "sim_physics": 0.12498325802559077, "survival_time": 4.299999999999993, "driven_lanedir": 0.25038328172798296, "sim_render-ego": 0.06476710563482241, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.10810404045637265, "deviation-heading": 1.8616910943321976, "set_robot_commands": 0.1033698320388794, "deviation-center-line": 0.2009580994971636, "driven_lanedir_consec": 0.25038328172798296, "sim_compute_sim_state": 0.038896419281183287, "sim_compute_performance-ego": 0.07343665943589321, "sim_compute_robot_state-ego": 0.08240098177000534}}
set_robot_commands_max	0.11280946021384382
set_robot_commands_mean	0.1038889401663509
set_robot_commands_median	0.10500492491163647
set_robot_commands_min	0.08735046500251406
sim_compute_performance-ego_max	0.07827583654427234
sim_compute_performance-ego_mean	0.07313015223575454
sim_compute_performance-ego_median	0.07363427303455494
sim_compute_performance-ego_min	0.0640290720122201
sim_compute_robot_state-ego_max	0.09255181982162151
sim_compute_robot_state-ego_mean	0.08013983705025432
sim_compute_robot_state-ego_median	0.08144701768954594
sim_compute_robot_state-ego_min	0.06922773803983416
sim_compute_sim_state_max	0.04452327794806902
sim_compute_sim_state_mean	0.040659373829849334
sim_compute_sim_state_median	0.04115228567804609
sim_compute_sim_state_min	0.03624081895464942
sim_physics_max	0.13794118210121437
sim_physics_mean	0.12454314622876211
sim_physics_median	0.12636830085931822
sim_physics_min	0.1021024017106919
sim_render-ego_max	0.07008454647470028
sim_render-ego_mean	0.06513157159717144
sim_render-ego_median	0.06592200950339988
sim_render-ego_min	0.058874330823383635
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.660000000000008
survival_time_min	2.1500000000000004

No reset possible

22715

2893

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-8195

2019-05-17 01:00:54+00:00

2019-05-17 01:17:22+00:00

0:16:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.304116736418659
survival_time_median	5.399999999999989
deviation-center-line_median	0.34309938833419684
in-drivable-lane_median	1.2999999999999954

other stats

agent_compute-ego_max	0.19250375511002368
agent_compute-ego_mean	0.1895727175854411
agent_compute-ego_median	0.19075250909441993
agent_compute-ego_min	0.18621441901930227
deviation-center-line_max	0.934137972843918
deviation-center-line_mean	0.44339332835806583
deviation-center-line_min	0.21661808686373696
deviation-heading_max	8.064304153466507
deviation-heading_mean	3.5740238093093297
deviation-heading_median	2.9305242906974516
deviation-heading_min	1.433791349071024
driven_any_max	2.0705700471419877
driven_any_mean	0.958886961824066
driven_any_median	0.7051824766287242
driven_any_min	0.4781775972896256
driven_lanedir_consec_max	0.953879461367509
driven_lanedir_consec_mean	0.45649840418015686
driven_lanedir_consec_min	0.1469783343480464
driven_lanedir_max	1.265094725866644
driven_lanedir_mean	0.5596224110948774
driven_lanedir_median	0.415823190199238
driven_lanedir_min	0.23262485160090973
in-drivable-lane_max	2.3500000000000227
in-drivable-lane_mean	1.3500000000000016
in-drivable-lane_min	0.7499999999999973
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0705700471419877, "sim_physics": 0.1172295352756577, "survival_time": 14.900000000000077, "driven_lanedir": 1.265094725866644, "sim_render-ego": 0.06535208785293886, "in-drivable-lane": 2.3500000000000227, "agent_compute-ego": 0.18621441901930227, "deviation-heading": 8.064304153466507, "set_robot_commands": 0.1042455010766151, "deviation-center-line": 0.934137972843918, "driven_lanedir_consec": 0.953879461367509, "sim_compute_sim_state": 0.04176746358807455, "sim_compute_performance-ego": 0.07206331803494652, "sim_compute_robot_state-ego": 0.0828198226506278}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5240546402948627, "sim_physics": 0.1271244664735432, "survival_time": 3.949999999999994, "driven_lanedir": 0.24174646492024457, "sim_render-ego": 0.06885190251507337, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.1869962245603151, "deviation-heading": 1.433791349071024, "set_robot_commands": 0.10055994685692124, "deviation-center-line": 0.21661808686373696, "driven_lanedir_consec": 0.23742194715929377, "sim_compute_sim_state": 0.04090690009201629, "sim_compute_performance-ego": 0.07635889475858665, "sim_compute_robot_state-ego": 0.07767916329299347}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7051824766287242, "sim_physics": 0.12355881929397584, "survival_time": 5.399999999999989, "driven_lanedir": 0.415823190199238, "sim_render-ego": 0.06526348988215129, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.1913966801431444, "deviation-heading": 3.165993605549857, "set_robot_commands": 0.1023014541025515, "deviation-center-line": 0.34309938833419684, "driven_lanedir_consec": 0.304116736418659, "sim_compute_sim_state": 0.04257737707208704, "sim_compute_performance-ego": 0.07126894924375746, "sim_compute_robot_state-ego": 0.07704771006548847}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0164500477651297, "sim_physics": 0.11487608060349512, "survival_time": 6.849999999999984, "driven_lanedir": 0.6428228228873509, "sim_render-ego": 0.06707138214668218, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.19250375511002368, "deviation-heading": 2.9305242906974516, "set_robot_commands": 0.10325534152288508, "deviation-center-line": 0.4658379712982559, "driven_lanedir_consec": 0.640095541607276, "sim_compute_sim_state": 0.04125834381493339, "sim_compute_performance-ego": 0.07894908250683416, "sim_compute_robot_state-ego": 0.09483345407639109}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4781775972896256, "sim_physics": 0.12220528012230283, "survival_time": 4.199999999999993, "driven_lanedir": 0.23262485160090973, "sim_render-ego": 0.06354670297531854, "in-drivable-lane": 0.9499999999999972, "agent_compute-ego": 0.19075250909441993, "deviation-heading": 2.2755056477618063, "set_robot_commands": 0.1004071803320022, "deviation-center-line": 0.2572732224502215, "driven_lanedir_consec": 0.1469783343480464, "sim_compute_sim_state": 0.04122933035805112, "sim_compute_performance-ego": 0.07246231748944237, "sim_compute_robot_state-ego": 0.07653179622831799}}
set_robot_commands_max	0.1042455010766151
set_robot_commands_mean	0.102153884778195
set_robot_commands_median	0.1023014541025515
set_robot_commands_min	0.1004071803320022
sim_compute_performance-ego_max	0.07894908250683416
sim_compute_performance-ego_mean	0.07422051240671343
sim_compute_performance-ego_median	0.07246231748944237
sim_compute_performance-ego_min	0.07126894924375746
sim_compute_robot_state-ego_max	0.09483345407639109
sim_compute_robot_state-ego_mean	0.08178238926276375
sim_compute_robot_state-ego_median	0.07767916329299347
sim_compute_robot_state-ego_min	0.07653179622831799
sim_compute_sim_state_max	0.04257737707208704
sim_compute_sim_state_mean	0.041547882985032474
sim_compute_sim_state_median	0.04125834381493339
sim_compute_sim_state_min	0.04090690009201629
sim_physics_max	0.1271244664735432
sim_physics_mean	0.12099883635379494
sim_physics_median	0.12220528012230283
sim_physics_min	0.11487608060349512
sim_render-ego_max	0.06885190251507337
sim_render-ego_mean	0.06601711307443285
sim_render-ego_median	0.06535208785293886
sim_render-ego_min	0.06354670297531854
simulation-passed	1
survival_time_max	14.900000000000077
survival_time_mean	7.060000000000008
survival_time_min	3.949999999999994

No reset possible

22710

2924

Bhairav Mehta

challenge-aido_LF-template-pytorch

aido2-LFV-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-17 00:54:03+00:00

2019-05-17 01:00:19+00:00

0:06:16

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22699

2945

Bhairav Mehta

Baseline solution using reinforcement learning

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-8195

2019-05-17 00:47:56+00:00

2019-05-17 00:53:08+00:00

0:05:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.17483248624303904
survival_time_median	1.6500000000000008
deviation-center-line_median	0.09538682627867286
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1814434456102776
agent_compute-ego_mean	0.16744318776588488
agent_compute-ego_median	0.1678756780402605
agent_compute-ego_min	0.15377687272571383
deviation-center-line_max	0.1055231600275232
deviation-center-line_mean	0.09304144689763608
deviation-center-line_min	0.08345689151890814
deviation-heading_max	1.0520933565747783
deviation-heading_mean	0.8571313660156221
deviation-heading_median	0.9129750112355444
deviation-heading_min	0.5591705580342284
driven_any_max	0.354966087195351
driven_any_mean	0.2368225237476456
driven_any_median	0.2478621587741717
driven_any_min	0.11838286695519692
driven_lanedir_consec_max	0.29368528485173373
driven_lanedir_consec_mean	0.17439224086041305
driven_lanedir_consec_min	0.08892084745337492
driven_lanedir_max	0.29368528485173373
driven_lanedir_mean	0.17439224086041305
driven_lanedir_median	0.17483248624303904
driven_lanedir_min	0.08892084745337492
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2478621587741717, "sim_physics": 0.12048787059205952, "survival_time": 1.6500000000000008, "driven_lanedir": 0.17483248624303904, "sim_render-ego": 0.06769822583054051, "in-drivable-lane": 0, "agent_compute-ego": 0.1814434456102776, "deviation-heading": 0.9458929352882908, "set_robot_commands": 0.0951484694625392, "deviation-center-line": 0.1055231600275232, "driven_lanedir_consec": 0.17483248624303904, "sim_compute_sim_state": 0.040643684791796135, "sim_compute_performance-ego": 0.06868360259316185, "sim_compute_robot_state-ego": 0.07692729343067516}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.354966087195351, "sim_physics": 0.11496773985929268, "survival_time": 2.1500000000000004, "driven_lanedir": 0.29368528485173373, "sim_render-ego": 0.05926643970400789, "in-drivable-lane": 0, "agent_compute-ego": 0.1678756780402605, "deviation-heading": 0.9129750112355444, "set_robot_commands": 0.09590339660644533, "deviation-center-line": 0.09700797072525864, "driven_lanedir_consec": 0.29368528485173373, "sim_compute_sim_state": 0.03990659602852755, "sim_compute_performance-ego": 0.07140210062958473, "sim_compute_robot_state-ego": 0.07680983321611272}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11838286695519692, "sim_physics": 0.11582631156558082, "survival_time": 1.0500000000000005, "driven_lanedir": 0.08892084745337492, "sim_render-ego": 0.06250194140842982, "in-drivable-lane": 0, "agent_compute-ego": 0.15377687272571383, "deviation-heading": 0.5591705580342284, "set_robot_commands": 0.10200760478065128, "deviation-center-line": 0.09538682627867286, "driven_lanedir_consec": 0.08892084745337492, "sim_compute_sim_state": 0.03686818622407459, "sim_compute_performance-ego": 0.06809695561726888, "sim_compute_robot_state-ego": 0.07603690737769717}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18589170857448029, "sim_physics": 0.1253350575764974, "survival_time": 1.3500000000000003, "driven_lanedir": 0.09973582047045416, "sim_render-ego": 0.06503202297069409, "in-drivable-lane": 0, "agent_compute-ego": 0.1680635611216227, "deviation-heading": 1.0520933565747783, "set_robot_commands": 0.1017691206049036, "deviation-center-line": 0.08383238593781753, "driven_lanedir_consec": 0.09973582047045416, "sim_compute_sim_state": 0.03389080365498861, "sim_compute_performance-ego": 0.0690012154755769, "sim_compute_robot_state-ego": 0.07372856140136719}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.27700979723902813, "sim_physics": 0.12868763340844047, "survival_time": 1.800000000000001, "driven_lanedir": 0.2147867652834634, "sim_render-ego": 0.06204906437132093, "in-drivable-lane": 0, "agent_compute-ego": 0.16605638133154976, "deviation-heading": 0.8155249689452684, "set_robot_commands": 0.09351325697369044, "deviation-center-line": 0.08345689151890814, "driven_lanedir_consec": 0.2147867652834634, "sim_compute_sim_state": 0.040797571341196694, "sim_compute_performance-ego": 0.06948043902715047, "sim_compute_robot_state-ego": 0.07473605208926731}}
set_robot_commands_max	0.10200760478065128
set_robot_commands_mean	0.09766836968564598
set_robot_commands_median	0.09590339660644533
set_robot_commands_min	0.09351325697369044
sim_compute_performance-ego_max	0.07140210062958473
sim_compute_performance-ego_mean	0.06933286266854857
sim_compute_performance-ego_median	0.0690012154755769
sim_compute_performance-ego_min	0.06809695561726888
sim_compute_robot_state-ego_max	0.07692729343067516
sim_compute_robot_state-ego_mean	0.07564772950302391
sim_compute_robot_state-ego_median	0.07603690737769717
sim_compute_robot_state-ego_min	0.07372856140136719
sim_compute_sim_state_max	0.040797571341196694
sim_compute_sim_state_mean	0.03842136840811671
sim_compute_sim_state_median	0.03990659602852755
sim_compute_sim_state_min	0.03389080365498861
sim_physics_max	0.12868763340844047
sim_physics_mean	0.12106092260037418
sim_physics_median	0.12048787059205952
sim_physics_min	0.11496773985929268
sim_render-ego_max	0.06769822583054051
sim_render-ego_mean	0.06330953885699864
sim_render-ego_median	0.06250194140842982
sim_render-ego_min	0.05926643970400789
simulation-passed	1
survival_time_max	2.1500000000000004
survival_time_mean	1.6000000000000008
survival_time_min	1.0500000000000005

No reset possible

22689

2965

Julian Zilly

Baseline-IL-logs-tensorflow

aido2-LFVI-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-8195

2019-05-17 00:24:56+00:00

2019-05-17 00:47:11+00:00

0:22:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.29278395040776584
survival_time_median	5.4999999999999885
deviation-center-line_median	0.20490681756639412
in-drivable-lane_median	2.6499999999999906

other stats

agent_compute-ego_max	0.2356324967216043
agent_compute-ego_mean	0.2262002982322183
agent_compute-ego_median	0.22599073509117223
agent_compute-ego_min	0.2207594633102417
deviation-center-line_max	1.148376041663458
deviation-center-line_mean	0.3929657263273465
deviation-center-line_min	0.1645219458915005
deviation-heading_max	2.1081274929705835
deviation-heading_mean	1.451200143574998
deviation-heading_median	1.387475927915964
deviation-heading_min	0.7553601276653396
driven_any_max	1.43655635577102
driven_any_mean	0.8299180108489989
driven_any_median	0.7161097639111021
driven_any_min	0.5699530689841495
driven_lanedir_consec_max	1.1103955898421023
driven_lanedir_consec_mean	0.4387203617492821
driven_lanedir_consec_min	0.22977059289386137
driven_lanedir_max	1.1103955898421023
driven_lanedir_mean	0.4401654030305992
driven_lanedir_median	0.29278395040776584
driven_lanedir_min	0.22977059289386137
in-drivable-lane_max	4.099999999999985
in-drivable-lane_mean	2.759999999999992
in-drivable-lane_min	1.2499999999999956
per-episodes	details {"udem1-0-0": {"driven_any": 1.43655635577102, "sim_physics": 0.21485844214757285, "survival_time": 14.950000000000076, "driven_lanedir": 1.1103955898421023, "sim_render-ego": 0.06362828890482584, "in-drivable-lane": 3.5499999999999954, "agent_compute-ego": 0.22142394065856932, "deviation-heading": 2.1081274929705835, "set_robot_commands": 0.0981121039390564, "deviation-center-line": 1.148376041663458, "driven_lanedir_consec": 1.1103955898421023, "sim_compute_sim_state": 0.04103370745976766, "sim_compute_performance-ego": 0.07147907972335815, "sim_compute_robot_state-ego": 0.07662670214970907, "sim_compute_robot_state-npc0": 0.07179960012435913, "sim_compute_robot_state-npc1": 0.0713109827041626, "sim_compute_robot_state-npc2": 0.0706908631324768, "sim_compute_robot_state-npc3": 0.07074330568313598}, "udem1-1-0": {"driven_any": 0.7161097639111021, "sim_physics": 0.2018126272687725, "survival_time": 5.09999999999999, "driven_lanedir": 0.22977059289386137, "sim_render-ego": 0.06629683924656288, "in-drivable-lane": 2.6499999999999906, "agent_compute-ego": 0.2356324967216043, "deviation-heading": 0.7553601276653396, "set_robot_commands": 0.09945176863202862, "deviation-center-line": 0.245450051662366, "driven_lanedir_consec": 0.22977059289386137, "sim_compute_sim_state": 0.04089690189735562, "sim_compute_performance-ego": 0.07074915427787631, "sim_compute_robot_state-ego": 0.07744184194826613, "sim_compute_robot_state-npc0": 0.0728146188399371, "sim_compute_robot_state-npc1": 0.07177370436051313, "sim_compute_robot_state-npc2": 0.07278801413143382, "sim_compute_robot_state-npc3": 0.07211938091352874}, "udem1-2-0": {"driven_any": 0.5699530689841495, "sim_physics": 0.1992556133935618, "survival_time": 4.299999999999993, "driven_lanedir": 0.25622264614376533, "sim_render-ego": 0.06447106738423192, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.22719485537950385, "deviation-heading": 1.8029659539410592, "set_robot_commands": 0.09750247278878856, "deviation-center-line": 0.20490681756639412, "driven_lanedir_consec": 0.2489974397371797, "sim_compute_sim_state": 0.04075854878092921, "sim_compute_performance-ego": 0.06976356894470924, "sim_compute_robot_state-ego": 0.07978209783864576, "sim_compute_robot_state-npc0": 0.07038364299508028, "sim_compute_robot_state-npc1": 0.06844404963559883, "sim_compute_robot_state-npc2": 0.06974510536637417, "sim_compute_robot_state-npc3": 0.06887995087823202}, "udem1-3-0": {"driven_any": 0.6927208221437324, "sim_physics": 0.2007970896634189, "survival_time": 5.4999999999999885, "driven_lanedir": 0.29278395040776584, "sim_render-ego": 0.06022030656987971, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 0.2207594633102417, "deviation-heading": 1.387475927915964, "set_robot_commands": 0.09640008969740434, "deviation-center-line": 0.20157377485301403, "driven_lanedir_consec": 0.29278395040776584, "sim_compute_sim_state": 0.04032342650673606, "sim_compute_performance-ego": 0.06866255023262717, "sim_compute_robot_state-ego": 0.06864786148071289, "sim_compute_robot_state-npc0": 0.07123154726895418, "sim_compute_robot_state-npc1": 0.06849943507801402, "sim_compute_robot_state-npc2": 0.07025124593214556, "sim_compute_robot_state-npc3": 0.0697686953978105}, "udem1-4-0": {"driven_any": 0.7342500434349902, "sim_physics": 0.21924245667147943, "survival_time": 7.699999999999981, "driven_lanedir": 0.311654235865501, "sim_render-ego": 0.0636978985427262, "in-drivable-lane": 4.099999999999985, "agent_compute-ego": 0.22599073509117223, "deviation-heading": 1.2020712153820434, "set_robot_commands": 0.0964514667337591, "deviation-center-line": 0.1645219458915005, "driven_lanedir_consec": 0.311654235865501, "sim_compute_sim_state": 0.03890896307957637, "sim_compute_performance-ego": 0.07060518048026344, "sim_compute_robot_state-ego": 0.07587688154988474, "sim_compute_robot_state-npc0": 0.07165162749104685, "sim_compute_robot_state-npc1": 0.07172434206132765, "sim_compute_robot_state-npc2": 0.07011849075168758, "sim_compute_robot_state-npc3": 0.06860361470804587}}
set_robot_commands_max	0.09945176863202862
set_robot_commands_mean	0.0975835803582074
set_robot_commands_median	0.09750247278878856
set_robot_commands_min	0.09640008969740434
sim_compute_performance-ego_max	0.07147907972335815
sim_compute_performance-ego_mean	0.07025190673176687
sim_compute_performance-ego_median	0.07060518048026344
sim_compute_performance-ego_min	0.06866255023262717
sim_compute_robot_state-ego_max	0.07978209783864576
sim_compute_robot_state-ego_mean	0.07567507699344372
sim_compute_robot_state-ego_median	0.07662670214970907
sim_compute_robot_state-ego_min	0.06864786148071289
sim_compute_robot_state-npc0_max	0.0728146188399371
sim_compute_robot_state-npc0_mean	0.07157620734387551
sim_compute_robot_state-npc0_median	0.07165162749104685
sim_compute_robot_state-npc0_min	0.07038364299508028
sim_compute_robot_state-npc1_max	0.07177370436051313
sim_compute_robot_state-npc1_mean	0.07035050276792325
sim_compute_robot_state-npc1_median	0.0713109827041626
sim_compute_robot_state-npc1_min	0.06844404963559883
sim_compute_robot_state-npc2_max	0.07278801413143382
sim_compute_robot_state-npc2_mean	0.07071874386282359
sim_compute_robot_state-npc2_median	0.07025124593214556
sim_compute_robot_state-npc2_min	0.06974510536637417
sim_compute_robot_state-npc3_max	0.07211938091352874
sim_compute_robot_state-npc3_mean	0.07002298951615063
sim_compute_robot_state-npc3_median	0.0697686953978105
sim_compute_robot_state-npc3_min	0.06860361470804587
sim_compute_sim_state_max	0.04103370745976766
sim_compute_sim_state_mean	0.04038430954487298
sim_compute_sim_state_median	0.04075854878092921
sim_compute_sim_state_min	0.03890896307957637
sim_physics_max	0.21924245667147943
sim_physics_mean	0.2071932458289611
sim_physics_median	0.2018126272687725
sim_physics_min	0.1992556133935618
sim_render-ego_max	0.06629683924656288
sim_render-ego_mean	0.06366288012964531
sim_render-ego_median	0.0636978985427262
sim_render-ego_min	0.06022030656987971
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.510000000000007
survival_time_min	4.299999999999993

No reset possible

22635

3055

Andrea Censi 🇨🇭

rotation

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-8195

2019-05-17 00:00:46+00:00

2019-05-17 00:24:26+00:00

0:23:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-0.0005547867508171045
survival_time_median	14.950000000000076
deviation-center-line_median	0.44901648578509457
in-drivable-lane_median	7.600000000000044

other stats

agent_compute-ego_max	0.1631548055013021
agent_compute-ego_mean	0.15689803377787276
agent_compute-ego_median	0.15747249364852903
agent_compute-ego_min	0.14748021523157756
deviation-center-line_max	0.5610133203215761
deviation-center-line_mean	0.3827485453764907
deviation-center-line_min	0.13860669343031343
deviation-heading_max	5.876680788839771
deviation-heading_mean	5.630778146323924
deviation-heading_median	5.657649106857695
deviation-heading_min	5.445457843647878
driven_any_max	0.026478672834056367
driven_any_mean	0.02486423959225153
driven_any_median	0.02593019554121306
driven_any_min	0.022165452661374756
driven_lanedir_consec_max	0.0021599934447711355
driven_lanedir_consec_mean	-0.00046586963337973407
driven_lanedir_consec_min	-0.003361806018059577
driven_lanedir_max	0.0021599934447711355
driven_lanedir_mean	-0.00046586963337973407
driven_lanedir_median	-0.0005547867508171045
driven_lanedir_min	-0.003361806018059577
in-drivable-lane_max	7.700000000000042
in-drivable-lane_mean	7.620000000000043
in-drivable-lane_min	7.550000000000042
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026478672834056367, "sim_physics": 0.1172210160891215, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021599934447711355, "sim_render-ego": 0.05829017957051595, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.14748021523157756, "deviation-heading": 5.657649106857695, "set_robot_commands": 0.09229744116465252, "deviation-center-line": 0.5610133203215761, "driven_lanedir_consec": 0.0021599934447711355, "sim_compute_sim_state": 0.03641358375549317, "sim_compute_performance-ego": 0.06496172825495403, "sim_compute_robot_state-ego": 0.07016754388809204}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.02593019554121306, "sim_physics": 0.12107119798660278, "survival_time": 14.950000000000076, "driven_lanedir": -0.003361806018059577, "sim_render-ego": 0.06279377778371176, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.15747249364852903, "deviation-heading": 5.445457843647878, "set_robot_commands": 0.09696175257364908, "deviation-center-line": 0.13860669343031343, "driven_lanedir_consec": -0.003361806018059577, "sim_compute_sim_state": 0.03884407838185628, "sim_compute_performance-ego": 0.06971666097640991, "sim_compute_robot_state-ego": 0.07682432095209757}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.023804404672438047, "sim_physics": 0.099455828666687, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021181059556472093, "sim_render-ego": 0.060255119005839027, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.1631548055013021, "deviation-heading": 5.876680788839771, "set_robot_commands": 0.09659610907236736, "deviation-center-line": 0.4784517475259532, "driven_lanedir_consec": 0.0021181059556472093, "sim_compute_sim_state": 0.039843077659606936, "sim_compute_performance-ego": 0.06824734926223755, "sim_compute_robot_state-ego": 0.07280610879262288}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022165452661374756, "sim_physics": 0.1208221952120463, "survival_time": 14.950000000000076, "driven_lanedir": -0.002690854798440334, "sim_render-ego": 0.06404405355453491, "in-drivable-lane": 7.700000000000042, "agent_compute-ego": 0.15691089789072674, "deviation-heading": 5.721005148732661, "set_robot_commands": 0.0985324756304423, "deviation-center-line": 0.44901648578509457, "driven_lanedir_consec": -0.002690854798440334, "sim_compute_sim_state": 0.0391504955291748, "sim_compute_performance-ego": 0.07155119975407918, "sim_compute_robot_state-ego": 0.07634682099024455}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.025942472252175396, "sim_physics": 0.1318619632720947, "survival_time": 14.950000000000076, "driven_lanedir": -0.0005547867508171045, "sim_render-ego": 0.06630721251169841, "in-drivable-lane": 7.650000000000044, "agent_compute-ego": 0.15947175661722818, "deviation-heading": 5.453097843541612, "set_robot_commands": 0.10188673496246338, "deviation-center-line": 0.28665447981951625, "driven_lanedir_consec": -0.0005547867508171045, "sim_compute_sim_state": 0.041293907165527347, "sim_compute_performance-ego": 0.07429551839828491, "sim_compute_robot_state-ego": 0.08194465319315593}}
set_robot_commands_max	0.10188673496246338
set_robot_commands_mean	0.09725490268071492
set_robot_commands_median	0.09696175257364908
set_robot_commands_min	0.09229744116465252
sim_compute_performance-ego_max	0.07429551839828491
sim_compute_performance-ego_mean	0.06975449132919312
sim_compute_performance-ego_median	0.06971666097640991
sim_compute_performance-ego_min	0.06496172825495403
sim_compute_robot_state-ego_max	0.08194465319315593
sim_compute_robot_state-ego_mean	0.07561788956324259
sim_compute_robot_state-ego_median	0.07634682099024455
sim_compute_robot_state-ego_min	0.07016754388809204
sim_compute_sim_state_max	0.041293907165527347
sim_compute_sim_state_mean	0.0391090284983317
sim_compute_sim_state_median	0.0391504955291748
sim_compute_sim_state_min	0.03641358375549317
sim_physics_max	0.1318619632720947
sim_physics_mean	0.11808644024531044
sim_physics_median	0.1208221952120463
sim_physics_min	0.099455828666687
sim_render-ego_max	0.06630721251169841
sim_render-ego_mean	0.06233806848526001
sim_render-ego_median	0.06279377778371176
sim_render-ego_min	0.05829017957051595
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

22627

3075

Julian Zilly

Baseline-IL-logs-tensorflow

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-16 23:55:40+00:00

2019-05-17 00:00:24+00:00

0:04:44

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22612

3105

Angel Woo 🇭🇰

HKU Duckietown Project

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-8195

2019-05-16 23:29:57+00:00

2019-05-16 23:54:57+00:00

0:25:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3843606663201364
survival_time_median	14.950000000000076
deviation-center-line_median	0.6382418992963101
in-drivable-lane_median	5.450000000000033

other stats

agent_compute-ego_max	0.23340062603695705
agent_compute-ego_mean	0.22070552737763047
agent_compute-ego_median	0.2158018906911214
agent_compute-ego_min	0.2129514495531718
deviation-center-line_max	1.0779822469327744
deviation-center-line_mean	0.6790927873912426
deviation-center-line_min	0.48815126628450994
deviation-heading_max	3.376228194451677
deviation-heading_mean	2.1028955817317345
deviation-heading_median	1.724521625729046
deviation-heading_min	1.187844998713908
driven_any_max	0.9421462987124752
driven_any_mean	0.8597745805779511
driven_any_median	0.9264118797137368
driven_any_min	0.6761689488868659
driven_lanedir_consec_max	0.8064876441331119
driven_lanedir_consec_mean	0.5227175891995144
driven_lanedir_consec_min	0.3114811070534965
driven_lanedir_max	0.8064876441331119
driven_lanedir_mean	0.5227175891995144
driven_lanedir_median	0.3843606663201364
driven_lanedir_min	0.3114811070534965
in-drivable-lane_max	9.250000000000089
in-drivable-lane_mean	4.9000000000000465
in-drivable-lane_min	1.4500000000000206
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8196413264847883, "sim_physics": 0.12405630923409498, "survival_time": 13.100000000000051, "driven_lanedir": 0.3843606663201364, "sim_render-ego": 0.06496327432967325, "in-drivable-lane": 6.700000000000066, "agent_compute-ego": 0.23340062603695705, "deviation-heading": 1.187844998713908, "set_robot_commands": 0.09967925621353033, "deviation-center-line": 0.6797657487002637, "driven_lanedir_consec": 0.3843606663201364, "sim_compute_sim_state": 0.04038598337246262, "sim_compute_performance-ego": 0.07251809116538244, "sim_compute_robot_state-ego": 0.07930992759821069}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9264118797137368, "sim_physics": 0.11082048416137696, "survival_time": 14.950000000000076, "driven_lanedir": 0.3114811070534965, "sim_render-ego": 0.06387359778086345, "in-drivable-lane": 9.250000000000089, "agent_compute-ego": 0.2129514495531718, "deviation-heading": 1.724521625729046, "set_robot_commands": 0.09809133688608804, "deviation-center-line": 0.48815126628450994, "driven_lanedir_consec": 0.3114811070534965, "sim_compute_sim_state": 0.0389648699760437, "sim_compute_performance-ego": 0.07054956595102946, "sim_compute_robot_state-ego": 0.07749095598856608}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9345044490918888, "sim_physics": 0.11288281838099162, "survival_time": 14.950000000000076, "driven_lanedir": 0.7990241302142027, "sim_render-ego": 0.062351027329762776, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.2158018906911214, "deviation-heading": 3.376228194451677, "set_robot_commands": 0.09638073205947877, "deviation-center-line": 1.0779822469327744, "driven_lanedir_consec": 0.7990241302142027, "sim_compute_sim_state": 0.039740991592407224, "sim_compute_performance-ego": 0.07024669170379638, "sim_compute_robot_state-ego": 0.07468078295389811}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9421462987124752, "sim_physics": 0.1128612995147705, "survival_time": 14.950000000000076, "driven_lanedir": 0.8064876441331119, "sim_render-ego": 0.06346303701400757, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.22642476717631024, "deviation-heading": 2.738440041273094, "set_robot_commands": 0.09921631336212158, "deviation-center-line": 0.6382418992963101, "driven_lanedir_consec": 0.8064876441331119, "sim_compute_sim_state": 0.040133893489837646, "sim_compute_performance-ego": 0.07124196211496989, "sim_compute_robot_state-ego": 0.07891410827636719}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6761689488868659, "sim_physics": 0.11620519052852284, "survival_time": 11.00000000000002, "driven_lanedir": 0.31223439827662425, "sim_render-ego": 0.06121277700770985, "in-drivable-lane": 5.450000000000033, "agent_compute-ego": 0.21494890343059192, "deviation-heading": 1.4874430484909476, "set_robot_commands": 0.0958545370535417, "deviation-center-line": 0.5113227757423547, "driven_lanedir_consec": 0.31223439827662425, "sim_compute_sim_state": 0.03864568146792325, "sim_compute_performance-ego": 0.068466224453666, "sim_compute_robot_state-ego": 0.07103328162973577}}
set_robot_commands_max	0.09967925621353033
set_robot_commands_mean	0.09784443511495208
set_robot_commands_median	0.09809133688608804
set_robot_commands_min	0.0958545370535417
sim_compute_performance-ego_max	0.07251809116538244
sim_compute_performance-ego_mean	0.07060450707776884
sim_compute_performance-ego_median	0.07054956595102946
sim_compute_performance-ego_min	0.068466224453666
sim_compute_robot_state-ego_max	0.07930992759821069
sim_compute_robot_state-ego_mean	0.07628581128935556
sim_compute_robot_state-ego_median	0.07749095598856608
sim_compute_robot_state-ego_min	0.07103328162973577
sim_compute_sim_state_max	0.04038598337246262
sim_compute_sim_state_mean	0.039574283979734885
sim_compute_sim_state_median	0.039740991592407224
sim_compute_sim_state_min	0.03864568146792325
sim_physics_max	0.12405630923409498
sim_physics_mean	0.1153652203639514
sim_physics_median	0.11288281838099162
sim_physics_min	0.11082048416137696
sim_render-ego_max	0.06496327432967325
sim_render-ego_mean	0.06317274269240337
sim_render-ego_median	0.06346303701400757
sim_render-ego_min	0.06121277700770985
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.79000000000006
survival_time_min	11.00000000000002

No reset possible

22592

3127

Rami Al-Naim 🇷🇺

[0.27;0.6]

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-38-104-8195

2019-05-16 23:02:55+00:00

2019-05-16 23:29:21+00:00

0:26:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.8095707431208443
survival_time_median	11.450000000000028
deviation-center-line_median	0.9592140039187546
in-drivable-lane_median	1.1999999999999955

other stats

agent_compute-ego_max	0.1590254057699175
agent_compute-ego_mean	0.1506287935430227
agent_compute-ego_median	0.15431394014816618
agent_compute-ego_min	0.13937878847122193
deviation-center-line_max	1.2970142045656785
deviation-center-line_mean	0.9017729030171162
deviation-center-line_min	0.5129286372496981
deviation-heading_max	2.518710388041859
deviation-heading_mean	1.8650061497778432
deviation-heading_median	2.091507052746198
deviation-heading_min	1.1367972737004453
driven_any_max	2.757710684330704
driven_any_mean	2.244580929275891
driven_any_median	2.0973407324198705
driven_any_min	1.7860016821509097
driven_lanedir_consec_max	2.4648022840846626
driven_lanedir_consec_mean	2.038731815587793
driven_lanedir_consec_min	1.7089153972102102
driven_lanedir_max	2.4648022840846626
driven_lanedir_mean	2.038731815587793
driven_lanedir_median	1.8095707431208443
driven_lanedir_min	1.7089153972102102
in-drivable-lane_max	1.5000000000000062
in-drivable-lane_mean	0.8100000000000043
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.748667922724299, "sim_physics": 0.13447846094767252, "survival_time": 14.950000000000076, "driven_lanedir": 2.4415332615797554, "sim_render-ego": 0.06777995189030965, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.1441759792963664, "deviation-heading": 2.091507052746198, "set_robot_commands": 0.10868946154912312, "deviation-center-line": 0.9592140039187546, "driven_lanedir_consec": 2.4415332615797554, "sim_compute_sim_state": 0.0423840594291687, "sim_compute_performance-ego": 0.07650857369105021, "sim_compute_robot_state-ego": 0.08485814412434896}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.757710684330704, "sim_physics": 0.14731083949406942, "survival_time": 14.950000000000076, "driven_lanedir": 2.4648022840846626, "sim_render-ego": 0.07090367078781128, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.13937878847122193, "deviation-heading": 2.117138743495478, "set_robot_commands": 0.1187810508410136, "deviation-center-line": 1.2970142045656785, "driven_lanedir_consec": 2.4648022840846626, "sim_compute_sim_state": 0.04475717782974243, "sim_compute_performance-ego": 0.08126818974812826, "sim_compute_robot_state-ego": 0.09567489703496296}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.0973407324198705, "sim_physics": 0.14364996123001564, "survival_time": 11.450000000000028, "driven_lanedir": 1.7688373919434932, "sim_render-ego": 0.07252889949681977, "in-drivable-lane": 1.5000000000000062, "agent_compute-ego": 0.15431394014816618, "deviation-heading": 1.4608772909052352, "set_robot_commands": 0.12022648211649932, "deviation-center-line": 0.9699375740923434, "driven_lanedir_consec": 1.7688373919434932, "sim_compute_sim_state": 0.046172060820733614, "sim_compute_performance-ego": 0.08253858495487397, "sim_compute_robot_state-ego": 0.09523453983156964}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7860016821509097, "sim_physics": 0.14574656194570113, "survival_time": 9.800000000000004, "driven_lanedir": 1.7089153972102102, "sim_render-ego": 0.07912433390714685, "in-drivable-lane": 0, "agent_compute-ego": 0.15624985402944136, "deviation-heading": 2.518710388041859, "set_robot_commands": 0.11836305564763594, "deviation-center-line": 0.5129286372496981, "driven_lanedir_consec": 1.7089153972102102, "sim_compute_sim_state": 0.045404525435700706, "sim_compute_performance-ego": 0.08739504765491096, "sim_compute_robot_state-ego": 0.09287382753527894}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.83318362475367, "sim_physics": 0.1532568836686623, "survival_time": 10.050000000000008, "driven_lanedir": 1.8095707431208443, "sim_render-ego": 0.072548759517385, "in-drivable-lane": 0, "agent_compute-ego": 0.1590254057699175, "deviation-heading": 1.1367972737004453, "set_robot_commands": 0.12071237398024222, "deviation-center-line": 0.7697700952591068, "driven_lanedir_consec": 1.8095707431208443, "sim_compute_sim_state": 0.04542109385058654, "sim_compute_performance-ego": 0.08196551408340681, "sim_compute_robot_state-ego": 0.09207615923525682}}
set_robot_commands_max	0.12071237398024222
set_robot_commands_mean	0.11735448482690285
set_robot_commands_median	0.1187810508410136
set_robot_commands_min	0.10868946154912312
sim_compute_performance-ego_max	0.08739504765491096
sim_compute_performance-ego_mean	0.08193518202647404
sim_compute_performance-ego_median	0.08196551408340681
sim_compute_performance-ego_min	0.07650857369105021
sim_compute_robot_state-ego_max	0.09567489703496296
sim_compute_robot_state-ego_mean	0.09214351355228348
sim_compute_robot_state-ego_median	0.09287382753527894
sim_compute_robot_state-ego_min	0.08485814412434896
sim_compute_sim_state_max	0.046172060820733614
sim_compute_sim_state_mean	0.0448277834731864
sim_compute_sim_state_median	0.045404525435700706
sim_compute_sim_state_min	0.0423840594291687
sim_physics_max	0.1532568836686623
sim_physics_mean	0.1448885414572242
sim_physics_median	0.14574656194570113
sim_physics_min	0.13447846094767252
sim_render-ego_max	0.07912433390714685
sim_render-ego_mean	0.0725771231198945
sim_render-ego_median	0.07252889949681977
sim_render-ego_min	0.06777995189030965
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.240000000000038
survival_time_min	9.800000000000004

No reset possible

22557

3183

jiang peng

Baseline solution using reinforcement learning

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-38-104-8195

2019-05-16 22:35:28+00:00

2019-05-16 23:02:16+00:00

0:26:48

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

ID	1213
evaluator	`ip-172-31-38-104-8195`
owner	I don't have one 😀
machine	ip-172-31-38-104
process	ip-172-31-38-104-8195
version	d-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard	2019-05-16 22:34:40+00:00
last heard	2019-05-17 15:37:08+00:00
status	inactive
# evaluating
# success	15 `22592`
# timeout
# failed	2 `22794`
# error	17 `22557`
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator 1213

Evaluator jobs