Evaluator 787

2019-04-24 16:41:27+00:00

2019-04-24 16:42:40+00:00

0:01:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

efficiency

-63.54840081245565

other stats

fleet_size	-1000000000
service_quality	-32.668280203114726

No reset possible

19666

2375

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

success

2019-04-24 16:33:33+00:00

2019-04-24 16:41:00+00:00

0:07:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2394590679116675
survival_time_median	5.549999999999988
deviation-center-line_median	0.04756896992501765
in-drivable-lane_median	0.9999999999999964

other stats

agent_compute-ego_max	0.059710949390858144
agent_compute-ego_mean	0.05825554234487517
agent_compute-ego_median	0.05856001045968798
agent_compute-ego_min	0.055859261088901095
deviation-center-line_max	0.06628159589691172
deviation-center-line_mean	0.055053867384428454
deviation-center-line_min	0.04756874938348469
deviation-heading_max	0.3902119203851745
deviation-heading_mean	0.3724667982759654
deviation-heading_median	0.39020902164128224
deviation-heading_min	0.34585149487811473
driven_any_max	1.5771689201187185
driven_any_mean	1.343168920198914
driven_any_median	1.5771689201187176
driven_any_min	0.992168920319208
driven_lanedir_consec_max	1.344898529895705
driven_lanedir_consec_mean	1.047634910702065
driven_lanedir_consec_min	0.6544587706938922
driven_lanedir_max	1.344898529895705
driven_lanedir_mean	1.047634910702065
driven_lanedir_median	1.2394590679116675
driven_lanedir_min	0.6544587706938922
in-drivable-lane_max	0.9999999999999964
in-drivable-lane_mean	0.8799999999999969
in-drivable-lane_min	0.6999999999999975
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9921689203192088, "sim_physics": 0.02272745304637485, "survival_time": 3.599999999999995, "driven_lanedir": 0.6544587706938922, "sim_render-ego": 0.053371840053134494, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.055859261088901095, "deviation-heading": 0.3902119203851745, "set_robot_commands": 0.08494937751028273, "deviation-center-line": 0.04756896992501765, "driven_lanedir_consec": 0.6544587706938922, "sim_compute_sim_state": 0.03560598691304525, "sim_compute_performance-ego": 0.05979217423333062, "sim_compute_robot_state-ego": 0.06179772151841058}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.992168920319208, "sim_physics": 0.022501763370301988, "survival_time": 3.599999999999995, "driven_lanedir": 0.7598991170973933, "sim_render-ego": 0.05675790044996473, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.05856001045968798, "deviation-heading": 0.34585253283397355, "set_robot_commands": 0.08362344900767009, "deviation-center-line": 0.06628159589691172, "driven_lanedir_consec": 0.7598991170973933, "sim_compute_sim_state": 0.03461182779735989, "sim_compute_performance-ego": 0.06360209981600444, "sim_compute_robot_state-ego": 0.06281786825921801}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5771689201187185, "sim_physics": 0.02173446105407165, "survival_time": 5.549999999999988, "driven_lanedir": 1.344898529895705, "sim_render-ego": 0.05765809883942475, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.059710949390858144, "deviation-heading": 0.34585149487811473, "set_robot_commands": 0.08372634380787343, "deviation-center-line": 0.06628127233324356, "driven_lanedir_consec": 1.344898529895705, "sim_compute_sim_state": 0.03321074365495561, "sim_compute_performance-ego": 0.06204633884601765, "sim_compute_robot_state-ego": 0.061234192805247264}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.0232898845328941, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.05457988086047473, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.05831612982191481, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.0826530563938725, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.03384277842066309, "sim_compute_performance-ego": 0.06551325858176292, "sim_compute_robot_state-ego": 0.06266529710443171}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.024629259968663123, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.05785610869124129, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.05883136096301379, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.08820472751651798, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.03554267926259084, "sim_compute_performance-ego": 0.06382823634792019, "sim_compute_robot_state-ego": 0.06499061068973026}}
set_robot_commands_max	0.08820472751651798
set_robot_commands_mean	0.08463139084724333
set_robot_commands_median	0.08372634380787343
set_robot_commands_min	0.0826530563938725
sim_compute_performance-ego_max	0.06551325858176292
sim_compute_performance-ego_mean	0.06295642156500716
sim_compute_performance-ego_median	0.06360209981600444
sim_compute_performance-ego_min	0.05979217423333062
sim_compute_robot_state-ego_max	0.06499061068973026
sim_compute_robot_state-ego_mean	0.06270113807540757
sim_compute_robot_state-ego_median	0.06266529710443171
sim_compute_robot_state-ego_min	0.061234192805247264
sim_compute_sim_state_max	0.03560598691304525
sim_compute_sim_state_mean	0.03456280320972293
sim_compute_sim_state_median	0.03461182779735989
sim_compute_sim_state_min	0.03321074365495561
sim_physics_max	0.024629259968663123
sim_physics_mean	0.022976564394461146
sim_physics_median	0.02272745304637485
sim_physics_min	0.02173446105407165
sim_render-ego_max	0.05785610869124129
sim_render-ego_mean	0.056044765778848
sim_render-ego_median	0.05675790044996473
sim_render-ego_min	0.053371840053134494
simulation-passed	1
survival_time_max	5.549999999999988
survival_time_mean	4.769999999999992
survival_time_min	3.599999999999995

No reset possible

19654

2388

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-24 16:27:49+00:00

2019-04-24 16:33:05+00:00

0:05:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.04934681395673124
survival_time_median	1.5500000000000007
deviation-center-line_median	0.025706323138888425
in-drivable-lane_median	0.5000000000000004

other stats

agent_compute-ego_max	0.1628387358880812
agent_compute-ego_mean	0.15999676116051212
agent_compute-ego_median	0.16064603097977176
agent_compute-ego_min	0.15712642669677734
deviation-center-line_max	0.03285137993967958
deviation-center-line_mean	0.024870108592371383
deviation-center-line_min	0.017416156218972835
deviation-heading_max	0.6344674844270517
deviation-heading_mean	0.5896644987797798
deviation-heading_median	0.589832133633276
deviation-heading_min	0.5298947659822151
driven_any_max	0.16069372559930117
driven_any_mean	0.1476011434582416
driven_any_median	0.14554552384828276
driven_any_min	0.13574773462612957
driven_lanedir_consec_max	0.06373423209303253
driven_lanedir_consec_mean	0.049831363921763086
driven_lanedir_consec_min	0.038932675801136574
driven_lanedir_max	0.06373423209303253
driven_lanedir_mean	0.049831363921763086
driven_lanedir_median	0.04934681395673124
driven_lanedir_min	0.038932675801136574
in-drivable-lane_max	0.5500000000000005
in-drivable-lane_mean	0.5100000000000005
in-drivable-lane_min	0.4500000000000004
per-episodes	details {"udem1-0-0": {"driven_any": 0.16069372559930117, "sim_physics": 0.035467132925987244, "survival_time": 1.6000000000000008, "driven_lanedir": 0.06373423209303253, "sim_render-ego": 0.05692680180072784, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.16068199276924133, "deviation-heading": 0.6184740770873826, "set_robot_commands": 0.08337520062923431, "deviation-center-line": 0.03285137993967958, "driven_lanedir_consec": 0.06373423209303253, "sim_compute_sim_state": 0.03205128014087677, "sim_compute_performance-ego": 0.0652381107211113, "sim_compute_robot_state-ego": 0.05974819511175155, "sim_compute_robot_state-npc0": 0.057191796600818634, "sim_compute_robot_state-npc1": 0.05400919169187546, "sim_compute_robot_state-npc2": 0.05390553921461105, "sim_compute_robot_state-npc3": 0.05577578395605087}, "udem1-1-0": {"driven_any": 0.15671346079759524, "sim_physics": 0.04056404482933783, "survival_time": 1.5500000000000007, "driven_lanedir": 0.05701623712381343, "sim_render-ego": 0.0584425849299277, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.16064603097977176, "deviation-heading": 0.589832133633276, "set_robot_commands": 0.0833339306616014, "deviation-center-line": 0.025706323138888425, "driven_lanedir_consec": 0.05701623712381343, "sim_compute_sim_state": 0.03463551305955456, "sim_compute_performance-ego": 0.06421036874094317, "sim_compute_robot_state-ego": 0.0704241491133167, "sim_compute_robot_state-npc0": 0.0589920167000063, "sim_compute_robot_state-npc1": 0.05948698136114305, "sim_compute_robot_state-npc2": 0.06089033619050057, "sim_compute_robot_state-npc3": 0.05991192786924301}, "udem1-2-0": {"driven_any": 0.13930527241989923, "sim_physics": 0.03887361095797631, "survival_time": 1.5500000000000007, "driven_lanedir": 0.040126860634101646, "sim_render-ego": 0.05650758743286133, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1628387358880812, "deviation-heading": 0.5756540327689734, "set_robot_commands": 0.08914978273453252, "deviation-center-line": 0.020667844179314228, "driven_lanedir_consec": 0.040126860634101646, "sim_compute_sim_state": 0.03685619754175986, "sim_compute_performance-ego": 0.06178079112883537, "sim_compute_robot_state-ego": 0.06670854937645697, "sim_compute_robot_state-npc0": 0.07155066151772776, "sim_compute_robot_state-npc1": 0.06272112169573384, "sim_compute_robot_state-npc2": 0.061065619991671656, "sim_compute_robot_state-npc3": 0.06269936407766034}, "udem1-3-0": {"driven_any": 0.14554552384828276, "sim_physics": 0.03999386628468831, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04934681395673124, "sim_render-ego": 0.05811029275258382, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.15869061946868895, "deviation-heading": 0.6344674844270517, "set_robot_commands": 0.0883586565653483, "deviation-center-line": 0.027708839485001843, "driven_lanedir_consec": 0.04934681395673124, "sim_compute_sim_state": 0.035518376032511394, "sim_compute_performance-ego": 0.06149595578511556, "sim_compute_robot_state-ego": 0.06643701394399007, "sim_compute_robot_state-npc0": 0.0615188201268514, "sim_compute_robot_state-npc1": 0.06072279612223307, "sim_compute_robot_state-npc2": 0.05912062327067057, "sim_compute_robot_state-npc3": 0.06360710461934407}, "udem1-4-0": {"driven_any": 0.13574773462612957, "sim_physics": 0.03630357583363851, "survival_time": 1.5000000000000009, "driven_lanedir": 0.038932675801136574, "sim_render-ego": 0.05661187966664632, "in-drivable-lane": 0.5500000000000004, "agent_compute-ego": 0.15712642669677734, "deviation-heading": 0.5298947659822151, "set_robot_commands": 0.08308657805124918, "deviation-center-line": 0.017416156218972835, "driven_lanedir_consec": 0.038932675801136574, "sim_compute_sim_state": 0.03684763113657633, "sim_compute_performance-ego": 0.0626018762588501, "sim_compute_robot_state-ego": 0.06356778144836425, "sim_compute_robot_state-npc0": 0.06330042680104574, "sim_compute_robot_state-npc1": 0.06288881301879883, "sim_compute_robot_state-npc2": 0.06327393849690756, "sim_compute_robot_state-npc3": 0.06224066416422526}}
set_robot_commands_max	0.08914978273453252
set_robot_commands_mean	0.08546082972839314
set_robot_commands_median	0.08337520062923431
set_robot_commands_min	0.08308657805124918
sim_compute_performance-ego_max	0.0652381107211113
sim_compute_performance-ego_mean	0.06306542052697109
sim_compute_performance-ego_median	0.0626018762588501
sim_compute_performance-ego_min	0.06149595578511556
sim_compute_robot_state-ego_max	0.0704241491133167
sim_compute_robot_state-ego_mean	0.06537713779877592
sim_compute_robot_state-ego_median	0.06643701394399007
sim_compute_robot_state-ego_min	0.05974819511175155
sim_compute_robot_state-npc0_max	0.07155066151772776
sim_compute_robot_state-npc0_mean	0.06251074434928997
sim_compute_robot_state-npc0_median	0.0615188201268514
sim_compute_robot_state-npc0_min	0.057191796600818634
sim_compute_robot_state-npc1_max	0.06288881301879883
sim_compute_robot_state-npc1_mean	0.059965780777956855
sim_compute_robot_state-npc1_median	0.06072279612223307
sim_compute_robot_state-npc1_min	0.05400919169187546
sim_compute_robot_state-npc2_max	0.06327393849690756
sim_compute_robot_state-npc2_mean	0.05965121143287229
sim_compute_robot_state-npc2_median	0.06089033619050057
sim_compute_robot_state-npc2_min	0.05390553921461105
sim_compute_robot_state-npc3_max	0.06360710461934407
sim_compute_robot_state-npc3_mean	0.060846968937304714
sim_compute_robot_state-npc3_median	0.06224066416422526
sim_compute_robot_state-npc3_min	0.05577578395605087
sim_compute_sim_state_max	0.03685619754175986
sim_compute_sim_state_mean	0.035181799582255785
sim_compute_sim_state_median	0.035518376032511394
sim_compute_sim_state_min	0.03205128014087677
sim_physics_max	0.04056404482933783
sim_physics_mean	0.03824044616632564
sim_physics_median	0.03887361095797631
sim_physics_min	0.035467132925987244
sim_render-ego_max	0.0584425849299277
sim_render-ego_mean	0.05731982931654941
sim_render-ego_median	0.05692680180072784
sim_render-ego_min	0.05650758743286133
simulation-passed	1
survival_time_max	1.6000000000000008
survival_time_mean	1.5400000000000007
survival_time_min	1.5000000000000009

No reset possible

19649

2395

Liam Paull 🇨🇦

random_agent

step1-simulation

success

2019-04-24 16:20:03+00:00

2019-04-24 16:27:07+00:00

0:07:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.14409337802366776
agent_compute-ego_mean	0.12594898158826306
agent_compute-ego_median	0.12576830652025012
agent_compute-ego_min	0.11572356493967884
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.03297382930539689, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.055263951139630015, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.11572356493967884, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08450681758376788, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03332829475402832, "sim_compute_performance-ego": 0.062075817360068265, "sim_compute_robot_state-ego": 0.06456195633366422, "sim_compute_robot_state-npc0": 0.060501314559072816, "sim_compute_robot_state-npc1": 0.06078718293387935, "sim_compute_robot_state-npc2": 0.06174168946608057, "sim_compute_robot_state-npc3": 0.058916190885147955}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.04274290258234197, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06238430738449097, "in-drivable-lane": 0, "agent_compute-ego": 0.14409337802366776, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.1024518229744651, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03946692835200916, "sim_compute_performance-ego": 0.06928728385405107, "sim_compute_robot_state-ego": 0.07674014026468451, "sim_compute_robot_state-npc0": 0.07137950442054054, "sim_compute_robot_state-npc1": 0.0705790411342274, "sim_compute_robot_state-npc2": 0.06940103660930287, "sim_compute_robot_state-npc3": 0.06884185292504051}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.03589817682902018, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.0601303948296441, "in-drivable-lane": 0, "agent_compute-ego": 0.12576830652025012, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.0896457036336263, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.033854839536878796, "sim_compute_performance-ego": 0.06158893373277452, "sim_compute_robot_state-ego": 0.06576714515686036, "sim_compute_robot_state-npc0": 0.06438548829820422, "sim_compute_robot_state-npc1": 0.06542659865485298, "sim_compute_robot_state-npc2": 0.06234690878126356, "sim_compute_robot_state-npc3": 0.05979840490553114}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.03384081522623698, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.04997199277083079, "in-drivable-lane": 0, "agent_compute-ego": 0.11615186432997386, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.08384460707505544, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03381963074207306, "sim_compute_performance-ego": 0.05816127359867096, "sim_compute_robot_state-ego": 0.0605710099140803, "sim_compute_robot_state-npc0": 0.06448801358540852, "sim_compute_robot_state-npc1": 0.06173907220363617, "sim_compute_robot_state-npc2": 0.05903386572996775, "sim_compute_robot_state-npc3": 0.06219496329625448}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.03849145945380716, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05726180707707124, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1280077941277448, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.09250789880752563, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.036355965277727914, "sim_compute_performance-ego": 0.06192198921652401, "sim_compute_robot_state-ego": 0.0681680300656487, "sim_compute_robot_state-npc0": 0.0620072133400861, "sim_compute_robot_state-npc1": 0.06363877128152286, "sim_compute_robot_state-npc2": 0.06259363889694214, "sim_compute_robot_state-npc3": 0.06430206929936129}}
set_robot_commands_max	0.1024518229744651
set_robot_commands_mean	0.09059137001488808
set_robot_commands_median	0.0896457036336263
set_robot_commands_min	0.08384460707505544
sim_compute_performance-ego_max	0.06928728385405107
sim_compute_performance-ego_mean	0.06260705955241777
sim_compute_performance-ego_median	0.06192198921652401
sim_compute_performance-ego_min	0.05816127359867096
sim_compute_robot_state-ego_max	0.07674014026468451
sim_compute_robot_state-ego_mean	0.06716165634698762
sim_compute_robot_state-ego_median	0.06576714515686036
sim_compute_robot_state-ego_min	0.0605710099140803
sim_compute_robot_state-npc0_max	0.07137950442054054
sim_compute_robot_state-npc0_mean	0.06455230684066243
sim_compute_robot_state-npc0_median	0.06438548829820422
sim_compute_robot_state-npc0_min	0.060501314559072816
sim_compute_robot_state-npc1_max	0.0705790411342274
sim_compute_robot_state-npc1_mean	0.06443413324162375
sim_compute_robot_state-npc1_median	0.06363877128152286
sim_compute_robot_state-npc1_min	0.06078718293387935
sim_compute_robot_state-npc2_max	0.06940103660930287
sim_compute_robot_state-npc2_mean	0.06302342789671138
sim_compute_robot_state-npc2_median	0.06234690878126356
sim_compute_robot_state-npc2_min	0.05903386572996775
sim_compute_robot_state-npc3_max	0.06884185292504051
sim_compute_robot_state-npc3_mean	0.06281069626226707
sim_compute_robot_state-npc3_median	0.06219496329625448
sim_compute_robot_state-npc3_min	0.058916190885147955
sim_compute_sim_state_max	0.03946692835200916
sim_compute_sim_state_mean	0.03536513173254345
sim_compute_sim_state_median	0.033854839536878796
sim_compute_sim_state_min	0.03332829475402832
sim_physics_max	0.04274290258234197
sim_physics_mean	0.03678943667936064
sim_physics_median	0.03589817682902018
sim_physics_min	0.03297382930539689
sim_render-ego_max	0.06238430738449097
sim_render-ego_mean	0.05700249064033343
sim_render-ego_median	0.05726180707707124
sim_render-ego_min	0.04997199277083079
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

19644

2401

Bhairav Mehta

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-24 16:17:04+00:00

2019-04-24 16:19:43+00:00

0:02:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19640

2404

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-24 16:09:25+00:00

2019-04-24 16:15:57+00:00

0:06:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.04495532692746895
survival_time_median	1.6500000000000008
deviation-center-line_median	0.02149311918284142
in-drivable-lane_median	0.6000000000000005

other stats

agent_compute-ego_max	0.18051398462719387
agent_compute-ego_mean	0.156811697359639
agent_compute-ego_median	0.1421516158364036
agent_compute-ego_min	0.14037799112724536
deviation-center-line_max	0.036146312395420925
deviation-center-line_mean	0.02390954983287188
deviation-center-line_min	0.01869645809269556
deviation-heading_max	0.7381519127115987
deviation-heading_mean	0.6437117720096519
deviation-heading_median	0.6350358014044327
deviation-heading_min	0.5976423971627426
driven_any_max	0.15538495112219788
driven_any_mean	0.14398646170998533
driven_any_median	0.1427609061964726
driven_any_min	0.13772822522276926
driven_lanedir_consec_max	0.06574312943718263
driven_lanedir_consec_mean	0.04686843519326676
driven_lanedir_consec_min	0.03387627745176536
driven_lanedir_max	0.06574312943718263
driven_lanedir_mean	0.04686843519326676
driven_lanedir_median	0.04495532692746895
driven_lanedir_min	0.03387627745176536
in-drivable-lane_max	0.7000000000000006
in-drivable-lane_mean	0.6000000000000005
in-drivable-lane_min	0.5500000000000005
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.15538495112219788, "sim_physics": 0.04266005092196994, "survival_time": 1.800000000000001, "driven_lanedir": 0.06574312943718263, "sim_render-ego": 0.0650596088833279, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.18041045135921904, "deviation-heading": 0.7381519127115987, "set_robot_commands": 0.10099786520004272, "deviation-center-line": 0.036146312395420925, "driven_lanedir_consec": 0.06574312943718263, "sim_compute_sim_state": 0.0396980709499783, "sim_compute_performance-ego": 0.07363357808854845, "sim_compute_robot_state-ego": 0.0765170587433709, "sim_compute_robot_state-npc0": 0.0733901129828559, "sim_compute_robot_state-npc1": 0.07325235340330336, "sim_compute_robot_state-npc2": 0.07343529992633396, "sim_compute_robot_state-npc3": 0.06875595781538221}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.13772822522276926, "sim_physics": 0.03813066085179647, "survival_time": 1.800000000000001, "driven_lanedir": 0.047253596810924225, "sim_render-ego": 0.06318797667821248, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.18051398462719387, "deviation-heading": 0.6402971895556415, "set_robot_commands": 0.10656560791863336, "deviation-center-line": 0.02234971671430155, "driven_lanedir_consec": 0.047253596810924225, "sim_compute_sim_state": 0.04012558195326063, "sim_compute_performance-ego": 0.07054504421022204, "sim_compute_robot_state-ego": 0.07721402910020617, "sim_compute_robot_state-npc0": 0.1064735386106703, "sim_compute_robot_state-npc1": 0.07284924719068739, "sim_compute_robot_state-npc2": 0.0695081286960178, "sim_compute_robot_state-npc3": 0.06960826449924046}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1427609061964726, "sim_physics": 0.03409107526143392, "survival_time": 1.6500000000000008, "driven_lanedir": 0.04495532692746895, "sim_render-ego": 0.04847551114631422, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.1421516158364036, "deviation-heading": 0.5976423971627426, "set_robot_commands": 0.07830454363967433, "deviation-center-line": 0.020862142779099965, "driven_lanedir_consec": 0.04495532692746895, "sim_compute_sim_state": 0.03459767139319218, "sim_compute_performance-ego": 0.055445772228818954, "sim_compute_robot_state-ego": 0.05887865297722094, "sim_compute_robot_state-npc0": 0.05752249920006954, "sim_compute_robot_state-npc1": 0.0618940122199781, "sim_compute_robot_state-npc2": 0.06221087051160408, "sim_compute_robot_state-npc3": 0.061167789228034744}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14087629495267548, "sim_physics": 0.03201340184067235, "survival_time": 1.6500000000000008, "driven_lanedir": 0.042513845338992606, "sim_render-ego": 0.05153634331443093, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.14037799112724536, "deviation-heading": 0.6074315592138436, "set_robot_commands": 0.07916544422958836, "deviation-center-line": 0.02149311918284142, "driven_lanedir_consec": 0.042513845338992606, "sim_compute_sim_state": 0.0327695861007228, "sim_compute_performance-ego": 0.06009437821128152, "sim_compute_robot_state-ego": 0.06061145753571481, "sim_compute_robot_state-npc0": 0.053643284421978576, "sim_compute_robot_state-npc1": 0.05569898720943567, "sim_compute_robot_state-npc2": 0.05538189049923059, "sim_compute_robot_state-npc3": 0.0565608125744444}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14318193105581134, "sim_physics": 0.03300904482603073, "survival_time": 1.6000000000000008, "driven_lanedir": 0.03387627745176536, "sim_render-ego": 0.05579260736703873, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1406044438481331, "deviation-heading": 0.6350358014044327, "set_robot_commands": 0.08411814272403717, "deviation-center-line": 0.01869645809269556, "driven_lanedir_consec": 0.03387627745176536, "sim_compute_sim_state": 0.035116665065288544, "sim_compute_performance-ego": 0.06093365699052811, "sim_compute_robot_state-ego": 0.06238184869289398, "sim_compute_robot_state-npc0": 0.062487661838531494, "sim_compute_robot_state-npc1": 0.05975280702114105, "sim_compute_robot_state-npc2": 0.06126154959201813, "sim_compute_robot_state-npc3": 0.06353144347667694}}
set_robot_commands_max	0.10656560791863336
set_robot_commands_mean	0.08983032074239519
set_robot_commands_median	0.08411814272403717
set_robot_commands_min	0.07830454363967433
sim_compute_performance-ego_max	0.07363357808854845
sim_compute_performance-ego_mean	0.0641304859458798
sim_compute_performance-ego_median	0.06093365699052811
sim_compute_performance-ego_min	0.055445772228818954
sim_compute_robot_state-ego_max	0.07721402910020617
sim_compute_robot_state-ego_mean	0.06712060940988136
sim_compute_robot_state-ego_median	0.06238184869289398
sim_compute_robot_state-ego_min	0.05887865297722094
sim_compute_robot_state-npc0_max	0.1064735386106703
sim_compute_robot_state-npc0_mean	0.07070341941082117
sim_compute_robot_state-npc0_median	0.062487661838531494
sim_compute_robot_state-npc0_min	0.053643284421978576
sim_compute_robot_state-npc1_max	0.07325235340330336
sim_compute_robot_state-npc1_mean	0.06468948140890911
sim_compute_robot_state-npc1_median	0.0618940122199781
sim_compute_robot_state-npc1_min	0.05569898720943567
sim_compute_robot_state-npc2_max	0.07343529992633396
sim_compute_robot_state-npc2_mean	0.06435954784504092
sim_compute_robot_state-npc2_median	0.06221087051160408
sim_compute_robot_state-npc2_min	0.05538189049923059
sim_compute_robot_state-npc3_max	0.06960826449924046
sim_compute_robot_state-npc3_mean	0.06392485351875575
sim_compute_robot_state-npc3_median	0.06353144347667694
sim_compute_robot_state-npc3_min	0.0565608125744444
sim_compute_sim_state_max	0.04012558195326063
sim_compute_sim_state_mean	0.03646151509248849
sim_compute_sim_state_median	0.035116665065288544
sim_compute_sim_state_min	0.0327695861007228
sim_physics_max	0.04266005092196994
sim_physics_mean	0.03598084674038068
sim_physics_median	0.03409107526143392
sim_physics_min	0.03201340184067235
sim_render-ego_max	0.0650596088833279
sim_render-ego_mean	0.05681040947786485
sim_render-ego_median	0.05579260736703873
sim_render-ego_min	0.04847551114631422
simulation-passed	1
survival_time_max	1.800000000000001
survival_time_mean	1.700000000000001
survival_time_min	1.6000000000000008

No reset possible

19620

2443

Jacopo Tani

random_agent

aido2-LFVI-sim-testing

step1-simulation

success

2019-04-24 16:00:19+00:00

2019-04-24 16:08:52+00:00

0:08:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9585846921942625
survival_time_median	3.099999999999997
deviation-center-line_median	0.13094298490844536
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.14741401976727425
agent_compute-ego_mean	0.13676246375794338
agent_compute-ego_median	0.13898145206390866
agent_compute-ego_min	0.12075106914226826
deviation-center-line_max	0.1934674474960452
deviation-center-line_mean	0.10884100878338444
deviation-center-line_min	0.032459786530846635
deviation-heading_max	0.7356226190209126
deviation-heading_mean	0.3809403978290703
deviation-heading_median	0.2855944786164235
deviation-heading_min	0.22149655353610215
driven_any_max	2.029872313755146
driven_any_mean	1.3151025945779695
driven_any_median	1.2614050434743518
driven_any_min	1.0057903566516673
driven_lanedir_consec_max	1.454438818080216
driven_lanedir_consec_mean	1.0334629747873598
driven_lanedir_consec_min	0.6769768591939229
driven_lanedir_max	1.4545895120774182
driven_lanedir_mean	1.0334931135868004
driven_lanedir_median	0.9585846921942625
driven_lanedir_min	0.6769768591939229
in-drivable-lane_max	1.149999999999996
in-drivable-lane_mean	0.539999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.04365396499633789, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.05662835968865289, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.13898145206390866, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.08826678518265013, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03595513767666287, "sim_compute_performance-ego": 0.05919833031911698, "sim_compute_robot_state-ego": 0.06637010120210193, "sim_compute_robot_state-npc0": 0.06244246164957682, "sim_compute_robot_state-npc1": 0.06349130660768539, "sim_compute_robot_state-npc2": 0.0644398606012738, "sim_compute_robot_state-npc3": 0.0627687242296007}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.03948058801538804, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.058365499272066, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13632645326502182, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.0890662342894311, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03767170158087039, "sim_compute_performance-ego": 0.0656294962939094, "sim_compute_robot_state-ego": 0.06582524729709999, "sim_compute_robot_state-npc0": 0.0628063772238937, "sim_compute_robot_state-npc1": 0.06619977951049805, "sim_compute_robot_state-npc2": 0.06406329659854665, "sim_compute_robot_state-npc3": 0.06453856767392625}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.04103133370799403, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.057657034166397586, "in-drivable-lane": 0, "agent_compute-ego": 0.14033932455124393, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.08931814086052679, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03741814628724129, "sim_compute_performance-ego": 0.06361149972484957, "sim_compute_robot_state-ego": 0.06691320865384993, "sim_compute_robot_state-npc0": 0.06113071595468829, "sim_compute_robot_state-npc1": 0.0620470239270118, "sim_compute_robot_state-npc2": 0.06432426744891752, "sim_compute_robot_state-npc3": 0.06750618642376315}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.04437479059746925, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06133073441525723, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.14741401976727425, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.09261799365916153, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03697626641456117, "sim_compute_performance-ego": 0.06637786043451187, "sim_compute_robot_state-ego": 0.06954733615225935, "sim_compute_robot_state-npc0": 0.06528570804190129, "sim_compute_robot_state-npc1": 0.0651358518194645, "sim_compute_robot_state-npc2": 0.06651629792883042, "sim_compute_robot_state-npc3": 0.06560476790083215}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.028603434562683105, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.045886489061208874, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.12075106914226826, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07634183076711801, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.02942867003954374, "sim_compute_performance-ego": 0.05086185381962703, "sim_compute_robot_state-ego": 0.051375783406771146, "sim_compute_robot_state-npc0": 0.05350626890475933, "sim_compute_robot_state-npc1": 0.051360721771533675, "sim_compute_robot_state-npc2": 0.05259176859488854, "sim_compute_robot_state-npc3": 0.05324410475217379}}
set_robot_commands_max	0.09261799365916153
set_robot_commands_mean	0.08712219695177752
set_robot_commands_median	0.0890662342894311
set_robot_commands_min	0.07634183076711801
sim_compute_performance-ego_max	0.06637786043451187
sim_compute_performance-ego_mean	0.06113580811840298
sim_compute_performance-ego_median	0.06361149972484957
sim_compute_performance-ego_min	0.05086185381962703
sim_compute_robot_state-ego_max	0.06954733615225935
sim_compute_robot_state-ego_mean	0.06400633534241647
sim_compute_robot_state-ego_median	0.06637010120210193
sim_compute_robot_state-ego_min	0.051375783406771146
sim_compute_robot_state-npc0_max	0.06528570804190129
sim_compute_robot_state-npc0_mean	0.06103430635496389
sim_compute_robot_state-npc0_median	0.06244246164957682
sim_compute_robot_state-npc0_min	0.05350626890475933
sim_compute_robot_state-npc1_max	0.06619977951049805
sim_compute_robot_state-npc1_mean	0.06164693672723868
sim_compute_robot_state-npc1_median	0.06349130660768539
sim_compute_robot_state-npc1_min	0.051360721771533675
sim_compute_robot_state-npc2_max	0.06651629792883042
sim_compute_robot_state-npc2_mean	0.06238709823449138
sim_compute_robot_state-npc2_median	0.06432426744891752
sim_compute_robot_state-npc2_min	0.05259176859488854
sim_compute_robot_state-npc3_max	0.06750618642376315
sim_compute_robot_state-npc3_mean	0.06273247019605921
sim_compute_robot_state-npc3_median	0.06453856767392625
sim_compute_robot_state-npc3_min	0.05324410475217379
sim_compute_sim_state_max	0.03767170158087039
sim_compute_sim_state_mean	0.035489984399775895
sim_compute_sim_state_median	0.03697626641456117
sim_compute_sim_state_min	0.02942867003954374
sim_physics_max	0.04437479059746925
sim_physics_mean	0.03942882237597446
sim_physics_median	0.04103133370799403
sim_physics_min	0.028603434562683105
sim_render-ego_max	0.06133073441525723
sim_render-ego_mean	0.05597362332071651
sim_render-ego_median	0.057657034166397586
sim_render-ego_min	0.045886489061208874
simulation-passed	1
survival_time_max	4.699999999999991
survival_time_mean	3.2199999999999966
survival_time_min	2.549999999999999

No reset possible

19611

2424

Andrea Censi 🇨🇭

random_agent

aido2-LFVI-sim-testing

step1-simulation

host-error

2019-04-24 15:57:55+00:00

2019-04-24 16:00:06+00:00

0:02:11

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19611-701944', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19611-701944', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19611-701944', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19607

2432

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-24 15:57:05+00:00

2019-04-24 15:57:36+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19604

2437

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-24 15:55:24+00:00

2019-04-24 15:56:17+00:00

0:00:53

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19567

2475

Liam Paull 🇨🇦

challenge-aido_LF-template-random

aido2-LFVI-sim-testing

step1-simulation

success

2019-04-24 15:46:36+00:00

2019-04-24 15:54:40+00:00

0:08:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9585846921942625
survival_time_median	3.099999999999997
deviation-center-line_median	0.13094298490844536
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.14087939262390137
agent_compute-ego_mean	0.13337525293445385
agent_compute-ego_median	0.1336901803170481
agent_compute-ego_min	0.12888488870985965
deviation-center-line_max	0.1934674474960452
deviation-center-line_mean	0.10884100878338444
deviation-center-line_min	0.032459786530846635
deviation-heading_max	0.7356226190209126
deviation-heading_mean	0.3809403978290703
deviation-heading_median	0.2855944786164235
deviation-heading_min	0.22149655353610215
driven_any_max	2.029872313755146
driven_any_mean	1.3151025945779695
driven_any_median	1.2614050434743518
driven_any_min	1.0057903566516673
driven_lanedir_consec_max	1.454438818080216
driven_lanedir_consec_mean	1.0334629747873598
driven_lanedir_consec_min	0.6769768591939229
driven_lanedir_max	1.4545895120774182
driven_lanedir_mean	1.0334931135868004
driven_lanedir_median	0.9585846921942625
driven_lanedir_min	0.6769768591939229
in-drivable-lane_max	1.149999999999996
in-drivable-lane_mean	0.539999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03783386094229562, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.04949480011349633, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.13388036924695212, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07626647419399685, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03073920143975152, "sim_compute_performance-ego": 0.053998421108911905, "sim_compute_robot_state-ego": 0.0570342843494718, "sim_compute_robot_state-npc0": 0.05681780406406948, "sim_compute_robot_state-npc1": 0.05623485928490048, "sim_compute_robot_state-npc2": 0.05354446456545875, "sim_compute_robot_state-npc3": 0.05330830528622582}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.040430606580248066, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.054555724648868334, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.14087939262390137, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.08328850129071404, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.038973574544869216, "sim_compute_performance-ego": 0.05801007794398887, "sim_compute_robot_state-ego": 0.06056381206886441, "sim_compute_robot_state-npc0": 0.06023237751979454, "sim_compute_robot_state-npc1": 0.060842219521017635, "sim_compute_robot_state-npc2": 0.06143484396093032, "sim_compute_robot_state-npc3": 0.06151140437406652}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.039555503476050594, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.054978797512669715, "in-drivable-lane": 0, "agent_compute-ego": 0.1336901803170481, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.0850210843547698, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03351182706894413, "sim_compute_performance-ego": 0.058152787147029754, "sim_compute_robot_state-ego": 0.06407827331173804, "sim_compute_robot_state-npc0": 0.06181506956777265, "sim_compute_robot_state-npc1": 0.059243652128404184, "sim_compute_robot_state-npc2": 0.059393152113883727, "sim_compute_robot_state-npc3": 0.06142737403992684}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.03915004780951967, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.05393536040123473, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.12888488870985965, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.08180185835412208, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.032749409371234, "sim_compute_performance-ego": 0.05968437803552506, "sim_compute_robot_state-ego": 0.06329126053668083, "sim_compute_robot_state-npc0": 0.0585226150269204, "sim_compute_robot_state-npc1": 0.05889330265369821, "sim_compute_robot_state-npc2": 0.05833950448543467, "sim_compute_robot_state-npc3": 0.05837541438163595}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.034989421184246354, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.053863465785980225, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.12954143377450797, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.08078605395097, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.033143226916973405, "sim_compute_performance-ego": 0.0600663790336022, "sim_compute_robot_state-ego": 0.0597308507332435, "sim_compute_robot_state-npc0": 0.053854603033799395, "sim_compute_robot_state-npc1": 0.0552831429701585, "sim_compute_robot_state-npc2": 0.05835962754029494, "sim_compute_robot_state-npc3": 0.05570406638658964}}
set_robot_commands_max	0.0850210843547698
set_robot_commands_mean	0.08143279442891455
set_robot_commands_median	0.08180185835412208
set_robot_commands_min	0.07626647419399685
sim_compute_performance-ego_max	0.0600663790336022
sim_compute_performance-ego_mean	0.05798240865381156
sim_compute_performance-ego_median	0.058152787147029754
sim_compute_performance-ego_min	0.053998421108911905
sim_compute_robot_state-ego_max	0.06407827331173804
sim_compute_robot_state-ego_mean	0.06093969619999971
sim_compute_robot_state-ego_median	0.06056381206886441
sim_compute_robot_state-ego_min	0.0570342843494718
sim_compute_robot_state-npc0_max	0.06181506956777265
sim_compute_robot_state-npc0_mean	0.05824849384247129
sim_compute_robot_state-npc0_median	0.0585226150269204
sim_compute_robot_state-npc0_min	0.053854603033799395
sim_compute_robot_state-npc1_max	0.060842219521017635
sim_compute_robot_state-npc1_mean	0.058099435311635805
sim_compute_robot_state-npc1_median	0.05889330265369821
sim_compute_robot_state-npc1_min	0.0552831429701585
sim_compute_robot_state-npc2_max	0.06143484396093032
sim_compute_robot_state-npc2_mean	0.058214318533200485
sim_compute_robot_state-npc2_median	0.05835962754029494
sim_compute_robot_state-npc2_min	0.05354446456545875
sim_compute_robot_state-npc3_max	0.06151140437406652
sim_compute_robot_state-npc3_mean	0.05806531289368896
sim_compute_robot_state-npc3_median	0.05837541438163595
sim_compute_robot_state-npc3_min	0.05330830528622582
sim_compute_sim_state_max	0.038973574544869216
sim_compute_sim_state_mean	0.03382344786835446
sim_compute_sim_state_median	0.033143226916973405
sim_compute_sim_state_min	0.03073920143975152
sim_physics_max	0.040430606580248066
sim_physics_mean	0.03839188799847206
sim_physics_median	0.03915004780951967
sim_physics_min	0.034989421184246354
sim_render-ego_max	0.054978797512669715
sim_render-ego_mean	0.053365629692449866
sim_render-ego_median	0.05393536040123473
sim_render-ego_min	0.04949480011349633
simulation-passed	1
survival_time_max	4.699999999999991
survival_time_mean	3.2199999999999966
survival_time_min	2.549999999999999

No reset possible

19555

2509

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-24 15:45:15+00:00

2019-04-24 15:46:23+00:00

0:01:08

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19541

2525

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-24 15:43:18+00:00

2019-04-24 15:44:39+00:00

0:01:21

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19533

2538

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-24 15:40:50+00:00

2019-04-24 15:42:59+00:00

0:02:09

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19518

2561

Alexander Karavaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-24 15:34:57+00:00

2019-04-24 15:39:57+00:00

0:05:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487126868955534
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041377901227004
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.06510120171767014
agent_compute-ego_mean	0.061338745501769695
agent_compute-ego_median	0.06136065848330234
agent_compute-ego_min	0.0559544563293457
deviation-center-line_max	0.12791029264553877
deviation-center-line_mean	0.10518143804729678
deviation-center-line_min	0.06917252689874298
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550056
deviation-heading_median	0.3636820162885191
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903463
driven_any_median	0.6642785413158997
driven_any_min	0.3059207793076624
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.5880385612453785
driven_lanedir_consec_min	0.2802213062291129
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.5880385612453785
driven_lanedir_median	0.5487126868955534
driven_lanedir_min	0.2802213062291129
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.023917579069370178, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05308648144326559, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06099039752308915, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.081967269502035, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03365798985085836, "sim_compute_performance-ego": 0.06020573290382943, "sim_compute_robot_state-ego": 0.061217057995679905}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.02058246502509484, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.05473011273604173, "in-drivable-lane": 0, "agent_compute-ego": 0.06510120171767014, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.08909782996544471, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.03480445421659029, "sim_compute_performance-ego": 0.0603260535460252, "sim_compute_robot_state-ego": 0.06415878809415378}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.019972060589080163, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.056198089680773146, "in-drivable-lane": 0, "agent_compute-ego": 0.06136065848330234, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.08385641016858689, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.032274438979777886, "sim_compute_performance-ego": 0.05939743873920846, "sim_compute_robot_state-ego": 0.060312225463542535}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.021410797978495506, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.048078293328756815, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0559544563293457, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.08077922758165297, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.029114170388861015, "sim_compute_performance-ego": 0.05112909222697164, "sim_compute_robot_state-ego": 0.05634666537190531}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.02158808708190918, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.053636256017183005, "in-drivable-lane": 0, "agent_compute-ego": 0.06328701345544112, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.08682279210341604, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.0362683095430073, "sim_compute_performance-ego": 0.0586078919862446, "sim_compute_robot_state-ego": 0.06325472028631914}}
set_robot_commands_max	0.08909782996544471
set_robot_commands_mean	0.08450470586422712
set_robot_commands_median	0.08385641016858689
set_robot_commands_min	0.08077922758165297
sim_compute_performance-ego_max	0.0603260535460252
sim_compute_performance-ego_mean	0.057933241880455864
sim_compute_performance-ego_median	0.05939743873920846
sim_compute_performance-ego_min	0.05112909222697164
sim_compute_robot_state-ego_max	0.06415878809415378
sim_compute_robot_state-ego_mean	0.061057891442320135
sim_compute_robot_state-ego_median	0.061217057995679905
sim_compute_robot_state-ego_min	0.05634666537190531
sim_compute_sim_state_max	0.0362683095430073
sim_compute_sim_state_mean	0.03322387259581897
sim_compute_sim_state_median	0.03365798985085836
sim_compute_sim_state_min	0.029114170388861015
sim_physics_max	0.023917579069370178
sim_physics_mean	0.021494197948789973
sim_physics_median	0.021410797978495506
sim_physics_min	0.019972060589080163
sim_render-ego_max	0.056198089680773146
sim_render-ego_mean	0.053145846641204066
sim_render-ego_median	0.053636256017183005
sim_render-ego_min	0.048078293328756815
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

19487

2601

FANG MEIYI 🇸🇬

baseline-IL-logs-tensorflow

step1-simulation

success

aido2-LFV-sim-validation

2019-04-24 15:20:12+00:00

2019-04-24 15:34:31+00:00

0:14:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.3039399231622726
survival_time_median	8.599999999999987
deviation-center-line_median	0.19034683504827893
in-drivable-lane_median	1.7999999999999965

other stats

agent_compute-ego_max	0.1499115662767708
agent_compute-ego_mean	0.14545241695889874
agent_compute-ego_median	0.14342763153790253
agent_compute-ego_min	0.1430304595402309
deviation-center-line_max	0.5795505745162659
deviation-center-line_mean	0.3193925366412146
deviation-center-line_min	0.1570778389038344
deviation-heading_max	1.1900508477598264
deviation-heading_mean	1.0128895196961718
deviation-heading_median	1.064750980222123
deviation-heading_min	0.786468272628002
driven_any_max	1.8546881353223652
driven_any_mean	1.618885853599546
driven_any_median	1.716042771307393
driven_any_min	1.1610469205481548
driven_lanedir_consec_max	1.6791574491030783
driven_lanedir_consec_mean	1.2491964152067403
driven_lanedir_consec_min	0.8041354581721046
driven_lanedir_max	1.6791574491030783
driven_lanedir_mean	1.2491964152067403
driven_lanedir_median	1.3039399231622726
driven_lanedir_min	0.8041354581721046
in-drivable-lane_max	5.450000000000018
in-drivable-lane_mean	1.9000000000000037
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.8546881353223652, "sim_physics": 0.021270912856304, "survival_time": 10.15000000000001, "driven_lanedir": 0.8041354581721046, "sim_render-ego": 0.05673478624503601, "in-drivable-lane": 5.450000000000018, "agent_compute-ego": 0.14342763153790253, "deviation-heading": 1.1900508477598264, "set_robot_commands": 0.08552299814271222, "deviation-center-line": 0.19034683504827893, "driven_lanedir_consec": 0.8041354581721046, "sim_compute_sim_state": 0.035246274741412384, "sim_compute_performance-ego": 0.06090518054116536, "sim_compute_robot_state-ego": 0.0636372495754599}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1610469205481548, "sim_physics": 0.02077631780079433, "survival_time": 6.999999999999983, "driven_lanedir": 1.150480044822772, "sim_render-ego": 0.0534473078591483, "in-drivable-lane": 0, "agent_compute-ego": 0.1430304595402309, "deviation-heading": 0.786468272628002, "set_robot_commands": 0.0846022367477417, "deviation-center-line": 0.5795505745162659, "driven_lanedir_consec": 1.150480044822772, "sim_compute_sim_state": 0.035520449706486296, "sim_compute_performance-ego": 0.059213147844587054, "sim_compute_robot_state-ego": 0.06439889839717321}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.716042771307393, "sim_physics": 0.02282307740580829, "survival_time": 8.649999999999988, "driven_lanedir": 1.6791574491030783, "sim_render-ego": 0.06430155004380066, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.1499115662767708, "deviation-heading": 0.9387765004888776, "set_robot_commands": 0.0909101329097858, "deviation-center-line": 0.5015003732103795, "driven_lanedir_consec": 1.6791574491030783, "sim_compute_sim_state": 0.03580869415591907, "sim_compute_performance-ego": 0.06252350283495953, "sim_compute_robot_state-ego": 0.06478243204899606}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6304840321824192, "sim_physics": 0.022623771574439074, "survival_time": 8.199999999999982, "driven_lanedir": 1.3039399231622726, "sim_render-ego": 0.05738452585732064, "in-drivable-lane": 1.7999999999999965, "agent_compute-ego": 0.14781227053665533, "deviation-heading": 1.064750980222123, "set_robot_commands": 0.08923626527553652, "deviation-center-line": 0.16848706152731407, "driven_lanedir_consec": 1.3039399231622726, "sim_compute_sim_state": 0.03486932050891039, "sim_compute_performance-ego": 0.060802371036715624, "sim_compute_robot_state-ego": 0.06490250186222356}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7321674086373977, "sim_physics": 0.021793659343275915, "survival_time": 8.599999999999987, "driven_lanedir": 1.3082692007734733, "sim_render-ego": 0.05602551892746326, "in-drivable-lane": 2.1000000000000023, "agent_compute-ego": 0.14308015690293424, "deviation-heading": 1.0844009973820306, "set_robot_commands": 0.08550794041434, "deviation-center-line": 0.1570778389038344, "driven_lanedir_consec": 1.3082692007734733, "sim_compute_sim_state": 0.035356348337129105, "sim_compute_performance-ego": 0.061101561368897904, "sim_compute_robot_state-ego": 0.06430315694143605}}
set_robot_commands_max	0.0909101329097858
set_robot_commands_mean	0.08715591469802325
set_robot_commands_median	0.08552299814271222
set_robot_commands_min	0.0846022367477417
sim_compute_performance-ego_max	0.06252350283495953
sim_compute_performance-ego_mean	0.06090915272526509
sim_compute_performance-ego_median	0.06090518054116536
sim_compute_performance-ego_min	0.059213147844587054
sim_compute_robot_state-ego_max	0.06490250186222356
sim_compute_robot_state-ego_mean	0.06440484776505775
sim_compute_robot_state-ego_median	0.06439889839717321
sim_compute_robot_state-ego_min	0.0636372495754599
sim_compute_sim_state_max	0.03580869415591907
sim_compute_sim_state_mean	0.03536021748997145
sim_compute_sim_state_median	0.035356348337129105
sim_compute_sim_state_min	0.03486932050891039
sim_physics_max	0.02282307740580829
sim_physics_mean	0.021857547796124317
sim_physics_median	0.021793659343275915
sim_physics_min	0.02077631780079433
sim_render-ego_max	0.06430155004380066
sim_render-ego_mean	0.05757873778655377
sim_render-ego_median	0.05673478624503601
sim_render-ego_min	0.0534473078591483
simulation-passed	1
survival_time_max	10.15000000000001
survival_time_mean	8.519999999999989
survival_time_min	6.999999999999983

No reset possible

19462

2695

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-24 15:03:15+00:00

2019-04-24 15:20:04+00:00

0:16:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.0583616254790376
survival_time_median	7.299999999999982
deviation-center-line_median	0.6157534729231199
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.08846772206972724
agent_compute-ego_mean	0.08191198314489423
agent_compute-ego_median	0.08585789714540754
agent_compute-ego_min	0.06468557168359626
deviation-center-line_max	0.8712996957796376
deviation-center-line_mean	0.6016458241577922
deviation-center-line_min	0.22233445750703068
deviation-heading_max	2.2029839236108866
deviation-heading_mean	1.4762462682930964
deviation-heading_median	1.4369008134443122
deviation-heading_min	0.8768810059901743
driven_any_max	1.3672780763115755
driven_any_mean	1.0887516636907908
driven_any_median	1.1261963298336348
driven_any_min	0.5372420035695203
driven_lanedir_consec_max	1.3384249530611538
driven_lanedir_consec_mean	1.0211939159045484
driven_lanedir_consec_min	0.4657498929779416
driven_lanedir_max	1.3384249530611538
driven_lanedir_mean	1.0211939159045484
driven_lanedir_median	1.0583616254790376
driven_lanedir_min	0.4657498929779416
in-drivable-lane_max	0.25000000000000355
in-drivable-lane_mean	0.15000000000000036
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5372420035695203, "sim_physics": 0.04741023011403541, "survival_time": 3.649999999999995, "driven_lanedir": 0.4657498929779416, "sim_render-ego": 0.06627821922302246, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.08846772206972724, "deviation-heading": 0.8768810059901743, "set_robot_commands": 0.1075960936611646, "deviation-center-line": 0.22233445750703068, "driven_lanedir_consec": 0.4657498929779416, "sim_compute_sim_state": 0.04180099866161608, "sim_compute_performance-ego": 0.0743848787595148, "sim_compute_robot_state-ego": 0.07650326376091944, "sim_compute_robot_state-npc0": 0.0726519088222556, "sim_compute_robot_state-npc1": 0.07510278322925307, "sim_compute_robot_state-npc2": 0.07762129992654879, "sim_compute_robot_state-npc3": 0.07600064800210195}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3672780763115755, "sim_physics": 0.04525286230173978, "survival_time": 8.79999999999999, "driven_lanedir": 1.3384249530611538, "sim_render-ego": 0.06630997901613062, "in-drivable-lane": 0, "agent_compute-ego": 0.08316265452991832, "deviation-heading": 1.539064382284434, "set_robot_commands": 0.10719046673991464, "deviation-center-line": 0.8712996957796376, "driven_lanedir_consec": 1.3384249530611538, "sim_compute_sim_state": 0.04185269502076236, "sim_compute_performance-ego": 0.07334642789580605, "sim_compute_robot_state-ego": 0.0784475789828734, "sim_compute_robot_state-npc0": 0.07426694170995192, "sim_compute_robot_state-npc1": 0.07580332593484358, "sim_compute_robot_state-npc2": 0.07459900866855275, "sim_compute_robot_state-npc3": 0.07508730346506293}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3350554532794052, "sim_physics": 0.04309062625086585, "survival_time": 8.599999999999987, "driven_lanedir": 1.2033605686007125, "sim_render-ego": 0.06821523987969687, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.0873860702958218, "deviation-heading": 2.2029839236108866, "set_robot_commands": 0.1076035596603571, "deviation-center-line": 0.7020152709971648, "driven_lanedir_consec": 1.2033605686007125, "sim_compute_sim_state": 0.04321820098300313, "sim_compute_performance-ego": 0.07302850623463475, "sim_compute_robot_state-ego": 0.07974326194718827, "sim_compute_robot_state-npc0": 0.07441394412240317, "sim_compute_robot_state-npc1": 0.07580564604249111, "sim_compute_robot_state-npc2": 0.07664154158082119, "sim_compute_robot_state-npc3": 0.07854046100793882}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0779864554598182, "sim_physics": 0.04868600198200771, "survival_time": 6.999999999999983, "driven_lanedir": 1.0400725394038974, "sim_render-ego": 0.06877487216676985, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.08585789714540754, "deviation-heading": 1.3254012161356752, "set_robot_commands": 0.11093946354729788, "deviation-center-line": 0.6157534729231199, "driven_lanedir_consec": 1.0400725394038974, "sim_compute_sim_state": 0.04208224160330636, "sim_compute_performance-ego": 0.07520885637828283, "sim_compute_robot_state-ego": 0.08402666194098336, "sim_compute_robot_state-npc0": 0.07637404033115931, "sim_compute_robot_state-npc1": 0.07537741661071777, "sim_compute_robot_state-npc2": 0.07764278990881783, "sim_compute_robot_state-npc3": 0.07559443541935512}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1261963298336348, "sim_physics": 0.029334009510197052, "survival_time": 7.299999999999982, "driven_lanedir": 1.0583616254790376, "sim_render-ego": 0.05226011472205593, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.06468557168359626, "deviation-heading": 1.4369008134443122, "set_robot_commands": 0.08154157253160868, "deviation-center-line": 0.5968262235820079, "driven_lanedir_consec": 1.0583616254790376, "sim_compute_sim_state": 0.029526341451357487, "sim_compute_performance-ego": 0.05374608137836195, "sim_compute_robot_state-ego": 0.05691437851892759, "sim_compute_robot_state-npc0": 0.053990205673322286, "sim_compute_robot_state-npc1": 0.0542932389533683, "sim_compute_robot_state-npc2": 0.0542598064631632, "sim_compute_robot_state-npc3": 0.05427658884492639}}
set_robot_commands_max	0.11093946354729788
set_robot_commands_mean	0.10297423122806856
set_robot_commands_median	0.1075960936611646
set_robot_commands_min	0.08154157253160868
sim_compute_performance-ego_max	0.07520885637828283
sim_compute_performance-ego_mean	0.06994295012932009
sim_compute_performance-ego_median	0.07334642789580605
sim_compute_performance-ego_min	0.05374608137836195
sim_compute_robot_state-ego_max	0.08402666194098336
sim_compute_robot_state-ego_mean	0.07512702903017841
sim_compute_robot_state-ego_median	0.0784475789828734
sim_compute_robot_state-ego_min	0.05691437851892759
sim_compute_robot_state-npc0_max	0.07637404033115931
sim_compute_robot_state-npc0_mean	0.07033940813181846
sim_compute_robot_state-npc0_median	0.07426694170995192
sim_compute_robot_state-npc0_min	0.053990205673322286
sim_compute_robot_state-npc1_max	0.07580564604249111
sim_compute_robot_state-npc1_mean	0.07127648215413476
sim_compute_robot_state-npc1_median	0.07537741661071777
sim_compute_robot_state-npc1_min	0.0542932389533683
sim_compute_robot_state-npc2_max	0.07764278990881783
sim_compute_robot_state-npc2_mean	0.07215288930958076
sim_compute_robot_state-npc2_median	0.07664154158082119
sim_compute_robot_state-npc2_min	0.0542598064631632
sim_compute_robot_state-npc3_max	0.07854046100793882
sim_compute_robot_state-npc3_mean	0.07189988734787704
sim_compute_robot_state-npc3_median	0.07559443541935512
sim_compute_robot_state-npc3_min	0.05427658884492639
sim_compute_sim_state_max	0.04321820098300313
sim_compute_sim_state_mean	0.03969609554400909
sim_compute_sim_state_median	0.04185269502076236
sim_compute_sim_state_min	0.029526341451357487
sim_physics_max	0.04868600198200771
sim_physics_mean	0.04275474603176916
sim_physics_median	0.04525286230173978
sim_physics_min	0.029334009510197052
sim_render-ego_max	0.06877487216676985
sim_render-ego_mean	0.06436768500153514
sim_render-ego_median	0.06630997901613062
sim_render-ego_min	0.05226011472205593
simulation-passed	1
survival_time_max	8.79999999999999
survival_time_mean	7.069999999999988
survival_time_min	3.649999999999995

No reset possible

19450

2641

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-24 15:00:14+00:00

2019-04-24 15:01:21+00:00

0:01:07

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 88, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 88, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19425

2680

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-24 14:47:49+00:00

2019-04-24 15:00:07+00:00

0:12:18

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19425-641583', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19425-641583', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19425-641583', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19409

2704

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-24 14:29:41+00:00

2019-04-24 14:47:34+00:00

0:17:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.3916560326708218
survival_time_median	11.450000000000028
deviation-center-line_median	0.9786395062697943
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.09102296725110716
agent_compute-ego_mean	0.0872866500821018
agent_compute-ego_median	0.08568380753199259
agent_compute-ego_min	0.0836976594145193
deviation-center-line_max	1.285681212027481
deviation-center-line_mean	0.9224365660463728
deviation-center-line_min	0.6480375800526952
deviation-heading_max	8.42586856100089
deviation-heading_mean	3.808687108802237
deviation-heading_median	2.386717574953422
deviation-heading_min	1.594601774971226
driven_any_max	2.3555268513526184
driven_any_mean	1.834252149142466
driven_any_median	1.7931489119723854
driven_any_min	1.2198845444560846
driven_lanedir_consec_max	1.7350265587284066
driven_lanedir_consec_mean	1.314722524735161
driven_lanedir_consec_min	0.75594488102813
driven_lanedir_max	1.7350265587284066
driven_lanedir_mean	1.4997103838814527
driven_lanedir_median	1.5339961257185153
driven_lanedir_min	1.1741861587644913
in-drivable-lane_max	3.100000000000044
in-drivable-lane_mean	0.9600000000000104
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2198845444560846, "sim_physics": 0.026126860072777702, "survival_time": 7.94999999999998, "driven_lanedir": 1.1741861587644913, "sim_render-ego": 0.06559512000413811, "in-drivable-lane": 0, "agent_compute-ego": 0.0836976594145193, "deviation-heading": 1.594601774971226, "set_robot_commands": 0.10518172851898386, "deviation-center-line": 0.6480375800526952, "driven_lanedir_consec": 1.1741861587644913, "sim_compute_sim_state": 0.04096631733876354, "sim_compute_performance-ego": 0.0708068181883614, "sim_compute_robot_state-ego": 0.07412477859161185}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3555268513526184, "sim_physics": 0.027136884530385336, "survival_time": 14.950000000000076, "driven_lanedir": 1.6636870435250284, "sim_render-ego": 0.06300053517023722, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.08568380753199259, "deviation-heading": 4.553135761967127, "set_robot_commands": 0.10177645524342854, "deviation-center-line": 0.980973817383081, "driven_lanedir_consec": 1.516798992483955, "sim_compute_sim_state": 0.03959394613901774, "sim_compute_performance-ego": 0.07098257859547932, "sim_compute_robot_state-ego": 0.07468679666519165}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3551047990962166, "sim_physics": 0.027135342756907144, "survival_time": 14.950000000000076, "driven_lanedir": 1.5339961257185153, "sim_render-ego": 0.06719446659088135, "in-drivable-lane": 1.7000000000000075, "agent_compute-ego": 0.09089796702067056, "deviation-heading": 8.42586856100089, "set_robot_commands": 0.11177817265192667, "deviation-center-line": 1.285681212027481, "driven_lanedir_consec": 0.75594488102813, "sim_compute_sim_state": 0.0428874945640564, "sim_compute_performance-ego": 0.07426035404205322, "sim_compute_robot_state-ego": 0.07986787954966228}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7931489119723854, "sim_physics": 0.0283238617093282, "survival_time": 11.450000000000028, "driven_lanedir": 1.7350265587284066, "sim_render-ego": 0.06900059604228324, "in-drivable-lane": 0, "agent_compute-ego": 0.09102296725110716, "deviation-heading": 2.386717574953422, "set_robot_commands": 0.11248457067398004, "deviation-center-line": 0.9786395062697943, "driven_lanedir_consec": 1.7350265587284066, "sim_compute_sim_state": 0.04199287776863731, "sim_compute_performance-ego": 0.07554131199699302, "sim_compute_robot_state-ego": 0.07953430159123183}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4475956388350255, "sim_physics": 0.027894689190772273, "survival_time": 9.299999999999995, "driven_lanedir": 1.3916560326708218, "sim_render-ego": 0.06465683701217816, "in-drivable-lane": 0, "agent_compute-ego": 0.0851308491922194, "deviation-heading": 2.0831118711185175, "set_robot_commands": 0.10339399307004866, "deviation-center-line": 0.7188507144988119, "driven_lanedir_consec": 1.3916560326708218, "sim_compute_sim_state": 0.04141116783183108, "sim_compute_performance-ego": 0.07067141609807168, "sim_compute_robot_state-ego": 0.07374723111429522}}
set_robot_commands_max	0.11248457067398004
set_robot_commands_mean	0.10692298403167357
set_robot_commands_median	0.10518172851898386
set_robot_commands_min	0.10177645524342854
sim_compute_performance-ego_max	0.07554131199699302
sim_compute_performance-ego_mean	0.07245249578419173
sim_compute_performance-ego_median	0.07098257859547932
sim_compute_performance-ego_min	0.07067141609807168
sim_compute_robot_state-ego_max	0.07986787954966228
sim_compute_robot_state-ego_mean	0.07639219750239856
sim_compute_robot_state-ego_median	0.07468679666519165
sim_compute_robot_state-ego_min	0.07374723111429522
sim_compute_sim_state_max	0.0428874945640564
sim_compute_sim_state_mean	0.04137036072846122
sim_compute_sim_state_median	0.04141116783183108
sim_compute_sim_state_min	0.03959394613901774
sim_physics_max	0.0283238617093282
sim_physics_mean	0.02732352765203413
sim_physics_median	0.027136884530385336
sim_physics_min	0.026126860072777702
sim_render-ego_max	0.06900059604228324
sim_render-ego_mean	0.06588951096394362
sim_render-ego_median	0.06559512000413811
sim_render-ego_min	0.06300053517023722
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.720000000000033
survival_time_min	7.94999999999998

No reset possible

19404

2715

jiang peng

test for ppo

step1-simulation

error

2019-04-24 14:28:53+00:00

2019-04-24 14:29:28+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19395

2727

jiang peng

test for ppo

step1-simulation

error

2019-04-24 14:26:38+00:00

2019-04-24 14:28:46+00:00

0:02:08

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 261, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 136, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 301, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 261, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19377

2770

Bhairav Mehta

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-24 14:14:21+00:00

2019-04-24 14:26:17+00:00

0:11:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.938104680941076
survival_time_median	6.199999999999986
deviation-center-line_median	0.5720235353352882
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.09607901954650878
agent_compute-ego_mean	0.09184104489391132
agent_compute-ego_median	0.0935843510202842
agent_compute-ego_min	0.0868970778451037
deviation-center-line_max	0.5978884227976471
deviation-center-line_mean	0.48697364282672984
deviation-center-line_min	0.2545281689206338
deviation-heading_max	2.2171878270604064
deviation-heading_mean	1.0361532154712232
deviation-heading_median	0.791947132368376
deviation-heading_min	0.6214622969325577
driven_any_max	0.9654998675195892
driven_any_mean	0.8251864854237253
driven_any_median	0.9494319231064836
driven_any_min	0.4890432021012295
driven_lanedir_consec_max	0.9516756049848047
driven_lanedir_consec_mean	0.7299511505037064
driven_lanedir_consec_min	0.3375582057283928
driven_lanedir_max	0.9516756049848047
driven_lanedir_mean	0.7770827756345672
driven_lanedir_median	0.938104680941076
driven_lanedir_min	0.4778889546313691
in-drivable-lane_max	0.3500000000000003
in-drivable-lane_mean	0.07000000000000006
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4890432021012295, "sim_physics": 0.03527246304412386, "survival_time": 3.349999999999996, "driven_lanedir": 0.4778889546313691, "sim_render-ego": 0.061869197816991094, "in-drivable-lane": 0, "agent_compute-ego": 0.0868970778451037, "deviation-heading": 0.6214622969325577, "set_robot_commands": 0.08715843086812033, "deviation-center-line": 0.2545281689206338, "driven_lanedir_consec": 0.4778889546313691, "sim_compute_sim_state": 0.032180131371341535, "sim_compute_performance-ego": 0.057940383455646574, "sim_compute_robot_state-ego": 0.05984631581092948, "sim_compute_robot_state-npc0": 0.05939283299801955, "sim_compute_robot_state-npc1": 0.056771570177220586, "sim_compute_robot_state-npc2": 0.058862486881996266, "sim_compute_robot_state-npc3": 0.06007272449891959}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7644899012813723, "sim_physics": 0.041288909345570175, "survival_time": 5.04999999999999, "driven_lanedir": 0.573216331382697, "sim_render-ego": 0.06295672265609892, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.0935843510202842, "deviation-heading": 2.2171878270604064, "set_robot_commands": 0.09661380371244828, "deviation-center-line": 0.4315403291746121, "driven_lanedir_consec": 0.3375582057283928, "sim_compute_sim_state": 0.036842145542107005, "sim_compute_performance-ego": 0.0675538436020955, "sim_compute_robot_state-ego": 0.07259290997344668, "sim_compute_robot_state-npc0": 0.07099343526481401, "sim_compute_robot_state-npc1": 0.06762697673079991, "sim_compute_robot_state-npc2": 0.06804593954936113, "sim_compute_robot_state-npc3": 0.06795787339163299}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9654998675195892, "sim_physics": 0.03864987312801301, "survival_time": 6.299999999999986, "driven_lanedir": 0.9516756049848047, "sim_render-ego": 0.05773998252929203, "in-drivable-lane": 0, "agent_compute-ego": 0.08749250949375213, "deviation-heading": 0.8656139768353303, "set_robot_commands": 0.09105506397428968, "deviation-center-line": 0.5720235353352882, "driven_lanedir_consec": 0.9516756049848047, "sim_compute_sim_state": 0.03723724683125814, "sim_compute_performance-ego": 0.06275760181366451, "sim_compute_robot_state-ego": 0.06705997860620892, "sim_compute_robot_state-npc0": 0.06530357353271, "sim_compute_robot_state-npc1": 0.06567154044196719, "sim_compute_robot_state-npc2": 0.0649944960124909, "sim_compute_robot_state-npc3": 0.0634437950830611}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9574675331099518, "sim_physics": 0.040899913787841795, "survival_time": 6.249999999999986, "driven_lanedir": 0.9445283062328892, "sim_render-ego": 0.06352255249023438, "in-drivable-lane": 0, "agent_compute-ego": 0.09607901954650878, "deviation-heading": 0.791947132368376, "set_robot_commands": 0.09919145774841308, "deviation-center-line": 0.5978884227976471, "driven_lanedir_consec": 0.9445283062328892, "sim_compute_sim_state": 0.038026975631713866, "sim_compute_performance-ego": 0.06860174751281738, "sim_compute_robot_state-ego": 0.07341622924804687, "sim_compute_robot_state-npc0": 0.06629364395141601, "sim_compute_robot_state-npc1": 0.07047330856323242, "sim_compute_robot_state-npc2": 0.06826805114746094, "sim_compute_robot_state-npc3": 0.07530437278747558}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9494319231064836, "sim_physics": 0.034684356181852276, "survival_time": 6.199999999999986, "driven_lanedir": 0.938104680941076, "sim_render-ego": 0.0556236159416937, "in-drivable-lane": 0, "agent_compute-ego": 0.09515226656390777, "deviation-heading": 0.6845548441594461, "set_robot_commands": 0.08589878005366172, "deviation-center-line": 0.5788877579054684, "driven_lanedir_consec": 0.938104680941076, "sim_compute_sim_state": 0.03521264753034038, "sim_compute_performance-ego": 0.06143591673143448, "sim_compute_robot_state-ego": 0.06513759205418249, "sim_compute_robot_state-npc0": 0.06209454805620255, "sim_compute_robot_state-npc1": 0.0629739434488358, "sim_compute_robot_state-npc2": 0.06295808284513411, "sim_compute_robot_state-npc3": 0.064009879865954}}
set_robot_commands_max	0.09919145774841308
set_robot_commands_mean	0.09198350727138664
set_robot_commands_median	0.09105506397428968
set_robot_commands_min	0.08589878005366172
sim_compute_performance-ego_max	0.06860174751281738
sim_compute_performance-ego_mean	0.06365789862313169
sim_compute_performance-ego_median	0.06275760181366451
sim_compute_performance-ego_min	0.057940383455646574
sim_compute_robot_state-ego_max	0.07341622924804687
sim_compute_robot_state-ego_mean	0.0676106051385629
sim_compute_robot_state-ego_median	0.06705997860620892
sim_compute_robot_state-ego_min	0.05984631581092948
sim_compute_robot_state-npc0_max	0.07099343526481401
sim_compute_robot_state-npc0_mean	0.06481560676063243
sim_compute_robot_state-npc0_median	0.06530357353271
sim_compute_robot_state-npc0_min	0.05939283299801955
sim_compute_robot_state-npc1_max	0.07047330856323242
sim_compute_robot_state-npc1_mean	0.06470346787241117
sim_compute_robot_state-npc1_median	0.06567154044196719
sim_compute_robot_state-npc1_min	0.056771570177220586
sim_compute_robot_state-npc2_max	0.06826805114746094
sim_compute_robot_state-npc2_mean	0.06462581128728866
sim_compute_robot_state-npc2_median	0.0649944960124909
sim_compute_robot_state-npc2_min	0.058862486881996266
sim_compute_robot_state-npc3_max	0.07530437278747558
sim_compute_robot_state-npc3_mean	0.06615772912540865
sim_compute_robot_state-npc3_median	0.064009879865954
sim_compute_robot_state-npc3_min	0.06007272449891959
sim_compute_sim_state_max	0.038026975631713866
sim_compute_sim_state_mean	0.03589982938135219
sim_compute_sim_state_median	0.036842145542107005
sim_compute_sim_state_min	0.032180131371341535
sim_physics_max	0.041288909345570175
sim_physics_mean	0.038159103097480225
sim_physics_median	0.03864987312801301
sim_physics_min	0.034684356181852276
sim_render-ego_max	0.06352255249023438
sim_render-ego_mean	0.060342414286862024
sim_render-ego_median	0.061869197816991094
sim_render-ego_min	0.0556236159416937
simulation-passed	1
survival_time_max	6.299999999999986
survival_time_mean	5.429999999999988
survival_time_min	3.349999999999996

No reset possible

19343

2813

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

2019-04-24 14:01:57+00:00

2019-04-24 14:13:33+00:00

0:11:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9585846921942625
survival_time_median	3.099999999999997
deviation-center-line_median	0.13094298490844536
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.19114837949238123
agent_compute-ego_mean	0.16101912608133634
agent_compute-ego_median	0.15448377682612494
agent_compute-ego_min	0.14309400954145066
deviation-center-line_max	0.1934674474960452
deviation-center-line_mean	0.10884100878338444
deviation-center-line_min	0.032459786530846635
deviation-heading_max	0.7356226190209126
deviation-heading_mean	0.3809403978290703
deviation-heading_median	0.2855944786164235
deviation-heading_min	0.22149655353610215
driven_any_max	2.029872313755146
driven_any_mean	1.3151025945779695
driven_any_median	1.2614050434743518
driven_any_min	1.0057903566516673
driven_lanedir_consec_max	1.454438818080216
driven_lanedir_consec_mean	1.0334629747873598
driven_lanedir_consec_min	0.6769768591939229
driven_lanedir_max	1.4545895120774182
driven_lanedir_mean	1.0334931135868004
driven_lanedir_median	0.9585846921942625
driven_lanedir_min	0.6769768591939229
in-drivable-lane_max	1.149999999999996
in-drivable-lane_mean	0.539999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.04665149961199079, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.059919871981181795, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.19114837949238123, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.11354508475651816, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.0372845104762486, "sim_compute_performance-ego": 0.06662279083615258, "sim_compute_robot_state-ego": 0.06583469633072142, "sim_compute_robot_state-npc0": 0.06672251035296728, "sim_compute_robot_state-npc1": 0.06424467525784931, "sim_compute_robot_state-npc2": 0.06860069623069158, "sim_compute_robot_state-npc3": 0.06869819429185656}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.04150645405638451, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.05544222569933124, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.1544341620276956, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.0882102835412119, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.039979831845152615, "sim_compute_performance-ego": 0.059705523883595187, "sim_compute_robot_state-ego": 0.06674305130453671, "sim_compute_robot_state-npc0": 0.060874256433225145, "sim_compute_robot_state-npc1": 0.06493848445368748, "sim_compute_robot_state-npc2": 0.06419804049473182, "sim_compute_robot_state-npc3": 0.06446485425911698}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.0465392489587107, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.06437010534348027, "in-drivable-lane": 0, "agent_compute-ego": 0.16193530251902918, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.09695136162542528, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.0382906275410806, "sim_compute_performance-ego": 0.06872713950372511, "sim_compute_robot_state-ego": 0.07596935379889704, "sim_compute_robot_state-npc0": 0.06773806771924419, "sim_compute_robot_state-npc1": 0.0705328526035432, "sim_compute_robot_state-npc2": 0.06757276673470775, "sim_compute_robot_state-npc3": 0.06889665511346632}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.04530879030836389, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.05863763930949759, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.14309400954145066, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.09142845488609153, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03855228170435479, "sim_compute_performance-ego": 0.060596859201471856, "sim_compute_robot_state-ego": 0.06710047163861863, "sim_compute_robot_state-npc0": 0.06785089918907652, "sim_compute_robot_state-npc1": 0.06763318751720672, "sim_compute_robot_state-npc2": 0.06683947684917044, "sim_compute_robot_state-npc3": 0.06726719470734292}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.04166931372422438, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.06095153093338013, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.15448377682612494, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.09752259804652288, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03834572663673988, "sim_compute_performance-ego": 0.06625253420609695, "sim_compute_robot_state-ego": 0.06894274399830745, "sim_compute_robot_state-npc0": 0.06531449006153987, "sim_compute_robot_state-npc1": 0.06487460778309749, "sim_compute_robot_state-npc2": 0.06760270778949444, "sim_compute_robot_state-npc3": 0.06922097848011897}}
set_robot_commands_max	0.11354508475651816
set_robot_commands_mean	0.09753155657115396
set_robot_commands_median	0.09695136162542528
set_robot_commands_min	0.0882102835412119
sim_compute_performance-ego_max	0.06872713950372511
sim_compute_performance-ego_mean	0.06438096952620834
sim_compute_performance-ego_median	0.06625253420609695
sim_compute_performance-ego_min	0.059705523883595187
sim_compute_robot_state-ego_max	0.07596935379889704
sim_compute_robot_state-ego_mean	0.06891806341421625
sim_compute_robot_state-ego_median	0.06710047163861863
sim_compute_robot_state-ego_min	0.06583469633072142
sim_compute_robot_state-npc0_max	0.06785089918907652
sim_compute_robot_state-npc0_mean	0.0657000447512106
sim_compute_robot_state-npc0_median	0.06672251035296728
sim_compute_robot_state-npc0_min	0.060874256433225145
sim_compute_robot_state-npc1_max	0.0705328526035432
sim_compute_robot_state-npc1_mean	0.06644476152307685
sim_compute_robot_state-npc1_median	0.06493848445368748
sim_compute_robot_state-npc1_min	0.06424467525784931
sim_compute_robot_state-npc2_max	0.06860069623069158
sim_compute_robot_state-npc2_mean	0.06696273761975921
sim_compute_robot_state-npc2_median	0.06757276673470775
sim_compute_robot_state-npc2_min	0.06419804049473182
sim_compute_robot_state-npc3_max	0.06922097848011897
sim_compute_robot_state-npc3_mean	0.06770957537038036
sim_compute_robot_state-npc3_median	0.06869819429185656
sim_compute_robot_state-npc3_min	0.06446485425911698
sim_compute_sim_state_max	0.039979831845152615
sim_compute_sim_state_mean	0.038490595640715296
sim_compute_sim_state_median	0.03834572663673988
sim_compute_sim_state_min	0.0372845104762486
sim_physics_max	0.04665149961199079
sim_physics_mean	0.04433506133193486
sim_physics_median	0.04530879030836389
sim_physics_min	0.04150645405638451
sim_render-ego_max	0.06437010534348027
sim_render-ego_mean	0.05986427465337421
sim_render-ego_median	0.059919871981181795
sim_render-ego_min	0.05544222569933124
simulation-passed	1
survival_time_max	4.699999999999991
survival_time_mean	3.2199999999999966
survival_time_min	2.549999999999999

No reset possible

19328

2819

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

host-error

2019-04-24 13:59:39+00:00

2019-04-24 14:00:04+00:00

0:00:25

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19328-866083', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19328-866083', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19328-866083', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19324

2832

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-24 13:59:00+00:00

2019-04-24 13:59:32+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

19279

2661

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-24 13:40:45+00:00

2019-04-24 13:58:29+00:00

0:17:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4683037753367385
survival_time_median	3.649999999999995
deviation-center-line_median	0.23418626973004936
in-drivable-lane_median	0.2499999999999991

other stats

agent_compute-ego_max	0.08277781042334152
agent_compute-ego_mean	0.07702600131025986
agent_compute-ego_median	0.07562927518572127
agent_compute-ego_min	0.07140578667322794
deviation-center-line_max	1.4152790771654613
deviation-center-line_mean	0.5131150842450662
deviation-center-line_min	0.08066613246194752
deviation-heading_max	3.1083169335957983
deviation-heading_mean	1.6854834145115845
deviation-heading_median	0.8856910372976856
deviation-heading_min	0.7127898440371149
driven_any_max	2.3449224271901388
driven_any_mean	1.0516881998193723
driven_any_median	0.5395702926195522
driven_any_min	0.2341792546397756
driven_lanedir_consec_max	2.1767667062060667
driven_lanedir_consec_mean	0.886997123699388
driven_lanedir_consec_min	0.19144652253619743
driven_lanedir_max	2.178596857997305
driven_lanedir_mean	0.8873631540576359
driven_lanedir_median	0.4683037753367385
driven_lanedir_min	0.19144652253619743
in-drivable-lane_max	2.5000000000000355
in-drivable-lane_mean	0.6400000000000082
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.3449224271901388, "sim_physics": 0.03765908082326253, "survival_time": 14.950000000000076, "driven_lanedir": 2.178596857997305, "sim_render-ego": 0.05714633385340373, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.07140578667322794, "deviation-heading": 3.1083169335957983, "set_robot_commands": 0.08968697627385458, "deviation-center-line": 1.4152790771654613, "driven_lanedir_consec": 2.1767667062060667, "sim_compute_sim_state": 0.0362329355875651, "sim_compute_performance-ego": 0.0633474858601888, "sim_compute_robot_state-ego": 0.06571447769800821, "sim_compute_robot_state-npc0": 0.06363943576812744, "sim_compute_robot_state-npc1": 0.06403493801752726, "sim_compute_robot_state-npc2": 0.06530000766118367, "sim_compute_robot_state-npc3": 0.06355050802230836}, "udem1-1-0": {"driven_any": 0.2341792546397756, "sim_physics": 0.03719745363507952, "survival_time": 1.7500000000000009, "driven_lanedir": 0.19144652253619743, "sim_render-ego": 0.057455689566476, "in-drivable-lane": 0, "agent_compute-ego": 0.07562927518572127, "deviation-heading": 0.7142071432287604, "set_robot_commands": 0.09217002051217216, "deviation-center-line": 0.08066613246194752, "driven_lanedir_consec": 0.19144652253619743, "sim_compute_sim_state": 0.03400724955967494, "sim_compute_performance-ego": 0.05748210634504046, "sim_compute_robot_state-ego": 0.06767463002886091, "sim_compute_robot_state-npc0": 0.062019354956490656, "sim_compute_robot_state-npc1": 0.06382100922720772, "sim_compute_robot_state-npc2": 0.06409264973231725, "sim_compute_robot_state-npc3": 0.06110826219831194}, "udem1-2-0": {"driven_any": 0.5395702926195522, "sim_physics": 0.05351744939203132, "survival_time": 3.649999999999995, "driven_lanedir": 0.4683037753367385, "sim_render-ego": 0.06645855511704536, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.08277781042334152, "deviation-heading": 0.8856910372976856, "set_robot_commands": 0.10342766160834324, "deviation-center-line": 0.23418626973004936, "driven_lanedir_consec": 0.4683037753367385, "sim_compute_sim_state": 0.039460498992710896, "sim_compute_performance-ego": 0.07170368873909728, "sim_compute_robot_state-ego": 0.08036364267950188, "sim_compute_robot_state-npc0": 0.07207081089281056, "sim_compute_robot_state-npc1": 0.07401125398400711, "sim_compute_robot_state-npc2": 0.06962562913764013, "sim_compute_robot_state-npc3": 0.07065001252579363}, "udem1-3-0": {"driven_any": 0.3627743162128094, "sim_physics": 0.04550619686351103, "survival_time": 2.549999999999999, "driven_lanedir": 0.3398498466682063, "sim_render-ego": 0.06461056073506673, "in-drivable-lane": 0, "agent_compute-ego": 0.07999134063720703, "deviation-heading": 0.7127898440371149, "set_robot_commands": 0.09932027611078, "deviation-center-line": 0.17292248753580647, "driven_lanedir_consec": 0.3398498466682063, "sim_compute_sim_state": 0.04062828363156786, "sim_compute_performance-ego": 0.06907988529579312, "sim_compute_robot_state-ego": 0.075668405084049, "sim_compute_robot_state-npc0": 0.07015547565385408, "sim_compute_robot_state-npc1": 0.07255758491216921, "sim_compute_robot_state-npc2": 0.07259230987698424, "sim_compute_robot_state-npc3": 0.0711981829474954}, "udem1-4-0": {"driven_any": 1.7769947084345852, "sim_physics": 0.04015857847776707, "survival_time": 11.350000000000026, "driven_lanedir": 1.2586187677497316, "sim_render-ego": 0.05959480659552083, "in-drivable-lane": 2.5000000000000355, "agent_compute-ego": 0.07532579363180152, "deviation-heading": 3.0064121143985636, "set_robot_commands": 0.0942585132195561, "deviation-center-line": 0.6625214543320666, "driven_lanedir_consec": 1.2586187677497316, "sim_compute_sim_state": 0.036996120923416205, "sim_compute_performance-ego": 0.0634980768884331, "sim_compute_robot_state-ego": 0.06604294419813786, "sim_compute_robot_state-npc0": 0.06379806102635052, "sim_compute_robot_state-npc1": 0.06414333839248455, "sim_compute_robot_state-npc2": 0.06394465274222622, "sim_compute_robot_state-npc3": 0.0656265529767007}}
set_robot_commands_max	0.10342766160834324
set_robot_commands_mean	0.0957726895449412
set_robot_commands_median	0.0942585132195561
set_robot_commands_min	0.08968697627385458
sim_compute_performance-ego_max	0.07170368873909728
sim_compute_performance-ego_mean	0.06502224862571056
sim_compute_performance-ego_median	0.0634980768884331
sim_compute_performance-ego_min	0.05748210634504046
sim_compute_robot_state-ego_max	0.08036364267950188
sim_compute_robot_state-ego_mean	0.07109281993771158
sim_compute_robot_state-ego_median	0.06767463002886091
sim_compute_robot_state-ego_min	0.06571447769800821
sim_compute_robot_state-npc0_max	0.07207081089281056
sim_compute_robot_state-npc0_mean	0.06633662765952666
sim_compute_robot_state-npc0_median	0.06379806102635052
sim_compute_robot_state-npc0_min	0.062019354956490656
sim_compute_robot_state-npc1_max	0.07401125398400711
sim_compute_robot_state-npc1_mean	0.06771362490667916
sim_compute_robot_state-npc1_median	0.06414333839248455
sim_compute_robot_state-npc1_min	0.06382100922720772
sim_compute_robot_state-npc2_max	0.07259230987698424
sim_compute_robot_state-npc2_mean	0.0671110498300703
sim_compute_robot_state-npc2_median	0.06530000766118367
sim_compute_robot_state-npc2_min	0.06394465274222622
sim_compute_robot_state-npc3_max	0.0711981829474954
sim_compute_robot_state-npc3_mean	0.066426703734122
sim_compute_robot_state-npc3_median	0.0656265529767007
sim_compute_robot_state-npc3_min	0.06110826219831194
sim_compute_sim_state_max	0.04062828363156786
sim_compute_sim_state_mean	0.037465017738987
sim_compute_sim_state_median	0.036996120923416205
sim_compute_sim_state_min	0.03400724955967494
sim_physics_max	0.05351744939203132
sim_physics_mean	0.0428077518383303
sim_physics_median	0.04015857847776707
sim_physics_min	0.03719745363507952
sim_render-ego_max	0.06645855511704536
sim_render-ego_mean	0.06105318917350253
sim_render-ego_median	0.05959480659552083
sim_render-ego_min	0.05714633385340373
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.85000000000002
survival_time_min	1.7500000000000009

No reset possible

19242

2941

Bhairav Mehta

Baseline solution using reinforcement learning

step1-simulation

error