Evaluator 1295

2019-05-21 20:22:42+00:00

2019-05-21 20:53:06+00:00

0:30:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7436917846674647
survival_time_median	10.20000000000001
deviation-center-line_median	0.6108961392314559
in-drivable-lane_median	1.500000000000021

other stats

agent_compute-ego_max	0.2856087714810915
agent_compute-ego_mean	0.24435379188988887
agent_compute-ego_median	0.2604771832057408
agent_compute-ego_min	0.1975888729095459
deviation-center-line_max	0.862874653800355
deviation-center-line_mean	0.6201168114584636
deviation-center-line_min	0.28153432723095967
deviation-heading_max	2.679654625154717
deviation-heading_mean	1.82739976738431
deviation-heading_median	1.806613752603841
deviation-heading_min	1.1153558271366146
driven_any_max	2.0311957991287444
driven_any_mean	1.4612315366080515
driven_any_median	1.143005642104603
driven_any_min	1.0343436901169003
driven_lanedir_consec_max	2.0042481539297596
driven_lanedir_consec_mean	1.1499590699946054
driven_lanedir_consec_min	0.6116709452809466
driven_lanedir_max	2.0042481539297596
driven_lanedir_mean	1.2570710791460058
driven_lanedir_median	0.884109830183272
driven_lanedir_min	0.6116709452809466
in-drivable-lane_max	3.099999999999989
in-drivable-lane_mean	1.2900000000000031
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.964158055928369, "sim_physics": 0.20575329224268596, "survival_time": 14.950000000000076, "driven_lanedir": 1.9499646942849536, "sim_render-ego": 0.06705616553624472, "in-drivable-lane": 0, "agent_compute-ego": 0.2682187819480896, "deviation-heading": 1.4942231122698246, "set_robot_commands": 0.10788672129313152, "deviation-center-line": 0.862874653800355, "driven_lanedir_consec": 1.6731856309100015, "sim_compute_sim_state": 0.04259851932525635, "sim_compute_performance-ego": 0.07520070155461629, "sim_compute_robot_state-ego": 0.08021342674891153, "sim_compute_robot_state-npc0": 0.07579264799753825, "sim_compute_robot_state-npc1": 0.07626279433568318, "sim_compute_robot_state-npc2": 0.07533884684244792, "sim_compute_robot_state-npc3": 0.07500372807184855}, "udem1-1-0": {"driven_any": 1.0343436901169003, "sim_physics": 0.21519323240352584, "survival_time": 7.89999999999998, "driven_lanedir": 0.6116709452809466, "sim_render-ego": 0.06781719304338286, "in-drivable-lane": 3.099999999999989, "agent_compute-ego": 0.2856087714810915, "deviation-heading": 1.1153558271366146, "set_robot_commands": 0.11029730114755752, "deviation-center-line": 0.28153432723095967, "driven_lanedir_consec": 0.6116709452809466, "sim_compute_sim_state": 0.04287344292749332, "sim_compute_performance-ego": 0.07536611375929433, "sim_compute_robot_state-ego": 0.08311259897449348, "sim_compute_robot_state-npc0": 0.07611137100412876, "sim_compute_robot_state-npc1": 0.07888068428522424, "sim_compute_robot_state-npc2": 0.07632634760458258, "sim_compute_robot_state-npc3": 0.0816686485387102}, "udem1-2-0": {"driven_any": 1.143005642104603, "sim_physics": 0.2091664777483259, "survival_time": 8.74999999999999, "driven_lanedir": 0.8353617720510967, "sim_render-ego": 0.06582516397748675, "in-drivable-lane": 1.850000000000006, "agent_compute-ego": 0.2604771832057408, "deviation-heading": 2.041151519756553, "set_robot_commands": 0.0991169888632638, "deviation-center-line": 0.6108961392314559, "driven_lanedir_consec": 0.7436917846674647, "sim_compute_sim_state": 0.0384398923601423, "sim_compute_performance-ego": 0.07083495821271624, "sim_compute_robot_state-ego": 0.07490050452096121, "sim_compute_robot_state-npc0": 0.069257230758667, "sim_compute_robot_state-npc1": 0.06929330144609724, "sim_compute_robot_state-npc2": 0.06945164271763393, "sim_compute_robot_state-npc3": 0.07180693217686245}, "udem1-3-0": {"driven_any": 1.133454495761642, "sim_physics": 0.1617068227599649, "survival_time": 10.20000000000001, "driven_lanedir": 0.884109830183272, "sim_render-ego": 0.05160948341968013, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.20987534990497664, "deviation-heading": 2.679654625154717, "set_robot_commands": 0.07660871276668474, "deviation-center-line": 0.8064927063392351, "driven_lanedir_consec": 0.7169988351848551, "sim_compute_sim_state": 0.03148683847165575, "sim_compute_performance-ego": 0.05482632739871156, "sim_compute_robot_state-ego": 0.05796708663304647, "sim_compute_robot_state-npc0": 0.057022651036580406, "sim_compute_robot_state-npc1": 0.05568327856998818, "sim_compute_robot_state-npc2": 0.05555941894942639, "sim_compute_robot_state-npc3": 0.05483832312565224}, "udem1-4-0": {"driven_any": 2.0311957991287444, "sim_physics": 0.14934304396311443, "survival_time": 14.950000000000076, "driven_lanedir": 2.0042481539297596, "sim_render-ego": 0.05070494254430135, "in-drivable-lane": 0, "agent_compute-ego": 0.1975888729095459, "deviation-heading": 1.806613752603841, "set_robot_commands": 0.0768399175008138, "deviation-center-line": 0.5387862306903126, "driven_lanedir_consec": 2.0042481539297596, "sim_compute_sim_state": 0.03230927308400472, "sim_compute_performance-ego": 0.05828827222188314, "sim_compute_robot_state-ego": 0.05869991540908814, "sim_compute_robot_state-npc0": 0.056784557501475014, "sim_compute_robot_state-npc1": 0.05592417081197103, "sim_compute_robot_state-npc2": 0.05472004334131877, "sim_compute_robot_state-npc3": 0.05534808953603109}}
set_robot_commands_max	0.11029730114755752
set_robot_commands_mean	0.09414992831429028
set_robot_commands_median	0.0991169888632638
set_robot_commands_min	0.07660871276668474
sim_compute_performance-ego_max	0.07536611375929433
sim_compute_performance-ego_mean	0.06690327462944431
sim_compute_performance-ego_median	0.07083495821271624
sim_compute_performance-ego_min	0.05482632739871156
sim_compute_robot_state-ego_max	0.08311259897449348
sim_compute_robot_state-ego_mean	0.07097870645730017
sim_compute_robot_state-ego_median	0.07490050452096121
sim_compute_robot_state-ego_min	0.05796708663304647
sim_compute_robot_state-npc0_max	0.07611137100412876
sim_compute_robot_state-npc0_mean	0.06699369165967788
sim_compute_robot_state-npc0_median	0.069257230758667
sim_compute_robot_state-npc0_min	0.056784557501475014
sim_compute_robot_state-npc1_max	0.07888068428522424
sim_compute_robot_state-npc1_mean	0.06720884588979278
sim_compute_robot_state-npc1_median	0.06929330144609724
sim_compute_robot_state-npc1_min	0.05568327856998818
sim_compute_robot_state-npc2_max	0.07632634760458258
sim_compute_robot_state-npc2_mean	0.06627925989108191
sim_compute_robot_state-npc2_median	0.06945164271763393
sim_compute_robot_state-npc2_min	0.05472004334131877
sim_compute_robot_state-npc3_max	0.0816686485387102
sim_compute_robot_state-npc3_mean	0.0677331442898209
sim_compute_robot_state-npc3_median	0.07180693217686245
sim_compute_robot_state-npc3_min	0.05483832312565224
sim_compute_sim_state_max	0.04287344292749332
sim_compute_sim_state_mean	0.037541593233710494
sim_compute_sim_state_median	0.0384398923601423
sim_compute_sim_state_min	0.03148683847165575
sim_physics_max	0.21519323240352584
sim_physics_mean	0.1882325738235234
sim_physics_median	0.20575329224268596
sim_physics_min	0.14934304396311443
sim_render-ego_max	0.06781719304338286
sim_render-ego_mean	0.060602589704219154
sim_render-ego_median	0.06582516397748675
sim_render-ego_min	0.05070494254430135
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.350000000000026
survival_time_min	7.89999999999998

No reset possible

23737

3750

sebastian glatz

step1-simulation

success

yes

2019-05-21 20:01:53+00:00

2019-05-21 20:11:01+00:00

0:09:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.18048708779471265
agent_compute-ego_mean	0.16137122595311343
agent_compute-ego_median	0.165758258418033
agent_compute-ego_min	0.1307445764541626
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.12651756552531995
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599273
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811214
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589035
driven_any_mean	1.0272530755098266
driven_any_median	1.0243289631429708
driven_any_min	0.4119037580118998
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.13629923484943532, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.053106343304669415, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1307445764541626, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.07854685076960811, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03319875399271647, "sim_compute_performance-ego": 0.055650794947588886, "sim_compute_robot_state-ego": 0.06115987124266448, "sim_compute_robot_state-npc0": 0.05796388343528465, "sim_compute_robot_state-npc1": 0.05770836494587086, "sim_compute_robot_state-npc2": 0.0552405560458148, "sim_compute_robot_state-npc3": 0.05598726095976653}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.20693071365356444, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06592957496643066, "in-drivable-lane": 0, "agent_compute-ego": 0.16041827201843262, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.10800556182861328, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.04169859886169434, "sim_compute_performance-ego": 0.08042551994323731, "sim_compute_robot_state-ego": 0.0806500244140625, "sim_compute_robot_state-npc0": 0.07306442260742188, "sim_compute_robot_state-npc1": 0.07663902282714843, "sim_compute_robot_state-npc2": 0.07800389289855957, "sim_compute_robot_state-npc3": 0.07485735893249512}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.2037149103064286, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06592684043081183, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.165758258418033, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.10697898111845318, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.04142205652437712, "sim_compute_performance-ego": 0.07357810672960784, "sim_compute_robot_state-ego": 0.08212428971340782, "sim_compute_robot_state-npc0": 0.07372335697475232, "sim_compute_robot_state-npc1": 0.07415810384248432, "sim_compute_robot_state-npc2": 0.0769615518419366, "sim_compute_robot_state-npc3": 0.07394163232100637}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.22660400294050387, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06984503661529927, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.16944793508022646, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.10532959503463551, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04330785063248646, "sim_compute_performance-ego": 0.07778421232971965, "sim_compute_robot_state-ego": 0.08653718912148778, "sim_compute_robot_state-npc0": 0.07777001284345796, "sim_compute_robot_state-npc1": 0.07813474196421949, "sim_compute_robot_state-npc2": 0.07609826401819157, "sim_compute_robot_state-npc3": 0.078370218035541}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.20218828746250697, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06866566623960223, "in-drivable-lane": 0, "agent_compute-ego": 0.18048708779471265, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.11136278935841153, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04277327230998448, "sim_compute_performance-ego": 0.07636176688330513, "sim_compute_robot_state-ego": 0.08826607465744019, "sim_compute_robot_state-npc0": 0.08104349885668073, "sim_compute_robot_state-npc1": 0.07754635810852051, "sim_compute_robot_state-npc2": 0.07915134940828596, "sim_compute_robot_state-npc3": 0.07687416246959142}}
set_robot_commands_max	0.11136278935841153
set_robot_commands_mean	0.10204475562194432
set_robot_commands_median	0.10697898111845318
set_robot_commands_min	0.07854685076960811
sim_compute_performance-ego_max	0.08042551994323731
sim_compute_performance-ego_mean	0.07276008016669176
sim_compute_performance-ego_median	0.07636176688330513
sim_compute_performance-ego_min	0.055650794947588886
sim_compute_robot_state-ego_max	0.08826607465744019
sim_compute_robot_state-ego_mean	0.07974748982981254
sim_compute_robot_state-ego_median	0.08212428971340782
sim_compute_robot_state-ego_min	0.06115987124266448
sim_compute_robot_state-npc0_max	0.08104349885668073
sim_compute_robot_state-npc0_mean	0.07271303494351951
sim_compute_robot_state-npc0_median	0.07372335697475232
sim_compute_robot_state-npc0_min	0.05796388343528465
sim_compute_robot_state-npc1_max	0.07813474196421949
sim_compute_robot_state-npc1_mean	0.07283731833764873
sim_compute_robot_state-npc1_median	0.07663902282714843
sim_compute_robot_state-npc1_min	0.05770836494587086
sim_compute_robot_state-npc2_max	0.07915134940828596
sim_compute_robot_state-npc2_mean	0.0730911228425577
sim_compute_robot_state-npc2_median	0.0769615518419366
sim_compute_robot_state-npc2_min	0.0552405560458148
sim_compute_robot_state-npc3_max	0.078370218035541
sim_compute_robot_state-npc3_mean	0.07200612654368008
sim_compute_robot_state-npc3_median	0.07485735893249512
sim_compute_robot_state-npc3_min	0.05598726095976653
sim_compute_sim_state_max	0.04330785063248646
sim_compute_sim_state_mean	0.04048010646425178
sim_compute_sim_state_median	0.04169859886169434
sim_compute_sim_state_min	0.03319875399271647
sim_physics_max	0.22660400294050387
sim_physics_mean	0.19514742984248784
sim_physics_median	0.2037149103064286
sim_physics_min	0.13629923484943532
sim_render-ego_max	0.06984503661529927
sim_render-ego_mean	0.06469469231136268
sim_render-ego_median	0.06592957496643066
sim_render-ego_min	0.053106343304669415
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

23716

3742

LF sim test - wh

step1-simulation

success

yes

2019-05-21 16:44:20+00:00

2019-05-21 16:58:59+00:00

0:14:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2511103104896957
survival_time_median	7.299999999999982
deviation-center-line_median	0.3890778750283658
in-drivable-lane_median	2.200000000000018

other stats

agent_compute-ego_max	0.10453449805577596
agent_compute-ego_mean	0.10366416272150676
agent_compute-ego_median	0.10354852924744289
agent_compute-ego_min	0.10312679596245287
deviation-center-line_max	1.2096355284597748
deviation-center-line_mean	0.6308438724571992
deviation-center-line_min	0.16027286524091103
deviation-heading_max	3.7921052624260585
deviation-heading_mean	1.875804634456928
deviation-heading_median	2.0452045084263974
deviation-heading_min	0.2064155920600475
driven_any_max	4.401160836732589
driven_any_mean	2.362961856545111
driven_any_median	1.6818565131429342
driven_any_min	1.02383035043854
driven_lanedir_consec_max	3.8491417630895617
driven_lanedir_consec_mean	1.8646866907762525
driven_lanedir_consec_min	0.6029246412859433
driven_lanedir_max	3.8591521470203847
driven_lanedir_mean	1.8699228090878717
driven_lanedir_median	1.267280518116967
driven_lanedir_min	0.6029246412859433
in-drivable-lane_max	5.649999999999981
in-drivable-lane_mean	2.719999999999996
in-drivable-lane_min	1.2999999999999972
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.02383035043854, "sim_physics": 0.08979545554069623, "survival_time": 7.299999999999982, "driven_lanedir": 0.6029246412859433, "sim_render-ego": 0.03970911894759087, "in-drivable-lane": 5.649999999999981, "agent_compute-ego": 0.10346002448095036, "deviation-heading": 0.2064155920600475, "set_robot_commands": 0.05748187189232813, "deviation-center-line": 0.16027286524091103, "driven_lanedir_consec": 0.6029246412859433, "sim_compute_sim_state": 0.02411073527924002, "sim_compute_performance-ego": 0.04151296778900983, "sim_compute_robot_state-ego": 0.04311025795871264, "sim_compute_robot_state-npc0": 0.04265388234020912, "sim_compute_robot_state-npc1": 0.04199992793880097, "sim_compute_robot_state-npc2": 0.04153082305437898, "sim_compute_robot_state-npc3": 0.041888241898523616}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.401160836732589, "sim_physics": 0.10120447715123494, "survival_time": 14.950000000000076, "driven_lanedir": 3.8591521470203847, "sim_render-ego": 0.04012745539347331, "in-drivable-lane": 2.200000000000018, "agent_compute-ego": 0.10453449805577596, "deviation-heading": 3.7921052624260585, "set_robot_commands": 0.05738849322001139, "deviation-center-line": 1.1154371180308842, "driven_lanedir_consec": 3.8491417630895617, "sim_compute_sim_state": 0.023910423119862873, "sim_compute_performance-ego": 0.04173701842625936, "sim_compute_robot_state-ego": 0.04336978991826376, "sim_compute_robot_state-npc0": 0.04300828854242961, "sim_compute_robot_state-npc1": 0.04236296574274699, "sim_compute_robot_state-npc2": 0.041906455357869465, "sim_compute_robot_state-npc3": 0.04246307611465454}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6818565131429342, "sim_physics": 0.094248590990901, "survival_time": 6.399999999999985, "driven_lanedir": 1.267280518116967, "sim_render-ego": 0.03805449791252613, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.10312679596245287, "deviation-heading": 2.0452045084263974, "set_robot_commands": 0.0596114918589592, "deviation-center-line": 0.3890778750283658, "driven_lanedir_consec": 1.2511103104896957, "sim_compute_sim_state": 0.024247456341981888, "sim_compute_performance-ego": 0.04192951321601868, "sim_compute_robot_state-ego": 0.043601226061582565, "sim_compute_robot_state-npc0": 0.043163930997252464, "sim_compute_robot_state-npc1": 0.04264931567013264, "sim_compute_robot_state-npc2": 0.04183228313922882, "sim_compute_robot_state-npc3": 0.04251795448362827}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6274400718111357, "sim_physics": 0.09708145473684585, "survival_time": 5.599999999999988, "driven_lanedir": 1.2467302243493457, "sim_render-ego": 0.03786175378731319, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.10365096586091178, "deviation-heading": 0.6256449974956864, "set_robot_commands": 0.05774146105561938, "deviation-center-line": 0.2797959755260603, "driven_lanedir_consec": 1.2467302243493457, "sim_compute_sim_state": 0.02396224864891597, "sim_compute_performance-ego": 0.04176018280642373, "sim_compute_robot_state-ego": 0.04343933718545096, "sim_compute_robot_state-npc0": 0.042746788689068387, "sim_compute_robot_state-npc1": 0.042353966406413486, "sim_compute_robot_state-npc2": 0.0415851218359811, "sim_compute_robot_state-npc3": 0.0420962210212435}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.0805215106003585, "sim_physics": 0.0934953863422076, "survival_time": 14.40000000000007, "driven_lanedir": 2.373526514666716, "sim_render-ego": 0.03811638802289963, "in-drivable-lane": 1.2999999999999972, "agent_compute-ego": 0.10354852924744289, "deviation-heading": 2.709652811876449, "set_robot_commands": 0.057205196056101054, "deviation-center-line": 1.2096355284597748, "driven_lanedir_consec": 2.373526514666716, "sim_compute_sim_state": 0.023949880566861897, "sim_compute_performance-ego": 0.04162211798959308, "sim_compute_robot_state-ego": 0.04285665601491928, "sim_compute_robot_state-npc0": 0.04252576414081785, "sim_compute_robot_state-npc1": 0.04206584559546577, "sim_compute_robot_state-npc2": 0.04160854468743006, "sim_compute_robot_state-npc3": 0.04206179827451706}}
set_robot_commands_max	0.0596114918589592
set_robot_commands_mean	0.05788570281660384
set_robot_commands_median	0.05748187189232813
set_robot_commands_min	0.057205196056101054
sim_compute_performance-ego_max	0.04192951321601868
sim_compute_performance-ego_mean	0.04171236004546094
sim_compute_performance-ego_median	0.04173701842625936
sim_compute_performance-ego_min	0.04151296778900983
sim_compute_robot_state-ego_max	0.043601226061582565
sim_compute_robot_state-ego_mean	0.04327545342778584
sim_compute_robot_state-ego_median	0.04336978991826376
sim_compute_robot_state-ego_min	0.04285665601491928
sim_compute_robot_state-npc0_max	0.043163930997252464
sim_compute_robot_state-npc0_mean	0.042819730941955486
sim_compute_robot_state-npc0_median	0.042746788689068387
sim_compute_robot_state-npc0_min	0.04252576414081785
sim_compute_robot_state-npc1_max	0.04264931567013264
sim_compute_robot_state-npc1_mean	0.042286404270711966
sim_compute_robot_state-npc1_median	0.042353966406413486
sim_compute_robot_state-npc1_min	0.04199992793880097
sim_compute_robot_state-npc2_max	0.041906455357869465
sim_compute_robot_state-npc2_mean	0.04169264561497769
sim_compute_robot_state-npc2_median	0.04160854468743006
sim_compute_robot_state-npc2_min	0.04153082305437898
sim_compute_robot_state-npc3_max	0.04251795448362827
sim_compute_robot_state-npc3_mean	0.0422054583585134
sim_compute_robot_state-npc3_median	0.0420962210212435
sim_compute_robot_state-npc3_min	0.041888241898523616
sim_compute_sim_state_max	0.024247456341981888
sim_compute_sim_state_mean	0.02403614879137253
sim_compute_sim_state_median	0.02396224864891597
sim_compute_sim_state_min	0.023910423119862873
sim_physics_max	0.10120447715123494
sim_physics_mean	0.09516507295237712
sim_physics_median	0.094248590990901
sim_physics_min	0.08979545554069623
sim_render-ego_max	0.04012745539347331
sim_render-ego_mean	0.038773842812760625
sim_render-ego_median	0.03811638802289963
sim_render-ego_min	0.03786175378731319
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.730000000000022
survival_time_min	5.599999999999988

No reset possible

23703

3731

LF sim test - wh

step1-simulation

success

yes

2019-05-21 16:07:31+00:00

2019-05-21 16:20:00+00:00

0:12:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.350612850222792
survival_time_median	14.950000000000076
deviation-center-line_median	1.21102617631047
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.10720314184824624
agent_compute-ego_mean	0.10528370736918966
agent_compute-ego_median	0.10571935415267944
agent_compute-ego_min	0.10326789207609274
deviation-center-line_max	1.3522233573874196
deviation-center-line_mean	0.9161433512987748
deviation-center-line_min	0.18504586279012217
deviation-heading_max	3.627652068611845
deviation-heading_mean	2.822060680937911
deviation-heading_median	3.007214333712165
deviation-heading_min	1.5864097090234126
driven_any_max	4.4984204427199765
driven_any_mean	2.7633314645369804
driven_any_median	3.4139778904807425
driven_any_min	1.0179222893824424
driven_lanedir_consec_max	3.7432236121764206
driven_lanedir_consec_mean	2.430367779214021
driven_lanedir_consec_min	0.62072854386785
driven_lanedir_max	3.7432236121764206
driven_lanedir_mean	2.46177724950481
driven_lanedir_median	3.350612850222792
driven_lanedir_min	0.7777758953217933
in-drivable-lane_max	6.600000000000037
in-drivable-lane_mean	1.650000000000011
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2476729462012706, "sim_physics": 0.055042168839646896, "survival_time": 12.650000000000045, "driven_lanedir": 0.7777758953217933, "sim_render-ego": 0.0376415516548006, "in-drivable-lane": 6.600000000000037, "agent_compute-ego": 0.10326789207609274, "deviation-heading": 3.627652068611845, "set_robot_commands": 0.05841817309262724, "deviation-center-line": 0.5976573084621427, "driven_lanedir_consec": 0.62072854386785, "sim_compute_sim_state": 0.024341210075046704, "sim_compute_performance-ego": 0.041596074349324226, "sim_compute_robot_state-ego": 0.04288415475325151}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0179222893824424, "sim_physics": 0.05843795888564166, "survival_time": 4.249999999999993, "driven_lanedir": 0.8727840497768748, "sim_render-ego": 0.038055041257072895, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.10385199434616986, "deviation-heading": 1.5864097090234126, "set_robot_commands": 0.05784941841574276, "deviation-center-line": 0.18504586279012217, "driven_lanedir_consec": 0.8727840497768748, "sim_compute_sim_state": 0.02459432377534754, "sim_compute_performance-ego": 0.051090571459601906, "sim_compute_robot_state-ego": 0.04344057756311753}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.4984204427199765, "sim_physics": 0.06158260583877564, "survival_time": 14.950000000000076, "driven_lanedir": 3.7432236121764206, "sim_render-ego": 0.038129477500915526, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.10571935415267944, "deviation-heading": 2.652760807522958, "set_robot_commands": 0.05977457284927368, "deviation-center-line": 1.2347640515437197, "driven_lanedir_consec": 3.7432236121764206, "sim_compute_sim_state": 0.0248866597811381, "sim_compute_performance-ego": 0.042130490144093834, "sim_compute_robot_state-ego": 0.04388765811920166}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.63866375390047, "sim_physics": 0.0646330738067627, "survival_time": 14.950000000000076, "driven_lanedir": 3.564489840026168, "sim_render-ego": 0.03793941895167033, "in-drivable-lane": 0, "agent_compute-ego": 0.10637615442276, "deviation-heading": 3.2362664858191748, "set_robot_commands": 0.05774425109227498, "deviation-center-line": 1.21102617631047, "driven_lanedir_consec": 3.564489840026168, "sim_compute_sim_state": 0.024712345600128173, "sim_compute_performance-ego": 0.04158751328786214, "sim_compute_robot_state-ego": 0.04396584431330363}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.4139778904807425, "sim_physics": 0.06380362987518311, "survival_time": 14.950000000000076, "driven_lanedir": 3.350612850222792, "sim_render-ego": 0.038228964805603026, "in-drivable-lane": 0, "agent_compute-ego": 0.10720314184824624, "deviation-heading": 3.007214333712165, "set_robot_commands": 0.05851756970087687, "deviation-center-line": 1.3522233573874196, "driven_lanedir_consec": 3.350612850222792, "sim_compute_sim_state": 0.02482379992802938, "sim_compute_performance-ego": 0.04285520474116007, "sim_compute_robot_state-ego": 0.043374516169230146}}
set_robot_commands_max	0.05977457284927368
set_robot_commands_mean	0.058460797030159106
set_robot_commands_median	0.05841817309262724
set_robot_commands_min	0.05774425109227498
sim_compute_performance-ego_max	0.051090571459601906
sim_compute_performance-ego_mean	0.04385197079640843
sim_compute_performance-ego_median	0.042130490144093834
sim_compute_performance-ego_min	0.04158751328786214
sim_compute_robot_state-ego_max	0.04396584431330363
sim_compute_robot_state-ego_mean	0.0435105501836209
sim_compute_robot_state-ego_median	0.04344057756311753
sim_compute_robot_state-ego_min	0.04288415475325151
sim_compute_sim_state_max	0.0248866597811381
sim_compute_sim_state_mean	0.02467166783193798
sim_compute_sim_state_median	0.024712345600128173
sim_compute_sim_state_min	0.024341210075046704
sim_physics_max	0.0646330738067627
sim_physics_mean	0.060699887449202
sim_physics_median	0.06158260583877564
sim_physics_min	0.055042168839646896
sim_render-ego_max	0.038228964805603026
sim_render-ego_mean	0.03799889083401248
sim_render-ego_median	0.038055041257072895
sim_render-ego_min	0.0376415516548006
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.350000000000056
survival_time_min	4.249999999999993

No reset possible

23681

3719

final test2 - wh

step1-simulation

failed

yes

2019-05-21 15:08:18+00:00

2019-05-21 15:09:03+00:00

0:00:45

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 60, in on_received_get_commands
               ||     action = self.compute_action(self.current_image)
               ||   File "solution.py", line 47, in compute_action
               ||     if action[0]<1e-2:
               || UnboundLocalError: local variable 'action' referenced before assignment
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23667

3713

final test - wh

step1-simulation

error

yes

2019-05-21 14:40:06+00:00

2019-05-21 15:00:41+00:00

0:20:35

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23621

3709

Tony Hsu 🇹🇼

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-05-21 04:18:36+00:00

2019-05-21 04:37:11+00:00

0:18:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6950573847640089
survival_time_median	14.950000000000076
deviation-center-line_median	0.44374302000365046
in-drivable-lane_median	7.200000000000037

other stats

agent_compute-ego_max	0.2448463694254557
agent_compute-ego_mean	0.24343085495630895
agent_compute-ego_median	0.24308706124623616
agent_compute-ego_min	0.2425648371378581
deviation-center-line_max	0.7337965812416224
deviation-center-line_mean	0.4812214119502003
deviation-center-line_min	0.29799505396684733
deviation-heading_max	5.990117020581061
deviation-heading_mean	5.864380088201328
deviation-heading_median	5.951617305849203
deviation-heading_min	5.613995197946513
driven_any_max	2.1853065485311514
driven_any_mean	2.185306548531142
driven_any_median	2.1853065485311407
driven_any_min	2.1853065485311367
driven_lanedir_consec_max	0.6964859913423234
driven_lanedir_consec_mean	0.6949286260456211
driven_lanedir_consec_min	0.6933707706415575
driven_lanedir_max	0.6964859913423234
driven_lanedir_mean	0.6949286260456211
driven_lanedir_median	0.6950573847640089
driven_lanedir_min	0.6933707706415575
in-drivable-lane_max	7.400000000000038
in-drivable-lane_mean	7.260000000000038
in-drivable-lane_min	7.200000000000037
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1853065485311434, "sim_physics": 0.059247544606526696, "survival_time": 14.950000000000076, "driven_lanedir": 0.6964859913423234, "sim_render-ego": 0.038106305599212645, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.24393007755279544, "deviation-heading": 5.613995197946513, "set_robot_commands": 0.05846373716990153, "deviation-center-line": 0.7337965812416224, "driven_lanedir_consec": 0.6964859913423234, "sim_compute_sim_state": 0.02430761973063151, "sim_compute_performance-ego": 0.04142737547556559, "sim_compute_robot_state-ego": 0.04331445773442586}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1853065485311514, "sim_physics": 0.0592593510945638, "survival_time": 14.950000000000076, "driven_lanedir": 0.694222936176982, "sim_render-ego": 0.03786354462305705, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.24308706124623616, "deviation-heading": 5.990117020581061, "set_robot_commands": 0.057410765488942465, "deviation-center-line": 0.29799505396684733, "driven_lanedir_consec": 0.694222936176982, "sim_compute_sim_state": 0.02449428637822469, "sim_compute_performance-ego": 0.041789872646331785, "sim_compute_robot_state-ego": 0.04321376800537109}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.185306548531138, "sim_physics": 0.062478825251261395, "survival_time": 14.950000000000076, "driven_lanedir": 0.6950573847640089, "sim_render-ego": 0.03751073122024536, "in-drivable-lane": 7.300000000000038, "agent_compute-ego": 0.2448463694254557, "deviation-heading": 5.796667795845188, "set_robot_commands": 0.05878574768702189, "deviation-center-line": 0.307138938696771, "driven_lanedir_consec": 0.6950573847640089, "sim_compute_sim_state": 0.024804592927296955, "sim_compute_performance-ego": 0.041551332473754886, "sim_compute_robot_state-ego": 0.04331302007039388}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.1853065485311367, "sim_physics": 0.058628045717875166, "survival_time": 14.950000000000076, "driven_lanedir": 0.6955060473032337, "sim_render-ego": 0.037618192036946614, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.2425648371378581, "deviation-heading": 5.969503120784673, "set_robot_commands": 0.05766243696212769, "deviation-center-line": 0.6234334658421105, "driven_lanedir_consec": 0.6955060473032337, "sim_compute_sim_state": 0.02437701145807902, "sim_compute_performance-ego": 0.04134683847427368, "sim_compute_robot_state-ego": 0.0449948779741923}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1853065485311407, "sim_physics": 0.06077486673990885, "survival_time": 14.950000000000076, "driven_lanedir": 0.6933707706415575, "sim_render-ego": 0.03791710774103801, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.24272592941919963, "deviation-heading": 5.951617305849203, "set_robot_commands": 0.058301066557566325, "deviation-center-line": 0.44374302000365046, "driven_lanedir_consec": 0.6933707706415575, "sim_compute_sim_state": 0.024428095022837323, "sim_compute_performance-ego": 0.04136400779088338, "sim_compute_robot_state-ego": 0.04325714906056722}}
set_robot_commands_max	0.05878574768702189
set_robot_commands_mean	0.05812475077311198
set_robot_commands_median	0.058301066557566325
set_robot_commands_min	0.057410765488942465
sim_compute_performance-ego_max	0.041789872646331785
sim_compute_performance-ego_mean	0.04149588537216187
sim_compute_performance-ego_median	0.04142737547556559
sim_compute_performance-ego_min	0.04134683847427368
sim_compute_robot_state-ego_max	0.0449948779741923
sim_compute_robot_state-ego_mean	0.04361865456899007
sim_compute_robot_state-ego_median	0.04331302007039388
sim_compute_robot_state-ego_min	0.04321376800537109
sim_compute_sim_state_max	0.024804592927296955
sim_compute_sim_state_mean	0.0244823211034139
sim_compute_sim_state_median	0.024428095022837323
sim_compute_sim_state_min	0.02430761973063151
sim_physics_max	0.062478825251261395
sim_physics_mean	0.060077726682027176
sim_physics_median	0.0592593510945638
sim_physics_min	0.058628045717875166
sim_render-ego_max	0.038106305599212645
sim_render-ego_mean	0.037803176244099936
sim_render-ego_median	0.03786354462305705
sim_render-ego_min	0.03751073122024536
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

23618

3705

Tony Hsu 🇹🇼

Baseline solution using reinforcement learning

aido2-LF-sim-testing

step1-simulation

host-error

yes

2019-05-21 02:09:56+00:00

2019-05-21 03:00:04+00:00

0:50:08

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 783, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 267, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.6/dist-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/containers/3df138cbcb18a27a56fd2f074194d43dc0e0ab1e1b614e718c9eae66c6056c70/json

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23592

3691

Manfred Diaz

challenge-aido_LF-template-tensorflow

aido2-LF-sim-testing

step1-simulation

success

yes

2019-05-20 20:44:12+00:00

2019-05-20 20:59:07+00:00

0:14:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5730673664674821
survival_time_median	3.899999999999994
deviation-center-line_median	0.21186974191782376
in-drivable-lane_median	0.7499999999999973

other stats

agent_compute-ego_max	0.09261270573264674
agent_compute-ego_mean	0.09009480232020424
agent_compute-ego_median	0.09006434220534104
agent_compute-ego_min	0.08856035942255064
deviation-center-line_max	0.5239460356096675
deviation-center-line_mean	0.23937452023049827
deviation-center-line_min	0.06411568877654636
deviation-heading_max	3.006943268491237
deviation-heading_mean	1.1929000948121042
deviation-heading_median	1.0677680114170414
deviation-heading_min	0.3781625032515413
driven_any_max	2.1879923625180044
driven_any_mean	0.9383965224967
driven_any_median	0.9228574223241656
driven_any_min	0.3146754468860701
driven_lanedir_consec_max	1.6951585638843074
driven_lanedir_consec_mean	0.6919882987794135
driven_lanedir_consec_min	0.2799133526913069
driven_lanedir_max	1.6951585638843074
driven_lanedir_mean	0.6980683980659316
driven_lanedir_median	0.6277290869154601
driven_lanedir_min	0.2799133526913069
in-drivable-lane_max	1.4499999999999948
in-drivable-lane_mean	0.6499999999999976
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0316749706337376, "sim_physics": 0.0647315203425396, "survival_time": 4.149999999999993, "driven_lanedir": 0.6351050343820952, "sim_render-ego": 0.0374070535223168, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.09010136558348876, "deviation-heading": 0.3781625032515413, "set_robot_commands": 0.05865025520324707, "deviation-center-line": 0.3929643786276097, "driven_lanedir_consec": 0.6351050343820952, "sim_compute_sim_state": 0.024174721844225044, "sim_compute_performance-ego": 0.04142711248742529, "sim_compute_robot_state-ego": 0.04261559463409056}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3146754468860701, "sim_physics": 0.0613934902044443, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2907978789206025, "sim_render-ego": 0.037256442583524264, "in-drivable-lane": 0, "agent_compute-ego": 0.08997735610375038, "deviation-heading": 0.3918106014099589, "set_robot_commands": 0.05806542359865629, "deviation-center-line": 0.06411568877654636, "driven_lanedir_consec": 0.2907978789206025, "sim_compute_sim_state": 0.02428408769460825, "sim_compute_performance-ego": 0.041119749729449935, "sim_compute_robot_state-ego": 0.042720978076641374}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6588769930822956, "sim_physics": 0.06223355678089878, "survival_time": 2.849999999999998, "driven_lanedir": 0.2799133526913069, "sim_render-ego": 0.037971952505279, "in-drivable-lane": 1.099999999999997, "agent_compute-ego": 0.09261270573264674, "deviation-heading": 0.7761099456651885, "set_robot_commands": 0.05864246686299642, "deviation-center-line": 0.1231317613238924, "driven_lanedir_consec": 0.2799133526913069, "sim_compute_sim_state": 0.02447157993651273, "sim_compute_performance-ego": 0.0416095214977599, "sim_compute_robot_state-ego": 0.04329788475705866}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9441484565813316, "sim_physics": 0.06286664531655507, "survival_time": 3.649999999999995, "driven_lanedir": 0.9003920952731561, "sim_render-ego": 0.03733477527148103, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.091889498984977, "deviation-heading": 1.1325112638216068, "set_robot_commands": 0.05808382818143662, "deviation-center-line": 0.21186974191782376, "driven_lanedir_consec": 0.9003920952731561, "sim_compute_sim_state": 0.024230411607925207, "sim_compute_performance-ego": 0.04102283307950791, "sim_compute_robot_state-ego": 0.0431983666877224}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1879923625180044, "sim_physics": 0.06403828584230863, "survival_time": 7.79999999999998, "driven_lanedir": 1.6951585638843074, "sim_render-ego": 0.03721731442671556, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.09007723514850324, "deviation-heading": 3.006943268491237, "set_robot_commands": 0.05727165326094016, "deviation-center-line": 0.5239460356096675, "driven_lanedir_consec": 1.6951585638843074, "sim_compute_sim_state": 0.024292893898792755, "sim_compute_performance-ego": 0.04133644165136875, "sim_compute_robot_state-ego": 0.042226962554149136}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.188384274002113, "sim_physics": 0.06252699238913399, "survival_time": 4.199999999999993, "driven_lanedir": 0.76510993579048, "sim_render-ego": 0.03777318341391427, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.08953302531015306, "deviation-heading": 1.716506050032251, "set_robot_commands": 0.05749041409719558, "deviation-center-line": 0.2127216497696847, "driven_lanedir_consec": 0.76510993579048, "sim_compute_sim_state": 0.02430781012489682, "sim_compute_performance-ego": 0.042522631940387544, "sim_compute_robot_state-ego": 0.043124636014302574}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.38796156382509395, "sim_physics": 0.06502617200215657, "survival_time": 1.5000000000000009, "driven_lanedir": 0.36705213210080245, "sim_render-ego": 0.03797659873962402, "in-drivable-lane": 0, "agent_compute-ego": 0.08960633277893067, "deviation-heading": 0.41264819339832015, "set_robot_commands": 0.05743210315704346, "deviation-center-line": 0.11161710575805824, "driven_lanedir_consec": 0.36705213210080245, "sim_compute_sim_state": 0.023897210756937664, "sim_compute_performance-ego": 0.04075245062510172, "sim_compute_robot_state-ego": 0.042766006787618}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.5433584613577912, "sim_physics": 0.06028340413020207, "survival_time": 1.950000000000001, "driven_lanedir": 0.4978725605114601, "sim_render-ego": 0.03666160656855656, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09006434220534104, "deviation-heading": 0.4486890052949937, "set_robot_commands": 0.05576899112799229, "deviation-center-line": 0.14624769687768413, "driven_lanedir_consec": 0.4978725605114601, "sim_compute_sim_state": 0.02450142762599847, "sim_compute_performance-ego": 0.040684718352097735, "sim_compute_robot_state-ego": 0.0428157280652951}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.711190213238187, "sim_physics": 0.05943419716574929, "survival_time": 7.149999999999983, "driven_lanedir": 1.2555860704927913, "sim_render-ego": 0.03755669827227826, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.09060060227667537, "deviation-heading": 1.910631449669402, "set_robot_commands": 0.057831525802612305, "deviation-center-line": 0.3792462196021766, "driven_lanedir_consec": 1.2555860704927913, "sim_compute_sim_state": 0.024257553207290755, "sim_compute_performance-ego": 0.04055659921019227, "sim_compute_robot_state-ego": 0.04255935695621517}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.7403060227910789, "sim_physics": 0.061478122686728455, "survival_time": 3.899999999999994, "driven_lanedir": 0.6948224668893908, "sim_render-ego": 0.038103149487422064, "in-drivable-lane": 0, "agent_compute-ego": 0.09168759676126334, "deviation-heading": 1.0677680114170414, "set_robot_commands": 0.05669271028958834, "deviation-center-line": 0.2162063987691845, "driven_lanedir_consec": 0.6948224668893908, "sim_compute_sim_state": 0.023799859560452975, "sim_compute_performance-ego": 0.040446645174271025, "sim_compute_robot_state-ego": 0.04306621123582889}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.9601998796525728, "sim_physics": 0.06397814220852321, "survival_time": 3.599999999999995, "driven_lanedir": 0.4750576108311232, "sim_render-ego": 0.03772815730836657, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.09028693371348911, "deviation-heading": 0.7624523882507178, "set_robot_commands": 0.05631539887852139, "deviation-center-line": 0.1599197832365024, "driven_lanedir_consec": 0.4750576108311232, "sim_compute_sim_state": 0.023905727598402236, "sim_compute_performance-ego": 0.040380239486694336, "sim_compute_robot_state-ego": 0.04245285193125407}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.460047374770625, "sim_physics": 0.06317187464514444, "survival_time": 2.1500000000000004, "driven_lanedir": 0.4252956824859204, "sim_render-ego": 0.037217833275018736, "in-drivable-lane": 0, "agent_compute-ego": 0.08856035942255064, "deviation-heading": 0.6048553975836963, "set_robot_commands": 0.056728656901869665, "deviation-center-line": 0.17094035496902682, "driven_lanedir_consec": 0.4252956824859204, "sim_compute_sim_state": 0.02346806193506995, "sim_compute_performance-ego": 0.04068633012993391, "sim_compute_robot_state-ego": 0.04207252347192099}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.1021746982117984, "sim_physics": 0.05981501035912092, "survival_time": 4.299999999999993, "driven_lanedir": 0.9549755696580258, "sim_render-ego": 0.03759774773619896, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08860500191533288, "deviation-heading": 1.3111285880436343, "set_robot_commands": 0.05776967558749886, "deviation-center-line": 0.20954568010006625, "driven_lanedir_consec": 0.9549755696580258, "sim_compute_sim_state": 0.024402238601861997, "sim_compute_performance-ego": 0.0405823546786641, "sim_compute_robot_state-ego": 0.042849033377891366}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.9220996975756331, "sim_physics": 0.05718335340607841, "survival_time": 5.299999999999989, "driven_lanedir": 0.6061579301620528, "sim_render-ego": 0.03732765620609499, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.08921914055662335, "deviation-heading": 2.0488280643323007, "set_robot_commands": 0.058348397039017584, "deviation-center-line": 0.3101625530401381, "driven_lanedir_consec": 0.5730673664674821, "sim_compute_sim_state": 0.02408398322339328, "sim_compute_performance-ego": 0.04035279211008324, "sim_compute_robot_state-ego": 0.04226056584772074}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9228574223241656, "sim_physics": 0.059326840835867575, "survival_time": 5.14999999999999, "driven_lanedir": 0.6277290869154601, "sim_render-ego": 0.037014320058730045, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.08860053830933802, "deviation-heading": 1.9244566915196717, "set_robot_commands": 0.057390238474873664, "deviation-center-line": 0.35798275507941196, "driven_lanedir_consec": 0.5696181613122571, "sim_compute_sim_state": 0.024335280205439597, "sim_compute_performance-ego": 0.04023271394007414, "sim_compute_robot_state-ego": 0.04204997970062552}}
set_robot_commands_max	0.05865025520324707
set_robot_commands_mean	0.05749878256423266
set_robot_commands_median	0.05749041409719558
set_robot_commands_min	0.05576899112799229
sim_compute_performance-ego_max	0.042522631940387544
sim_compute_performance-ego_mean	0.04091420893953412
sim_compute_performance-ego_median	0.04068633012993391
sim_compute_performance-ego_min	0.04023271394007414
sim_compute_robot_state-ego_max	0.04329788475705866
sim_compute_robot_state-ego_mean	0.0426717786732223
sim_compute_robot_state-ego_median	0.042720978076641374
sim_compute_robot_state-ego_min	0.04204997970062552
sim_compute_sim_state_max	0.02450142762599847
sim_compute_sim_state_mean	0.024160856521453847
sim_compute_sim_state_median	0.024257553207290755
sim_compute_sim_state_min	0.02346806193506995
sim_physics_max	0.06502617200215657
sim_physics_mean	0.06183250722103009
sim_physics_median	0.06223355678089878
sim_physics_min	0.05718335340607841
sim_render-ego_max	0.038103149487422064
sim_render-ego_mean	0.03747629929170141
sim_render-ego_median	0.0374070535223168
sim_render-ego_min	0.03666160656855656
simulation-passed	1
survival_time_max	7.79999999999998
survival_time_mean	3.9299999999999935
survival_time_min	1.3000000000000005

No reset possible

23562

3687

Tony Hsu 🇹🇼

Baseline solution using reinforcement learning

aido2-LF-sim-testing

step1-simulation

aborted

yes

2019-05-20 15:45:35+00:00

2019-05-20 16:00:28+00:00

0:14:53

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23465

3654

RL-TH-xyz

step1-simulation

failed

yes

2019-05-20 03:56:56+00:00

2019-05-20 03:59:04+00:00

0:02:08

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 50, in on_received_get_commands
               ||     action = self.compute_action(self.current_image)
               ||   File "solution.py", line 44, in compute_action
               ||     action = self.model.predict(observation)
               ||   File "/workspace/model.py", line 373, in predict
               ||     action = self.actor(state).cpu().data.numpy().flatten()
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 489, in __call__
               ||     result = self.forward(*input, **kwargs)
               ||   File "/workspace/model.py", line 220, in forward
               ||     x[:, 1] = self.tanh(x[:, 1])
               || IndexError: index 1 is out of bounds for dimension 1 with size 1
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23402

3635

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

error

yes

aido2-LFVI-sim-validation

2019-05-19 19:56:14+00:00

2019-05-19 20:00:15+00:00

0:04:01

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23392

3633

Nicky Eichmann

step1-simulation

success

yes

2019-05-19 18:33:23+00:00

2019-05-19 18:46:04+00:00

0:12:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.9728172853971908
survival_time_median	7.399999999999982
deviation-center-line_median	0.28905228033842156
in-drivable-lane_median	1.7999999999999936

other stats

agent_compute-ego_max	0.1055177419350065
agent_compute-ego_mean	0.10369339727911012
agent_compute-ego_median	0.10390765190124512
agent_compute-ego_min	0.10161341428756714
deviation-center-line_max	1.5701033510353766
deviation-center-line_mean	0.4786105270959126
deviation-center-line_min	0.060733287044270105
deviation-heading_max	3.738230862655436
deviation-heading_mean	1.0457688434242178
deviation-heading_median	0.3681646786246837
deviation-heading_min	0.2638670899443274
driven_any_max	4.572711795639489
driven_any_mean	2.212978417418545
driven_any_median	2.50162892780929
driven_any_min	0.400811386017319
driven_lanedir_consec_max	2.35052758885685
driven_lanedir_consec_mean	1.4531971044053411
driven_lanedir_consec_min	0.38693847040587825
driven_lanedir_max	4.223582747004244
driven_lanedir_mean	1.9096666822464072
driven_lanedir_median	2.1208268912576216
driven_lanedir_min	0.38693847040587825
in-drivable-lane_max	7.100000000000021
in-drivable-lane_mean	2.47
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.50162892780929, "sim_physics": 0.10974974890013, "survival_time": 7.399999999999982, "driven_lanedir": 2.1208268912576216, "sim_render-ego": 0.03846768591855023, "in-drivable-lane": 3.4499999999999877, "agent_compute-ego": 0.10413285203882164, "deviation-heading": 0.36159719377172606, "set_robot_commands": 0.057647676081270784, "deviation-center-line": 0.28905228033842156, "driven_lanedir_consec": 2.120743097074997, "sim_compute_sim_state": 0.023866255541105528, "sim_compute_performance-ego": 0.04118656951027948, "sim_compute_robot_state-ego": 0.04557463768366221, "sim_compute_robot_state-npc0": 0.04291595156128342, "sim_compute_robot_state-npc1": 0.04253734930141552, "sim_compute_robot_state-npc2": 0.04194546229130513, "sim_compute_robot_state-npc3": 0.04187925925125947}, "udem1-1-0": {"driven_any": 0.46051146883057115, "sim_physics": 0.1170472340150313, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495908029179065, "sim_render-ego": 0.039383801546963776, "in-drivable-lane": 0, "agent_compute-ego": 0.10329532623291016, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.05850617452101274, "deviation-center-line": 0.07726482156623102, "driven_lanedir_consec": 0.43495908029179065, "sim_compute_sim_state": 0.02362646839835427, "sim_compute_performance-ego": 0.04121082479303533, "sim_compute_robot_state-ego": 0.0423860875043002, "sim_compute_robot_state-npc0": 0.04333018172870983, "sim_compute_robot_state-npc1": 0.04236988587812944, "sim_compute_robot_state-npc2": 0.041940255598588425, "sim_compute_robot_state-npc3": 0.04259858348152854}, "udem1-2-0": {"driven_any": 4.572711795639489, "sim_physics": 0.10555750687917072, "survival_time": 14.950000000000076, "driven_lanedir": 4.223582747004244, "sim_render-ego": 0.038323630491892496, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.10390765190124512, "deviation-heading": 3.738230862655436, "set_robot_commands": 0.0575240953763326, "deviation-center-line": 1.5701033510353766, "driven_lanedir_consec": 1.9728172853971908, "sim_compute_sim_state": 0.024070714314778644, "sim_compute_performance-ego": 0.042135063012441, "sim_compute_robot_state-ego": 0.043673095703125, "sim_compute_robot_state-npc0": 0.042920111815134686, "sim_compute_robot_state-npc1": 0.04223047176996867, "sim_compute_robot_state-npc2": 0.04186389366785685, "sim_compute_robot_state-npc3": 0.04347842534383138}, "udem1-3-0": {"driven_any": 3.1292285087960567, "sim_physics": 0.1100501572263652, "survival_time": 11.60000000000003, "driven_lanedir": 2.382026222272503, "sim_render-ego": 0.038659308491082026, "in-drivable-lane": 7.100000000000021, "agent_compute-ego": 0.1055177419350065, "deviation-heading": 0.4969843921249166, "set_robot_commands": 0.057598202392972746, "deviation-center-line": 0.39589889549526386, "driven_lanedir_consec": 2.35052758885685, "sim_compute_sim_state": 0.02411432821175148, "sim_compute_performance-ego": 0.04191076036157279, "sim_compute_robot_state-ego": 0.04349113230047555, "sim_compute_robot_state-npc0": 0.04310335270289717, "sim_compute_robot_state-npc1": 0.04236135606108041, "sim_compute_robot_state-npc2": 0.04178373053156097, "sim_compute_robot_state-npc3": 0.04219275712966919}, "udem1-4-0": {"driven_any": 0.400811386017319, "sim_physics": 0.11901004314422609, "survival_time": 1.0000000000000002, "driven_lanedir": 0.38693847040587825, "sim_render-ego": 0.038721895217895506, "in-drivable-lane": 0, "agent_compute-ego": 0.10161341428756714, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.05857532024383545, "deviation-center-line": 0.060733287044270105, "driven_lanedir_consec": 0.38693847040587825, "sim_compute_sim_state": 0.02388662099838257, "sim_compute_performance-ego": 0.04205541610717774, "sim_compute_robot_state-ego": 0.04344155788421631, "sim_compute_robot_state-npc0": 0.04288688898086548, "sim_compute_robot_state-npc1": 0.04160571098327637, "sim_compute_robot_state-npc2": 0.04175909757614136, "sim_compute_robot_state-npc3": 0.04151142835617065}}
set_robot_commands_max	0.05857532024383545
set_robot_commands_mean	0.05797029372308486
set_robot_commands_median	0.057647676081270784
set_robot_commands_min	0.0575240953763326
sim_compute_performance-ego_max	0.042135063012441
sim_compute_performance-ego_mean	0.04169972675690127
sim_compute_performance-ego_median	0.04191076036157279
sim_compute_performance-ego_min	0.04118656951027948
sim_compute_robot_state-ego_max	0.04557463768366221
sim_compute_robot_state-ego_mean	0.043713302215155854
sim_compute_robot_state-ego_median	0.04349113230047555
sim_compute_robot_state-ego_min	0.0423860875043002
sim_compute_robot_state-npc0_max	0.04333018172870983
sim_compute_robot_state-npc0_mean	0.04303129735777812
sim_compute_robot_state-npc0_median	0.042920111815134686
sim_compute_robot_state-npc0_min	0.04288688898086548
sim_compute_robot_state-npc1_max	0.04253734930141552
sim_compute_robot_state-npc1_mean	0.04222095479877408
sim_compute_robot_state-npc1_median	0.04236135606108041
sim_compute_robot_state-npc1_min	0.04160571098327637
sim_compute_robot_state-npc2_max	0.04194546229130513
sim_compute_robot_state-npc2_mean	0.04185848793309054
sim_compute_robot_state-npc2_median	0.04186389366785685
sim_compute_robot_state-npc2_min	0.04175909757614136
sim_compute_robot_state-npc3_max	0.04347842534383138
sim_compute_robot_state-npc3_mean	0.042332090712491846
sim_compute_robot_state-npc3_median	0.04219275712966919
sim_compute_robot_state-npc3_min	0.04151142835617065
sim_compute_sim_state_max	0.02411432821175148
sim_compute_sim_state_mean	0.023912877492874497
sim_compute_sim_state_median	0.02388662099838257
sim_compute_sim_state_min	0.02362646839835427
sim_physics_max	0.11901004314422609
sim_physics_mean	0.11228293803298466
sim_physics_median	0.1100501572263652
sim_physics_min	0.10555750687917072
sim_render-ego_max	0.039383801546963776
sim_render-ego_mean	0.03871126433327681
sim_render-ego_median	0.038659308491082026
sim_render-ego_min	0.038323630491892496
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.210000000000018
survival_time_min	1.0000000000000002

No reset possible

23367

3615

Fourth test - TH

step1-simulation

failed

yes

2019-05-19 14:19:13+00:00

2019-05-19 14:21:31+00:00

0:02:18

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 296, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 41, in on_received_observations
               ||     self.current_image = self.preprocessor.preprocess(obs)
               ||   File "/workspace/wrappers.py", line 11, in preprocess
               ||     new_obs = imresize(new_obs, self.shape).transpose(2, 0, 1)
               || UnboundLocalError: local variable 'new_obs' referenced before assignment
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23322

3595

Victor Adolfo Romero Cano 🇨🇴

step1-simulation

success

yes

2019-05-18 16:27:34+00:00

2019-05-18 16:33:10+00:00

0:05:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.17427163124084472
agent_compute-ego_mean	0.15722620735053786
agent_compute-ego_median	0.16250030903876583
agent_compute-ego_min	0.12503461484555844
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.08884906768798828, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.047173107111895526, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.12503461484555844, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.07444479288878264, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.030339399973551433, "sim_compute_performance-ego": 0.05394001360292787, "sim_compute_robot_state-ego": 0.05933562914530436}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11344178050172096, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06426510156369676, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1522257889018339, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.1022178004769718, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03943158598507152, "sim_compute_performance-ego": 0.07201209255293303, "sim_compute_robot_state-ego": 0.0790249272888782}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13140350229599895, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07124080377466538, "in-drivable-lane": 0, "agent_compute-ego": 0.17209869272568645, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.1032716386458453, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04189276695251465, "sim_compute_performance-ego": 0.07427396493799546, "sim_compute_robot_state-ego": 0.08945178985595703}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13608137130737305, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06578660011291504, "in-drivable-lane": 0, "agent_compute-ego": 0.17427163124084472, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.11142016410827636, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.041144580841064454, "sim_compute_performance-ego": 0.06892147064208984, "sim_compute_robot_state-ego": 0.07571574211120606}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.1253851878492138, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06710181356985358, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.16250030903876583, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10121387771413295, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04112436499776719, "sim_compute_performance-ego": 0.07653762720808198, "sim_compute_robot_state-ego": 0.0836426789247537}}
set_robot_commands_max	0.11142016410827636
set_robot_commands_mean	0.0985136547668018
set_robot_commands_median	0.1022178004769718
set_robot_commands_min	0.07444479288878264
sim_compute_performance-ego_max	0.07653762720808198
sim_compute_performance-ego_mean	0.06913703378880565
sim_compute_performance-ego_median	0.07201209255293303
sim_compute_performance-ego_min	0.05394001360292787
sim_compute_robot_state-ego_max	0.08945178985595703
sim_compute_robot_state-ego_mean	0.07743415346521987
sim_compute_robot_state-ego_median	0.0790249272888782
sim_compute_robot_state-ego_min	0.05933562914530436
sim_compute_sim_state_max	0.04189276695251465
sim_compute_sim_state_mean	0.03878653974999385
sim_compute_sim_state_median	0.04112436499776719
sim_compute_sim_state_min	0.030339399973551433
sim_physics_max	0.13608137130737305
sim_physics_mean	0.11903218192845902
sim_physics_median	0.1253851878492138
sim_physics_min	0.08884906768798828
sim_render-ego_max	0.07124080377466538
sim_render-ego_mean	0.06311348522660526
sim_render-ego_median	0.06578660011291504
sim_render-ego_min	0.047173107111895526
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

23307

3585

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-05-18 05:12:22+00:00

2019-05-18 05:21:11+00:00

0:08:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.02672740225879
survival_time_median	6.449999999999985
deviation-center-line_median	0.21097756106066112
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.10352346703812884
agent_compute-ego_mean	0.10297446938380549
agent_compute-ego_median	0.10320262829462688
agent_compute-ego_min	0.10198712348937988
deviation-center-line_max	0.4822401828615347
deviation-center-line_mean	0.2618128898284002
deviation-center-line_min	0.13998676158204298
deviation-heading_max	7.014722634820147
deviation-heading_mean	1.7810383800543672
deviation-heading_median	0.5861071525629321
deviation-heading_min	0.25140342371554725
driven_any_max	2.064304909583592
driven_any_mean	1.055530010129783
driven_any_median	1.0340559830496436
driven_any_min	0.331461239289386
driven_lanedir_consec_max	1.9054921881689215
driven_lanedir_consec_mean	0.9821624687808032
driven_lanedir_consec_min	0.3300829885971317
driven_lanedir_max	1.9054921881689215
driven_lanedir_mean	0.9821624687808032
driven_lanedir_median	1.02672740225879
driven_lanedir_min	0.3300829885971317
in-drivable-lane_max	3.149999999999989
in-drivable-lane_mean	1.2399999999999956
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.331461239289386, "sim_physics": 0.06313825607299804, "survival_time": 14.950000000000076, "driven_lanedir": 0.3300829885971317, "sim_render-ego": 0.03819253285725911, "in-drivable-lane": 0, "agent_compute-ego": 0.10320262829462688, "deviation-heading": 7.014722634820147, "set_robot_commands": 0.057580992380778, "deviation-center-line": 0.4822401828615347, "driven_lanedir_consec": 0.3300829885971317, "sim_compute_sim_state": 0.02447602113087972, "sim_compute_performance-ego": 0.04111603975296021, "sim_compute_robot_state-ego": 0.04339608510335286}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3974489376093735, "sim_physics": 0.058255269545917365, "survival_time": 6.449999999999985, "driven_lanedir": 1.216097855831572, "sim_render-ego": 0.03720047492389531, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.10198712348937988, "deviation-heading": 0.5861071525629321, "set_robot_commands": 0.057261478069216706, "deviation-center-line": 0.21097756106066112, "driven_lanedir_consec": 1.216097855831572, "sim_compute_sim_state": 0.024581116299296536, "sim_compute_performance-ego": 0.04148105687873308, "sim_compute_robot_state-ego": 0.04324836878813514}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.064304909583592, "sim_physics": 0.0606625772811271, "survival_time": 7.399999999999982, "driven_lanedir": 1.9054921881689215, "sim_render-ego": 0.03749672947703181, "in-drivable-lane": 3.049999999999989, "agent_compute-ego": 0.1032555602692269, "deviation-heading": 0.6164430123184443, "set_robot_commands": 0.057689600699656715, "deviation-center-line": 0.30230222193374956, "driven_lanedir_consec": 1.9054921881689215, "sim_compute_sim_state": 0.0239764387543137, "sim_compute_performance-ego": 0.04136335527574694, "sim_compute_robot_state-ego": 0.04310973592706629}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.45037898111692065, "sim_physics": 0.06536542402731406, "survival_time": 1.850000000000001, "driven_lanedir": 0.4324119090476009, "sim_render-ego": 0.03785822198197648, "in-drivable-lane": 0, "agent_compute-ego": 0.10352346703812884, "deviation-heading": 0.436515676854766, "set_robot_commands": 0.05647566511824324, "deviation-center-line": 0.17355772170401257, "driven_lanedir_consec": 0.4324119090476009, "sim_compute_sim_state": 0.02468395877528835, "sim_compute_performance-ego": 0.04217711010494748, "sim_compute_robot_state-ego": 0.04326416995074298}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0340559830496436, "sim_physics": 0.06789190035599929, "survival_time": 2.5999999999999988, "driven_lanedir": 1.02672740225879, "sim_render-ego": 0.03718441724777222, "in-drivable-lane": 0, "agent_compute-ego": 0.10290356782766488, "deviation-heading": 0.25140342371554725, "set_robot_commands": 0.057091277379256025, "deviation-center-line": 0.13998676158204298, "driven_lanedir_consec": 1.02672740225879, "sim_compute_sim_state": 0.02403671007889968, "sim_compute_performance-ego": 0.04120511275071364, "sim_compute_robot_state-ego": 0.04253325554040762}}
set_robot_commands_max	0.057689600699656715
set_robot_commands_mean	0.057219802729430135
set_robot_commands_median	0.057261478069216706
set_robot_commands_min	0.05647566511824324
sim_compute_performance-ego_max	0.04217711010494748
sim_compute_performance-ego_mean	0.04146853495262027
sim_compute_performance-ego_median	0.04136335527574694
sim_compute_performance-ego_min	0.04111603975296021
sim_compute_robot_state-ego_max	0.04339608510335286
sim_compute_robot_state-ego_mean	0.04311032306194098
sim_compute_robot_state-ego_median	0.04324836878813514
sim_compute_robot_state-ego_min	0.04253325554040762
sim_compute_sim_state_max	0.02468395877528835
sim_compute_sim_state_mean	0.0243508490077356
sim_compute_sim_state_median	0.02447602113087972
sim_compute_sim_state_min	0.0239764387543137
sim_physics_max	0.06789190035599929
sim_physics_mean	0.06306268545667118
sim_physics_median	0.06313825607299804
sim_physics_min	0.058255269545917365
sim_render-ego_max	0.03819253285725911
sim_render-ego_mean	0.037586475297586984
sim_render-ego_median	0.03749672947703181
sim_render-ego_min	0.03718441724777222
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.650000000000008
survival_time_min	1.850000000000001

No reset possible

23302

3581

Peter Almasi 🇭🇺

My solution using reinforcement learning

aido2-LFVI-sim-testing

step1-simulation

error

yes

2019-05-17 21:26:17+00:00

2019-05-17 22:00:09+00:00

0:33:52

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23295

2904

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

error

yes

2019-05-17 20:50:07+00:00

2019-05-17 21:00:18+00:00

0:10:11

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23167

3572

Bhairav Mehta

challenge-aido_LF-template-pytorch

aido2-LFV-sim-testing

step1-simulation

error

yes