Duckietown Challenges Home Challenges Submissions

Evaluator 792

ID792
evaluatorip-172-31-38-104-8054
ownerI don't have one 😀
machineip-172-31-38-104
processip-172-31-38-104-8054
versiond-c:4.0.18;d-c-r:4.0.28;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success15 19275
# timeout
# failed2 19389
# error8 19366
# aborted
# host-error4 19248
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
197023007Manfred Diazchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationerrornoip-172-31-38-104-80540:01:23
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
196912995Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LF-sim-validationstep1-simulationerrornoip-172-31-38-104-80540:02:19
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
196862991Artem Ioselevskiichallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-38-104-80540:04:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7157697011236979
survival_time_median2.3999999999999995
deviation-center-line_median0.15455893108765126
in-drivable-lane_median0


other stats
agent_compute-ego_max0.08441731135050455
agent_compute-ego_mean0.08320468677995443
agent_compute-ego_median0.08278140615909657
agent_compute-ego_min0.08217898659084154
deviation-center-line_max0.31013597737792836
deviation-center-line_mean0.17272448361148324
deviation-center-line_min0.06782071622287905
deviation-heading_max1.0294008730754531
deviation-heading_mean0.6612078934498565
deviation-heading_median0.5819250435314811
deviation-heading_min0.4153718610881797
driven_any_max1.0461131967100066
driven_any_mean0.7136509992911837
driven_any_median0.7462427298960345
driven_any_min0.2521905708737723
driven_lanedir_consec_max0.9903600843233328
driven_lanedir_consec_mean0.6683690295539942
driven_lanedir_consec_min0.2241193320471978
driven_lanedir_max0.9903600843233328
driven_lanedir_mean0.6683690295539942
driven_lanedir_median0.7157697011236979
driven_lanedir_min0.2241193320471978
in-drivable-lane_max0.04999999999999982
in-drivable-lane_mean0.009999999999999964
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7415069526187248, "sim_physics": 0.013830022017161051, "survival_time": 2.9999999999999973, "driven_lanedir": 0.7157697011236979, "sim_render-ego": 0.03590603272120158, "in-drivable-lane": 0, "agent_compute-ego": 0.08441731135050455, "deviation-heading": 0.5819250435314811, "set_robot_commands": 0.05428593953450521, "deviation-center-line": 0.23704537675561177, "driven_lanedir_consec": 0.7157697011236979, "sim_compute_sim_state": 0.022181475162506105, "sim_compute_performance-ego": 0.038554712136586504, "sim_compute_robot_state-ego": 0.04653525749842326}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2521905708737723, "sim_physics": 0.012557319972826086, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2241193320471978, "sim_render-ego": 0.03400087356567383, "in-drivable-lane": 0, "agent_compute-ego": 0.08217898659084154, "deviation-heading": 0.4153718610881797, "set_robot_commands": 0.05443942028543224, "deviation-center-line": 0.06782071622287905, "driven_lanedir_consec": 0.2241193320471978, "sim_compute_sim_state": 0.02195844442948051, "sim_compute_performance-ego": 0.03753157283948815, "sim_compute_robot_state-ego": 0.03885209042093028}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7462427298960345, "sim_physics": 0.012426763772964478, "survival_time": 2.3999999999999995, "driven_lanedir": 0.671032190486883, "sim_render-ego": 0.034855092565218605, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.08395916720231374, "deviation-heading": 0.7148788097193758, "set_robot_commands": 0.05435678859551748, "deviation-center-line": 0.15455893108765126, "driven_lanedir_consec": 0.671032190486883, "sim_compute_sim_state": 0.0222582866748174, "sim_compute_performance-ego": 0.0378873348236084, "sim_compute_robot_state-ego": 0.038962731758753456}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0461131967100066, "sim_physics": 0.014426899544986676, "survival_time": 4.049999999999994, "driven_lanedir": 0.9903600843233328, "sim_render-ego": 0.035378620948320554, "in-drivable-lane": 0, "agent_compute-ego": 0.08268656259701576, "deviation-heading": 1.0294008730754531, "set_robot_commands": 0.05450933362230843, "deviation-center-line": 0.31013597737792836, "driven_lanedir_consec": 0.9903600843233328, "sim_compute_sim_state": 0.022132381980801807, "sim_compute_performance-ego": 0.037948378810176146, "sim_compute_robot_state-ego": 0.03916792810699086}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7822015463573803, "sim_physics": 0.013658701105320708, "survival_time": 2.3499999999999996, "driven_lanedir": 0.7405638397888596, "sim_render-ego": 0.0358350175492307, "in-drivable-lane": 0, "agent_compute-ego": 0.08278140615909657, "deviation-heading": 0.5644628798347927, "set_robot_commands": 0.05471428404463098, "deviation-center-line": 0.0940614166133459, "driven_lanedir_consec": 0.7405638397888596, "sim_compute_sim_state": 0.022147381559331367, "sim_compute_performance-ego": 0.0379575161223716, "sim_compute_robot_state-ego": 0.0390587309573559}}
set_robot_commands_max0.05471428404463098
set_robot_commands_mean0.05446115321647886
set_robot_commands_median0.05443942028543224
set_robot_commands_min0.05428593953450521
sim_compute_performance-ego_max0.038554712136586504
sim_compute_performance-ego_mean0.03797590294644616
sim_compute_performance-ego_median0.037948378810176146
sim_compute_performance-ego_min0.03753157283948815
sim_compute_robot_state-ego_max0.04653525749842326
sim_compute_robot_state-ego_mean0.04051534774849075
sim_compute_robot_state-ego_median0.0390587309573559
sim_compute_robot_state-ego_min0.03885209042093028
sim_compute_sim_state_max0.0222582866748174
sim_compute_sim_state_mean0.022135593961387437
sim_compute_sim_state_median0.022147381559331367
sim_compute_sim_state_min0.02195844442948051
sim_physics_max0.014426899544986676
sim_physics_mean0.0133799412826518
sim_physics_median0.013658701105320708
sim_physics_min0.012426763772964478
sim_render-ego_max0.03590603272120158
sim_render-ego_mean0.035195127469929054
sim_render-ego_median0.035378620948320554
sim_render-ego_min0.03400087356567383
simulation-passed1
survival_time_max4.049999999999994
survival_time_mean2.589999999999998
survival_time_min1.1500000000000004
No reset possible
196692374Liam Paull 🇨🇦minimal_agent (Python 3)aido2-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-38-104-80540:20:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6900582707828695
survival_time_median14.700000000000074
deviation-center-line_median0.3591683262706219
in-drivable-lane_median1.200000000000017


other stats
agent_compute-ego_max0.14696917399554185
agent_compute-ego_mean0.124354321418425
agent_compute-ego_median0.12259139691369007
agent_compute-ego_min0.1013140225932546
deviation-center-line_max0.5528244200733968
deviation-center-line_mean0.3250388716749043
deviation-center-line_min0.12474392863155234
deviation-heading_max1.7841667326335335
deviation-heading_mean1.0687591038626745
deviation-heading_median0.9805073681793997
deviation-heading_min0.6869591234399757
driven_any_max2.196039556148948
driven_any_mean1.706254237612001
driven_any_median2.1660738591449116
driven_any_min0.9910472848979056
driven_lanedir_consec_max1.8205635516580176
driven_lanedir_consec_mean1.3480125540484669
driven_lanedir_consec_min0.616683423521228
driven_lanedir_max2.1929637182965305
driven_lanedir_mean1.482287538796306
driven_lanedir_median1.8205635516580176
driven_lanedir_min0.616683423521228
in-drivable-lane_max2.3999999999999915
in-drivable-lane_mean1.250000000000006
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.1660738591449116, "sim_physics": 0.03725821144726812, "survival_time": 14.700000000000074, "driven_lanedir": 1.961201560444252, "sim_render-ego": 0.05845983255477179, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.1444408617863039, "deviation-heading": 0.9805073681793997, "set_robot_commands": 0.0911146353702156, "deviation-center-line": 0.3591683262706219, "driven_lanedir_consec": 1.6900582707828695, "sim_compute_sim_state": 0.03589114121028355, "sim_compute_performance-ego": 0.06399245732495575, "sim_compute_robot_state-ego": 0.06617054890613167, "sim_compute_robot_state-npc0": 0.0632476011912028, "sim_compute_robot_state-npc1": 0.0636490267150256, "sim_compute_robot_state-npc2": 0.06188009223159479, "sim_compute_robot_state-npc3": 0.061808716683160694}, "udem1-1-0": {"driven_any": 1.0094322716915194, "sim_physics": 0.04102036147050454, "survival_time": 7.099999999999983, "driven_lanedir": 0.616683423521228, "sim_render-ego": 0.05748738033670775, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.14696917399554185, "deviation-heading": 0.7757170340260829, "set_robot_commands": 0.09246191508333448, "deviation-center-line": 0.12474392863155234, "driven_lanedir_consec": 0.616683423521228, "sim_compute_sim_state": 0.03688974615553735, "sim_compute_performance-ego": 0.06358416987137055, "sim_compute_robot_state-ego": 0.0678701014585898, "sim_compute_robot_state-npc0": 0.06572524594589019, "sim_compute_robot_state-npc1": 0.06466220130383128, "sim_compute_robot_state-npc2": 0.06537391937954325, "sim_compute_robot_state-npc3": 0.06627774574387242}, "udem1-2-0": {"driven_any": 2.168678216176718, "sim_physics": 0.03291701381489382, "survival_time": 14.750000000000076, "driven_lanedir": 1.8205635516580176, "sim_render-ego": 0.049820088532011385, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.12259139691369007, "deviation-heading": 1.7841667326335335, "set_robot_commands": 0.07996160458710234, "deviation-center-line": 0.38105433778148035, "driven_lanedir_consec": 1.8205635516580176, "sim_compute_sim_state": 0.0313636214046155, "sim_compute_performance-ego": 0.05355877876281738, "sim_compute_robot_state-ego": 0.05576996884103549, "sim_compute_robot_state-npc0": 0.05440357903302726, "sim_compute_robot_state-npc1": 0.05537224704936399, "sim_compute_robot_state-npc2": 0.055668169765149135, "sim_compute_robot_state-npc3": 0.05539805040521137}, "udem1-3-0": {"driven_any": 2.196039556148948, "sim_physics": 0.02702465295791626, "survival_time": 14.950000000000076, "driven_lanedir": 2.1929637182965305, "sim_render-ego": 0.04301705757776896, "in-drivable-lane": 0, "agent_compute-ego": 0.10645615180333456, "deviation-heading": 0.6869591234399757, "set_robot_commands": 0.0681262477238973, "deviation-center-line": 0.5528244200733968, "driven_lanedir_consec": 1.792732084218717, "sim_compute_sim_state": 0.02661114851633708, "sim_compute_performance-ego": 0.046172073682149255, "sim_compute_robot_state-ego": 0.04733540932337443, "sim_compute_robot_state-npc0": 0.04921907424926758, "sim_compute_robot_state-npc1": 0.04813600460688273, "sim_compute_robot_state-npc2": 0.04677481730779012, "sim_compute_robot_state-npc3": 0.046840092341105144}, "udem1-4-0": {"driven_any": 0.9910472848979056, "sim_physics": 0.02420314037016709, "survival_time": 6.849999999999984, "driven_lanedir": 0.8200254400615028, "sim_render-ego": 0.038628893177004624, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.1013140225932546, "deviation-heading": 1.116445261034381, "set_robot_commands": 0.06420979012538047, "deviation-center-line": 0.20740334561747012, "driven_lanedir_consec": 0.8200254400615028, "sim_compute_sim_state": 0.023591673287161944, "sim_compute_performance-ego": 0.04161184025506904, "sim_compute_robot_state-ego": 0.04186083800601263, "sim_compute_robot_state-npc0": 0.04418502410832983, "sim_compute_robot_state-npc1": 0.04357928081150472, "sim_compute_robot_state-npc2": 0.04292478526595735, "sim_compute_robot_state-npc3": 0.042132633445906814}}
set_robot_commands_max0.09246191508333448
set_robot_commands_mean0.07917483857798605
set_robot_commands_median0.07996160458710234
set_robot_commands_min0.06420979012538047
sim_compute_performance-ego_max0.06399245732495575
sim_compute_performance-ego_mean0.053783863979272394
sim_compute_performance-ego_median0.05355877876281738
sim_compute_performance-ego_min0.04161184025506904
sim_compute_robot_state-ego_max0.0678701014585898
sim_compute_robot_state-ego_mean0.0558013733070288
sim_compute_robot_state-ego_median0.05576996884103549
sim_compute_robot_state-ego_min0.04186083800601263
sim_compute_robot_state-npc0_max0.06572524594589019
sim_compute_robot_state-npc0_mean0.05535610490554353
sim_compute_robot_state-npc0_median0.05440357903302726
sim_compute_robot_state-npc0_min0.04418502410832983
sim_compute_robot_state-npc1_max0.06466220130383128
sim_compute_robot_state-npc1_mean0.05507975209732167
sim_compute_robot_state-npc1_median0.05537224704936399
sim_compute_robot_state-npc1_min0.04357928081150472
sim_compute_robot_state-npc2_max0.06537391937954325
sim_compute_robot_state-npc2_mean0.05452435679000693
sim_compute_robot_state-npc2_median0.055668169765149135
sim_compute_robot_state-npc2_min0.04292478526595735
sim_compute_robot_state-npc3_max0.06627774574387242
sim_compute_robot_state-npc3_mean0.05449144772385128
sim_compute_robot_state-npc3_median0.05539805040521137
sim_compute_robot_state-npc3_min0.042132633445906814
sim_compute_sim_state_max0.03688974615553735
sim_compute_sim_state_mean0.03086946611478708
sim_compute_sim_state_median0.0313636214046155
sim_compute_sim_state_min0.023591673287161944
sim_physics_max0.04102036147050454
sim_physics_mean0.03248467601214996
sim_physics_median0.03291701381489382
sim_physics_min0.02420314037016709
sim_render-ego_max0.05845983255477179
sim_render-ego_mean0.049482650435652906
sim_render-ego_median0.049820088532011385
sim_render-ego_min0.038628893177004624
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.67000000000004
survival_time_min6.849999999999984
No reset possible
196562387Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-38-104-80540:05:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06250397767452975
survival_time_median1.5500000000000007
deviation-center-line_median0.030573157092336233
in-drivable-lane_median0.4500000000000004


other stats
agent_compute-ego_max0.1730713515446104
agent_compute-ego_mean0.1543377437353481
agent_compute-ego_median0.16611700673257151
agent_compute-ego_min0.12750367964467696
deviation-center-line_max0.051804362428377305
deviation-center-line_mean0.03249589851155763
deviation-center-line_min0.022246819479622856
deviation-heading_max0.695130265439951
deviation-heading_mean0.6188490993776077
deviation-heading_median0.6320758088617918
deviation-heading_min0.5549671911329761
driven_any_max0.1714742099440101
driven_any_mean0.16337218336408224
driven_any_median0.1637779329041015
driven_any_min0.15506140681018937
driven_lanedir_consec_max0.10495631101882852
driven_lanedir_consec_mean0.06857741962385618
driven_lanedir_consec_min0.05400560759998796
driven_lanedir_max0.10495631101882852
driven_lanedir_mean0.06857741962385618
driven_lanedir_median0.06250397767452975
driven_lanedir_min0.05400560759998796
in-drivable-lane_max0.5500000000000005
in-drivable-lane_mean0.4000000000000003
in-drivable-lane_min0.05000000000000005
per-episodes
details{"udem1-0-0": {"driven_any": 0.1714742099440101, "sim_physics": 0.0373193621635437, "survival_time": 1.6000000000000008, "driven_lanedir": 0.06642391629546185, "sim_render-ego": 0.058997318148612976, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.16847607493400574, "deviation-heading": 0.6463014757759601, "set_robot_commands": 0.095756433904171, "deviation-center-line": 0.03385854968943623, "driven_lanedir_consec": 0.06642391629546185, "sim_compute_sim_state": 0.036262184381484985, "sim_compute_performance-ego": 0.06680025160312653, "sim_compute_robot_state-ego": 0.07224055379629135, "sim_compute_robot_state-npc0": 0.06358056515455246, "sim_compute_robot_state-npc1": 0.06529569625854492, "sim_compute_robot_state-npc2": 0.06236310303211212, "sim_compute_robot_state-npc3": 0.06662531197071075}, "udem1-1-0": {"driven_any": 0.16960186824690598, "sim_physics": 0.04137915949667654, "survival_time": 1.5500000000000007, "driven_lanedir": 0.06250397767452975, "sim_render-ego": 0.06111900268062469, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.16611700673257151, "deviation-heading": 0.6320758088617918, "set_robot_commands": 0.09640106078117124, "deviation-center-line": 0.030573157092336233, "driven_lanedir_consec": 0.06250397767452975, "sim_compute_sim_state": 0.037883535508186586, "sim_compute_performance-ego": 0.06193924719287503, "sim_compute_robot_state-ego": 0.0653395575861777, "sim_compute_robot_state-npc0": 0.06805636036780573, "sim_compute_robot_state-npc1": 0.0679408965572234, "sim_compute_robot_state-npc2": 0.067213196908274, "sim_compute_robot_state-npc3": 0.06631728141538558}, "udem1-2-0": {"driven_any": 0.15506140681018937, "sim_physics": 0.041201155761192584, "survival_time": 1.4500000000000006, "driven_lanedir": 0.054997285530472784, "sim_render-ego": 0.06230785928923508, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.1730713515446104, "deviation-heading": 0.5657707556773597, "set_robot_commands": 0.09499507114805024, "deviation-center-line": 0.023996603868015543, "driven_lanedir_consec": 0.054997285530472784, "sim_compute_sim_state": 0.035277901024653995, "sim_compute_performance-ego": 0.06439191719581341, "sim_compute_robot_state-ego": 0.06660027339540679, "sim_compute_robot_state-npc0": 0.06387730302481816, "sim_compute_robot_state-npc1": 0.0652224113201273, "sim_compute_robot_state-npc2": 0.06515925506065631, "sim_compute_robot_state-npc3": 0.06761153813066154}, "udem1-3-0": {"driven_any": 0.15694549891520423, "sim_physics": 0.03077203227627662, "survival_time": 1.5500000000000007, "driven_lanedir": 0.05400560759998796, "sim_render-ego": 0.046098686033679594, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.12750367964467696, "deviation-heading": 0.5549671911329761, "set_robot_commands": 0.06921187523872621, "deviation-center-line": 0.022246819479622856, "driven_lanedir_consec": 0.05400560759998796, "sim_compute_sim_state": 0.02736296192292244, "sim_compute_performance-ego": 0.0486242002056491, "sim_compute_robot_state-ego": 0.05015996194654895, "sim_compute_robot_state-npc0": 0.047317297227921024, "sim_compute_robot_state-npc1": 0.0482042912513979, "sim_compute_robot_state-npc2": 0.04890757991421607, "sim_compute_robot_state-npc3": 0.049518208349904703}, "udem1-4-0": {"driven_any": 0.1637779329041015, "sim_physics": 0.03800619565523588, "survival_time": 1.3000000000000005, "driven_lanedir": 0.10495631101882852, "sim_render-ego": 0.05346322976625883, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1365206058208759, "deviation-heading": 0.695130265439951, "set_robot_commands": 0.07967455570514385, "deviation-center-line": 0.051804362428377305, "driven_lanedir_consec": 0.10495631101882852, "sim_compute_sim_state": 0.033838510513305664, "sim_compute_performance-ego": 0.06111629192645733, "sim_compute_robot_state-ego": 0.06150760100438045, "sim_compute_robot_state-npc0": 0.05703405233529898, "sim_compute_robot_state-npc1": 0.05582927740537203, "sim_compute_robot_state-npc2": 0.060129679166353665, "sim_compute_robot_state-npc3": 0.05962676268357497}}
set_robot_commands_max0.09640106078117124
set_robot_commands_mean0.08720779935545252
set_robot_commands_median0.09499507114805024
set_robot_commands_min0.06921187523872621
sim_compute_performance-ego_max0.06680025160312653
sim_compute_performance-ego_mean0.06057438162478427
sim_compute_performance-ego_median0.06193924719287503
sim_compute_performance-ego_min0.0486242002056491
sim_compute_robot_state-ego_max0.07224055379629135
sim_compute_robot_state-ego_mean0.06316958954576106
sim_compute_robot_state-ego_median0.0653395575861777
sim_compute_robot_state-ego_min0.05015996194654895
sim_compute_robot_state-npc0_max0.06805636036780573
sim_compute_robot_state-npc0_mean0.059973115622079264
sim_compute_robot_state-npc0_median0.06358056515455246
sim_compute_robot_state-npc0_min0.047317297227921024
sim_compute_robot_state-npc1_max0.0679408965572234
sim_compute_robot_state-npc1_mean0.06049851455853311
sim_compute_robot_state-npc1_median0.0652224113201273
sim_compute_robot_state-npc1_min0.0482042912513979
sim_compute_robot_state-npc2_max0.067213196908274
sim_compute_robot_state-npc2_mean0.06075456281632243
sim_compute_robot_state-npc2_median0.06236310303211212
sim_compute_robot_state-npc2_min0.04890757991421607
sim_compute_robot_state-npc3_max0.06761153813066154
sim_compute_robot_state-npc3_mean0.061939820510047504
sim_compute_robot_state-npc3_median0.06631728141538558
sim_compute_robot_state-npc3_min0.049518208349904703
sim_compute_sim_state_max0.037883535508186586
sim_compute_sim_state_mean0.03412501867011074
sim_compute_sim_state_median0.035277901024653995
sim_compute_sim_state_min0.02736296192292244
sim_physics_max0.04137915949667654
sim_physics_mean0.03773558107058507
sim_physics_median0.03800619565523588
sim_physics_min0.03077203227627662
sim_render-ego_max0.06230785928923508
sim_render-ego_mean0.056397219183682235
sim_render-ego_median0.058997318148612976
sim_render-ego_min0.046098686033679594
simulation-passed1
survival_time_max1.6000000000000008
survival_time_mean1.4900000000000009
survival_time_min1.3000000000000005
No reset possible
196242448Nicky EichmannBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessnoip-172-31-38-104-80540:27:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.361452200425545
survival_time_median14.950000000000076
deviation-center-line_median1.011969887428033
in-drivable-lane_median4.050000000000022


other stats
agent_compute-ego_max0.15984177668889363
agent_compute-ego_mean0.14737123950322467
agent_compute-ego_median0.15024606386820474
agent_compute-ego_min0.13072726964950562
deviation-center-line_max1.0119698874280334
deviation-center-line_mean1.0119697532537184
deviation-center-line_min1.0119693200897375
deviation-heading_max6.81542792438532
deviation-heading_mean6.81542792438532
deviation-heading_median6.815427924385319
deviation-heading_min6.815427924385319
driven_any_max4.3908241527849325
driven_any_mean4.390824152784925
driven_any_median4.390824152784922
driven_any_min4.390824152784921
driven_lanedir_consec_max-1.3614496374256428
driven_lanedir_consec_mean-1.3614540243276398
driven_lanedir_consec_min-1.3614583993086016
driven_lanedir_max-2.3158123434400073
driven_lanedir_mean-2.3158154428816067
driven_lanedir_median-2.315814608416598
driven_lanedir_min-2.3158179462767055
in-drivable-lane_max4.050000000000022
in-drivable-lane_mean4.050000000000022
in-drivable-lane_min4.050000000000022
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.39082415278493, "sim_physics": 0.03515132268269857, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158179462767055, "sim_render-ego": 0.05810791412989298, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.15984177668889363, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.09060070196787516, "deviation-center-line": 1.0119698874280334, "driven_lanedir_consec": -1.3614583993086016, "sim_compute_sim_state": 0.03648718516031901, "sim_compute_performance-ego": 0.06372979879379273, "sim_compute_robot_state-ego": 0.06785923639933268, "sim_compute_robot_state-npc0": 0.0640403699874878, "sim_compute_robot_state-npc1": 0.06342065572738648, "sim_compute_robot_state-npc2": 0.06382303794225057, "sim_compute_robot_state-npc3": 0.06385458230972291}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.3908241527849325, "sim_physics": 0.027764931519826255, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158177078581264, "sim_render-ego": 0.04810751835505168, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.13072726964950562, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.07788371324539184, "deviation-center-line": 1.0119697838947552, "driven_lanedir_consec": -1.3614576840528645, "sim_compute_sim_state": 0.02988925536473592, "sim_compute_performance-ego": 0.051010363896687824, "sim_compute_robot_state-ego": 0.05414000988006592, "sim_compute_robot_state-npc0": 0.05479250351587931, "sim_compute_robot_state-npc1": 0.0535907785097758, "sim_compute_robot_state-npc2": 0.05250390529632568, "sim_compute_robot_state-npc3": 0.053332165877024336}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.390824152784922, "sim_physics": 0.03156455596288045, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.05358941555023193, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.14259749174118042, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.08196475903193155, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.03220351696014404, "sim_compute_performance-ego": 0.057098484834035235, "sim_compute_robot_state-ego": 0.05919091860453288, "sim_compute_robot_state-npc0": 0.05725210905075073, "sim_compute_robot_state-npc1": 0.05680520137151082, "sim_compute_robot_state-npc2": 0.05728218555450439, "sim_compute_robot_state-npc3": 0.05733437856038411}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.390824152784922, "sim_physics": 0.032047954400380455, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.05383769114812215, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.15024606386820474, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.08273054122924804, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.03333012501398722, "sim_compute_performance-ego": 0.058685912291208904, "sim_compute_robot_state-ego": 0.06126601219177246, "sim_compute_robot_state-npc0": 0.05856253782908122, "sim_compute_robot_state-npc1": 0.058657828172047934, "sim_compute_robot_state-npc2": 0.05834691286087036, "sim_compute_robot_state-npc3": 0.0585590132077535}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.390824152784921, "sim_physics": 0.03347968657811483, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158123434400073, "sim_render-ego": 0.05633100668589274, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.15344359556833903, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.08467065016428629, "deviation-center-line": 1.0119693200897375, "driven_lanedir_consec": -1.3614496374256428, "sim_compute_sim_state": 0.03404191096623738, "sim_compute_performance-ego": 0.06065035263697306, "sim_compute_robot_state-ego": 0.06458023468653361, "sim_compute_robot_state-npc0": 0.060951884587605795, "sim_compute_robot_state-npc1": 0.06183581829071045, "sim_compute_robot_state-npc2": 0.06509930928548177, "sim_compute_robot_state-npc3": 0.06204607884089152}}
set_robot_commands_max0.09060070196787516
set_robot_commands_mean0.08357007312774659
set_robot_commands_median0.08273054122924804
set_robot_commands_min0.07788371324539184
sim_compute_performance-ego_max0.06372979879379273
sim_compute_performance-ego_mean0.058234982490539544
sim_compute_performance-ego_median0.058685912291208904
sim_compute_performance-ego_min0.051010363896687824
sim_compute_robot_state-ego_max0.06785923639933268
sim_compute_robot_state-ego_mean0.06140728235244751
sim_compute_robot_state-ego_median0.06126601219177246
sim_compute_robot_state-ego_min0.05414000988006592
sim_compute_robot_state-npc0_max0.0640403699874878
sim_compute_robot_state-npc0_mean0.05911988099416097
sim_compute_robot_state-npc0_median0.05856253782908122
sim_compute_robot_state-npc0_min0.05479250351587931
sim_compute_robot_state-npc1_max0.06342065572738648
sim_compute_robot_state-npc1_mean0.0588620564142863
sim_compute_robot_state-npc1_median0.058657828172047934
sim_compute_robot_state-npc1_min0.0535907785097758
sim_compute_robot_state-npc2_max0.06509930928548177
sim_compute_robot_state-npc2_mean0.05941107018788656
sim_compute_robot_state-npc2_median0.05834691286087036
sim_compute_robot_state-npc2_min0.05250390529632568
sim_compute_robot_state-npc3_max0.06385458230972291
sim_compute_robot_state-npc3_mean0.05902524375915528
sim_compute_robot_state-npc3_median0.0585590132077535
sim_compute_robot_state-npc3_min0.053332165877024336
sim_compute_sim_state_max0.03648718516031901
sim_compute_sim_state_mean0.03319039869308472
sim_compute_sim_state_median0.03333012501398722
sim_compute_sim_state_min0.02988925536473592
sim_physics_max0.03515132268269857
sim_physics_mean0.03200169022878011
sim_physics_median0.032047954400380455
sim_physics_min0.027764931519826255
sim_render-ego_max0.05810791412989298
sim_render-ego_mean0.05399470917383829
sim_render-ego_median0.05383769114812215
sim_render-ego_min0.04810751835505168
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
196142420Andrea Censi 🇨🇭random_agentaido2-LFV-sim-testingstep1-simulationhost-errornoip-172-31-38-104-80540:01:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19614-659069', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19614-659069', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19614-659069', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
196092429Andrea Censi 🇨🇭random_agentaido2-LF-sim-validationstep1-simulationerrornoip-172-31-38-104-80540:00:29
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
196062433Andrea Censi 🇨🇭random_agentaido2-LFV-sim-validationstep1-simulationerrornoip-172-31-38-104-80540:00:48
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195632500Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-38-104-80540:09:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06932541990502461
survival_time_median1.5500000000000007
deviation-center-line_median0.02976830699675767
in-drivable-lane_median0.5000000000000004


other stats
agent_compute-ego_max0.1812804668180404
agent_compute-ego_mean0.15536110898948485
agent_compute-ego_median0.15783026069402695
agent_compute-ego_min0.1284027022700156
deviation-center-line_max0.5523524483577869
deviation-center-line_mean0.13398243928680592
deviation-center-line_min0.02245956537917439
deviation-heading_max5.435133748922003
deviation-heading_mean1.5820883301909965
deviation-heading_median0.632449296150344
deviation-heading_min0.5626289240153576
driven_any_max1.551542735402312
driven_any_mean0.43884924720751606
driven_any_median0.1684896389275625
driven_any_min0.14283428173200993
driven_lanedir_consec_max0.4813952877215952
driven_lanedir_consec_mean0.1474722402422306
driven_lanedir_consec_min0.0517530912657187
driven_lanedir_max0.4813952877215952
driven_lanedir_mean0.1474722402422306
driven_lanedir_median0.06932541990502461
driven_lanedir_min0.0517530912657187
in-drivable-lane_max7.850000000000047
in-drivable-lane_mean1.9500000000000095
in-drivable-lane_min0.4000000000000003
per-episodes
details{"udem1-0-0": {"driven_any": 1.551542735402312, "sim_physics": 0.03526180108388265, "survival_time": 14.950000000000076, "driven_lanedir": 0.4813952877215952, "sim_render-ego": 0.05488410711288452, "in-drivable-lane": 7.850000000000047, "agent_compute-ego": 0.17019198656082157, "deviation-heading": 5.435133748922003, "set_robot_commands": 0.0883458669980367, "deviation-center-line": 0.5523524483577869, "driven_lanedir_consec": 0.4813952877215952, "sim_compute_sim_state": 0.03802519083023071, "sim_compute_performance-ego": 0.05743284940719604, "sim_compute_robot_state-ego": 0.06035141865412394, "sim_compute_robot_state-npc0": 0.0654735517501831, "sim_compute_robot_state-npc1": 0.06047542810440063, "sim_compute_robot_state-npc2": 0.05829337994257609, "sim_compute_robot_state-npc3": 0.06491401751836141}, "udem1-1-0": {"driven_any": 0.17714190282868275, "sim_physics": 0.034427604367656094, "survival_time": 1.5500000000000007, "driven_lanedir": 0.07987095954018875, "sim_render-ego": 0.05169911538400958, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.13910012860451976, "deviation-heading": 0.5788526687873309, "set_robot_commands": 0.07971279082759734, "deviation-center-line": 0.02976830699675767, "driven_lanedir_consec": 0.07987095954018875, "sim_compute_sim_state": 0.03261671527739494, "sim_compute_performance-ego": 0.052452256602625695, "sim_compute_robot_state-ego": 0.05470869618077432, "sim_compute_robot_state-npc0": 0.054637685898811586, "sim_compute_robot_state-npc1": 0.05359262804831228, "sim_compute_robot_state-npc2": 0.05478391339701991, "sim_compute_robot_state-npc3": 0.05558347702026367}, "udem1-2-0": {"driven_any": 0.14283428173200993, "sim_physics": 0.03076840216113675, "survival_time": 1.5500000000000007, "driven_lanedir": 0.0517530912657187, "sim_render-ego": 0.044355777002150015, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1284027022700156, "deviation-heading": 0.632449296150344, "set_robot_commands": 0.06698616089359406, "deviation-center-line": 0.02749388905594616, "driven_lanedir_consec": 0.0517530912657187, "sim_compute_sim_state": 0.027329844813193043, "sim_compute_performance-ego": 0.04672059705180506, "sim_compute_robot_state-ego": 0.047768392870503086, "sim_compute_robot_state-npc0": 0.04788558713851437, "sim_compute_robot_state-npc1": 0.04415264437275549, "sim_compute_robot_state-npc2": 0.04607774365332819, "sim_compute_robot_state-npc3": 0.047096683133033015}, "udem1-3-0": {"driven_any": 0.1684896389275625, "sim_physics": 0.038963571671516664, "survival_time": 1.5500000000000007, "driven_lanedir": 0.06932541990502461, "sim_render-ego": 0.06359169560094033, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1812804668180404, "deviation-heading": 0.7013770130799469, "set_robot_commands": 0.09794845119599371, "deviation-center-line": 0.03783798664436448, "driven_lanedir_consec": 0.06932541990502461, "sim_compute_sim_state": 0.03646628318294402, "sim_compute_performance-ego": 0.07528113549755465, "sim_compute_robot_state-ego": 0.06748663225481587, "sim_compute_robot_state-npc0": 0.06466517909880608, "sim_compute_robot_state-npc1": 0.06282246497369581, "sim_compute_robot_state-npc2": 0.06399591507450227, "sim_compute_robot_state-npc3": 0.06333229618687783}, "udem1-4-0": {"driven_any": 0.15423767714701314, "sim_physics": 0.03606497496366501, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05501644277862572, "sim_render-ego": 0.05310641974210739, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.15783026069402695, "deviation-heading": 0.5626289240153576, "set_robot_commands": 0.082008495926857, "deviation-center-line": 0.02245956537917439, "driven_lanedir_consec": 0.05501644277862572, "sim_compute_sim_state": 0.034437790513038635, "sim_compute_performance-ego": 0.05741818994283676, "sim_compute_robot_state-ego": 0.06282050907611847, "sim_compute_robot_state-npc0": 0.057196103036403656, "sim_compute_robot_state-npc1": 0.06087677180767059, "sim_compute_robot_state-npc2": 0.05959013104438782, "sim_compute_robot_state-npc3": 0.05849273502826691}}
set_robot_commands_max0.09794845119599371
set_robot_commands_mean0.08300035316841577
set_robot_commands_median0.082008495926857
set_robot_commands_min0.06698616089359406
sim_compute_performance-ego_max0.07528113549755465
sim_compute_performance-ego_mean0.057861005700403645
sim_compute_performance-ego_median0.05741818994283676
sim_compute_performance-ego_min0.04672059705180506
sim_compute_robot_state-ego_max0.06748663225481587
sim_compute_robot_state-ego_mean0.05862712980726713
sim_compute_robot_state-ego_median0.06035141865412394
sim_compute_robot_state-ego_min0.047768392870503086
sim_compute_robot_state-npc0_max0.0654735517501831
sim_compute_robot_state-npc0_mean0.05797162138454376
sim_compute_robot_state-npc0_median0.057196103036403656
sim_compute_robot_state-npc0_min0.04788558713851437
sim_compute_robot_state-npc1_max0.06282246497369581
sim_compute_robot_state-npc1_mean0.056383987461366955
sim_compute_robot_state-npc1_median0.06047542810440063
sim_compute_robot_state-npc1_min0.04415264437275549
sim_compute_robot_state-npc2_max0.06399591507450227
sim_compute_robot_state-npc2_mean0.056548216622362854
sim_compute_robot_state-npc2_median0.05829337994257609
sim_compute_robot_state-npc2_min0.04607774365332819
sim_compute_robot_state-npc3_max0.06491401751836141
sim_compute_robot_state-npc3_mean0.05788384177736057
sim_compute_robot_state-npc3_median0.05849273502826691
sim_compute_robot_state-npc3_min0.047096683133033015
sim_compute_sim_state_max0.03802519083023071
sim_compute_sim_state_mean0.03377516492336027
sim_compute_sim_state_median0.034437790513038635
sim_compute_sim_state_min0.027329844813193043
sim_physics_max0.038963571671516664
sim_physics_mean0.03509727084957144
sim_physics_median0.03526180108388265
sim_physics_min0.03076840216113675
sim_render-ego_max0.06359169560094033
sim_render-ego_mean0.05352742296841837
sim_render-ego_median0.05310641974210739
sim_render-ego_min0.044355777002150015
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean4.240000000000016
survival_time_min1.5500000000000007
No reset possible
195442528Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LF-sim-testingstep1-simulationerrornoip-172-31-38-104-80540:02:22
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195342538Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrornoip-172-31-38-104-80540:02:09
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
194902598Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-38-104-80540:17:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.177285395289443
survival_time_median14.950000000000076
deviation-center-line_median1.042586759550595
in-drivable-lane_median2.0000000000000124


other stats
agent_compute-ego_max0.07659868876139322
agent_compute-ego_mean0.07472287054088603
agent_compute-ego_median0.07447521225744937
agent_compute-ego_min0.07239107131958007
deviation-center-line_max1.1458701765582588
deviation-center-line_mean0.8735473633828403
deviation-center-line_min0.19112317915112173
deviation-heading_max6.820564690693029
deviation-heading_mean4.303029287808786
deviation-heading_median3.3392886560483857
deviation-heading_min1.5769547747132515
driven_any_max2.3556774769756066
driven_any_mean2.063994816978094
driven_any_median2.355074217494031
driven_any_min0.9090801038753694
driven_lanedir_consec_max2.2611439193707783
driven_lanedir_consec_mean1.3716266314676104
driven_lanedir_consec_min0.4056449447220096
driven_lanedir_max2.2611439193707783
driven_lanedir_mean1.6032864379845826
driven_lanedir_median1.6648678486073911
driven_lanedir_min0.4056449447220096
in-drivable-lane_max2.5500000000000203
in-drivable-lane_mean1.5300000000000042
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.344895003587564, "sim_physics": 0.02174866835276286, "survival_time": 14.950000000000076, "driven_lanedir": 2.2611439193707783, "sim_render-ego": 0.05533046086629232, "in-drivable-lane": 0, "agent_compute-ego": 0.07659868876139322, "deviation-heading": 3.337710107951181, "set_robot_commands": 0.08499777714411418, "deviation-center-line": 1.0601789579695955, "driven_lanedir_consec": 2.2611439193707783, "sim_compute_sim_state": 0.033864699204762774, "sim_compute_performance-ego": 0.059827430248260496, "sim_compute_robot_state-ego": 0.0627977999051412}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3556774769756066, "sim_physics": 0.02299911101659139, "survival_time": 14.950000000000076, "driven_lanedir": 2.1782457165960305, "sim_render-ego": 0.06045380353927613, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.07416653553644816, "deviation-heading": 3.3392886560483857, "set_robot_commands": 0.09688610474268596, "deviation-center-line": 1.1458701765582588, "driven_lanedir_consec": 2.1782457165960305, "sim_compute_sim_state": 0.037596909205118816, "sim_compute_performance-ego": 0.06734742561976115, "sim_compute_robot_state-ego": 0.07041957855224609}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3552472829579, "sim_physics": 0.023936814467112225, "survival_time": 14.950000000000076, "driven_lanedir": 1.6648678486073911, "sim_render-ego": 0.06152062813440959, "in-drivable-lane": 2.0000000000000124, "agent_compute-ego": 0.07598284482955933, "deviation-heading": 6.440628209638086, "set_robot_commands": 0.09833296219507852, "deviation-center-line": 0.9279777436846308, "driven_lanedir_consec": 1.177285395289443, "sim_compute_sim_state": 0.03809566974639893, "sim_compute_performance-ego": 0.06855262200037639, "sim_compute_robot_state-ego": 0.07175386587778727}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9090801038753694, "sim_physics": 0.025666170761364848, "survival_time": 5.949999999999987, "driven_lanedir": 0.4056449447220096, "sim_render-ego": 0.06281457828874347, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.07447521225744937, "deviation-heading": 1.5769547747132515, "set_robot_commands": 0.09253838082321553, "deviation-center-line": 0.19112317915112173, "driven_lanedir_consec": 0.4056449447220096, "sim_compute_sim_state": 0.037833884984505274, "sim_compute_performance-ego": 0.06993378510996073, "sim_compute_robot_state-ego": 0.07296467628799566}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.355074217494031, "sim_physics": 0.02305680751800537, "survival_time": 14.950000000000076, "driven_lanedir": 1.5065297606267043, "sim_render-ego": 0.059023324648539224, "in-drivable-lane": 2.5500000000000203, "agent_compute-ego": 0.07239107131958007, "deviation-heading": 6.820564690693029, "set_robot_commands": 0.09321588118871052, "deviation-center-line": 1.042586759550595, "driven_lanedir_consec": 0.8358131813597915, "sim_compute_sim_state": 0.03793955723444621, "sim_compute_performance-ego": 0.0663619836171468, "sim_compute_robot_state-ego": 0.06790700515111288}}
set_robot_commands_max0.09833296219507852
set_robot_commands_mean0.09319422121876096
set_robot_commands_median0.09321588118871052
set_robot_commands_min0.08499777714411418
sim_compute_performance-ego_max0.06993378510996073
sim_compute_performance-ego_mean0.0664046493191011
sim_compute_performance-ego_median0.06734742561976115
sim_compute_performance-ego_min0.059827430248260496
sim_compute_robot_state-ego_max0.07296467628799566
sim_compute_robot_state-ego_mean0.0691685851548566
sim_compute_robot_state-ego_median0.07041957855224609
sim_compute_robot_state-ego_min0.0627977999051412
sim_compute_sim_state_max0.03809566974639893
sim_compute_sim_state_mean0.037066144075046395
sim_compute_sim_state_median0.037833884984505274
sim_compute_sim_state_min0.033864699204762774
sim_physics_max0.025666170761364848
sim_physics_mean0.023481514423167336
sim_physics_median0.02305680751800537
sim_physics_min0.02174866835276286
sim_render-ego_max0.06281457828874347
sim_render-ego_mean0.059828559095452136
sim_render-ego_median0.06045380353927613
sim_render-ego_min0.05533046086629232
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.15000000000006
survival_time_min5.949999999999987
No reset possible
194782620Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFV-sim-testingstep1-simulationsuccessnoip-172-31-38-104-80540:06:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1506484498580297
agent_compute-ego_mean0.13753722023148834
agent_compute-ego_median0.14438392835504868
agent_compute-ego_min0.10163261131806808
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.035968366658912516, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05946918703475088, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14981047612316203, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.09336213345797556, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.035173321669956424, "sim_compute_performance-ego": 0.06671061155931005, "sim_compute_robot_state-ego": 0.06571742723572929, "sim_compute_robot_state-npc0": 0.06204587558530412, "sim_compute_robot_state-npc1": 0.05965028618866543, "sim_compute_robot_state-npc2": 0.0601125438258333, "sim_compute_robot_state-npc3": 0.062071026496167456}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.026101773435419254, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.041853617538105355, "in-drivable-lane": 0, "agent_compute-ego": 0.10163261131806808, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.06521273743022572, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.027349347418004814, "sim_compute_performance-ego": 0.046966021711176094, "sim_compute_robot_state-ego": 0.04773182218725031, "sim_compute_robot_state-npc0": 0.04871411757035689, "sim_compute_robot_state-npc1": 0.04912988164208152, "sim_compute_robot_state-npc2": 0.04817741025577892, "sim_compute_robot_state-npc3": 0.046762152151627975}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.034555546442667645, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.05858918825785319, "in-drivable-lane": 0, "agent_compute-ego": 0.14121063550313315, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.08879742622375489, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03424511485629612, "sim_compute_performance-ego": 0.06298928790622288, "sim_compute_robot_state-ego": 0.06460934744940863, "sim_compute_robot_state-npc0": 0.06307678752475315, "sim_compute_robot_state-npc1": 0.06616600354512532, "sim_compute_robot_state-npc2": 0.0630986213684082, "sim_compute_robot_state-npc3": 0.06328923437330458}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.03537849088509878, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.0623587965965271, "in-drivable-lane": 0, "agent_compute-ego": 0.1506484498580297, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.09239702920118968, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.037319570779800415, "sim_compute_performance-ego": 0.06710538268089294, "sim_compute_robot_state-ego": 0.07040723661581676, "sim_compute_robot_state-npc0": 0.0664792110522588, "sim_compute_robot_state-npc1": 0.06628232697645824, "sim_compute_robot_state-npc2": 0.0645893265803655, "sim_compute_robot_state-npc3": 0.06550147632757823}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.03749904562445248, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.0588081303764792, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14438392835504868, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.09375824998406802, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03771125218447517, "sim_compute_performance-ego": 0.06542068018632777, "sim_compute_robot_state-ego": 0.06497280387317433, "sim_compute_robot_state-npc0": 0.06499647392946131, "sim_compute_robot_state-npc1": 0.06443514894036685, "sim_compute_robot_state-npc2": 0.061346842962152814, "sim_compute_robot_state-npc3": 0.06374839824788711}}
set_robot_commands_max0.09375824998406802
set_robot_commands_mean0.08670551525944278
set_robot_commands_median0.09239702920118968
set_robot_commands_min0.06521273743022572
sim_compute_performance-ego_max0.06710538268089294
sim_compute_performance-ego_mean0.061838396808785945
sim_compute_performance-ego_median0.06542068018632777
sim_compute_performance-ego_min0.046966021711176094
sim_compute_robot_state-ego_max0.07040723661581676
sim_compute_robot_state-ego_mean0.06268772747227587
sim_compute_robot_state-ego_median0.06497280387317433
sim_compute_robot_state-ego_min0.04773182218725031
sim_compute_robot_state-npc0_max0.0664792110522588
sim_compute_robot_state-npc0_mean0.061062493132426864
sim_compute_robot_state-npc0_median0.06307678752475315
sim_compute_robot_state-npc0_min0.04871411757035689
sim_compute_robot_state-npc1_max0.06628232697645824
sim_compute_robot_state-npc1_mean0.06113272945853947
sim_compute_robot_state-npc1_median0.06443514894036685
sim_compute_robot_state-npc1_min0.04912988164208152
sim_compute_robot_state-npc2_max0.0645893265803655
sim_compute_robot_state-npc2_mean0.05946494899850775
sim_compute_robot_state-npc2_median0.061346842962152814
sim_compute_robot_state-npc2_min0.04817741025577892
sim_compute_robot_state-npc3_max0.06550147632757823
sim_compute_robot_state-npc3_mean0.06027445751931306
sim_compute_robot_state-npc3_median0.06328923437330458
sim_compute_robot_state-npc3_min0.046762152151627975
sim_compute_sim_state_max0.03771125218447517
sim_compute_sim_state_mean0.034359721381706586
sim_compute_sim_state_median0.035173321669956424
sim_compute_sim_state_min0.027349347418004814
sim_physics_max0.03749904562445248
sim_physics_mean0.03390064460931013
sim_physics_median0.03537849088509878
sim_physics_min0.026101773435419254
sim_render-ego_max0.0623587965965271
sim_render-ego_mean0.05621578396074315
sim_render-ego_median0.0588081303764792
sim_render-ego_min0.041853617538105355
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
194702644Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationsuccessnoip-172-31-38-104-80540:06:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487132829419987
survival_time_median2.3499999999999996
deviation-center-line_median0.11041400208354252
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0660489994090992
agent_compute-ego_mean0.06124024656274117
agent_compute-ego_median0.06095959785136771
agent_compute-ego_min0.055778826155313634
deviation-center-line_max0.1279102488429998
deviation-center-line_mean0.10518151035257096
deviation-center-line_min0.06917270915638028
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550057
deviation-heading_median0.36368201628851926
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903464
driven_any_median0.6642785413159032
driven_any_min0.3059207793076613
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.588039443394122
driven_lanedir_consec_min0.28022225990343186
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.588039443394122
driven_lanedir_median0.5487132829419987
driven_lanedir_min0.28022225990343186
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.032214315926156395, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.0490388085202473, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.055778826155313634, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07828191722311624, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.030923381084349097, "sim_compute_performance-ego": 0.0519814694800028, "sim_compute_robot_state-ego": 0.05560424269699469, "sim_compute_robot_state-npc0": 0.054734733046554934, "sim_compute_robot_state-npc1": 0.05354657696514595, "sim_compute_robot_state-npc2": 0.055432057962185, "sim_compute_robot_state-npc3": 0.05845887486527606}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.036266904610853926, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.06728557439950797, "in-drivable-lane": 0, "agent_compute-ego": 0.06503026302044208, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.09177834254044752, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.035779246917137734, "sim_compute_performance-ego": 0.06432967002575214, "sim_compute_robot_state-ego": 0.0658340729199923, "sim_compute_robot_state-npc0": 0.062067508697509766, "sim_compute_robot_state-npc1": 0.05922706310565655, "sim_compute_robot_state-npc2": 0.06176687203920805, "sim_compute_robot_state-npc3": 0.06615840471707858}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.03330476233299742, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.057975662515518514, "in-drivable-lane": 0, "agent_compute-ego": 0.06095959785136771, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.08476959898116741, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.03373190189929719, "sim_compute_performance-ego": 0.061393306610432075, "sim_compute_robot_state-ego": 0.06415520830357328, "sim_compute_robot_state-npc0": 0.060366402281091566, "sim_compute_robot_state-npc1": 0.05920779958684394, "sim_compute_robot_state-npc2": 0.0604896088863941, "sim_compute_robot_state-npc3": 0.06562703213793167}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.040478373621846295, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.0595787226498782, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0660489994090992, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.091663787653158, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03731858337318504, "sim_compute_performance-ego": 0.06583224810086764, "sim_compute_robot_state-ego": 0.06802121361533364, "sim_compute_robot_state-npc0": 0.06558142389569964, "sim_compute_robot_state-npc1": 0.06539524518526517, "sim_compute_robot_state-npc2": 0.06226439004415994, "sim_compute_robot_state-npc3": 0.0638763197175749}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.027093786942331416, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.0515170787510119, "in-drivable-lane": 0, "agent_compute-ego": 0.05838354637748317, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.0845644097579153, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.029285857551976255, "sim_compute_performance-ego": 0.05392638005708393, "sim_compute_robot_state-ego": 0.054336836463526675, "sim_compute_robot_state-npc0": 0.05953026445288407, "sim_compute_robot_state-npc1": 0.05875827136792635, "sim_compute_robot_state-npc2": 0.05294807333695261, "sim_compute_robot_state-npc3": 0.0531520592538934}}
set_robot_commands_max0.09177834254044752
set_robot_commands_mean0.08621161123116089
set_robot_commands_median0.08476959898116741
set_robot_commands_min0.07828191722311624
sim_compute_performance-ego_max0.06583224810086764
sim_compute_performance-ego_mean0.05949261485482772
sim_compute_performance-ego_median0.061393306610432075
sim_compute_performance-ego_min0.0519814694800028
sim_compute_robot_state-ego_max0.06802121361533364
sim_compute_robot_state-ego_mean0.06159031479988412
sim_compute_robot_state-ego_median0.06415520830357328
sim_compute_robot_state-ego_min0.054336836463526675
sim_compute_robot_state-npc0_max0.06558142389569964
sim_compute_robot_state-npc0_mean0.060456066474747994
sim_compute_robot_state-npc0_median0.060366402281091566
sim_compute_robot_state-npc0_min0.054734733046554934
sim_compute_robot_state-npc1_max0.06539524518526517
sim_compute_robot_state-npc1_mean0.05922699124216759
sim_compute_robot_state-npc1_median0.05920779958684394
sim_compute_robot_state-npc1_min0.05354657696514595
sim_compute_robot_state-npc2_max0.06226439004415994
sim_compute_robot_state-npc2_mean0.05858020045377994
sim_compute_robot_state-npc2_median0.0604896088863941
sim_compute_robot_state-npc2_min0.05294807333695261
sim_compute_robot_state-npc3_max0.06615840471707858
sim_compute_robot_state-npc3_mean0.06145453813835093
sim_compute_robot_state-npc3_median0.0638763197175749
sim_compute_robot_state-npc3_min0.0531520592538934
sim_compute_sim_state_max0.03731858337318504
sim_compute_sim_state_mean0.03340779416518906
sim_compute_sim_state_median0.03373190189929719
sim_compute_sim_state_min0.029285857551976255
sim_physics_max0.040478373621846295
sim_physics_mean0.03387162868683709
sim_physics_median0.03330476233299742
sim_physics_min0.027093786942331416
sim_render-ego_max0.06728557439950797
sim_render-ego_mean0.05707916936723277
sim_render-ego_median0.057975662515518514
sim_render-ego_min0.0490388085202473
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
194582633Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessnoip-172-31-38-104-80540:07:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14790151516596475
agent_compute-ego_mean0.13652684552275088
agent_compute-ego_median0.13086586489396937
agent_compute-ego_min0.128153535452756
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.03133376139514851, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05288203257434773, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1301090672331036, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08475075127943507, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03386105681365391, "sim_compute_performance-ego": 0.05805038056283627, "sim_compute_robot_state-ego": 0.0591962382478534, "sim_compute_robot_state-npc0": 0.05993849376462541, "sim_compute_robot_state-npc1": 0.05851918346477005, "sim_compute_robot_state-npc2": 0.05871943707736033, "sim_compute_robot_state-npc3": 0.05951376681057912}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.03238215229728005, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.05408658222718672, "in-drivable-lane": 0, "agent_compute-ego": 0.128153535452756, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.08245568925684149, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03166161342100664, "sim_compute_performance-ego": 0.05689022757790305, "sim_compute_robot_state-ego": 0.05764967745000666, "sim_compute_robot_state-npc0": 0.057473670352589, "sim_compute_robot_state-npc1": 0.059358818964524704, "sim_compute_robot_state-npc2": 0.05804805863987316, "sim_compute_robot_state-npc3": 0.057703169909390534}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.03588499493069119, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.058660591973198783, "in-drivable-lane": 0, "agent_compute-ego": 0.1456042448679606, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.09350914425320096, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.036991082297431095, "sim_compute_performance-ego": 0.06690294477674696, "sim_compute_robot_state-ego": 0.0706840303209093, "sim_compute_robot_state-npc0": 0.06703113979763455, "sim_compute_robot_state-npc1": 0.067459593878852, "sim_compute_robot_state-npc2": 0.0641013675265842, "sim_compute_robot_state-npc3": 0.06405782699584961}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.035852079590161644, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06045270959536234, "in-drivable-lane": 0, "agent_compute-ego": 0.14790151516596475, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0964652995268504, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.034712026516596474, "sim_compute_performance-ego": 0.06431900958220164, "sim_compute_robot_state-ego": 0.06529965500036876, "sim_compute_robot_state-npc0": 0.06512875358263652, "sim_compute_robot_state-npc1": 0.06534456213315327, "sim_compute_robot_state-npc2": 0.0649724652369817, "sim_compute_robot_state-npc3": 0.06611625850200653}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.034605808117810416, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05265237653956694, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13086586489396937, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08109685252694522, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.035202576833612775, "sim_compute_performance-ego": 0.05951055358437931, "sim_compute_robot_state-ego": 0.06329700175453634, "sim_compute_robot_state-npc0": 0.057747073033276725, "sim_compute_robot_state-npc1": 0.061567359110888314, "sim_compute_robot_state-npc2": 0.06071210258147296, "sim_compute_robot_state-npc3": 0.06150550351423376}}
set_robot_commands_max0.0964652995268504
set_robot_commands_mean0.08765554736865463
set_robot_commands_median0.08475075127943507
set_robot_commands_min0.08109685252694522
sim_compute_performance-ego_max0.06690294477674696
sim_compute_performance-ego_mean0.06113462321681344
sim_compute_performance-ego_median0.05951055358437931
sim_compute_performance-ego_min0.05689022757790305
sim_compute_robot_state-ego_max0.0706840303209093
sim_compute_robot_state-ego_mean0.0632253205547349
sim_compute_robot_state-ego_median0.06329700175453634
sim_compute_robot_state-ego_min0.05764967745000666
sim_compute_robot_state-npc0_max0.06703113979763455
sim_compute_robot_state-npc0_mean0.06146382610615244
sim_compute_robot_state-npc0_median0.05993849376462541
sim_compute_robot_state-npc0_min0.057473670352589
sim_compute_robot_state-npc1_max0.067459593878852
sim_compute_robot_state-npc1_mean0.062449903510437665
sim_compute_robot_state-npc1_median0.061567359110888314
sim_compute_robot_state-npc1_min0.05851918346477005
sim_compute_robot_state-npc2_max0.0649724652369817
sim_compute_robot_state-npc2_mean0.06131068621245447
sim_compute_robot_state-npc2_median0.06071210258147296
sim_compute_robot_state-npc2_min0.05804805863987316
sim_compute_robot_state-npc3_max0.06611625850200653
sim_compute_robot_state-npc3_mean0.06177930514641191
sim_compute_robot_state-npc3_median0.06150550351423376
sim_compute_robot_state-npc3_min0.057703169909390534
sim_compute_sim_state_max0.036991082297431095
sim_compute_sim_state_mean0.034485671176460175
sim_compute_sim_state_median0.034712026516596474
sim_compute_sim_state_min0.03166161342100664
sim_physics_max0.03588499493069119
sim_physics_mean0.03401175926621837
sim_physics_median0.034605808117810416
sim_physics_min0.03133376139514851
sim_render-ego_max0.06045270959536234
sim_render-ego_mean0.0557468585819325
sim_render-ego_median0.05408658222718672
sim_render-ego_min0.05265237653956694
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
194312676Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationhost-errornoip-172-31-38-104-80540:10:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19431-837323', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19431-837323', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19431-837323', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
194062712Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-38-104-80540:19:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5551489018366877
survival_time_median7.649999999999981
deviation-center-line_median0.4780840675901234
in-drivable-lane_median1.40000000000002


other stats
agent_compute-ego_max0.09244657331897368
agent_compute-ego_mean0.0904363556367562
agent_compute-ego_median0.09041248115838744
agent_compute-ego_min0.08843794289757223
deviation-center-line_max0.9168559739048878
deviation-center-line_mean0.46279303715671505
deviation-center-line_min0.05971102145196014
deviation-heading_max6.876234441605709
deviation-heading_mean3.004338379842646
deviation-heading_median2.5927605254648753
deviation-heading_min0.6926864640029595
driven_any_max2.266995980060927
driven_any_mean1.1303620610786314
driven_any_median1.1715954359633207
driven_any_min0.20203391996793393
driven_lanedir_consec_max1.3293322030563397
driven_lanedir_consec_mean0.6375805576703222
driven_lanedir_consec_min0.14583729419541935
driven_lanedir_max1.5500115876159974
driven_lanedir_mean0.7957162255405464
driven_lanedir_median0.742512619869365
driven_lanedir_min0.14583729419541935
in-drivable-lane_max1.9500000000000128
in-drivable-lane_mean1.0400000000000051
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.1715954359633207, "sim_physics": 0.049594382055444655, "survival_time": 7.649999999999981, "driven_lanedir": 0.742512619869365, "sim_render-ego": 0.06867759835486319, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.09041248115838744, "deviation-heading": 2.5927605254648753, "set_robot_commands": 0.11498683106665518, "deviation-center-line": 0.4780840675901234, "driven_lanedir_consec": 0.5551489018366877, "sim_compute_sim_state": 0.04306992518356423, "sim_compute_performance-ego": 0.0738425737892101, "sim_compute_robot_state-ego": 0.08093917603586234, "sim_compute_robot_state-npc0": 0.07662525831484328, "sim_compute_robot_state-npc1": 0.07528350399989708, "sim_compute_robot_state-npc2": 0.0767890627867256, "sim_compute_robot_state-npc3": 0.07758673655441384}, "udem1-1-0": {"driven_any": 0.20203391996793393, "sim_physics": 0.05042183014654344, "survival_time": 1.5500000000000007, "driven_lanedir": 0.14583729419541935, "sim_render-ego": 0.07459871999679073, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09244657331897368, "deviation-heading": 0.6926864640029595, "set_robot_commands": 0.11739030191975255, "deviation-center-line": 0.05971102145196014, "driven_lanedir_consec": 0.14583729419541935, "sim_compute_sim_state": 0.0440477478888727, "sim_compute_performance-ego": 0.07465991666240077, "sim_compute_robot_state-ego": 0.07986635546530446, "sim_compute_robot_state-npc0": 0.07838403024981098, "sim_compute_robot_state-npc1": 0.07629236867350916, "sim_compute_robot_state-npc2": 0.07900809472607027, "sim_compute_robot_state-npc3": 0.0788031239663401}, "udem1-2-0": {"driven_any": 2.266995980060927, "sim_physics": 0.048054900434282094, "survival_time": 14.40000000000007, "driven_lanedir": 1.5500115876159974, "sim_render-ego": 0.06793255855639775, "in-drivable-lane": 1.9500000000000128, "agent_compute-ego": 0.08967836615112093, "deviation-heading": 6.876234441605709, "set_robot_commands": 0.11248852478133307, "deviation-center-line": 0.9168559739048878, "driven_lanedir_consec": 0.972622959266582, "sim_compute_sim_state": 0.04259575572278765, "sim_compute_performance-ego": 0.07470308989286423, "sim_compute_robot_state-ego": 0.07979139437278111, "sim_compute_robot_state-npc0": 0.07403981933991115, "sim_compute_robot_state-npc1": 0.07413796583811443, "sim_compute_robot_state-npc2": 0.07459551841020584, "sim_compute_robot_state-npc3": 0.07460569590330124}, "udem1-3-0": {"driven_any": 0.226151769611615, "sim_physics": 0.04793378184823429, "survival_time": 1.7000000000000008, "driven_lanedir": 0.1849614299965825, "sim_render-ego": 0.06358249047223259, "in-drivable-lane": 0, "agent_compute-ego": 0.08843794289757223, "deviation-heading": 0.6944159542307292, "set_robot_commands": 0.1115163424435784, "deviation-center-line": 0.07554867214268302, "driven_lanedir_consec": 0.1849614299965825, "sim_compute_sim_state": 0.04070561072405647, "sim_compute_performance-ego": 0.07301986918729894, "sim_compute_robot_state-ego": 0.07721083304461311, "sim_compute_robot_state-npc0": 0.07447263072518741, "sim_compute_robot_state-npc1": 0.07722236829645493, "sim_compute_robot_state-npc2": 0.07478333220762365, "sim_compute_robot_state-npc3": 0.0725711513968075}, "udem1-4-0": {"driven_any": 1.7850331997893596, "sim_physics": 0.04688893493853117, "survival_time": 11.400000000000029, "driven_lanedir": 1.3552581960253678, "sim_render-ego": 0.06561159460168135, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.09120641465772662, "deviation-heading": 4.165594513908958, "set_robot_commands": 0.11508476838730929, "deviation-center-line": 0.783765450693921, "driven_lanedir_consec": 1.3293322030563397, "sim_compute_sim_state": 0.04106862398616055, "sim_compute_performance-ego": 0.07251237986380593, "sim_compute_robot_state-ego": 0.07688641548156738, "sim_compute_robot_state-npc0": 0.07599133775945295, "sim_compute_robot_state-npc1": 0.07396715252022994, "sim_compute_robot_state-npc2": 0.07340584616912038, "sim_compute_robot_state-npc3": 0.07260525749440778}}
set_robot_commands_max0.11739030191975255
set_robot_commands_mean0.11429335371972568
set_robot_commands_median0.11498683106665518
set_robot_commands_min0.1115163424435784
sim_compute_performance-ego_max0.07470308989286423
sim_compute_performance-ego_mean0.07374756587911599
sim_compute_performance-ego_median0.0738425737892101
sim_compute_performance-ego_min0.07251237986380593
sim_compute_robot_state-ego_max0.08093917603586234
sim_compute_robot_state-ego_mean0.07893883488002569
sim_compute_robot_state-ego_median0.07979139437278111
sim_compute_robot_state-ego_min0.07688641548156738
sim_compute_robot_state-npc0_max0.07838403024981098
sim_compute_robot_state-npc0_mean0.07590261527784115
sim_compute_robot_state-npc0_median0.07599133775945295
sim_compute_robot_state-npc0_min0.07403981933991115
sim_compute_robot_state-npc1_max0.07722236829645493
sim_compute_robot_state-npc1_mean0.07538067186564111
sim_compute_robot_state-npc1_median0.07528350399989708
sim_compute_robot_state-npc1_min0.07396715252022994
sim_compute_robot_state-npc2_max0.07900809472607027
sim_compute_robot_state-npc2_mean0.07571637085994916
sim_compute_robot_state-npc2_median0.07478333220762365
sim_compute_robot_state-npc2_min0.07340584616912038
sim_compute_robot_state-npc3_max0.0788031239663401
sim_compute_robot_state-npc3_mean0.0752343930630541
sim_compute_robot_state-npc3_median0.07460569590330124
sim_compute_robot_state-npc3_min0.0725711513968075
sim_compute_sim_state_max0.0440477478888727
sim_compute_sim_state_mean0.04229753270108832
sim_compute_sim_state_median0.04259575572278765
sim_compute_sim_state_min0.04070561072405647
sim_physics_max0.05042183014654344
sim_physics_mean0.04857876588460713
sim_physics_median0.048054900434282094
sim_physics_min0.04688893493853117
sim_render-ego_max0.07459871999679073
sim_render-ego_mean0.06808059239639312
sim_render-ego_median0.06793255855639775
sim_render-ego_min0.06358249047223259
simulation-passed1
survival_time_max14.40000000000007
survival_time_mean7.340000000000015
survival_time_min1.5500000000000007
No reset possible
194002720jiang pengtest for ppoaido2-LFV-sim-validationstep1-simulationerrornoip-172-31-38-104-80540:00:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
193942730Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationfailednoip-172-31-38-104-80540:01:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
193892742Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationfailednoip-172-31-38-104-80540:01:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
193762767Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-38-104-80540:10:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6730551409975218
survival_time_median4.549999999999992
deviation-center-line_median0.3951856466319917
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0999109148979187
agent_compute-ego_mean0.09495093841857058
agent_compute-ego_median0.09544466177622478
agent_compute-ego_min0.09033782665546124
deviation-center-line_max1.181284973106407
deviation-center-line_mean0.521547068102756
deviation-center-line_min0.22616383148695665
deviation-heading_max7.071926670065188
deviation-heading_mean2.265823219869722
deviation-heading_median0.7085741988615615
deviation-heading_min0.6021326168044523
driven_any_max2.3551094393019314
driven_any_mean0.977737873308884
driven_any_median0.6842416511385191
driven_any_min0.4890341514978688
driven_lanedir_consec_max0.9269610567687576
driven_lanedir_consec_mean0.6014762317785467
driven_lanedir_consec_min0.25491948741097004
driven_lanedir_max1.5596579717298311
driven_lanedir_mean0.7639406246194941
driven_lanedir_median0.6730551409975218
driven_lanedir_min0.4345445366546329
in-drivable-lane_max2.100000000000011
in-drivable-lane_mean0.5100000000000022
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4890341514978688, "sim_physics": 0.023844793661316827, "survival_time": 3.349999999999996, "driven_lanedir": 0.4706890994365121, "sim_render-ego": 0.05900946659828299, "in-drivable-lane": 0, "agent_compute-ego": 0.0909901234641004, "deviation-heading": 0.7085741988615615, "set_robot_commands": 0.09087963602436122, "deviation-center-line": 0.22616383148695665, "driven_lanedir_consec": 0.4706890994365121, "sim_compute_sim_state": 0.034780214081949264, "sim_compute_performance-ego": 0.0635811321770967, "sim_compute_robot_state-ego": 0.06741025910448672}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6680305370656292, "sim_physics": 0.0266205541203531, "survival_time": 4.449999999999992, "driven_lanedir": 0.4345445366546329, "sim_render-ego": 0.06576042764642265, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.09807116529914772, "deviation-heading": 2.2799216732028564, "set_robot_commands": 0.10181955809003852, "deviation-center-line": 0.38379067668294065, "driven_lanedir_consec": 0.25491948741097004, "sim_compute_sim_state": 0.03848885418323989, "sim_compute_performance-ego": 0.06992203466008219, "sim_compute_robot_state-ego": 0.07526284657167585}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6922735875404715, "sim_physics": 0.0302701851596003, "survival_time": 4.599999999999992, "driven_lanedir": 0.6817563742789723, "sim_render-ego": 0.06366933428722879, "in-drivable-lane": 0, "agent_compute-ego": 0.0999109148979187, "deviation-heading": 0.6021326168044523, "set_robot_commands": 0.10489784893782242, "deviation-center-line": 0.3951856466319917, "driven_lanedir_consec": 0.6817563742789723, "sim_compute_sim_state": 0.03970527389775152, "sim_compute_performance-ego": 0.07147052236225294, "sim_compute_robot_state-ego": 0.07867750136748604}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6842416511385191, "sim_physics": 0.025853400702004904, "survival_time": 4.549999999999992, "driven_lanedir": 0.6730551409975218, "sim_render-ego": 0.05970688966604379, "in-drivable-lane": 0, "agent_compute-ego": 0.09033782665546124, "deviation-heading": 0.6665609404145512, "set_robot_commands": 0.0975615401844402, "deviation-center-line": 0.42131021260548374, "driven_lanedir_consec": 0.6730551409975218, "sim_compute_sim_state": 0.037855947410667334, "sim_compute_performance-ego": 0.06520134538084596, "sim_compute_robot_state-ego": 0.06875345471141102}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3551094393019314, "sim_physics": 0.023961352507273357, "survival_time": 14.950000000000076, "driven_lanedir": 1.5596579717298311, "sim_render-ego": 0.06209882656733195, "in-drivable-lane": 2.100000000000011, "agent_compute-ego": 0.09544466177622478, "deviation-heading": 7.071926670065188, "set_robot_commands": 0.09692703564961752, "deviation-center-line": 1.181284973106407, "driven_lanedir_consec": 0.9269610567687576, "sim_compute_sim_state": 0.03819758415222168, "sim_compute_performance-ego": 0.06894258896509807, "sim_compute_robot_state-ego": 0.07333815813064576}}
set_robot_commands_max0.10489784893782242
set_robot_commands_mean0.09841712377725596
set_robot_commands_median0.0975615401844402
set_robot_commands_min0.09087963602436122
sim_compute_performance-ego_max0.07147052236225294
sim_compute_performance-ego_mean0.06782352470907518
sim_compute_performance-ego_median0.06894258896509807
sim_compute_performance-ego_min0.0635811321770967
sim_compute_robot_state-ego_max0.07867750136748604
sim_compute_robot_state-ego_mean0.07268844397714108
sim_compute_robot_state-ego_median0.07333815813064576
sim_compute_robot_state-ego_min0.06741025910448672
sim_compute_sim_state_max0.03970527389775152
sim_compute_sim_state_mean0.03780557474516594
sim_compute_sim_state_median0.03819758415222168
sim_compute_sim_state_min0.034780214081949264
sim_physics_max0.0302701851596003
sim_physics_mean0.026110057230109698
sim_physics_median0.025853400702004904
sim_physics_min0.023844793661316827
sim_render-ego_max0.06576042764642265
sim_render-ego_mean0.06204898895306203
sim_render-ego_median0.06209882656733195
sim_render-ego_min0.05900946659828299
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.3800000000000106
survival_time_min3.349999999999996
No reset possible
193662787Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationerrornoip-172-31-38-104-80540:01:36
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
193512804Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agentaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-38-104-80540:04:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.13605251411596933
agent_compute-ego_mean0.12499202488359432
agent_compute-ego_median0.12392536199317788
agent_compute-ego_min0.11344075202941896
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.022719833086121757, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.04785563360969975, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12392536199317788, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07787565015396981, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.030819317079939932, "sim_compute_performance-ego": 0.054402648278002466, "sim_compute_robot_state-ego": 0.05738258361816406}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.020084516568617383, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.0543639984997836, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1346831050786105, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.08403897285461426, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03323465585708618, "sim_compute_performance-ego": 0.059504552321000534, "sim_compute_robot_state-ego": 0.060470418496565384}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.017240873972574868, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.04443576600816515, "in-drivable-lane": 0, "agent_compute-ego": 0.11344075202941896, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07035206688774956, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.0294164604610867, "sim_compute_performance-ego": 0.051326221889919706, "sim_compute_robot_state-ego": 0.05264801979064941}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.022379507621129353, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.050280988216400146, "in-drivable-lane": 0, "agent_compute-ego": 0.13605251411596933, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.08898645639419556, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03490528464317322, "sim_compute_performance-ego": 0.05744943022727966, "sim_compute_robot_state-ego": 0.06036023795604706}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.018681750578038833, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.04537703009212718, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.11685839120079489, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.06759622868369608, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.028682421235477224, "sim_compute_performance-ego": 0.04899477958679199, "sim_compute_robot_state-ego": 0.05047670883290908}}
set_robot_commands_max0.08898645639419556
set_robot_commands_mean0.07776987499484504
set_robot_commands_median0.07787565015396981
set_robot_commands_min0.06759622868369608
sim_compute_performance-ego_max0.059504552321000534
sim_compute_performance-ego_mean0.054335526460598874
sim_compute_performance-ego_median0.054402648278002466
sim_compute_performance-ego_min0.04899477958679199
sim_compute_robot_state-ego_max0.060470418496565384
sim_compute_robot_state-ego_mean0.05626759373886699
sim_compute_robot_state-ego_median0.05738258361816406
sim_compute_robot_state-ego_min0.05047670883290908
sim_compute_sim_state_max0.03490528464317322
sim_compute_sim_state_mean0.031411627855352654
sim_compute_sim_state_median0.030819317079939932
sim_compute_sim_state_min0.028682421235477224
sim_physics_max0.022719833086121757
sim_physics_mean0.02022129636529644
sim_physics_median0.020084516568617383
sim_physics_min0.017240873972574868
sim_render-ego_max0.0543639984997836
sim_render-ego_mean0.04846268328523516
sim_render-ego_median0.04785563360969975
sim_render-ego_min0.04443576600816515
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
193412814Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-38-104-80540:05:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.14708008766174316
agent_compute-ego_mean0.13626278573886635
agent_compute-ego_median0.13363965849081674
agent_compute-ego_min0.13148295337503607
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.02110045810915389, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05653026418865851, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13724323488631338, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08407197358473292, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03202992115380629, "sim_compute_performance-ego": 0.0596685454530536, "sim_compute_robot_state-ego": 0.06282953496249218}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.020920005711642178, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.05198202891783281, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13148295337503607, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.08128495649857954, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03233771974390203, "sim_compute_performance-ego": 0.05728390541943637, "sim_compute_robot_state-ego": 0.05829880996183916}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.020898252063327367, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.055960528055826825, "in-drivable-lane": 0, "agent_compute-ego": 0.14708008766174316, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.09269763628641764, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.036541790432400176, "sim_compute_performance-ego": 0.05991866323682997, "sim_compute_robot_state-ego": 0.06939241091410318}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.01910446584224701, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05082544187704722, "in-drivable-lane": 0, "agent_compute-ego": 0.13363965849081674, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.08579759796460469, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03361416359742483, "sim_compute_performance-ego": 0.05675429105758667, "sim_compute_robot_state-ego": 0.057035679618517555}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.021920042879441205, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.05609835596645579, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13186799428042242, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08224208565319285, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.033362234339994544, "sim_compute_performance-ego": 0.057749436182134295, "sim_compute_robot_state-ego": 0.060687790898715746}}
set_robot_commands_max0.09269763628641764
set_robot_commands_mean0.08521884999750554
set_robot_commands_median0.08407197358473292
set_robot_commands_min0.08128495649857954
sim_compute_performance-ego_max0.05991866323682997
sim_compute_performance-ego_mean0.05827496826980818
sim_compute_performance-ego_median0.057749436182134295
sim_compute_performance-ego_min0.05675429105758667
sim_compute_robot_state-ego_max0.06939241091410318
sim_compute_robot_state-ego_mean0.06164884527113357
sim_compute_robot_state-ego_median0.060687790898715746
sim_compute_robot_state-ego_min0.057035679618517555
sim_compute_sim_state_max0.036541790432400176
sim_compute_sim_state_mean0.03357716585350558
sim_compute_sim_state_median0.033362234339994544
sim_compute_sim_state_min0.03202992115380629
sim_physics_max0.021920042879441205
sim_physics_mean0.02078864492116233
sim_physics_median0.020920005711642178
sim_physics_min0.01910446584224701
sim_render-ego_max0.05653026418865851
sim_render-ego_mean0.05427932380116422
sim_render-ego_median0.055960528055826825
sim_render-ego_min0.05082544187704722
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
193072856Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationhost-errornoip-172-31-38-104-80540:05:46
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19307-662888', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19307-662888', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19307-662888', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
192972872Peter Almasi 🇭🇺challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-38-104-80540:04:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.10083668636451826
survival_time_median1.2500000000000004
deviation-center-line_median0.05866398029835883
in-drivable-lane_median0


other stats
agent_compute-ego_max0.17381628354390463
agent_compute-ego_mean0.15494659348023246
agent_compute-ego_median0.15340883255004883
agent_compute-ego_min0.1353086783335759
deviation-center-line_max0.05940377569248654
deviation-center-line_mean0.056150660119407225
deviation-center-line_min0.04888183122442952
deviation-heading_max0.8205073877623288
deviation-heading_mean0.7460412752997186
deviation-heading_median0.7505517796973944
deviation-heading_min0.6917950492507041
driven_any_max0.16282618890771708
driven_any_mean0.1548757298705467
driven_any_median0.16151189436887484
driven_any_min0.13446638601146174
driven_lanedir_consec_max0.1053047934450526
driven_lanedir_consec_mean0.09546267973765428
driven_lanedir_consec_min0.06835241419131588
driven_lanedir_max0.1053047934450526
driven_lanedir_mean0.09546267973765428
driven_lanedir_median0.10083668636451826
driven_lanedir_min0.06835241419131588
in-drivable-lane_max0.10000000000000007
in-drivable-lane_mean0.020000000000000014
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.13446638601146174, "sim_physics": 0.0241158390045166, "survival_time": 1.2500000000000004, "driven_lanedir": 0.06835241419131588, "sim_render-ego": 0.06324880599975585, "in-drivable-lane": 0, "agent_compute-ego": 0.17095797538757324, "deviation-heading": 0.8205073877623288, "set_robot_commands": 0.09518891334533693, "deviation-center-line": 0.05490594465334656, "driven_lanedir_consec": 0.06835241419131588, "sim_compute_sim_state": 0.03653336524963379, "sim_compute_performance-ego": 0.0663563346862793, "sim_compute_robot_state-ego": 0.06436286926269531}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16151189436887484, "sim_physics": 0.02146087646484375, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1049886370540567, "sim_render-ego": 0.05967049598693848, "in-drivable-lane": 0, "agent_compute-ego": 0.15340883255004883, "deviation-heading": 0.7113644905653347, "set_robot_commands": 0.08988265991210938, "deviation-center-line": 0.05889776872841466, "driven_lanedir_consec": 0.1049886370540567, "sim_compute_sim_state": 0.03630220413208008, "sim_compute_performance-ego": 0.06703565597534179, "sim_compute_robot_state-ego": 0.07324560165405274}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15285097540466253, "sim_physics": 0.01985872268676758, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09783086763332792, "sim_render-ego": 0.05236357688903809, "in-drivable-lane": 0, "agent_compute-ego": 0.14124119758605955, "deviation-heading": 0.7559876692228316, "set_robot_commands": 0.08214818000793457, "deviation-center-line": 0.05866398029835883, "driven_lanedir_consec": 0.09783086763332792, "sim_compute_sim_state": 0.03485998153686523, "sim_compute_performance-ego": 0.05545113563537598, "sim_compute_robot_state-ego": 0.057475652694702145}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16272320466001733, "sim_physics": 0.025978256154943397, "survival_time": 1.3500000000000003, "driven_lanedir": 0.10083668636451826, "sim_render-ego": 0.06275773048400879, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.17381628354390463, "deviation-heading": 0.6917950492507041, "set_robot_commands": 0.09467201762729222, "deviation-center-line": 0.04888183122442952, "driven_lanedir_consec": 0.10083668636451826, "sim_compute_sim_state": 0.03867446934735334, "sim_compute_performance-ego": 0.07016274664137098, "sim_compute_robot_state-ego": 0.07536522547403972}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16282618890771708, "sim_physics": 0.01806165621830867, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1053047934450526, "sim_render-ego": 0.05355932162358211, "in-drivable-lane": 0, "agent_compute-ego": 0.1353086783335759, "deviation-heading": 0.7505517796973944, "set_robot_commands": 0.08029968921954815, "deviation-center-line": 0.05940377569248654, "driven_lanedir_consec": 0.1053047934450526, "sim_compute_sim_state": 0.028975440905644342, "sim_compute_performance-ego": 0.0558009147644043, "sim_compute_robot_state-ego": 0.05592622206761287}}
set_robot_commands_max0.09518891334533693
set_robot_commands_mean0.08843829202244424
set_robot_commands_median0.08988265991210938
set_robot_commands_min0.08029968921954815
sim_compute_performance-ego_max0.07016274664137098
sim_compute_performance-ego_mean0.06296135754055447
sim_compute_performance-ego_median0.0663563346862793
sim_compute_performance-ego_min0.05545113563537598
sim_compute_robot_state-ego_max0.07536522547403972
sim_compute_robot_state-ego_mean0.06527511423062056
sim_compute_robot_state-ego_median0.06436286926269531
sim_compute_robot_state-ego_min0.05592622206761287
sim_compute_sim_state_max0.03867446934735334
sim_compute_sim_state_mean0.035069092234315355
sim_compute_sim_state_median0.03630220413208008
sim_compute_sim_state_min0.028975440905644342
sim_physics_max0.025978256154943397
sim_physics_mean0.021895070105876
sim_physics_median0.02146087646484375
sim_physics_min0.01806165621830867
sim_render-ego_max0.06324880599975585
sim_render-ego_mean0.05831998619666466
sim_render-ego_median0.05967049598693848
sim_render-ego_min0.05236357688903809
simulation-passed1
survival_time_max1.3500000000000003
survival_time_mean1.2800000000000005
survival_time_min1.2500000000000004
No reset possible
192752828Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-38-104-80540:13:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.19620110193888343
agent_compute-ego_mean0.15786271887420464
agent_compute-ego_median0.16447535969994284
agent_compute-ego_min0.11692047615845998
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.04479638585504496, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06767089861743855, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.17214424655122576, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.11437007616151054, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.04537677315046203, "sim_compute_performance-ego": 0.07874630982021116, "sim_compute_robot_state-ego": 0.06733738701298551}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.023800297216935593, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.07318795269185846, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.16447535969994284, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.0960105765949596, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03753073648972945, "sim_compute_performance-ego": 0.06812806021083485, "sim_compute_robot_state-ego": 0.06979363073002208}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.03382843865288628, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.07505389849344889, "in-drivable-lane": 0, "agent_compute-ego": 0.19620110193888343, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.12854857444763185, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04548312822977702, "sim_compute_performance-ego": 0.08450807995266385, "sim_compute_robot_state-ego": 0.09459426138136122}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.017860621213912964, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.04966151217619578, "in-drivable-lane": 0, "agent_compute-ego": 0.11692047615845998, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0715909202893575, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.02965615689754486, "sim_compute_performance-ego": 0.0524054616689682, "sim_compute_robot_state-ego": 0.05344358583291372}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.02270542523440193, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.05572490481769338, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1395724100225112, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.09123171427670648, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03847117283765007, "sim_compute_performance-ego": 0.0594288987271926, "sim_compute_robot_state-ego": 0.08350691023994894}}
set_robot_commands_max0.12854857444763185
set_robot_commands_mean0.10035037235403318
set_robot_commands_median0.0960105765949596
set_robot_commands_min0.0715909202893575
sim_compute_performance-ego_max0.08450807995266385
sim_compute_performance-ego_mean0.06864336207597413
sim_compute_performance-ego_median0.06812806021083485
sim_compute_performance-ego_min0.0524054616689682
sim_compute_robot_state-ego_max0.09459426138136122
sim_compute_robot_state-ego_mean0.07373515503944629
sim_compute_robot_state-ego_median0.06979363073002208
sim_compute_robot_state-ego_min0.05344358583291372
sim_compute_sim_state_max0.04548312822977702
sim_compute_sim_state_mean0.03930359352103269
sim_compute_sim_state_median0.03847117283765007
sim_compute_sim_state_min0.02965615689754486
sim_physics_max0.04479638585504496
sim_physics_mean0.028598233634636344
sim_physics_median0.023800297216935593
sim_physics_min0.017860621213912964
sim_render-ego_max0.07505389849344889
sim_render-ego_mean0.06425983335932701
sim_render-ego_median0.06767089861743855
sim_render-ego_min0.04966151217619578
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
192482933Bhairav MehtaBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationhost-errornoip-172-31-38-104-80540:15:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 384, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 380, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1331, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 297, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 258, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 686, in reraise
    raise value
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 306, in _raise_timeout
    raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown-shell/lib/dt_shell/env_checks.py", line 60, in check_docker_environment
    containers = client.containers.list(filters=dict(status='running'))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 925, in list
    containers.append(self.get(r['Id']))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 862, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 755, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 892, in write_logs
    client = check_docker_environment()
  File "/project/src/duckietown-shell/lib/dt_shell/env_checks.py", line 67, in check_docker_environment
    raise InvalidEnvironment(msg)
dt_shell.exceptions.InvalidEnvironment: I cannot communicate with Docker:
UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

Make sure the docker service is running.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible