Duckietown Challenges Home Challenges Submissions

Evaluator 765

ID765
evaluatoridsc-rudolf-9560
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-9560
versiond-c:4.0.18;d-c-r:4.0.27;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success23 18624
# timeout
# failed2 18630
# error11 18638
# aborted6 18969
# host-error6 18982
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
191522300Andrea Censi 🇨🇭Python templateaido2-AMOD-service_qualitystep2-scoringsuccessyesidsc-rudolf-95600:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality-32.754042946526994


other stats
efficiency-64.0305317861065
fleet_size-1000000000
No reset possible
191452300Andrea Censi 🇨🇭Python templateaido2-AMOD-service_qualitystep1-simulationsuccessyesidsc-rudolf-95600:03:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible
191182961Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-95600:21:20
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
191162953Bhairav MehtaBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-95600:07:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07091088688141989
survival_time_median1.6000000000000008
deviation-center-line_median0.04246300250295304
in-drivable-lane_median0.5000000000000004


other stats
agent_compute-ego_max0.2579405754804611
agent_compute-ego_mean0.2133246343326168
agent_compute-ego_median0.2034933987785788
agent_compute-ego_min0.19487913165773663
deviation-center-line_max0.045456903080898
deviation-center-line_mean0.0389239937943314
deviation-center-line_min0.025872964535231698
deviation-heading_max0.7807873705161368
deviation-heading_mean0.7255365667992566
deviation-heading_median0.7430474472660081
deviation-heading_min0.6233433972699136
driven_any_max0.18014278328049962
driven_any_mean0.15928533802065087
driven_any_median0.16274017393720963
driven_any_min0.13684221131338936
driven_lanedir_consec_max0.08655675364174176
driven_lanedir_consec_mean0.06991173327637604
driven_lanedir_consec_min0.05504410747792443
driven_lanedir_max0.08655675364174176
driven_lanedir_mean0.06991173327637604
driven_lanedir_median0.07091088688141989
driven_lanedir_min0.05504410747792443
in-drivable-lane_max0.5000000000000004
in-drivable-lane_mean0.37000000000000033
in-drivable-lane_min0.15000000000000013
per-episodes
details{"udem1-0-0": {"driven_any": 0.16274017393720963, "sim_physics": 0.02904096245765686, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05504410747792443, "sim_render-ego": 0.061547622084617615, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.2579405754804611, "deviation-heading": 0.6233433972699136, "set_robot_commands": 0.07875682413578033, "deviation-center-line": 0.025872964535231698, "driven_lanedir_consec": 0.05504410747792443, "sim_compute_sim_state": 0.03543737530708313, "sim_compute_performance-ego": 0.06299611926078796, "sim_compute_robot_state-ego": 0.06494870781898499, "sim_compute_robot_state-npc0": 0.06798671931028366, "sim_compute_robot_state-npc1": 0.062150247395038605, "sim_compute_robot_state-npc2": 0.0644928365945816, "sim_compute_robot_state-npc3": 0.062031470239162445}, "udem1-1-0": {"driven_any": 0.18014278328049962, "sim_physics": 0.030026025242275663, "survival_time": 1.800000000000001, "driven_lanedir": 0.08655675364174176, "sim_render-ego": 0.06837745507558186, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.2120231588681539, "deviation-heading": 0.7430474472660081, "set_robot_commands": 0.0811455249786377, "deviation-center-line": 0.04246300250295304, "driven_lanedir_consec": 0.08655675364174176, "sim_compute_sim_state": 0.035464968946244985, "sim_compute_performance-ego": 0.06644046306610107, "sim_compute_robot_state-ego": 0.06421591175927056, "sim_compute_robot_state-npc0": 0.06967057122124566, "sim_compute_robot_state-npc1": 0.06484229034847683, "sim_compute_robot_state-npc2": 0.06533877054850261, "sim_compute_robot_state-npc3": 0.06330524550543891}, "udem1-2-0": {"driven_any": 0.13684221131338936, "sim_physics": 0.03094461134501866, "survival_time": 1.4000000000000006, "driven_lanedir": 0.06156084273478957, "sim_render-ego": 0.06839399678366524, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.19487913165773663, "deviation-heading": 0.7807873705161368, "set_robot_commands": 0.0804266163281032, "deviation-center-line": 0.04314689230184291, "driven_lanedir_consec": 0.06156084273478957, "sim_compute_sim_state": 0.036161414214542935, "sim_compute_performance-ego": 0.06784322432109288, "sim_compute_robot_state-ego": 0.06291465248380389, "sim_compute_robot_state-npc0": 0.07068834134510585, "sim_compute_robot_state-npc1": 0.06306967564991542, "sim_compute_robot_state-npc2": 0.061986991337367466, "sim_compute_robot_state-npc3": 0.06232788733073643}, "udem1-3-0": {"driven_any": 0.1515844345680399, "sim_physics": 0.031406315167744954, "survival_time": 1.5000000000000009, "driven_lanedir": 0.07548607564600451, "sim_render-ego": 0.06781995296478271, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.19828690687815348, "deviation-heading": 0.7736276142889771, "set_robot_commands": 0.07887507279713948, "deviation-center-line": 0.045456903080898, "driven_lanedir_consec": 0.07548607564600451, "sim_compute_sim_state": 0.036392529805501304, "sim_compute_performance-ego": 0.06488362153371176, "sim_compute_robot_state-ego": 0.06600981553395589, "sim_compute_robot_state-npc0": 0.07352470556894938, "sim_compute_robot_state-npc1": 0.06949685414632162, "sim_compute_robot_state-npc2": 0.06737685203552246, "sim_compute_robot_state-npc3": 0.06783738136291503}, "udem1-4-0": {"driven_any": 0.16511708700411593, "sim_physics": 0.029892654979930204, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07091088688141989, "sim_render-ego": 0.06614139500786276, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.2034933987785788, "deviation-heading": 0.7068770046552477, "set_robot_commands": 0.08351841393639059, "deviation-center-line": 0.037680206550731385, "driven_lanedir_consec": 0.07091088688141989, "sim_compute_sim_state": 0.03623269586002126, "sim_compute_performance-ego": 0.0652620932635139, "sim_compute_robot_state-ego": 0.06642056212705724, "sim_compute_robot_state-npc0": 0.07249156166525449, "sim_compute_robot_state-npc1": 0.06532777056974523, "sim_compute_robot_state-npc2": 0.06315771271200742, "sim_compute_robot_state-npc3": 0.06436858457677505}}
set_robot_commands_max0.08351841393639059
set_robot_commands_mean0.08054449043521025
set_robot_commands_median0.0804266163281032
set_robot_commands_min0.07875682413578033
sim_compute_performance-ego_max0.06784322432109288
sim_compute_performance-ego_mean0.06548510428904152
sim_compute_performance-ego_median0.0652620932635139
sim_compute_performance-ego_min0.06299611926078796
sim_compute_robot_state-ego_max0.06642056212705724
sim_compute_robot_state-ego_mean0.06490192994461452
sim_compute_robot_state-ego_median0.06494870781898499
sim_compute_robot_state-ego_min0.06291465248380389
sim_compute_robot_state-npc0_max0.07352470556894938
sim_compute_robot_state-npc0_mean0.0708723798221678
sim_compute_robot_state-npc0_median0.07068834134510585
sim_compute_robot_state-npc0_min0.06798671931028366
sim_compute_robot_state-npc1_max0.06949685414632162
sim_compute_robot_state-npc1_mean0.06497736762189954
sim_compute_robot_state-npc1_median0.06484229034847683
sim_compute_robot_state-npc1_min0.062150247395038605
sim_compute_robot_state-npc2_max0.06737685203552246
sim_compute_robot_state-npc2_mean0.06447063264559631
sim_compute_robot_state-npc2_median0.0644928365945816
sim_compute_robot_state-npc2_min0.061986991337367466
sim_compute_robot_state-npc3_max0.06783738136291503
sim_compute_robot_state-npc3_mean0.06397411380300558
sim_compute_robot_state-npc3_median0.06330524550543891
sim_compute_robot_state-npc3_min0.062031470239162445
sim_compute_sim_state_max0.036392529805501304
sim_compute_sim_state_mean0.035937796826678726
sim_compute_sim_state_median0.036161414214542935
sim_compute_sim_state_min0.03543737530708313
sim_physics_max0.031406315167744954
sim_physics_mean0.030262113838525267
sim_physics_median0.030026025242275663
sim_physics_min0.02904096245765686
sim_render-ego_max0.06839399678366524
sim_render-ego_mean0.06645608438330204
sim_render-ego_median0.06781995296478271
sim_render-ego_min0.061547622084617615
simulation-passed1
survival_time_max1.800000000000001
survival_time_mean1.6000000000000008
survival_time_min1.4000000000000006
No reset possible
191002928Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-95600:08:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.14012603313990724
survival_time_median1.3000000000000005
deviation-center-line_median0.05901274376135567
in-drivable-lane_median0


other stats
agent_compute-ego_max0.40788776533944265
agent_compute-ego_mean0.33476597719486617
agent_compute-ego_median0.3408019175896278
agent_compute-ego_min0.2745673656463623
deviation-center-line_max0.07434475248362699
deviation-center-line_mean0.06201598225778786
deviation-center-line_min0.05461460644938909
deviation-heading_max0.6377796155010951
deviation-heading_mean0.6154194085069695
deviation-heading_median0.6190157965000459
deviation-heading_min0.5674665480797144
driven_any_max0.2796817885960001
driven_any_mean0.20593806949763796
driven_any_median0.1871045668127292
driven_any_min0.17578018806740175
driven_lanedir_consec_max0.23903091529425913
driven_lanedir_consec_mean0.16036595005642157
driven_lanedir_consec_min0.1279389730175884
driven_lanedir_max0.23903091529425913
driven_lanedir_mean0.16036595005642157
driven_lanedir_median0.14012603313990724
driven_lanedir_min0.1279389730175884
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.2059048053357713, "sim_physics": 0.031181837831224715, "survival_time": 1.4000000000000006, "driven_lanedir": 0.16286248277670645, "sim_render-ego": 0.05852032559258597, "in-drivable-lane": 0, "agent_compute-ego": 0.40788776533944265, "deviation-heading": 0.6346092584853296, "set_robot_commands": 0.07690385409763881, "deviation-center-line": 0.06601172089939268, "driven_lanedir_consec": 0.16286248277670645, "sim_compute_sim_state": 0.03514761584145682, "sim_compute_performance-ego": 0.0623563357761928, "sim_compute_robot_state-ego": 0.0639021737234933, "sim_compute_robot_state-npc0": 0.06595374856676374, "sim_compute_robot_state-npc1": 0.06268812928880964, "sim_compute_robot_state-npc2": 0.06058218649455479, "sim_compute_robot_state-npc3": 0.06117244277681623}, "udem1-1-0": {"driven_any": 0.2796817885960001, "sim_physics": 0.03246504260647681, "survival_time": 1.5500000000000007, "driven_lanedir": 0.23903091529425913, "sim_render-ego": 0.06040010144633631, "in-drivable-lane": 0, "agent_compute-ego": 0.3627976832851287, "deviation-heading": 0.5674665480797144, "set_robot_commands": 0.07400949539676789, "deviation-center-line": 0.07434475248362699, "driven_lanedir_consec": 0.23903091529425913, "sim_compute_sim_state": 0.03461214803880261, "sim_compute_performance-ego": 0.06014895439147949, "sim_compute_robot_state-ego": 0.06273445006339781, "sim_compute_robot_state-npc0": 0.06440121127713111, "sim_compute_robot_state-npc1": 0.060471234783049554, "sim_compute_robot_state-npc2": 0.05954065630512853, "sim_compute_robot_state-npc3": 0.05880754993807885}, "udem1-2-0": {"driven_any": 0.1871045668127292, "sim_physics": 0.033487870143010065, "survival_time": 1.3000000000000005, "driven_lanedir": 0.14012603313990724, "sim_render-ego": 0.0637430319419274, "in-drivable-lane": 0, "agent_compute-ego": 0.3408019175896278, "deviation-heading": 0.6182258239686623, "set_robot_commands": 0.07684743404388428, "deviation-center-line": 0.05901274376135567, "driven_lanedir_consec": 0.14012603313990724, "sim_compute_sim_state": 0.03321899817540096, "sim_compute_performance-ego": 0.06036737331977257, "sim_compute_robot_state-ego": 0.0614479321699876, "sim_compute_robot_state-npc0": 0.06562955562884991, "sim_compute_robot_state-npc1": 0.06337139239678016, "sim_compute_robot_state-npc2": 0.05981185803046593, "sim_compute_robot_state-npc3": 0.06107833752265343}, "udem1-3-0": {"driven_any": 0.18121899867628752, "sim_physics": 0.034824600586524375, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1318713460536467, "sim_render-ego": 0.061914874957158014, "in-drivable-lane": 0, "agent_compute-ego": 0.2745673656463623, "deviation-heading": 0.6377796155010951, "set_robot_commands": 0.07638521377856915, "deviation-center-line": 0.05461460644938909, "driven_lanedir_consec": 0.1318713460536467, "sim_compute_sim_state": 0.036618489485520586, "sim_compute_performance-ego": 0.06064668985513541, "sim_compute_robot_state-ego": 0.06405409482809213, "sim_compute_robot_state-npc0": 0.06459342516385592, "sim_compute_robot_state-npc1": 0.06436325036562406, "sim_compute_robot_state-npc2": 0.0631101131439209, "sim_compute_robot_state-npc3": 0.06552574267754188}, "udem1-4-0": {"driven_any": 0.17578018806740175, "sim_physics": 0.028391132354736327, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1279389730175884, "sim_render-ego": 0.05883027076721192, "in-drivable-lane": 0, "agent_compute-ego": 0.2877751541137695, "deviation-heading": 0.6190157965000459, "set_robot_commands": 0.07870048522949219, "deviation-center-line": 0.056096087695174865, "driven_lanedir_consec": 0.1279389730175884, "sim_compute_sim_state": 0.03718918800354004, "sim_compute_performance-ego": 0.06277231216430663, "sim_compute_robot_state-ego": 0.06137678146362305, "sim_compute_robot_state-npc0": 0.0681296443939209, "sim_compute_robot_state-npc1": 0.0647162914276123, "sim_compute_robot_state-npc2": 0.06087549209594727, "sim_compute_robot_state-npc3": 0.062456703186035155}}
set_robot_commands_max0.07870048522949219
set_robot_commands_mean0.07656929650927047
set_robot_commands_median0.07684743404388428
set_robot_commands_min0.07400949539676789
sim_compute_performance-ego_max0.06277231216430663
sim_compute_performance-ego_mean0.061258333101377384
sim_compute_performance-ego_median0.06064668985513541
sim_compute_performance-ego_min0.06014895439147949
sim_compute_robot_state-ego_max0.06405409482809213
sim_compute_robot_state-ego_mean0.06270308644971878
sim_compute_robot_state-ego_median0.06273445006339781
sim_compute_robot_state-ego_min0.06137678146362305
sim_compute_robot_state-npc0_max0.0681296443939209
sim_compute_robot_state-npc0_mean0.06574151700610431
sim_compute_robot_state-npc0_median0.06562955562884991
sim_compute_robot_state-npc0_min0.06440121127713111
sim_compute_robot_state-npc1_max0.0647162914276123
sim_compute_robot_state-npc1_mean0.06312205965237515
sim_compute_robot_state-npc1_median0.06337139239678016
sim_compute_robot_state-npc1_min0.060471234783049554
sim_compute_robot_state-npc2_max0.0631101131439209
sim_compute_robot_state-npc2_mean0.06078406121400348
sim_compute_robot_state-npc2_median0.06058218649455479
sim_compute_robot_state-npc2_min0.05954065630512853
sim_compute_robot_state-npc3_max0.06552574267754188
sim_compute_robot_state-npc3_mean0.06180815522022511
sim_compute_robot_state-npc3_median0.06117244277681623
sim_compute_robot_state-npc3_min0.05880754993807885
sim_compute_sim_state_max0.03718918800354004
sim_compute_sim_state_mean0.0353572879089442
sim_compute_sim_state_median0.03514761584145682
sim_compute_sim_state_min0.03321899817540096
sim_physics_max0.034824600586524375
sim_physics_mean0.032070096704394466
sim_physics_median0.03246504260647681
sim_physics_min0.028391132354736327
sim_render-ego_max0.0637430319419274
sim_render-ego_mean0.060681720941043925
sim_render-ego_median0.06040010144633631
sim_render-ego_min0.05852032559258597
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.3600000000000003
survival_time_min1.2500000000000004
No reset possible
190902916Claudio RuchPython templateaido2-AMOD-efficiencystep1-simulationabortednoidsc-rudolf-95600:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190882917Claudio RuchPython templateaido2-AMOD-service_qualitystep1-simulationabortednoidsc-rudolf-95600:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190642914Claudio RuchPython templateaido2-AMOD-efficiencystep1-simulationhost-errornoidsc-rudolf-95600:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190632915Claudio RuchPython templateaido2-AMOD-service_qualitystep1-simulationhost-errornoidsc-rudolf-95600:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190412907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-95600:21:06
Waited 1200 seconds [...]
Waited 1200 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190312903Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-95600:21:11
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190092891Diego Charrez 🇵🇪Python templateaido2-AMOD-efficiencystep1-simulationhost-errornoidsc-rudolf-95600:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190052892Diego Charrez 🇵🇪Python templateaido2-AMOD-service_qualitystep1-simulationhost-errornoidsc-rudolf-95600:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189832890Diego Charrez 🇵🇪Python templateaido2-AMOD-service_qualitystep1-simulationhost-errornoidsc-rudolf-95600:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189822889Diego Charrez 🇵🇪Python templateaido2-AMOD-efficiencystep1-simulationhost-errornoidsc-rudolf-95600:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189772889Diego Charrez 🇵🇪Python templateaido2-AMOD-efficiencystep1-simulationabortednoidsc-rudolf-95600:00:03
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189762889Diego Charrez 🇵🇪Python templateaido2-AMOD-efficiencystep1-simulationabortednoidsc-rudolf-95600:00:27
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189722889Diego Charrez 🇵🇪Python templateaido2-AMOD-efficiencystep1-simulationabortednoidsc-rudolf-95600:02:35
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189692890Diego Charrez 🇵🇪Python templateaido2-AMOD-service_qualitystep1-simulationabortednoidsc-rudolf-95600:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189332877Andrea Daniele 🇮🇹minimal_agent (Python 3)aido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-95600:15:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.225306900765771
survival_time_median10.750000000000018
deviation-center-line_median0.40864173779456053
in-drivable-lane_median1.7000000000000242


other stats
agent_compute-ego_max0.1553019771661459
agent_compute-ego_mean0.1522871327134929
agent_compute-ego_median0.15303011162336483
agent_compute-ego_min0.1487415576422656
deviation-center-line_max0.6491801892887803
deviation-center-line_mean0.3683230725655418
deviation-center-line_min0.1475671628461062
deviation-heading_max2.2060076411946548
deviation-heading_mean1.4163758252990906
deviation-heading_median1.5250264276913703
deviation-heading_min0.6970592634293067
driven_any_max1.6057043265958648
driven_any_mean1.3484469345214642
driven_any_median1.5756972277649912
driven_any_min0.9900494571900692
driven_lanedir_consec_max1.4904214722299334
driven_lanedir_consec_mean1.0721437270256324
driven_lanedir_consec_min0.6474115509746436
driven_lanedir_max1.4904214722299334
driven_lanedir_mean1.0721437270256324
driven_lanedir_median1.225306900765771
driven_lanedir_min0.6474115509746436
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.4300000000000082
in-drivable-lane_min0.25000000000000355
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.016956157821545498, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.06850323231100179, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15118990527640144, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.07797704497687251, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.04369469169232485, "sim_compute_performance-ego": 0.06827188224243604, "sim_compute_robot_state-ego": 0.06697689886573407}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900494571900692, "sim_physics": 0.017733264143449546, "survival_time": 6.849999999999984, "driven_lanedir": 0.764431461654983, "sim_render-ego": 0.07056141247714523, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15317211185928678, "deviation-heading": 0.6970592634293067, "set_robot_commands": 0.07753892710609157, "deviation-center-line": 0.21999312889725264, "driven_lanedir_consec": 0.764431461654983, "sim_compute_sim_state": 0.045230931609216395, "sim_compute_performance-ego": 0.06963044535504641, "sim_compute_robot_state-ego": 0.06926959796543539}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6057043265958648, "sim_physics": 0.017274058987741512, "survival_time": 11.150000000000023, "driven_lanedir": 1.4904214722299334, "sim_render-ego": 0.07073965628585473, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.1553019771661459, "deviation-heading": 2.2060076411946548, "set_robot_commands": 0.0773118707631201, "deviation-center-line": 0.6491801892887803, "driven_lanedir_consec": 1.4904214722299334, "sim_compute_sim_state": 0.04413172375460911, "sim_compute_performance-ego": 0.06847063842910288, "sim_compute_robot_state-ego": 0.06801971726353392}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5770378848298965, "sim_physics": 0.01704337430554767, "survival_time": 10.750000000000018, "driven_lanedir": 1.225306900765771, "sim_render-ego": 0.06926361793695494, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.15303011162336483, "deviation-heading": 1.8264323848694184, "set_robot_commands": 0.07893157005310059, "deviation-center-line": 0.40864173779456053, "driven_lanedir_consec": 1.225306900765771, "sim_compute_sim_state": 0.04480573853781057, "sim_compute_performance-ego": 0.06811237335205078, "sim_compute_robot_state-ego": 0.06881538657254951}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5756972277649912, "sim_physics": 0.01714963052007887, "survival_time": 10.800000000000018, "driven_lanedir": 1.233147249502831, "sim_render-ego": 0.06752782618557965, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.1487415576422656, "deviation-heading": 1.5250264276913703, "set_robot_commands": 0.07686309461240415, "deviation-center-line": 0.4162331440010094, "driven_lanedir_consec": 1.233147249502831, "sim_compute_sim_state": 0.043922222322887845, "sim_compute_performance-ego": 0.06724305064589889, "sim_compute_robot_state-ego": 0.0688973312024717}}
set_robot_commands_max0.07893157005310059
set_robot_commands_mean0.07772450150231777
set_robot_commands_median0.07753892710609157
set_robot_commands_min0.07686309461240415
sim_compute_performance-ego_max0.06963044535504641
sim_compute_performance-ego_mean0.06834567800490701
sim_compute_performance-ego_median0.06827188224243604
sim_compute_performance-ego_min0.06724305064589889
sim_compute_robot_state-ego_max0.06926959796543539
sim_compute_robot_state-ego_mean0.06839578637394492
sim_compute_robot_state-ego_median0.06881538657254951
sim_compute_robot_state-ego_min0.06697689886573407
sim_compute_sim_state_max0.045230931609216395
sim_compute_sim_state_mean0.04435706158336975
sim_compute_sim_state_median0.04413172375460911
sim_compute_sim_state_min0.04369469169232485
sim_physics_max0.017733264143449546
sim_physics_mean0.017231297155672617
sim_physics_median0.01714963052007887
sim_physics_min0.016956157821545498
sim_render-ego_max0.07073965628585473
sim_render-ego_mean0.06931914903930728
sim_render-ego_median0.06926361793695494
sim_render-ego_min0.06752782618557965
simulation-passed1
survival_time_max11.150000000000023
survival_time_mean9.300000000000004
survival_time_min6.849999999999984
No reset possible
189302871Peter Almasi 🇭🇺Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-95600:06:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7818595530775636
survival_time_median2.3999999999999995
deviation-center-line_median0.05477019665148306
in-drivable-lane_median0.6999999999999991


other stats
agent_compute-ego_max0.1835041168408516
agent_compute-ego_mean0.1776204226967709
agent_compute-ego_median0.1796757393195981
agent_compute-ego_min0.17165122353113615
deviation-center-line_max0.18216209978951656
deviation-center-line_mean0.10011615593181442
deviation-center-line_min0.03755859071755083
deviation-heading_max1.436729282105208
deviation-heading_mean0.5980113330451529
deviation-heading_median0.5234815026970941
deviation-heading_min0.1839215741515293
driven_any_max2.4295522418543007
driven_any_mean1.413325455749734
driven_any_median1.137655986662778
driven_any_min0.8584365506054418
driven_lanedir_consec_max1.5058707151667556
driven_lanedir_consec_mean0.9397893721182252
driven_lanedir_consec_min0.37727616016542065
driven_lanedir_max1.7174987384633815
driven_lanedir_mean0.9884061899166752
driven_lanedir_median0.7818595530775636
driven_lanedir_min0.37727616016542065
in-drivable-lane_max1.0499999999999965
in-drivable-lane_mean0.679999999999999
in-drivable-lane_min0.2499999999999991
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.137655986662778, "sim_physics": 0.016470864415168762, "survival_time": 2.3999999999999995, "driven_lanedir": 0.6899675327353663, "sim_render-ego": 0.064009095231692, "in-drivable-lane": 0.6999999999999991, "agent_compute-ego": 0.18042359252770743, "deviation-heading": 0.5234815026970941, "set_robot_commands": 0.0753908356030782, "deviation-center-line": 0.04855382277826571, "driven_lanedir_consec": 0.6585114670397423, "sim_compute_sim_state": 0.04270936052004496, "sim_compute_performance-ego": 0.06425277392069499, "sim_compute_robot_state-ego": 0.06530348459879558}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0245341668356458, "sim_physics": 0.016336242357889812, "survival_time": 2.1000000000000005, "driven_lanedir": 0.7818595530775636, "sim_render-ego": 0.06448884237380255, "in-drivable-lane": 0.44999999999999973, "agent_compute-ego": 0.17284744126456125, "deviation-heading": 0.1839215741515293, "set_robot_commands": 0.07891757147652763, "deviation-center-line": 0.03755859071755083, "driven_lanedir_consec": 0.7818595530775636, "sim_compute_sim_state": 0.04335409686678931, "sim_compute_performance-ego": 0.06472064767565046, "sim_compute_robot_state-ego": 0.06639347757611956}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.616448332790504, "sim_physics": 0.018168441584852875, "survival_time": 3.049999999999997, "driven_lanedir": 1.3754289651416445, "sim_render-ego": 0.06531209632998607, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.1796757393195981, "deviation-heading": 0.6320132901052304, "set_robot_commands": 0.08031917400047427, "deviation-center-line": 0.17753606972225594, "driven_lanedir_consec": 1.3754289651416445, "sim_compute_sim_state": 0.04487337440740867, "sim_compute_performance-ego": 0.06769394483722624, "sim_compute_robot_state-ego": 0.06823433422651447}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.4295522418543007, "sim_physics": 0.017785166318599995, "survival_time": 5.1999999999999895, "driven_lanedir": 1.7174987384633815, "sim_render-ego": 0.0637474128833184, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.17165122353113615, "deviation-heading": 1.436729282105208, "set_robot_commands": 0.07725564333108756, "deviation-center-line": 0.18216209978951656, "driven_lanedir_consec": 1.5058707151667556, "sim_compute_sim_state": 0.04402235379585853, "sim_compute_performance-ego": 0.0640224562241481, "sim_compute_robot_state-ego": 0.06611225238213173}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8584365506054418, "sim_physics": 0.016926031846266527, "survival_time": 1.950000000000001, "driven_lanedir": 0.37727616016542065, "sim_render-ego": 0.06512330739926069, "in-drivable-lane": 0.9500000000000008, "agent_compute-ego": 0.1835041168408516, "deviation-heading": 0.21391101616670205, "set_robot_commands": 0.08513269057640663, "deviation-center-line": 0.05477019665148306, "driven_lanedir_consec": 0.37727616016542065, "sim_compute_sim_state": 0.045707445878248945, "sim_compute_performance-ego": 0.06671172533279811, "sim_compute_robot_state-ego": 0.06851421258388421}}
set_robot_commands_max0.08513269057640663
set_robot_commands_mean0.07940318299751485
set_robot_commands_median0.07891757147652763
set_robot_commands_min0.0753908356030782
sim_compute_performance-ego_max0.06769394483722624
sim_compute_performance-ego_mean0.06548030959810358
sim_compute_performance-ego_median0.06472064767565046
sim_compute_performance-ego_min0.0640224562241481
sim_compute_robot_state-ego_max0.06851421258388421
sim_compute_robot_state-ego_mean0.0669115522734891
sim_compute_robot_state-ego_median0.06639347757611956
sim_compute_robot_state-ego_min0.06530348459879558
sim_compute_sim_state_max0.045707445878248945
sim_compute_sim_state_mean0.04413332629367008
sim_compute_sim_state_median0.04402235379585853
sim_compute_sim_state_min0.04270936052004496
sim_physics_max0.018168441584852875
sim_physics_mean0.017137349304555592
sim_physics_median0.016926031846266527
sim_physics_min0.016336242357889812
sim_render-ego_max0.06531209632998607
sim_render-ego_mean0.06453615084361194
sim_render-ego_median0.06448884237380255
sim_render-ego_min0.0637474128833184
simulation-passed1
survival_time_max5.1999999999999895
survival_time_mean2.9399999999999973
survival_time_min1.950000000000001
No reset possible
189272362Andrea Censi 🇨🇭random_agentaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-95600:05:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.14006199205622957
agent_compute-ego_mean0.13542655626338732
agent_compute-ego_median0.1353160752190484
agent_compute-ego_min0.13177581103342884
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.01714697423970924, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.0672340932882057, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13177581103342884, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07782833531217755, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.041972128850109175, "sim_compute_performance-ego": 0.06585045580594044, "sim_compute_robot_state-ego": 0.06467843505571473}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.01681418852372603, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06899551911787553, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1346296342936429, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07780558954585683, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.041655930605801667, "sim_compute_performance-ego": 0.06792104786092584, "sim_compute_robot_state-ego": 0.0660496245731007}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.016089434093899197, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.0682701375749376, "in-drivable-lane": 0, "agent_compute-ego": 0.1353160752190484, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07742909855312771, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04190480444166395, "sim_compute_performance-ego": 0.06693691147698297, "sim_compute_robot_state-ego": 0.06527104377746581}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.016620213786760967, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.07083448270956676, "in-drivable-lane": 0, "agent_compute-ego": 0.13534926871458688, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07721162339051564, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04268089930216471, "sim_compute_performance-ego": 0.07002131640911102, "sim_compute_robot_state-ego": 0.0660781313975652}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.01731406941133387, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.07121878161149867, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14006199205622957, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07982104315477259, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04173452012679156, "sim_compute_performance-ego": 0.0682839365566478, "sim_compute_robot_state-ego": 0.06474509309319888}}
set_robot_commands_max0.07982104315477259
set_robot_commands_mean0.07801913799129005
set_robot_commands_median0.07780558954585683
set_robot_commands_min0.07721162339051564
sim_compute_performance-ego_max0.07002131640911102
sim_compute_performance-ego_mean0.06780273362192162
sim_compute_performance-ego_median0.06792104786092584
sim_compute_performance-ego_min0.06585045580594044
sim_compute_robot_state-ego_max0.0660781313975652
sim_compute_robot_state-ego_mean0.06536446557940906
sim_compute_robot_state-ego_median0.06527104377746581
sim_compute_robot_state-ego_min0.06467843505571473
sim_compute_sim_state_max0.04268089930216471
sim_compute_sim_state_mean0.041989656665306206
sim_compute_sim_state_median0.04190480444166395
sim_compute_sim_state_min0.041655930605801667
sim_physics_max0.01731406941133387
sim_physics_mean0.016796976011085863
sim_physics_median0.01681418852372603
sim_physics_min0.016089434093899197
sim_render-ego_max0.07121878161149867
sim_render-ego_mean0.06931060286041686
sim_render-ego_median0.06899551911787553
sim_render-ego_min0.0672340932882057
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
189142413jiang pengBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-95600:21:01
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189072384Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-95600:04:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.09168411810457444
survival_time_median1.4000000000000006
deviation-center-line_median0.03738462622611095
in-drivable-lane_median0.2500000000000002


other stats
agent_compute-ego_max0.2618074246815273
agent_compute-ego_mean0.23965671825809637
agent_compute-ego_median0.22907150643212457
agent_compute-ego_min0.2245689971106393
deviation-center-line_max0.04543008975077391
deviation-center-line_mean0.03683944555026227
deviation-center-line_min0.0257094706357947
deviation-heading_max0.6842052506949267
deviation-heading_mean0.6448628777701277
deviation-heading_median0.6406996668380651
deviation-heading_min0.6137629919574086
driven_any_max0.208993278749454
driven_any_mean0.16892466870312145
driven_any_median0.16210268435820271
driven_any_min0.14946320112132128
driven_lanedir_consec_max0.11287440353545895
driven_lanedir_consec_mean0.08678324154576308
driven_lanedir_consec_min0.04966684745878158
driven_lanedir_max0.11287440353545895
driven_lanedir_mean0.08678324154576308
driven_lanedir_median0.09168411810457444
driven_lanedir_min0.04966684745878158
in-drivable-lane_max0.4500000000000004
in-drivable-lane_mean0.29000000000000026
in-drivable-lane_min0.15000000000000013
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.16210268435820271, "sim_physics": 0.017290805067334856, "survival_time": 1.4000000000000006, "driven_lanedir": 0.09168411810457444, "sim_render-ego": 0.06107690504619053, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.2618074246815273, "deviation-heading": 0.6276650742372778, "set_robot_commands": 0.07684681245258876, "deviation-center-line": 0.03589796187071441, "driven_lanedir_consec": 0.09168411810457444, "sim_compute_sim_state": 0.040510518210274835, "sim_compute_performance-ego": 0.06327951805932182, "sim_compute_robot_state-ego": 0.06334137916564941}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.14946320112132128, "sim_physics": 0.015819509824117024, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04966684745878158, "sim_render-ego": 0.06079301834106445, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.22870473861694335, "deviation-heading": 0.6137629919574086, "set_robot_commands": 0.08008301258087158, "deviation-center-line": 0.0257094706357947, "driven_lanedir_consec": 0.04966684745878158, "sim_compute_sim_state": 0.036480498313903806, "sim_compute_performance-ego": 0.060522905985514325, "sim_compute_robot_state-ego": 0.05921659469604492}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15679024614579956, "sim_physics": 0.015977433749607632, "survival_time": 1.4000000000000006, "driven_lanedir": 0.08129691342031897, "sim_render-ego": 0.05663019418716431, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.2245689971106393, "deviation-heading": 0.6406996668380651, "set_robot_commands": 0.07622144903455462, "deviation-center-line": 0.03738462622611095, "driven_lanedir_consec": 0.08129691342031897, "sim_compute_sim_state": 0.03723009995051792, "sim_compute_performance-ego": 0.059169811861855645, "sim_compute_robot_state-ego": 0.058279948575156074}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.208993278749454, "sim_physics": 0.015404883553000057, "survival_time": 1.7000000000000008, "driven_lanedir": 0.11287440353545895, "sim_render-ego": 0.059829782037174, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.25413092444924745, "deviation-heading": 0.6842052506949267, "set_robot_commands": 0.07447428563061882, "deviation-center-line": 0.04543008975077391, "driven_lanedir_consec": 0.11287440353545895, "sim_compute_sim_state": 0.037393289453843064, "sim_compute_performance-ego": 0.0597079641678754, "sim_compute_robot_state-ego": 0.06173517423517564}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1672739331408297, "sim_physics": 0.016069786889212474, "survival_time": 1.4000000000000006, "driven_lanedir": 0.09839392520968147, "sim_render-ego": 0.06096327304840088, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.22907150643212457, "deviation-heading": 0.6579814051229604, "set_robot_commands": 0.08315916572298322, "deviation-center-line": 0.0397750792679174, "driven_lanedir_consec": 0.09839392520968147, "sim_compute_sim_state": 0.03885937588555472, "sim_compute_performance-ego": 0.06160180057798113, "sim_compute_robot_state-ego": 0.05986851453781128}}
set_robot_commands_max0.08315916572298322
set_robot_commands_mean0.07815694508432339
set_robot_commands_median0.07684681245258876
set_robot_commands_min0.07447428563061882
sim_compute_performance-ego_max0.06327951805932182
sim_compute_performance-ego_mean0.06085640013050967
sim_compute_performance-ego_median0.060522905985514325
sim_compute_performance-ego_min0.059169811861855645
sim_compute_robot_state-ego_max0.06334137916564941
sim_compute_robot_state-ego_mean0.06048832224196747
sim_compute_robot_state-ego_median0.05986851453781128
sim_compute_robot_state-ego_min0.058279948575156074
sim_compute_sim_state_max0.040510518210274835
sim_compute_sim_state_mean0.03809475636281887
sim_compute_sim_state_median0.037393289453843064
sim_compute_sim_state_min0.036480498313903806
sim_physics_max0.017290805067334856
sim_physics_mean0.016112483816654408
sim_physics_median0.015977433749607632
sim_physics_min0.015404883553000057
sim_render-ego_max0.06107690504619053
sim_render-ego_mean0.059858634531998835
sim_render-ego_median0.06079301834106445
sim_render-ego_min0.05663019418716431
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.4800000000000006
survival_time_min1.4000000000000006
No reset possible
188992395Liam Paull 🇨🇦random_agentaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-95600:09:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13430878851148817
agent_compute-ego_mean0.12959764445755123
agent_compute-ego_median0.13147126544605603
agent_compute-ego_min0.12523723098466982
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.024960355938605544, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06457016153155633, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12523723098466982, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07912447317591254, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03656102126499392, "sim_compute_performance-ego": 0.062358856201171875, "sim_compute_robot_state-ego": 0.06244058878916615, "sim_compute_robot_state-npc0": 0.07142569433968023, "sim_compute_robot_state-npc1": 0.06678067963078337, "sim_compute_robot_state-npc2": 0.0659020037021277, "sim_compute_robot_state-npc3": 0.06485999305293245}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.02810780026695945, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.0642886378548362, "in-drivable-lane": 0, "agent_compute-ego": 0.13147126544605603, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07980390028520064, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03521115129644221, "sim_compute_performance-ego": 0.06637482751499522, "sim_compute_robot_state-ego": 0.06383631446144798, "sim_compute_robot_state-npc0": 0.07111905921589244, "sim_compute_robot_state-npc1": 0.06630967963825572, "sim_compute_robot_state-npc2": 0.06480656970630992, "sim_compute_robot_state-npc3": 0.06382526592774825}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.02807234658135308, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06572010252210829, "in-drivable-lane": 0, "agent_compute-ego": 0.13430878851148817, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.08026097085740831, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03750994470384386, "sim_compute_performance-ego": 0.0645588927798801, "sim_compute_robot_state-ego": 0.06484191152784559, "sim_compute_robot_state-npc0": 0.07288278473748101, "sim_compute_robot_state-npc1": 0.06667973730299208, "sim_compute_robot_state-npc2": 0.06544089847140842, "sim_compute_robot_state-npc3": 0.06573102209303114}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.028977001706759136, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.0647961397965749, "in-drivable-lane": 0, "agent_compute-ego": 0.12526561816533408, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07926993072032928, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03757149477799734, "sim_compute_performance-ego": 0.0674847960472107, "sim_compute_robot_state-ego": 0.06647037466367085, "sim_compute_robot_state-npc0": 0.07152558366457622, "sim_compute_robot_state-npc1": 0.06688213845094045, "sim_compute_robot_state-npc2": 0.06384679178396861, "sim_compute_robot_state-npc3": 0.06632199883460999}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.026631846147425035, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06909712272531846, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13170531918020809, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07765864975312177, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03617634142146391, "sim_compute_performance-ego": 0.06622515706455007, "sim_compute_robot_state-ego": 0.06496456791372861, "sim_compute_robot_state-npc0": 0.07266260946498197, "sim_compute_robot_state-npc1": 0.06667928485309377, "sim_compute_robot_state-npc2": 0.06639156622045181, "sim_compute_robot_state-npc3": 0.06670290932935827}}
set_robot_commands_max0.08026097085740831
set_robot_commands_mean0.0792235849583945
set_robot_commands_median0.07926993072032928
set_robot_commands_min0.07765864975312177
sim_compute_performance-ego_max0.0674847960472107
sim_compute_performance-ego_mean0.06540050592156159
sim_compute_performance-ego_median0.06622515706455007
sim_compute_performance-ego_min0.062358856201171875
sim_compute_robot_state-ego_max0.06647037466367085
sim_compute_robot_state-ego_mean0.06451075147117183
sim_compute_robot_state-ego_median0.06484191152784559
sim_compute_robot_state-ego_min0.06244058878916615
sim_compute_robot_state-npc0_max0.07288278473748101
sim_compute_robot_state-npc0_mean0.07192314628452237
sim_compute_robot_state-npc0_median0.07152558366457622
sim_compute_robot_state-npc0_min0.07111905921589244
sim_compute_robot_state-npc1_max0.06688213845094045
sim_compute_robot_state-npc1_mean0.06666630397521307
sim_compute_robot_state-npc1_median0.06667973730299208
sim_compute_robot_state-npc1_min0.06630967963825572
sim_compute_robot_state-npc2_max0.06639156622045181
sim_compute_robot_state-npc2_mean0.0652775659768533
sim_compute_robot_state-npc2_median0.06544089847140842
sim_compute_robot_state-npc2_min0.06384679178396861
sim_compute_robot_state-npc3_max0.06670290932935827
sim_compute_robot_state-npc3_mean0.06548823784753602
sim_compute_robot_state-npc3_median0.06573102209303114
sim_compute_robot_state-npc3_min0.06382526592774825
sim_compute_sim_state_max0.03757149477799734
sim_compute_sim_state_mean0.036605990692948245
sim_compute_sim_state_median0.03656102126499392
sim_compute_sim_state_min0.03521115129644221
sim_physics_max0.028977001706759136
sim_physics_mean0.02734987012822045
sim_physics_median0.02807234658135308
sim_physics_min0.024960355938605544
sim_render-ego_max0.06909712272531846
sim_render-ego_mean0.06569443288607883
sim_render-ego_median0.0647961397965749
sim_render-ego_min0.0642886378548362
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
188812408jiang pengBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-95600:21:13
Waited 1203 seconds [...]
Waited 1203 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188672420Andrea Censi 🇨🇭random_agentaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-95600:09:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13184779385725656
agent_compute-ego_mean0.1295863025085393
agent_compute-ego_median0.12922024726867676
agent_compute-ego_min0.12704808976915147
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.025935074068465323, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.0656555508667568, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12890754105909816, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07395164921598614, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03764159274551104, "sim_compute_performance-ego": 0.06387801440256946, "sim_compute_robot_state-ego": 0.061790502296303805, "sim_compute_robot_state-npc0": 0.07013612423302992, "sim_compute_robot_state-npc1": 0.06587448210086462, "sim_compute_robot_state-npc2": 0.06623512394023391, "sim_compute_robot_state-npc3": 0.06655908530613161}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.027893223545768044, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06255456534298984, "in-drivable-lane": 0, "agent_compute-ego": 0.12922024726867676, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.08085924928838556, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03427381948991255, "sim_compute_performance-ego": 0.06337959658015858, "sim_compute_robot_state-ego": 0.06015851822766391, "sim_compute_robot_state-npc0": 0.06945013458078558, "sim_compute_robot_state-npc1": 0.06470473246140913, "sim_compute_robot_state-npc2": 0.06300111792304298, "sim_compute_robot_state-npc3": 0.06473049792376431}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.02517496214972602, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06166612307230632, "in-drivable-lane": 0, "agent_compute-ego": 0.12704808976915147, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07503305011325412, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03370631006028917, "sim_compute_performance-ego": 0.059746408462524415, "sim_compute_robot_state-ego": 0.05867693689134386, "sim_compute_robot_state-npc0": 0.06708441310458713, "sim_compute_robot_state-npc1": 0.05993762016296387, "sim_compute_robot_state-npc2": 0.05955550405714247, "sim_compute_robot_state-npc3": 0.06000061564975315}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.027841617663701378, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06270660956700642, "in-drivable-lane": 0, "agent_compute-ego": 0.13184779385725656, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07721113165219624, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.0363818754752477, "sim_compute_performance-ego": 0.06453285117944081, "sim_compute_robot_state-ego": 0.06242880721886953, "sim_compute_robot_state-npc0": 0.07085236410299937, "sim_compute_robot_state-npc1": 0.06866460541884105, "sim_compute_robot_state-npc2": 0.06266037126382192, "sim_compute_robot_state-npc3": 0.06429083148638408}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.02723953653784359, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06440036437090706, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13090784058851354, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07838651011971866, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03769037653418148, "sim_compute_performance-ego": 0.06114883633220897, "sim_compute_robot_state-ego": 0.059744982158436495, "sim_compute_robot_state-npc0": 0.07113056673723109, "sim_compute_robot_state-npc1": 0.06677743266610538, "sim_compute_robot_state-npc2": 0.06536927994559794, "sim_compute_robot_state-npc3": 0.06584140132455264}}
set_robot_commands_max0.08085924928838556
set_robot_commands_mean0.07708831807790814
set_robot_commands_median0.07721113165219624
set_robot_commands_min0.07395164921598614
sim_compute_performance-ego_max0.06453285117944081
sim_compute_performance-ego_mean0.06253714139138045
sim_compute_performance-ego_median0.06337959658015858
sim_compute_performance-ego_min0.059746408462524415
sim_compute_robot_state-ego_max0.06242880721886953
sim_compute_robot_state-ego_mean0.060559949358523525
sim_compute_robot_state-ego_median0.06015851822766391
sim_compute_robot_state-ego_min0.05867693689134386
sim_compute_robot_state-npc0_max0.07113056673723109
sim_compute_robot_state-npc0_mean0.06973072055172662
sim_compute_robot_state-npc0_median0.07013612423302992
sim_compute_robot_state-npc0_min0.06708441310458713
sim_compute_robot_state-npc1_max0.06866460541884105
sim_compute_robot_state-npc1_mean0.06519177456203681
sim_compute_robot_state-npc1_median0.06587448210086462
sim_compute_robot_state-npc1_min0.05993762016296387
sim_compute_robot_state-npc2_max0.06623512394023391
sim_compute_robot_state-npc2_mean0.06336427942596784
sim_compute_robot_state-npc2_median0.06300111792304298
sim_compute_robot_state-npc2_min0.05955550405714247
sim_compute_robot_state-npc3_max0.06655908530613161
sim_compute_robot_state-npc3_mean0.06428448633811715
sim_compute_robot_state-npc3_median0.06473049792376431
sim_compute_robot_state-npc3_min0.06000061564975315
sim_compute_sim_state_max0.03769037653418148
sim_compute_sim_state_mean0.03593879486102839
sim_compute_sim_state_median0.0363818754752477
sim_compute_sim_state_min0.03370631006028917
sim_physics_max0.027893223545768044
sim_physics_mean0.02681688279310087
sim_physics_median0.02723953653784359
sim_physics_min0.02517496214972602
sim_render-ego_max0.0656555508667568
sim_render-ego_mean0.06339664264399329
sim_render-ego_median0.06270660956700642
sim_render-ego_min0.06166612307230632
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
188602439Jacopo Tanirandom_agentaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-95600:05:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.1477189752790663
agent_compute-ego_mean0.1414069285968193
agent_compute-ego_median0.1422685764052651
agent_compute-ego_min0.13542036712169647
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.01615164414891657, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.058773985448873266, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13834510659271815, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07633437750474462, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03480195999145508, "sim_compute_performance-ego": 0.059396995688384434, "sim_compute_robot_state-ego": 0.06233715111354612}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.016406682404604824, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.061376869678497314, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1422685764052651, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07733388922431252, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03898599472912875, "sim_compute_performance-ego": 0.06283779035915028, "sim_compute_robot_state-ego": 0.06297606229782104}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.016646697786119248, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06185140079922146, "in-drivable-lane": 0, "agent_compute-ego": 0.1477189752790663, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.08192501597934299, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04092974132961697, "sim_compute_performance-ego": 0.06450129614935982, "sim_compute_robot_state-ego": 0.06474089622497559}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.015330066283543903, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.056953608989715576, "in-drivable-lane": 0, "agent_compute-ego": 0.13542036712169647, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0745796263217926, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.037009100119272866, "sim_compute_performance-ego": 0.06342651446660359, "sim_compute_robot_state-ego": 0.061145653327306114}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.017333896721110624, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06269154829137466, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1432816175853505, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08003934691934024, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.037977260701796585, "sim_compute_performance-ego": 0.06250086952658261, "sim_compute_robot_state-ego": 0.06307263584697947}}
set_robot_commands_max0.08192501597934299
set_robot_commands_mean0.07804245118990659
set_robot_commands_median0.07733388922431252
set_robot_commands_min0.0745796263217926
sim_compute_performance-ego_max0.06450129614935982
sim_compute_performance-ego_mean0.06253269323801615
sim_compute_performance-ego_median0.06283779035915028
sim_compute_performance-ego_min0.059396995688384434
sim_compute_robot_state-ego_max0.06474089622497559
sim_compute_robot_state-ego_mean0.06285447976212567
sim_compute_robot_state-ego_median0.06297606229782104
sim_compute_robot_state-ego_min0.061145653327306114
sim_compute_sim_state_max0.04092974132961697
sim_compute_sim_state_mean0.03794081137425405
sim_compute_sim_state_median0.037977260701796585
sim_compute_sim_state_min0.03480195999145508
sim_physics_max0.017333896721110624
sim_physics_mean0.016373797468859037
sim_physics_median0.016406682404604824
sim_physics_min0.015330066283543903
sim_render-ego_max0.06269154829137466
sim_render-ego_mean0.06032948264153646
sim_render-ego_median0.061376869678497314
sim_render-ego_min0.056953608989715576
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
188552443Jacopo Tanirandom_agentaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-95600:11:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.1489038582771055
agent_compute-ego_mean0.14487740152312775
agent_compute-ego_median0.1450577086590706
agent_compute-ego_min0.13920152888578527
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.032953954878307525, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06511223126971533, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.14625017983572824, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.08114270179990739, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.0346370538075765, "sim_compute_performance-ego": 0.0647773023635622, "sim_compute_robot_state-ego": 0.06389324248783172, "sim_compute_robot_state-npc0": 0.07462559427533831, "sim_compute_robot_state-npc1": 0.06657564072381883, "sim_compute_robot_state-npc2": 0.06547195192367311, "sim_compute_robot_state-npc3": 0.06499860400245303}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.03145463326398064, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.06255251286076564, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13920152888578527, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.08132564320283778, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03876484141630285, "sim_compute_performance-ego": 0.061894888971366135, "sim_compute_robot_state-ego": 0.06551865502899769, "sim_compute_robot_state-npc0": 0.07028649835025563, "sim_compute_robot_state-npc1": 0.06293754951626647, "sim_compute_robot_state-npc2": 0.0658273883894378, "sim_compute_robot_state-npc3": 0.06386436668096804}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.03277116437112131, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.06451187979790472, "in-drivable-lane": 0, "agent_compute-ego": 0.1489038582771055, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07858372888257427, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.037082306800350066, "sim_compute_performance-ego": 0.0626540107111777, "sim_compute_robot_state-ego": 0.06615976748927947, "sim_compute_robot_state-npc0": 0.07097456532139931, "sim_compute_robot_state-npc1": 0.06612048995110296, "sim_compute_robot_state-npc2": 0.06462519784127513, "sim_compute_robot_state-npc3": 0.0637176998199955}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.031129824354293498, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06507757876781707, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.1450577086590706, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07885824365818754, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03520633819255423, "sim_compute_performance-ego": 0.06400692209284356, "sim_compute_robot_state-ego": 0.06217335893752727, "sim_compute_robot_state-npc0": 0.07074271110778159, "sim_compute_robot_state-npc1": 0.06521030689807648, "sim_compute_robot_state-npc2": 0.06385260439933614, "sim_compute_robot_state-npc3": 0.06391100173300886}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.029595512610215407, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.060408326295705944, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.14497373195794913, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.08016567046825702, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03697017522958609, "sim_compute_performance-ego": 0.06287254278476422, "sim_compute_robot_state-ego": 0.06248000951913687, "sim_compute_robot_state-npc0": 0.07053176714823796, "sim_compute_robot_state-npc1": 0.06429906991811898, "sim_compute_robot_state-npc2": 0.06286816413585956, "sim_compute_robot_state-npc3": 0.06363992049143864}}
set_robot_commands_max0.08132564320283778
set_robot_commands_mean0.08001519760235279
set_robot_commands_median0.08016567046825702
set_robot_commands_min0.07858372888257427
sim_compute_performance-ego_max0.0647773023635622
sim_compute_performance-ego_mean0.06324113338474277
sim_compute_performance-ego_median0.06287254278476422
sim_compute_performance-ego_min0.061894888971366135
sim_compute_robot_state-ego_max0.06615976748927947
sim_compute_robot_state-ego_mean0.06404500669255461
sim_compute_robot_state-ego_median0.06389324248783172
sim_compute_robot_state-ego_min0.06217335893752727
sim_compute_robot_state-npc0_max0.07462559427533831
sim_compute_robot_state-npc0_mean0.07143222724060257
sim_compute_robot_state-npc0_median0.07074271110778159
sim_compute_robot_state-npc0_min0.07028649835025563
sim_compute_robot_state-npc1_max0.06657564072381883
sim_compute_robot_state-npc1_mean0.06502861140147675
sim_compute_robot_state-npc1_median0.06521030689807648
sim_compute_robot_state-npc1_min0.06293754951626647
sim_compute_robot_state-npc2_max0.0658273883894378
sim_compute_robot_state-npc2_mean0.06452906133791635
sim_compute_robot_state-npc2_median0.06462519784127513
sim_compute_robot_state-npc2_min0.06286816413585956
sim_compute_robot_state-npc3_max0.06499860400245303
sim_compute_robot_state-npc3_mean0.06402631854557281
sim_compute_robot_state-npc3_median0.06386436668096804
sim_compute_robot_state-npc3_min0.06363992049143864
sim_compute_sim_state_max0.03876484141630285
sim_compute_sim_state_mean0.03653214308927395
sim_compute_sim_state_median0.03697017522958609
sim_compute_sim_state_min0.0346370538075765
sim_physics_max0.032953954878307525
sim_physics_mean0.03158101789558368
sim_physics_median0.03145463326398064
sim_physics_min0.029595512610215407
sim_render-ego_max0.06511223126971533
sim_render-ego_mean0.06353250579838174
sim_render-ego_median0.06451187979790472
sim_render-ego_min0.060408326295705944
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible
188542870Jieming Ji 🇨🇭PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-95600:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.12164876936953704
error_L20.022846773723256546


No reset possible
188322475Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-95600:11:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.14989055839239382
agent_compute-ego_mean0.14662550110549075
agent_compute-ego_median0.1464844510910359
agent_compute-ego_min0.1421569585800171
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03385351953052339, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06477576967269655, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.14529277029491605, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07841517054845416, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03578928160288977, "sim_compute_performance-ego": 0.06493617239452544, "sim_compute_robot_state-ego": 0.0649049963269915, "sim_compute_robot_state-npc0": 0.07041251848614405, "sim_compute_robot_state-npc1": 0.06359342923240056, "sim_compute_robot_state-npc2": 0.06511240913754418, "sim_compute_robot_state-npc3": 0.06481907102796766}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.0306551783692603, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.07003104452993356, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.14989055839239382, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.0787816047668457, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03930169460820217, "sim_compute_performance-ego": 0.06710269871880026, "sim_compute_robot_state-ego": 0.06619507191227932, "sim_compute_robot_state-npc0": 0.07092373978857901, "sim_compute_robot_state-npc1": 0.06497837047950894, "sim_compute_robot_state-npc2": 0.06542472745857987, "sim_compute_robot_state-npc3": 0.0646982333239387}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.03210203109248992, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.0671311616897583, "in-drivable-lane": 0, "agent_compute-ego": 0.14930276716909102, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07945863662227508, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.036330922957389586, "sim_compute_performance-ego": 0.06379543965862643, "sim_compute_robot_state-ego": 0.06690226831743794, "sim_compute_robot_state-npc0": 0.07259240842634632, "sim_compute_robot_state-npc1": 0.06648009438668528, "sim_compute_robot_state-npc2": 0.06615486837202503, "sim_compute_robot_state-npc3": 0.06638853011592742}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.0322667918306716, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06366338121130112, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.1464844510910359, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07618858205511216, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03519853125227258, "sim_compute_performance-ego": 0.06328164770248089, "sim_compute_robot_state-ego": 0.06398504592002706, "sim_compute_robot_state-npc0": 0.07167275154844244, "sim_compute_robot_state-npc1": 0.06695339020262374, "sim_compute_robot_state-npc2": 0.06793799552511662, "sim_compute_robot_state-npc3": 0.06533007418855707}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.027638728802020732, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.05908803297923161, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1421569585800171, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.08114955975459172, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.035278691695286676, "sim_compute_performance-ego": 0.06255892606881949, "sim_compute_robot_state-ego": 0.06150081065984873, "sim_compute_robot_state-npc0": 0.06572932921923123, "sim_compute_robot_state-npc1": 0.06297138562569252, "sim_compute_robot_state-npc2": 0.06259472095049344, "sim_compute_robot_state-npc3": 0.06113507197453426}}
set_robot_commands_max0.08114955975459172
set_robot_commands_mean0.07879871074945576
set_robot_commands_median0.0787816047668457
set_robot_commands_min0.07618858205511216
sim_compute_performance-ego_max0.06710269871880026
sim_compute_performance-ego_mean0.0643349769086505
sim_compute_performance-ego_median0.06379543965862643
sim_compute_performance-ego_min0.06255892606881949
sim_compute_robot_state-ego_max0.06690226831743794
sim_compute_robot_state-ego_mean0.06469763862731691
sim_compute_robot_state-ego_median0.0649049963269915
sim_compute_robot_state-ego_min0.06150081065984873
sim_compute_robot_state-npc0_max0.07259240842634632
sim_compute_robot_state-npc0_mean0.07026614949374861
sim_compute_robot_state-npc0_median0.07092373978857901
sim_compute_robot_state-npc0_min0.06572932921923123
sim_compute_robot_state-npc1_max0.06695339020262374
sim_compute_robot_state-npc1_mean0.06499533398538222
sim_compute_robot_state-npc1_median0.06497837047950894
sim_compute_robot_state-npc1_min0.06297138562569252
sim_compute_robot_state-npc2_max0.06793799552511662
sim_compute_robot_state-npc2_mean0.06544494428875183
sim_compute_robot_state-npc2_median0.06542472745857987
sim_compute_robot_state-npc2_min0.06259472095049344
sim_compute_robot_state-npc3_max0.06638853011592742
sim_compute_robot_state-npc3_mean0.06447419612618502
sim_compute_robot_state-npc3_median0.06481907102796766
sim_compute_robot_state-npc3_min0.06113507197453426
sim_compute_sim_state_max0.03930169460820217
sim_compute_sim_state_mean0.03637982442320816
sim_compute_sim_state_median0.03578928160288977
sim_compute_sim_state_min0.03519853125227258
sim_physics_max0.03385351953052339
sim_physics_mean0.031303249924993184
sim_physics_median0.03210203109248992
sim_physics_min0.027638728802020732
sim_render-ego_max0.07003104452993356
sim_render-ego_mean0.06493787801658422
sim_render-ego_median0.06477576967269655
sim_render-ego_min0.05908803297923161
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible
188282484Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-95600:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188012543Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-95600:06:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.15923770035014434
agent_compute-ego_mean0.14224011733309597
agent_compute-ego_median0.14225865999857584
agent_compute-ego_min0.1302955448627472
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.01524405209523327, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05882408933819465, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14237359334837715, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07653590868104179, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03661096770808382, "sim_compute_performance-ego": 0.06235483007610969, "sim_compute_robot_state-ego": 0.0625408595463015}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.015658140182495117, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.05910911885174838, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13703508810563522, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07155447114597667, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.037184715270996094, "sim_compute_performance-ego": 0.05943116816607388, "sim_compute_robot_state-ego": 0.06317095864902843}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.015737417009141712, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.0610980298784044, "in-drivable-lane": 0, "agent_compute-ego": 0.14225865999857584, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07718082533942329, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.041053862041897246, "sim_compute_performance-ego": 0.06242553393046061, "sim_compute_robot_state-ego": 0.0644660578833686}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.015757376948992412, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05934771398703257, "in-drivable-lane": 0, "agent_compute-ego": 0.1302955448627472, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07311089336872101, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03787030279636383, "sim_compute_performance-ego": 0.06018282473087311, "sim_compute_robot_state-ego": 0.0621131956577301}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.01915827218224021, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06941197549595553, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.15923770035014434, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08188288352068733, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04509990355547737, "sim_compute_performance-ego": 0.0713669833014993, "sim_compute_robot_state-ego": 0.07191039534176097}}
set_robot_commands_max0.08188288352068733
set_robot_commands_mean0.07605299641117001
set_robot_commands_median0.07653590868104179
set_robot_commands_min0.07155447114597667
sim_compute_performance-ego_max0.0713669833014993
sim_compute_performance-ego_mean0.06315226804100332
sim_compute_performance-ego_median0.06235483007610969
sim_compute_performance-ego_min0.05943116816607388
sim_compute_robot_state-ego_max0.07191039534176097
sim_compute_robot_state-ego_mean0.06484029341563792
sim_compute_robot_state-ego_median0.06317095864902843
sim_compute_robot_state-ego_min0.0621131956577301
sim_compute_sim_state_max0.04509990355547737
sim_compute_sim_state_mean0.03956395027456368
sim_compute_sim_state_median0.03787030279636383
sim_compute_sim_state_min0.03661096770808382
sim_physics_max0.01915827218224021
sim_physics_mean0.016311051683620542
sim_physics_median0.015737417009141712
sim_physics_min0.01524405209523327
sim_render-ego_max0.06941197549595553
sim_render-ego_mean0.06155818551026711
sim_render-ego_median0.05934771398703257
sim_render-ego_min0.05882408933819465
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
187932537Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-95600:02:23
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
187832544Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-95600:05:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487126868955534
survival_time_median2.3499999999999996
deviation-center-line_median0.11041377901227004
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06645475901090182
agent_compute-ego_mean0.06494207800549531
agent_compute-ego_median0.06617624508707147
agent_compute-ego_min0.06244826607587861
deviation-center-line_max0.12791029264553877
deviation-center-line_mean0.10518143804729678
deviation-center-line_min0.06917252689874298
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550056
deviation-heading_median0.3636820162885191
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903463
driven_any_median0.6642785413158997
driven_any_min0.3059207793076624
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.5880385612453785
driven_lanedir_consec_min0.2802213062291129
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.5880385612453785
driven_lanedir_median0.5487126868955534
driven_lanedir_min0.2802213062291129
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.017945403006018663, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.062390469923252014, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06244826607587861, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07451305156800805, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.0404645059166885, "sim_compute_performance-ego": 0.06351428787882735, "sim_compute_robot_state-ego": 0.06412388638752263}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.016752041303194486, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.0609810444024893, "in-drivable-lane": 0, "agent_compute-ego": 0.06645475901090182, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.0768433534182035, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.040868557416475736, "sim_compute_performance-ego": 0.06183913120856652, "sim_compute_robot_state-ego": 0.06539658399728629}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.015706605099617167, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.06335212321991616, "in-drivable-lane": 0, "agent_compute-ego": 0.06333911165278008, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07444318304670618, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.039118076892609294, "sim_compute_performance-ego": 0.06399755782269417, "sim_compute_robot_state-ego": 0.06494699133203384}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.02042681568271511, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06828946857661991, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06629200820084456, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.0753350284073379, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.04118544714791434, "sim_compute_performance-ego": 0.0666883437188117, "sim_compute_robot_state-ego": 0.06633695927295057}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.015891269633644504, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.06906625471617046, "in-drivable-lane": 0, "agent_compute-ego": 0.06617624508707147, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07450513463271291, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.04092399697554739, "sim_compute_performance-ego": 0.06410559227592066, "sim_compute_robot_state-ego": 0.06435396169361315}}
set_robot_commands_max0.0768433534182035
set_robot_commands_mean0.0751279502145937
set_robot_commands_median0.07451305156800805
set_robot_commands_min0.07444318304670618
sim_compute_performance-ego_max0.0666883437188117
sim_compute_performance-ego_mean0.06402898258096408
sim_compute_performance-ego_median0.06399755782269417
sim_compute_performance-ego_min0.06183913120856652
sim_compute_robot_state-ego_max0.06633695927295057
sim_compute_robot_state-ego_mean0.0650316765366813
sim_compute_robot_state-ego_median0.06494699133203384
sim_compute_robot_state-ego_min0.06412388638752263
sim_compute_sim_state_max0.04118544714791434
sim_compute_sim_state_mean0.04051211686984705
sim_compute_sim_state_median0.040868557416475736
sim_compute_sim_state_min0.039118076892609294
sim_physics_max0.02042681568271511
sim_physics_mean0.01734442694503799
sim_physics_median0.016752041303194486
sim_physics_min0.015706605099617167
sim_render-ego_max0.06906625471617046
sim_render-ego_mean0.06481587216768955
sim_render-ego_median0.06335212321991616
sim_render-ego_min0.0609810444024893
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
187752568Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-95600:11:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6013276121655571
survival_time_median2.2
deviation-center-line_median0.11994879786730762
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.06808629035949706
agent_compute-ego_mean0.06521023194403013
agent_compute-ego_median0.06424808166396449
agent_compute-ego_min0.062240660190582275
deviation-center-line_max0.31602167939174997
deviation-center-line_mean0.15029477661273552
deviation-center-line_min0.08465176242372947
deviation-heading_max1.298091820230251
deviation-heading_mean0.5590872679348118
deviation-heading_median0.39186075366845463
deviation-heading_min0.29133071980288444
driven_any_max1.2345099137442228
driven_any_mean0.7773148514182241
driven_any_median0.6489566174251553
driven_any_min0.47625793140583145
driven_lanedir_consec_max0.923268763707114
driven_lanedir_consec_mean0.634114415404596
driven_lanedir_consec_min0.4596280139000144
driven_lanedir_max0.923268763707114
driven_lanedir_mean0.6342515685671332
driven_lanedir_median0.6013276121655571
driven_lanedir_min0.4596280139000144
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.3599999999999987
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.029908049734015212, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06183208666349712, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06808629035949706, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.07818648940638492, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03497128988567152, "sim_compute_performance-ego": 0.06297629506964432, "sim_compute_robot_state-ego": 0.06196737038461785, "sim_compute_robot_state-npc0": 0.06948522266588714, "sim_compute_robot_state-npc1": 0.06296151813707854, "sim_compute_robot_state-npc2": 0.06237695091649106, "sim_compute_robot_state-npc3": 0.06336809459485505}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.027011105888768247, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.0577542781829834, "in-drivable-lane": 0, "agent_compute-ego": 0.06402517619885896, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07360477823960154, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.03648939258173892, "sim_compute_performance-ego": 0.06175168564445094, "sim_compute_robot_state-ego": 0.06338679790496826, "sim_compute_robot_state-npc0": 0.06694941771657843, "sim_compute_robot_state-npc1": 0.06483575544859234, "sim_compute_robot_state-npc2": 0.06397429265474018, "sim_compute_robot_state-npc3": 0.06112549179478696}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.02959873126103328, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06453397335150303, "in-drivable-lane": 0, "agent_compute-ego": 0.06745095130724785, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07720526059468587, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.035938538037813626, "sim_compute_performance-ego": 0.062137689345922224, "sim_compute_robot_state-ego": 0.06280376972296299, "sim_compute_robot_state-npc0": 0.07086397440005572, "sim_compute_robot_state-npc1": 0.06693713481609638, "sim_compute_robot_state-npc2": 0.06474206997798039, "sim_compute_robot_state-npc3": 0.0644695330888797}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.030934330443261375, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.062357462627786985, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06424808166396449, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07529757728039378, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.035855397372178625, "sim_compute_performance-ego": 0.06021285392868687, "sim_compute_robot_state-ego": 0.06021162153969349, "sim_compute_robot_state-npc0": 0.06710186138958998, "sim_compute_robot_state-npc1": 0.06209653196200519, "sim_compute_robot_state-npc2": 0.06316591988147145, "sim_compute_robot_state-npc3": 0.061808109283447266}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.02727939323945479, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.06039654666727239, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.062240660190582275, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07708645950664174, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03441278500990434, "sim_compute_performance-ego": 0.06123727018182928, "sim_compute_robot_state-ego": 0.0642878684130582, "sim_compute_robot_state-npc0": 0.06490807099775835, "sim_compute_robot_state-npc1": 0.06461964412169023, "sim_compute_robot_state-npc2": 0.0657851750200445, "sim_compute_robot_state-npc3": 0.062322388995777474}}
set_robot_commands_max0.07818648940638492
set_robot_commands_mean0.07627611300554157
set_robot_commands_median0.07708645950664174
set_robot_commands_min0.07360477823960154
sim_compute_performance-ego_max0.06297629506964432
sim_compute_performance-ego_mean0.06166315883410672
sim_compute_performance-ego_median0.06175168564445094
sim_compute_performance-ego_min0.06021285392868687
sim_compute_robot_state-ego_max0.0642878684130582
sim_compute_robot_state-ego_mean0.06253148559306015
sim_compute_robot_state-ego_median0.06280376972296299
sim_compute_robot_state-ego_min0.06021162153969349
sim_compute_robot_state-npc0_max0.07086397440005572
sim_compute_robot_state-npc0_mean0.06786170943397393
sim_compute_robot_state-npc0_median0.06710186138958998
sim_compute_robot_state-npc0_min0.06490807099775835
sim_compute_robot_state-npc1_max0.06693713481609638
sim_compute_robot_state-npc1_mean0.06429011689709255
sim_compute_robot_state-npc1_median0.06461964412169023
sim_compute_robot_state-npc1_min0.06209653196200519
sim_compute_robot_state-npc2_max0.0657851750200445
sim_compute_robot_state-npc2_mean0.06400888169014551
sim_compute_robot_state-npc2_median0.06397429265474018
sim_compute_robot_state-npc2_min0.06237695091649106
sim_compute_robot_state-npc3_max0.0644695330888797
sim_compute_robot_state-npc3_mean0.0626187235515493
sim_compute_robot_state-npc3_median0.062322388995777474
sim_compute_robot_state-npc3_min0.06112549179478696
sim_compute_sim_state_max0.03648939258173892
sim_compute_sim_state_mean0.035533480577461404
sim_compute_sim_state_median0.035855397372178625
sim_compute_sim_state_min0.03441278500990434
sim_physics_max0.030934330443261375
sim_physics_mean0.028946322113306576
sim_physics_median0.02959873126103328
sim_physics_min0.027011105888768247
sim_render-ego_max0.06453397335150303
sim_render-ego_mean0.061374869498608584
sim_render-ego_median0.06183208666349712
sim_render-ego_min0.0577542781829834
simulation-passed1
survival_time_max4.749999999999991
survival_time_mean2.8699999999999983
survival_time_min1.900000000000001
No reset possible
187332608Konstantin Chaikachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-95600:09:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487132829419987
survival_time_median2.3499999999999996
deviation-center-line_median0.11041400208354252
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06813844214094446
agent_compute-ego_mean0.06447828654096821
agent_compute-ego_median0.0653760891694289
agent_compute-ego_min0.060724841920953045
deviation-center-line_max0.1279102488429998
deviation-center-line_mean0.10518151035257096
deviation-center-line_min0.06917270915638028
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550057
deviation-heading_median0.36368201628851926
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903464
driven_any_median0.6642785413159032
driven_any_min0.3059207793076613
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.588039443394122
driven_lanedir_consec_min0.28022225990343186
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.588039443394122
driven_lanedir_median0.5487132829419987
driven_lanedir_min0.28022225990343186
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.026857393543894697, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05966724709766667, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06232792284430527, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07421867149632151, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.035190742190291245, "sim_compute_performance-ego": 0.05972480192417052, "sim_compute_robot_state-ego": 0.060681037786530286, "sim_compute_robot_state-npc0": 0.06509426163464058, "sim_compute_robot_state-npc1": 0.06297479897010617, "sim_compute_robot_state-npc2": 0.061800889852570325, "sim_compute_robot_state-npc3": 0.06257650328845513}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.027337138469402607, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.06028297314277062, "in-drivable-lane": 0, "agent_compute-ego": 0.0653760891694289, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.08170537765209492, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.03595147683070256, "sim_compute_performance-ego": 0.06335935225853553, "sim_compute_robot_state-ego": 0.06656529353215145, "sim_compute_robot_state-npc0": 0.06565402104304387, "sim_compute_robot_state-npc1": 0.06431999573340783, "sim_compute_robot_state-npc2": 0.06778130164513221, "sim_compute_robot_state-npc3": 0.06538131603827843}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.027785463536039313, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.06510314535587391, "in-drivable-lane": 0, "agent_compute-ego": 0.06813844214094446, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.0763478583477913, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.03615979438132428, "sim_compute_performance-ego": 0.06053062195473529, "sim_compute_robot_state-ego": 0.06258310155665621, "sim_compute_robot_state-npc0": 0.06676671352792293, "sim_compute_robot_state-npc1": 0.06324518487808552, "sim_compute_robot_state-npc2": 0.06336219767306714, "sim_compute_robot_state-npc3": 0.06248612606779058}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.027974076323456817, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06085811866508736, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06582413662920941, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.0766589824969952, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03541866763607486, "sim_compute_performance-ego": 0.06266486513745653, "sim_compute_robot_state-ego": 0.06250166107010055, "sim_compute_robot_state-npc0": 0.06830944595756111, "sim_compute_robot_state-npc1": 0.06443308735941793, "sim_compute_robot_state-npc2": 0.06593194636669787, "sim_compute_robot_state-npc3": 0.06185392757038494}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.023309651174043353, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.05806553363800049, "in-drivable-lane": 0, "agent_compute-ego": 0.060724841920953045, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07362149263683118, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.03477972432186729, "sim_compute_performance-ego": 0.0585966988613731, "sim_compute_robot_state-ego": 0.06202900409698486, "sim_compute_robot_state-npc0": 0.06443839951565392, "sim_compute_robot_state-npc1": 0.06092865216104608, "sim_compute_robot_state-npc2": 0.06154500183306242, "sim_compute_robot_state-npc3": 0.06081042164250424}}
set_robot_commands_max0.08170537765209492
set_robot_commands_mean0.07651047652600682
set_robot_commands_median0.0763478583477913
set_robot_commands_min0.07362149263683118
sim_compute_performance-ego_max0.06335935225853553
sim_compute_performance-ego_mean0.06097526802725419
sim_compute_performance-ego_median0.06053062195473529
sim_compute_performance-ego_min0.0585966988613731
sim_compute_robot_state-ego_max0.06656529353215145
sim_compute_robot_state-ego_mean0.06287201960848468
sim_compute_robot_state-ego_median0.06250166107010055
sim_compute_robot_state-ego_min0.060681037786530286
sim_compute_robot_state-npc0_max0.06830944595756111
sim_compute_robot_state-npc0_mean0.06605256833576448
sim_compute_robot_state-npc0_median0.06565402104304387
sim_compute_robot_state-npc0_min0.06443839951565392
sim_compute_robot_state-npc1_max0.06443308735941793
sim_compute_robot_state-npc1_mean0.06318034382041271
sim_compute_robot_state-npc1_median0.06324518487808552
sim_compute_robot_state-npc1_min0.06092865216104608
sim_compute_robot_state-npc2_max0.06778130164513221
sim_compute_robot_state-npc2_mean0.06408426747410599
sim_compute_robot_state-npc2_median0.06336219767306714
sim_compute_robot_state-npc2_min0.06154500183306242
sim_compute_robot_state-npc3_max0.06538131603827843
sim_compute_robot_state-npc3_mean0.06262165892148266
sim_compute_robot_state-npc3_median0.06248612606779058
sim_compute_robot_state-npc3_min0.06081042164250424
sim_compute_sim_state_max0.03615979438132428
sim_compute_sim_state_mean0.03550008107205204
sim_compute_sim_state_median0.03541866763607486
sim_compute_sim_state_min0.03477972432186729
sim_physics_max0.027974076323456817
sim_physics_mean0.02665274460936736
sim_physics_median0.027337138469402607
sim_physics_min0.023309651174043353
sim_render-ego_max0.06510314535587391
sim_render-ego_mean0.0607954035798798
sim_render-ego_median0.06028297314277062
sim_render-ego_min0.05806553363800049
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
187252620Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-95600:09:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14945689307318794
agent_compute-ego_mean0.14327110336603183
agent_compute-ego_median0.14567875862121582
agent_compute-ego_min0.13095587141373577
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.02409694329747614, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.061432240144261775, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14567875862121582, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07796069361128898, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.035351519314747934, "sim_compute_performance-ego": 0.06383342113134996, "sim_compute_robot_state-ego": 0.06146662640121748, "sim_compute_robot_state-npc0": 0.06900559281403164, "sim_compute_robot_state-npc1": 0.06509660774806761, "sim_compute_robot_state-npc2": 0.062974547440151, "sim_compute_robot_state-npc3": 0.06359934356977355}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.02607095241546631, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06549310142343695, "in-drivable-lane": 0, "agent_compute-ego": 0.14382121779701926, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07726398381319913, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03406537120992487, "sim_compute_performance-ego": 0.06418849121440541, "sim_compute_robot_state-ego": 0.06141759590669112, "sim_compute_robot_state-npc0": 0.07204648581418124, "sim_compute_robot_state-npc1": 0.06841016899455678, "sim_compute_robot_state-npc2": 0.06375624374909834, "sim_compute_robot_state-npc3": 0.06237370317632502}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.02747408019171821, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06825590663486057, "in-drivable-lane": 0, "agent_compute-ego": 0.14945689307318794, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07684207492404514, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03861549695332845, "sim_compute_performance-ego": 0.06726317935519749, "sim_compute_robot_state-ego": 0.06717090606689453, "sim_compute_robot_state-npc0": 0.07448142369588216, "sim_compute_robot_state-npc1": 0.07083477444118924, "sim_compute_robot_state-npc2": 0.06913813485039605, "sim_compute_robot_state-npc3": 0.06731991767883301}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.026688093940416973, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.061696295936902366, "in-drivable-lane": 0, "agent_compute-ego": 0.14644277592500052, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07477375864982605, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03686430553595225, "sim_compute_performance-ego": 0.05921914676825205, "sim_compute_robot_state-ego": 0.06077504654725393, "sim_compute_robot_state-npc0": 0.07018640140692393, "sim_compute_robot_state-npc1": 0.06572442253430684, "sim_compute_robot_state-npc2": 0.06305172542730968, "sim_compute_robot_state-npc3": 0.06464353700478871}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.022908862899331486, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05493676311829511, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13095587141373577, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07267528772354126, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.031198189539067885, "sim_compute_performance-ego": 0.05487971446093391, "sim_compute_robot_state-ego": 0.05497001549776863, "sim_compute_robot_state-npc0": 0.06210052967071533, "sim_compute_robot_state-npc1": 0.058190380825715905, "sim_compute_robot_state-npc2": 0.05661507564432481, "sim_compute_robot_state-npc3": 0.05622144306407256}}
set_robot_commands_max0.07796069361128898
set_robot_commands_mean0.07590315974438011
set_robot_commands_median0.07684207492404514
set_robot_commands_min0.07267528772354126
sim_compute_performance-ego_max0.06726317935519749
sim_compute_performance-ego_mean0.061876790586027776
sim_compute_performance-ego_median0.06383342113134996
sim_compute_performance-ego_min0.05487971446093391
sim_compute_robot_state-ego_max0.06717090606689453
sim_compute_robot_state-ego_mean0.06116003808396514
sim_compute_robot_state-ego_median0.06141759590669112
sim_compute_robot_state-ego_min0.05497001549776863
sim_compute_robot_state-npc0_max0.07448142369588216
sim_compute_robot_state-npc0_mean0.06956408668034687
sim_compute_robot_state-npc0_median0.07018640140692393
sim_compute_robot_state-npc0_min0.06210052967071533
sim_compute_robot_state-npc1_max0.07083477444118924
sim_compute_robot_state-npc1_mean0.06565127090876728
sim_compute_robot_state-npc1_median0.06572442253430684
sim_compute_robot_state-npc1_min0.058190380825715905
sim_compute_robot_state-npc2_max0.06913813485039605
sim_compute_robot_state-npc2_mean0.06310714542225598
sim_compute_robot_state-npc2_median0.06305172542730968
sim_compute_robot_state-npc2_min0.05661507564432481
sim_compute_robot_state-npc3_max0.06731991767883301
sim_compute_robot_state-npc3_mean0.06283158889875858
sim_compute_robot_state-npc3_median0.06359934356977355
sim_compute_robot_state-npc3_min0.05622144306407256
sim_compute_sim_state_max0.03861549695332845
sim_compute_sim_state_mean0.03521897651060428
sim_compute_sim_state_median0.035351519314747934
sim_compute_sim_state_min0.031198189539067885
sim_physics_max0.02747408019171821
sim_physics_mean0.025447786548881825
sim_physics_median0.02607095241546631
sim_physics_min0.022908862899331486
sim_render-ego_max0.06825590663486057
sim_render-ego_mean0.062362861451551344
sim_render-ego_median0.061696295936902366
sim_render-ego_min0.05493676311829511
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
187152636Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-95600:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.13579045557508282
agent_compute-ego_mean0.13476392274003002
agent_compute-ego_median0.13421933881698117
agent_compute-ego_min0.13396534465608145
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.02819173676627023, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.056166035788399835, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.13396534465608145, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07515877012222533, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.0315234623258076, "sim_compute_performance-ego": 0.05505102399795774, "sim_compute_robot_state-ego": 0.05822285773262145, "sim_compute_robot_state-npc0": 0.062905576494005, "sim_compute_robot_state-npc1": 0.05776728902544294, "sim_compute_robot_state-npc2": 0.05808120303683811, "sim_compute_robot_state-npc3": 0.0582325988345676}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.027356914445465685, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.06231226640589097, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13579045557508282, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07497844509049958, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03329094250996908, "sim_compute_performance-ego": 0.06103777417949602, "sim_compute_robot_state-ego": 0.06225436809016209, "sim_compute_robot_state-npc0": 0.06889870120029823, "sim_compute_robot_state-npc1": 0.06264826363208247, "sim_compute_robot_state-npc2": 0.060337005877027325, "sim_compute_robot_state-npc3": 0.06109236268436208}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.02861104472990959, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.05905063306131671, "in-drivable-lane": 0, "agent_compute-ego": 0.13421933881698117, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07781016057537447, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03283260714623236, "sim_compute_performance-ego": 0.05972817251759191, "sim_compute_robot_state-ego": 0.05849372186968403, "sim_compute_robot_state-npc0": 0.06514381208727436, "sim_compute_robot_state-npc1": 0.061406504723333546, "sim_compute_robot_state-npc2": 0.06098027767673615, "sim_compute_robot_state-npc3": 0.05871926584551411}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.02865324375477243, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.05932986482660821, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.13568706461723817, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07444498640425662, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.032368160308675564, "sim_compute_performance-ego": 0.05956572928327195, "sim_compute_robot_state-ego": 0.05900548113153336, "sim_compute_robot_state-npc0": 0.0641907681810095, "sim_compute_robot_state-npc1": 0.061285706276589254, "sim_compute_robot_state-npc2": 0.058927358464991794, "sim_compute_robot_state-npc3": 0.05927261900394521}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.027343378617213324, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.05863735767511221, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.13415741003476656, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.076900275853964, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03380237634365375, "sim_compute_performance-ego": 0.061488247834719144, "sim_compute_robot_state-ego": 0.06322365540724534, "sim_compute_robot_state-npc0": 0.06837271727048434, "sim_compute_robot_state-npc1": 0.06232975079463078, "sim_compute_robot_state-npc2": 0.06209258849804218, "sim_compute_robot_state-npc3": 0.06186998348969679}}
set_robot_commands_max0.07781016057537447
set_robot_commands_mean0.075858527609264
set_robot_commands_median0.07515877012222533
set_robot_commands_min0.07444498640425662
sim_compute_performance-ego_max0.061488247834719144
sim_compute_performance-ego_mean0.05937418956260735
sim_compute_performance-ego_median0.05972817251759191
sim_compute_performance-ego_min0.05505102399795774
sim_compute_robot_state-ego_max0.06322365540724534
sim_compute_robot_state-ego_mean0.06024001684624926
sim_compute_robot_state-ego_median0.05900548113153336
sim_compute_robot_state-ego_min0.05822285773262145
sim_compute_robot_state-npc0_max0.06889870120029823
sim_compute_robot_state-npc0_mean0.06590231504661428
sim_compute_robot_state-npc0_median0.06514381208727436
sim_compute_robot_state-npc0_min0.062905576494005
sim_compute_robot_state-npc1_max0.06264826363208247
sim_compute_robot_state-npc1_mean0.06108750289041579
sim_compute_robot_state-npc1_median0.061406504723333546
sim_compute_robot_state-npc1_min0.05776728902544294
sim_compute_robot_state-npc2_max0.06209258849804218
sim_compute_robot_state-npc2_mean0.06008368671072711
sim_compute_robot_state-npc2_median0.060337005877027325
sim_compute_robot_state-npc2_min0.05808120303683811
sim_compute_robot_state-npc3_max0.06186998348969679
sim_compute_robot_state-npc3_mean0.059837365971617165
sim_compute_robot_state-npc3_median0.05927261900394521
sim_compute_robot_state-npc3_min0.0582325988345676
sim_compute_sim_state_max0.03380237634365375
sim_compute_sim_state_mean0.032763509726867666
sim_compute_sim_state_median0.03283260714623236
sim_compute_sim_state_min0.0315234623258076
sim_physics_max0.02865324375477243
sim_physics_mean0.028031263662726253
sim_physics_median0.02819173676627023
sim_physics_min0.027343378617213324
sim_render-ego_max0.06231226640589097
sim_render-ego_mean0.05909923155146559
sim_render-ego_median0.05905063306131671
sim_render-ego_min0.056166035788399835
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible
187102641Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-95600:05:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487126868955534
survival_time_median2.3499999999999996
deviation-center-line_median0.11041377901227004
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06643049009553678
agent_compute-ego_mean0.06341180145834482
agent_compute-ego_median0.06351688567628251
agent_compute-ego_min0.059132869427020736
deviation-center-line_max0.12791029264553877
deviation-center-line_mean0.10518143804729678
deviation-center-line_min0.06917252689874298
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550056
deviation-heading_median0.3636820162885191
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903463
driven_any_median0.6642785413158997
driven_any_min0.3059207793076624
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.5880385612453785
driven_lanedir_consec_min0.2802213062291129
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.5880385612453785
driven_lanedir_median0.5487126868955534
driven_lanedir_min0.2802213062291129
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.017355796767444146, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05835513661547405, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06335078216180569, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07894538670051389, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.039125840838362534, "sim_compute_performance-ego": 0.05948587452493063, "sim_compute_robot_state-ego": 0.06112836919179777}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.016177562566903923, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.05592181132389949, "in-drivable-lane": 0, "agent_compute-ego": 0.059132869427020736, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.07212692040663499, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.03890386911538931, "sim_compute_performance-ego": 0.05892688494462233, "sim_compute_robot_state-ego": 0.06019750008216271}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.015909879765612013, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.06083034961781603, "in-drivable-lane": 0, "agent_compute-ego": 0.06351688567628251, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07303985129011438, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03841393551927932, "sim_compute_performance-ego": 0.062073443798308675, "sim_compute_robot_state-ego": 0.060201726061232544}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.01711604097387293, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06018330500676082, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06643049009553678, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07670727404919299, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03722984974200909, "sim_compute_performance-ego": 0.06133712517036186, "sim_compute_robot_state-ego": 0.06196947150178008}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.01636354546797903, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.06028575646249872, "in-drivable-lane": 0, "agent_compute-ego": 0.06462797993107845, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07554334715793007, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03994427856646086, "sim_compute_performance-ego": 0.0620201449645193, "sim_compute_robot_state-ego": 0.06367180849376478}}
set_robot_commands_max0.07894538670051389
set_robot_commands_mean0.07527255592087725
set_robot_commands_median0.07554334715793007
set_robot_commands_min0.07212692040663499
sim_compute_performance-ego_max0.062073443798308675
sim_compute_performance-ego_mean0.06076869468054855
sim_compute_performance-ego_median0.06133712517036186
sim_compute_performance-ego_min0.05892688494462233
sim_compute_robot_state-ego_max0.06367180849376478
sim_compute_robot_state-ego_mean0.061433775066147576
sim_compute_robot_state-ego_median0.06112836919179777
sim_compute_robot_state-ego_min0.06019750008216271
sim_compute_sim_state_max0.03994427856646086
sim_compute_sim_state_mean0.038723554756300224
sim_compute_sim_state_median0.03890386911538931
sim_compute_sim_state_min0.03722984974200909
sim_physics_max0.017355796767444146
sim_physics_mean0.01658456510836241
sim_physics_median0.01636354546797903
sim_physics_min0.015909879765612013
sim_render-ego_max0.06083034961781603
sim_render-ego_mean0.059115271805289825
sim_render-ego_median0.06018330500676082
sim_render-ego_min0.05592181132389949
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
187012680Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-95600:18:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0494101139404726
survival_time_median6.999999999999983
deviation-center-line_median0.4114452923747232
in-drivable-lane_median0


other stats
agent_compute-ego_max0.058055541094611675
agent_compute-ego_mean0.056533243481632814
agent_compute-ego_median0.056312439289498833
agent_compute-ego_min0.05561222859791347
deviation-center-line_max0.6224996164639154
deviation-center-line_mean0.420658543577316
deviation-center-line_min0.18669002326807368
deviation-heading_max2.7051896780359175
deviation-heading_mean1.82092421288296
deviation-heading_median2.1176976665979463
deviation-heading_min0.6240920157870962
driven_any_max1.3270581137113913
driven_any_mean0.984184420377592
driven_any_median1.0779845464860416
driven_any_min0.4886497723225228
driven_lanedir_consec_max1.2414388188003094
driven_lanedir_consec_mean0.8399082041571099
driven_lanedir_consec_min0.24101563879124388
driven_lanedir_max1.2414388188003094
driven_lanedir_mean0.8798729125236007
driven_lanedir_median1.0494101139404726
driven_lanedir_min0.44083918062369776
in-drivable-lane_max0.4999999999999995
in-drivable-lane_mean0.15000000000000063
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4886497723225228, "sim_physics": 0.025568471235387465, "survival_time": 3.399999999999996, "driven_lanedir": 0.4738535967511015, "sim_render-ego": 0.05256384611129761, "in-drivable-lane": 0, "agent_compute-ego": 0.058055541094611675, "deviation-heading": 0.6240920157870962, "set_robot_commands": 0.0721786898725173, "deviation-center-line": 0.18669002326807368, "driven_lanedir_consec": 0.4738535967511015, "sim_compute_sim_state": 0.031239902271943933, "sim_compute_performance-ego": 0.0544653710197, "sim_compute_robot_state-ego": 0.05606660772772396, "sim_compute_robot_state-npc0": 0.05844837076523725, "sim_compute_robot_state-npc1": 0.05609311075771556, "sim_compute_robot_state-npc2": 0.054628144292270434, "sim_compute_robot_state-npc3": 0.05491023905137006}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7082069604129195, "sim_physics": 0.024996356761201897, "survival_time": 4.699999999999991, "driven_lanedir": 0.44083918062369776, "sim_render-ego": 0.053299622332796136, "in-drivable-lane": 0.4999999999999995, "agent_compute-ego": 0.056312439289498833, "deviation-heading": 2.7051896780359175, "set_robot_commands": 0.07100561324586259, "deviation-center-line": 0.41024624739519655, "driven_lanedir_consec": 0.24101563879124388, "sim_compute_sim_state": 0.03115388941257558, "sim_compute_performance-ego": 0.05435696814922576, "sim_compute_robot_state-ego": 0.055436890176002014, "sim_compute_robot_state-npc0": 0.05690842486442404, "sim_compute_robot_state-npc1": 0.05505929855590171, "sim_compute_robot_state-npc2": 0.05453406242614097, "sim_compute_robot_state-npc3": 0.05487891714623634}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0779845464860416, "sim_physics": 0.02310058048793248, "survival_time": 6.999999999999983, "driven_lanedir": 1.0494101139404726, "sim_render-ego": 0.05109184639794486, "in-drivable-lane": 0, "agent_compute-ego": 0.05561222859791347, "deviation-heading": 1.3240471487517858, "set_robot_commands": 0.07017819370542254, "deviation-center-line": 0.6224996164639154, "driven_lanedir_consec": 1.0494101139404726, "sim_compute_sim_state": 0.03092080695288522, "sim_compute_performance-ego": 0.05252840689250401, "sim_compute_robot_state-ego": 0.05464540209089007, "sim_compute_robot_state-npc0": 0.05518579993929182, "sim_compute_robot_state-npc1": 0.05383493900299072, "sim_compute_robot_state-npc2": 0.05294177872794015, "sim_compute_robot_state-npc3": 0.053218431132180354}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3190227089550843, "sim_physics": 0.02350615894093233, "survival_time": 8.499999999999986, "driven_lanedir": 1.193822852502422, "sim_render-ego": 0.05136822532205021, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.055868214719435746, "deviation-heading": 2.1176976665979463, "set_robot_commands": 0.07247818217558019, "deviation-center-line": 0.47241153838467104, "driven_lanedir_consec": 1.193822852502422, "sim_compute_sim_state": 0.030094431428348316, "sim_compute_performance-ego": 0.05325909081627341, "sim_compute_robot_state-ego": 0.0546905798070571, "sim_compute_robot_state-npc0": 0.05562842873965992, "sim_compute_robot_state-npc1": 0.054597208079169776, "sim_compute_robot_state-npc2": 0.05449595170862535, "sim_compute_robot_state-npc3": 0.053436749121722055}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3270581137113913, "sim_physics": 0.022095883798878096, "survival_time": 8.549999999999986, "driven_lanedir": 1.2414388188003094, "sim_render-ego": 0.05293096854672794, "in-drivable-lane": 0, "agent_compute-ego": 0.056817793706704305, "deviation-heading": 2.3335945552420543, "set_robot_commands": 0.07224065936796846, "deviation-center-line": 0.4114452923747232, "driven_lanedir_consec": 1.2414388188003094, "sim_compute_sim_state": 0.030615014639514233, "sim_compute_performance-ego": 0.0539181065141109, "sim_compute_robot_state-ego": 0.054751242810522606, "sim_compute_robot_state-npc0": 0.05813365651850115, "sim_compute_robot_state-npc1": 0.05505394099051492, "sim_compute_robot_state-npc2": 0.05499884259631062, "sim_compute_robot_state-npc3": 0.05403708714490745}}
set_robot_commands_max0.07247818217558019
set_robot_commands_mean0.07161626767347021
set_robot_commands_median0.0721786898725173
set_robot_commands_min0.07017819370542254
sim_compute_performance-ego_max0.0544653710197
sim_compute_performance-ego_mean0.053705588678362816
sim_compute_performance-ego_median0.0539181065141109
sim_compute_performance-ego_min0.05252840689250401
sim_compute_robot_state-ego_max0.05606660772772396
sim_compute_robot_state-ego_mean0.05511814452243915
sim_compute_robot_state-ego_median0.054751242810522606
sim_compute_robot_state-ego_min0.05464540209089007
sim_compute_robot_state-npc0_max0.05844837076523725
sim_compute_robot_state-npc0_mean0.05686093616542283
sim_compute_robot_state-npc0_median0.05690842486442404
sim_compute_robot_state-npc0_min0.05518579993929182
sim_compute_robot_state-npc1_max0.05609311075771556
sim_compute_robot_state-npc1_mean0.05492769947725854
sim_compute_robot_state-npc1_median0.05505394099051492
sim_compute_robot_state-npc1_min0.05383493900299072
sim_compute_robot_state-npc2_max0.05499884259631062
sim_compute_robot_state-npc2_mean0.054319755950257495
sim_compute_robot_state-npc2_median0.05453406242614097
sim_compute_robot_state-npc2_min0.05294177872794015
sim_compute_robot_state-npc3_max0.05491023905137006
sim_compute_robot_state-npc3_mean0.05409628471928325
sim_compute_robot_state-npc3_median0.05403708714490745
sim_compute_robot_state-npc3_min0.053218431132180354
sim_compute_sim_state_max0.031239902271943933
sim_compute_sim_state_mean0.030804808941053457
sim_compute_sim_state_median0.03092080695288522
sim_compute_sim_state_min0.030094431428348316
sim_physics_max0.025568471235387465
sim_physics_mean0.023853490244866455
sim_physics_median0.02350615894093233
sim_physics_min0.022095883798878096
sim_render-ego_max0.053299622332796136
sim_render-ego_mean0.05225090174216336
sim_render-ego_median0.05256384611129761
sim_render-ego_min0.05109184639794486
simulation-passed1
survival_time_max8.549999999999986
survival_time_mean6.429999999999988
survival_time_min3.399999999999996
No reset possible
186842681Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-95600:21:10
Waited 1201 seconds [...]
Waited 1201 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186742707Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-95600:21:11
Waited 1201 seconds [...]
Waited 1201 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186682715jiang pengtest for ppoaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-95600:00:46
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186602735Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationfailednoidsc-rudolf-95600:01:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186382771Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-95600:21:12
Waited 1201 seconds [...]
Waited 1201 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186302796Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationfailednoidsc-rudolf-95600:01:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186242805Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agentaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-95600:05:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.14711361581628973
agent_compute-ego_mean0.1418899499268463
agent_compute-ego_median0.1421171873807907
agent_compute-ego_min0.13792327245076497
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.0160117599199403, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05780366231810371, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13993256047086897, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07396613876774626, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.0393999567571676, "sim_compute_performance-ego": 0.057604825721596774, "sim_compute_robot_state-ego": 0.06039941535805756}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.016332534226504238, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.05791804465380582, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.14711361581628973, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07723181356083263, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.036203454841266976, "sim_compute_performance-ego": 0.05991086092862216, "sim_compute_robot_state-ego": 0.060851248827847565}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.015873389773898655, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.05820664829678006, "in-drivable-lane": 0, "agent_compute-ego": 0.13792327245076497, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.0769890202416314, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.038576825459798174, "sim_compute_performance-ego": 0.05943384170532227, "sim_compute_robot_state-ego": 0.062493186526828344}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.015710721413294475, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06076530118783315, "in-drivable-lane": 0, "agent_compute-ego": 0.1421171873807907, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07699679334958394, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03892690440018972, "sim_compute_performance-ego": 0.06239058574040731, "sim_compute_robot_state-ego": 0.06371283531188965}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.01751635004492367, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06541435157551485, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14236311351551728, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07830983400344849, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04158027382457957, "sim_compute_performance-ego": 0.06405102505403407, "sim_compute_robot_state-ego": 0.06680783103494083}}
set_robot_commands_max0.07830983400344849
set_robot_commands_mean0.07669871998464854
set_robot_commands_median0.07699679334958394
set_robot_commands_min0.07396613876774626
sim_compute_performance-ego_max0.06405102505403407
sim_compute_performance-ego_mean0.06067822782999653
sim_compute_performance-ego_median0.05991086092862216
sim_compute_performance-ego_min0.057604825721596774
sim_compute_robot_state-ego_max0.06680783103494083
sim_compute_robot_state-ego_mean0.06285290341191278
sim_compute_robot_state-ego_median0.062493186526828344
sim_compute_robot_state-ego_min0.06039941535805756
sim_compute_sim_state_max0.04158027382457957
sim_compute_sim_state_mean0.03893748305660041
sim_compute_sim_state_median0.03892690440018972
sim_compute_sim_state_min0.036203454841266976
sim_physics_max0.01751635004492367
sim_physics_mean0.016288951075712266
sim_physics_median0.0160117599199403
sim_physics_min0.015710721413294475
sim_render-ego_max0.06541435157551485
sim_render-ego_mean0.06002160160640753
sim_render-ego_median0.05820664829678006
sim_render-ego_min0.05780366231810371
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible