Duckietown Challenges Home Challenges Submissions

Evaluator 759

ID759
evaluatoridsc-rudolf-11638
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-11638
versiond-c:4.0.18;d-c-r:4.0.27;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success24 18613
# timeout1 18947
# failed1 18653
# error13 18663
# aborted5 18963
# host-error7 18892
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
191572296Andrea Censi 🇨🇭Java templateaido2-AMOD-fleet_sizestep1-simulationerroryesidsc-rudolf-116380:00:46
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
191492309Andrea Censi 🇨🇭Java templateaido2-AMOD-service_qualitystep1-simulationerroryesidsc-rudolf-116380:00:30
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
191202960Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-116380:21:02
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
191122948Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-116380:07:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07179001331996626
survival_time_median1.7000000000000008
deviation-center-line_median0.03475202883081557
in-drivable-lane_median0.5000000000000004


other stats
agent_compute-ego_max0.26492850920733285
agent_compute-ego_mean0.22379267462222124
agent_compute-ego_median0.2136208450092989
agent_compute-ego_min0.21087892616496368
deviation-center-line_max0.045840464281330026
deviation-center-line_mean0.036001887564649566
deviation-center-line_min0.03181446965987815
deviation-heading_max0.7143297362676483
deviation-heading_mean0.6661904609323562
deviation-heading_median0.6675311192971669
deviation-heading_min0.6130925161246024
driven_any_max0.19043924071075288
driven_any_mean0.17267671197493786
driven_any_median0.17205930246389672
driven_any_min0.16180443455343235
driven_lanedir_consec_max0.10149193983173666
driven_lanedir_consec_mean0.075913373034416
driven_lanedir_consec_min0.06130330911019399
driven_lanedir_max0.10149193983173666
driven_lanedir_mean0.075913373034416
driven_lanedir_median0.07179001331996626
driven_lanedir_min0.06130330911019399
in-drivable-lane_max0.5500000000000005
in-drivable-lane_mean0.5000000000000004
in-drivable-lane_min0.4500000000000004
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.17484617187554558, "sim_physics": 0.026218673762153175, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07887380319174353, "sim_render-ego": 0.06725950100842644, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.26492850920733285, "deviation-heading": 0.6130925161246024, "set_robot_commands": 0.0777956668068381, "deviation-center-line": 0.03181446965987815, "driven_lanedir_consec": 0.07887380319174353, "sim_compute_sim_state": 0.03381968245786779, "sim_compute_performance-ego": 0.06354049374075497, "sim_compute_robot_state-ego": 0.06384637075311997, "sim_compute_robot_state-npc0": 0.06788821080151726, "sim_compute_robot_state-npc1": 0.06628307875464945, "sim_compute_robot_state-npc2": 0.06187393384821275, "sim_compute_robot_state-npc3": 0.062159033382640165}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16180443455343235, "sim_physics": 0.02674838374642765, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06130330911019399, "sim_render-ego": 0.06387982648961685, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.21087892616496368, "deviation-heading": 0.7143297362676483, "set_robot_commands": 0.07480772803811465, "deviation-center-line": 0.03475202883081557, "driven_lanedir_consec": 0.06130330911019399, "sim_compute_sim_state": 0.03674321314867805, "sim_compute_performance-ego": 0.06604848188512466, "sim_compute_robot_state-ego": 0.06938819324269015, "sim_compute_robot_state-npc0": 0.06880610830643598, "sim_compute_robot_state-npc1": 0.06697961863349466, "sim_compute_robot_state-npc2": 0.06352043853086584, "sim_compute_robot_state-npc3": 0.06372066806344424}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1642344102710617, "sim_physics": 0.02789988662257339, "survival_time": 1.6500000000000008, "driven_lanedir": 0.06610779971843961, "sim_render-ego": 0.06172331896695224, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.2120760643120968, "deviation-heading": 0.6675311192971669, "set_robot_commands": 0.07525480877269398, "deviation-center-line": 0.03239491258340806, "driven_lanedir_consec": 0.06610779971843961, "sim_compute_sim_state": 0.03662162116079619, "sim_compute_performance-ego": 0.06245949774077445, "sim_compute_robot_state-ego": 0.06258403893673059, "sim_compute_robot_state-npc0": 0.06782411084030614, "sim_compute_robot_state-npc1": 0.06531039151278409, "sim_compute_robot_state-npc2": 0.06376746929053104, "sim_compute_robot_state-npc3": 0.0719880840995095}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19043924071075288, "sim_physics": 0.02814633004805621, "survival_time": 1.7000000000000008, "driven_lanedir": 0.10149193983173666, "sim_render-ego": 0.06749185393838321, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.2136208450092989, "deviation-heading": 0.6772187407031505, "set_robot_commands": 0.07547553146586698, "deviation-center-line": 0.045840464281330026, "driven_lanedir_consec": 0.10149193983173666, "sim_compute_sim_state": 0.03721381636226878, "sim_compute_performance-ego": 0.06441081972683177, "sim_compute_robot_state-ego": 0.06480191034429214, "sim_compute_robot_state-npc0": 0.0716551191666547, "sim_compute_robot_state-npc1": 0.06568673778982724, "sim_compute_robot_state-npc2": 0.06581790306988884, "sim_compute_robot_state-npc3": 0.06732368469238281}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.17205930246389672, "sim_physics": 0.02402712359572902, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07179001331996626, "sim_render-ego": 0.06862767537434895, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.21745902841741388, "deviation-heading": 0.658780192269213, "set_robot_commands": 0.07640118309945772, "deviation-center-line": 0.035207562467816, "driven_lanedir_consec": 0.07179001331996626, "sim_compute_sim_state": 0.03612880273298784, "sim_compute_performance-ego": 0.06831974694223115, "sim_compute_robot_state-ego": 0.06490694392811168, "sim_compute_robot_state-npc0": 0.0732040260777329, "sim_compute_robot_state-npc1": 0.0674905776977539, "sim_compute_robot_state-npc2": 0.06819628224228368, "sim_compute_robot_state-npc3": 0.0678746628038811}}
set_robot_commands_max0.0777956668068381
set_robot_commands_mean0.07594698363659429
set_robot_commands_median0.07547553146586698
set_robot_commands_min0.07480772803811465
sim_compute_performance-ego_max0.06831974694223115
sim_compute_performance-ego_mean0.06495580800714339
sim_compute_performance-ego_median0.06441081972683177
sim_compute_performance-ego_min0.06245949774077445
sim_compute_robot_state-ego_max0.06938819324269015
sim_compute_robot_state-ego_mean0.06510549144098891
sim_compute_robot_state-ego_median0.06480191034429214
sim_compute_robot_state-ego_min0.06258403893673059
sim_compute_robot_state-npc0_max0.0732040260777329
sim_compute_robot_state-npc0_mean0.06987551503852939
sim_compute_robot_state-npc0_median0.06880610830643598
sim_compute_robot_state-npc0_min0.06782411084030614
sim_compute_robot_state-npc1_max0.0674905776977539
sim_compute_robot_state-npc1_mean0.06635008087770186
sim_compute_robot_state-npc1_median0.06628307875464945
sim_compute_robot_state-npc1_min0.06531039151278409
sim_compute_robot_state-npc2_max0.06819628224228368
sim_compute_robot_state-npc2_mean0.06463520539635643
sim_compute_robot_state-npc2_median0.06376746929053104
sim_compute_robot_state-npc2_min0.06187393384821275
sim_compute_robot_state-npc3_max0.0719880840995095
sim_compute_robot_state-npc3_mean0.06661322660837157
sim_compute_robot_state-npc3_median0.06732368469238281
sim_compute_robot_state-npc3_min0.062159033382640165
sim_compute_sim_state_max0.03721381636226878
sim_compute_sim_state_mean0.03610542717251973
sim_compute_sim_state_median0.03662162116079619
sim_compute_sim_state_min0.03381968245786779
sim_physics_max0.02814633004805621
sim_physics_mean0.02660807955498789
sim_physics_median0.02674838374642765
sim_physics_min0.02402712359572902
sim_render-ego_max0.06862767537434895
sim_render-ego_mean0.06579643515554554
sim_render-ego_median0.06725950100842644
sim_render-ego_min0.06172331896695224
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.6800000000000008
survival_time_min1.6500000000000008
No reset possible
191092936Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-116380:00:41
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190932921Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-116380:06:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.09609956070622117
survival_time_median1.3000000000000005
deviation-center-line_median0.05889312899417622
in-drivable-lane_median0


other stats
agent_compute-ego_max0.4142019584261138
agent_compute-ego_mean0.32704722104155487
agent_compute-ego_median0.3183154601317186
agent_compute-ego_min0.28314367624429554
deviation-center-line_max0.06346849384387046
deviation-center-line_mean0.05351148097184
deviation-center-line_min0.03932529663921851
deviation-heading_max0.763198721795378
deviation-heading_mean0.7358968919290065
deviation-heading_median0.7393143421643041
deviation-heading_min0.6895693135231163
driven_any_max0.1830137306234541
driven_any_mean0.1561559675311207
driven_any_median0.15395851345620623
driven_any_min0.13528327513937982
driven_lanedir_consec_max0.1338501762049349
driven_lanedir_consec_mean0.0938684829475778
driven_lanedir_consec_min0.06063808649400837
driven_lanedir_max0.1338501762049349
driven_lanedir_mean0.0938684829475778
driven_lanedir_median0.09609956070622117
driven_lanedir_min0.06063808649400837
in-drivable-lane_max0.20000000000000015
in-drivable-lane_mean0.07000000000000006
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.15353046916186674, "sim_physics": 0.0183812585370294, "survival_time": 1.4500000000000006, "driven_lanedir": 0.08069915915517178, "sim_render-ego": 0.0559738093409045, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.4142019584261138, "deviation-heading": 0.7393143421643041, "set_robot_commands": 0.07757963805363097, "deviation-center-line": 0.04581304346477418, "driven_lanedir_consec": 0.08069915915517178, "sim_compute_sim_state": 0.03659992382444184, "sim_compute_performance-ego": 0.06090303947185648, "sim_compute_robot_state-ego": 0.06044373841121279}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1830137306234541, "sim_physics": 0.01630925249170374, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1338501762049349, "sim_render-ego": 0.05761691376014992, "in-drivable-lane": 0, "agent_compute-ego": 0.29676686392890084, "deviation-heading": 0.6895693135231163, "set_robot_commands": 0.07365701816700122, "deviation-center-line": 0.06346849384387046, "driven_lanedir_consec": 0.1338501762049349, "sim_compute_sim_state": 0.038056647336041485, "sim_compute_performance-ego": 0.06358757725468388, "sim_compute_robot_state-ego": 0.062037406144318755}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13528327513937982, "sim_physics": 0.01795825591454139, "survival_time": 1.3000000000000005, "driven_lanedir": 0.06063808649400837, "sim_render-ego": 0.058620526240422174, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.3183154601317186, "deviation-heading": 0.7289045594933315, "set_robot_commands": 0.07812787019289456, "deviation-center-line": 0.03932529663921851, "driven_lanedir_consec": 0.06063808649400837, "sim_compute_sim_state": 0.038423849986149713, "sim_compute_performance-ego": 0.06013462176689735, "sim_compute_robot_state-ego": 0.06268066626328689}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.15499384927469664, "sim_physics": 0.015548357596764198, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09609956070622117, "sim_render-ego": 0.05432437933408297, "in-drivable-lane": 0, "agent_compute-ego": 0.28314367624429554, "deviation-heading": 0.763198721795378, "set_robot_commands": 0.07503100541921762, "deviation-center-line": 0.05889312899417622, "driven_lanedir_consec": 0.09609956070622117, "sim_compute_sim_state": 0.03404278938586895, "sim_compute_performance-ego": 0.057020141528202936, "sim_compute_robot_state-ego": 0.057703797633831315}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15395851345620623, "sim_physics": 0.01863686855022724, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09805543217755286, "sim_render-ego": 0.05990677613478441, "in-drivable-lane": 0, "agent_compute-ego": 0.3228081464767456, "deviation-heading": 0.7584975226689031, "set_robot_commands": 0.07354722573206975, "deviation-center-line": 0.06005744191716057, "driven_lanedir_consec": 0.09805543217755286, "sim_compute_sim_state": 0.03657971895658053, "sim_compute_performance-ego": 0.05932380602909969, "sim_compute_robot_state-ego": 0.061757674584021933}}
set_robot_commands_max0.07812787019289456
set_robot_commands_mean0.07558855151296281
set_robot_commands_median0.07503100541921762
set_robot_commands_min0.07354722573206975
sim_compute_performance-ego_max0.06358757725468388
sim_compute_performance-ego_mean0.06019383721014807
sim_compute_performance-ego_median0.06013462176689735
sim_compute_performance-ego_min0.057020141528202936
sim_compute_robot_state-ego_max0.06268066626328689
sim_compute_robot_state-ego_mean0.060924656607334336
sim_compute_robot_state-ego_median0.061757674584021933
sim_compute_robot_state-ego_min0.057703797633831315
sim_compute_sim_state_max0.038423849986149713
sim_compute_sim_state_mean0.0367405858978165
sim_compute_sim_state_median0.03659992382444184
sim_compute_sim_state_min0.03404278938586895
sim_physics_max0.01863686855022724
sim_physics_mean0.01736679861805319
sim_physics_median0.01795825591454139
sim_physics_min0.015548357596764198
sim_render-ego_max0.05990677613478441
sim_render-ego_mean0.05728848096206879
sim_render-ego_median0.05761691376014992
sim_render-ego_min0.05432437933408297
simulation-passed1
survival_time_max1.4500000000000006
survival_time_mean1.3400000000000003
survival_time_min1.3000000000000005
No reset possible
190912917Claudio RuchPython templateaido2-AMOD-service_qualitystep1-simulationabortednoidsc-rudolf-116380:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190702916Claudio RuchPython templateaido2-AMOD-efficiencystep1-simulationabortednoidsc-rudolf-116380:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190622914Claudio RuchPython templateaido2-AMOD-efficiencystep1-simulationhost-errornoidsc-rudolf-116380:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190532915Claudio RuchPython templateaido2-AMOD-service_qualitystep1-simulationhost-errornoidsc-rudolf-116380:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190422909Ashwin Ram 🇸🇬challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-116380:04:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.34720876110443966
survival_time_median1.0500000000000005
deviation-center-line_median0.041304691380128496
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.24540294919695177
agent_compute-ego_mean0.2406323088099922
agent_compute-ego_median0.24222764303517896
agent_compute-ego_min0.23367378825233096
deviation-center-line_max0.09006002946176994
deviation-center-line_mean0.051055726149202986
deviation-center-line_min0.04130450856096399
deviation-heading_max0.5504084005929305
deviation-heading_mean0.28252334561179815
deviation-heading_median0.21555208186651512
deviation-heading_min0.21555208186651495
driven_any_max1.0267195124681896
driven_any_mean0.5226997498610592
driven_any_median0.3966948092092771
driven_any_min0.3966948092092761
driven_lanedir_consec_max0.6528703795518611
driven_lanedir_consec_mean0.40834045298468896
driven_lanedir_consec_min0.3472069729650955
driven_lanedir_max0.6528703795518611
driven_lanedir_mean0.40834045298468896
driven_lanedir_median0.34720876110443966
driven_lanedir_min0.3472069729650955
in-drivable-lane_max0.4999999999999995
in-drivable-lane_mean0.13999999999999996
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0267195124681896, "sim_physics": 0.016370008158129314, "survival_time": 2.1500000000000004, "driven_lanedir": 0.6528703795518611, "sim_render-ego": 0.06286561211874318, "in-drivable-lane": 0.4999999999999995, "agent_compute-ego": 0.24222764303517896, "deviation-heading": 0.5504084005929305, "set_robot_commands": 0.08207048926242562, "deviation-center-line": 0.09006002946176994, "driven_lanedir_consec": 0.6528703795518611, "sim_compute_sim_state": 0.041339336439620615, "sim_compute_performance-ego": 0.06482900575149891, "sim_compute_robot_state-ego": 0.06607298518336097}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3966948092092761, "sim_physics": 0.017552341733660017, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3472073901976088, "sim_render-ego": 0.06729817390441895, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.2453834783463251, "deviation-heading": 0.21555208186651495, "set_robot_commands": 0.0816839649563744, "deviation-center-line": 0.04130450856096399, "driven_lanedir_consec": 0.3472073901976088, "sim_compute_sim_state": 0.041717540650140675, "sim_compute_performance-ego": 0.06853790510268438, "sim_compute_robot_state-ego": 0.06900310516357422}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.39669480920927613, "sim_physics": 0.016681058066231862, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3472069729650955, "sim_render-ego": 0.0673156806400844, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.24540294919695177, "deviation-heading": 0.21555208186651512, "set_robot_commands": 0.0766654582250686, "deviation-center-line": 0.04130470996302398, "driven_lanedir_consec": 0.3472069729650955, "sim_compute_sim_state": 0.04393536703927176, "sim_compute_performance-ego": 0.06455653054373604, "sim_compute_robot_state-ego": 0.06677151861644927}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3966948092092771, "sim_physics": 0.01694134303501674, "survival_time": 1.0500000000000005, "driven_lanedir": 0.34720876110443966, "sim_render-ego": 0.06622858274550665, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.2364736852191743, "deviation-heading": 0.21555208186651512, "set_robot_commands": 0.07999113627842494, "deviation-center-line": 0.041304691380128496, "driven_lanedir_consec": 0.34720876110443966, "sim_compute_sim_state": 0.0434912954057966, "sim_compute_performance-ego": 0.06896643411545526, "sim_compute_robot_state-ego": 0.06622961589268275}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3966948092092771, "sim_physics": 0.017409858249482654, "survival_time": 1.0500000000000005, "driven_lanedir": 0.34720876110443966, "sim_render-ego": 0.06581727663675944, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.23367378825233096, "deviation-heading": 0.21555208186651512, "set_robot_commands": 0.07598742984590076, "deviation-center-line": 0.041304691380128496, "driven_lanedir_consec": 0.34720876110443966, "sim_compute_sim_state": 0.040851536251249765, "sim_compute_performance-ego": 0.06699842498415992, "sim_compute_robot_state-ego": 0.06778899828592937}}
set_robot_commands_max0.08207048926242562
set_robot_commands_mean0.07927969571363887
set_robot_commands_median0.07999113627842494
set_robot_commands_min0.07598742984590076
sim_compute_performance-ego_max0.06896643411545526
sim_compute_performance-ego_mean0.0667776600995069
sim_compute_performance-ego_median0.06699842498415992
sim_compute_performance-ego_min0.06455653054373604
sim_compute_robot_state-ego_max0.06900310516357422
sim_compute_robot_state-ego_mean0.06717324462839933
sim_compute_robot_state-ego_median0.06677151861644927
sim_compute_robot_state-ego_min0.06607298518336097
sim_compute_sim_state_max0.04393536703927176
sim_compute_sim_state_mean0.04226701515721589
sim_compute_sim_state_median0.041717540650140675
sim_compute_sim_state_min0.040851536251249765
sim_physics_max0.017552341733660017
sim_physics_mean0.016990921848504117
sim_physics_median0.01694134303501674
sim_physics_min0.016370008158129314
sim_render-ego_max0.0673156806400844
sim_render-ego_mean0.06590506520910253
sim_render-ego_median0.06622858274550665
sim_render-ego_min0.06286561211874318
simulation-passed1
survival_time_max2.1500000000000004
survival_time_mean1.2700000000000002
survival_time_min1.0500000000000005
No reset possible
190292908Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-116380:21:15
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190182891Diego Charrez 🇵🇪Python templateaido2-AMOD-efficiencystep1-simulationhost-errornoidsc-rudolf-116380:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190152892Diego Charrez 🇵🇪Python templateaido2-AMOD-service_qualitystep1-simulationhost-errornoidsc-rudolf-116380:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190032889Diego Charrez 🇵🇪Python templateaido2-AMOD-efficiencystep1-simulationhost-errornoidsc-rudolf-116380:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190022890Diego Charrez 🇵🇪Python templateaido2-AMOD-service_qualitystep1-simulationhost-errornoidsc-rudolf-116380:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189732890Diego Charrez 🇵🇪Python templateaido2-AMOD-service_qualitystep1-simulationabortednoidsc-rudolf-116380:02:30
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189662890Diego Charrez 🇵🇪Python templateaido2-AMOD-service_qualitystep1-simulationabortednoidsc-rudolf-116380:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189632889Diego Charrez 🇵🇪Python templateaido2-AMOD-efficiencystep1-simulationabortednoidsc-rudolf-116380:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189472887Diego Charrez 🇵🇪PredictorLastaido2-PREDstep1-simulationtimeoutnoidsc-rudolf-116380:01:19
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189452886Diego Charrez 🇵🇪PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-116380:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11117085234242324
error_L20.019745474798141947


No reset possible
189382885Andrea Daniele 🇮🇹minimal_agent (Python 3)aido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-116380:21:03
Waited 1200 seconds [...]
Waited 1200 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189212369Liam Paull 🇨🇦minimal_agent (Python 3)aido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-116380:14:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.225306900765771
survival_time_median10.750000000000018
deviation-center-line_median0.40864173779456053
in-drivable-lane_median1.7000000000000242


other stats
agent_compute-ego_max0.14669710210620554
agent_compute-ego_mean0.1427996383699446
agent_compute-ego_median0.1433113038974957
agent_compute-ego_min0.13943133132402288
deviation-center-line_max0.6491801892887803
deviation-center-line_mean0.3683230725655418
deviation-center-line_min0.1475671628461062
deviation-heading_max2.2060076411946548
deviation-heading_mean1.4163758252990906
deviation-heading_median1.5250264276913703
deviation-heading_min0.6970592634293067
driven_any_max1.6057043265958648
driven_any_mean1.3484469345214642
driven_any_median1.5756972277649912
driven_any_min0.9900494571900692
driven_lanedir_consec_max1.4904214722299334
driven_lanedir_consec_mean1.0721437270256324
driven_lanedir_consec_min0.6474115509746436
driven_lanedir_max1.4904214722299334
driven_lanedir_mean1.0721437270256324
driven_lanedir_median1.225306900765771
driven_lanedir_min0.6474115509746436
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.4300000000000082
in-drivable-lane_min0.25000000000000355
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.016930398323553073, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.06379860253642788, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.14481593550537988, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.07872619903344902, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.04111417420476461, "sim_compute_performance-ego": 0.06530018161526686, "sim_compute_robot_state-ego": 0.06493676480629461}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900494571900692, "sim_physics": 0.016663319873113702, "survival_time": 6.849999999999984, "driven_lanedir": 0.764431461654983, "sim_render-ego": 0.06110344664023741, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1433113038974957, "deviation-heading": 0.6970592634293067, "set_robot_commands": 0.07788738021015251, "deviation-center-line": 0.21999312889725264, "driven_lanedir_consec": 0.764431461654983, "sim_compute_sim_state": 0.03931674469996543, "sim_compute_performance-ego": 0.06338070256866678, "sim_compute_robot_state-ego": 0.062465857415303694}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6057043265958648, "sim_physics": 0.01627040123191115, "survival_time": 11.150000000000023, "driven_lanedir": 1.4904214722299334, "sim_render-ego": 0.06462379635182197, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.14669710210620554, "deviation-heading": 2.2060076411946548, "set_robot_commands": 0.07902212207092832, "deviation-center-line": 0.6491801892887803, "driven_lanedir_consec": 1.4904214722299334, "sim_compute_sim_state": 0.040956436251311026, "sim_compute_performance-ego": 0.0646615477420824, "sim_compute_robot_state-ego": 0.0645904230964558}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5770378848298965, "sim_physics": 0.015511255486066952, "survival_time": 10.750000000000018, "driven_lanedir": 1.225306900765771, "sim_render-ego": 0.06162783156993777, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.13943133132402288, "deviation-heading": 1.8264323848694184, "set_robot_commands": 0.07530401584713958, "deviation-center-line": 0.40864173779456053, "driven_lanedir_consec": 1.225306900765771, "sim_compute_sim_state": 0.03965470180955044, "sim_compute_performance-ego": 0.062139507781627565, "sim_compute_robot_state-ego": 0.062461157732231674}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5756972277649912, "sim_physics": 0.01669363291175277, "survival_time": 10.800000000000018, "driven_lanedir": 1.233147249502831, "sim_render-ego": 0.061183284830164025, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.13974251901661908, "deviation-heading": 1.5250264276913703, "set_robot_commands": 0.07660985655254787, "deviation-center-line": 0.4162331440010094, "driven_lanedir_consec": 1.233147249502831, "sim_compute_sim_state": 0.039721273713641696, "sim_compute_performance-ego": 0.06249723059159738, "sim_compute_robot_state-ego": 0.06331335063333865}}
set_robot_commands_max0.07902212207092832
set_robot_commands_mean0.07750991474284347
set_robot_commands_median0.07788738021015251
set_robot_commands_min0.07530401584713958
sim_compute_performance-ego_max0.06530018161526686
sim_compute_performance-ego_mean0.0635958340598482
sim_compute_performance-ego_median0.06338070256866678
sim_compute_performance-ego_min0.062139507781627565
sim_compute_robot_state-ego_max0.06493676480629461
sim_compute_robot_state-ego_mean0.06355351073672488
sim_compute_robot_state-ego_median0.06331335063333865
sim_compute_robot_state-ego_min0.062461157732231674
sim_compute_sim_state_max0.04111417420476461
sim_compute_sim_state_mean0.04015266613584664
sim_compute_sim_state_median0.039721273713641696
sim_compute_sim_state_min0.03931674469996543
sim_physics_max0.016930398323553073
sim_physics_mean0.01641380156527953
sim_physics_median0.016663319873113702
sim_physics_min0.015511255486066952
sim_render-ego_max0.06462379635182197
sim_render-ego_mean0.062467392385717815
sim_render-ego_median0.06162783156993777
sim_render-ego_min0.06110344664023741
simulation-passed1
survival_time_max11.150000000000023
survival_time_mean9.300000000000004
survival_time_min6.849999999999984
No reset possible
189152375Liam Paull 🇨🇦minimal_agent_python2 (Python 2)aido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-116380:08:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2394590679116675
survival_time_median5.549999999999988
deviation-center-line_median0.04756896992501765
in-drivable-lane_median0.9999999999999964


other stats
agent_compute-ego_max0.05774542447682973
agent_compute-ego_mean0.05585371785693698
agent_compute-ego_median0.056444519095950656
agent_compute-ego_min0.054217550489637584
deviation-center-line_max0.06628159589691172
deviation-center-line_mean0.055053867384428454
deviation-center-line_min0.04756874938348469
deviation-heading_max0.3902119203851745
deviation-heading_mean0.3724667982759654
deviation-heading_median0.39020902164128224
deviation-heading_min0.34585149487811473
driven_any_max1.5771689201187185
driven_any_mean1.343168920198914
driven_any_median1.5771689201187176
driven_any_min0.992168920319208
driven_lanedir_consec_max1.344898529895705
driven_lanedir_consec_mean1.047634910702065
driven_lanedir_consec_min0.6544587706938922
driven_lanedir_max1.344898529895705
driven_lanedir_mean1.047634910702065
driven_lanedir_median1.2394590679116675
driven_lanedir_min0.6544587706938922
in-drivable-lane_max0.9999999999999964
in-drivable-lane_mean0.8799999999999969
in-drivable-lane_min0.6999999999999975
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9921689203192088, "sim_physics": 0.018814464410146076, "survival_time": 3.599999999999995, "driven_lanedir": 0.6544587706938922, "sim_render-ego": 0.061959803104400635, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.054217550489637584, "deviation-heading": 0.3902119203851745, "set_robot_commands": 0.07716435856289333, "deviation-center-line": 0.04756896992501765, "driven_lanedir_consec": 0.6544587706938922, "sim_compute_sim_state": 0.04188084602355957, "sim_compute_performance-ego": 0.06446506248580085, "sim_compute_robot_state-ego": 0.0647617479165395}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.992168920319208, "sim_physics": 0.020642701122495864, "survival_time": 3.599999999999995, "driven_lanedir": 0.7598991170973933, "sim_render-ego": 0.0652037262916565, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.056444519095950656, "deviation-heading": 0.34585253283397355, "set_robot_commands": 0.07881961597336663, "deviation-center-line": 0.06628159589691172, "driven_lanedir_consec": 0.7598991170973933, "sim_compute_sim_state": 0.04111632042460971, "sim_compute_performance-ego": 0.0650943054093255, "sim_compute_robot_state-ego": 0.06733749310175578}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5771689201187185, "sim_physics": 0.017338258726102812, "survival_time": 5.549999999999988, "driven_lanedir": 1.344898529895705, "sim_render-ego": 0.06603571960517952, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.05431424175296818, "deviation-heading": 0.34585149487811473, "set_robot_commands": 0.07615100800454079, "deviation-center-line": 0.06628127233324356, "driven_lanedir_consec": 1.344898529895705, "sim_compute_sim_state": 0.04153465150712846, "sim_compute_performance-ego": 0.06777132309234894, "sim_compute_robot_state-ego": 0.0683801217122121}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.01839515969559953, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.06671410852724367, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.05654685346929877, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.07786606668352007, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.0430744338679958, "sim_compute_performance-ego": 0.06842326473545383, "sim_compute_robot_state-ego": 0.0683069894979666}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.01903119387927356, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.06506329613762933, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.05774542447682973, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.07621981861355069, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.04134327871305449, "sim_compute_performance-ego": 0.06480156408773886, "sim_compute_robot_state-ego": 0.06682189305623372}}
set_robot_commands_max0.07881961597336663
set_robot_commands_mean0.0772441735675743
set_robot_commands_median0.07716435856289333
set_robot_commands_min0.07615100800454079
sim_compute_performance-ego_max0.06842326473545383
sim_compute_performance-ego_mean0.0661111039621336
sim_compute_performance-ego_median0.0650943054093255
sim_compute_performance-ego_min0.06446506248580085
sim_compute_robot_state-ego_max0.0683801217122121
sim_compute_robot_state-ego_mean0.06712164905694154
sim_compute_robot_state-ego_median0.06733749310175578
sim_compute_robot_state-ego_min0.0647617479165395
sim_compute_sim_state_max0.0430744338679958
sim_compute_sim_state_mean0.04178990610726961
sim_compute_sim_state_median0.04153465150712846
sim_compute_sim_state_min0.04111632042460971
sim_physics_max0.020642701122495864
sim_physics_mean0.018844355566723568
sim_physics_median0.018814464410146076
sim_physics_min0.017338258726102812
sim_render-ego_max0.06671410852724367
sim_render-ego_mean0.06499533073322193
sim_render-ego_median0.0652037262916565
sim_render-ego_min0.061959803104400635
simulation-passed1
survival_time_max5.549999999999988
survival_time_mean4.769999999999992
survival_time_min3.599999999999995
No reset possible
189052387Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-116380:07:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08060409244250177
survival_time_median1.5000000000000009
deviation-center-line_median0.05056685702229619
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.27073867567654314
agent_compute-ego_mean0.22929559357925655
agent_compute-ego_median0.23051984310150148
agent_compute-ego_min0.18963816089014857
deviation-center-line_max0.06479000643859326
deviation-center-line_mean0.05165414464579261
deviation-center-line_min0.04185146909411329
deviation-heading_max0.922271385839668
deviation-heading_mean0.8151226004215351
deviation-heading_median0.7999057765321629
deviation-heading_min0.7524679340461129
driven_any_max0.17533087585891713
driven_any_mean0.1594285822654594
driven_any_median0.15741859268473926
driven_any_min0.14620159717922857
driven_lanedir_consec_max0.09996483485192308
driven_lanedir_consec_mean0.08655896885656733
driven_lanedir_consec_min0.0777157561908286
driven_lanedir_max0.09996483485192308
driven_lanedir_mean0.08655896885656733
driven_lanedir_median0.08060409244250177
driven_lanedir_min0.0777157561908286
in-drivable-lane_max0.5000000000000004
in-drivable-lane_mean0.19000000000000017
in-drivable-lane_min0.05000000000000005
per-episodes
details{"udem1-0-0": {"driven_any": 0.1667909133275325, "sim_physics": 0.026822320876582977, "survival_time": 1.5500000000000007, "driven_lanedir": 0.09996483485192308, "sim_render-ego": 0.059881656400619016, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18963816089014857, "deviation-heading": 0.922271385839668, "set_robot_commands": 0.07697134633218089, "deviation-center-line": 0.06479000643859326, "driven_lanedir_consec": 0.09996483485192308, "sim_compute_sim_state": 0.034170942921792305, "sim_compute_performance-ego": 0.06048622438984533, "sim_compute_robot_state-ego": 0.05914891919782085, "sim_compute_robot_state-npc0": 0.07183657153960198, "sim_compute_robot_state-npc1": 0.06374510642020934, "sim_compute_robot_state-npc2": 0.06231562552913543, "sim_compute_robot_state-npc3": 0.06209408083269673}, "udem1-1-0": {"driven_any": 0.17533087585891713, "sim_physics": 0.029729372925228544, "survival_time": 1.800000000000001, "driven_lanedir": 0.08060409244250177, "sim_render-ego": 0.06570995516247219, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.2322609027226766, "deviation-heading": 0.7524679340461129, "set_robot_commands": 0.07576983504825169, "deviation-center-line": 0.04185146909411329, "driven_lanedir_consec": 0.08060409244250177, "sim_compute_sim_state": 0.03650894429948595, "sim_compute_performance-ego": 0.06178348594241672, "sim_compute_robot_state-ego": 0.06049491961797079, "sim_compute_robot_state-npc0": 0.0748438901371426, "sim_compute_robot_state-npc1": 0.06918046871821086, "sim_compute_robot_state-npc2": 0.06480526924133301, "sim_compute_robot_state-npc3": 0.06408052312003241}, "udem1-2-0": {"driven_any": 0.14620159717922857, "sim_physics": 0.035388930090542496, "survival_time": 1.4500000000000006, "driven_lanedir": 0.0777157561908286, "sim_render-ego": 0.06323719846791234, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.2233203855054132, "deviation-heading": 0.7999057765321629, "set_robot_commands": 0.07419508901135675, "deviation-center-line": 0.05056685702229619, "driven_lanedir_consec": 0.0777157561908286, "sim_compute_sim_state": 0.038774687668372845, "sim_compute_performance-ego": 0.06458204368065143, "sim_compute_robot_state-ego": 0.06553104828143942, "sim_compute_robot_state-npc0": 0.07000074715449892, "sim_compute_robot_state-npc1": 0.0648068066301017, "sim_compute_robot_state-npc2": 0.062473017593909955, "sim_compute_robot_state-npc3": 0.06649712858528926}, "udem1-3-0": {"driven_any": 0.1514009322768796, "sim_physics": 0.03232687917248956, "survival_time": 1.4500000000000006, "driven_lanedir": 0.08033925906033068, "sim_render-ego": 0.07064600648551152, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.27073867567654314, "deviation-heading": 0.7830950124808711, "set_robot_commands": 0.07731537161202266, "deviation-center-line": 0.04511973885800811, "driven_lanedir_consec": 0.08033925906033068, "sim_compute_sim_state": 0.03731111000324118, "sim_compute_performance-ego": 0.06461010308101259, "sim_compute_robot_state-ego": 0.06275782091864224, "sim_compute_robot_state-npc0": 0.06846181277571053, "sim_compute_robot_state-npc1": 0.060618548557676115, "sim_compute_robot_state-npc2": 0.06207207153583395, "sim_compute_robot_state-npc3": 0.06525189301063275}, "udem1-4-0": {"driven_any": 0.15741859268473926, "sim_physics": 0.027890896797180174, "survival_time": 1.5000000000000009, "driven_lanedir": 0.09417090173725252, "sim_render-ego": 0.062023742993672686, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.23051984310150148, "deviation-heading": 0.8178728932088613, "set_robot_commands": 0.07326001326243083, "deviation-center-line": 0.05594265181595222, "driven_lanedir_consec": 0.09417090173725252, "sim_compute_sim_state": 0.03643218676249186, "sim_compute_performance-ego": 0.06331882476806641, "sim_compute_robot_state-ego": 0.0608462651570638, "sim_compute_robot_state-npc0": 0.06665395100911459, "sim_compute_robot_state-npc1": 0.0611302375793457, "sim_compute_robot_state-npc2": 0.06185031731923421, "sim_compute_robot_state-npc3": 0.06050558884938558}}
set_robot_commands_max0.07731537161202266
set_robot_commands_mean0.07550233105324856
set_robot_commands_median0.07576983504825169
set_robot_commands_min0.07326001326243083
sim_compute_performance-ego_max0.06461010308101259
sim_compute_performance-ego_mean0.0629561363723985
sim_compute_performance-ego_median0.06331882476806641
sim_compute_performance-ego_min0.06048622438984533
sim_compute_robot_state-ego_max0.06553104828143942
sim_compute_robot_state-ego_mean0.06175579463458743
sim_compute_robot_state-ego_median0.0608462651570638
sim_compute_robot_state-ego_min0.05914891919782085
sim_compute_robot_state-npc0_max0.0748438901371426
sim_compute_robot_state-npc0_mean0.07035939452321373
sim_compute_robot_state-npc0_median0.07000074715449892
sim_compute_robot_state-npc0_min0.06665395100911459
sim_compute_robot_state-npc1_max0.06918046871821086
sim_compute_robot_state-npc1_mean0.06389623358110874
sim_compute_robot_state-npc1_median0.06374510642020934
sim_compute_robot_state-npc1_min0.060618548557676115
sim_compute_robot_state-npc2_max0.06480526924133301
sim_compute_robot_state-npc2_mean0.06270326024388931
sim_compute_robot_state-npc2_median0.06231562552913543
sim_compute_robot_state-npc2_min0.06185031731923421
sim_compute_robot_state-npc3_max0.06649712858528926
sim_compute_robot_state-npc3_mean0.06368584287960734
sim_compute_robot_state-npc3_median0.06408052312003241
sim_compute_robot_state-npc3_min0.06050558884938558
sim_compute_sim_state_max0.038774687668372845
sim_compute_sim_state_mean0.03663957433107683
sim_compute_sim_state_median0.03650894429948595
sim_compute_sim_state_min0.034170942921792305
sim_physics_max0.035388930090542496
sim_physics_mean0.03043167997240475
sim_physics_median0.029729372925228544
sim_physics_min0.026822320876582977
sim_render-ego_max0.07064600648551152
sim_render-ego_mean0.06429971190203755
sim_render-ego_median0.06323719846791234
sim_render-ego_min0.059881656400619016
simulation-passed1
survival_time_max1.800000000000001
survival_time_mean1.550000000000001
survival_time_min1.4500000000000006
No reset possible
188952400Liam Paull 🇨🇦random_agentaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-116380:11:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.12953664410498836
agent_compute-ego_mean0.126105392510875
agent_compute-ego_median0.1258528279323204
agent_compute-ego_min0.1232647593059237
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03129424746074374, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06094419388543992, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.1232647593059237, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07685769550384038, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03468913880605546, "sim_compute_performance-ego": 0.062068780263264976, "sim_compute_robot_state-ego": 0.06145057224092029, "sim_compute_robot_state-npc0": 0.06617658857315306, "sim_compute_robot_state-npc1": 0.06258782129439097, "sim_compute_robot_state-npc2": 0.06086998515658908, "sim_compute_robot_state-npc3": 0.061200478720286534}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.028939490224800857, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.06201307913836311, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.1258528279323204, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07995463820064769, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03486533258475509, "sim_compute_performance-ego": 0.0622415028366388, "sim_compute_robot_state-ego": 0.06203053044337852, "sim_compute_robot_state-npc0": 0.06513074332592535, "sim_compute_robot_state-npc1": 0.0606850783030192, "sim_compute_robot_state-npc2": 0.061556283165426814, "sim_compute_robot_state-npc3": 0.062232255935668945}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.03115651684422647, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.06332955437321816, "in-drivable-lane": 0, "agent_compute-ego": 0.12953664410498836, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07829806497020106, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03522809859245054, "sim_compute_performance-ego": 0.0607585483981717, "sim_compute_robot_state-ego": 0.06128778765278478, "sim_compute_robot_state-npc0": 0.06867739077537291, "sim_compute_robot_state-npc1": 0.06263567939881355, "sim_compute_robot_state-npc2": 0.06139416463913456, "sim_compute_robot_state-npc3": 0.06137686391030588}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.03126522581628029, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06282419346748515, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.12707528154900732, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07706179010107163, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03478953686166317, "sim_compute_performance-ego": 0.06259725702569839, "sim_compute_robot_state-ego": 0.06364388922427563, "sim_compute_robot_state-npc0": 0.07137759695661829, "sim_compute_robot_state-npc1": 0.06497249197452626, "sim_compute_robot_state-npc2": 0.06410894241738826, "sim_compute_robot_state-npc3": 0.06365344879475046}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.0273474775827848, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.06653885657970722, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1247974496621352, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07778353416002713, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03538842843129085, "sim_compute_performance-ego": 0.06358582698381864, "sim_compute_robot_state-ego": 0.06249111890792847, "sim_compute_robot_state-npc0": 0.07248985767364502, "sim_compute_robot_state-npc1": 0.06602311592835647, "sim_compute_robot_state-npc2": 0.06323814850587112, "sim_compute_robot_state-npc3": 0.060709866193624645}}
set_robot_commands_max0.07995463820064769
set_robot_commands_mean0.07799114458715758
set_robot_commands_median0.07778353416002713
set_robot_commands_min0.07685769550384038
sim_compute_performance-ego_max0.06358582698381864
sim_compute_performance-ego_mean0.0622503831015185
sim_compute_performance-ego_median0.0622415028366388
sim_compute_performance-ego_min0.0607585483981717
sim_compute_robot_state-ego_max0.06364388922427563
sim_compute_robot_state-ego_mean0.06218077969385753
sim_compute_robot_state-ego_median0.06203053044337852
sim_compute_robot_state-ego_min0.06128778765278478
sim_compute_robot_state-npc0_max0.07248985767364502
sim_compute_robot_state-npc0_mean0.06877043546094293
sim_compute_robot_state-npc0_median0.06867739077537291
sim_compute_robot_state-npc0_min0.06513074332592535
sim_compute_robot_state-npc1_max0.06602311592835647
sim_compute_robot_state-npc1_mean0.06338083737982128
sim_compute_robot_state-npc1_median0.06263567939881355
sim_compute_robot_state-npc1_min0.0606850783030192
sim_compute_robot_state-npc2_max0.06410894241738826
sim_compute_robot_state-npc2_mean0.06223350477688197
sim_compute_robot_state-npc2_median0.061556283165426814
sim_compute_robot_state-npc2_min0.06086998515658908
sim_compute_robot_state-npc3_max0.06365344879475046
sim_compute_robot_state-npc3_mean0.0618345827109273
sim_compute_robot_state-npc3_median0.06137686391030588
sim_compute_robot_state-npc3_min0.060709866193624645
sim_compute_sim_state_max0.03538842843129085
sim_compute_sim_state_mean0.03499210705524303
sim_compute_sim_state_median0.03486533258475509
sim_compute_sim_state_min0.03468913880605546
sim_physics_max0.03129424746074374
sim_physics_mean0.030000591585767223
sim_physics_median0.03115651684422647
sim_physics_min0.0273474775827848
sim_render-ego_max0.06653885657970722
sim_render-ego_mean0.06312997548884271
sim_render-ego_median0.06282419346748515
sim_render-ego_min0.06094419388543992
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible
188942401Bhairav MehtaBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-116380:00:56
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188922402Victor Guerra 🇫🇷Baseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationhost-errornoidsc-rudolf-116380:01:04
Error while running [...]

stderr | Creating job18892-951325_evaluator_1      ... error
stderr | 
stderr | Creating job18892-951325_simulator_1      ... 
stderr | Creating job18892-951325_solution_1       ... 
stderr | Creating job18892-951325_scenario_maker_1 ... done
stderr | 
stderr | ERROR: for evaluator  Cannot create container for service evaluator: device or resource busy
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188772411jiang pengBaseline solution using reinforcement learningaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-116380:22:03
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188522446Nicky EichmannBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-116380:21:12
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188382467Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-116380:05:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.14897249503569168
agent_compute-ego_mean0.14133941774238706
agent_compute-ego_median0.1410793662071228
agent_compute-ego_min0.13313774150960586
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.015774146565851174, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05794273232514004, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13984628893294423, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07692927234577683, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.0376180702785276, "sim_compute_performance-ego": 0.05877102545972141, "sim_compute_robot_state-ego": 0.06057380280404721}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.01586338606747714, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.061682197180661286, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.14897249503569168, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07831253246827559, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03834481672807173, "sim_compute_performance-ego": 0.06146033243699507, "sim_compute_robot_state-ego": 0.06351068886843594}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.016729121738009983, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06493345896402995, "in-drivable-lane": 0, "agent_compute-ego": 0.14366119702657065, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07855285538567437, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04405028025309245, "sim_compute_performance-ego": 0.06349933412339952, "sim_compute_robot_state-ego": 0.06769681506686741}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.0166307936112086, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.060068165262540184, "in-drivable-lane": 0, "agent_compute-ego": 0.1410793662071228, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07914136350154877, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03973845640818278, "sim_compute_performance-ego": 0.06205794711907705, "sim_compute_robot_state-ego": 0.0644136518239975}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.016360331984127268, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06298642999985639, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13313774150960586, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07730687015196856, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.037322647431317496, "sim_compute_performance-ego": 0.05919131461311789, "sim_compute_robot_state-ego": 0.05957952667685116}}
set_robot_commands_max0.07914136350154877
set_robot_commands_mean0.07804857877064883
set_robot_commands_median0.07831253246827559
set_robot_commands_min0.07692927234577683
sim_compute_performance-ego_max0.06349933412339952
sim_compute_performance-ego_mean0.06099599075046219
sim_compute_performance-ego_median0.06146033243699507
sim_compute_performance-ego_min0.05877102545972141
sim_compute_robot_state-ego_max0.06769681506686741
sim_compute_robot_state-ego_mean0.06315489704803985
sim_compute_robot_state-ego_median0.06351068886843594
sim_compute_robot_state-ego_min0.05957952667685116
sim_compute_sim_state_max0.04405028025309245
sim_compute_sim_state_mean0.03941485421983841
sim_compute_sim_state_median0.03834481672807173
sim_compute_sim_state_min0.037322647431317496
sim_physics_max0.016729121738009983
sim_physics_mean0.016271555993334835
sim_physics_median0.016360331984127268
sim_physics_min0.015774146565851174
sim_render-ego_max0.06493345896402995
sim_render-ego_mean0.06152259674644557
sim_render-ego_median0.061682197180661286
sim_render-ego_min0.05794273232514004
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
188232499Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-116380:08:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06836971733651387
survival_time_median1.3000000000000005
deviation-center-line_median0.03776843398379538
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.27798638343811033
agent_compute-ego_mean0.25525296688079835
agent_compute-ego_median0.2680644591649373
agent_compute-ego_min0.2208705981572469
deviation-center-line_max0.04315498417541115
deviation-center-line_mean0.03557906179154956
deviation-center-line_min0.0281914229202313
deviation-heading_max0.7064059004006582
deviation-heading_mean0.6449117309748591
deviation-heading_median0.6380756693922931
deviation-heading_min0.5893420663654189
driven_any_max0.1766006993197309
driven_any_mean0.1495558832271592
driven_any_median0.1521778720824784
driven_any_min0.12445094922861956
driven_lanedir_consec_max0.07925680065459217
driven_lanedir_consec_mean0.06731771601319739
driven_lanedir_consec_min0.04923556438706456
driven_lanedir_max0.07925680065459217
driven_lanedir_mean0.06731771601319739
driven_lanedir_median0.06836971733651387
driven_lanedir_min0.04923556438706456
in-drivable-lane_max0.4500000000000004
in-drivable-lane_mean0.2500000000000002
in-drivable-lane_min0.10000000000000007
per-episodes
details{"udem1-0-0": {"driven_any": 0.1521778720824784, "sim_physics": 0.03081813225379357, "survival_time": 1.3000000000000005, "driven_lanedir": 0.07925680065459217, "sim_render-ego": 0.05550036063561073, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.2775402069091797, "deviation-heading": 0.6591970368704603, "set_robot_commands": 0.07920968532562256, "deviation-center-line": 0.03963919353784128, "driven_lanedir_consec": 0.07925680065459217, "sim_compute_sim_state": 0.033531638292165905, "sim_compute_performance-ego": 0.058186705295856185, "sim_compute_robot_state-ego": 0.058838376632103555, "sim_compute_robot_state-npc0": 0.06501591205596924, "sim_compute_robot_state-npc1": 0.0605385395196768, "sim_compute_robot_state-npc2": 0.058522316125723034, "sim_compute_robot_state-npc3": 0.06189974454733042}, "udem1-1-0": {"driven_any": 0.157602901801455, "sim_physics": 0.03048241933186849, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06163997386149367, "sim_render-ego": 0.07160038948059082, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.2318031867345174, "deviation-heading": 0.5893420663654189, "set_robot_commands": 0.08237229188283285, "deviation-center-line": 0.0281914229202313, "driven_lanedir_consec": 0.06163997386149367, "sim_compute_sim_state": 0.03600727717081706, "sim_compute_performance-ego": 0.06505271593729654, "sim_compute_robot_state-ego": 0.06482219696044922, "sim_compute_robot_state-npc0": 0.0735703468322754, "sim_compute_robot_state-npc1": 0.06797012488047281, "sim_compute_robot_state-npc2": 0.0664847453435262, "sim_compute_robot_state-npc3": 0.06416370868682861}, "udem1-2-0": {"driven_any": 0.13694699370351218, "sim_physics": 0.03174728393554688, "survival_time": 1.2500000000000004, "driven_lanedir": 0.06836971733651387, "sim_render-ego": 0.05976004600524902, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.27798638343811033, "deviation-heading": 0.7064059004006582, "set_robot_commands": 0.07714271545410156, "deviation-center-line": 0.04315498417541115, "driven_lanedir_consec": 0.06836971733651387, "sim_compute_sim_state": 0.03465091705322266, "sim_compute_performance-ego": 0.06440509796142578, "sim_compute_robot_state-ego": 0.06347810745239257, "sim_compute_robot_state-npc0": 0.06877765655517579, "sim_compute_robot_state-npc1": 0.06668352127075196, "sim_compute_robot_state-npc2": 0.062691011428833, "sim_compute_robot_state-npc3": 0.06183749198913574}, "udem1-3-0": {"driven_any": 0.12445094922861956, "sim_physics": 0.03069208065668742, "survival_time": 1.2000000000000004, "driven_lanedir": 0.04923556438706456, "sim_render-ego": 0.05961867173512777, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.2680644591649373, "deviation-heading": 0.6380756693922931, "set_robot_commands": 0.07177383701006572, "deviation-center-line": 0.029141274340468655, "driven_lanedir_consec": 0.04923556438706456, "sim_compute_sim_state": 0.03505675991376241, "sim_compute_performance-ego": 0.05862734715143839, "sim_compute_robot_state-ego": 0.06037310759226481, "sim_compute_robot_state-npc0": 0.0658717155456543, "sim_compute_robot_state-npc1": 0.06138884027798971, "sim_compute_robot_state-npc2": 0.06117692589759827, "sim_compute_robot_state-npc3": 0.06440393129984538}, "udem1-4-0": {"driven_any": 0.1766006993197309, "sim_physics": 0.02861496607462565, "survival_time": 1.5000000000000009, "driven_lanedir": 0.07808652382632264, "sim_render-ego": 0.065450119972229, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.2208705981572469, "deviation-heading": 0.6315379818454651, "set_robot_commands": 0.07642525831858317, "deviation-center-line": 0.03776843398379538, "driven_lanedir_consec": 0.07808652382632264, "sim_compute_sim_state": 0.03665005366007487, "sim_compute_performance-ego": 0.0671376625696818, "sim_compute_robot_state-ego": 0.06911837259928386, "sim_compute_robot_state-npc0": 0.07113569577534994, "sim_compute_robot_state-npc1": 0.06704533100128174, "sim_compute_robot_state-npc2": 0.06620577971140544, "sim_compute_robot_state-npc3": 0.06500744819641113}}
set_robot_commands_max0.08237229188283285
set_robot_commands_mean0.07738475759824118
set_robot_commands_median0.07714271545410156
set_robot_commands_min0.07177383701006572
sim_compute_performance-ego_max0.0671376625696818
sim_compute_performance-ego_mean0.06268190578313974
sim_compute_performance-ego_median0.06440509796142578
sim_compute_performance-ego_min0.058186705295856185
sim_compute_robot_state-ego_max0.06911837259928386
sim_compute_robot_state-ego_mean0.0633260322472988
sim_compute_robot_state-ego_median0.06347810745239257
sim_compute_robot_state-ego_min0.058838376632103555
sim_compute_robot_state-npc0_max0.0735703468322754
sim_compute_robot_state-npc0_mean0.06887426535288493
sim_compute_robot_state-npc0_median0.06877765655517579
sim_compute_robot_state-npc0_min0.06501591205596924
sim_compute_robot_state-npc1_max0.06797012488047281
sim_compute_robot_state-npc1_mean0.0647252713900346
sim_compute_robot_state-npc1_median0.06668352127075196
sim_compute_robot_state-npc1_min0.0605385395196768
sim_compute_robot_state-npc2_max0.0664847453435262
sim_compute_robot_state-npc2_mean0.06301615570141719
sim_compute_robot_state-npc2_median0.062691011428833
sim_compute_robot_state-npc2_min0.058522316125723034
sim_compute_robot_state-npc3_max0.06500744819641113
sim_compute_robot_state-npc3_mean0.06346246494391025
sim_compute_robot_state-npc3_median0.06416370868682861
sim_compute_robot_state-npc3_min0.06183749198913574
sim_compute_sim_state_max0.03665005366007487
sim_compute_sim_state_mean0.03517932921800858
sim_compute_sim_state_median0.03505675991376241
sim_compute_sim_state_min0.033531638292165905
sim_physics_max0.03174728393554688
sim_physics_mean0.0304709764505044
sim_physics_median0.03069208065668742
sim_physics_min0.02861496607462565
sim_render-ego_max0.07160038948059082
sim_render-ego_mean0.06238591756576147
sim_render-ego_median0.05976004600524902
sim_render-ego_min0.05550036063561073
simulation-passed1
survival_time_max1.5000000000000009
survival_time_mean1.3500000000000003
survival_time_min1.2000000000000004
No reset possible
188182506Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-116380:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188112511Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-116380:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188032521Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-116380:00:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
187872552Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-116380:09:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487132829419987
survival_time_median2.3499999999999996
deviation-center-line_median0.11041400208354252
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06918875070718619
agent_compute-ego_mean0.06181956842222529
agent_compute-ego_median0.06054273542467054
agent_compute-ego_min0.057889865665901
deviation-center-line_max0.1279102488429998
deviation-center-line_mean0.10518151035257096
deviation-center-line_min0.06917270915638028
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550057
deviation-heading_median0.36368201628851926
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903464
driven_any_median0.6642785413159032
driven_any_min0.3059207793076613
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.588039443394122
driven_lanedir_consec_min0.28022225990343186
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.588039443394122
driven_lanedir_median0.5487132829419987
driven_lanedir_min0.28022225990343186
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.023826639826704816, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05589841051799495, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.057889865665901, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07210917298386736, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03269986117758402, "sim_compute_performance-ego": 0.05901179662564906, "sim_compute_robot_state-ego": 0.05759542162825421, "sim_compute_robot_state-npc0": 0.06485286863838755, "sim_compute_robot_state-npc1": 0.06126711426711664, "sim_compute_robot_state-npc2": 0.05786087745573462, "sim_compute_robot_state-npc3": 0.05802254851271466}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.025462260613074668, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.0558776488670936, "in-drivable-lane": 0, "agent_compute-ego": 0.06918875070718619, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.07666613505436824, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.03564302737896259, "sim_compute_performance-ego": 0.059842861615694486, "sim_compute_robot_state-ego": 0.05880508056053749, "sim_compute_robot_state-npc0": 0.07149315797365628, "sim_compute_robot_state-npc1": 0.06446714584644024, "sim_compute_robot_state-npc2": 0.06383508902329665, "sim_compute_robot_state-npc3": 0.06322114284221943}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.02453706112313778, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.055316377193369765, "in-drivable-lane": 0, "agent_compute-ego": 0.06344468035596482, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07152129234151637, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.03221858815943941, "sim_compute_performance-ego": 0.05695934498563726, "sim_compute_robot_state-ego": 0.05942744904376091, "sim_compute_robot_state-npc0": 0.0641282670041348, "sim_compute_robot_state-npc1": 0.060146631078517185, "sim_compute_robot_state-npc2": 0.05742070522714168, "sim_compute_robot_state-npc3": 0.05940152229146754}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.025914249839363517, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.05729650665115524, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06054273542467054, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.0747242000076797, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.0340448369036664, "sim_compute_performance-ego": 0.05879196229871813, "sim_compute_robot_state-ego": 0.06071354268671392, "sim_compute_robot_state-npc0": 0.06435367301270202, "sim_compute_robot_state-npc1": 0.060080145741557026, "sim_compute_robot_state-npc2": 0.059499072504567575, "sim_compute_robot_state-npc3": 0.060087851115635464}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.02130840954027678, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.05445853032563862, "in-drivable-lane": 0, "agent_compute-ego": 0.05803180995740389, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.0719590563523142, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.030847524341784022, "sim_compute_performance-ego": 0.0612016477082905, "sim_compute_robot_state-ego": 0.05994702640332674, "sim_compute_robot_state-npc0": 0.05672780463570043, "sim_compute_robot_state-npc1": 0.05567995498054906, "sim_compute_robot_state-npc2": 0.05479109914679276, "sim_compute_robot_state-npc3": 0.053432853598343696}}
set_robot_commands_max0.07666613505436824
set_robot_commands_mean0.07339597134794917
set_robot_commands_median0.07210917298386736
set_robot_commands_min0.07152129234151637
sim_compute_performance-ego_max0.0612016477082905
sim_compute_performance-ego_mean0.059161522646797894
sim_compute_performance-ego_median0.05901179662564906
sim_compute_performance-ego_min0.05695934498563726
sim_compute_robot_state-ego_max0.06071354268671392
sim_compute_robot_state-ego_mean0.059297704064518654
sim_compute_robot_state-ego_median0.05942744904376091
sim_compute_robot_state-ego_min0.05759542162825421
sim_compute_robot_state-npc0_max0.07149315797365628
sim_compute_robot_state-npc0_mean0.06431115425291621
sim_compute_robot_state-npc0_median0.06435367301270202
sim_compute_robot_state-npc0_min0.05672780463570043
sim_compute_robot_state-npc1_max0.06446714584644024
sim_compute_robot_state-npc1_mean0.060328198382836026
sim_compute_robot_state-npc1_median0.060146631078517185
sim_compute_robot_state-npc1_min0.05567995498054906
sim_compute_robot_state-npc2_max0.06383508902329665
sim_compute_robot_state-npc2_mean0.05868136867150666
sim_compute_robot_state-npc2_median0.05786087745573462
sim_compute_robot_state-npc2_min0.05479109914679276
sim_compute_robot_state-npc3_max0.06322114284221943
sim_compute_robot_state-npc3_mean0.05883318367207616
sim_compute_robot_state-npc3_median0.05940152229146754
sim_compute_robot_state-npc3_min0.053432853598343696
sim_compute_sim_state_max0.03564302737896259
sim_compute_sim_state_mean0.03309076759228729
sim_compute_sim_state_median0.03269986117758402
sim_compute_sim_state_min0.030847524341784022
sim_physics_max0.025914249839363517
sim_physics_mean0.02420972418851151
sim_physics_median0.02453706112313778
sim_physics_min0.02130840954027678
sim_render-ego_max0.05729650665115524
sim_render-ego_mean0.05576949471105044
sim_render-ego_median0.0558776488670936
sim_render-ego_min0.05445853032563862
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
187802568Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-116380:11:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6013276121655571
survival_time_median2.2
deviation-center-line_median0.11994879786730762
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.06762077258183406
agent_compute-ego_mean0.06554516285531047
agent_compute-ego_median0.06565027169778313
agent_compute-ego_min0.06322465159676292
deviation-center-line_max0.31602167939174997
deviation-center-line_mean0.15029477661273552
deviation-center-line_min0.08465176242372947
deviation-heading_max1.298091820230251
deviation-heading_mean0.5590872679348118
deviation-heading_median0.39186075366845463
deviation-heading_min0.29133071980288444
driven_any_max1.2345099137442228
driven_any_mean0.7773148514182241
driven_any_median0.6489566174251553
driven_any_min0.47625793140583145
driven_lanedir_consec_max0.923268763707114
driven_lanedir_consec_mean0.634114415404596
driven_lanedir_consec_min0.4596280139000144
driven_lanedir_max0.923268763707114
driven_lanedir_mean0.6342515685671332
driven_lanedir_median0.6013276121655571
driven_lanedir_min0.4596280139000144
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.3599999999999987
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.03150291693838019, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.0657256000920346, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06481938864055432, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.07549076080322266, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.035929190485100994, "sim_compute_performance-ego": 0.06321299703497636, "sim_compute_robot_state-ego": 0.06268374794407895, "sim_compute_robot_state-npc0": 0.07074801294427169, "sim_compute_robot_state-npc1": 0.06636827870419151, "sim_compute_robot_state-npc2": 0.0647027843876889, "sim_compute_robot_state-npc3": 0.06635275890952662}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.02728772790808427, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.06437233247255024, "in-drivable-lane": 0, "agent_compute-ego": 0.06641072975961786, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07611740890302156, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.034880487542403374, "sim_compute_performance-ego": 0.06153900999771921, "sim_compute_robot_state-ego": 0.0603410005569458, "sim_compute_robot_state-npc0": 0.06604363416370593, "sim_compute_robot_state-npc1": 0.06145286560058594, "sim_compute_robot_state-npc2": 0.059782097214146665, "sim_compute_robot_state-npc3": 0.061923830132735405}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.0291287593352489, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06936135658851036, "in-drivable-lane": 0, "agent_compute-ego": 0.06762077258183406, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07601185334034455, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03776218340947078, "sim_compute_performance-ego": 0.06620448063581418, "sim_compute_robot_state-ego": 0.062492712950095154, "sim_compute_robot_state-npc0": 0.06979207503489959, "sim_compute_robot_state-npc1": 0.06581387764368302, "sim_compute_robot_state-npc2": 0.06747902356661283, "sim_compute_robot_state-npc3": 0.06926488265013084}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.0322327110129343, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.06508269444317885, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06565027169778313, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07597805748523122, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.037699887450312226, "sim_compute_performance-ego": 0.06514879011772048, "sim_compute_robot_state-ego": 0.06156751807306854, "sim_compute_robot_state-npc0": 0.07250172319546552, "sim_compute_robot_state-npc1": 0.06847672395303216, "sim_compute_robot_state-npc2": 0.07028174736130406, "sim_compute_robot_state-npc3": 0.06662801957466233}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.02754553339698098, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.06469830057837746, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06322465159676292, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07355924627997658, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03759160908785733, "sim_compute_performance-ego": 0.06432151794433594, "sim_compute_robot_state-ego": 0.06299070878462358, "sim_compute_robot_state-npc0": 0.07153115489266136, "sim_compute_robot_state-npc1": 0.0684486681764776, "sim_compute_robot_state-npc2": 0.06812906265258789, "sim_compute_robot_state-npc3": 0.06644667820496993}}
set_robot_commands_max0.07611740890302156
set_robot_commands_mean0.07543146536235931
set_robot_commands_median0.07597805748523122
set_robot_commands_min0.07355924627997658
sim_compute_performance-ego_max0.06620448063581418
sim_compute_performance-ego_mean0.06408535914611324
sim_compute_performance-ego_median0.06432151794433594
sim_compute_performance-ego_min0.06153900999771921
sim_compute_robot_state-ego_max0.06299070878462358
sim_compute_robot_state-ego_mean0.06201513766176241
sim_compute_robot_state-ego_median0.062492712950095154
sim_compute_robot_state-ego_min0.0603410005569458
sim_compute_robot_state-npc0_max0.07250172319546552
sim_compute_robot_state-npc0_mean0.07012332004620082
sim_compute_robot_state-npc0_median0.07074801294427169
sim_compute_robot_state-npc0_min0.06604363416370593
sim_compute_robot_state-npc1_max0.06847672395303216
sim_compute_robot_state-npc1_mean0.06611208281559404
sim_compute_robot_state-npc1_median0.06636827870419151
sim_compute_robot_state-npc1_min0.06145286560058594
sim_compute_robot_state-npc2_max0.07028174736130406
sim_compute_robot_state-npc2_mean0.06607494303646808
sim_compute_robot_state-npc2_median0.06747902356661283
sim_compute_robot_state-npc2_min0.059782097214146665
sim_compute_robot_state-npc3_max0.06926488265013084
sim_compute_robot_state-npc3_mean0.06612323389440503
sim_compute_robot_state-npc3_median0.06644667820496993
sim_compute_robot_state-npc3_min0.061923830132735405
sim_compute_sim_state_max0.03776218340947078
sim_compute_sim_state_mean0.03677267159502894
sim_compute_sim_state_median0.03759160908785733
sim_compute_sim_state_min0.034880487542403374
sim_physics_max0.0322327110129343
sim_physics_mean0.02953952971832573
sim_physics_median0.0291287593352489
sim_physics_min0.02728772790808427
sim_render-ego_max0.06936135658851036
sim_render-ego_mean0.06584805683493031
sim_render-ego_median0.06508269444317885
sim_render-ego_min0.06437233247255024
simulation-passed1
survival_time_max4.749999999999991
survival_time_mean2.8699999999999983
survival_time_min1.900000000000001
No reset possible
187292613Konstantin Chaikachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-116380:10:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6013276121655571
survival_time_median2.2
deviation-center-line_median0.11994879786730762
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.06678008361601494
agent_compute-ego_mean0.06550190091846453
agent_compute-ego_median0.06558404213342911
agent_compute-ego_min0.06389039213007147
deviation-center-line_max0.31602167939174997
deviation-center-line_mean0.15029477661273552
deviation-center-line_min0.08465176242372947
deviation-heading_max1.298091820230251
deviation-heading_mean0.5590872679348118
deviation-heading_median0.39186075366845463
deviation-heading_min0.29133071980288444
driven_any_max1.2345099137442228
driven_any_mean0.7773148514182241
driven_any_median0.6489566174251553
driven_any_min0.47625793140583145
driven_lanedir_consec_max0.923268763707114
driven_lanedir_consec_mean0.634114415404596
driven_lanedir_consec_min0.4596280139000144
driven_lanedir_max0.923268763707114
driven_lanedir_mean0.6342515685671332
driven_lanedir_median0.6013276121655571
driven_lanedir_min0.4596280139000144
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.3599999999999987
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.031827745939555924, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06390066648784437, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06517639913057026, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.07590443209597939, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03602328802409925, "sim_compute_performance-ego": 0.06254703371148361, "sim_compute_robot_state-ego": 0.06205146689164011, "sim_compute_robot_state-npc0": 0.06894830151608115, "sim_compute_robot_state-npc1": 0.06520573716414602, "sim_compute_robot_state-npc2": 0.06464936858729313, "sim_compute_robot_state-npc3": 0.06375663405970523}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.02678705516614412, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.05775025643800434, "in-drivable-lane": 0, "agent_compute-ego": 0.06607858758223684, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07943238710102282, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.0358105458711323, "sim_compute_performance-ego": 0.06053865583319413, "sim_compute_robot_state-ego": 0.056449752104909795, "sim_compute_robot_state-npc0": 0.06508725567867882, "sim_compute_robot_state-npc1": 0.06065704948023746, "sim_compute_robot_state-npc2": 0.062189804880242595, "sim_compute_robot_state-npc3": 0.06463277339935303}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.030065573178804837, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.05976175650572165, "in-drivable-lane": 0, "agent_compute-ego": 0.06558404213342911, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07513019977471767, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03506634174249111, "sim_compute_performance-ego": 0.06062645178574782, "sim_compute_robot_state-ego": 0.06413440215281951, "sim_compute_robot_state-npc0": 0.06408833846067771, "sim_compute_robot_state-npc1": 0.05970080693562826, "sim_compute_robot_state-npc2": 0.06072804255363269, "sim_compute_robot_state-npc3": 0.06258895458319248}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.03324632577493157, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.0600842254262575, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06678008361601494, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07796526291001012, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.03538831522766973, "sim_compute_performance-ego": 0.06205771674572582, "sim_compute_robot_state-ego": 0.06286453529142998, "sim_compute_robot_state-npc0": 0.06634614165400116, "sim_compute_robot_state-npc1": 0.06371318790274606, "sim_compute_robot_state-npc2": 0.06284216759910047, "sim_compute_robot_state-npc3": 0.06151071736510371}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.026113374666734177, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.06053965200077404, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06389039213007147, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07460100542415272, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03394115513021296, "sim_compute_performance-ego": 0.0598839900710366, "sim_compute_robot_state-ego": 0.06042362343181263, "sim_compute_robot_state-npc0": 0.06714778596704657, "sim_compute_robot_state-npc1": 0.0617488676851446, "sim_compute_robot_state-npc2": 0.05973728136582808, "sim_compute_robot_state-npc3": 0.060156491669741546}}
set_robot_commands_max0.07943238710102282
set_robot_commands_mean0.07660665746117654
set_robot_commands_median0.07590443209597939
set_robot_commands_min0.07460100542415272
sim_compute_performance-ego_max0.06254703371148361
sim_compute_performance-ego_mean0.0611307696294376
sim_compute_performance-ego_median0.06062645178574782
sim_compute_performance-ego_min0.0598839900710366
sim_compute_robot_state-ego_max0.06413440215281951
sim_compute_robot_state-ego_mean0.06118475597452241
sim_compute_robot_state-ego_median0.06205146689164011
sim_compute_robot_state-ego_min0.056449752104909795
sim_compute_robot_state-npc0_max0.06894830151608115
sim_compute_robot_state-npc0_mean0.06632356465529708
sim_compute_robot_state-npc0_median0.06634614165400116
sim_compute_robot_state-npc0_min0.06408833846067771
sim_compute_robot_state-npc1_max0.06520573716414602
sim_compute_robot_state-npc1_mean0.06220512983358047
sim_compute_robot_state-npc1_median0.0617488676851446
sim_compute_robot_state-npc1_min0.05970080693562826
sim_compute_robot_state-npc2_max0.06464936858729313
sim_compute_robot_state-npc2_mean0.06202933299721939
sim_compute_robot_state-npc2_median0.062189804880242595
sim_compute_robot_state-npc2_min0.05973728136582808
sim_compute_robot_state-npc3_max0.06463277339935303
sim_compute_robot_state-npc3_mean0.06252911421541921
sim_compute_robot_state-npc3_median0.06258895458319248
sim_compute_robot_state-npc3_min0.060156491669741546
sim_compute_sim_state_max0.03602328802409925
sim_compute_sim_state_mean0.03524592919912107
sim_compute_sim_state_median0.03538831522766973
sim_compute_sim_state_min0.03394115513021296
sim_physics_max0.03324632577493157
sim_physics_mean0.02960801494523412
sim_physics_median0.030065573178804837
sim_physics_min0.026113374666734177
sim_render-ego_max0.06390066648784437
sim_render-ego_mean0.060407311371720375
sim_render-ego_median0.0600842254262575
sim_render-ego_min0.05775025643800434
simulation-passed1
survival_time_max4.749999999999991
survival_time_mean2.8699999999999983
survival_time_min1.900000000000001
No reset possible
187242617Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-116380:05:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.1542948434750239
agent_compute-ego_mean0.14730647774150638
agent_compute-ego_median0.14508571949872104
agent_compute-ego_min0.1429322800546322
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.016237870702203713, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06369920946517081, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1429322800546322, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07838831757599453, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03927292913760779, "sim_compute_performance-ego": 0.06347026914920446, "sim_compute_robot_state-ego": 0.06379136499368919}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.015930257060311058, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06443128802559593, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.14508571949872104, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07692567326805809, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.04009120030836626, "sim_compute_performance-ego": 0.06411004608327692, "sim_compute_robot_state-ego": 0.06266846981915561}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.01576470798916287, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06317856046888563, "in-drivable-lane": 0, "agent_compute-ego": 0.14978970421685112, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.0773388491736518, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04019447432623969, "sim_compute_performance-ego": 0.06540916230943468, "sim_compute_robot_state-ego": 0.062086190117730033}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.01679319143295288, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.07149473329385121, "in-drivable-lane": 0, "agent_compute-ego": 0.1542948434750239, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07757502794265747, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04310393830140432, "sim_compute_performance-ego": 0.06644431749979655, "sim_compute_robot_state-ego": 0.06644187867641449}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.016639137969297522, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06297119926003848, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14442984146230362, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07670956499436322, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03948063008925494, "sim_compute_performance-ego": 0.06252922380671781, "sim_compute_robot_state-ego": 0.06313934045679429}}
set_robot_commands_max0.07838831757599453
set_robot_commands_mean0.07738748659094502
set_robot_commands_median0.0773388491736518
set_robot_commands_min0.07670956499436322
sim_compute_performance-ego_max0.06644431749979655
sim_compute_performance-ego_mean0.06439260376968609
sim_compute_performance-ego_median0.06411004608327692
sim_compute_performance-ego_min0.06252922380671781
sim_compute_robot_state-ego_max0.06644187867641449
sim_compute_robot_state-ego_mean0.06362544881275671
sim_compute_robot_state-ego_median0.06313934045679429
sim_compute_robot_state-ego_min0.062086190117730033
sim_compute_sim_state_max0.04310393830140432
sim_compute_sim_state_mean0.04042863443257459
sim_compute_sim_state_median0.04009120030836626
sim_compute_sim_state_min0.03927292913760779
sim_physics_max0.01679319143295288
sim_physics_mean0.01627303303078561
sim_physics_median0.016237870702203713
sim_physics_min0.01576470798916287
sim_render-ego_max0.07149473329385121
sim_render-ego_mean0.0651549981027084
sim_render-ego_median0.06369920946517081
sim_render-ego_min0.06297119926003848
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
187172632Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-116380:09:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14453208446502686
agent_compute-ego_mean0.14305504294695037
agent_compute-ego_median0.143854946460364
agent_compute-ego_min0.141230431470004
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.025043775450508548, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06463880359001879, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.143854946460364, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07561915775514999, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03502812475528357, "sim_compute_performance-ego": 0.0652430552356648, "sim_compute_robot_state-ego": 0.0655369668636682, "sim_compute_robot_state-npc0": 0.0699638195757596, "sim_compute_robot_state-npc1": 0.06573003642963914, "sim_compute_robot_state-npc2": 0.06430737477428508, "sim_compute_robot_state-npc3": 0.06425815258386}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.026406049728393555, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06368690729141235, "in-drivable-lane": 0, "agent_compute-ego": 0.141230431470004, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07749095288189975, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03592265735973011, "sim_compute_performance-ego": 0.061367939818989144, "sim_compute_robot_state-ego": 0.06069589203054255, "sim_compute_robot_state-npc0": 0.06861979853023183, "sim_compute_robot_state-npc1": 0.06497142531655052, "sim_compute_robot_state-npc2": 0.06358847292986783, "sim_compute_robot_state-npc3": 0.06138780984011563}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.02560234599643283, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06444304254319932, "in-drivable-lane": 0, "agent_compute-ego": 0.1441861735449897, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07760042084587945, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03459484842088487, "sim_compute_performance-ego": 0.06087349785698785, "sim_compute_robot_state-ego": 0.060432185067070855, "sim_compute_robot_state-npc0": 0.0715738508436415, "sim_compute_robot_state-npc1": 0.06339114507039388, "sim_compute_robot_state-npc2": 0.06019524998135037, "sim_compute_robot_state-npc3": 0.06193132400512695}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.027069583535194397, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06651642421881358, "in-drivable-lane": 0, "agent_compute-ego": 0.14453208446502686, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07648760577042897, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03449362019697825, "sim_compute_performance-ego": 0.06230536103248596, "sim_compute_robot_state-ego": 0.06339241067568462, "sim_compute_robot_state-npc0": 0.06812410553296407, "sim_compute_robot_state-npc1": 0.0649334192276001, "sim_compute_robot_state-npc2": 0.06313472986221313, "sim_compute_robot_state-npc3": 0.06055931746959686}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.024190531057469985, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06211167223313275, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14147157879436717, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07840217912898344, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03407834207310396, "sim_compute_performance-ego": 0.05964181002448587, "sim_compute_robot_state-ego": 0.059697999673731184, "sim_compute_robot_state-npc0": 0.06632437776116763, "sim_compute_robot_state-npc1": 0.06163717368069817, "sim_compute_robot_state-npc2": 0.060576340731452495, "sim_compute_robot_state-npc3": 0.060804630027097815}}
set_robot_commands_max0.07840217912898344
set_robot_commands_mean0.07712006327646832
set_robot_commands_median0.07749095288189975
set_robot_commands_min0.07561915775514999
sim_compute_performance-ego_max0.0652430552356648
sim_compute_performance-ego_mean0.06188633279372272
sim_compute_performance-ego_median0.061367939818989144
sim_compute_performance-ego_min0.05964181002448587
sim_compute_robot_state-ego_max0.0655369668636682
sim_compute_robot_state-ego_mean0.06195109086213948
sim_compute_robot_state-ego_median0.06069589203054255
sim_compute_robot_state-ego_min0.059697999673731184
sim_compute_robot_state-npc0_max0.0715738508436415
sim_compute_robot_state-npc0_mean0.06892119044875292
sim_compute_robot_state-npc0_median0.06861979853023183
sim_compute_robot_state-npc0_min0.06632437776116763
sim_compute_robot_state-npc1_max0.06573003642963914
sim_compute_robot_state-npc1_mean0.06413263994497635
sim_compute_robot_state-npc1_median0.0649334192276001
sim_compute_robot_state-npc1_min0.06163717368069817
sim_compute_robot_state-npc2_max0.06430737477428508
sim_compute_robot_state-npc2_mean0.06236043365583378
sim_compute_robot_state-npc2_median0.06313472986221313
sim_compute_robot_state-npc2_min0.06019524998135037
sim_compute_robot_state-npc3_max0.06425815258386
sim_compute_robot_state-npc3_mean0.06178824678515945
sim_compute_robot_state-npc3_median0.06138780984011563
sim_compute_robot_state-npc3_min0.06055931746959686
sim_compute_sim_state_max0.03592265735973011
sim_compute_sim_state_mean0.03482351856119615
sim_compute_sim_state_median0.03459484842088487
sim_compute_sim_state_min0.03407834207310396
sim_physics_max0.027069583535194397
sim_physics_mean0.025662457153599865
sim_physics_median0.02560234599643283
sim_physics_min0.024190531057469985
sim_render-ego_max0.06651642421881358
sim_render-ego_mean0.06427936997531536
sim_render-ego_median0.06444304254319932
sim_render-ego_min0.06211167223313275
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
187082645Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-116380:09:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487132829419987
survival_time_median2.3499999999999996
deviation-center-line_median0.11041400208354252
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06666575408563381
agent_compute-ego_mean0.06353571119234833
agent_compute-ego_median0.06466845103672572
agent_compute-ego_min0.06018686921972977
deviation-center-line_max0.1279102488429998
deviation-center-line_mean0.10518151035257096
deviation-center-line_min0.06917270915638028
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550057
deviation-heading_median0.36368201628851926
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903464
driven_any_median0.6642785413159032
driven_any_min0.3059207793076613
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.588039443394122
driven_lanedir_consec_min0.28022225990343186
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.588039443394122
driven_lanedir_median0.5487132829419987
driven_lanedir_min0.28022225990343186
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.02729355125892453, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.06024647049787568, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06666575408563381, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07764731674659543, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.0347401194456147, "sim_compute_performance-ego": 0.059570460784726026, "sim_compute_robot_state-ego": 0.06176506600728849, "sim_compute_robot_state-npc0": 0.06972238203374351, "sim_compute_robot_state-npc1": 0.06416400758231558, "sim_compute_robot_state-npc2": 0.062455348852204114, "sim_compute_robot_state-npc3": 0.06195851070124928}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.02512808029468243, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.05693701597360464, "in-drivable-lane": 0, "agent_compute-ego": 0.06473016738891602, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.0725001463523278, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.03297230830559364, "sim_compute_performance-ego": 0.05741989612579346, "sim_compute_robot_state-ego": 0.05859242952786959, "sim_compute_robot_state-npc0": 0.06457950518681453, "sim_compute_robot_state-npc1": 0.06309218590076153, "sim_compute_robot_state-npc2": 0.058425307273864746, "sim_compute_robot_state-npc3": 0.056588392991286054}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.02617409888734209, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.058771224732094625, "in-drivable-lane": 0, "agent_compute-ego": 0.06142731423073627, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07616095847271859, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.03358184530379924, "sim_compute_performance-ego": 0.06262356169680332, "sim_compute_robot_state-ego": 0.06281216601107983, "sim_compute_robot_state-npc0": 0.06593565737947504, "sim_compute_robot_state-npc1": 0.061139522714817776, "sim_compute_robot_state-npc2": 0.06125604852716973, "sim_compute_robot_state-npc3": 0.059975908157673286}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.028086264054853836, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06092962327894274, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06466845103672572, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07658935117197561, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.035775635268662, "sim_compute_performance-ego": 0.059684459979717545, "sim_compute_robot_state-ego": 0.06245128925030048, "sim_compute_robot_state-npc0": 0.06545062379522638, "sim_compute_robot_state-npc1": 0.06379493514260093, "sim_compute_robot_state-npc2": 0.06272083586388892, "sim_compute_robot_state-npc3": 0.06271313834976364}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.021962140735826995, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.05981447194751941, "in-drivable-lane": 0, "agent_compute-ego": 0.06018686921972977, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07274975274738513, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.03422381375965319, "sim_compute_performance-ego": 0.06089314034110621, "sim_compute_robot_state-ego": 0.06019982538725201, "sim_compute_robot_state-npc0": 0.06498730182647705, "sim_compute_robot_state-npc1": 0.06266806000157406, "sim_compute_robot_state-npc2": 0.06119916313572934, "sim_compute_robot_state-npc3": 0.06129830761959678}}
set_robot_commands_max0.07764731674659543
set_robot_commands_mean0.07512950509820052
set_robot_commands_median0.07616095847271859
set_robot_commands_min0.0725001463523278
sim_compute_performance-ego_max0.06262356169680332
sim_compute_performance-ego_mean0.06003830378562931
sim_compute_performance-ego_median0.059684459979717545
sim_compute_performance-ego_min0.05741989612579346
sim_compute_robot_state-ego_max0.06281216601107983
sim_compute_robot_state-ego_mean0.06116415523675808
sim_compute_robot_state-ego_median0.06176506600728849
sim_compute_robot_state-ego_min0.05859242952786959
sim_compute_robot_state-npc0_max0.06972238203374351
sim_compute_robot_state-npc0_mean0.0661350940443473
sim_compute_robot_state-npc0_median0.06545062379522638
sim_compute_robot_state-npc0_min0.06457950518681453
sim_compute_robot_state-npc1_max0.06416400758231558
sim_compute_robot_state-npc1_mean0.06297174226841397
sim_compute_robot_state-npc1_median0.06309218590076153
sim_compute_robot_state-npc1_min0.061139522714817776
sim_compute_robot_state-npc2_max0.06272083586388892
sim_compute_robot_state-npc2_mean0.06121134073057136
sim_compute_robot_state-npc2_median0.06125604852716973
sim_compute_robot_state-npc2_min0.058425307273864746
sim_compute_robot_state-npc3_max0.06271313834976364
sim_compute_robot_state-npc3_mean0.06050685156391381
sim_compute_robot_state-npc3_median0.06129830761959678
sim_compute_robot_state-npc3_min0.056588392991286054
sim_compute_sim_state_max0.035775635268662
sim_compute_sim_state_mean0.03425874441666456
sim_compute_sim_state_median0.03422381375965319
sim_compute_sim_state_min0.03297230830559364
sim_physics_max0.028086264054853836
sim_physics_mean0.02572882704632598
sim_physics_median0.02617409888734209
sim_physics_min0.021962140735826995
sim_render-ego_max0.06092962327894274
sim_render-ego_mean0.05933976128600742
sim_render-ego_median0.05981447194751941
sim_render-ego_min0.05693701597360464
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
187052652Egor Zamotaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-116380:13:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0739788898018283
survival_time_median8.599999999999987
deviation-center-line_median0.5029867927186854
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.06062969323751088
agent_compute-ego_mean0.05758156573314581
agent_compute-ego_median0.05680202221383854
agent_compute-ego_min0.05542554827623589
deviation-center-line_max1.0060590379238237
deviation-center-line_mean0.6740665507315736
deviation-center-line_min0.4396600304628227
deviation-heading_max6.932204486419896
deviation-heading_mean3.344530763848808
deviation-heading_median2.4641123720012934
deviation-heading_min0.7424120908962206
driven_any_max2.3044947257684885
driven_any_mean1.5289718421065746
driven_any_median1.335108330935434
driven_any_min0.7485241011900582
driven_lanedir_consec_max1.3888888470375496
driven_lanedir_consec_mean1.0847719056519594
driven_lanedir_consec_min0.7357398452719424
driven_lanedir_max1.7612229018119103
driven_lanedir_mean1.3006411236366735
driven_lanedir_median1.2392434925903448
driven_lanedir_min0.7357398452719424
in-drivable-lane_max1.1000000000000156
in-drivable-lane_mean0.40000000000000463
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3044947257684885, "sim_physics": 0.01387615917491264, "survival_time": 14.700000000000074, "driven_lanedir": 1.7612229018119103, "sim_render-ego": 0.05327443362904244, "in-drivable-lane": 0.8500000000000076, "agent_compute-ego": 0.05680202221383854, "deviation-heading": 6.932204486419896, "set_robot_commands": 0.07133813861276017, "deviation-center-line": 0.959842032973408, "driven_lanedir_consec": 0.986008453558132, "sim_compute_sim_state": 0.033582053216947176, "sim_compute_performance-ego": 0.05556918650257344, "sim_compute_robot_state-ego": 0.05676579637592342}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1144549942954485, "sim_physics": 0.01492003880468886, "survival_time": 13.450000000000056, "driven_lanedir": 1.693020488707342, "sim_render-ego": 0.05407446910900698, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.05904065100233794, "deviation-heading": 4.542653559989581, "set_robot_commands": 0.07147939852179205, "deviation-center-line": 1.0060590379238237, "driven_lanedir_consec": 1.3888888470375496, "sim_compute_sim_state": 0.034080352925013435, "sim_compute_performance-ego": 0.05562754102799086, "sim_compute_robot_state-ego": 0.0573856405166002}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7485241011900582, "sim_physics": 0.019682383296465635, "survival_time": 4.94999999999999, "driven_lanedir": 0.7357398452719424, "sim_render-ego": 0.05251995481625952, "in-drivable-lane": 0, "agent_compute-ego": 0.05600991393580581, "deviation-heading": 0.7424120908962206, "set_robot_commands": 0.07041914776118115, "deviation-center-line": 0.4396600304628227, "driven_lanedir_consec": 0.7357398452719424, "sim_compute_sim_state": 0.03463735965767292, "sim_compute_performance-ego": 0.05610401943476513, "sim_compute_robot_state-ego": 0.05692601203918457}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.335108330935434, "sim_physics": 0.01506491178690001, "survival_time": 8.599999999999987, "driven_lanedir": 1.2392434925903448, "sim_render-ego": 0.053325964960941045, "in-drivable-lane": 0, "agent_compute-ego": 0.05542554827623589, "deviation-heading": 2.4641123720012934, "set_robot_commands": 0.06882802414339642, "deviation-center-line": 0.5029867927186854, "driven_lanedir_consec": 1.2392434925903448, "sim_compute_sim_state": 0.03263368162997933, "sim_compute_performance-ego": 0.05569817021835682, "sim_compute_robot_state-ego": 0.05627451525178066}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1422770583434445, "sim_physics": 0.014858250682418412, "survival_time": 7.399999999999982, "driven_lanedir": 1.0739788898018283, "sim_render-ego": 0.05581713206059224, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.06062969323751088, "deviation-heading": 2.0412713099370494, "set_robot_commands": 0.07195180171244853, "deviation-center-line": 0.4617848595791285, "driven_lanedir_consec": 1.0739788898018283, "sim_compute_sim_state": 0.035206519268654486, "sim_compute_performance-ego": 0.05677618851532807, "sim_compute_robot_state-ego": 0.05873057648942277}}
set_robot_commands_max0.07195180171244853
set_robot_commands_mean0.07080330215031568
set_robot_commands_median0.07133813861276017
set_robot_commands_min0.06882802414339642
sim_compute_performance-ego_max0.05677618851532807
sim_compute_performance-ego_mean0.055955021139802864
sim_compute_performance-ego_median0.05569817021835682
sim_compute_performance-ego_min0.05556918650257344
sim_compute_robot_state-ego_max0.05873057648942277
sim_compute_robot_state-ego_mean0.05721650813458232
sim_compute_robot_state-ego_median0.05692601203918457
sim_compute_robot_state-ego_min0.05627451525178066
sim_compute_sim_state_max0.035206519268654486
sim_compute_sim_state_mean0.03402799333965347
sim_compute_sim_state_median0.034080352925013435
sim_compute_sim_state_min0.03263368162997933
sim_physics_max0.019682383296465635
sim_physics_mean0.01568034874907711
sim_physics_median0.01492003880468886
sim_physics_min0.01387615917491264
sim_render-ego_max0.05581713206059224
sim_render-ego_mean0.05380239091516844
sim_render-ego_median0.053325964960941045
sim_render-ego_min0.05251995481625952
simulation-passed1
survival_time_max14.700000000000074
survival_time_mean9.820000000000018
survival_time_min4.94999999999999
No reset possible
186902677Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-116380:15:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.202221592932256
survival_time_median12.850000000000048
deviation-center-line_median0.9687184240404874
in-drivable-lane_median0.6500000000000092


other stats
agent_compute-ego_max0.058077110449473064
agent_compute-ego_mean0.05716942368023559
agent_compute-ego_median0.05702131135123117
agent_compute-ego_min0.055887011477821755
deviation-center-line_max1.1622805047842808
deviation-center-line_mean0.7926806168902946
deviation-center-line_min0.2018975231970928
deviation-heading_max7.597509915025929
deviation-heading_mean4.1846881453648646
deviation-heading_median4.188708152197959
deviation-heading_min1.6110122425656916
driven_any_max2.355533545792855
driven_any_mean1.747416155800336
driven_any_median2.017983939550831
driven_any_min0.705559741016834
driven_lanedir_consec_max1.277398020304542
driven_lanedir_consec_mean1.0166512245526935
driven_lanedir_consec_min0.5789166673372881
driven_lanedir_max1.8877444229648188
driven_lanedir_mean1.345455916673204
driven_lanedir_median1.4233315360412813
driven_lanedir_min0.5789166673372881
in-drivable-lane_max2.6500000000000137
in-drivable-lane_mean1.12000000000001
in-drivable-lane_min0.20000000000000284
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.705559741016834, "sim_physics": 0.015440102627402858, "survival_time": 4.749999999999991, "driven_lanedir": 0.5789166673372881, "sim_render-ego": 0.05414762747915167, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.055887011477821755, "deviation-heading": 1.6110122425656916, "set_robot_commands": 0.07115388418498793, "deviation-center-line": 0.2018975231970928, "driven_lanedir_consec": 0.5789166673372881, "sim_compute_sim_state": 0.03292259919015985, "sim_compute_performance-ego": 0.054820620386224046, "sim_compute_robot_state-ego": 0.056159245340447674}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.017983939550831, "sim_physics": 0.014759666724891514, "survival_time": 12.850000000000048, "driven_lanedir": 1.635065364090376, "sim_render-ego": 0.05500809784529274, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.05807081270774515, "deviation-heading": 5.443387012889267, "set_robot_commands": 0.07332380458074785, "deviation-center-line": 0.9687184240404874, "driven_lanedir_consec": 1.277398020304542, "sim_compute_sim_state": 0.034370127355078314, "sim_compute_performance-ego": 0.05512257958200655, "sim_compute_robot_state-ego": 0.05747709014536342}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3550587710293147, "sim_physics": 0.01444554646809896, "survival_time": 14.950000000000076, "driven_lanedir": 1.4233315360412813, "sim_render-ego": 0.0542832358678182, "in-drivable-lane": 2.6500000000000137, "agent_compute-ego": 0.058077110449473064, "deviation-heading": 7.597509915025929, "set_robot_commands": 0.07209004243214925, "deviation-center-line": 1.1622805047842808, "driven_lanedir_consec": 0.763021216966695, "sim_compute_sim_state": 0.034221434593200685, "sim_compute_performance-ego": 0.05532984177271525, "sim_compute_robot_state-ego": 0.057204442818959554}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.355533545792855, "sim_physics": 0.014354673226674398, "survival_time": 14.950000000000076, "driven_lanedir": 1.8877444229648188, "sim_render-ego": 0.05317486763000488, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.056790872414906816, "deviation-heading": 4.188708152197959, "set_robot_commands": 0.07127537727355956, "deviation-center-line": 1.0199910570043096, "driven_lanedir_consec": 1.2616986252226878, "sim_compute_sim_state": 0.03294666051864624, "sim_compute_performance-ego": 0.05438733021418254, "sim_compute_robot_state-ego": 0.05744863986968994}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.302944781611845, "sim_physics": 0.014714409907658895, "survival_time": 8.399999999999984, "driven_lanedir": 1.202221592932256, "sim_render-ego": 0.0522862814721607, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.05702131135123117, "deviation-heading": 2.0828234041454747, "set_robot_commands": 0.07304860864366804, "deviation-center-line": 0.6105155754253027, "driven_lanedir_consec": 1.202221592932256, "sim_compute_sim_state": 0.03279346653393337, "sim_compute_performance-ego": 0.05418941378593445, "sim_compute_robot_state-ego": 0.055906502973465694}}
set_robot_commands_max0.07332380458074785
set_robot_commands_mean0.07217834342302251
set_robot_commands_median0.07209004243214925
set_robot_commands_min0.07115388418498793
sim_compute_performance-ego_max0.05532984177271525
sim_compute_performance-ego_mean0.05476995714821257
sim_compute_performance-ego_median0.054820620386224046
sim_compute_performance-ego_min0.05418941378593445
sim_compute_robot_state-ego_max0.05747709014536342
sim_compute_robot_state-ego_mean0.05683918422958525
sim_compute_robot_state-ego_median0.057204442818959554
sim_compute_robot_state-ego_min0.055906502973465694
sim_compute_sim_state_max0.034370127355078314
sim_compute_sim_state_mean0.033450857638203685
sim_compute_sim_state_median0.03294666051864624
sim_compute_sim_state_min0.03279346653393337
sim_physics_max0.015440102627402858
sim_physics_mean0.014742879790945324
sim_physics_median0.014714409907658895
sim_physics_min0.014354673226674398
sim_render-ego_max0.05500809784529274
sim_render-ego_mean0.05378002205888563
sim_render-ego_median0.05414762747915167
sim_render-ego_min0.0522862814721607
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.180000000000032
survival_time_min4.749999999999991
No reset possible
186822690Konstantin Chaikachallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-116380:11:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7245915423041689
survival_time_median7.099999999999983
deviation-center-line_median0.4021403184535915
in-drivable-lane_median1.5499999999999945


other stats
agent_compute-ego_max0.0570776681287573
agent_compute-ego_mean0.05547462230201715
agent_compute-ego_median0.05519630104662424
agent_compute-ego_min0.054654301052362145
deviation-center-line_max1.2344358790973269
deviation-center-line_mean0.5646722093014196
deviation-center-line_min0.3505746254855995
deviation-heading_max7.59410232950743
deviation-heading_mean3.226421023210308
deviation-heading_median2.1771148952065835
deviation-heading_min1.4271827836547688
driven_any_max2.3552047347054947
driven_any_mean1.2508527511850278
driven_any_median1.093945828339629
driven_any_min0.7001949419502052
driven_lanedir_consec_max1.0081134323898362
driven_lanedir_consec_mean0.6535501097926313
driven_lanedir_consec_min0.2962975489755738
driven_lanedir_max1.6199276467067425
driven_lanedir_mean0.8570736944755749
driven_lanedir_median0.7326189796444076
driven_lanedir_min0.484707708832717
in-drivable-lane_max2.6499999999999906
in-drivable-lane_mean1.2399999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8180883055133201, "sim_physics": 0.014237165451049805, "survival_time": 5.449999999999989, "driven_lanedir": 0.7694527587607143, "sim_render-ego": 0.05082101996885527, "in-drivable-lane": 0, "agent_compute-ego": 0.0570776681287573, "deviation-heading": 1.4271827836547688, "set_robot_commands": 0.06977441332755832, "deviation-center-line": 0.3505746254855995, "driven_lanedir_consec": 0.7694527587607143, "sim_compute_sim_state": 0.03158991708668, "sim_compute_performance-ego": 0.05097372816243303, "sim_compute_robot_state-ego": 0.052200050528990016}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7001949419502052, "sim_physics": 0.015494408146027596, "survival_time": 4.6499999999999915, "driven_lanedir": 0.484707708832717, "sim_render-ego": 0.053451927759314094, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.055310315983269805, "deviation-heading": 2.1771148952065835, "set_robot_commands": 0.06983629862467448, "deviation-center-line": 0.3971855416284632, "driven_lanedir_consec": 0.2962975489755738, "sim_compute_sim_state": 0.0323589591569798, "sim_compute_performance-ego": 0.055591657597531555, "sim_compute_robot_state-ego": 0.05529955894716324}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.286829945416489, "sim_physics": 0.014248174357126994, "survival_time": 8.299999999999983, "driven_lanedir": 0.7326189796444076, "sim_render-ego": 0.04991294964250312, "in-drivable-lane": 2.6499999999999906, "agent_compute-ego": 0.05519630104662424, "deviation-heading": 2.168019349914971, "set_robot_commands": 0.07099182634468539, "deviation-center-line": 0.4021403184535915, "driven_lanedir_consec": 0.7245915423041689, "sim_compute_sim_state": 0.031023292656404425, "sim_compute_performance-ego": 0.05228140267981104, "sim_compute_robot_state-ego": 0.053678745246795286}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3552047347054947, "sim_physics": 0.013411076068878171, "survival_time": 14.950000000000076, "driven_lanedir": 1.6199276467067425, "sim_render-ego": 0.04917970101038615, "in-drivable-lane": 1.5500000000000078, "agent_compute-ego": 0.055134525299072264, "deviation-heading": 7.59410232950743, "set_robot_commands": 0.07013459920883179, "deviation-center-line": 1.2344358790973269, "driven_lanedir_consec": 1.0081134323898362, "sim_compute_sim_state": 0.030124976634979247, "sim_compute_performance-ego": 0.05121788263320923, "sim_compute_robot_state-ego": 0.05310532967249552}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.093945828339629, "sim_physics": 0.014389276504516602, "survival_time": 7.099999999999983, "driven_lanedir": 0.6786613784332935, "sim_render-ego": 0.05122884058616531, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.054654301052362145, "deviation-heading": 2.76568575776779, "set_robot_commands": 0.07007467914635027, "deviation-center-line": 0.4390246818421168, "driven_lanedir_consec": 0.46929526653286313, "sim_compute_sim_state": 0.03003102121218829, "sim_compute_performance-ego": 0.05113585566131162, "sim_compute_robot_state-ego": 0.05275107605356566}}
set_robot_commands_max0.07099182634468539
set_robot_commands_mean0.07016236333042006
set_robot_commands_median0.07007467914635027
set_robot_commands_min0.06977441332755832
sim_compute_performance-ego_max0.055591657597531555
sim_compute_performance-ego_mean0.052240105346859286
sim_compute_performance-ego_median0.05121788263320923
sim_compute_performance-ego_min0.05097372816243303
sim_compute_robot_state-ego_max0.05529955894716324
sim_compute_robot_state-ego_mean0.05340695208980194
sim_compute_robot_state-ego_median0.05310532967249552
sim_compute_robot_state-ego_min0.052200050528990016
sim_compute_sim_state_max0.0323589591569798
sim_compute_sim_state_mean0.03102563334944635
sim_compute_sim_state_median0.031023292656404425
sim_compute_sim_state_min0.03003102121218829
sim_physics_max0.015494408146027596
sim_physics_mean0.014356020105519837
sim_physics_median0.014248174357126994
sim_physics_min0.013411076068878171
sim_render-ego_max0.053451927759314094
sim_render-ego_mean0.05091888779344479
sim_render-ego_median0.05082101996885527
sim_render-ego_min0.04917970101038615
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.090000000000003
survival_time_min4.6499999999999915
No reset possible
186712703Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-116380:18:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2468331909373518
survival_time_median14.950000000000076
deviation-center-line_median0.996175201578854
in-drivable-lane_median1.999999999999994


other stats
agent_compute-ego_max0.05686150232950846
agent_compute-ego_mean0.05592099807792331
agent_compute-ego_median0.05622216780980428
agent_compute-ego_min0.05484202146530151
deviation-center-line_max1.1348766289370735
deviation-center-line_mean1.004070109498398
deviation-center-line_min0.9115479883866708
deviation-heading_max6.693619510496486
deviation-heading_mean5.022917553082092
deviation-heading_median4.801251631540189
deviation-heading_min2.9913552687395817
driven_any_max2.3555078324138137
driven_any_mean2.189381583280487
driven_any_median2.344698446262583
driven_any_min1.7127604489063049
driven_lanedir_consec_max1.5995980151250346
driven_lanedir_consec_mean1.219266306980395
driven_lanedir_consec_min0.7470657890992469
driven_lanedir_max2.0675397103261206
driven_lanedir_mean1.6928269317870823
driven_lanedir_median1.6200465137329116
driven_lanedir_min1.5284777023406413
in-drivable-lane_max2.600000000000014
in-drivable-lane_mean1.460000000000004
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.344698446262583, "sim_physics": 0.013835973739624023, "survival_time": 14.950000000000076, "driven_lanedir": 1.6484727174107043, "sim_render-ego": 0.05342347462972005, "in-drivable-lane": 2.250000000000009, "agent_compute-ego": 0.05622216780980428, "deviation-heading": 5.933066860475736, "set_robot_commands": 0.07204471429189047, "deviation-center-line": 0.9981075845479958, "driven_lanedir_consec": 1.050247371007656, "sim_compute_sim_state": 0.0328763222694397, "sim_compute_performance-ego": 0.05460806290308635, "sim_compute_robot_state-ego": 0.05593577702840169}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3555078324138137, "sim_physics": 0.013293782869974772, "survival_time": 14.950000000000076, "driven_lanedir": 2.0675397103261206, "sim_render-ego": 0.05121598641077677, "in-drivable-lane": 0.4500000000000038, "agent_compute-ego": 0.05686150232950846, "deviation-heading": 4.695294494158464, "set_robot_commands": 0.07186798095703124, "deviation-center-line": 1.1348766289370735, "driven_lanedir_consec": 1.2468331909373518, "sim_compute_sim_state": 0.030727969805399578, "sim_compute_performance-ego": 0.053324162165323895, "sim_compute_robot_state-ego": 0.054041417439778645}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.1786817074148948, "sim_physics": 0.013663973618930856, "survival_time": 13.850000000000062, "driven_lanedir": 1.6200465137329116, "sim_render-ego": 0.05086827364208896, "in-drivable-lane": 1.999999999999994, "agent_compute-ego": 0.0552782659496211, "deviation-heading": 4.801251631540189, "set_robot_commands": 0.0707242815933503, "deviation-center-line": 0.9115479883866708, "driven_lanedir_consec": 1.452587168732685, "sim_compute_sim_state": 0.03108592153886595, "sim_compute_performance-ego": 0.05176795777000675, "sim_compute_robot_state-ego": 0.05400149572627209}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.355259481404839, "sim_physics": 0.01349198579788208, "survival_time": 14.950000000000076, "driven_lanedir": 1.5284777023406413, "sim_render-ego": 0.04925535758336385, "in-drivable-lane": 2.600000000000014, "agent_compute-ego": 0.05484202146530151, "deviation-heading": 6.693619510496486, "set_robot_commands": 0.06925744930903117, "deviation-center-line": 0.979643144041396, "driven_lanedir_consec": 0.7470657890992469, "sim_compute_sim_state": 0.030667672952016195, "sim_compute_performance-ego": 0.05132949352264404, "sim_compute_robot_state-ego": 0.05306491613388062}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7127604489063049, "sim_physics": 0.013885953110646984, "survival_time": 10.95000000000002, "driven_lanedir": 1.5995980151250346, "sim_render-ego": 0.04905022007145294, "in-drivable-lane": 0, "agent_compute-ego": 0.05640103283538122, "deviation-heading": 2.9913552687395817, "set_robot_commands": 0.06886413870336802, "deviation-center-line": 0.996175201578854, "driven_lanedir_consec": 1.5995980151250346, "sim_compute_sim_state": 0.03170808591799105, "sim_compute_performance-ego": 0.05133568206334223, "sim_compute_robot_state-ego": 0.05298443036536648}}
set_robot_commands_max0.07204471429189047
set_robot_commands_mean0.07055171297093424
set_robot_commands_median0.0707242815933503
set_robot_commands_min0.06886413870336802
sim_compute_performance-ego_max0.05460806290308635
sim_compute_performance-ego_mean0.052473071684880655
sim_compute_performance-ego_median0.05176795777000675
sim_compute_performance-ego_min0.05132949352264404
sim_compute_robot_state-ego_max0.05593577702840169
sim_compute_robot_state-ego_mean0.0540056073387399
sim_compute_robot_state-ego_median0.05400149572627209
sim_compute_robot_state-ego_min0.05298443036536648
sim_compute_sim_state_max0.0328763222694397
sim_compute_sim_state_mean0.0314131944967425
sim_compute_sim_state_median0.03108592153886595
sim_compute_sim_state_min0.030667672952016195
sim_physics_max0.013885953110646984
sim_physics_mean0.013634333827411744
sim_physics_median0.013663973618930856
sim_physics_min0.013293782869974772
sim_render-ego_max0.05342347462972005
sim_render-ego_mean0.05076266246748051
sim_render-ego_median0.05086827364208896
sim_render-ego_min0.04905022007145294
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.93000000000006
survival_time_min10.95000000000002
No reset possible
186632720jiang pengtest for ppoaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-116380:01:14
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186532743Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationfailednoidsc-rudolf-116380:01:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186462758Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-116380:09:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487132829419987
survival_time_median2.3499999999999996
deviation-center-line_median0.11041400208354252
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06363934592196815
agent_compute-ego_mean0.06091343108912508
agent_compute-ego_median0.061558378503677694
agent_compute-ego_min0.056179852020449755
deviation-center-line_max0.1279102488429998
deviation-center-line_mean0.10518151035257096
deviation-center-line_min0.06917270915638028
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550057
deviation-heading_median0.36368201628851926
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903464
driven_any_median0.6642785413159032
driven_any_min0.3059207793076613
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.588039443394122
driven_lanedir_consec_min0.28022225990343186
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.588039443394122
driven_lanedir_median0.5487132829419987
driven_lanedir_min0.28022225990343186
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.023146734005067407, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.050677197735484056, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.056179852020449755, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07151125117046077, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.02990689219498053, "sim_compute_performance-ego": 0.052701182481719226, "sim_compute_robot_state-ego": 0.05395401105648134, "sim_compute_robot_state-npc0": 0.05825837937796989, "sim_compute_robot_state-npc1": 0.05502150407651576, "sim_compute_robot_state-npc2": 0.05262031787779273, "sim_compute_robot_state-npc3": 0.05279031032469214}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.025036105742821328, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.05957542015955998, "in-drivable-lane": 0, "agent_compute-ego": 0.06309961355649508, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.0748215363575862, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.03304210075965294, "sim_compute_performance-ego": 0.06464120974907508, "sim_compute_robot_state-ego": 0.05713651730464055, "sim_compute_robot_state-npc0": 0.06700085676633395, "sim_compute_robot_state-npc1": 0.06475626505338229, "sim_compute_robot_state-npc2": 0.05964922904968262, "sim_compute_robot_state-npc3": 0.05595248479109544}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.02531316432547062, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.05864288959097355, "in-drivable-lane": 0, "agent_compute-ego": 0.061558378503677694, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07469177753367323, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.03171049280369535, "sim_compute_performance-ego": 0.056094960963472405, "sim_compute_robot_state-ego": 0.05813183175756576, "sim_compute_robot_state-npc0": 0.06305592110816469, "sim_compute_robot_state-npc1": 0.058177212451366665, "sim_compute_robot_state-npc2": 0.057282320996548265, "sim_compute_robot_state-npc3": 0.0573299692032185}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.02708184588086474, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.05658070595709832, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06008996544303475, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.0732728701371413, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03233654682452862, "sim_compute_performance-ego": 0.05587267089676071, "sim_compute_robot_state-ego": 0.05617251238980136, "sim_compute_robot_state-npc0": 0.06207573544848096, "sim_compute_robot_state-npc1": 0.05736076176821531, "sim_compute_robot_state-npc2": 0.05728723452641414, "sim_compute_robot_state-npc3": 0.05701261300307054}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.023904656109056975, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.06258999046526457, "in-drivable-lane": 0, "agent_compute-ego": 0.06363934592196815, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07817735797480534, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.03361960461265162, "sim_compute_performance-ego": 0.06066798536401046, "sim_compute_robot_state-ego": 0.06143110676815635, "sim_compute_robot_state-npc0": 0.0655965805053711, "sim_compute_robot_state-npc1": 0.06223324098085102, "sim_compute_robot_state-npc2": 0.06049350060914692, "sim_compute_robot_state-npc3": 0.06036299153378135}}
set_robot_commands_max0.07817735797480534
set_robot_commands_mean0.07449495863473336
set_robot_commands_median0.07469177753367323
set_robot_commands_min0.07151125117046077
sim_compute_performance-ego_max0.06464120974907508
sim_compute_performance-ego_mean0.057995601891007574
sim_compute_performance-ego_median0.056094960963472405
sim_compute_performance-ego_min0.052701182481719226
sim_compute_robot_state-ego_max0.06143110676815635
sim_compute_robot_state-ego_mean0.057365195855329065
sim_compute_robot_state-ego_median0.05713651730464055
sim_compute_robot_state-ego_min0.05395401105648134
sim_compute_robot_state-npc0_max0.06700085676633395
sim_compute_robot_state-npc0_mean0.06319749464126412
sim_compute_robot_state-npc0_median0.06305592110816469
sim_compute_robot_state-npc0_min0.05825837937796989
sim_compute_robot_state-npc1_max0.06475626505338229
sim_compute_robot_state-npc1_mean0.05950979686606621
sim_compute_robot_state-npc1_median0.058177212451366665
sim_compute_robot_state-npc1_min0.05502150407651576
sim_compute_robot_state-npc2_max0.06049350060914692
sim_compute_robot_state-npc2_mean0.05746652061191694
sim_compute_robot_state-npc2_median0.05728723452641414
sim_compute_robot_state-npc2_min0.05262031787779273
sim_compute_robot_state-npc3_max0.06036299153378135
sim_compute_robot_state-npc3_mean0.05668967377117159
sim_compute_robot_state-npc3_median0.05701261300307054
sim_compute_robot_state-npc3_min0.05279031032469214
sim_compute_sim_state_max0.03361960461265162
sim_compute_sim_state_mean0.03212312743910181
sim_compute_sim_state_median0.03233654682452862
sim_compute_sim_state_min0.02990689219498053
sim_physics_max0.02708184588086474
sim_physics_mean0.024896501212656217
sim_physics_median0.025036105742821328
sim_physics_min0.023146734005067407
sim_render-ego_max0.06258999046526457
sim_render-ego_mean0.0576132407816761
sim_render-ego_median0.05864288959097355
sim_render-ego_min0.050677197735484056
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
186422762Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-116380:10:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6013276121655571
survival_time_median2.2
deviation-center-line_median0.11994879786730762
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.061091320138228565
agent_compute-ego_mean0.0597480634807759
agent_compute-ego_median0.0602264404296875
agent_compute-ego_min0.05692092465682769
deviation-center-line_max0.31602167939174997
deviation-center-line_mean0.15029477661273552
deviation-center-line_min0.08465176242372947
deviation-heading_max1.298091820230251
deviation-heading_mean0.5590872679348118
deviation-heading_median0.39186075366845463
deviation-heading_min0.29133071980288444
driven_any_max1.2345099137442228
driven_any_mean0.7773148514182241
driven_any_median0.6489566174251553
driven_any_min0.47625793140583145
driven_lanedir_consec_max0.923268763707114
driven_lanedir_consec_mean0.634114415404596
driven_lanedir_consec_min0.4596280139000144
driven_lanedir_max0.923268763707114
driven_lanedir_mean0.6342515685671332
driven_lanedir_median0.6013276121655571
driven_lanedir_min0.4596280139000144
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.3599999999999987
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.029595658653660824, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.05728845345346551, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.061091320138228565, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.07494476719906455, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.032730278215910256, "sim_compute_performance-ego": 0.057226853621633426, "sim_compute_robot_state-ego": 0.058456669355693616, "sim_compute_robot_state-npc0": 0.06355601360923366, "sim_compute_robot_state-npc1": 0.05951621406956723, "sim_compute_robot_state-npc2": 0.05881915343435187, "sim_compute_robot_state-npc3": 0.06035320382369192}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.02486587825574373, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.0570516774528905, "in-drivable-lane": 0, "agent_compute-ego": 0.0602264404296875, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07078067252510473, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.031087825172825864, "sim_compute_performance-ego": 0.05572059279993961, "sim_compute_robot_state-ego": 0.05761448333137914, "sim_compute_robot_state-npc0": 0.0589556380322105, "sim_compute_robot_state-npc1": 0.05654141150022808, "sim_compute_robot_state-npc2": 0.05467933730075234, "sim_compute_robot_state-npc3": 0.05507915898373252}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.02747106552124023, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.058087789095365085, "in-drivable-lane": 0, "agent_compute-ego": 0.06049327972607735, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07419178424737392, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.031757776553814225, "sim_compute_performance-ego": 0.058251130275237255, "sim_compute_robot_state-ego": 0.05795474541492951, "sim_compute_robot_state-npc0": 0.05902235324566181, "sim_compute_robot_state-npc1": 0.056575402235373475, "sim_compute_robot_state-npc2": 0.05681794117658566, "sim_compute_robot_state-npc3": 0.05546712875366211}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.03020579042569013, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.05597989324113013, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.05692092465682769, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07322915171233702, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.03322472370846171, "sim_compute_performance-ego": 0.057238619092484594, "sim_compute_robot_state-ego": 0.05893098132711061, "sim_compute_robot_state-npc0": 0.06110618483852333, "sim_compute_robot_state-npc1": 0.057388594452763945, "sim_compute_robot_state-npc2": 0.0581139174985214, "sim_compute_robot_state-npc3": 0.057390505159404914}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.026241302490234375, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.056835396723313766, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06000835245305842, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07482453367926857, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03411100669340654, "sim_compute_performance-ego": 0.05826466733759099, "sim_compute_robot_state-ego": 0.05940447612242265, "sim_compute_robot_state-npc0": 0.0639811862598766, "sim_compute_robot_state-npc1": 0.060582350600849495, "sim_compute_robot_state-npc2": 0.05823834375901656, "sim_compute_robot_state-npc3": 0.05782560868696733}}
set_robot_commands_max0.07494476719906455
set_robot_commands_mean0.07359418187262975
set_robot_commands_median0.07419178424737392
set_robot_commands_min0.07078067252510473
sim_compute_performance-ego_max0.05826466733759099
sim_compute_performance-ego_mean0.05734037262537718
sim_compute_performance-ego_median0.057238619092484594
sim_compute_performance-ego_min0.05572059279993961
sim_compute_robot_state-ego_max0.05940447612242265
sim_compute_robot_state-ego_mean0.0584722711103071
sim_compute_robot_state-ego_median0.058456669355693616
sim_compute_robot_state-ego_min0.05761448333137914
sim_compute_robot_state-npc0_max0.0639811862598766
sim_compute_robot_state-npc0_mean0.06132427519710117
sim_compute_robot_state-npc0_median0.06110618483852333
sim_compute_robot_state-npc0_min0.0589556380322105
sim_compute_robot_state-npc1_max0.060582350600849495
sim_compute_robot_state-npc1_mean0.05812079457175645
sim_compute_robot_state-npc1_median0.057388594452763945
sim_compute_robot_state-npc1_min0.05654141150022808
sim_compute_robot_state-npc2_max0.05881915343435187
sim_compute_robot_state-npc2_mean0.05733373863384557
sim_compute_robot_state-npc2_median0.0581139174985214
sim_compute_robot_state-npc2_min0.05467933730075234
sim_compute_robot_state-npc3_max0.06035320382369192
sim_compute_robot_state-npc3_mean0.05722312108149176
sim_compute_robot_state-npc3_median0.057390505159404914
sim_compute_robot_state-npc3_min0.05507915898373252
sim_compute_sim_state_max0.03411100669340654
sim_compute_sim_state_mean0.032582322068883715
sim_compute_sim_state_median0.032730278215910256
sim_compute_sim_state_min0.031087825172825864
sim_physics_max0.03020579042569013
sim_physics_mean0.02767593906931386
sim_physics_median0.02747106552124023
sim_physics_min0.02486587825574373
sim_render-ego_max0.058087789095365085
sim_render-ego_mean0.05704864199323299
sim_render-ego_median0.0570516774528905
sim_render-ego_min0.05597989324113013
simulation-passed1
survival_time_max4.749999999999991
survival_time_mean2.8699999999999983
survival_time_min1.900000000000001
No reset possible
186232809Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agentaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-116380:09:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1456374851140109
agent_compute-ego_mean0.14184003924378355
agent_compute-ego_median0.14325398206710815
agent_compute-ego_min0.13534319400787354
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.023849172412224538, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.057998945128242926, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1398460640097564, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07543978151285423, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03371407400886967, "sim_compute_performance-ego": 0.05915455098422069, "sim_compute_robot_state-ego": 0.06186060185702342, "sim_compute_robot_state-npc0": 0.06813976449786492, "sim_compute_robot_state-npc1": 0.06150378821031103, "sim_compute_robot_state-npc2": 0.061078894813105744, "sim_compute_robot_state-npc3": 0.0608394370888764}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.026120109991593796, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.062236569144509056, "in-drivable-lane": 0, "agent_compute-ego": 0.1456374851140109, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.0824400620027022, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.035649326714602386, "sim_compute_performance-ego": 0.06345654617656361, "sim_compute_robot_state-ego": 0.06153868545185436, "sim_compute_robot_state-npc0": 0.07323454184965654, "sim_compute_robot_state-npc1": 0.06920222802595659, "sim_compute_robot_state-npc2": 0.06716605208136818, "sim_compute_robot_state-npc3": 0.06557473811236295}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.02640599144829644, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06568430264790853, "in-drivable-lane": 0, "agent_compute-ego": 0.14511947102016873, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07820512983534071, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03674532042609321, "sim_compute_performance-ego": 0.06213388972812229, "sim_compute_robot_state-ego": 0.0625874572330051, "sim_compute_robot_state-npc0": 0.06862522231207954, "sim_compute_robot_state-npc1": 0.06458440356784396, "sim_compute_robot_state-npc2": 0.06583353148566352, "sim_compute_robot_state-npc3": 0.06575813293457031}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.025600979725519817, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05924263099829355, "in-drivable-lane": 0, "agent_compute-ego": 0.14325398206710815, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07624829312165578, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03374780714511871, "sim_compute_performance-ego": 0.057909091313680015, "sim_compute_robot_state-ego": 0.05969159801801046, "sim_compute_robot_state-npc0": 0.06480970978736877, "sim_compute_robot_state-npc1": 0.06199916203816732, "sim_compute_robot_state-npc2": 0.060434977213541664, "sim_compute_robot_state-npc3": 0.06175321340560913}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.02527580541722915, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05862082102719475, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13534319400787354, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07689975289737477, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.0338407228974735, "sim_compute_performance-ego": 0.05878614678102381, "sim_compute_robot_state-ego": 0.06090555822148042, "sim_compute_robot_state-npc0": 0.06545153435538797, "sim_compute_robot_state-npc1": 0.06032030722674202, "sim_compute_robot_state-npc2": 0.059277362683240103, "sim_compute_robot_state-npc3": 0.06029230706831988}}
set_robot_commands_max0.0824400620027022
set_robot_commands_mean0.07784660387398554
set_robot_commands_median0.07689975289737477
set_robot_commands_min0.07543978151285423
sim_compute_performance-ego_max0.06345654617656361
sim_compute_performance-ego_mean0.06028804499672209
sim_compute_performance-ego_median0.05915455098422069
sim_compute_performance-ego_min0.057909091313680015
sim_compute_robot_state-ego_max0.0625874572330051
sim_compute_robot_state-ego_mean0.06131678015627475
sim_compute_robot_state-ego_median0.06153868545185436
sim_compute_robot_state-ego_min0.05969159801801046
sim_compute_robot_state-npc0_max0.07323454184965654
sim_compute_robot_state-npc0_mean0.06805215456047156
sim_compute_robot_state-npc0_median0.06813976449786492
sim_compute_robot_state-npc0_min0.06480970978736877
sim_compute_robot_state-npc1_max0.06920222802595659
sim_compute_robot_state-npc1_mean0.06352197781380418
sim_compute_robot_state-npc1_median0.06199916203816732
sim_compute_robot_state-npc1_min0.06032030722674202
sim_compute_robot_state-npc2_max0.06716605208136818
sim_compute_robot_state-npc2_mean0.06275816365538385
sim_compute_robot_state-npc2_median0.061078894813105744
sim_compute_robot_state-npc2_min0.059277362683240103
sim_compute_robot_state-npc3_max0.06575813293457031
sim_compute_robot_state-npc3_mean0.06284356572194774
sim_compute_robot_state-npc3_median0.06175321340560913
sim_compute_robot_state-npc3_min0.06029230706831988
sim_compute_sim_state_max0.03674532042609321
sim_compute_sim_state_mean0.034739450238431495
sim_compute_sim_state_median0.0338407228974735
sim_compute_sim_state_min0.03371407400886967
sim_physics_max0.02640599144829644
sim_physics_mean0.025450411798972748
sim_physics_median0.025600979725519817
sim_physics_min0.023849172412224538
sim_render-ego_max0.06568430264790853
sim_render-ego_mean0.060756653789229766
sim_render-ego_median0.05924263099829355
sim_render-ego_min0.057998945128242926
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
186132818Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-116380:05:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.14771231738003818
agent_compute-ego_mean0.1418463449575162
agent_compute-ego_median0.141611205206977
agent_compute-ego_min0.13788902759552002
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.01656464360794931, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06718164569926711, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13983829966131248, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07610257166736531, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.042135832444676814, "sim_compute_performance-ego": 0.06571507004072082, "sim_compute_robot_state-ego": 0.06435816243009747}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.01731484586542303, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06439564986662431, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.14771231738003818, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07654793154109608, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.04219352115284313, "sim_compute_performance-ego": 0.06439773602919145, "sim_compute_robot_state-ego": 0.06662814183668657}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.016117705239189997, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06855269538031684, "in-drivable-lane": 0, "agent_compute-ego": 0.141611205206977, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07839016384548611, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04158320426940918, "sim_compute_performance-ego": 0.06767656008402506, "sim_compute_robot_state-ego": 0.06385814878675673}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.0165230135122935, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06849759817123413, "in-drivable-lane": 0, "agent_compute-ego": 0.14218087494373322, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07648056745529175, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.04146480063597361, "sim_compute_performance-ego": 0.06790195902188619, "sim_compute_robot_state-ego": 0.06387519836425781}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.01792629326091093, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06610951353521909, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13788902759552002, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07736015670439776, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04214614279129926, "sim_compute_performance-ego": 0.06400071522768806, "sim_compute_robot_state-ego": 0.06651055812835693}}
set_robot_commands_max0.07839016384548611
set_robot_commands_mean0.07697627824272742
set_robot_commands_median0.07654793154109608
set_robot_commands_min0.07610257166736531
sim_compute_performance-ego_max0.06790195902188619
sim_compute_performance-ego_mean0.06593840808070231
sim_compute_performance-ego_median0.06571507004072082
sim_compute_performance-ego_min0.06400071522768806
sim_compute_robot_state-ego_max0.06662814183668657
sim_compute_robot_state-ego_mean0.0650460419092311
sim_compute_robot_state-ego_median0.06435816243009747
sim_compute_robot_state-ego_min0.06385814878675673
sim_compute_sim_state_max0.04219352115284313
sim_compute_sim_state_mean0.0419047002588404
sim_compute_sim_state_median0.042135832444676814
sim_compute_sim_state_min0.04146480063597361
sim_physics_max0.01792629326091093
sim_physics_mean0.016889300297153353
sim_physics_median0.01656464360794931
sim_physics_min0.016117705239189997
sim_render-ego_max0.06855269538031684
sim_render-ego_mean0.06694742053053229
sim_render-ego_median0.06718164569926711
sim_render-ego_min0.06439564986662431
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible