Duckietown Challenges Home Challenges Submissions

Evaluator 761

ID761
evaluatoridsc-rudolf-9899
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-9899
versiond-c:4.0.18;d-c-r:4.0.27;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success20 18612
# timeout
# failed2 18652
# error17 18662
# aborted4 18957
# host-error8 18978
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
191672308Andrea Censi 🇨🇭Java templateaido2-AMOD-fleet_sizestep1-simulationerroryesidsc-rudolf-98990:00:30
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
191212956Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationhost-errornoidsc-rudolf-98990:20:32
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2956/step1-simulation-idsc-rudolf-9899-job19121/tmp/tmpp8ytr6d2/attempts/ETHZ_autolab_technical_track-4-0.attempt4/drawing.html']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
191062933Bhairav MehtaBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-98990:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190972925Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-98990:08:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08756587818501371
survival_time_median1.3500000000000003
deviation-center-line_median0.040804333999969855
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.4442277806145804
agent_compute-ego_mean0.31422224303693075
agent_compute-ego_median0.3319361209869385
agent_compute-ego_min0.20975758411266185
deviation-center-line_max0.04726835489163604
deviation-center-line_mean0.04132912259693171
deviation-center-line_min0.03471606058589435
deviation-heading_max0.6710101374726185
deviation-heading_mean0.6539239214567523
deviation-heading_median0.6541089039577742
deviation-heading_min0.6379791554824507
driven_any_max0.17778105511334658
driven_any_mean0.16404325401973213
driven_any_median0.15898687271587955
driven_any_min0.15611879208260526
driven_lanedir_consec_max0.1168468867470529
driven_lanedir_consec_mean0.08835312571163363
driven_lanedir_consec_min0.06890026029445395
driven_lanedir_max0.1168468867470529
driven_lanedir_mean0.08835312571163363
driven_lanedir_median0.08756587818501371
driven_lanedir_min0.06890026029445395
in-drivable-lane_max0.4000000000000003
in-drivable-lane_mean0.20000000000000015
in-drivable-lane_min0.10000000000000007
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.17778105511334658, "sim_physics": 0.02740518535886492, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1168468867470529, "sim_render-ego": 0.05650137151990618, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.4442277806145804, "deviation-heading": 0.6379791554824507, "set_robot_commands": 0.07512170927865165, "deviation-center-line": 0.04726835489163604, "driven_lanedir_consec": 0.1168468867470529, "sim_compute_sim_state": 0.03440427780151367, "sim_compute_performance-ego": 0.058228296892983575, "sim_compute_robot_state-ego": 0.05945022617067609, "sim_compute_robot_state-npc0": 0.05892638649259295, "sim_compute_robot_state-npc1": 0.05581423214503697, "sim_compute_robot_state-npc2": 0.05878804411206927, "sim_compute_robot_state-npc3": 0.06098087344850813}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.15872641337425564, "sim_physics": 0.02442538261413574, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08756587818501371, "sim_render-ego": 0.053121700286865234, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.3319361209869385, "deviation-heading": 0.6516177477631554, "set_robot_commands": 0.07628643035888671, "deviation-center-line": 0.040804333999969855, "driven_lanedir_consec": 0.08756587818501371, "sim_compute_sim_state": 0.03431594848632812, "sim_compute_performance-ego": 0.058928089141845705, "sim_compute_robot_state-ego": 0.058184213638305664, "sim_compute_robot_state-npc0": 0.061210317611694334, "sim_compute_robot_state-npc1": 0.0628818416595459, "sim_compute_robot_state-npc2": 0.05787424087524414, "sim_compute_robot_state-npc3": 0.057689208984375}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15898687271587955, "sim_physics": 0.025356421103844277, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09847984851057624, "sim_render-ego": 0.06183763650747446, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.3441139276211078, "deviation-heading": 0.6710101374726185, "set_robot_commands": 0.07484114170074463, "deviation-center-line": 0.046746263227429, "driven_lanedir_consec": 0.09847984851057624, "sim_compute_sim_state": 0.0345833760041457, "sim_compute_performance-ego": 0.06138501717494084, "sim_compute_robot_state-ego": 0.06085088619819054, "sim_compute_robot_state-npc0": 0.0670935924236591, "sim_compute_robot_state-npc1": 0.06210009868328388, "sim_compute_robot_state-npc2": 0.0624089057628925, "sim_compute_robot_state-npc3": 0.061622170301584095}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16860313681257355, "sim_physics": 0.02748725414276123, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06997275482107135, "sim_render-ego": 0.05686391989390056, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.2410758018493652, "deviation-heading": 0.6549036626077624, "set_robot_commands": 0.07906699975331624, "deviation-center-line": 0.037110600279729275, "driven_lanedir_consec": 0.06997275482107135, "sim_compute_sim_state": 0.034505399068196614, "sim_compute_performance-ego": 0.05944735209147135, "sim_compute_robot_state-ego": 0.06320199966430665, "sim_compute_robot_state-npc0": 0.06854791641235351, "sim_compute_robot_state-npc1": 0.06456669171651204, "sim_compute_robot_state-npc2": 0.06325709025065104, "sim_compute_robot_state-npc3": 0.06195656458536784}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15611879208260526, "sim_physics": 0.024673567877875432, "survival_time": 1.3500000000000003, "driven_lanedir": 0.06890026029445395, "sim_render-ego": 0.06255873044331868, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.20975758411266185, "deviation-heading": 0.6541089039577742, "set_robot_commands": 0.07829369439019097, "deviation-center-line": 0.03471606058589435, "driven_lanedir_consec": 0.06890026029445395, "sim_compute_sim_state": 0.03590032789442274, "sim_compute_performance-ego": 0.06142980964095504, "sim_compute_robot_state-ego": 0.06435544402511031, "sim_compute_robot_state-npc0": 0.06672393834149395, "sim_compute_robot_state-npc1": 0.06315775270815249, "sim_compute_robot_state-npc2": 0.06906942084983543, "sim_compute_robot_state-npc3": 0.06651149855719672}}
set_robot_commands_max0.07906699975331624
set_robot_commands_mean0.07672199509635805
set_robot_commands_median0.07628643035888671
set_robot_commands_min0.07484114170074463
sim_compute_performance-ego_max0.06142980964095504
sim_compute_performance-ego_mean0.05988371298843931
sim_compute_performance-ego_median0.05944735209147135
sim_compute_performance-ego_min0.058228296892983575
sim_compute_robot_state-ego_max0.06435544402511031
sim_compute_robot_state-ego_mean0.06120855393931786
sim_compute_robot_state-ego_median0.06085088619819054
sim_compute_robot_state-ego_min0.058184213638305664
sim_compute_robot_state-npc0_max0.06854791641235351
sim_compute_robot_state-npc0_mean0.06450043025635877
sim_compute_robot_state-npc0_median0.06672393834149395
sim_compute_robot_state-npc0_min0.05892638649259295
sim_compute_robot_state-npc1_max0.06456669171651204
sim_compute_robot_state-npc1_mean0.06170412338250625
sim_compute_robot_state-npc1_median0.0628818416595459
sim_compute_robot_state-npc1_min0.05581423214503697
sim_compute_robot_state-npc2_max0.06906942084983543
sim_compute_robot_state-npc2_mean0.06227954037013848
sim_compute_robot_state-npc2_median0.0624089057628925
sim_compute_robot_state-npc2_min0.05787424087524414
sim_compute_robot_state-npc3_max0.06651149855719672
sim_compute_robot_state-npc3_mean0.06175206317540636
sim_compute_robot_state-npc3_median0.061622170301584095
sim_compute_robot_state-npc3_min0.057689208984375
sim_compute_sim_state_max0.03590032789442274
sim_compute_sim_state_mean0.03474186585092137
sim_compute_sim_state_median0.034505399068196614
sim_compute_sim_state_min0.03431594848632812
sim_physics_max0.02748725414276123
sim_physics_mean0.025869562219496323
sim_physics_median0.025356421103844277
sim_physics_min0.02442538261413574
sim_render-ego_max0.06255873044331868
sim_render-ego_mean0.05817667173029302
sim_render-ego_median0.05686391989390056
sim_render-ego_min0.053121700286865234
simulation-passed1
survival_time_max1.5000000000000009
survival_time_mean1.3600000000000008
survival_time_min1.2500000000000004
No reset possible
190762916Claudio RuchPython templateaido2-AMOD-efficiencystep1-simulationabortednoidsc-rudolf-98990:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190752917Claudio RuchPython templateaido2-AMOD-service_qualitystep1-simulationabortednoidsc-rudolf-98990:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190502915Claudio RuchPython templateaido2-AMOD-service_qualitystep1-simulationhost-errornoidsc-rudolf-98990:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190482914Claudio RuchPython templateaido2-AMOD-efficiencystep1-simulationhost-errornoidsc-rudolf-98990:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190332903Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-testingstep1-simulationhost-errornoidsc-rudolf-98990:20:34
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2903/step1-simulation-idsc-rudolf-9899-job19033/tmp/tmp02kkvupv/attempts/ETHZ_autolab_technical_track-3-0.attempt3/log.gs2.cbor.tmp']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190252895Masaya Kambara 🇯🇵PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-98990:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.09970570646835288
error_L20.015964147208371793


No reset possible
190232893Peter Almasi 🇭🇺Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-98990:15:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6821745596987041
survival_time_median9.149999999999997
deviation-center-line_median0.3189450250887953
in-drivable-lane_median1.8000000000000034


other stats
agent_compute-ego_max0.1809330523551047
agent_compute-ego_mean0.17661286973379503
agent_compute-ego_median0.1783549016942092
agent_compute-ego_min0.16826583782831828
deviation-center-line_max0.8579640591589709
deviation-center-line_mean0.4552662936067183
deviation-center-line_min0.16296114041842033
deviation-heading_max7.148023409956541
deviation-heading_mean3.5281733293044275
deviation-heading_median1.939058863868817
deviation-heading_min0.6216279031730237
driven_any_max1.8750436345598749
driven_any_mean1.3315309180217094
driven_any_median1.496528984773467
driven_any_min0.7156061516804972
driven_lanedir_consec_max0.7776793545809837
driven_lanedir_consec_mean0.6002314121204944
driven_lanedir_consec_min0.3811584691058997
driven_lanedir_max1.4560876015890285
driven_lanedir_mean0.8681760761909615
driven_lanedir_median0.7776793545809837
driven_lanedir_min0.4231503445518876
in-drivable-lane_max4.400000000000004
in-drivable-lane_mean2.250000000000001
in-drivable-lane_min1.1999999999999955
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.852242080269711, "sim_physics": 0.016680901845296223, "survival_time": 14.950000000000076, "driven_lanedir": 1.2208178058691035, "sim_render-ego": 0.07547480662663777, "in-drivable-lane": 2.500000000000005, "agent_compute-ego": 0.1796970852216085, "deviation-heading": 7.148023409956541, "set_robot_commands": 0.08046995083491007, "deviation-center-line": 0.642531223833879, "driven_lanedir_consec": 0.6821745596987041, "sim_compute_sim_state": 0.04548096021016439, "sim_compute_performance-ego": 0.07565390984217325, "sim_compute_robot_state-ego": 0.06902593056360881}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7182337388249969, "sim_physics": 0.018346339732677013, "survival_time": 5.549999999999988, "driven_lanedir": 0.4631452743638035, "sim_render-ego": 0.07790862332593214, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1809330523551047, "deviation-heading": 1.939058863868817, "set_robot_commands": 0.08057101138003238, "deviation-center-line": 0.29393001953352543, "driven_lanedir_consec": 0.3811584691058997, "sim_compute_sim_state": 0.047006177472638654, "sim_compute_performance-ego": 0.0779082474407849, "sim_compute_robot_state-ego": 0.06989494315138808}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.8750436345598749, "sim_physics": 0.016497673988342284, "survival_time": 14.950000000000076, "driven_lanedir": 1.4560876015890285, "sim_render-ego": 0.07011709372202556, "in-drivable-lane": 1.8000000000000034, "agent_compute-ego": 0.16826583782831828, "deviation-heading": 6.093146567038955, "set_robot_commands": 0.07811492522557577, "deviation-center-line": 0.8579640591589709, "driven_lanedir_consec": 0.7596139045535271, "sim_compute_sim_state": 0.04572750806808472, "sim_compute_performance-ego": 0.07023990790049235, "sim_compute_robot_state-ego": 0.06871686935424805}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7156061516804972, "sim_physics": 0.01795041561126709, "survival_time": 5.09999999999999, "driven_lanedir": 0.4231503445518876, "sim_render-ego": 0.06580835230210248, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.17581347156973445, "deviation-heading": 1.8390099024848023, "set_robot_commands": 0.0810468781228159, "deviation-center-line": 0.16296114041842033, "driven_lanedir_consec": 0.4005307726633576, "sim_compute_sim_state": 0.04591674664441277, "sim_compute_performance-ego": 0.06810106716903985, "sim_compute_robot_state-ego": 0.070038262535544}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.496528984773467, "sim_physics": 0.01852421682389056, "survival_time": 9.149999999999997, "driven_lanedir": 0.7776793545809837, "sim_render-ego": 0.06462785064196977, "in-drivable-lane": 4.400000000000004, "agent_compute-ego": 0.1783549016942092, "deviation-heading": 0.6216279031730237, "set_robot_commands": 0.08090638462963, "deviation-center-line": 0.3189450250887953, "driven_lanedir_consec": 0.7776793545809837, "sim_compute_sim_state": 0.04670750378259544, "sim_compute_performance-ego": 0.06623302652536193, "sim_compute_robot_state-ego": 0.06989063851820315}}
set_robot_commands_max0.0810468781228159
set_robot_commands_mean0.08022183003859283
set_robot_commands_median0.08057101138003238
set_robot_commands_min0.07811492522557577
sim_compute_performance-ego_max0.0779082474407849
sim_compute_performance-ego_mean0.07162723177557045
sim_compute_performance-ego_median0.07023990790049235
sim_compute_performance-ego_min0.06623302652536193
sim_compute_robot_state-ego_max0.070038262535544
sim_compute_robot_state-ego_mean0.06951332882459842
sim_compute_robot_state-ego_median0.06989063851820315
sim_compute_robot_state-ego_min0.06871686935424805
sim_compute_sim_state_max0.047006177472638654
sim_compute_sim_state_mean0.046167779235579194
sim_compute_sim_state_median0.04591674664441277
sim_compute_sim_state_min0.04548096021016439
sim_physics_max0.01852421682389056
sim_physics_mean0.017599909600294637
sim_physics_median0.01795041561126709
sim_physics_min0.016497673988342284
sim_render-ego_max0.07790862332593214
sim_render-ego_mean0.07078734532373354
sim_render-ego_median0.07011709372202556
sim_render-ego_min0.06462785064196977
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.940000000000026
survival_time_min5.09999999999999
No reset possible
190192892Diego Charrez 🇵🇪Python templateaido2-AMOD-service_qualitystep1-simulationhost-errornoidsc-rudolf-98990:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
190002891Diego Charrez 🇵🇪Python templateaido2-AMOD-efficiencystep1-simulationhost-errornoidsc-rudolf-98990:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189812889Diego Charrez 🇵🇪Python templateaido2-AMOD-efficiencystep1-simulationhost-errornoidsc-rudolf-98990:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189782890Diego Charrez 🇵🇪Python templateaido2-AMOD-service_qualitystep1-simulationhost-errornoidsc-rudolf-98990:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189612890Diego Charrez 🇵🇪Python templateaido2-AMOD-service_qualitystep1-simulationabortednoidsc-rudolf-98990:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189572889Diego Charrez 🇵🇪Python templateaido2-AMOD-efficiencystep1-simulationabortednoidsc-rudolf-98990:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 422, in get_cr
    raise ValueError(msg)
ValueError: Invalid timeout None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189342876Andrea Daniele 🇮🇹minimal_agent (Python 3)aido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-98990:15:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.225306900765771
survival_time_median10.750000000000018
deviation-center-line_median0.40864173779456053
in-drivable-lane_median1.7000000000000242


other stats
agent_compute-ego_max0.1583910806335672
agent_compute-ego_mean0.15453825161856485
agent_compute-ego_median0.1557643790896848
agent_compute-ego_min0.1483111580212911
deviation-center-line_max0.6491801892887803
deviation-center-line_mean0.3683230725655418
deviation-center-line_min0.1475671628461062
deviation-heading_max2.2060076411946548
deviation-heading_mean1.4163758252990906
deviation-heading_median1.5250264276913703
deviation-heading_min0.6970592634293067
driven_any_max1.6057043265958648
driven_any_mean1.3484469345214642
driven_any_median1.5756972277649912
driven_any_min0.9900494571900692
driven_lanedir_consec_max1.4904214722299334
driven_lanedir_consec_mean1.0721437270256324
driven_lanedir_consec_min0.6474115509746436
driven_lanedir_max1.4904214722299334
driven_lanedir_mean1.0721437270256324
driven_lanedir_median1.225306900765771
driven_lanedir_min0.6474115509746436
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.4300000000000082
in-drivable-lane_min0.25000000000000355
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.016390640958607625, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.0624867360368907, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1557643790896848, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.07909732070758188, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.04193499105439769, "sim_compute_performance-ego": 0.06275231718159408, "sim_compute_robot_state-ego": 0.06501667619609147}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900494571900692, "sim_physics": 0.01580345021547192, "survival_time": 6.849999999999984, "driven_lanedir": 0.764431461654983, "sim_render-ego": 0.0662379125609015, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1583910806335672, "deviation-heading": 0.6970592634293067, "set_robot_commands": 0.07884813051154144, "deviation-center-line": 0.21999312889725264, "driven_lanedir_consec": 0.764431461654983, "sim_compute_sim_state": 0.043288413625564015, "sim_compute_performance-ego": 0.06526960943737169, "sim_compute_robot_state-ego": 0.06520792863664836}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6057043265958648, "sim_physics": 0.01609526407558287, "survival_time": 11.150000000000023, "driven_lanedir": 1.4904214722299334, "sim_render-ego": 0.0662527811366881, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.15645016041571785, "deviation-heading": 2.2060076411946548, "set_robot_commands": 0.0799028916209268, "deviation-center-line": 0.6491801892887803, "driven_lanedir_consec": 1.4904214722299334, "sim_compute_sim_state": 0.04277685191064672, "sim_compute_performance-ego": 0.06540566281887449, "sim_compute_robot_state-ego": 0.06601570539944909}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5770378848298965, "sim_physics": 0.015975724819094636, "survival_time": 10.750000000000018, "driven_lanedir": 1.225306900765771, "sim_render-ego": 0.06535336472267328, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.15377447993256324, "deviation-heading": 1.8264323848694184, "set_robot_commands": 0.07784030603808026, "deviation-center-line": 0.40864173779456053, "driven_lanedir_consec": 1.225306900765771, "sim_compute_sim_state": 0.042397872791733855, "sim_compute_performance-ego": 0.06550652370896451, "sim_compute_robot_state-ego": 0.06500223514645599}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5756972277649912, "sim_physics": 0.016366123049347488, "survival_time": 10.800000000000018, "driven_lanedir": 1.233147249502831, "sim_render-ego": 0.06512105023419415, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.1483111580212911, "deviation-heading": 1.5250264276913703, "set_robot_commands": 0.07768837610880534, "deviation-center-line": 0.4162331440010094, "driven_lanedir_consec": 1.233147249502831, "sim_compute_sim_state": 0.04243336562757139, "sim_compute_performance-ego": 0.06541300592599092, "sim_compute_robot_state-ego": 0.06609175271458095}}
set_robot_commands_max0.0799028916209268
set_robot_commands_mean0.07867540499738715
set_robot_commands_median0.07884813051154144
set_robot_commands_min0.07768837610880534
sim_compute_performance-ego_max0.06550652370896451
sim_compute_performance-ego_mean0.06486942381455915
sim_compute_performance-ego_median0.06540566281887449
sim_compute_performance-ego_min0.06275231718159408
sim_compute_robot_state-ego_max0.06609175271458095
sim_compute_robot_state-ego_mean0.06546685961864518
sim_compute_robot_state-ego_median0.06520792863664836
sim_compute_robot_state-ego_min0.06500223514645599
sim_compute_sim_state_max0.043288413625564015
sim_compute_sim_state_mean0.042566299001982735
sim_compute_sim_state_median0.04243336562757139
sim_compute_sim_state_min0.04193499105439769
sim_physics_max0.016390640958607625
sim_physics_mean0.01612624062362091
sim_physics_median0.01609526407558287
sim_physics_min0.01580345021547192
sim_render-ego_max0.0662527811366881
sim_render-ego_mean0.06509036893826954
sim_render-ego_median0.06535336472267328
sim_render-ego_min0.0624867360368907
simulation-passed1
survival_time_max11.150000000000023
survival_time_mean9.300000000000004
survival_time_min6.849999999999984
No reset possible
189182372Liam Paull 🇨🇦minimal_agent (Python 3)aido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-98990:21:07
Waited 1203 seconds [...]
Waited 1203 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
189062385Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-98990:06:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07195240880386056
survival_time_median1.2500000000000004
deviation-center-line_median0.03664916542585176
in-drivable-lane_median0.20000000000000015


other stats
agent_compute-ego_max0.26571423074473505
agent_compute-ego_mean0.23213946069914204
agent_compute-ego_median0.2157649795214335
agent_compute-ego_min0.208281370309683
deviation-center-line_max0.038333120350922574
deviation-center-line_mean0.035596714464072664
deviation-center-line_min0.030809029055809223
deviation-heading_max0.672270895023468
deviation-heading_mean0.6154781735465913
deviation-heading_median0.6049727633299206
deviation-heading_min0.5826374562965739
driven_any_max0.17630653332794097
driven_any_mean0.1531122726182274
driven_any_median0.14762193810337443
driven_any_min0.14008808830820463
driven_lanedir_consec_max0.08273714245405239
driven_lanedir_consec_mean0.0745518129366953
driven_lanedir_consec_min0.07101230000586778
driven_lanedir_max0.08273714245405239
driven_lanedir_mean0.0745518129366953
driven_lanedir_median0.07195240880386056
driven_lanedir_min0.07101230000586778
in-drivable-lane_max0.3500000000000003
in-drivable-lane_mean0.20000000000000015
in-drivable-lane_min0.10000000000000007
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.14493525505264662, "sim_physics": 0.026274114847183228, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07102234999560286, "sim_render-ego": 0.06229451298713684, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.2157649795214335, "deviation-heading": 0.672270895023468, "set_robot_commands": 0.07423102855682373, "deviation-center-line": 0.03831755902693093, "driven_lanedir_consec": 0.07102234999560286, "sim_compute_sim_state": 0.03403635819753011, "sim_compute_performance-ego": 0.05774342020352682, "sim_compute_robot_state-ego": 0.06252582867940266, "sim_compute_robot_state-npc0": 0.06641977032025655, "sim_compute_robot_state-npc1": 0.06515374779701233, "sim_compute_robot_state-npc2": 0.06537677844365437, "sim_compute_robot_state-npc3": 0.06092334787050883}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.14008808830820463, "sim_physics": 0.02394599499909774, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07195240880386056, "sim_render-ego": 0.06102020844169285, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.26571423074473505, "deviation-heading": 0.6049727633299206, "set_robot_commands": 0.0795812814132027, "deviation-center-line": 0.03664916542585176, "driven_lanedir_consec": 0.07195240880386056, "sim_compute_sim_state": 0.03340985464013141, "sim_compute_performance-ego": 0.062299375948698624, "sim_compute_robot_state-ego": 0.06279457133749257, "sim_compute_robot_state-npc0": 0.06416647330574367, "sim_compute_robot_state-npc1": 0.059956395107766854, "sim_compute_robot_state-npc2": 0.05843606202498726, "sim_compute_robot_state-npc3": 0.05860543251037598}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14762193810337443, "sim_physics": 0.024266347885131836, "survival_time": 1.2500000000000004, "driven_lanedir": 0.07101230000586778, "sim_render-ego": 0.059189128875732425, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.256357946395874, "deviation-heading": 0.5826374562965739, "set_robot_commands": 0.07808987617492676, "deviation-center-line": 0.030809029055809223, "driven_lanedir_consec": 0.07101230000586778, "sim_compute_sim_state": 0.03341766357421875, "sim_compute_performance-ego": 0.05898492813110352, "sim_compute_robot_state-ego": 0.05810921669006348, "sim_compute_robot_state-npc0": 0.06797543525695801, "sim_compute_robot_state-npc1": 0.05903142929077149, "sim_compute_robot_state-npc2": 0.06200569152832031, "sim_compute_robot_state-npc3": 0.06216041564941406}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17630653332794097, "sim_physics": 0.025841301885144465, "survival_time": 1.4500000000000006, "driven_lanedir": 0.08273714245405239, "sim_render-ego": 0.06048986007427347, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.21457877652398472, "deviation-heading": 0.6298536873929027, "set_robot_commands": 0.07457502134915056, "deviation-center-line": 0.038333120350922574, "driven_lanedir_consec": 0.08273714245405239, "sim_compute_sim_state": 0.034844784901059904, "sim_compute_performance-ego": 0.06123093078876364, "sim_compute_robot_state-ego": 0.062407518255299534, "sim_compute_robot_state-npc0": 0.06751965654307399, "sim_compute_robot_state-npc1": 0.06165865371967184, "sim_compute_robot_state-npc2": 0.061932991290914605, "sim_compute_robot_state-npc3": 0.06819454554853768}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1566095482989703, "sim_physics": 0.02154262249286358, "survival_time": 1.3000000000000005, "driven_lanedir": 0.07603486342409294, "sim_render-ego": 0.058373332023620605, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.208281370309683, "deviation-heading": 0.587656065690091, "set_robot_commands": 0.07805309845851018, "deviation-center-line": 0.03387469846084885, "driven_lanedir_consec": 0.07603486342409294, "sim_compute_sim_state": 0.03257798231565035, "sim_compute_performance-ego": 0.06014030713301439, "sim_compute_robot_state-ego": 0.06077400537637564, "sim_compute_robot_state-npc0": 0.06823265552520752, "sim_compute_robot_state-npc1": 0.06336265343886155, "sim_compute_robot_state-npc2": 0.06329990350283109, "sim_compute_robot_state-npc3": 0.06012785434722901}}
set_robot_commands_max0.0795812814132027
set_robot_commands_mean0.07690606119052278
set_robot_commands_median0.07805309845851018
set_robot_commands_min0.07423102855682373
sim_compute_performance-ego_max0.062299375948698624
sim_compute_performance-ego_mean0.06007979244102139
sim_compute_performance-ego_median0.06014030713301439
sim_compute_performance-ego_min0.05774342020352682
sim_compute_robot_state-ego_max0.06279457133749257
sim_compute_robot_state-ego_mean0.06132222806772677
sim_compute_robot_state-ego_median0.062407518255299534
sim_compute_robot_state-ego_min0.05810921669006348
sim_compute_robot_state-npc0_max0.06823265552520752
sim_compute_robot_state-npc0_mean0.06686279819024794
sim_compute_robot_state-npc0_median0.06751965654307399
sim_compute_robot_state-npc0_min0.06416647330574367
sim_compute_robot_state-npc1_max0.06515374779701233
sim_compute_robot_state-npc1_mean0.06183257587081681
sim_compute_robot_state-npc1_median0.06165865371967184
sim_compute_robot_state-npc1_min0.05903142929077149
sim_compute_robot_state-npc2_max0.06537677844365437
sim_compute_robot_state-npc2_mean0.06221028535814153
sim_compute_robot_state-npc2_median0.06200569152832031
sim_compute_robot_state-npc2_min0.05843606202498726
sim_compute_robot_state-npc3_max0.06819454554853768
sim_compute_robot_state-npc3_mean0.06200231918521311
sim_compute_robot_state-npc3_median0.06092334787050883
sim_compute_robot_state-npc3_min0.05860543251037598
sim_compute_sim_state_max0.034844784901059904
sim_compute_sim_state_mean0.033657328725718104
sim_compute_sim_state_median0.03341766357421875
sim_compute_sim_state_min0.03257798231565035
sim_physics_max0.026274114847183228
sim_physics_mean0.024374076421884168
sim_physics_median0.024266347885131836
sim_physics_min0.02154262249286358
sim_render-ego_max0.06229451298713684
sim_render-ego_mean0.060273408480491245
sim_render-ego_median0.06048986007427347
sim_render-ego_min0.058373332023620605
simulation-passed1
survival_time_max1.4500000000000006
survival_time_mean1.2700000000000005
survival_time_min1.1500000000000004
No reset possible
188982396Liam Paull 🇨🇦random_agentaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-98990:09:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9097625228344608
survival_time_median2.3999999999999995
deviation-center-line_median0.09850417100304978
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1304977115462808
agent_compute-ego_mean0.12803064760373278
agent_compute-ego_median0.12760007878144583
agent_compute-ego_min0.1261521150481026
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10656223356403702
deviation-center-line_min0.07952733817751276
deviation-heading_max0.26115230540596424
deviation-heading_mean0.23093022559873316
deviation-heading_median0.23417405060778035
deviation-heading_min0.1984807025035913
driven_any_max1.4367438864906794
driven_any_mean1.0309070915612302
driven_any_median0.9157141892899948
driven_any_min0.8462726558162903
driven_lanedir_consec_max0.9542194653539162
driven_lanedir_consec_mean0.8288426551719738
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542194653539162
driven_lanedir_mean0.8288426551719738
driven_lanedir_median0.9097625228344608
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.025141837461939397, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06589340713788878, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1261521150481026, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.0779892273668973, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03755707560845141, "sim_compute_performance-ego": 0.06470221843359605, "sim_compute_robot_state-ego": 0.06351646387352133, "sim_compute_robot_state-npc0": 0.07029345350445441, "sim_compute_robot_state-npc1": 0.06660534750740484, "sim_compute_robot_state-npc2": 0.06649767677738981, "sim_compute_robot_state-npc3": 0.06648373153974425}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.026198744773864743, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.0644670995798978, "in-drivable-lane": 0, "agent_compute-ego": 0.1292313879186457, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.0769294175234708, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03662417693571611, "sim_compute_performance-ego": 0.06413770805705678, "sim_compute_robot_state-ego": 0.06284281340512363, "sim_compute_robot_state-npc0": 0.07532811706716364, "sim_compute_robot_state-npc1": 0.06890059601176869, "sim_compute_robot_state-npc2": 0.06769520586187189, "sim_compute_robot_state-npc3": 0.0656137087128379}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.027509456210666233, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06133510801527235, "in-drivable-lane": 0, "agent_compute-ego": 0.1266719447241889, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07590341567993164, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03528961605495877, "sim_compute_performance-ego": 0.06196908420986599, "sim_compute_robot_state-ego": 0.0630925178527832, "sim_compute_robot_state-npc0": 0.07086720996432834, "sim_compute_robot_state-npc1": 0.0658955627017551, "sim_compute_robot_state-npc2": 0.06433855162726508, "sim_compute_robot_state-npc3": 0.06322724554273818}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.026753549774487812, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06617104013760884, "in-drivable-lane": 0, "agent_compute-ego": 0.12760007878144583, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07520303130149841, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.037340521812438965, "sim_compute_performance-ego": 0.06543768445650737, "sim_compute_robot_state-ego": 0.06358306109905243, "sim_compute_robot_state-npc0": 0.07504334549109141, "sim_compute_robot_state-npc1": 0.07035776476065318, "sim_compute_robot_state-npc2": 0.06832234064737956, "sim_compute_robot_state-npc3": 0.06735929846763611}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.026095306172090417, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06875391918070176, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1304977115462808, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07513326406478882, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03787805753595689, "sim_compute_performance-ego": 0.0644084846272188, "sim_compute_robot_state-ego": 0.06217604174333461, "sim_compute_robot_state-npc0": 0.0731581449508667, "sim_compute_robot_state-npc1": 0.0667621142723981, "sim_compute_robot_state-npc2": 0.06506115899366491, "sim_compute_robot_state-npc3": 0.06473682908450856}}
set_robot_commands_max0.0779892273668973
set_robot_commands_mean0.0762316711873174
set_robot_commands_median0.07590341567993164
set_robot_commands_min0.07513326406478882
sim_compute_performance-ego_max0.06543768445650737
sim_compute_performance-ego_mean0.064131035956849
sim_compute_performance-ego_median0.0644084846272188
sim_compute_performance-ego_min0.06196908420986599
sim_compute_robot_state-ego_max0.06358306109905243
sim_compute_robot_state-ego_mean0.06304217959476303
sim_compute_robot_state-ego_median0.0630925178527832
sim_compute_robot_state-ego_min0.06217604174333461
sim_compute_robot_state-npc0_max0.07532811706716364
sim_compute_robot_state-npc0_mean0.0729380541955809
sim_compute_robot_state-npc0_median0.0731581449508667
sim_compute_robot_state-npc0_min0.07029345350445441
sim_compute_robot_state-npc1_max0.07035776476065318
sim_compute_robot_state-npc1_mean0.06770427705079599
sim_compute_robot_state-npc1_median0.0667621142723981
sim_compute_robot_state-npc1_min0.0658955627017551
sim_compute_robot_state-npc2_max0.06832234064737956
sim_compute_robot_state-npc2_mean0.06638298678151426
sim_compute_robot_state-npc2_median0.06649767677738981
sim_compute_robot_state-npc2_min0.06433855162726508
sim_compute_robot_state-npc3_max0.06735929846763611
sim_compute_robot_state-npc3_mean0.065484162669493
sim_compute_robot_state-npc3_median0.0656137087128379
sim_compute_robot_state-npc3_min0.06322724554273818
sim_compute_sim_state_max0.03787805753595689
sim_compute_sim_state_mean0.03693788958950443
sim_compute_sim_state_median0.037340521812438965
sim_compute_sim_state_min0.03528961605495877
sim_physics_max0.027509456210666233
sim_physics_mean0.02633977887860972
sim_physics_median0.026198744773864743
sim_physics_min0.025141837461939397
sim_render-ego_max0.06875391918070176
sim_render-ego_mean0.06532411481027392
sim_render-ego_median0.06589340713788878
sim_render-ego_min0.06133510801527235
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
188932404Victor Guerra 🇫🇷Baseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-98990:06:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.09873707143542344
survival_time_median1.2500000000000004
deviation-center-line_median0.04592359960005141
in-drivable-lane_median0.10000000000000007


other stats
agent_compute-ego_max0.3199605464935303
agent_compute-ego_mean0.24684273761416237
agent_compute-ego_median0.23659192191229927
agent_compute-ego_min0.1824019145965576
deviation-center-line_max0.05857137466617032
deviation-center-line_mean0.04877808183261258
deviation-center-line_min0.04112259771355417
deviation-heading_max0.7277304719787785
deviation-heading_mean0.6906426250852917
deviation-heading_median0.6753038427735897
deviation-heading_min0.6626231424980282
driven_any_max0.17301820730679077
driven_any_mean0.1651899671948293
driven_any_median0.1678657491689443
driven_any_min0.1565353296721422
driven_lanedir_consec_max0.11557588120532047
driven_lanedir_consec_mean0.09837189826348668
driven_lanedir_consec_min0.07694075035809522
driven_lanedir_max0.11557588120532047
driven_lanedir_mean0.09837189826348668
driven_lanedir_median0.09873707143542344
driven_lanedir_min0.07694075035809522
in-drivable-lane_max0.2500000000000002
in-drivable-lane_mean0.10000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.17112768301732045, "sim_physics": 0.02736332893371582, "survival_time": 1.2500000000000004, "driven_lanedir": 0.11557588120532047, "sim_render-ego": 0.057354164123535153, "in-drivable-lane": 0, "agent_compute-ego": 0.1824019145965576, "deviation-heading": 0.7142797679585603, "set_robot_commands": 0.07815479278564454, "deviation-center-line": 0.056580134510647355, "driven_lanedir_consec": 0.11557588120532047, "sim_compute_sim_state": 0.03504360198974609, "sim_compute_performance-ego": 0.060678596496582034, "sim_compute_robot_state-ego": 0.06123615264892578, "sim_compute_robot_state-npc0": 0.05947666168212891, "sim_compute_robot_state-npc1": 0.05784566879272461, "sim_compute_robot_state-npc2": 0.054940223693847656, "sim_compute_robot_state-npc3": 0.05977399826049805}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1565353296721422, "sim_physics": 0.02745052746364049, "survival_time": 1.4000000000000006, "driven_lanedir": 0.07694075035809522, "sim_render-ego": 0.057588236672537665, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.23082088572638376, "deviation-heading": 0.6732759002175019, "set_robot_commands": 0.0727311543055943, "deviation-center-line": 0.04112259771355417, "driven_lanedir_consec": 0.07694075035809522, "sim_compute_sim_state": 0.03453718764441354, "sim_compute_performance-ego": 0.058991585459027975, "sim_compute_robot_state-ego": 0.06274186713354928, "sim_compute_robot_state-npc0": 0.0649154782295227, "sim_compute_robot_state-npc1": 0.06302672624588013, "sim_compute_robot_state-npc2": 0.06131071703774588, "sim_compute_robot_state-npc3": 0.059547364711761475}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17301820730679077, "sim_physics": 0.026393747329711913, "survival_time": 1.2500000000000004, "driven_lanedir": 0.11117628133532388, "sim_render-ego": 0.058320293426513674, "in-drivable-lane": 0, "agent_compute-ego": 0.3199605464935303, "deviation-heading": 0.7277304719787785, "set_robot_commands": 0.07766693115234374, "deviation-center-line": 0.05857137466617032, "driven_lanedir_consec": 0.11117628133532388, "sim_compute_sim_state": 0.03302192687988281, "sim_compute_performance-ego": 0.059859704971313474, "sim_compute_robot_state-ego": 0.06112851142883301, "sim_compute_robot_state-npc0": 0.060945043563842775, "sim_compute_robot_state-npc1": 0.06065567016601563, "sim_compute_robot_state-npc2": 0.059851217269897464, "sim_compute_robot_state-npc3": 0.05890959739685059}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.157402866808949, "sim_physics": 0.02593374252319336, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08942950698327046, "sim_render-ego": 0.06327138900756836, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.26443841934204104, "deviation-heading": 0.6626231424980282, "set_robot_commands": 0.07367743492126465, "deviation-center-line": 0.04169270267263964, "driven_lanedir_consec": 0.08942950698327046, "sim_compute_sim_state": 0.03340729713439941, "sim_compute_performance-ego": 0.06364314079284668, "sim_compute_robot_state-ego": 0.05986316680908203, "sim_compute_robot_state-npc0": 0.06831693649291992, "sim_compute_robot_state-npc1": 0.06304441452026367, "sim_compute_robot_state-npc2": 0.06242213249206543, "sim_compute_robot_state-npc3": 0.06406610488891601}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1678657491689443, "sim_physics": 0.024660189946492512, "survival_time": 1.3500000000000003, "driven_lanedir": 0.09873707143542344, "sim_render-ego": 0.06666056315104167, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.23659192191229927, "deviation-heading": 0.6753038427735897, "set_robot_commands": 0.07485850652058919, "deviation-center-line": 0.04592359960005141, "driven_lanedir_consec": 0.09873707143542344, "sim_compute_sim_state": 0.03607878861603914, "sim_compute_performance-ego": 0.06714407602945964, "sim_compute_robot_state-ego": 0.0665299274303295, "sim_compute_robot_state-npc0": 0.07090426374364782, "sim_compute_robot_state-npc1": 0.0661501442944562, "sim_compute_robot_state-npc2": 0.06422070220664695, "sim_compute_robot_state-npc3": 0.06463433195043493}}
set_robot_commands_max0.07815479278564454
set_robot_commands_mean0.07541776393708728
set_robot_commands_median0.07485850652058919
set_robot_commands_min0.0727311543055943
sim_compute_performance-ego_max0.06714407602945964
sim_compute_performance-ego_mean0.06206342074984597
sim_compute_performance-ego_median0.060678596496582034
sim_compute_performance-ego_min0.058991585459027975
sim_compute_robot_state-ego_max0.0665299274303295
sim_compute_robot_state-ego_mean0.06229992509014391
sim_compute_robot_state-ego_median0.06123615264892578
sim_compute_robot_state-ego_min0.05986316680908203
sim_compute_robot_state-npc0_max0.07090426374364782
sim_compute_robot_state-npc0_mean0.06491167674241242
sim_compute_robot_state-npc0_median0.0649154782295227
sim_compute_robot_state-npc0_min0.05947666168212891
sim_compute_robot_state-npc1_max0.0661501442944562
sim_compute_robot_state-npc1_mean0.06214452480386805
sim_compute_robot_state-npc1_median0.06302672624588013
sim_compute_robot_state-npc1_min0.05784566879272461
sim_compute_robot_state-npc2_max0.06422070220664695
sim_compute_robot_state-npc2_mean0.06054899854004068
sim_compute_robot_state-npc2_median0.06131071703774588
sim_compute_robot_state-npc2_min0.054940223693847656
sim_compute_robot_state-npc3_max0.06463433195043493
sim_compute_robot_state-npc3_mean0.06138627944169221
sim_compute_robot_state-npc3_median0.05977399826049805
sim_compute_robot_state-npc3_min0.05890959739685059
sim_compute_sim_state_max0.03607878861603914
sim_compute_sim_state_mean0.0344177604528962
sim_compute_sim_state_median0.03453718764441354
sim_compute_sim_state_min0.03302192687988281
sim_physics_max0.02745052746364049
sim_physics_mean0.026360307239350823
sim_physics_median0.026393747329711913
sim_physics_min0.024660189946492512
sim_render-ego_max0.06666056315104167
sim_render-ego_mean0.0606389292762393
sim_render-ego_median0.058320293426513674
sim_render-ego_min0.057354164123535153
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.3000000000000005
survival_time_min1.2500000000000004
No reset possible
188762413jiang pengBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-98990:22:35
Waited 1203 seconds [...]
Waited 1203 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188712428Andrea Censi 🇨🇭random_agentaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-98990:00:42
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188642433Andrea Censi 🇨🇭random_agentaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-98990:00:39
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188462451Nicky EichmannBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-98990:21:33
Waited 1203 seconds [...]
Waited 1203 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188452456Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-98990:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188422460Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-98990:00:40
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188402463Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-98990:00:41
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188222496Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-98990:07:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.15089731569363674
survival_time_median1.3000000000000005
deviation-center-line_median0.05963407554753716
in-drivable-lane_median0


other stats
agent_compute-ego_max0.27855337142944336
agent_compute-ego_mean0.23885476232865596
agent_compute-ego_median0.2460201382637024
agent_compute-ego_min0.19274263911777073
deviation-center-line_max0.06317134568333214
deviation-center-line_mean0.05894408861725113
deviation-center-line_min0.050486966055592705
deviation-heading_max0.6442605021126564
deviation-heading_mean0.6138084899762443
deviation-heading_median0.6203596500157968
deviation-heading_min0.5601619221493759
driven_any_max0.21958134284046857
driven_any_mean0.19399470204256417
driven_any_median0.19587761845214197
driven_any_min0.16440723982048994
driven_lanedir_consec_max0.17142729403552215
driven_lanedir_consec_mean0.14718518830381594
driven_lanedir_consec_min0.1144104150126295
driven_lanedir_max0.17142729403552215
driven_lanedir_mean0.14718518830381594
driven_lanedir_median0.15089731569363674
driven_lanedir_min0.1144104150126295
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20114378088328835, "sim_physics": 0.02743619918823242, "survival_time": 1.2500000000000004, "driven_lanedir": 0.15961323293940088, "sim_render-ego": 0.05879855155944824, "in-drivable-lane": 0, "agent_compute-ego": 0.27855337142944336, "deviation-heading": 0.5601619221493759, "set_robot_commands": 0.07901923179626465, "deviation-center-line": 0.059001290237192174, "driven_lanedir_consec": 0.15961323293940088, "sim_compute_sim_state": 0.03401060104370117, "sim_compute_performance-ego": 0.05931857109069824, "sim_compute_robot_state-ego": 0.05871164321899414, "sim_compute_robot_state-npc0": 0.06089524269104004, "sim_compute_robot_state-npc1": 0.06168328285217285, "sim_compute_robot_state-npc2": 0.061683244705200195, "sim_compute_robot_state-npc3": 0.061031951904296874}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.21958134284046857, "sim_physics": 0.02643923406247739, "survival_time": 1.3500000000000003, "driven_lanedir": 0.17142729403552215, "sim_render-ego": 0.06326066123114692, "in-drivable-lane": 0, "agent_compute-ego": 0.19274263911777073, "deviation-heading": 0.6069697856078615, "set_robot_commands": 0.07583226980986418, "deviation-center-line": 0.06317134568333214, "driven_lanedir_consec": 0.17142729403552215, "sim_compute_sim_state": 0.036556915000632954, "sim_compute_performance-ego": 0.06411187737076371, "sim_compute_robot_state-ego": 0.06800630357530382, "sim_compute_robot_state-npc0": 0.06799608689767343, "sim_compute_robot_state-npc1": 0.06155773445411965, "sim_compute_robot_state-npc2": 0.06245862996136701, "sim_compute_robot_state-npc3": 0.0655374703583894}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1889635282164321, "sim_physics": 0.027078967828017015, "survival_time": 1.3000000000000005, "driven_lanedir": 0.13957768383789038, "sim_render-ego": 0.06907038505260761, "in-drivable-lane": 0, "agent_compute-ego": 0.2281815272111159, "deviation-heading": 0.6442605021126564, "set_robot_commands": 0.07781058091383714, "deviation-center-line": 0.06242676556260151, "driven_lanedir_consec": 0.13957768383789038, "sim_compute_sim_state": 0.034594169029822715, "sim_compute_performance-ego": 0.0660329690346351, "sim_compute_robot_state-ego": 0.059737104635972246, "sim_compute_robot_state-npc0": 0.06540615742023174, "sim_compute_robot_state-npc1": 0.060497283935546875, "sim_compute_robot_state-npc2": 0.06242323838747465, "sim_compute_robot_state-npc3": 0.06494074601393479}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16440723982048994, "sim_physics": 0.03187444806098938, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1144104150126295, "sim_render-ego": 0.06133958697319031, "in-drivable-lane": 0, "agent_compute-ego": 0.2460201382637024, "deviation-heading": 0.6203596500157968, "set_robot_commands": 0.07682486375172932, "deviation-center-line": 0.050486966055592705, "driven_lanedir_consec": 0.1144104150126295, "sim_compute_sim_state": 0.03734045227368673, "sim_compute_performance-ego": 0.06739407777786255, "sim_compute_robot_state-ego": 0.0643482506275177, "sim_compute_robot_state-npc0": 0.06534677743911743, "sim_compute_robot_state-npc1": 0.061629255612691246, "sim_compute_robot_state-npc2": 0.0633537769317627, "sim_compute_robot_state-npc3": 0.06169521808624267}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.19587761845214197, "sim_physics": 0.027353957847312645, "survival_time": 1.3500000000000003, "driven_lanedir": 0.15089731569363674, "sim_render-ego": 0.06538409656948513, "in-drivable-lane": 0, "agent_compute-ego": 0.24877613562124748, "deviation-heading": 0.6372905899955303, "set_robot_commands": 0.08011101793359827, "deviation-center-line": 0.05963407554753716, "driven_lanedir_consec": 0.15089731569363674, "sim_compute_sim_state": 0.035655065819069194, "sim_compute_performance-ego": 0.06811748610602485, "sim_compute_robot_state-ego": 0.062214401033189565, "sim_compute_robot_state-npc0": 0.07332777093957972, "sim_compute_robot_state-npc1": 0.0717453161875407, "sim_compute_robot_state-npc2": 0.06942266005056875, "sim_compute_robot_state-npc3": 0.06511000350669578}}
set_robot_commands_max0.08011101793359827
set_robot_commands_mean0.0779195928410587
set_robot_commands_median0.07781058091383714
set_robot_commands_min0.07583226980986418
sim_compute_performance-ego_max0.06811748610602485
sim_compute_performance-ego_mean0.06499499627599689
sim_compute_performance-ego_median0.0660329690346351
sim_compute_performance-ego_min0.05931857109069824
sim_compute_robot_state-ego_max0.06800630357530382
sim_compute_robot_state-ego_mean0.06260354061819548
sim_compute_robot_state-ego_median0.062214401033189565
sim_compute_robot_state-ego_min0.05871164321899414
sim_compute_robot_state-npc0_max0.07332777093957972
sim_compute_robot_state-npc0_mean0.06659440707752848
sim_compute_robot_state-npc0_median0.06540615742023174
sim_compute_robot_state-npc0_min0.06089524269104004
sim_compute_robot_state-npc1_max0.0717453161875407
sim_compute_robot_state-npc1_mean0.06342257460841426
sim_compute_robot_state-npc1_median0.061629255612691246
sim_compute_robot_state-npc1_min0.060497283935546875
sim_compute_robot_state-npc2_max0.06942266005056875
sim_compute_robot_state-npc2_mean0.06386831000727466
sim_compute_robot_state-npc2_median0.06245862996136701
sim_compute_robot_state-npc2_min0.061683244705200195
sim_compute_robot_state-npc3_max0.0655374703583894
sim_compute_robot_state-npc3_mean0.0636630779739119
sim_compute_robot_state-npc3_median0.06494074601393479
sim_compute_robot_state-npc3_min0.061031951904296874
sim_compute_sim_state_max0.03734045227368673
sim_compute_sim_state_mean0.03563144063338255
sim_compute_sim_state_median0.035655065819069194
sim_compute_sim_state_min0.03401060104370117
sim_physics_max0.03187444806098938
sim_physics_mean0.02803656139740577
sim_physics_median0.027353957847312645
sim_physics_min0.02643923406247739
sim_render-ego_max0.06907038505260761
sim_render-ego_mean0.06357065627717565
sim_render-ego_median0.06326066123114692
sim_render-ego_min0.05879855155944824
simulation-passed1
survival_time_max1.3500000000000003
survival_time_mean1.2900000000000005
survival_time_min1.2000000000000004
No reset possible
188162504Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-98990:00:41
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188122510Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-98990:00:40
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
188042525Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-98990:00:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
187992536Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-98990:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
187922540jiang pengtest for ppoaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-98990:02:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
187842548Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-98990:05:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487126868955534
survival_time_median2.3499999999999996
deviation-center-line_median0.11041377901227004
in-drivable-lane_median0


other stats
agent_compute-ego_max0.068274763914255
agent_compute-ego_mean0.06562730017872846
agent_compute-ego_median0.06584730901216206
agent_compute-ego_min0.0625362250863052
deviation-center-line_max0.12791029264553877
deviation-center-line_mean0.10518143804729678
deviation-center-line_min0.06917252689874298
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550056
deviation-heading_median0.3636820162885191
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903463
driven_any_median0.6642785413158997
driven_any_min0.3059207793076624
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.5880385612453785
driven_lanedir_consec_min0.2802213062291129
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.5880385612453785
driven_lanedir_median0.5487126868955534
driven_lanedir_min0.2802213062291129
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.01648538868601729, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05857173989458782, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.0625362250863052, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.0771175593864627, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03828142328960139, "sim_compute_performance-ego": 0.05900522557700553, "sim_compute_robot_state-ego": 0.06075567733950731}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.01743468871483436, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.06320574650397667, "in-drivable-lane": 0, "agent_compute-ego": 0.068274763914255, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.07546642193427452, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.040049112760103665, "sim_compute_performance-ego": 0.06294823609865628, "sim_compute_robot_state-ego": 0.06688567308279184}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.01648819700200507, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.06377001518898821, "in-drivable-lane": 0, "agent_compute-ego": 0.06715486404743601, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.0765139752245964, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.04033756763377088, "sim_compute_performance-ego": 0.06741262496785914, "sim_compute_robot_state-ego": 0.0649721622467041}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.018049397311367833, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06348668349968208, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06432333883348403, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07417394302703523, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.04012123831025847, "sim_compute_performance-ego": 0.06223370478703426, "sim_compute_robot_state-ego": 0.06439554560315477}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.016675158550864773, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.06402794310921117, "in-drivable-lane": 0, "agent_compute-ego": 0.06584730901216206, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.0768823686398958, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03986208689840216, "sim_compute_performance-ego": 0.06478630241594817, "sim_compute_robot_state-ego": 0.06387339767656829}}
set_robot_commands_max0.0771175593864627
set_robot_commands_mean0.07603085364245292
set_robot_commands_median0.0765139752245964
set_robot_commands_min0.07417394302703523
sim_compute_performance-ego_max0.06741262496785914
sim_compute_performance-ego_mean0.06327721876930067
sim_compute_performance-ego_median0.06294823609865628
sim_compute_performance-ego_min0.05900522557700553
sim_compute_robot_state-ego_max0.06688567308279184
sim_compute_robot_state-ego_mean0.06417649118974526
sim_compute_robot_state-ego_median0.06439554560315477
sim_compute_robot_state-ego_min0.06075567733950731
sim_compute_sim_state_max0.04033756763377088
sim_compute_sim_state_mean0.03973028577842731
sim_compute_sim_state_median0.040049112760103665
sim_compute_sim_state_min0.03828142328960139
sim_physics_max0.018049397311367833
sim_physics_mean0.017026566053017868
sim_physics_median0.016675158550864773
sim_physics_min0.01648538868601729
sim_render-ego_max0.06402794310921117
sim_render-ego_mean0.06261242563928919
sim_render-ego_median0.06348668349968208
sim_render-ego_min0.05857173989458782
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
187782568Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-98990:11:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6013276121655571
survival_time_median2.2
deviation-center-line_median0.11994879786730762
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.0655984144944411
agent_compute-ego_mean0.06320635732788499
agent_compute-ego_median0.06270146369934082
agent_compute-ego_min0.06066316908056086
deviation-center-line_max0.31602167939174997
deviation-center-line_mean0.15029477661273552
deviation-center-line_min0.08465176242372947
deviation-heading_max1.298091820230251
deviation-heading_mean0.5590872679348118
deviation-heading_median0.39186075366845463
deviation-heading_min0.29133071980288444
driven_any_max1.2345099137442228
driven_any_mean0.7773148514182241
driven_any_median0.6489566174251553
driven_any_min0.47625793140583145
driven_lanedir_consec_max0.923268763707114
driven_lanedir_consec_mean0.634114415404596
driven_lanedir_consec_min0.4596280139000144
driven_lanedir_max0.923268763707114
driven_lanedir_mean0.6342515685671332
driven_lanedir_median0.6013276121655571
driven_lanedir_min0.4596280139000144
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.3599999999999987
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.028750439694053248, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.05567145096628289, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06270146369934082, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.07364147587826378, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.032673343859220806, "sim_compute_performance-ego": 0.057786271446629574, "sim_compute_robot_state-ego": 0.0594325768320184, "sim_compute_robot_state-npc0": 0.06455614441319515, "sim_compute_robot_state-npc1": 0.05981063340839587, "sim_compute_robot_state-npc2": 0.05882563340036493, "sim_compute_robot_state-npc3": 0.05860483771876285}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.025371658174615157, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.057445482203834934, "in-drivable-lane": 0, "agent_compute-ego": 0.06174605143697638, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07285063517721076, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.0329648632752268, "sim_compute_performance-ego": 0.060394149077566045, "sim_compute_robot_state-ego": 0.05980695548810457, "sim_compute_robot_state-npc0": 0.06422777552353709, "sim_compute_robot_state-npc1": 0.06102090760281211, "sim_compute_robot_state-npc2": 0.05948906823208457, "sim_compute_robot_state-npc3": 0.058521044881720295}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.026682071196727265, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.05765720514150766, "in-drivable-lane": 0, "agent_compute-ego": 0.0655984144944411, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.0766597038660294, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03112487915234688, "sim_compute_performance-ego": 0.05701909309778458, "sim_compute_robot_state-ego": 0.05599263998178335, "sim_compute_robot_state-npc0": 0.06692386284852639, "sim_compute_robot_state-npc1": 0.060036769280066855, "sim_compute_robot_state-npc2": 0.059139263935578175, "sim_compute_robot_state-npc3": 0.0565645816998604}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.029993369545735105, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.06040545920251121, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06532268792810575, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07488828309824769, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.03293841321703414, "sim_compute_performance-ego": 0.06019055339652048, "sim_compute_robot_state-ego": 0.05983690812554158, "sim_compute_robot_state-npc0": 0.06438739870635557, "sim_compute_robot_state-npc1": 0.06177115776169468, "sim_compute_robot_state-npc2": 0.0608089138084734, "sim_compute_robot_state-npc3": 0.059880296948929906}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.025401955301111393, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.058143523606387054, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06066316908056086, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07416599447076971, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03328450701453469, "sim_compute_performance-ego": 0.059361598708412865, "sim_compute_robot_state-ego": 0.05714615908536044, "sim_compute_robot_state-npc0": 0.06394399838014082, "sim_compute_robot_state-npc1": 0.06124191392551769, "sim_compute_robot_state-npc2": 0.06088455698706887, "sim_compute_robot_state-npc3": 0.05928360332142223}}
set_robot_commands_max0.0766597038660294
set_robot_commands_mean0.07444121849810427
set_robot_commands_median0.07416599447076971
set_robot_commands_min0.07285063517721076
sim_compute_performance-ego_max0.060394149077566045
sim_compute_performance-ego_mean0.058950333145382706
sim_compute_performance-ego_median0.059361598708412865
sim_compute_performance-ego_min0.05701909309778458
sim_compute_robot_state-ego_max0.05983690812554158
sim_compute_robot_state-ego_mean0.05844304790256168
sim_compute_robot_state-ego_median0.0594325768320184
sim_compute_robot_state-ego_min0.05599263998178335
sim_compute_robot_state-npc0_max0.06692386284852639
sim_compute_robot_state-npc0_mean0.064807835974351
sim_compute_robot_state-npc0_median0.06438739870635557
sim_compute_robot_state-npc0_min0.06394399838014082
sim_compute_robot_state-npc1_max0.06177115776169468
sim_compute_robot_state-npc1_mean0.06077627639569744
sim_compute_robot_state-npc1_median0.06102090760281211
sim_compute_robot_state-npc1_min0.05981063340839587
sim_compute_robot_state-npc2_max0.06088455698706887
sim_compute_robot_state-npc2_mean0.05982948727271399
sim_compute_robot_state-npc2_median0.05948906823208457
sim_compute_robot_state-npc2_min0.05882563340036493
sim_compute_robot_state-npc3_max0.059880296948929906
sim_compute_robot_state-npc3_mean0.058570872914139135
sim_compute_robot_state-npc3_median0.05860483771876285
sim_compute_robot_state-npc3_min0.0565645816998604
sim_compute_sim_state_max0.03328450701453469
sim_compute_sim_state_mean0.03259720130367266
sim_compute_sim_state_median0.03293841321703414
sim_compute_sim_state_min0.03112487915234688
sim_physics_max0.029993369545735105
sim_physics_mean0.02723989878244843
sim_physics_median0.026682071196727265
sim_physics_min0.025371658174615157
sim_render-ego_max0.06040545920251121
sim_render-ego_mean0.057864624224104745
sim_render-ego_median0.05765720514150766
sim_render-ego_min0.05567145096628289
simulation-passed1
survival_time_max4.749999999999991
survival_time_mean2.8699999999999983
survival_time_min1.900000000000001
No reset possible
187312612Konstantin Chaikachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-98990:09:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6013276121655571
survival_time_median2.2
deviation-center-line_median0.11994879786730762
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.06567563154758552
agent_compute-ego_mean0.063120678717377
agent_compute-ego_median0.06192319501530041
agent_compute-ego_min0.06102473861292789
deviation-center-line_max0.31602167939174997
deviation-center-line_mean0.15029477661273552
deviation-center-line_min0.08465176242372947
deviation-heading_max1.298091820230251
deviation-heading_mean0.5590872679348118
deviation-heading_median0.39186075366845463
deviation-heading_min0.29133071980288444
driven_any_max1.2345099137442228
driven_any_mean0.7773148514182241
driven_any_median0.6489566174251553
driven_any_min0.47625793140583145
driven_lanedir_consec_max0.923268763707114
driven_lanedir_consec_mean0.634114415404596
driven_lanedir_consec_min0.4596280139000144
driven_lanedir_max0.923268763707114
driven_lanedir_mean0.6342515685671332
driven_lanedir_median0.6013276121655571
driven_lanedir_min0.4596280139000144
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.3599999999999987
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.0299295048964651, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.05511253507513749, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06102473861292789, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.07399366027430485, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03177145154852616, "sim_compute_performance-ego": 0.05531204625179893, "sim_compute_robot_state-ego": 0.05813923384013929, "sim_compute_robot_state-npc0": 0.06442866827312269, "sim_compute_robot_state-npc1": 0.059992890608938115, "sim_compute_robot_state-npc2": 0.058025824396233806, "sim_compute_robot_state-npc3": 0.05694822763141833}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.026098634067334623, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.05612793721650776, "in-drivable-lane": 0, "agent_compute-ego": 0.06539234362150494, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07745340623353657, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.03416298565111662, "sim_compute_performance-ego": 0.05710981394115247, "sim_compute_robot_state-ego": 0.05856684007142719, "sim_compute_robot_state-npc0": 0.06567481944435521, "sim_compute_robot_state-npc1": 0.06065883134540759, "sim_compute_robot_state-npc2": 0.06005050634082995, "sim_compute_robot_state-npc3": 0.06181226278606214}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.031116228837233324, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06653575408153045, "in-drivable-lane": 0, "agent_compute-ego": 0.06567563154758552, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07633284422067496, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03724801846039601, "sim_compute_performance-ego": 0.06444958540109488, "sim_compute_robot_state-ego": 0.06302325542156513, "sim_compute_robot_state-npc0": 0.06912795091286683, "sim_compute_robot_state-npc1": 0.06531827877729367, "sim_compute_robot_state-npc2": 0.06384722391764323, "sim_compute_robot_state-npc3": 0.06479134315099472}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.030843173953848824, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.057743891863755774, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06158748478956626, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07415455831608302, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.03290780833069707, "sim_compute_performance-ego": 0.0592162441199934, "sim_compute_robot_state-ego": 0.058892438109491914, "sim_compute_robot_state-npc0": 0.06437172016627352, "sim_compute_robot_state-npc1": 0.06087369314381774, "sim_compute_robot_state-npc2": 0.05913475869407117, "sim_compute_robot_state-npc3": 0.05839649724288726}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.02649897336959839, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.05901437997817993, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06192319501530041, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07496668533845381, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03445975888859142, "sim_compute_performance-ego": 0.059470415115356445, "sim_compute_robot_state-ego": 0.06008677590977062, "sim_compute_robot_state-npc0": 0.06479576500979337, "sim_compute_robot_state-npc1": 0.06049223379655318, "sim_compute_robot_state-npc2": 0.059200606562874535, "sim_compute_robot_state-npc3": 0.05991358648646961}}
set_robot_commands_max0.07745340623353657
set_robot_commands_mean0.07538023087661064
set_robot_commands_median0.07496668533845381
set_robot_commands_min0.07399366027430485
sim_compute_performance-ego_max0.06444958540109488
sim_compute_performance-ego_mean0.05911162096587923
sim_compute_performance-ego_median0.0592162441199934
sim_compute_performance-ego_min0.05531204625179893
sim_compute_robot_state-ego_max0.06302325542156513
sim_compute_robot_state-ego_mean0.05974170867047883
sim_compute_robot_state-ego_median0.058892438109491914
sim_compute_robot_state-ego_min0.05813923384013929
sim_compute_robot_state-npc0_max0.06912795091286683
sim_compute_robot_state-npc0_mean0.0656797847612823
sim_compute_robot_state-npc0_median0.06479576500979337
sim_compute_robot_state-npc0_min0.06437172016627352
sim_compute_robot_state-npc1_max0.06531827877729367
sim_compute_robot_state-npc1_mean0.06146718553440206
sim_compute_robot_state-npc1_median0.06065883134540759
sim_compute_robot_state-npc1_min0.059992890608938115
sim_compute_robot_state-npc2_max0.06384722391764323
sim_compute_robot_state-npc2_mean0.06005178398233054
sim_compute_robot_state-npc2_median0.059200606562874535
sim_compute_robot_state-npc2_min0.058025824396233806
sim_compute_robot_state-npc3_max0.06479134315099472
sim_compute_robot_state-npc3_mean0.060372383459566414
sim_compute_robot_state-npc3_median0.05991358648646961
sim_compute_robot_state-npc3_min0.05694822763141833
sim_compute_sim_state_max0.03724801846039601
sim_compute_sim_state_mean0.03411000457586546
sim_compute_sim_state_median0.03416298565111662
sim_compute_sim_state_min0.03177145154852616
sim_physics_max0.031116228837233324
sim_physics_mean0.02889730302489605
sim_physics_median0.0299295048964651
sim_physics_min0.026098634067334623
sim_render-ego_max0.06653575408153045
sim_render-ego_mean0.05890689964302228
sim_render-ego_median0.057743891863755774
sim_render-ego_min0.05511253507513749
simulation-passed1
survival_time_max4.749999999999991
survival_time_mean2.8699999999999983
survival_time_min1.900000000000001
No reset possible
187212625Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-98990:11:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.14631706349393156
agent_compute-ego_mean0.13868822639399592
agent_compute-ego_median0.1394030215248229
agent_compute-ego_min0.13375870539591864
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.029121062112232997, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06026812583681137, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.1394030215248229, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07537209798419287, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.032106183824085054, "sim_compute_performance-ego": 0.05764554038880363, "sim_compute_robot_state-ego": 0.05868448151482476, "sim_compute_robot_state-npc0": 0.06437895411536806, "sim_compute_robot_state-npc1": 0.05990479105994815, "sim_compute_robot_state-npc2": 0.059422704908582896, "sim_compute_robot_state-npc3": 0.06122275004311213}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.02768412290834913, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.05791531357110715, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13439619307424508, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07322475956935509, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03282088859408509, "sim_compute_performance-ego": 0.05653197157616709, "sim_compute_robot_state-ego": 0.06123467052684111, "sim_compute_robot_state-npc0": 0.0638419413099102, "sim_compute_robot_state-npc1": 0.058378803963754694, "sim_compute_robot_state-npc2": 0.0577848565344717, "sim_compute_robot_state-npc3": 0.058994690577189125}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.02997853679041709, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.058858594586772305, "in-drivable-lane": 0, "agent_compute-ego": 0.1395661484810614, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07434042038456086, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.0324233885734312, "sim_compute_performance-ego": 0.06032859894537156, "sim_compute_robot_state-ego": 0.05984707801572738, "sim_compute_robot_state-npc0": 0.06551679103605208, "sim_compute_robot_state-npc1": 0.06075491828303183, "sim_compute_robot_state-npc2": 0.057854879286981395, "sim_compute_robot_state-npc3": 0.05822308217325518}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.030980287714207425, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06515912045823767, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.14631706349393156, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07675572659106965, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.035129435518954664, "sim_compute_performance-ego": 0.06549445365337615, "sim_compute_robot_state-ego": 0.06559534022148619, "sim_compute_robot_state-npc0": 0.06866232638663435, "sim_compute_robot_state-npc1": 0.06513170739437671, "sim_compute_robot_state-npc2": 0.06439950871974864, "sim_compute_robot_state-npc3": 0.06421682936079959}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.02679685904429509, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.05932768491598276, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.13375870539591864, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07569874708469097, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03370545919124897, "sim_compute_performance-ego": 0.05975296405645517, "sim_compute_robot_state-ego": 0.062008362550001875, "sim_compute_robot_state-npc0": 0.06548849435952994, "sim_compute_robot_state-npc1": 0.05924542592122005, "sim_compute_robot_state-npc2": 0.058729699024787314, "sim_compute_robot_state-npc3": 0.06114822167616624}}
set_robot_commands_max0.07675572659106965
set_robot_commands_mean0.07507835032277389
set_robot_commands_median0.07537209798419287
set_robot_commands_min0.07322475956935509
sim_compute_performance-ego_max0.06549445365337615
sim_compute_performance-ego_mean0.05995070572403473
sim_compute_performance-ego_median0.05975296405645517
sim_compute_performance-ego_min0.05653197157616709
sim_compute_robot_state-ego_max0.06559534022148619
sim_compute_robot_state-ego_mean0.06147398656577626
sim_compute_robot_state-ego_median0.06123467052684111
sim_compute_robot_state-ego_min0.05868448151482476
sim_compute_robot_state-npc0_max0.06866232638663435
sim_compute_robot_state-npc0_mean0.06557770144149892
sim_compute_robot_state-npc0_median0.06548849435952994
sim_compute_robot_state-npc0_min0.0638419413099102
sim_compute_robot_state-npc1_max0.06513170739437671
sim_compute_robot_state-npc1_mean0.06068312932446629
sim_compute_robot_state-npc1_median0.05990479105994815
sim_compute_robot_state-npc1_min0.058378803963754694
sim_compute_robot_state-npc2_max0.06439950871974864
sim_compute_robot_state-npc2_mean0.059638329694914394
sim_compute_robot_state-npc2_median0.058729699024787314
sim_compute_robot_state-npc2_min0.0577848565344717
sim_compute_robot_state-npc3_max0.06421682936079959
sim_compute_robot_state-npc3_mean0.06076111476610445
sim_compute_robot_state-npc3_median0.06114822167616624
sim_compute_robot_state-npc3_min0.05822308217325518
sim_compute_sim_state_max0.035129435518954664
sim_compute_sim_state_mean0.033237071140360994
sim_compute_sim_state_median0.03282088859408509
sim_compute_sim_state_min0.032106183824085054
sim_physics_max0.030980287714207425
sim_physics_mean0.028912173713900348
sim_physics_median0.029121062112232997
sim_physics_min0.02679685904429509
sim_render-ego_max0.06515912045823767
sim_render-ego_mean0.06030576787378226
sim_render-ego_median0.05932768491598276
sim_render-ego_min0.05791531357110715
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible
187182629Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-98990:05:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.1459088643391927
agent_compute-ego_mean0.1430562662810285
agent_compute-ego_median0.14473341405391693
agent_compute-ego_min0.13827877694910223
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.015537972720164174, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.0636959750697298, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1449104704946842, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07814035775526515, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03935612372632297, "sim_compute_performance-ego": 0.06144819619520655, "sim_compute_robot_state-ego": 0.06114216120737904}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.015097975730895996, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.05816138332540339, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13827877694910223, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07609633965925737, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.03556216304952448, "sim_compute_performance-ego": 0.059785561128096146, "sim_compute_robot_state-ego": 0.06103194843639027}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.015422503153483072, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06337145699395073, "in-drivable-lane": 0, "agent_compute-ego": 0.1459088643391927, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07739051712883843, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04021363258361817, "sim_compute_performance-ego": 0.06335341665479872, "sim_compute_robot_state-ego": 0.062356079949273}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.015629311402638752, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06509808202584584, "in-drivable-lane": 0, "agent_compute-ego": 0.14473341405391693, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07692225277423859, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03832940260569254, "sim_compute_performance-ego": 0.06602571407953899, "sim_compute_robot_state-ego": 0.06363687912623088}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.016713973353890813, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.0659562209073235, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14144980556824627, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07808476335862104, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.03946248222799862, "sim_compute_performance-ego": 0.0658617194961099, "sim_compute_robot_state-ego": 0.062353887978722065}}
set_robot_commands_max0.07814035775526515
set_robot_commands_mean0.07732684613524411
set_robot_commands_median0.07739051712883843
set_robot_commands_min0.07609633965925737
sim_compute_performance-ego_max0.06602571407953899
sim_compute_performance-ego_mean0.06329492151075007
sim_compute_performance-ego_median0.06335341665479872
sim_compute_performance-ego_min0.059785561128096146
sim_compute_robot_state-ego_max0.06363687912623088
sim_compute_robot_state-ego_mean0.062104191339599046
sim_compute_robot_state-ego_median0.062353887978722065
sim_compute_robot_state-ego_min0.06103194843639027
sim_compute_sim_state_max0.04021363258361817
sim_compute_sim_state_mean0.038584760838631355
sim_compute_sim_state_median0.03935612372632297
sim_compute_sim_state_min0.03556216304952448
sim_physics_max0.016713973353890813
sim_physics_mean0.01568034727221456
sim_physics_median0.015537972720164174
sim_physics_min0.015097975730895996
sim_render-ego_max0.0659562209073235
sim_render-ego_mean0.06325662366445065
sim_render-ego_median0.0636959750697298
sim_render-ego_min0.05816138332540339
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
187072648Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-98990:09:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6013276121655571
survival_time_median2.2
deviation-center-line_median0.11994879786730762
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.06962817754500951
agent_compute-ego_mean0.06463075507812081
agent_compute-ego_median0.06436713984314825
agent_compute-ego_min0.06037176739085804
deviation-center-line_max0.31602167939174997
deviation-center-line_mean0.15029477661273552
deviation-center-line_min0.08465176242372947
deviation-heading_max1.298091820230251
deviation-heading_mean0.5590872679348118
deviation-heading_median0.39186075366845463
deviation-heading_min0.29133071980288444
driven_any_max1.2345099137442228
driven_any_mean0.7773148514182241
driven_any_median0.6489566174251553
driven_any_min0.47625793140583145
driven_lanedir_consec_max0.923268763707114
driven_lanedir_consec_mean0.634114415404596
driven_lanedir_consec_min0.4596280139000144
driven_lanedir_max0.923268763707114
driven_lanedir_mean0.6342515685671332
driven_lanedir_median0.6013276121655571
driven_lanedir_min0.4596280139000144
in-drivable-lane_max0.9499999999999966
in-drivable-lane_mean0.3599999999999987
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.03020968939128675, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.0623630774648566, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06320079502306486, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.07473477815326891, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03455031545538651, "sim_compute_performance-ego": 0.061904766685084295, "sim_compute_robot_state-ego": 0.06110771831713225, "sim_compute_robot_state-npc0": 0.0658147510729338, "sim_compute_robot_state-npc1": 0.06266603720815558, "sim_compute_robot_state-npc2": 0.06168416926735326, "sim_compute_robot_state-npc3": 0.06184351569727847}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.02582498600608424, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.060840575318587456, "in-drivable-lane": 0, "agent_compute-ego": 0.06558589558852346, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07381795582018401, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.03447350702787701, "sim_compute_performance-ego": 0.06108782165928891, "sim_compute_robot_state-ego": 0.05865040578340229, "sim_compute_robot_state-npc0": 0.06860508416828356, "sim_compute_robot_state-npc1": 0.06525565448560212, "sim_compute_robot_state-npc2": 0.06322238947215833, "sim_compute_robot_state-npc3": 0.06228603814777575}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.030509227361434545, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.05976327871664976, "in-drivable-lane": 0, "agent_compute-ego": 0.06962817754500951, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07677049514574882, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03441599699167105, "sim_compute_performance-ego": 0.057462117610833585, "sim_compute_robot_state-ego": 0.05877292461884327, "sim_compute_robot_state-npc0": 0.06284151933132073, "sim_compute_robot_state-npc1": 0.0612187385559082, "sim_compute_robot_state-npc2": 0.060158815139379256, "sim_compute_robot_state-npc3": 0.061157104296562}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.031494855880737305, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.061487409430490414, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06436713984314825, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.0749458393580477, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.03479280270321269, "sim_compute_performance-ego": 0.061186441233460336, "sim_compute_robot_state-ego": 0.060788221762213906, "sim_compute_robot_state-npc0": 0.06508269444317885, "sim_compute_robot_state-npc1": 0.06360305195123377, "sim_compute_robot_state-npc2": 0.06302944707198882, "sim_compute_robot_state-npc3": 0.061361003929460554}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.026763872666792435, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.060948041352358734, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06037176739085804, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07313108444213867, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.032828217202966865, "sim_compute_performance-ego": 0.05906374346126209, "sim_compute_robot_state-ego": 0.05800562555139715, "sim_compute_robot_state-npc0": 0.0654797770760276, "sim_compute_robot_state-npc1": 0.06277074055238203, "sim_compute_robot_state-npc2": 0.06080072576349432, "sim_compute_robot_state-npc3": 0.06065565889531916}}
set_robot_commands_max0.07677049514574882
set_robot_commands_mean0.07468003058387762
set_robot_commands_median0.07473477815326891
set_robot_commands_min0.07313108444213867
sim_compute_performance-ego_max0.061904766685084295
sim_compute_performance-ego_mean0.060140978129985846
sim_compute_performance-ego_median0.06108782165928891
sim_compute_performance-ego_min0.057462117610833585
sim_compute_robot_state-ego_max0.06110771831713225
sim_compute_robot_state-ego_mean0.05946497920659777
sim_compute_robot_state-ego_median0.05877292461884327
sim_compute_robot_state-ego_min0.05800562555139715
sim_compute_robot_state-npc0_max0.06860508416828356
sim_compute_robot_state-npc0_mean0.0655647652183489
sim_compute_robot_state-npc0_median0.0654797770760276
sim_compute_robot_state-npc0_min0.06284151933132073
sim_compute_robot_state-npc1_max0.06525565448560212
sim_compute_robot_state-npc1_mean0.06310284455065635
sim_compute_robot_state-npc1_median0.06277074055238203
sim_compute_robot_state-npc1_min0.0612187385559082
sim_compute_robot_state-npc2_max0.06322238947215833
sim_compute_robot_state-npc2_mean0.0617791093428748
sim_compute_robot_state-npc2_median0.06168416926735326
sim_compute_robot_state-npc2_min0.060158815139379256
sim_compute_robot_state-npc3_max0.06228603814777575
sim_compute_robot_state-npc3_mean0.06146066419327919
sim_compute_robot_state-npc3_median0.061361003929460554
sim_compute_robot_state-npc3_min0.06065565889531916
sim_compute_sim_state_max0.03479280270321269
sim_compute_sim_state_mean0.034212167876222825
sim_compute_sim_state_median0.03447350702787701
sim_compute_sim_state_min0.032828217202966865
sim_physics_max0.031494855880737305
sim_physics_mean0.028960526261267057
sim_physics_median0.03020968939128675
sim_physics_min0.02582498600608424
sim_render-ego_max0.0623630774648566
sim_render-ego_mean0.061080476456588595
sim_render-ego_median0.060948041352358734
sim_render-ego_min0.05976327871664976
simulation-passed1
survival_time_max4.749999999999991
survival_time_mean2.8699999999999983
survival_time_min1.900000000000001
No reset possible
186992657Egor Zamotaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-98990:17:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9723517206662984
survival_time_median6.499999999999985
deviation-center-line_median0.40891268336159664
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05855429172515869
agent_compute-ego_mean0.0562803773671295
agent_compute-ego_median0.05607990971926985
agent_compute-ego_min0.05480375853917932
deviation-center-line_max0.6416536781867477
deviation-center-line_mean0.4298651687240717
deviation-center-line_min0.2438516811329288
deviation-heading_max2.5725307289639257
deviation-heading_mean1.731848127659438
deviation-heading_median1.9325693773858563
deviation-heading_min0.6295822004364728
driven_any_max1.3511208671369048
driven_any_mean0.9584727259581494
driven_any_median0.9976360612180756
driven_any_min0.5207881393521417
driven_lanedir_consec_max1.2016554007894849
driven_lanedir_consec_mean0.8284244286139641
driven_lanedir_consec_min0.3008686826250674
driven_lanedir_max1.2016554007894849
driven_lanedir_mean0.8698746228247899
driven_lanedir_median0.9723517206662984
driven_lanedir_min0.5044526885051974
in-drivable-lane_max0.2500000000000002
in-drivable-lane_mean0.09000000000000061
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5207881393521417, "sim_physics": 0.02462699015935262, "survival_time": 3.599999999999995, "driven_lanedir": 0.5044526885051974, "sim_render-ego": 0.053516252173317805, "in-drivable-lane": 0, "agent_compute-ego": 0.05855429172515869, "deviation-heading": 0.6295822004364728, "set_robot_commands": 0.07071582476298015, "deviation-center-line": 0.2438516811329288, "driven_lanedir_consec": 0.5044526885051974, "sim_compute_sim_state": 0.030128657817840576, "sim_compute_performance-ego": 0.053406629297468394, "sim_compute_robot_state-ego": 0.05368575784895155, "sim_compute_robot_state-npc0": 0.05707370241483053, "sim_compute_robot_state-npc1": 0.05488482448789808, "sim_compute_robot_state-npc2": 0.05492313702901205, "sim_compute_robot_state-npc3": 0.05355755819214715}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7002047306288188, "sim_physics": 0.025376632649411437, "survival_time": 4.6499999999999915, "driven_lanedir": 0.5081196536791966, "sim_render-ego": 0.052273678523237985, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.05480375853917932, "deviation-heading": 2.33999361036682, "set_robot_commands": 0.07026432150153704, "deviation-center-line": 0.3977578755040915, "driven_lanedir_consec": 0.3008686826250674, "sim_compute_sim_state": 0.03039315695403725, "sim_compute_performance-ego": 0.05274995680778257, "sim_compute_robot_state-ego": 0.05478138052007203, "sim_compute_robot_state-npc0": 0.057488351739862914, "sim_compute_robot_state-npc1": 0.05536587776676301, "sim_compute_robot_state-npc2": 0.053295830244659094, "sim_compute_robot_state-npc3": 0.05293406209638042}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9976360612180756, "sim_physics": 0.02344208130469689, "survival_time": 6.499999999999985, "driven_lanedir": 0.9723517206662984, "sim_render-ego": 0.05179750002347506, "in-drivable-lane": 0, "agent_compute-ego": 0.056880796872652496, "deviation-heading": 1.1845647211441137, "set_robot_commands": 0.07106187160198506, "deviation-center-line": 0.40891268336159664, "driven_lanedir_consec": 0.9723517206662984, "sim_compute_sim_state": 0.029878766720111555, "sim_compute_performance-ego": 0.05313972509824313, "sim_compute_robot_state-ego": 0.054206340129558855, "sim_compute_robot_state-npc0": 0.05646191927102896, "sim_compute_robot_state-npc1": 0.05447550736940824, "sim_compute_robot_state-npc2": 0.05364307440244234, "sim_compute_robot_state-npc3": 0.05400147071251502}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3511208671369048, "sim_physics": 0.023166641421701717, "survival_time": 8.699999999999989, "driven_lanedir": 1.2016554007894849, "sim_render-ego": 0.0528459453034675, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.05607990971926985, "deviation-heading": 2.5725307289639257, "set_robot_commands": 0.07129919254916837, "deviation-center-line": 0.45714992543499433, "driven_lanedir_consec": 1.2016554007894849, "sim_compute_sim_state": 0.03034028924744705, "sim_compute_performance-ego": 0.05336393981144346, "sim_compute_robot_state-ego": 0.055468919633448806, "sim_compute_robot_state-npc0": 0.057326953986595416, "sim_compute_robot_state-npc1": 0.05521724826988132, "sim_compute_robot_state-npc2": 0.054789963809923195, "sim_compute_robot_state-npc3": 0.05395509593788235}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2226138314548056, "sim_physics": 0.02236767962009092, "survival_time": 7.89999999999998, "driven_lanedir": 1.1627936504837724, "sim_render-ego": 0.05085415930687627, "in-drivable-lane": 0, "agent_compute-ego": 0.055083129979387115, "deviation-heading": 1.9325693773858563, "set_robot_commands": 0.06910642943804778, "deviation-center-line": 0.6416536781867477, "driven_lanedir_consec": 1.1627936504837724, "sim_compute_sim_state": 0.029759376863890057, "sim_compute_performance-ego": 0.05217383481279205, "sim_compute_robot_state-ego": 0.05410906634753263, "sim_compute_robot_state-npc0": 0.056174973898296114, "sim_compute_robot_state-npc1": 0.053447714334801784, "sim_compute_robot_state-npc2": 0.05346009550215323, "sim_compute_robot_state-npc3": 0.052864553053167805}}
set_robot_commands_max0.07129919254916837
set_robot_commands_mean0.07048952797074368
set_robot_commands_median0.07071582476298015
set_robot_commands_min0.06910642943804778
sim_compute_performance-ego_max0.053406629297468394
sim_compute_performance-ego_mean0.05296681716554592
sim_compute_performance-ego_median0.05313972509824313
sim_compute_performance-ego_min0.05217383481279205
sim_compute_robot_state-ego_max0.055468919633448806
sim_compute_robot_state-ego_mean0.05445029289591278
sim_compute_robot_state-ego_median0.054206340129558855
sim_compute_robot_state-ego_min0.05368575784895155
sim_compute_robot_state-npc0_max0.057488351739862914
sim_compute_robot_state-npc0_mean0.05690518026212279
sim_compute_robot_state-npc0_median0.05707370241483053
sim_compute_robot_state-npc0_min0.056174973898296114
sim_compute_robot_state-npc1_max0.05536587776676301
sim_compute_robot_state-npc1_mean0.05467823444575048
sim_compute_robot_state-npc1_median0.05488482448789808
sim_compute_robot_state-npc1_min0.053447714334801784
sim_compute_robot_state-npc2_max0.05492313702901205
sim_compute_robot_state-npc2_mean0.05402242019763799
sim_compute_robot_state-npc2_median0.05364307440244234
sim_compute_robot_state-npc2_min0.053295830244659094
sim_compute_robot_state-npc3_max0.05400147071251502
sim_compute_robot_state-npc3_mean0.05346254799841854
sim_compute_robot_state-npc3_median0.05355755819214715
sim_compute_robot_state-npc3_min0.052864553053167805
sim_compute_sim_state_max0.03039315695403725
sim_compute_sim_state_mean0.030100049520665296
sim_compute_sim_state_median0.030128657817840576
sim_compute_sim_state_min0.029759376863890057
sim_physics_max0.025376632649411437
sim_physics_mean0.023796005031050716
sim_physics_median0.02344208130469689
sim_physics_min0.02236767962009092
sim_render-ego_max0.053516252173317805
sim_render-ego_mean0.052257507066074925
sim_render-ego_median0.052273678523237985
sim_render-ego_min0.05085415930687627
simulation-passed1
survival_time_max8.699999999999989
survival_time_mean6.269999999999988
survival_time_min3.599999999999995
No reset possible
186832684Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-98990:19:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.454483828527426
survival_time_median4.249999999999993
deviation-center-line_median0.17476676631378263
in-drivable-lane_median0.5000000000000071


other stats
agent_compute-ego_max0.05808121402089189
agent_compute-ego_mean0.05625818654186297
agent_compute-ego_median0.05663166608352328
agent_compute-ego_min0.05429150637458353
deviation-center-line_max1.0769624691982704
deviation-center-line_mean0.4252420174457075
deviation-center-line_min0.1035576329106605
deviation-heading_max3.8979512804343215
deviation-heading_mean2.0649042027772264
deviation-heading_median1.6076826642939133
deviation-heading_min0.6879298044272166
driven_any_max2.344903553354708
driven_any_mean1.066127402567735
driven_any_median0.6358898632017704
driven_any_min0.27435941849956075
driven_lanedir_consec_max2.1329750060204145
driven_lanedir_consec_mean0.8589677114762807
driven_lanedir_consec_min0.24102817314881309
driven_lanedir_max2.135020183193467
driven_lanedir_mean0.8593767469108913
driven_lanedir_median0.454483828527426
driven_lanedir_min0.24102817314881309
in-drivable-lane_max2.6500000000000377
in-drivable-lane_mean0.7500000000000085
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.344903553354708, "sim_physics": 0.02427494287490845, "survival_time": 14.950000000000076, "driven_lanedir": 2.135020183193467, "sim_render-ego": 0.05141247510910034, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.05547524929046631, "deviation-heading": 3.8979512804343215, "set_robot_commands": 0.06980074087778727, "deviation-center-line": 1.0769624691982704, "driven_lanedir_consec": 2.1329750060204145, "sim_compute_sim_state": 0.030218482812245685, "sim_compute_performance-ego": 0.052915215492248535, "sim_compute_robot_state-ego": 0.05462832450866699, "sim_compute_robot_state-npc0": 0.05694175640741984, "sim_compute_robot_state-npc1": 0.054105887413024904, "sim_compute_robot_state-npc2": 0.053076585133870445, "sim_compute_robot_state-npc3": 0.05324583848317464}, "udem1-1-0": {"driven_any": 0.27435941849956075, "sim_physics": 0.023740774393081664, "survival_time": 2.000000000000001, "driven_lanedir": 0.24102817314881309, "sim_render-ego": 0.04988009929656982, "in-drivable-lane": 0, "agent_compute-ego": 0.056811296939849855, "deviation-heading": 0.6879298044272166, "set_robot_commands": 0.06904042959213257, "deviation-center-line": 0.1035576329106605, "driven_lanedir_consec": 0.24102817314881309, "sim_compute_sim_state": 0.029123693704605103, "sim_compute_performance-ego": 0.05058012008666992, "sim_compute_robot_state-ego": 0.05241824984550477, "sim_compute_robot_state-npc0": 0.054154354333877566, "sim_compute_robot_state-npc1": 0.051518940925598146, "sim_compute_robot_state-npc2": 0.053136271238327024, "sim_compute_robot_state-npc3": 0.05329398512840271}, "udem1-2-0": {"driven_any": 0.6358898632017704, "sim_physics": 0.02922798044541303, "survival_time": 4.249999999999993, "driven_lanedir": 0.454483828527426, "sim_render-ego": 0.051445784288294175, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.05429150637458353, "deviation-heading": 1.6076826642939133, "set_robot_commands": 0.06961263207828297, "deviation-center-line": 0.17476676631378263, "driven_lanedir_consec": 0.454483828527426, "sim_compute_sim_state": 0.030335165472591623, "sim_compute_performance-ego": 0.05415046916288488, "sim_compute_robot_state-ego": 0.05606249640969669, "sim_compute_robot_state-npc0": 0.0546811861150405, "sim_compute_robot_state-npc1": 0.05266191819134881, "sim_compute_robot_state-npc2": 0.05327790204216453, "sim_compute_robot_state-npc3": 0.053948284597957835}, "udem1-3-0": {"driven_any": 0.282404280689763, "sim_physics": 0.024668949406321455, "survival_time": 2.0500000000000007, "driven_lanedir": 0.2481629332089399, "sim_render-ego": 0.05414450459363984, "in-drivable-lane": 0, "agent_compute-ego": 0.05808121402089189, "deviation-heading": 0.7199208906938868, "set_robot_commands": 0.06958667824908, "deviation-center-line": 0.11031312866428576, "driven_lanedir_consec": 0.2481629332089399, "sim_compute_sim_state": 0.030355453491210938, "sim_compute_performance-ego": 0.05290578632819944, "sim_compute_robot_state-ego": 0.05371289718441847, "sim_compute_robot_state-npc0": 0.05692671566474729, "sim_compute_robot_state-npc1": 0.05608340589011588, "sim_compute_robot_state-npc2": 0.05376557024513803, "sim_compute_robot_state-npc3": 0.05378395755116532}, "udem1-4-0": {"driven_any": 1.793079897092872, "sim_physics": 0.025921218780450943, "survival_time": 11.450000000000028, "driven_lanedir": 1.218188616475811, "sim_render-ego": 0.051561524253745265, "in-drivable-lane": 2.6500000000000377, "agent_compute-ego": 0.05663166608352328, "deviation-heading": 3.4110363740367937, "set_robot_commands": 0.07002576157515747, "deviation-center-line": 0.6606100901415383, "driven_lanedir_consec": 1.218188616475811, "sim_compute_sim_state": 0.02975873030949888, "sim_compute_performance-ego": 0.052350525252163146, "sim_compute_robot_state-ego": 0.05344704873697206, "sim_compute_robot_state-npc0": 0.05789561354957814, "sim_compute_robot_state-npc1": 0.05429093598278329, "sim_compute_robot_state-npc2": 0.05342063008437511, "sim_compute_robot_state-npc3": 0.053489352938389675}}
set_robot_commands_max0.07002576157515747
set_robot_commands_mean0.06961324847448806
set_robot_commands_median0.06961263207828297
set_robot_commands_min0.06904042959213257
sim_compute_performance-ego_max0.05415046916288488
sim_compute_performance-ego_mean0.052580423264433185
sim_compute_performance-ego_median0.05290578632819944
sim_compute_performance-ego_min0.05058012008666992
sim_compute_robot_state-ego_max0.05606249640969669
sim_compute_robot_state-ego_mean0.05405380333705179
sim_compute_robot_state-ego_median0.05371289718441847
sim_compute_robot_state-ego_min0.05241824984550477
sim_compute_robot_state-npc0_max0.05789561354957814
sim_compute_robot_state-npc0_mean0.05611992521413266
sim_compute_robot_state-npc0_median0.05692671566474729
sim_compute_robot_state-npc0_min0.054154354333877566
sim_compute_robot_state-npc1_max0.05608340589011588
sim_compute_robot_state-npc1_mean0.0537322176805742
sim_compute_robot_state-npc1_median0.054105887413024904
sim_compute_robot_state-npc1_min0.051518940925598146
sim_compute_robot_state-npc2_max0.05376557024513803
sim_compute_robot_state-npc2_mean0.05333539174877503
sim_compute_robot_state-npc2_median0.05327790204216453
sim_compute_robot_state-npc2_min0.053076585133870445
sim_compute_robot_state-npc3_max0.053948284597957835
sim_compute_robot_state-npc3_mean0.05355228373981804
sim_compute_robot_state-npc3_median0.053489352938389675
sim_compute_robot_state-npc3_min0.05324583848317464
sim_compute_sim_state_max0.030355453491210938
sim_compute_sim_state_mean0.029958305158030447
sim_compute_sim_state_median0.030218482812245685
sim_compute_sim_state_min0.029123693704605103
sim_physics_max0.02922798044541303
sim_physics_mean0.025566773180035102
sim_physics_median0.024668949406321455
sim_physics_min0.023740774393081664
sim_render-ego_max0.05414450459363984
sim_render-ego_mean0.05168887750826989
sim_render-ego_median0.051445784288294175
sim_render-ego_min0.04988009929656982
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.940000000000021
survival_time_min2.000000000000001
No reset possible
186762708Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-98990:21:07
Waited 1201 seconds [...]
Waited 1201 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186622723jiang pengtest for ppoaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-98990:01:08
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186562739Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationfailednoidsc-rudolf-98990:01:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186522746Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationfailednoidsc-rudolf-98990:01:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
186472755Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-98990:05:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487126868955534
survival_time_median2.3499999999999996
deviation-center-line_median0.11041377901227004
in-drivable-lane_median0


other stats
agent_compute-ego_max0.062332015288503545
agent_compute-ego_mean0.059486565552821544
agent_compute-ego_median0.06110398585979755
agent_compute-ego_min0.05547498134856529
deviation-center-line_max0.12791029264553877
deviation-center-line_mean0.10518143804729678
deviation-center-line_min0.06917252689874298
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550056
deviation-heading_median0.3636820162885191
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903463
driven_any_median0.6642785413158997
driven_any_min0.3059207793076624
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.5880385612453785
driven_lanedir_consec_min0.2802213062291129
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.5880385612453785
driven_lanedir_median0.5487126868955534
driven_lanedir_min0.2802213062291129
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.01665233984226134, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05605606625719768, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06117770729995355, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07550948131375196, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03564516218697152, "sim_compute_performance-ego": 0.05723495308945819, "sim_compute_robot_state-ego": 0.05886892283835062}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.014020369603083683, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.05772613562070406, "in-drivable-lane": 0, "agent_compute-ego": 0.06110398585979755, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.07511232449458195, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.03601309886345497, "sim_compute_performance-ego": 0.056563881727365345, "sim_compute_robot_state-ego": 0.05869870919447679}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.01555960736376174, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.05537518034590051, "in-drivable-lane": 0, "agent_compute-ego": 0.05547498134856529, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07080759900681516, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03545799153916379, "sim_compute_performance-ego": 0.05639389727977996, "sim_compute_robot_state-ego": 0.05834006248636449}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.01728659409743089, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.05548245566231864, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.05734413796728784, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07231780722901061, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.034276333484020864, "sim_compute_performance-ego": 0.05804552350725446, "sim_compute_robot_state-ego": 0.059540780036004035}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.01530664845516807, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.05940177566126773, "in-drivable-lane": 0, "agent_compute-ego": 0.062332015288503545, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.0737218794069792, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.037081279252704824, "sim_compute_performance-ego": 0.05802270613218609, "sim_compute_robot_state-ego": 0.06053895071933144}}
set_robot_commands_max0.07550948131375196
set_robot_commands_mean0.07349381829022777
set_robot_commands_median0.0737218794069792
set_robot_commands_min0.07080759900681516
sim_compute_performance-ego_max0.05804552350725446
sim_compute_performance-ego_mean0.05725219234720881
sim_compute_performance-ego_median0.05723495308945819
sim_compute_performance-ego_min0.05639389727977996
sim_compute_robot_state-ego_max0.06053895071933144
sim_compute_robot_state-ego_mean0.05919748505490549
sim_compute_robot_state-ego_median0.05886892283835062
sim_compute_robot_state-ego_min0.05834006248636449
sim_compute_sim_state_max0.037081279252704824
sim_compute_sim_state_mean0.0356947730652632
sim_compute_sim_state_median0.03564516218697152
sim_compute_sim_state_min0.034276333484020864
sim_physics_max0.01728659409743089
sim_physics_mean0.015765111872341146
sim_physics_median0.01555960736376174
sim_physics_min0.014020369603083683
sim_render-ego_max0.05940177566126773
sim_render-ego_mean0.056808322709477735
sim_render-ego_median0.05605606625719768
sim_render-ego_min0.05537518034590051
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
186452759Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-98990:09:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487132829419987
survival_time_median2.3499999999999996
deviation-center-line_median0.11041400208354252
in-drivable-lane_median0


other stats
agent_compute-ego_max0.061617673711573825
agent_compute-ego_mean0.05902195968419888
agent_compute-ego_median0.05922774892104299
agent_compute-ego_min0.05684254719660832
deviation-center-line_max0.1279102488429998
deviation-center-line_mean0.10518151035257096
deviation-center-line_min0.06917270915638028
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550057
deviation-heading_median0.36368201628851926
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903464
driven_any_median0.6642785413159032
driven_any_min0.3059207793076613
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.588039443394122
driven_lanedir_consec_min0.28022225990343186
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.588039443394122
driven_lanedir_median0.5487132829419987
driven_lanedir_min0.28022225990343186
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.0247599671526653, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05665681129548608, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.05940453017630228, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07534829290901743, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.032710752836087854, "sim_compute_performance-ego": 0.05782512920658763, "sim_compute_robot_state-ego": 0.05828064534722305, "sim_compute_robot_state-npc0": 0.061969815230951075, "sim_compute_robot_state-npc1": 0.059117759146341466, "sim_compute_robot_state-npc2": 0.058821428112867405, "sim_compute_robot_state-npc3": 0.05754933996898372}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.024721475747915413, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.053156027427086465, "in-drivable-lane": 0, "agent_compute-ego": 0.05684254719660832, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.06928689663226788, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.031590755169208236, "sim_compute_performance-ego": 0.05483873990865854, "sim_compute_robot_state-ego": 0.05866401929121751, "sim_compute_robot_state-npc0": 0.06030853895040659, "sim_compute_robot_state-npc1": 0.057600745787987344, "sim_compute_robot_state-npc2": 0.05632743468651405, "sim_compute_robot_state-npc3": 0.055878556691683255}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.024097351317710063, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.055320323781764255, "in-drivable-lane": 0, "agent_compute-ego": 0.061617673711573825, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07140025179436867, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.030788898468017575, "sim_compute_performance-ego": 0.05630089881572318, "sim_compute_robot_state-ego": 0.05582623278841059, "sim_compute_robot_state-npc0": 0.058982991157694065, "sim_compute_robot_state-npc1": 0.05609002519161143, "sim_compute_robot_state-npc2": 0.0545811450227778, "sim_compute_robot_state-npc3": 0.05421720667088285}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.02606726216745901, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.05738742534930889, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.05801729841546698, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.0731415093600095, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.033035370019766, "sim_compute_performance-ego": 0.05547541314428979, "sim_compute_robot_state-ego": 0.05761284094590407, "sim_compute_robot_state-npc0": 0.06213538201300652, "sim_compute_robot_state-npc1": 0.057669023891071695, "sim_compute_robot_state-npc2": 0.05669703850379357, "sim_compute_robot_state-npc3": 0.05692923199999463}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.021774222976283023, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.055606842041015625, "in-drivable-lane": 0, "agent_compute-ego": 0.05922774892104299, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07236352719758686, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.033256850744548594, "sim_compute_performance-ego": 0.05552541582207931, "sim_compute_robot_state-ego": 0.0579489971462049, "sim_compute_robot_state-npc0": 0.06181117107993678, "sim_compute_robot_state-npc1": 0.057581819986042226, "sim_compute_robot_state-npc2": 0.05632901819128739, "sim_compute_robot_state-npc3": 0.05749657906984028}}
set_robot_commands_max0.07534829290901743
set_robot_commands_mean0.07230809557865006
set_robot_commands_median0.07236352719758686
set_robot_commands_min0.06928689663226788
sim_compute_performance-ego_max0.05782512920658763
sim_compute_performance-ego_mean0.055993119379467694
sim_compute_performance-ego_median0.05552541582207931
sim_compute_performance-ego_min0.05483873990865854
sim_compute_robot_state-ego_max0.05866401929121751
sim_compute_robot_state-ego_mean0.05766654710379202
sim_compute_robot_state-ego_median0.0579489971462049
sim_compute_robot_state-ego_min0.05582623278841059
sim_compute_robot_state-npc0_max0.06213538201300652
sim_compute_robot_state-npc0_mean0.061041579686399006
sim_compute_robot_state-npc0_median0.06181117107993678
sim_compute_robot_state-npc0_min0.058982991157694065
sim_compute_robot_state-npc1_max0.059117759146341466
sim_compute_robot_state-npc1_mean0.05761187480061083
sim_compute_robot_state-npc1_median0.057600745787987344
sim_compute_robot_state-npc1_min0.05609002519161143
sim_compute_robot_state-npc2_max0.058821428112867405
sim_compute_robot_state-npc2_mean0.05655121290344804
sim_compute_robot_state-npc2_median0.05632901819128739
sim_compute_robot_state-npc2_min0.0545811450227778
sim_compute_robot_state-npc3_max0.05754933996898372
sim_compute_robot_state-npc3_mean0.05641418288027694
sim_compute_robot_state-npc3_median0.05692923199999463
sim_compute_robot_state-npc3_min0.05421720667088285
sim_compute_sim_state_max0.033256850744548594
sim_compute_sim_state_mean0.03227652544752565
sim_compute_sim_state_median0.032710752836087854
sim_compute_sim_state_min0.030788898468017575
sim_physics_max0.02606726216745901
sim_physics_mean0.02428405587240656
sim_physics_median0.024721475747915413
sim_physics_min0.021774222976283023
sim_render-ego_max0.05738742534930889
sim_render-ego_mean0.055625485978932264
sim_render-ego_median0.055606842041015625
sim_render-ego_min0.053156027427086465
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
186262804Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agentaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-98990:05:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.14709629652635106
agent_compute-ego_mean0.14031240510313628
agent_compute-ego_median0.1397546880385455
agent_compute-ego_min0.13378036518891653
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.015917876981339365, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06152491299611217, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14709629652635106, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07574245164979179, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.04066364720182599, "sim_compute_performance-ego": 0.06235685888326393, "sim_compute_robot_state-ego": 0.06307993295057765}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.01541015776720914, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06550067663192749, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.1463812752203508, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.0768879922953519, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.04192177274010398, "sim_compute_performance-ego": 0.06600124185735529, "sim_compute_robot_state-ego": 0.06358071348883888}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.015310239791870118, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.060655334260728624, "in-drivable-lane": 0, "agent_compute-ego": 0.13454940054151748, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07426274087693956, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.038418091668023006, "sim_compute_performance-ego": 0.058368221918741865, "sim_compute_robot_state-ego": 0.0602551089392768}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.01531467338403066, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.062344759702682495, "in-drivable-lane": 0, "agent_compute-ego": 0.13378036518891653, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0730134646097819, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.038038561741511025, "sim_compute_performance-ego": 0.06112500031789144, "sim_compute_robot_state-ego": 0.06214782595634461}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.016261924715603098, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.05726888600517722, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1397546880385455, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07635311519398409, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.035323490114773023, "sim_compute_performance-ego": 0.05813402638715856, "sim_compute_robot_state-ego": 0.05856745383318733}}
set_robot_commands_max0.0768879922953519
set_robot_commands_mean0.07525195292516985
set_robot_commands_median0.07574245164979179
set_robot_commands_min0.0730134646097819
sim_compute_performance-ego_max0.06600124185735529
sim_compute_performance-ego_mean0.06119706987288222
sim_compute_performance-ego_median0.06112500031789144
sim_compute_performance-ego_min0.05813402638715856
sim_compute_robot_state-ego_max0.06358071348883888
sim_compute_robot_state-ego_mean0.06152620703364505
sim_compute_robot_state-ego_median0.06214782595634461
sim_compute_robot_state-ego_min0.05856745383318733
sim_compute_sim_state_max0.04192177274010398
sim_compute_sim_state_mean0.038873112693247405
sim_compute_sim_state_median0.038418091668023006
sim_compute_sim_state_min0.035323490114773023
sim_physics_max0.016261924715603098
sim_physics_mean0.015642974528010476
sim_physics_median0.01541015776720914
sim_physics_min0.015310239791870118
sim_render-ego_max0.06550067663192749
sim_render-ego_mean0.0614589139193256
sim_render-ego_median0.06152491299611217
sim_render-ego_min0.05726888600517722
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
186122813Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agentaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-98990:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9585846921942625
survival_time_median3.099999999999997
deviation-center-line_median0.13094298490844536
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.15061047030430214
agent_compute-ego_mean0.14793210438278176
agent_compute-ego_median0.14707441483774492
agent_compute-ego_min0.14529509014553493
deviation-center-line_max0.1934674474960452
deviation-center-line_mean0.10884100878338444
deviation-center-line_min0.032459786530846635
deviation-heading_max0.7356226190209126
deviation-heading_mean0.3809403978290703
deviation-heading_median0.2855944786164235
deviation-heading_min0.22149655353610215
driven_any_max2.029872313755146
driven_any_mean1.3151025945779695
driven_any_median1.2614050434743518
driven_any_min1.0057903566516673
driven_lanedir_consec_max1.454438818080216
driven_lanedir_consec_mean1.0334629747873598
driven_lanedir_consec_min0.6769768591939229
driven_lanedir_max1.4545895120774182
driven_lanedir_mean1.0334931135868004
driven_lanedir_median0.9585846921942625
driven_lanedir_min0.6769768591939229
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.539999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.030808463929191468, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06173482016911582, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.14529509014553493, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.0776652835664295, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.03601343669588604, "sim_compute_performance-ego": 0.060196108288235135, "sim_compute_robot_state-ego": 0.06346906556023492, "sim_compute_robot_state-npc0": 0.0725844247000558, "sim_compute_robot_state-npc1": 0.06548003544883123, "sim_compute_robot_state-npc2": 0.0640875120011587, "sim_compute_robot_state-npc3": 0.06415523423088922}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.028119218115713083, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.06460302951289158, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.15061047030430214, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07848191728778914, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03478635993658328, "sim_compute_performance-ego": 0.06430702115975175, "sim_compute_robot_state-ego": 0.06494534249399223, "sim_compute_robot_state-npc0": 0.07353784523758233, "sim_compute_robot_state-npc1": 0.067917594722673, "sim_compute_robot_state-npc2": 0.06360104037266151, "sim_compute_robot_state-npc3": 0.06485580930522844}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.032108972149510535, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.06770546974674348, "in-drivable-lane": 0, "agent_compute-ego": 0.14707441483774492, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.08300011773263255, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.03525920068064044, "sim_compute_performance-ego": 0.064436508763221, "sim_compute_robot_state-ego": 0.0618076785918205, "sim_compute_robot_state-npc0": 0.07508611679077148, "sim_compute_robot_state-npc1": 0.06695598940695485, "sim_compute_robot_state-npc2": 0.06482996863703575, "sim_compute_robot_state-npc3": 0.06461971805941674}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.03135328343574037, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.0653971459003205, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.1463527907716467, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.08201166163099573, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03709863855483684, "sim_compute_performance-ego": 0.06449132523638137, "sim_compute_robot_state-ego": 0.06432378799357313, "sim_compute_robot_state-npc0": 0.07304704189300537, "sim_compute_robot_state-npc1": 0.06695656573518793, "sim_compute_robot_state-npc2": 0.06534159944412556, "sim_compute_robot_state-npc3": 0.06608997000024673}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.02776756653418908, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.06401724081773025, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.15032775585468, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07750038458750798, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03596236614080576, "sim_compute_performance-ego": 0.06414208045372596, "sim_compute_robot_state-ego": 0.062027958723214954, "sim_compute_robot_state-npc0": 0.07105379379712619, "sim_compute_robot_state-npc1": 0.06553908036305355, "sim_compute_robot_state-npc2": 0.06283743106401883, "sim_compute_robot_state-npc3": 0.06554745252315815}}
set_robot_commands_max0.08300011773263255
set_robot_commands_mean0.07973187296107097
set_robot_commands_median0.07848191728778914
set_robot_commands_min0.07750038458750798
sim_compute_performance-ego_max0.06449132523638137
sim_compute_performance-ego_mean0.06351460878026305
sim_compute_performance-ego_median0.06430702115975175
sim_compute_performance-ego_min0.060196108288235135
sim_compute_robot_state-ego_max0.06494534249399223
sim_compute_robot_state-ego_mean0.06331476667256715
sim_compute_robot_state-ego_median0.06346906556023492
sim_compute_robot_state-ego_min0.0618076785918205
sim_compute_robot_state-npc0_max0.07508611679077148
sim_compute_robot_state-npc0_mean0.07306184448370823
sim_compute_robot_state-npc0_median0.07304704189300537
sim_compute_robot_state-npc0_min0.07105379379712619
sim_compute_robot_state-npc1_max0.067917594722673
sim_compute_robot_state-npc1_mean0.06656985313534011
sim_compute_robot_state-npc1_median0.06695598940695485
sim_compute_robot_state-npc1_min0.06548003544883123
sim_compute_robot_state-npc2_max0.06534159944412556
sim_compute_robot_state-npc2_mean0.06413951030380008
sim_compute_robot_state-npc2_median0.0640875120011587
sim_compute_robot_state-npc2_min0.06283743106401883
sim_compute_robot_state-npc3_max0.06608997000024673
sim_compute_robot_state-npc3_mean0.06505363682378786
sim_compute_robot_state-npc3_median0.06485580930522844
sim_compute_robot_state-npc3_min0.06415523423088922
sim_compute_sim_state_max0.03709863855483684
sim_compute_sim_state_mean0.035824000401750475
sim_compute_sim_state_median0.03596236614080576
sim_compute_sim_state_min0.03478635993658328
sim_physics_max0.032108972149510535
sim_physics_mean0.03003150083286891
sim_physics_median0.030808463929191468
sim_physics_min0.02776756653418908
sim_render-ego_max0.06770546974674348
sim_render-ego_mean0.06469154122936033
sim_render-ego_median0.06460302951289158
sim_render-ego_min0.06173482016911582
simulation-passed1
survival_time_max4.699999999999991
survival_time_mean3.2199999999999966
survival_time_min2.549999999999999
No reset possible