AI Driving Olympics Home Challenges Submissions Jobs

Submission 2707

Submission2707
Competingyes
Challengeaido2-LFV-sim-testing
UserRamiNaim
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 22818
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessing50
User priority

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
228182707RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerroryes-0:52:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212152707RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessno-1:02:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9417440026442327
survival_time_median14.950000000000076
deviation-center-line_median0.9238011415860462
in-drivable-lane_median2.3999999999999915


other stats
agent_compute-ego_max0.05994925101598104
agent_compute-ego_mean0.05639258413678589
agent_compute-ego_median0.056250300407409665
agent_compute-ego_min0.0540994143486023
deviation-center-line_max1.363339676333421
deviation-center-line_mean0.8950889610932073
deviation-center-line_min0.14812745372738273
deviation-heading_max9.118318235148962
deviation-heading_mean5.456572652852311
deviation-heading_median5.72134353422308
deviation-heading_min0.3908742305245808
driven_any_max2.348983687668645
driven_any_mean2.011222529309175
driven_any_median2.348619556372972
driven_any_min0.2115333872677981
driven_lanedir_consec_max2.1600076250758975
driven_lanedir_consec_mean1.0264342648535183
driven_lanedir_consec_min0.20102583008842867
driven_lanedir_max2.1600076250758975
driven_lanedir_mean1.369190670041699
driven_lanedir_median1.4970535866670844
driven_lanedir_min0.20102583008842867
in-drivable-lane_max3.8500000000000143
in-drivable-lane_mean2.0400000000000107
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.332070914793717, "sim_physics": 0.09855101108551026, "survival_time": 14.950000000000076, "driven_lanedir": 2.1600076250758975, "sim_render-ego": 0.051806774934132896, "in-drivable-lane": 0, "agent_compute-ego": 0.05753300666809082, "deviation-heading": 4.377223884743198, "set_robot_commands": 0.07703704277674357, "deviation-center-line": 1.1405734885156409, "driven_lanedir_consec": 2.1600076250758975, "sim_compute_sim_state": 0.03238776127497355, "sim_compute_performance-ego": 0.05604317347208659, "sim_compute_robot_state-ego": 0.058873307704925534, "sim_compute_robot_state-npc0": 0.05814898729324341, "sim_compute_robot_state-npc1": 0.0578292981783549, "sim_compute_robot_state-npc2": 0.05708003838857015, "sim_compute_robot_state-npc3": 0.05670909643173218}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.348747490201881, "sim_physics": 0.10066606283187866, "survival_time": 14.950000000000076, "driven_lanedir": 1.7096106881967308, "sim_render-ego": 0.05174002965291341, "in-drivable-lane": 1.5500000000000096, "agent_compute-ego": 0.05736178954442342, "deviation-heading": 7.064134685653317, "set_robot_commands": 0.07648484865824381, "deviation-center-line": 0.919093192702742, "driven_lanedir_consec": 0.8411535448703864, "sim_compute_sim_state": 0.03299037535985311, "sim_compute_performance-ego": 0.05639552513758341, "sim_compute_robot_state-ego": 0.05901617129643758, "sim_compute_robot_state-npc0": 0.058575147787729896, "sim_compute_robot_state-npc1": 0.058614497184753415, "sim_compute_robot_state-npc2": 0.0577751620610555, "sim_compute_robot_state-npc3": 0.05951220115025838}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2115333872677981, "sim_physics": 0.11395609017574426, "survival_time": 1.6500000000000008, "driven_lanedir": 0.20102583008842867, "sim_render-ego": 0.0523037187980883, "in-drivable-lane": 0, "agent_compute-ego": 0.05866021820993134, "deviation-heading": 0.3908742305245808, "set_robot_commands": 0.07890223011826024, "deviation-center-line": 0.14812745372738273, "driven_lanedir_consec": 0.20102583008842867, "sim_compute_sim_state": 0.03391181338917126, "sim_compute_performance-ego": 0.05670054031140877, "sim_compute_robot_state-ego": 0.06062542308460583, "sim_compute_robot_state-npc0": 0.0594818014087099, "sim_compute_robot_state-npc1": 0.06089667840437456, "sim_compute_robot_state-npc2": 0.05985877008149118, "sim_compute_robot_state-npc3": 0.05980609402512059}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3485581403778433, "sim_physics": 0.10282312393188477, "survival_time": 14.950000000000076, "driven_lanedir": 1.5329546922678952, "sim_render-ego": 0.053945143222808835, "in-drivable-lane": 2.5500000000000043, "agent_compute-ego": 0.05994925101598104, "deviation-heading": 6.643359362554916, "set_robot_commands": 0.0787211028734843, "deviation-center-line": 1.1548809103977586, "driven_lanedir_consec": 1.3243668677514036, "sim_compute_sim_state": 0.03399364074071248, "sim_compute_performance-ego": 0.058274451891581217, "sim_compute_robot_state-ego": 0.06115551710128784, "sim_compute_robot_state-npc0": 0.05985873858133952, "sim_compute_robot_state-npc1": 0.059169947306315106, "sim_compute_robot_state-npc2": 0.05969702879587809, "sim_compute_robot_state-npc3": 0.05975227435429891}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.348619556372972, "sim_physics": 0.0994043763478597, "survival_time": 14.950000000000076, "driven_lanedir": 1.3630725319727386, "sim_render-ego": 0.05203773419062296, "in-drivable-lane": 3.650000000000015, "agent_compute-ego": 0.05784801006317139, "deviation-heading": 6.272733778055803, "set_robot_commands": 0.07767489512761434, "deviation-center-line": 0.954455530237288, "driven_lanedir_consec": 0.827239197014424, "sim_compute_sim_state": 0.0329305362701416, "sim_compute_performance-ego": 0.05679171164830526, "sim_compute_robot_state-ego": 0.05896047115325928, "sim_compute_robot_state-npc0": 0.0585701068242391, "sim_compute_robot_state-npc1": 0.057901693185170494, "sim_compute_robot_state-npc2": 0.0579097588857015, "sim_compute_robot_state-npc3": 0.05838086128234863}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.348698568741479, "sim_physics": 0.0955595056215922, "survival_time": 14.950000000000076, "driven_lanedir": 1.6275034621201503, "sim_render-ego": 0.05038265625635783, "in-drivable-lane": 1.2000000000000002, "agent_compute-ego": 0.05574737707773844, "deviation-heading": 8.493366027056952, "set_robot_commands": 0.07512874841690063, "deviation-center-line": 1.0977123461950262, "driven_lanedir_consec": 1.2019169658021926, "sim_compute_sim_state": 0.031347883542378746, "sim_compute_performance-ego": 0.05441954533259074, "sim_compute_robot_state-ego": 0.05724750200907389, "sim_compute_robot_state-npc0": 0.05662332693735758, "sim_compute_robot_state-npc1": 0.05750384648640951, "sim_compute_robot_state-npc2": 0.05578512271245321, "sim_compute_robot_state-npc3": 0.055760354200998945}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.3488006680181983, "sim_physics": 0.092086660861969, "survival_time": 14.950000000000076, "driven_lanedir": 1.455563589179649, "sim_render-ego": 0.04918985843658447, "in-drivable-lane": 3.8500000000000143, "agent_compute-ego": 0.056250300407409665, "deviation-heading": 4.775698704211189, "set_robot_commands": 0.07406596819559733, "deviation-center-line": 0.9238011415860462, "driven_lanedir_consec": 1.0936208634401687, "sim_compute_sim_state": 0.030950674215952555, "sim_compute_performance-ego": 0.05352877298990885, "sim_compute_robot_state-ego": 0.05590632359186808, "sim_compute_robot_state-npc0": 0.05554043451944987, "sim_compute_robot_state-npc1": 0.05493294239044189, "sim_compute_robot_state-npc2": 0.055244688193003336, "sim_compute_robot_state-npc3": 0.055012136300404864}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.669502266218026, "sim_physics": 0.09362474812401664, "survival_time": 4.499999999999992, "driven_lanedir": 0.3560005409517363, "sim_render-ego": 0.049346486727396645, "in-drivable-lane": 1.15, "agent_compute-ego": 0.05554759237501356, "deviation-heading": 2.119418082898662, "set_robot_commands": 0.07450510660807291, "deviation-center-line": 0.2941598104144824, "driven_lanedir_consec": 0.304974323575829, "sim_compute_sim_state": 0.03105020523071289, "sim_compute_performance-ego": 0.05382778114742703, "sim_compute_robot_state-ego": 0.05638953579796685, "sim_compute_robot_state-npc0": 0.05582283867730035, "sim_compute_robot_state-npc1": 0.0550865199830797, "sim_compute_robot_state-npc2": 0.05501814683278402, "sim_compute_robot_state-npc3": 0.05530480013953315}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.348746310260567, "sim_physics": 0.08780421177546183, "survival_time": 14.950000000000076, "driven_lanedir": 1.4970535866670844, "sim_render-ego": 0.04842990716298421, "in-drivable-lane": 3.1000000000000254, "agent_compute-ego": 0.05429579734802246, "deviation-heading": 6.275619421520322, "set_robot_commands": 0.07443878332773844, "deviation-center-line": 0.8562421076754017, "driven_lanedir_consec": 1.0179172644383625, "sim_compute_sim_state": 0.03079743226369222, "sim_compute_performance-ego": 0.05335508426030477, "sim_compute_robot_state-ego": 0.05529518445332845, "sim_compute_robot_state-npc0": 0.05490435123443604, "sim_compute_robot_state-npc1": 0.05480835914611817, "sim_compute_robot_state-npc2": 0.05462559938430786, "sim_compute_robot_state-npc3": 0.05439823627471923}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.3486834897467608, "sim_physics": 0.09496131658554076, "survival_time": 14.950000000000076, "driven_lanedir": 1.5648293978233747, "sim_render-ego": 0.04900658289591471, "in-drivable-lane": 2.950000000000033, "agent_compute-ego": 0.05446165959040323, "deviation-heading": 5.72134353422308, "set_robot_commands": 0.07400011301040649, "deviation-center-line": 0.8677746798172702, "driven_lanedir_consec": 1.4085157109166009, "sim_compute_sim_state": 0.030678380330403647, "sim_compute_performance-ego": 0.05314722776412964, "sim_compute_robot_state-ego": 0.0554493776957194, "sim_compute_robot_state-npc0": 0.055263910293579105, "sim_compute_robot_state-npc1": 0.05496734778086344, "sim_compute_robot_state-npc2": 0.05453003644943237, "sim_compute_robot_state-npc3": 0.05418832619984944}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.348983687668645, "sim_physics": 0.09045597076416016, "survival_time": 14.950000000000076, "driven_lanedir": 2.1383270007906536, "sim_render-ego": 0.04930612325668335, "in-drivable-lane": 0, "agent_compute-ego": 0.057035890420277915, "deviation-heading": 5.135670860191942, "set_robot_commands": 0.07353862126668294, "deviation-center-line": 1.363339676333421, "driven_lanedir_consec": 2.1383270007906536, "sim_compute_sim_state": 0.03076904853185018, "sim_compute_performance-ego": 0.0530001950263977, "sim_compute_robot_state-ego": 0.05544454097747803, "sim_compute_robot_state-npc0": 0.05465036233266195, "sim_compute_robot_state-npc1": 0.0547415804862976, "sim_compute_robot_state-npc2": 0.05467416683832804, "sim_compute_robot_state-npc3": 0.054420767625172936}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.348886501783089, "sim_physics": 0.08739651600519815, "survival_time": 14.950000000000076, "driven_lanedir": 1.5009885619933934, "sim_render-ego": 0.04897803068161011, "in-drivable-lane": 3.650000000000039, "agent_compute-ego": 0.0540994143486023, "deviation-heading": 5.128391376574731, "set_robot_commands": 0.07321349700291951, "deviation-center-line": 0.8286356977096659, "driven_lanedir_consec": 0.9417440026442327, "sim_compute_sim_state": 0.030621069272359212, "sim_compute_performance-ego": 0.054756588141123455, "sim_compute_robot_state-ego": 0.05573645273844401, "sim_compute_robot_state-npc0": 0.05470526138941447, "sim_compute_robot_state-npc1": 0.05424781481424967, "sim_compute_robot_state-npc2": 0.05440293947855632, "sim_compute_robot_state-npc3": 0.05436269919077555}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.348521498657651, "sim_physics": 0.0918245299657186, "survival_time": 14.950000000000076, "driven_lanedir": 1.4509732981751784, "sim_render-ego": 0.048661999702453614, "in-drivable-lane": 1.8000000000000087, "agent_compute-ego": 0.05591816902160644, "deviation-heading": 9.118318235148962, "set_robot_commands": 0.07386287450790405, "deviation-center-line": 1.2561743243515675, "driven_lanedir_consec": 0.733144585919354, "sim_compute_sim_state": 0.030663621425628663, "sim_compute_performance-ego": 0.05336751302083333, "sim_compute_robot_state-ego": 0.055287543137868246, "sim_compute_robot_state-npc0": 0.054875555833180746, "sim_compute_robot_state-npc1": 0.05472162882486979, "sim_compute_robot_state-npc2": 0.05478452682495117, "sim_compute_robot_state-npc3": 0.0542074187596639}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.119473080813021, "sim_physics": 0.09442130670155564, "survival_time": 7.299999999999982, "driven_lanedir": 0.6089410595588141, "sim_render-ego": 0.04857054311935216, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.05633677358496679, "deviation-heading": 2.1219314606980024, "set_robot_commands": 0.07331232828636693, "deviation-center-line": 0.5009091889694232, "driven_lanedir_consec": 0.47456280495915193, "sim_compute_sim_state": 0.03057815277413146, "sim_compute_performance-ego": 0.05318515594691446, "sim_compute_robot_state-ego": 0.055164337158203125, "sim_compute_robot_state-npc0": 0.05438323870097121, "sim_compute_robot_state-npc1": 0.05390418555638562, "sim_compute_robot_state-npc2": 0.05413169730199526, "sim_compute_robot_state-npc3": 0.05362495820816249}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.3485123787159696, "sim_physics": 0.09219703594843548, "survival_time": 14.950000000000076, "driven_lanedir": 1.3710081857637588, "sim_render-ego": 0.04937123060226441, "in-drivable-lane": 2.7500000000000195, "agent_compute-ego": 0.0548435123761495, "deviation-heading": 8.210506148728994, "set_robot_commands": 0.074593825340271, "deviation-center-line": 1.1204548677649917, "driven_lanedir_consec": 0.7279973855156925, "sim_compute_sim_state": 0.03166845480600993, "sim_compute_performance-ego": 0.05436023235321045, "sim_compute_robot_state-ego": 0.056241192022959394, "sim_compute_robot_state-npc0": 0.056152495543162026, "sim_compute_robot_state-npc1": 0.05590303421020508, "sim_compute_robot_state-npc2": 0.05549859921137492, "sim_compute_robot_state-npc3": 0.05577229420344035}}
set_robot_commands_max0.07890223011826024
set_robot_commands_mean0.0752986657011471
set_robot_commands_median0.07450510660807291
set_robot_commands_min0.07321349700291951
sim_compute_performance-ego_max0.058274451891581217
sim_compute_performance-ego_mean0.05474356656292038
sim_compute_performance-ego_median0.05436023235321045
sim_compute_performance-ego_min0.0530001950263977
sim_compute_robot_state-ego_max0.06115551710128784
sim_compute_robot_state-ego_mean0.05711952532822837
sim_compute_robot_state-ego_median0.056241192022959394
sim_compute_robot_state-ego_min0.055164337158203125
sim_compute_robot_state-npc0_max0.05985873858133952
sim_compute_robot_state-npc0_mean0.056503770490451674
sim_compute_robot_state-npc0_median0.05582283867730035
sim_compute_robot_state-npc0_min0.05438323870097121
sim_compute_robot_state-npc1_max0.06089667840437456
sim_compute_robot_state-npc1_mean0.05634862492919259
sim_compute_robot_state-npc1_median0.0550865199830797
sim_compute_robot_state-npc1_min0.05390418555638562
sim_compute_robot_state-npc2_max0.05985877008149118
sim_compute_robot_state-npc2_mean0.0560677520959922
sim_compute_robot_state-npc2_median0.055244688193003336
sim_compute_robot_state-npc2_min0.05413169730199526
sim_compute_robot_state-npc3_max0.05980609402512059
sim_compute_robot_state-npc3_mean0.056080834556431966
sim_compute_robot_state-npc3_median0.05530480013953315
sim_compute_robot_state-npc3_min0.05362495820816249
sim_compute_sim_state_max0.03399364074071248
sim_compute_sim_state_mean0.03168926996186477
sim_compute_sim_state_median0.03105020523071289
sim_compute_sim_state_min0.03057815277413146
sim_physics_max0.11395609017574426
sim_physics_mean0.0957154977817684
sim_physics_median0.09442130670155564
sim_physics_min0.08739651600519815
sim_render-ego_max0.053945143222808835
sim_render-ego_mean0.050205121309344534
sim_render-ego_median0.049346486727396645
sim_render-ego_min0.04842990716298421
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.856666666666724
survival_time_min1.6500000000000008
211692707RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationhost-errorno-0:57:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2707/step1-simulation-ip-172-31-42-167-7194-job21169/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
211272707RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationhost-errorno-0:43:43
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2707/step1-simulation-ip-172-31-25-98-2348-job21127/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
210852707RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationhost-errorno-0:58:07
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2707/step1-simulation-ip-172-31-25-98-2062-job21085/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
210712707RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationhost-errorno-0:11:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2707/step1-simulation-ip-172-31-38-104-5317-job21071/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
203952707RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessno-0:18:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3735765436876388
survival_time_median4.099999999999993
deviation-center-line_median0.3000010871348648
in-drivable-lane_median0


other stats
agent_compute-ego_max0.10673763693832768
agent_compute-ego_mean0.10034551974667225
agent_compute-ego_median0.10020739010402134
agent_compute-ego_min0.09568119404920893
deviation-center-line_max0.5048306708180472
deviation-center-line_mean0.288037127808292
deviation-center-line_min0.14995794171326127
deviation-heading_max4.132275290977632
deviation-heading_mean1.7227536647153372
deviation-heading_median0.9494178402583634
deviation-heading_min0.44122817888830096
driven_any_max1.5608916325326776
driven_any_mean0.7482586868669036
driven_any_median0.6051888307092602
driven_any_min0.22749881741451777
driven_lanedir_consec_max0.5851979391324885
driven_lanedir_consec_mean0.39546743983033206
driven_lanedir_consec_min0.21413555287343877
driven_lanedir_max0.7602786149280263
driven_lanedir_mean0.43103926996088504
driven_lanedir_median0.3735765436876388
driven_lanedir_min0.21413555287343877
in-drivable-lane_max3.400000000000011
in-drivable-lane_mean1.36
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1121797351270557, "sim_physics": 0.24156442304857736, "survival_time": 7.349999999999982, "driven_lanedir": 0.3735765436876388, "sim_render-ego": 0.07458122246930389, "in-drivable-lane": 3.3999999999999893, "agent_compute-ego": 0.1007229114065365, "deviation-heading": 2.639619114557924, "set_robot_commands": 0.1329965656306468, "deviation-center-line": 0.3322470078306945, "driven_lanedir_consec": 0.3735765436876388, "sim_compute_sim_state": 0.04579567747051213, "sim_compute_performance-ego": 0.08387442186576169, "sim_compute_robot_state-ego": 0.09868024968776572, "sim_compute_robot_state-npc0": 0.08420712931626508, "sim_compute_robot_state-npc1": 0.08259302742627202, "sim_compute_robot_state-npc2": 0.08446115701376987, "sim_compute_robot_state-npc3": 0.08267854508899507}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5608916325326776, "sim_physics": 0.24541840980302043, "survival_time": 10.050000000000008, "driven_lanedir": 0.7602786149280263, "sim_render-ego": 0.07421676317850749, "in-drivable-lane": 3.400000000000011, "agent_compute-ego": 0.09568119404920893, "deviation-heading": 4.132275290977632, "set_robot_commands": 0.12475746425230112, "deviation-center-line": 0.5048306708180472, "driven_lanedir_consec": 0.5824194642752616, "sim_compute_sim_state": 0.04661719241545568, "sim_compute_performance-ego": 0.08337724505372308, "sim_compute_robot_state-ego": 0.09849866587131176, "sim_compute_robot_state-npc0": 0.08169924797703378, "sim_compute_robot_state-npc1": 0.08278349382960382, "sim_compute_robot_state-npc2": 0.08139509822598737, "sim_compute_robot_state-npc3": 0.08340629890783509}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22749881741451777, "sim_physics": 0.23862596920558385, "survival_time": 1.7500000000000009, "driven_lanedir": 0.21413555287343877, "sim_render-ego": 0.0743117196219308, "in-drivable-lane": 0, "agent_compute-ego": 0.10020739010402134, "deviation-heading": 0.44122817888830096, "set_robot_commands": 0.13211924689156668, "deviation-center-line": 0.15314893154459228, "driven_lanedir_consec": 0.21413555287343877, "sim_compute_sim_state": 0.04787132399422782, "sim_compute_performance-ego": 0.08411129542759486, "sim_compute_robot_state-ego": 0.09978196961539132, "sim_compute_robot_state-npc0": 0.08510093007768904, "sim_compute_robot_state-npc1": 0.08650789942060198, "sim_compute_robot_state-npc2": 0.08779966490609305, "sim_compute_robot_state-npc3": 0.08668319157191685}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.23553441855100687, "sim_physics": 0.2379635837343004, "survival_time": 1.800000000000001, "driven_lanedir": 0.2220076991828326, "sim_render-ego": 0.07295554876327515, "in-drivable-lane": 0, "agent_compute-ego": 0.0983784662352668, "deviation-heading": 0.4512278988944648, "set_robot_commands": 0.12644946575164795, "deviation-center-line": 0.14995794171326127, "driven_lanedir_consec": 0.2220076991828326, "sim_compute_sim_state": 0.04800573984781901, "sim_compute_performance-ego": 0.082217984729343, "sim_compute_robot_state-ego": 0.09576551781760322, "sim_compute_robot_state-npc0": 0.08806802829106648, "sim_compute_robot_state-npc1": 0.08070152335696751, "sim_compute_robot_state-npc2": 0.08345562219619751, "sim_compute_robot_state-npc3": 0.0836170580652025}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6051888307092602, "sim_physics": 0.2023014033712992, "survival_time": 4.099999999999993, "driven_lanedir": 0.5851979391324885, "sim_render-ego": 0.08077648209362495, "in-drivable-lane": 0, "agent_compute-ego": 0.10673763693832768, "deviation-heading": 0.9494178402583634, "set_robot_commands": 0.13754577462266132, "deviation-center-line": 0.3000010871348648, "driven_lanedir_consec": 0.5851979391324885, "sim_compute_sim_state": 0.04866914342089397, "sim_compute_performance-ego": 0.09039370897339612, "sim_compute_robot_state-ego": 0.10004379981901589, "sim_compute_robot_state-npc0": 0.08652486161487859, "sim_compute_robot_state-npc1": 0.08874334940096228, "sim_compute_robot_state-npc2": 0.08835331695835764, "sim_compute_robot_state-npc3": 0.08995828686690913}}
set_robot_commands_max0.13754577462266132
set_robot_commands_mean0.13077370342976477
set_robot_commands_median0.13211924689156668
set_robot_commands_min0.12475746425230112
sim_compute_performance-ego_max0.09039370897339612
sim_compute_performance-ego_mean0.08479493120996376
sim_compute_performance-ego_median0.08387442186576169
sim_compute_performance-ego_min0.082217984729343
sim_compute_robot_state-ego_max0.10004379981901589
sim_compute_robot_state-ego_mean0.0985540405622176
sim_compute_robot_state-ego_median0.09868024968776572
sim_compute_robot_state-ego_min0.09576551781760322
sim_compute_robot_state-npc0_max0.08806802829106648
sim_compute_robot_state-npc0_mean0.08512003945538658
sim_compute_robot_state-npc0_median0.08510093007768904
sim_compute_robot_state-npc0_min0.08169924797703378
sim_compute_robot_state-npc1_max0.08874334940096228
sim_compute_robot_state-npc1_mean0.08426585868688152
sim_compute_robot_state-npc1_median0.08278349382960382
sim_compute_robot_state-npc1_min0.08070152335696751
sim_compute_robot_state-npc2_max0.08835331695835764
sim_compute_robot_state-npc2_mean0.08509297186008108
sim_compute_robot_state-npc2_median0.08446115701376987
sim_compute_robot_state-npc2_min0.08139509822598737
sim_compute_robot_state-npc3_max0.08995828686690913
sim_compute_robot_state-npc3_mean0.08526867610017172
sim_compute_robot_state-npc3_median0.0836170580652025
sim_compute_robot_state-npc3_min0.08267854508899507
sim_compute_sim_state_max0.04866914342089397
sim_compute_sim_state_mean0.04739181542978173
sim_compute_sim_state_median0.04787132399422782
sim_compute_sim_state_min0.04579567747051213
sim_physics_max0.24541840980302043
sim_physics_mean0.2331747578325562
sim_physics_median0.23862596920558385
sim_physics_min0.2023014033712992
sim_render-ego_max0.08077648209362495
sim_render-ego_mean0.07536834722532845
sim_render-ego_median0.0743117196219308
sim_render-ego_min0.07295554876327515
simulation-passed1
survival_time_max10.050000000000008
survival_time_mean5.009999999999997
survival_time_min1.7500000000000009
203712707RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationhost-errorno-0:04:43
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20371-329436', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20371-329436', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20371-329436', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
194082707RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessno-0:26:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.183261477398303
survival_time_median14.950000000000076
deviation-center-line_median0.6706332358860305
in-drivable-lane_median0.70000000000001


other stats
agent_compute-ego_max0.08288402636845907
agent_compute-ego_mean0.08147083446091297
agent_compute-ego_median0.08243078867594401
agent_compute-ego_min0.07828015907138001
deviation-center-line_max0.9305654365610976
deviation-center-line_mean0.7135206064740223
deviation-center-line_min0.4321051385628835
deviation-heading_max5.56775721116824
deviation-heading_mean4.094841427989829
deviation-heading_median4.630150302307117
deviation-heading_min0.7909882519973938
driven_any_max2.3556222661830684
driven_any_mean2.0367589545123783
driven_any_median2.35520307073673
driven_any_min0.772627441113389
driven_lanedir_consec_max2.198106216984594
driven_lanedir_consec_mean1.2657520019877055
driven_lanedir_consec_min0.7575014415192567
driven_lanedir_max2.198106216984594
driven_lanedir_mean1.640195497486945
driven_lanedir_median1.747635567312302
driven_lanedir_min0.7575014415192567
in-drivable-lane_max3.35000000000002
in-drivable-lane_mean1.330000000000004
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3447696885876965, "sim_physics": 0.03801925182342529, "survival_time": 14.950000000000076, "driven_lanedir": 1.747635567312302, "sim_render-ego": 0.06078183015187581, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.08100973447163899, "deviation-heading": 4.3216542104187505, "set_robot_commands": 0.0971023710568746, "deviation-center-line": 0.617152068505891, "driven_lanedir_consec": 1.183261477398303, "sim_compute_sim_state": 0.03824557145436605, "sim_compute_performance-ego": 0.07007643063863118, "sim_compute_robot_state-ego": 0.07171982288360595, "sim_compute_robot_state-npc0": 0.06715941747029622, "sim_compute_robot_state-npc1": 0.06784185489018758, "sim_compute_robot_state-npc2": 0.0676832143465678, "sim_compute_robot_state-npc3": 0.06854088624318441}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3556222661830684, "sim_physics": 0.03944462378819784, "survival_time": 14.950000000000076, "driven_lanedir": 2.198106216984594, "sim_render-ego": 0.06427579164505005, "in-drivable-lane": 0, "agent_compute-ego": 0.08243078867594401, "deviation-heading": 4.630150302307117, "set_robot_commands": 0.0985377009709676, "deviation-center-line": 0.6706332358860305, "driven_lanedir_consec": 2.198106216984594, "sim_compute_sim_state": 0.03901123046875, "sim_compute_performance-ego": 0.06920122464497884, "sim_compute_robot_state-ego": 0.07341202179590861, "sim_compute_robot_state-npc0": 0.06975213925043743, "sim_compute_robot_state-npc1": 0.06968554735183716, "sim_compute_robot_state-npc2": 0.0734534215927124, "sim_compute_robot_state-npc3": 0.0698073140780131}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.772627441113389, "sim_physics": 0.03968494546179678, "survival_time": 5.09999999999999, "driven_lanedir": 0.7575014415192567, "sim_render-ego": 0.05781739833308201, "in-drivable-lane": 0, "agent_compute-ego": 0.07828015907138001, "deviation-heading": 0.7909882519973938, "set_robot_commands": 0.0921612440371046, "deviation-center-line": 0.4321051385628835, "driven_lanedir_consec": 0.7575014415192567, "sim_compute_sim_state": 0.03801830843383191, "sim_compute_performance-ego": 0.06371073161854464, "sim_compute_robot_state-ego": 0.06830088063782337, "sim_compute_robot_state-npc0": 0.06488233454087201, "sim_compute_robot_state-npc1": 0.06614998041414748, "sim_compute_robot_state-npc2": 0.06870617586023667, "sim_compute_robot_state-npc3": 0.06477959483277564}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3555723059410076, "sim_physics": 0.038283207416534425, "survival_time": 14.950000000000076, "driven_lanedir": 2.0059157103455387, "sim_render-ego": 0.06381122589111328, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.08288402636845907, "deviation-heading": 5.163657164057641, "set_robot_commands": 0.10118438561757404, "deviation-center-line": 0.9305654365610976, "driven_lanedir_consec": 1.232546728061254, "sim_compute_sim_state": 0.03938105901082357, "sim_compute_performance-ego": 0.07000568707784018, "sim_compute_robot_state-ego": 0.07322371085484823, "sim_compute_robot_state-npc0": 0.06981225570042927, "sim_compute_robot_state-npc1": 0.070847593943278, "sim_compute_robot_state-npc2": 0.06954341491063436, "sim_compute_robot_state-npc3": 0.06980353991190592}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.35520307073673, "sim_physics": 0.03818076769510905, "survival_time": 14.950000000000076, "driven_lanedir": 1.4918185512730349, "sim_render-ego": 0.06373929500579834, "in-drivable-lane": 3.35000000000002, "agent_compute-ego": 0.08274946371714274, "deviation-heading": 5.56775721116824, "set_robot_commands": 0.09953969240188598, "deviation-center-line": 0.9171471528542082, "driven_lanedir_consec": 0.9573441459751206, "sim_compute_sim_state": 0.038639055093129475, "sim_compute_performance-ego": 0.06838476260503133, "sim_compute_robot_state-ego": 0.07330115636189778, "sim_compute_robot_state-npc0": 0.0692789347966512, "sim_compute_robot_state-npc1": 0.06850706656773885, "sim_compute_robot_state-npc2": 0.06806285858154297, "sim_compute_robot_state-npc3": 0.06910456418991089}}
set_robot_commands_max0.10118438561757404
set_robot_commands_mean0.09770507881688135
set_robot_commands_median0.0985377009709676
set_robot_commands_min0.0921612440371046
sim_compute_performance-ego_max0.07007643063863118
sim_compute_performance-ego_mean0.06827576731700523
sim_compute_performance-ego_median0.06920122464497884
sim_compute_performance-ego_min0.06371073161854464
sim_compute_robot_state-ego_max0.07341202179590861
sim_compute_robot_state-ego_mean0.07199151850681679
sim_compute_robot_state-ego_median0.07322371085484823
sim_compute_robot_state-ego_min0.06830088063782337
sim_compute_robot_state-npc0_max0.06981225570042927
sim_compute_robot_state-npc0_mean0.06817701635173722
sim_compute_robot_state-npc0_median0.0692789347966512
sim_compute_robot_state-npc0_min0.06488233454087201
sim_compute_robot_state-npc1_max0.070847593943278
sim_compute_robot_state-npc1_mean0.06860640863343782
sim_compute_robot_state-npc1_median0.06850706656773885
sim_compute_robot_state-npc1_min0.06614998041414748
sim_compute_robot_state-npc2_max0.0734534215927124
sim_compute_robot_state-npc2_mean0.06948981705833884
sim_compute_robot_state-npc2_median0.06870617586023667
sim_compute_robot_state-npc2_min0.0676832143465678
sim_compute_robot_state-npc3_max0.0698073140780131
sim_compute_robot_state-npc3_mean0.06840717985115799
sim_compute_robot_state-npc3_median0.06910456418991089
sim_compute_robot_state-npc3_min0.06477959483277564
sim_compute_sim_state_max0.03938105901082357
sim_compute_sim_state_mean0.0386590448921802
sim_compute_sim_state_median0.038639055093129475
sim_compute_sim_state_min0.03801830843383191
sim_physics_max0.03968494546179678
sim_physics_mean0.03872255923701268
sim_physics_median0.038283207416534425
sim_physics_min0.03801925182342529
sim_render-ego_max0.06427579164505005
sim_render-ego_mean0.0620851082053839
sim_render-ego_median0.06373929500579834
sim_render-ego_min0.05781739833308201
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.980000000000055
survival_time_min5.09999999999999
186742707RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrorno-0:21:11
Waited 1201 seconds [...]
Waited 1201 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
183362707RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessno-0:19:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7913973283713115
survival_time_median8.14999999999998
deviation-center-line_median0.4771767758800493
in-drivable-lane_median0.4500000000000002


other stats
agent_compute-ego_max0.046005647961455995
agent_compute-ego_mean0.04542925644710137
agent_compute-ego_median0.045531790680680535
agent_compute-ego_min0.044881705726896017
deviation-center-line_max0.8605097120228962
deviation-center-line_mean0.5507122852935121
deviation-center-line_min0.34581067631051454
deviation-heading_max6.110307944646417
deviation-heading_mean2.888495431126587
deviation-heading_median2.481128690063512
deviation-heading_min0.7934900967294212
driven_any_max2.3552529581289097
driven_any_mean1.4855455318820605
driven_any_median1.2627878576133904
driven_any_min0.7645941809436542
driven_lanedir_consec_max1.088809422668986
driven_lanedir_consec_mean0.8851793863797706
driven_lanedir_consec_min0.7493107776620294
driven_lanedir_max1.3515777317207136
driven_lanedir_mean1.0470658995077096
driven_lanedir_median1.088809422668986
driven_lanedir_min0.7493107776620294
in-drivable-lane_max4.80000000000003
in-drivable-lane_mean1.8400000000000076
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8421811223254343, "sim_physics": 0.018480935267039707, "survival_time": 5.599999999999988, "driven_lanedir": 0.7913973283713115, "sim_render-ego": 0.03566482237407139, "in-drivable-lane": 0, "agent_compute-ego": 0.045756908399718146, "deviation-heading": 1.492252001456641, "set_robot_commands": 0.05257931777409145, "deviation-center-line": 0.34581067631051454, "driven_lanedir_consec": 0.7913973283713115, "sim_compute_sim_state": 0.02255328212465559, "sim_compute_performance-ego": 0.037081064922469, "sim_compute_robot_state-ego": 0.04315558075904846, "sim_compute_robot_state-npc0": 0.04069348105362484, "sim_compute_robot_state-npc1": 0.039814140115465434, "sim_compute_robot_state-npc2": 0.038925230503082275, "sim_compute_robot_state-npc3": 0.03966248674052102}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.202911540398914, "sim_physics": 0.017596278871808733, "survival_time": 14.000000000000064, "driven_lanedir": 1.2542342371155075, "sim_render-ego": 0.03639324392591204, "in-drivable-lane": 4.80000000000003, "agent_compute-ego": 0.044881705726896017, "deviation-heading": 3.5652984227369453, "set_robot_commands": 0.05318761723382132, "deviation-center-line": 0.6425309060853074, "driven_lanedir_consec": 1.0102067008408224, "sim_compute_sim_state": 0.023000939403261457, "sim_compute_performance-ego": 0.037400591373443606, "sim_compute_robot_state-ego": 0.04324178695678711, "sim_compute_robot_state-npc0": 0.04114596503121512, "sim_compute_robot_state-npc1": 0.03980989371027265, "sim_compute_robot_state-npc2": 0.03924528700964791, "sim_compute_robot_state-npc3": 0.039641943999699183}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2627878576133904, "sim_physics": 0.0177597326735046, "survival_time": 8.14999999999998, "driven_lanedir": 1.088809422668986, "sim_render-ego": 0.03596691119890272, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.045531790680680535, "deviation-heading": 2.481128690063512, "set_robot_commands": 0.05288857185036127, "deviation-center-line": 0.4771767758800493, "driven_lanedir_consec": 1.088809422668986, "sim_compute_sim_state": 0.02274052350798999, "sim_compute_performance-ego": 0.037485881817121446, "sim_compute_robot_state-ego": 0.04326398972353321, "sim_compute_robot_state-npc0": 0.04106782111653521, "sim_compute_robot_state-npc1": 0.03947863842080707, "sim_compute_robot_state-npc2": 0.03881926478052432, "sim_compute_robot_state-npc3": 0.03972684386317715}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3552529581289097, "sim_physics": 0.017274043560028075, "survival_time": 14.950000000000076, "driven_lanedir": 1.3515777317207136, "sim_render-ego": 0.03613660494486491, "in-drivable-lane": 3.950000000000008, "agent_compute-ego": 0.04497022946675618, "deviation-heading": 6.110307944646417, "set_robot_commands": 0.05244232257207235, "deviation-center-line": 0.8605097120228962, "driven_lanedir_consec": 0.7861727023557044, "sim_compute_sim_state": 0.022957525253295898, "sim_compute_performance-ego": 0.03802459398905436, "sim_compute_robot_state-ego": 0.04338470300038656, "sim_compute_robot_state-npc0": 0.04133031368255615, "sim_compute_robot_state-npc1": 0.03998137553532918, "sim_compute_robot_state-npc2": 0.03900428533554077, "sim_compute_robot_state-npc3": 0.03948255062103272}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7645941809436542, "sim_physics": 0.018279111031258465, "survival_time": 5.04999999999999, "driven_lanedir": 0.7493107776620294, "sim_render-ego": 0.03654914091129114, "in-drivable-lane": 0, "agent_compute-ego": 0.046005647961455995, "deviation-heading": 0.7934900967294212, "set_robot_commands": 0.05441086363084245, "deviation-center-line": 0.42753335616879307, "driven_lanedir_consec": 0.7493107776620294, "sim_compute_sim_state": 0.02276564116525178, "sim_compute_performance-ego": 0.03732231583925757, "sim_compute_robot_state-ego": 0.04274892807006836, "sim_compute_robot_state-npc0": 0.040144474199502775, "sim_compute_robot_state-npc1": 0.039136990462199296, "sim_compute_robot_state-npc2": 0.03889859076773766, "sim_compute_robot_state-npc3": 0.039352147886068514}}
set_robot_commands_max0.05441086363084245
set_robot_commands_mean0.05310173861223777
set_robot_commands_median0.05288857185036127
set_robot_commands_min0.05244232257207235
sim_compute_performance-ego_max0.03802459398905436
sim_compute_performance-ego_mean0.0374628895882692
sim_compute_performance-ego_median0.037400591373443606
sim_compute_performance-ego_min0.037081064922469
sim_compute_robot_state-ego_max0.04338470300038656
sim_compute_robot_state-ego_mean0.04315899770196474
sim_compute_robot_state-ego_median0.04324178695678711
sim_compute_robot_state-ego_min0.04274892807006836
sim_compute_robot_state-npc0_max0.04133031368255615
sim_compute_robot_state-npc0_mean0.04087641101668682
sim_compute_robot_state-npc0_median0.04106782111653521
sim_compute_robot_state-npc0_min0.040144474199502775
sim_compute_robot_state-npc1_max0.03998137553532918
sim_compute_robot_state-npc1_mean0.039644207648814725
sim_compute_robot_state-npc1_median0.03980989371027265
sim_compute_robot_state-npc1_min0.039136990462199296
sim_compute_robot_state-npc2_max0.03924528700964791
sim_compute_robot_state-npc2_mean0.03897853167930659
sim_compute_robot_state-npc2_median0.038925230503082275
sim_compute_robot_state-npc2_min0.03881926478052432
sim_compute_robot_state-npc3_max0.03972684386317715
sim_compute_robot_state-npc3_mean0.03957319462209972
sim_compute_robot_state-npc3_median0.039641943999699183
sim_compute_robot_state-npc3_min0.039352147886068514
sim_compute_sim_state_max0.023000939403261457
sim_compute_sim_state_mean0.022803582290890943
sim_compute_sim_state_median0.02276564116525178
sim_compute_sim_state_min0.02255328212465559
sim_physics_max0.018480935267039707
sim_physics_mean0.017878020280727915
sim_physics_median0.0177597326735046
sim_physics_min0.017274043560028075
sim_render-ego_max0.03654914091129114
sim_render-ego_mean0.03614214467100844
sim_render-ego_median0.03613660494486491
sim_render-ego_min0.03566482237407139
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.55000000000002
survival_time_min5.04999999999999
180882707RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessno-0:11:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8851457673653744
survival_time_median3.4999999999999956
deviation-center-line_median0.23932484147997415
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0722341707774571
agent_compute-ego_mean0.06796894107998616
agent_compute-ego_median0.06704223496573312
agent_compute-ego_min0.06559279057886694
deviation-center-line_max0.30218677769694013
deviation-center-line_mean0.2216864280827174
deviation-center-line_min0.10401604027369428
deviation-heading_max1.8463619024917823
deviation-heading_mean0.91118441233242
deviation-heading_median0.6243056250855269
deviation-heading_min0.3721329959876409
driven_any_max1.8111318011808593
driven_any_mean1.1266515511366988
driven_any_median1.124125141763516
driven_any_min0.56223996040486
driven_lanedir_consec_max1.0985805175011678
driven_lanedir_consec_mean0.8225630383441367
driven_lanedir_consec_min0.457250427887026
driven_lanedir_max1.0985805175011678
driven_lanedir_mean0.8692853291483784
driven_lanedir_median0.8851457673653744
driven_lanedir_min0.457250427887026
in-drivable-lane_max2.399999999999994
in-drivable-lane_mean0.5299999999999988
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.56223996040486, "sim_physics": 0.0214085256731188, "survival_time": 1.850000000000001, "driven_lanedir": 0.457250427887026, "sim_render-ego": 0.06337836626413706, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.06794451378487251, "deviation-heading": 0.3721329959876409, "set_robot_commands": 0.07421323415395376, "deviation-center-line": 0.10401604027369428, "driven_lanedir_consec": 0.457250427887026, "sim_compute_sim_state": 0.03702540655393858, "sim_compute_performance-ego": 0.06345736658250964, "sim_compute_robot_state-ego": 0.0636204126718882, "sim_compute_robot_state-npc0": 0.06708970585384884, "sim_compute_robot_state-npc1": 0.06323608192237648, "sim_compute_robot_state-npc2": 0.06456271377769676, "sim_compute_robot_state-npc3": 0.06607224490191485}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8111318011808593, "sim_physics": 0.023378450258643227, "survival_time": 5.649999999999988, "driven_lanedir": 0.8071453359009868, "sim_render-ego": 0.06490925982990096, "in-drivable-lane": 2.399999999999994, "agent_compute-ego": 0.06703099529300116, "deviation-heading": 1.8463619024917823, "set_robot_commands": 0.07427223382797916, "deviation-center-line": 0.2046300992082749, "driven_lanedir_consec": 0.5735338818797775, "sim_compute_sim_state": 0.03669914946091914, "sim_compute_performance-ego": 0.06453195926362434, "sim_compute_robot_state-ego": 0.06461851997713072, "sim_compute_robot_state-npc0": 0.07015742031873855, "sim_compute_robot_state-npc1": 0.06596989336266981, "sim_compute_robot_state-npc2": 0.06514209139663561, "sim_compute_robot_state-npc3": 0.06597647624733173}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8996560480244998, "sim_physics": 0.023184720958982195, "survival_time": 2.799999999999998, "driven_lanedir": 0.8851457673653744, "sim_render-ego": 0.06634657723563057, "in-drivable-lane": 0, "agent_compute-ego": 0.0722341707774571, "deviation-heading": 0.4143112168154284, "set_robot_commands": 0.07928785255977086, "deviation-center-line": 0.2582743817547035, "driven_lanedir_consec": 0.8851457673653744, "sim_compute_sim_state": 0.03734683990478515, "sim_compute_performance-ego": 0.06386350733893258, "sim_compute_robot_state-ego": 0.06455283505575997, "sim_compute_robot_state-npc0": 0.07521232536860875, "sim_compute_robot_state-npc1": 0.06932379943983895, "sim_compute_robot_state-npc2": 0.06870069674083165, "sim_compute_robot_state-npc3": 0.0668925302369254}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.124125141763516, "sim_physics": 0.024309536388942173, "survival_time": 3.4999999999999956, "driven_lanedir": 1.0985805175011678, "sim_render-ego": 0.06635944502694266, "in-drivable-lane": 0, "agent_compute-ego": 0.06704223496573312, "deviation-heading": 0.6243056250855269, "set_robot_commands": 0.07549049173082624, "deviation-center-line": 0.30218677769694013, "driven_lanedir_consec": 1.0985805175011678, "sim_compute_sim_state": 0.036945891380310056, "sim_compute_performance-ego": 0.06377109118870326, "sim_compute_robot_state-ego": 0.06540295737130301, "sim_compute_robot_state-npc0": 0.06909767900194441, "sim_compute_robot_state-npc1": 0.06542167322976249, "sim_compute_robot_state-npc2": 0.06660200187138149, "sim_compute_robot_state-npc3": 0.06566798005785261}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2361048043097582, "sim_physics": 0.02182729213268726, "survival_time": 3.8499999999999943, "driven_lanedir": 1.098304597087337, "sim_render-ego": 0.0614968306058413, "in-drivable-lane": 0, "agent_compute-ego": 0.06559279057886694, "deviation-heading": 1.2988103212817204, "set_robot_commands": 0.0750339650488519, "deviation-center-line": 0.23932484147997415, "driven_lanedir_consec": 1.098304597087337, "sim_compute_sim_state": 0.033506703067135504, "sim_compute_performance-ego": 0.05979248145958046, "sim_compute_robot_state-ego": 0.0599543336149934, "sim_compute_robot_state-npc0": 0.06443840187865418, "sim_compute_robot_state-npc1": 0.06296457872762308, "sim_compute_robot_state-npc2": 0.06101276967432592, "sim_compute_robot_state-npc3": 0.0611922431301761}}
set_robot_commands_max0.07928785255977086
set_robot_commands_mean0.07565955546427638
set_robot_commands_median0.0750339650488519
set_robot_commands_min0.07421323415395376
sim_compute_performance-ego_max0.06453195926362434
sim_compute_performance-ego_mean0.06308328116667006
sim_compute_performance-ego_median0.06377109118870326
sim_compute_performance-ego_min0.05979248145958046
sim_compute_robot_state-ego_max0.06540295737130301
sim_compute_robot_state-ego_mean0.06362981173821507
sim_compute_robot_state-ego_median0.06455283505575997
sim_compute_robot_state-ego_min0.0599543336149934
sim_compute_robot_state-npc0_max0.07521232536860875
sim_compute_robot_state-npc0_mean0.06919910648435895
sim_compute_robot_state-npc0_median0.06909767900194441
sim_compute_robot_state-npc0_min0.06443840187865418
sim_compute_robot_state-npc1_max0.06932379943983895
sim_compute_robot_state-npc1_mean0.06538320533645417
sim_compute_robot_state-npc1_median0.06542167322976249
sim_compute_robot_state-npc1_min0.06296457872762308
sim_compute_robot_state-npc2_max0.06870069674083165
sim_compute_robot_state-npc2_mean0.06520405469217427
sim_compute_robot_state-npc2_median0.06514209139663561
sim_compute_robot_state-npc2_min0.06101276967432592
sim_compute_robot_state-npc3_max0.0668925302369254
sim_compute_robot_state-npc3_mean0.06516029491484014
sim_compute_robot_state-npc3_median0.06597647624733173
sim_compute_robot_state-npc3_min0.0611922431301761
sim_compute_sim_state_max0.03734683990478515
sim_compute_sim_state_mean0.03630479807341769
sim_compute_sim_state_median0.036945891380310056
sim_compute_sim_state_min0.033506703067135504
sim_physics_max0.024309536388942173
sim_physics_mean0.02282170508247473
sim_physics_median0.023184720958982195
sim_physics_min0.0214085256731188
sim_render-ego_max0.06635944502694266
sim_render-ego_mean0.06449809579249052
sim_render-ego_median0.06490925982990096
sim_render-ego_min0.0614968306058413
simulation-passed1
survival_time_max5.649999999999988
survival_time_mean3.5299999999999954
survival_time_min1.850000000000001
180862707RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessno-0:18:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1958036315014096
survival_time_median4.149999999999993
deviation-center-line_median0.21450264924921497
in-drivable-lane_median0.6500000000000002


other stats
agent_compute-ego_max0.07339835616777528
agent_compute-ego_mean0.0700250487711814
agent_compute-ego_median0.06986484876493128
agent_compute-ego_min0.06841963871269469
deviation-center-line_max0.5158092388455554
deviation-center-line_mean0.3086710387100332
deviation-center-line_min0.12642786562036365
deviation-heading_max2.972039227722927
deviation-heading_mean1.6515356959157443
deviation-heading_median1.5713797444096391
deviation-heading_min0.392677436637527
driven_any_max2.998642112628
driven_any_mean1.6714902557846858
driven_any_median1.3306443111865334
driven_any_min0.6579554917149006
driven_lanedir_consec_max1.5164752893596227
driven_lanedir_consec_mean1.014176648484046
driven_lanedir_consec_min0.26808797076402924
driven_lanedir_max1.6306617923430684
driven_lanedir_mean1.0898159416391529
driven_lanedir_median1.1958036315014096
driven_lanedir_min0.29633956075111334
in-drivable-lane_max3.499999999999991
in-drivable-lane_mean1.2199999999999969
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.998642112628, "sim_physics": 0.028991740847390795, "survival_time": 9.45, "driven_lanedir": 1.4881384928632364, "sim_render-ego": 0.05724767654661148, "in-drivable-lane": 3.499999999999991, "agent_compute-ego": 0.06995860230985773, "deviation-heading": 2.972039227722927, "set_robot_commands": 0.08421564606762437, "deviation-center-line": 0.5000772658102186, "driven_lanedir_consec": 1.2523801200582323, "sim_compute_sim_state": 0.03363081891700704, "sim_compute_performance-ego": 0.05860818126214244, "sim_compute_robot_state-ego": 0.062243308970537134, "sim_compute_robot_state-npc0": 0.06009826836762605, "sim_compute_robot_state-npc1": 0.05888930704227831, "sim_compute_robot_state-npc2": 0.05898890041169666, "sim_compute_robot_state-npc3": 0.05971963317305953}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6579554917149006, "sim_physics": 0.026878292967633503, "survival_time": 2.0500000000000007, "driven_lanedir": 0.29633956075111334, "sim_render-ego": 0.0515864825830227, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.06986484876493128, "deviation-heading": 0.9695085798990638, "set_robot_commands": 0.0788092496918469, "deviation-center-line": 0.12642786562036365, "driven_lanedir_consec": 0.26808797076402924, "sim_compute_sim_state": 0.030295430160150297, "sim_compute_performance-ego": 0.05523187939713641, "sim_compute_robot_state-ego": 0.057104750377375904, "sim_compute_robot_state-npc0": 0.05638431339729123, "sim_compute_robot_state-npc1": 0.055493697887513696, "sim_compute_robot_state-npc2": 0.055261402595333936, "sim_compute_robot_state-npc3": 0.05494055515382349}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8514251443949954, "sim_physics": 0.03343385120607772, "survival_time": 2.6499999999999986, "driven_lanedir": 0.8381362307369362, "sim_render-ego": 0.06490516662597656, "in-drivable-lane": 0, "agent_compute-ego": 0.07339835616777528, "deviation-heading": 0.392677436637527, "set_robot_commands": 0.09816556606652602, "deviation-center-line": 0.21450264924921497, "driven_lanedir_consec": 0.8381362307369362, "sim_compute_sim_state": 0.03754276149677781, "sim_compute_performance-ego": 0.06552810039160387, "sim_compute_robot_state-ego": 0.06981064238638249, "sim_compute_robot_state-npc0": 0.07075116319476434, "sim_compute_robot_state-npc1": 0.06855931821859108, "sim_compute_robot_state-npc2": 0.06874218077029821, "sim_compute_robot_state-npc3": 0.06786884901658544}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.5187842189990004, "sim_physics": 0.02765385816051702, "survival_time": 7.84999999999998, "driven_lanedir": 1.6306617923430684, "sim_render-ego": 0.055696956670967634, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.06841963871269469, "deviation-heading": 2.352073490909565, "set_robot_commands": 0.08238392878489889, "deviation-center-line": 0.5158092388455554, "driven_lanedir_consec": 1.5164752893596227, "sim_compute_sim_state": 0.03273389749466234, "sim_compute_performance-ego": 0.05681974113367166, "sim_compute_robot_state-ego": 0.05930892221487251, "sim_compute_robot_state-npc0": 0.05869301261415907, "sim_compute_robot_state-npc1": 0.05835597074715195, "sim_compute_robot_state-npc2": 0.05753424365049715, "sim_compute_robot_state-npc3": 0.0573875463692246}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3306443111865334, "sim_physics": 0.027812228145369565, "survival_time": 4.149999999999993, "driven_lanedir": 1.1958036315014096, "sim_render-ego": 0.05246379863784974, "in-drivable-lane": 0, "agent_compute-ego": 0.068483797900648, "deviation-heading": 1.5713797444096391, "set_robot_commands": 0.07747513414865517, "deviation-center-line": 0.1865381740248133, "driven_lanedir_consec": 1.1958036315014096, "sim_compute_sim_state": 0.03101130278713732, "sim_compute_performance-ego": 0.05285769485565553, "sim_compute_robot_state-ego": 0.05382430122559329, "sim_compute_robot_state-npc0": 0.05475799434156303, "sim_compute_robot_state-npc1": 0.051957371723221006, "sim_compute_robot_state-npc2": 0.054079667631402074, "sim_compute_robot_state-npc3": 0.05340442600020443}}
set_robot_commands_max0.09816556606652602
set_robot_commands_mean0.08420990495191025
set_robot_commands_median0.08238392878489889
set_robot_commands_min0.07747513414865517
sim_compute_performance-ego_max0.06552810039160387
sim_compute_performance-ego_mean0.05780911940804199
sim_compute_performance-ego_median0.05681974113367166
sim_compute_performance-ego_min0.05285769485565553
sim_compute_robot_state-ego_max0.06981064238638249
sim_compute_robot_state-ego_mean0.06045838503495227
sim_compute_robot_state-ego_median0.05930892221487251
sim_compute_robot_state-ego_min0.05382430122559329
sim_compute_robot_state-npc0_max0.07075116319476434
sim_compute_robot_state-npc0_mean0.06013695038308074
sim_compute_robot_state-npc0_median0.05869301261415907
sim_compute_robot_state-npc0_min0.05475799434156303
sim_compute_robot_state-npc1_max0.06855931821859108
sim_compute_robot_state-npc1_mean0.05865113312375121
sim_compute_robot_state-npc1_median0.05835597074715195
sim_compute_robot_state-npc1_min0.051957371723221006
sim_compute_robot_state-npc2_max0.06874218077029821
sim_compute_robot_state-npc2_mean0.05892127901184561
sim_compute_robot_state-npc2_median0.05753424365049715
sim_compute_robot_state-npc2_min0.054079667631402074
sim_compute_robot_state-npc3_max0.06786884901658544
sim_compute_robot_state-npc3_mean0.0586642019425795
sim_compute_robot_state-npc3_median0.0573875463692246
sim_compute_robot_state-npc3_min0.05340442600020443
sim_compute_sim_state_max0.03754276149677781
sim_compute_sim_state_mean0.03304284217114696
sim_compute_sim_state_median0.03273389749466234
sim_compute_sim_state_min0.030295430160150297
sim_physics_max0.03343385120607772
sim_physics_mean0.02895399426539772
sim_physics_median0.027812228145369565
sim_physics_min0.026878292967633503
sim_render-ego_max0.06490516662597656
sim_render-ego_mean0.05638001621288562
sim_render-ego_median0.055696956670967634
sim_render-ego_min0.0515864825830227
simulation-passed1
survival_time_max9.45
survival_time_mean5.229999999999994
survival_time_min2.0500000000000007