AI Driving Olympics Home Challenges Submissions Jobs

Submission 3229

Submission3229
Competingyes
Challengeaido2-LF-sim-validation
UserJBRRussia
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 22511
Next
User labelJetBrains Research
Admin priority50
Blessing50
User priority

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
225113229JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationerroryes-0:17:31
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
225103229JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationsuccessyes-0:23:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2123803234758848
survival_time_median11.350000000000026
deviation-center-line_median0.9933169792906318
in-drivable-lane_median1.6000000000000227


other stats
agent_compute-ego_max0.6791923319190609
agent_compute-ego_mean0.6171286969794316
agent_compute-ego_median0.6066282727664575
agent_compute-ego_min0.5452301036352398
deviation-center-line_max1.0478460402313363
deviation-center-line_mean0.7653377201947371
deviation-center-line_min0.28819192241742625
deviation-heading_max4.158475396336831
deviation-heading_mean2.1771425946441436
deviation-heading_median1.9896659934944143
deviation-heading_min0.3727153081942806
driven_any_max3.4157183990867392
driven_any_mean2.2687951930978745
driven_any_median2.694252583768843
driven_any_min0.982264116008556
driven_lanedir_consec_max2.6993014304680925
driven_lanedir_consec_mean1.7930464178976078
driven_lanedir_consec_min0.7079287422335795
driven_lanedir_max2.6993014304680925
driven_lanedir_mean1.7930464178976078
driven_lanedir_median2.2123803234758848
driven_lanedir_min0.7079287422335795
in-drivable-lane_max2.550000000000023
in-drivable-lane_mean1.4800000000000135
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.159455033152567, "sim_physics": 0.05275023162813115, "survival_time": 13.300000000000054, "driven_lanedir": 2.369632812414407, "sim_render-ego": 0.05389506297003954, "in-drivable-lane": 2.550000000000023, "agent_compute-ego": 0.6066282727664575, "deviation-heading": 3.1810765083732777, "set_robot_commands": 0.05184811488130039, "deviation-center-line": 1.0075311661721005, "driven_lanedir_consec": 2.369632812414407, "sim_compute_sim_state": 0.03943094812837759, "sim_compute_performance-ego": 0.05715423419063253, "sim_compute_robot_state-ego": 0.05689723957750134}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0922858334726664, "sim_physics": 0.04995506753524145, "survival_time": 4.799999999999991, "driven_lanedir": 0.7079287422335795, "sim_render-ego": 0.05240500718355179, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.6059611638387045, "deviation-heading": 1.1837797668219148, "set_robot_commands": 0.05670842031637827, "deviation-center-line": 0.28819192241742625, "driven_lanedir_consec": 0.7079287422335795, "sim_compute_sim_state": 0.03987697511911392, "sim_compute_performance-ego": 0.055978151659170784, "sim_compute_robot_state-ego": 0.05623165766398112}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.982264116008556, "sim_physics": 0.05191244476142971, "survival_time": 4.3499999999999925, "driven_lanedir": 0.9759887808960754, "sim_render-ego": 0.05072577246304216, "in-drivable-lane": 0, "agent_compute-ego": 0.5452301036352398, "deviation-heading": 0.3727153081942806, "set_robot_commands": 0.0519843978443365, "deviation-center-line": 0.48980249286219024, "driven_lanedir_consec": 0.9759887808960754, "sim_compute_sim_state": 0.04004176183678638, "sim_compute_performance-ego": 0.0549248306230567, "sim_compute_robot_state-ego": 0.0554773752716766}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.4157183990867392, "sim_physics": 0.05210178632002611, "survival_time": 14.300000000000068, "driven_lanedir": 2.6993014304680925, "sim_render-ego": 0.05271444203970316, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.6486316127376957, "deviation-heading": 4.158475396336831, "set_robot_commands": 0.05345827132671863, "deviation-center-line": 1.0478460402313363, "driven_lanedir_consec": 2.6993014304680925, "sim_compute_sim_state": 0.03918496462015005, "sim_compute_performance-ego": 0.05634438408004654, "sim_compute_robot_state-ego": 0.055490683842372227}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.694252583768843, "sim_physics": 0.05238833616483579, "survival_time": 11.350000000000026, "driven_lanedir": 2.2123803234758848, "sim_render-ego": 0.05200784426953824, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.6791923319190609, "deviation-heading": 1.9896659934944143, "set_robot_commands": 0.052285972670836595, "deviation-center-line": 0.9933169792906318, "driven_lanedir_consec": 2.2123803234758848, "sim_compute_sim_state": 0.03798523348333552, "sim_compute_performance-ego": 0.05568680574190249, "sim_compute_robot_state-ego": 0.055583352034312514}}
set_robot_commands_max0.05670842031637827
set_robot_commands_mean0.05325703540791408
set_robot_commands_median0.052285972670836595
set_robot_commands_min0.05184811488130039
sim_compute_performance-ego_max0.05715423419063253
sim_compute_performance-ego_mean0.0560176812589618
sim_compute_performance-ego_median0.055978151659170784
sim_compute_performance-ego_min0.0549248306230567
sim_compute_robot_state-ego_max0.05689723957750134
sim_compute_robot_state-ego_mean0.05593606167796876
sim_compute_robot_state-ego_median0.055583352034312514
sim_compute_robot_state-ego_min0.0554773752716766
sim_compute_sim_state_max0.04004176183678638
sim_compute_sim_state_mean0.03930397663755269
sim_compute_sim_state_median0.03943094812837759
sim_compute_sim_state_min0.03798523348333552
sim_physics_max0.05275023162813115
sim_physics_mean0.05182157328193284
sim_physics_median0.05210178632002611
sim_physics_min0.04995506753524145
sim_render-ego_max0.05389506297003954
sim_render-ego_mean0.05234962578517498
sim_render-ego_median0.05240500718355179
sim_render-ego_min0.05072577246304216
simulation-passed1
survival_time_max14.300000000000068
survival_time_mean9.620000000000028
survival_time_min4.3499999999999925
215763229JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationsuccessno-0:13:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0680135678207798
survival_time_median4.94999999999999
deviation-center-line_median0.3683836422073795
in-drivable-lane_median1.500000000000021


other stats
agent_compute-ego_max0.3343187808990479
agent_compute-ego_mean0.2962315481524593
agent_compute-ego_median0.30255850878628815
agent_compute-ego_min0.2218819519258895
deviation-center-line_max1.1349797934935273
deviation-center-line_mean0.5638768299737152
deviation-center-line_min0.27597475388666126
deviation-heading_max3.1082652497814784
deviation-heading_mean1.697890568178956
deviation-heading_median1.1832497626511975
deviation-heading_min0.32972855907377124
driven_any_max3.5630330512904034
driven_any_mean1.7796595284760968
driven_any_median1.128961384917068
driven_any_min0.5664764208093115
driven_lanedir_consec_max2.7889961194637634
driven_lanedir_consec_mean1.4196399712756496
driven_lanedir_consec_min0.561874652087262
driven_lanedir_max2.7889961194637634
driven_lanedir_mean1.4196399712756496
driven_lanedir_median1.0680135678207798
driven_lanedir_min0.561874652087262
in-drivable-lane_max2.550000000000036
in-drivable-lane_mean1.1300000000000103
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.5630330512904034, "sim_physics": 0.08314438899358113, "survival_time": 14.950000000000076, "driven_lanedir": 2.7889961194637634, "sim_render-ego": 0.04782614231109619, "in-drivable-lane": 2.550000000000036, "agent_compute-ego": 0.30022245248158774, "deviation-heading": 3.1082652497814784, "set_robot_commands": 0.07357827583948771, "deviation-center-line": 1.1349797934935273, "driven_lanedir_consec": 2.7889961194637634, "sim_compute_sim_state": 0.03038559277852376, "sim_compute_performance-ego": 0.05186926921208699, "sim_compute_robot_state-ego": 0.055774827003479}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.128961384917068, "sim_physics": 0.08031153678894043, "survival_time": 4.94999999999999, "driven_lanedir": 0.6693688100075108, "sim_render-ego": 0.04569161781156906, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.30255850878628815, "deviation-heading": 1.1832497626511975, "set_robot_commands": 0.07612153014751395, "deviation-center-line": 0.27597475388666126, "driven_lanedir_consec": 0.6693688100075108, "sim_compute_sim_state": 0.029841476016574435, "sim_compute_performance-ego": 0.0512952371077104, "sim_compute_robot_state-ego": 0.05538118006003023}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5664764208093115, "sim_physics": 0.08411186146286298, "survival_time": 2.6499999999999986, "driven_lanedir": 0.561874652087262, "sim_render-ego": 0.047781525917772974, "in-drivable-lane": 0, "agent_compute-ego": 0.2218819519258895, "deviation-heading": 0.32972855907377124, "set_robot_commands": 0.074415589278599, "deviation-center-line": 0.2841231133794584, "driven_lanedir_consec": 0.561874652087262, "sim_compute_sim_state": 0.031495913019720115, "sim_compute_performance-ego": 0.053112947715903226, "sim_compute_robot_state-ego": 0.05706152376138939}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0923230180312424, "sim_physics": 0.08621070037285487, "survival_time": 4.799999999999991, "driven_lanedir": 1.0680135678207798, "sim_render-ego": 0.04839677611986796, "in-drivable-lane": 0, "agent_compute-ego": 0.3221760466694832, "deviation-heading": 0.9288944234322016, "set_robot_commands": 0.07596710572640102, "deviation-center-line": 0.3683836422073795, "driven_lanedir_consec": 1.0680135678207798, "sim_compute_sim_state": 0.032510834435621895, "sim_compute_performance-ego": 0.055921249091625214, "sim_compute_robot_state-ego": 0.05890559405088425}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.5475037673324583, "sim_physics": 0.08380869931952897, "survival_time": 10.750000000000018, "driven_lanedir": 2.0099467069989316, "sim_render-ego": 0.047151333786720456, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.3343187808990479, "deviation-heading": 2.9393148459561305, "set_robot_commands": 0.07415289435275765, "deviation-center-line": 0.7559228469015499, "driven_lanedir_consec": 2.0099467069989316, "sim_compute_sim_state": 0.03049984310948571, "sim_compute_performance-ego": 0.05266198003014853, "sim_compute_robot_state-ego": 0.05679712406424589}}
set_robot_commands_max0.07612153014751395
set_robot_commands_mean0.07484707906895187
set_robot_commands_median0.074415589278599
set_robot_commands_min0.07357827583948771
sim_compute_performance-ego_max0.055921249091625214
sim_compute_performance-ego_mean0.05297213663149487
sim_compute_performance-ego_median0.05266198003014853
sim_compute_performance-ego_min0.0512952371077104
sim_compute_robot_state-ego_max0.05890559405088425
sim_compute_robot_state-ego_mean0.056784049788005754
sim_compute_robot_state-ego_median0.05679712406424589
sim_compute_robot_state-ego_min0.05538118006003023
sim_compute_sim_state_max0.032510834435621895
sim_compute_sim_state_mean0.030946731871985184
sim_compute_sim_state_median0.03049984310948571
sim_compute_sim_state_min0.029841476016574435
sim_physics_max0.08621070037285487
sim_physics_mean0.08351743738755368
sim_physics_median0.08380869931952897
sim_physics_min0.08031153678894043
sim_render-ego_max0.04839677611986796
sim_render-ego_mean0.04736947918940533
sim_render-ego_median0.047781525917772974
sim_render-ego_min0.04569161781156906
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.620000000000016
survival_time_min2.6499999999999986
215753229JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationhost-errorno-0:10:08
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3229/step1-simulation-ip-172-31-25-98-2062-job21575/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.