AI Driving Olympics Home Challenges Submissions Jobs

Submission 3296

Submission3296
Competingyes
Challengeaido2-LF-sim-validation
Userjp18813100494
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22444
Next
User labelThird test - TH
Admin priority50
Blessing50
User priority

22444

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
224443296jp18813100494Third test - THaido2-LF-sim-validationstep1-simulationsuccessyes-0:18:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.5625804732500495
survival_time_median14.950000000000076
deviation-center-line_median1.1698837272523748
in-drivable-lane_median1.1000000000000156


other stats
agent_compute-ego_max0.18611751079559327
agent_compute-ego_mean0.18077207835515335
agent_compute-ego_median0.18314343929290772
agent_compute-ego_min0.16847042640050253
deviation-center-line_max1.459319908753633
deviation-center-line_mean1.1987510610496053
deviation-center-line_min0.9391295391734318
deviation-heading_max4.707369714165231
deviation-heading_mean3.2139189593142747
deviation-heading_median3.178631104730079
deviation-heading_min2.008253469291316
driven_any_max5.342279310525335
driven_any_mean3.6604427746521737
driven_any_median3.636894290631455
driven_any_min2.455427904924257
driven_lanedir_consec_max5.29393649255367
driven_lanedir_consec_mean3.245650827220022
driven_lanedir_consec_min1.5258191746980736
driven_lanedir_max5.29393649255367
driven_lanedir_mean3.4301974856370947
driven_lanedir_median3.5625804732500495
driven_lanedir_min2.243778842147973
in-drivable-lane_max4.9499999999999975
in-drivable-lane_mean1.610000000000008
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.4870338187439804, "sim_physics": 0.05298996051152547, "survival_time": 14.950000000000076, "driven_lanedir": 2.243778842147973, "sim_render-ego": 0.05283098618189494, "in-drivable-lane": 4.9499999999999975, "agent_compute-ego": 0.18314343929290772, "deviation-heading": 3.771969216372672, "set_robot_commands": 0.07486454010009766, "deviation-center-line": 1.2689583831348747, "driven_lanedir_consec": 1.5258191746980736, "sim_compute_sim_state": 0.03542221228281657, "sim_compute_performance-ego": 0.05726420005162557, "sim_compute_robot_state-ego": 0.05784172693888346}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.342279310525335, "sim_physics": 0.05521598736445109, "survival_time": 14.950000000000076, "driven_lanedir": 5.29393649255367, "sim_render-ego": 0.05660218795140584, "in-drivable-lane": 0, "agent_compute-ego": 0.18545785506566365, "deviation-heading": 2.008253469291316, "set_robot_commands": 0.07586246252059936, "deviation-center-line": 1.1698837272523748, "driven_lanedir_consec": 5.29393649255367, "sim_compute_sim_state": 0.03777879476547241, "sim_compute_performance-ego": 0.06016388018925985, "sim_compute_robot_state-ego": 0.06130816698074341}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.3805785484358415, "sim_physics": 0.05547953844070434, "survival_time": 14.950000000000076, "driven_lanedir": 3.709366417526528, "sim_render-ego": 0.05222558418909709, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.16847042640050253, "deviation-heading": 2.403371292012072, "set_robot_commands": 0.0751651398340861, "deviation-center-line": 1.1564637469337116, "driven_lanedir_consec": 3.709366417526528, "sim_compute_sim_state": 0.03715720415115356, "sim_compute_performance-ego": 0.0587774395942688, "sim_compute_robot_state-ego": 0.05917754570643107}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.455427904924257, "sim_physics": 0.05616841713587443, "survival_time": 14.950000000000076, "driven_lanedir": 2.3413252027072557, "sim_render-ego": 0.05703994909922282, "in-drivable-lane": 2.0000000000000258, "agent_compute-ego": 0.18611751079559327, "deviation-heading": 4.707369714165231, "set_robot_commands": 0.07751471439997355, "deviation-center-line": 1.459319908753633, "driven_lanedir_consec": 2.1365515780717916, "sim_compute_sim_state": 0.03882108211517334, "sim_compute_performance-ego": 0.060897933642069496, "sim_compute_robot_state-ego": 0.06025100390116374}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.636894290631455, "sim_physics": 0.05504616260528565, "survival_time": 14.950000000000076, "driven_lanedir": 3.5625804732500495, "sim_render-ego": 0.05258286396662394, "in-drivable-lane": 0, "agent_compute-ego": 0.18067116022109983, "deviation-heading": 3.178631104730079, "set_robot_commands": 0.07363721370697021, "deviation-center-line": 0.9391295391734318, "driven_lanedir_consec": 3.5625804732500495, "sim_compute_sim_state": 0.0367575740814209, "sim_compute_performance-ego": 0.0574726398785909, "sim_compute_robot_state-ego": 0.05815633376439412}}
set_robot_commands_max0.07751471439997355
set_robot_commands_mean0.07540881411234537
set_robot_commands_median0.0751651398340861
set_robot_commands_min0.07363721370697021
sim_compute_performance-ego_max0.060897933642069496
sim_compute_performance-ego_mean0.058915218671162915
sim_compute_performance-ego_median0.0587774395942688
sim_compute_performance-ego_min0.05726420005162557
sim_compute_robot_state-ego_max0.06130816698074341
sim_compute_robot_state-ego_mean0.05934695545832316
sim_compute_robot_state-ego_median0.05917754570643107
sim_compute_robot_state-ego_min0.05784172693888346
sim_compute_sim_state_max0.03882108211517334
sim_compute_sim_state_mean0.03718737347920735
sim_compute_sim_state_median0.03715720415115356
sim_compute_sim_state_min0.03542221228281657
sim_physics_max0.05616841713587443
sim_physics_mean0.05498001321156819
sim_physics_median0.05521598736445109
sim_physics_min0.05298996051152547
sim_render-ego_max0.05703994909922282
sim_render-ego_mean0.05425631427764892
sim_render-ego_median0.05283098618189494
sim_render-ego_min0.05222558418909709
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
218173296jp18813100494Third test - THaido2-LF-sim-validationstep1-simulationsuccessno-0:14:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1809595844475407
survival_time_median14.950000000000076
deviation-center-line_median0.9330764711462172
in-drivable-lane_median2.549999999999991


other stats
agent_compute-ego_max0.10151201963424684
agent_compute-ego_mean0.10120250638326007
agent_compute-ego_median0.10140568176905314
agent_compute-ego_min0.10025413354237876
deviation-center-line_max1.2972656050385445
deviation-center-line_mean1.003541776059705
deviation-center-line_min0.6994148946189701
deviation-heading_max3.9608969195564088
deviation-heading_mean2.895539669243423
deviation-heading_median2.7946171305526017
deviation-heading_min2.220101574863344
driven_any_max3.4982747714473343
driven_any_mean2.4211883097531386
driven_any_median2.4790203778985425
driven_any_min0.7829732809241864
driven_lanedir_consec_max3.4398693754119662
driven_lanedir_consec_mean2.1767209374051957
driven_lanedir_consec_min0.7744686931872476
driven_lanedir_max3.4398693754119662
driven_lanedir_mean2.252046399240645
driven_lanedir_median2.235232816322172
driven_lanedir_min0.7744686931872476
in-drivable-lane_max5.950000000000084
in-drivable-lane_mean2.840000000000019
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.066075886606429, "sim_physics": 0.059428006013234454, "survival_time": 14.950000000000076, "driven_lanedir": 1.873431031853096, "sim_render-ego": 0.03645070155461629, "in-drivable-lane": 5.700000000000019, "agent_compute-ego": 0.10151201963424684, "deviation-heading": 3.9608969195564088, "set_robot_commands": 0.05566086451212565, "deviation-center-line": 1.174555757008702, "driven_lanedir_consec": 1.5510769545504792, "sim_compute_sim_state": 0.0239279580116272, "sim_compute_performance-ego": 0.03975734313329061, "sim_compute_robot_state-ego": 0.041986351807912194}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7829732809241864, "sim_physics": 0.05277527650197347, "survival_time": 14.950000000000076, "driven_lanedir": 0.7744686931872476, "sim_render-ego": 0.036327910423278806, "in-drivable-lane": 0, "agent_compute-ego": 0.10025413354237876, "deviation-heading": 2.624950508028493, "set_robot_commands": 0.055914162794748944, "deviation-center-line": 0.6994148946189701, "driven_lanedir_consec": 0.7744686931872476, "sim_compute_sim_state": 0.02391575256983439, "sim_compute_performance-ego": 0.03977577050526937, "sim_compute_robot_state-ego": 0.042046062151590985}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.4982747714473343, "sim_physics": 0.06233551263809204, "survival_time": 14.950000000000076, "driven_lanedir": 3.4398693754119662, "sim_render-ego": 0.03668109178543091, "in-drivable-lane": 0, "agent_compute-ego": 0.10147260030110676, "deviation-heading": 2.7946171305526017, "set_robot_commands": 0.05541056156158447, "deviation-center-line": 1.2972656050385445, "driven_lanedir_consec": 3.4398693754119662, "sim_compute_sim_state": 0.023826092878977457, "sim_compute_performance-ego": 0.04091724793116252, "sim_compute_robot_state-ego": 0.041762107213338215}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.279597231889202, "sim_physics": 0.05993807951609294, "survival_time": 14.950000000000076, "driven_lanedir": 2.9372300794287436, "sim_render-ego": 0.03666571458180745, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.10140568176905314, "deviation-heading": 2.877132213216268, "set_robot_commands": 0.05589641571044922, "deviation-center-line": 0.9133961524860906, "driven_lanedir_consec": 2.9372300794287436, "sim_compute_sim_state": 0.0236415966351827, "sim_compute_performance-ego": 0.03978380839029948, "sim_compute_robot_state-ego": 0.04217204570770264}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.4790203778985425, "sim_physics": 0.05759679396947225, "survival_time": 14.950000000000076, "driven_lanedir": 2.235232816322172, "sim_render-ego": 0.03632041295369466, "in-drivable-lane": 5.950000000000084, "agent_compute-ego": 0.10136809666951498, "deviation-heading": 2.220101574863344, "set_robot_commands": 0.0563749090830485, "deviation-center-line": 0.9330764711462172, "driven_lanedir_consec": 2.1809595844475407, "sim_compute_sim_state": 0.023926120599110923, "sim_compute_performance-ego": 0.04025616645812989, "sim_compute_robot_state-ego": 0.04164817094802856}}
set_robot_commands_max0.0563749090830485
set_robot_commands_mean0.055851382732391354
set_robot_commands_median0.05589641571044922
set_robot_commands_min0.05541056156158447
sim_compute_performance-ego_max0.04091724793116252
sim_compute_performance-ego_mean0.04009806728363037
sim_compute_performance-ego_median0.03978380839029948
sim_compute_performance-ego_min0.03975734313329061
sim_compute_robot_state-ego_max0.04217204570770264
sim_compute_robot_state-ego_mean0.04192294756571452
sim_compute_robot_state-ego_median0.041986351807912194
sim_compute_robot_state-ego_min0.04164817094802856
sim_compute_sim_state_max0.0239279580116272
sim_compute_sim_state_mean0.023847504138946533
sim_compute_sim_state_median0.02391575256983439
sim_compute_sim_state_min0.0236415966351827
sim_physics_max0.06233551263809204
sim_physics_mean0.058414733727773026
sim_physics_median0.059428006013234454
sim_physics_min0.05277527650197347
sim_render-ego_max0.03668109178543091
sim_render-ego_mean0.03648916625976563
sim_render-ego_median0.03645070155461629
sim_render-ego_min0.03632041295369466
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
218163296jp18813100494Third test - THaido2-LF-sim-validationstep1-simulationhost-errorno-0:00:48
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3296/step1-simulation-ip-172-31-40-253-32059-job21816/logs/challenges-runner/stdout.html'
Hidden. If you are the author, please login using the top-right link or use the dashboard.