AI Driving Olympics Home Challenges Submissions Jobs

Submission 3328

Submission3328
Competingyes
Challengeaido2-LFV-sim-validation
Userjp18813100494
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22407
Next
User labelRL - TH -xyz
Admin priority50
Blessing50
User priority

22407

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
224073328jp18813100494RL - TH -xyzaido2-LFV-sim-validationstep1-simulationsuccessyes-0:11:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.227819515552722
survival_time_median5.799999999999987
deviation-center-line_median0.22386875522206823
in-drivable-lane_median1.4499999999999948


other stats
agent_compute-ego_max0.1874852180480957
agent_compute-ego_mean0.18004823055148172
agent_compute-ego_median0.18359124369737576
agent_compute-ego_min0.1695663542360873
deviation-center-line_max0.4305492360948032
deviation-center-line_mean0.2427194205077623
deviation-center-line_min0.12290248816951904
deviation-heading_max2.352856747169026
deviation-heading_mean1.0506874496921812
deviation-heading_median0.7176770483640806
deviation-heading_min0.6099402965886649
driven_any_max1.7192664304834346
driven_any_mean1.2511217070796443
driven_any_median1.5978390101871738
driven_any_min0.3080067169334595
driven_lanedir_consec_max1.2445934083383023
driven_lanedir_consec_mean0.9234546878934644
driven_lanedir_consec_min0.2587589692083694
driven_lanedir_max1.2445934083383023
driven_lanedir_mean0.9267754187677676
driven_lanedir_median1.2365591490514087
driven_lanedir_min0.2587589692083694
in-drivable-lane_max1.6999999999999966
in-drivable-lane_mean1.1899999999999964
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0310896536940737, "sim_physics": 0.09291348876533928, "survival_time": 4.549999999999992, "driven_lanedir": 0.6495423973165191, "sim_render-ego": 0.057694809777396064, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.1726825263474014, "deviation-heading": 0.7176770483640806, "set_robot_commands": 0.07646369148086715, "deviation-center-line": 0.22386875522206823, "driven_lanedir_consec": 0.6495423973165191, "sim_compute_sim_state": 0.03389178527580513, "sim_compute_performance-ego": 0.06092306021805648, "sim_compute_robot_state-ego": 0.060767142327277215, "sim_compute_robot_state-npc0": 0.06636866894397107, "sim_compute_robot_state-npc1": 0.06290915248158215, "sim_compute_robot_state-npc2": 0.061598513152573135, "sim_compute_robot_state-npc3": 0.061416990154392115}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3080067169334595, "sim_physics": 0.10154511477496173, "survival_time": 1.850000000000001, "driven_lanedir": 0.2587589692083694, "sim_render-ego": 0.05773340044794856, "in-drivable-lane": 0, "agent_compute-ego": 0.1695663542360873, "deviation-heading": 0.9349624220681668, "set_robot_commands": 0.07586627393155485, "deviation-center-line": 0.12290248816951904, "driven_lanedir_consec": 0.2587589692083694, "sim_compute_sim_state": 0.035546998719911314, "sim_compute_performance-ego": 0.06304561769640124, "sim_compute_robot_state-ego": 0.06304141637441274, "sim_compute_robot_state-npc0": 0.07010271742537215, "sim_compute_robot_state-npc1": 0.06242302946142248, "sim_compute_robot_state-npc2": 0.06101175901052114, "sim_compute_robot_state-npc3": 0.063053002228608}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5978390101871738, "sim_physics": 0.10044576176281632, "survival_time": 5.799999999999987, "driven_lanedir": 1.2445934083383023, "sim_render-ego": 0.05622075343954152, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.1874852180480957, "deviation-heading": 0.6099402965886649, "set_robot_commands": 0.07629847937616809, "deviation-center-line": 0.1768586536968656, "driven_lanedir_consec": 1.2445934083383023, "sim_compute_sim_state": 0.03474992719189874, "sim_compute_performance-ego": 0.0606634966258345, "sim_compute_robot_state-ego": 0.05991466497552806, "sim_compute_robot_state-npc0": 0.06742263251337512, "sim_compute_robot_state-npc1": 0.06316429376602173, "sim_compute_robot_state-npc2": 0.062200116700139536, "sim_compute_robot_state-npc3": 0.06083532037406132}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.599406724100081, "sim_physics": 0.10042242861505764, "survival_time": 6.699999999999984, "driven_lanedir": 1.2365591490514087, "sim_render-ego": 0.057240123179421495, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.18691581042844857, "deviation-heading": 0.6380007342709684, "set_robot_commands": 0.0775475751108198, "deviation-center-line": 0.4305492360948032, "driven_lanedir_consec": 1.2365591490514087, "sim_compute_sim_state": 0.03502555391681728, "sim_compute_performance-ego": 0.060114931704393075, "sim_compute_robot_state-ego": 0.06145497934142156, "sim_compute_robot_state-npc0": 0.06833919482444649, "sim_compute_robot_state-npc1": 0.06316670375083809, "sim_compute_robot_state-npc2": 0.06123581217296088, "sim_compute_robot_state-npc3": 0.06167893623238179}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7192664304834346, "sim_physics": 0.09126594153846182, "survival_time": 8.199999999999982, "driven_lanedir": 1.2444231699242378, "sim_render-ego": 0.057317038861716664, "in-drivable-lane": 1.6999999999999966, "agent_compute-ego": 0.18359124369737576, "deviation-heading": 2.352856747169026, "set_robot_commands": 0.07545680970680423, "deviation-center-line": 0.2594179693555554, "driven_lanedir_consec": 1.227819515552722, "sim_compute_sim_state": 0.03433303571328884, "sim_compute_performance-ego": 0.0601655273902707, "sim_compute_robot_state-ego": 0.06169008191038922, "sim_compute_robot_state-npc0": 0.0668684200542729, "sim_compute_robot_state-npc1": 0.0626609659776455, "sim_compute_robot_state-npc2": 0.06146310887685636, "sim_compute_robot_state-npc3": 0.06112768155772511}}
set_robot_commands_max0.0775475751108198
set_robot_commands_mean0.07632656592124283
set_robot_commands_median0.07629847937616809
set_robot_commands_min0.07545680970680423
sim_compute_performance-ego_max0.06304561769640124
sim_compute_performance-ego_mean0.060982526726991206
sim_compute_performance-ego_median0.0606634966258345
sim_compute_performance-ego_min0.060114931704393075
sim_compute_robot_state-ego_max0.06304141637441274
sim_compute_robot_state-ego_mean0.061373656985805755
sim_compute_robot_state-ego_median0.06145497934142156
sim_compute_robot_state-ego_min0.05991466497552806
sim_compute_robot_state-npc0_max0.07010271742537215
sim_compute_robot_state-npc0_mean0.06782032675228755
sim_compute_robot_state-npc0_median0.06742263251337512
sim_compute_robot_state-npc0_min0.06636866894397107
sim_compute_robot_state-npc1_max0.06316670375083809
sim_compute_robot_state-npc1_mean0.06286482908750199
sim_compute_robot_state-npc1_median0.06290915248158215
sim_compute_robot_state-npc1_min0.06242302946142248
sim_compute_robot_state-npc2_max0.062200116700139536
sim_compute_robot_state-npc2_mean0.061501861982610206
sim_compute_robot_state-npc2_median0.06146310887685636
sim_compute_robot_state-npc2_min0.06101175901052114
sim_compute_robot_state-npc3_max0.063053002228608
sim_compute_robot_state-npc3_mean0.06162238610943367
sim_compute_robot_state-npc3_median0.061416990154392115
sim_compute_robot_state-npc3_min0.06083532037406132
sim_compute_sim_state_max0.035546998719911314
sim_compute_sim_state_mean0.03470946016354426
sim_compute_sim_state_median0.03474992719189874
sim_compute_sim_state_min0.03389178527580513
sim_physics_max0.10154511477496173
sim_physics_mean0.09731854709132735
sim_physics_median0.10042242861505764
sim_physics_min0.09126594153846182
sim_render-ego_max0.05773340044794856
sim_render-ego_mean0.05724122514120487
sim_render-ego_median0.057317038861716664
sim_render-ego_min0.05622075343954152
simulation-passed1
survival_time_max8.199999999999982
survival_time_mean5.419999999999989
survival_time_min1.850000000000001
218713328jp18813100494RL - TH -xyzaido2-LFV-sim-validationstep1-simulationsuccessno-0:10:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1089760897555982
survival_time_median5.549999999999988
deviation-center-line_median0.2476663086154968
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.10043633806294408
agent_compute-ego_mean0.09964748932311723
agent_compute-ego_median0.09954852026862068
agent_compute-ego_min0.09846871429019503
deviation-center-line_max0.7255807918250504
deviation-center-line_mean0.30237382814243546
deviation-center-line_min0.109162676733599
deviation-heading_max2.2544182705193885
deviation-heading_mean1.0865783989719835
deviation-heading_median0.903509765853432
deviation-heading_min0.3073496771774518
driven_any_max2.46068057326112
driven_any_mean1.418269167469275
driven_any_median1.6405268191114948
driven_any_min0.309788092040252
driven_lanedir_consec_max2.0707898667846076
driven_lanedir_consec_mean1.0473676702411958
driven_lanedir_consec_min0.2367789929468218
driven_lanedir_max2.0707898667846076
driven_lanedir_mean1.0480428064415608
driven_lanedir_median1.1089760897555982
driven_lanedir_min0.2367789929468218
in-drivable-lane_max2.2000000000000313
in-drivable-lane_mean1.340000000000003
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.006216106124416, "sim_physics": 0.08766241320248308, "survival_time": 2.8999999999999977, "driven_lanedir": 0.6299700438633247, "sim_render-ego": 0.036278350599880875, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.10043633806294408, "deviation-heading": 0.3073496771774518, "set_robot_commands": 0.056041261245464456, "deviation-center-line": 0.1492936891058104, "driven_lanedir_consec": 0.6299700438633247, "sim_compute_sim_state": 0.023416140983844622, "sim_compute_performance-ego": 0.039528904290034854, "sim_compute_robot_state-ego": 0.041777660106790473, "sim_compute_robot_state-npc0": 0.04110654058127568, "sim_compute_robot_state-npc1": 0.040330652532906366, "sim_compute_robot_state-npc2": 0.04006481992787328, "sim_compute_robot_state-npc3": 0.040360146555407296}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.309788092040252, "sim_physics": 0.09868758916854858, "survival_time": 1.800000000000001, "driven_lanedir": 0.2367789929468218, "sim_render-ego": 0.03577463494406806, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09846871429019503, "deviation-heading": 0.903509765853432, "set_robot_commands": 0.0548584328757392, "deviation-center-line": 0.109162676733599, "driven_lanedir_consec": 0.2367789929468218, "sim_compute_sim_state": 0.022580855422549777, "sim_compute_performance-ego": 0.03875249624252319, "sim_compute_robot_state-ego": 0.04208064079284668, "sim_compute_robot_state-npc0": 0.04180896944469876, "sim_compute_robot_state-npc1": 0.04025032785203722, "sim_compute_robot_state-npc2": 0.03989122973548041, "sim_compute_robot_state-npc3": 0.04021992948320177}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6405268191114948, "sim_physics": 0.10093544195364187, "survival_time": 5.549999999999988, "driven_lanedir": 1.1089760897555982, "sim_render-ego": 0.03641449008976017, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.09954852026862068, "deviation-heading": 0.5475181023038442, "set_robot_commands": 0.05543541263889622, "deviation-center-line": 0.2476663086154968, "driven_lanedir_consec": 1.1089760897555982, "sim_compute_sim_state": 0.02319771319896251, "sim_compute_performance-ego": 0.04059879629461615, "sim_compute_robot_state-ego": 0.04179670574428799, "sim_compute_robot_state-npc0": 0.04111805262866321, "sim_compute_robot_state-npc1": 0.04005959656861451, "sim_compute_robot_state-npc2": 0.04029966045070339, "sim_compute_robot_state-npc3": 0.03996166023048195}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.46068057326112, "sim_physics": 0.0903441705286302, "survival_time": 14.850000000000076, "driven_lanedir": 2.0707898667846076, "sim_render-ego": 0.036679272699837735, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.09950267104588777, "deviation-heading": 2.2544182705193885, "set_robot_commands": 0.055217771819143585, "deviation-center-line": 0.7255807918250504, "driven_lanedir_consec": 2.0707898667846076, "sim_compute_sim_state": 0.022896631799563017, "sim_compute_performance-ego": 0.039418395520862105, "sim_compute_robot_state-ego": 0.04170561238170072, "sim_compute_robot_state-npc0": 0.041410556947342074, "sim_compute_robot_state-npc1": 0.04009133155899818, "sim_compute_robot_state-npc2": 0.040033259375729546, "sim_compute_robot_state-npc3": 0.04062601131220859}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6741342468090905, "sim_physics": 0.08937837396349226, "survival_time": 7.699999999999981, "driven_lanedir": 1.1936990388574518, "sim_render-ego": 0.038546302101828835, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1002812029479386, "deviation-heading": 1.420096179005801, "set_robot_commands": 0.05575072765350342, "deviation-center-line": 0.2801656744322206, "driven_lanedir_consec": 1.1903233578556274, "sim_compute_sim_state": 0.02322024494022518, "sim_compute_performance-ego": 0.03952988711270419, "sim_compute_robot_state-ego": 0.042187466249837505, "sim_compute_robot_state-npc0": 0.04151959233469777, "sim_compute_robot_state-npc1": 0.040328295199902026, "sim_compute_robot_state-npc2": 0.04019608745327244, "sim_compute_robot_state-npc3": 0.040174156040340275}}
set_robot_commands_max0.056041261245464456
set_robot_commands_mean0.05546072124654937
set_robot_commands_median0.05543541263889622
set_robot_commands_min0.0548584328757392
sim_compute_performance-ego_max0.04059879629461615
sim_compute_performance-ego_mean0.0395656958921481
sim_compute_performance-ego_median0.039528904290034854
sim_compute_performance-ego_min0.03875249624252319
sim_compute_robot_state-ego_max0.042187466249837505
sim_compute_robot_state-ego_mean0.04190961705509268
sim_compute_robot_state-ego_median0.04179670574428799
sim_compute_robot_state-ego_min0.04170561238170072
sim_compute_robot_state-npc0_max0.04180896944469876
sim_compute_robot_state-npc0_mean0.04139274238733549
sim_compute_robot_state-npc0_median0.041410556947342074
sim_compute_robot_state-npc0_min0.04110654058127568
sim_compute_robot_state-npc1_max0.040330652532906366
sim_compute_robot_state-npc1_mean0.04021204074249166
sim_compute_robot_state-npc1_median0.04025032785203722
sim_compute_robot_state-npc1_min0.04005959656861451
sim_compute_robot_state-npc2_max0.04029966045070339
sim_compute_robot_state-npc2_mean0.04009701138861181
sim_compute_robot_state-npc2_median0.04006481992787328
sim_compute_robot_state-npc2_min0.03989122973548041
sim_compute_robot_state-npc3_max0.04062601131220859
sim_compute_robot_state-npc3_mean0.04026838072432797
sim_compute_robot_state-npc3_median0.04021992948320177
sim_compute_robot_state-npc3_min0.03996166023048195
sim_compute_sim_state_max0.023416140983844622
sim_compute_sim_state_mean0.02306231726902902
sim_compute_sim_state_median0.02319771319896251
sim_compute_sim_state_min0.022580855422549777
sim_physics_max0.10093544195364187
sim_physics_mean0.09340159776335918
sim_physics_median0.0903441705286302
sim_physics_min0.08766241320248308
sim_render-ego_max0.038546302101828835
sim_render-ego_mean0.03673861008707513
sim_render-ego_median0.03641449008976017
sim_render-ego_min0.03577463494406806
simulation-passed1
survival_time_max14.850000000000076
survival_time_mean6.560000000000008
survival_time_min1.800000000000001
218703328jp18813100494RL - TH -xyzaido2-LFV-sim-validationstep1-simulationhost-errorno-0:05:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission3328/step1-simulation-ip-172-31-40-253-32059-job21870/logs/challenges-runner/stdout.html'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
218693328jp18813100494RL - TH -xyzaido2-LFV-sim-validationstep1-simulationhost-errorno-0:05:53
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission3328/step1-simulation-ip-172-31-42-167-7194-job21869/logs/challenges-runner/stdout.html'
Hidden. If you are the author, please login using the top-right link or use the dashboard.