AI Driving Olympics Home Challenges Submissions Jobs

Submission 3190

Submission3190
Competingyes
Challengeaido2-LF-sim-validation
UserJBRRussia
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22545
Next
User labelNN Solution
Admin priority50
Blessing50
User priority

22545

Click the images to see detailed statistics about the episode.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
225453190JBRRussiaNN Solutionaido2-LF-sim-validationstep1-simulationsuccessyes-0:28:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.565454441076636
survival_time_median14.950000000000076
deviation-center-line_median1.1048541736364808
in-drivable-lane_median1.7499999999999938


other stats
agent_compute-ego_max0.11431202173233032
agent_compute-ego_mean0.1111501953268564
agent_compute-ego_median0.1122921794973394
agent_compute-ego_min0.106088125705719
deviation-center-line_max1.2795665520291992
deviation-center-line_mean1.0784654919112424
deviation-center-line_min0.6489066981260487
deviation-heading_max3.24259962279599
deviation-heading_mean2.555693089139582
deviation-heading_median2.848507363300843
deviation-heading_min1.3470834296994465
driven_any_max3.064133709422124
driven_any_mean2.8251956235131335
driven_any_median3.0640542624367324
driven_any_min1.879636541915353
driven_lanedir_consec_max2.9551951891344515
driven_lanedir_consec_mean2.4565892741769777
driven_lanedir_consec_min1.8039808852920165
driven_lanedir_max2.9551951891344515
driven_lanedir_mean2.4565892741769777
driven_lanedir_median2.565454441076636
driven_lanedir_min1.8039808852920165
in-drivable-lane_max2.750000000000039
in-drivable-lane_mean1.2700000000000062
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.054059899981893, "sim_physics": 0.1342835791905721, "survival_time": 14.950000000000076, "driven_lanedir": 2.3140011021734, "sim_render-ego": 0.07029918114344279, "in-drivable-lane": 2.750000000000039, "agent_compute-ego": 0.11431202173233032, "deviation-heading": 3.1280961506916416, "set_robot_commands": 0.11399154424667358, "deviation-center-line": 1.1048541736364808, "driven_lanedir_consec": 2.3140011021734, "sim_compute_sim_state": 0.04298319657643636, "sim_compute_performance-ego": 0.07865835905075073, "sim_compute_robot_state-ego": 0.0889142362276713}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.0640937038095637, "sim_physics": 0.13397605975468954, "survival_time": 14.950000000000076, "driven_lanedir": 2.565454441076636, "sim_render-ego": 0.07155969699223837, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.11231665372848512, "deviation-heading": 3.24259962279599, "set_robot_commands": 0.1130498433113098, "deviation-center-line": 1.0824156929037418, "driven_lanedir_consec": 2.565454441076636, "sim_compute_sim_state": 0.04327025254567464, "sim_compute_performance-ego": 0.08004132986068725, "sim_compute_robot_state-ego": 0.09201850573221844}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.064133709422124, "sim_physics": 0.12865578571955363, "survival_time": 14.950000000000076, "driven_lanedir": 2.644314753208384, "sim_render-ego": 0.07078912734985351, "in-drivable-lane": 1.849999999999998, "agent_compute-ego": 0.11074199597040812, "deviation-heading": 1.3470834296994465, "set_robot_commands": 0.1100933559735616, "deviation-center-line": 1.2765843428607413, "driven_lanedir_consec": 2.644314753208384, "sim_compute_sim_state": 0.0431714129447937, "sim_compute_performance-ego": 0.07867499828338623, "sim_compute_robot_state-ego": 0.0871767020225525}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.879636541915353, "sim_physics": 0.13316760909172795, "survival_time": 9.299999999999995, "driven_lanedir": 1.8039808852920165, "sim_render-ego": 0.07188243378875075, "in-drivable-lane": 0, "agent_compute-ego": 0.1122921794973394, "deviation-heading": 2.212178879209989, "set_robot_commands": 0.1102669636408488, "deviation-center-line": 0.6489066981260487, "driven_lanedir_consec": 1.8039808852920165, "sim_compute_sim_state": 0.042934594615813226, "sim_compute_performance-ego": 0.07942879071799658, "sim_compute_robot_state-ego": 0.08814696599078435}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.0640542624367324, "sim_physics": 0.1158755866686503, "survival_time": 14.950000000000076, "driven_lanedir": 2.9551951891344515, "sim_render-ego": 0.06413028955459595, "in-drivable-lane": 0, "agent_compute-ego": 0.106088125705719, "deviation-heading": 2.848507363300843, "set_robot_commands": 0.1024988357226054, "deviation-center-line": 1.2795665520291992, "driven_lanedir_consec": 2.9551951891344515, "sim_compute_sim_state": 0.039449278513590494, "sim_compute_performance-ego": 0.07311878283818563, "sim_compute_robot_state-ego": 0.08317259152730307}}
set_robot_commands_max0.11399154424667358
set_robot_commands_mean0.10998010857899984
set_robot_commands_median0.1102669636408488
set_robot_commands_min0.1024988357226054
sim_compute_performance-ego_max0.08004132986068725
sim_compute_performance-ego_mean0.07798445215020129
sim_compute_performance-ego_median0.07867499828338623
sim_compute_performance-ego_min0.07311878283818563
sim_compute_robot_state-ego_max0.09201850573221844
sim_compute_robot_state-ego_mean0.08788580030010593
sim_compute_robot_state-ego_median0.08814696599078435
sim_compute_robot_state-ego_min0.08317259152730307
sim_compute_sim_state_max0.04327025254567464
sim_compute_sim_state_mean0.04236174703926169
sim_compute_sim_state_median0.04298319657643636
sim_compute_sim_state_min0.039449278513590494
sim_physics_max0.1342835791905721
sim_physics_mean0.1291917240850387
sim_physics_median0.13316760909172795
sim_physics_min0.1158755866686503
sim_render-ego_max0.07188243378875075
sim_render-ego_mean0.06973214576577627
sim_render-ego_median0.07078912734985351
sim_render-ego_min0.06413028955459595
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.82000000000006
survival_time_min9.299999999999995
214993190JBRRussiaNN Solutionaido2-LF-sim-validationstep1-simulationsuccessno-0:10:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0096368514757823
survival_time_median11.500000000000028
deviation-center-line_median0.9222028429987708
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06206277453381082
agent_compute-ego_mean0.06040884276354304
agent_compute-ego_median0.061561539967854816
agent_compute-ego_min0.05574692646662394
deviation-center-line_max1.2809593311596688
deviation-center-line_mean0.9931619772367696
deviation-center-line_min0.6077957145702887
deviation-heading_max3.843336238733628
deviation-heading_mean1.881123677761953
deviation-heading_median1.4015774707169977
deviation-heading_min0.957723749734539
driven_any_max3.0641146819014704
driven_any_mean2.3912601002466927
driven_any_median2.3408557906934404
driven_any_min1.4503852994932436
driven_lanedir_consec_max2.9080900586559726
driven_lanedir_consec_mean2.17962879520145
driven_lanedir_consec_min1.428387288482544
driven_lanedir_max2.9080900586559726
driven_lanedir_mean2.17962879520145
driven_lanedir_median2.0096368514757823
driven_lanedir_min1.428387288482544
in-drivable-lane_max1.7499999999999938
in-drivable-lane_mean0.6899999999999981
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.4503852994932436, "sim_physics": 0.061919859010879305, "survival_time": 7.299999999999982, "driven_lanedir": 1.428387288482544, "sim_render-ego": 0.037105153684746726, "in-drivable-lane": 0, "agent_compute-ego": 0.061577089845317685, "deviation-heading": 0.957723749734539, "set_robot_commands": 0.05598988108438988, "deviation-center-line": 0.6077957145702887, "driven_lanedir_consec": 1.428387288482544, "sim_compute_sim_state": 0.02424602639185239, "sim_compute_performance-ego": 0.04033666930786551, "sim_compute_robot_state-ego": 0.04228740359005863}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.0641146819014704, "sim_physics": 0.05670181433359782, "survival_time": 14.950000000000076, "driven_lanedir": 2.618564120212993, "sim_render-ego": 0.03656819423039754, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.05574692646662394, "deviation-heading": 2.0388310749790293, "set_robot_commands": 0.055452980995178223, "deviation-center-line": 1.2704174646304611, "driven_lanedir_consec": 2.618564120212993, "sim_compute_sim_state": 0.024507408142089845, "sim_compute_performance-ego": 0.04040131092071533, "sim_compute_robot_state-ego": 0.04231821616490682}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3408557906934404, "sim_physics": 0.05837993932806927, "survival_time": 11.500000000000028, "driven_lanedir": 1.9334656571799596, "sim_render-ego": 0.037054336589315666, "in-drivable-lane": 1.6999999999999966, "agent_compute-ego": 0.06206277453381082, "deviation-heading": 1.4015774707169977, "set_robot_commands": 0.05509617121323295, "deviation-center-line": 0.9222028429987708, "driven_lanedir_consec": 1.9334656571799596, "sim_compute_sim_state": 0.0244426675464796, "sim_compute_performance-ego": 0.04023374992868175, "sim_compute_robot_state-ego": 0.04277153844418733}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.064073475933625, "sim_physics": 0.06201379140218099, "survival_time": 14.950000000000076, "driven_lanedir": 2.9080900586559726, "sim_render-ego": 0.03716214021046956, "in-drivable-lane": 0, "agent_compute-ego": 0.061561539967854816, "deviation-heading": 3.843336238733628, "set_robot_commands": 0.055506645043691, "deviation-center-line": 1.2809593311596688, "driven_lanedir_consec": 2.9080900586559726, "sim_compute_sim_state": 0.024112961292266845, "sim_compute_performance-ego": 0.039834404786427816, "sim_compute_robot_state-ego": 0.04203800280888875}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.0368712532116846, "sim_physics": 0.06293465248980926, "survival_time": 10.050000000000008, "driven_lanedir": 2.0096368514757823, "sim_render-ego": 0.03692129713978933, "in-drivable-lane": 0, "agent_compute-ego": 0.06109588300410788, "deviation-heading": 1.1641498546455715, "set_robot_commands": 0.0560628739162464, "deviation-center-line": 0.8844345328246576, "driven_lanedir_consec": 2.0096368514757823, "sim_compute_sim_state": 0.024229536009072072, "sim_compute_performance-ego": 0.040153167734098674, "sim_compute_robot_state-ego": 0.042373259862264}}
set_robot_commands_max0.0560628739162464
set_robot_commands_mean0.0556217104505477
set_robot_commands_median0.055506645043691
set_robot_commands_min0.05509617121323295
sim_compute_performance-ego_max0.04040131092071533
sim_compute_performance-ego_mean0.04019186053555781
sim_compute_performance-ego_median0.04023374992868175
sim_compute_performance-ego_min0.039834404786427816
sim_compute_robot_state-ego_max0.04277153844418733
sim_compute_robot_state-ego_mean0.042357684174061105
sim_compute_robot_state-ego_median0.04231821616490682
sim_compute_robot_state-ego_min0.04203800280888875
sim_compute_sim_state_max0.024507408142089845
sim_compute_sim_state_mean0.024307719876352153
sim_compute_sim_state_median0.02424602639185239
sim_compute_sim_state_min0.024112961292266845
sim_physics_max0.06293465248980926
sim_physics_mean0.06039001131290733
sim_physics_median0.061919859010879305
sim_physics_min0.05670181433359782
sim_render-ego_max0.03716214021046956
sim_render-ego_mean0.03696222437094377
sim_render-ego_median0.037054336589315666
sim_render-ego_min0.03656819423039754
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.750000000000034
survival_time_min7.299999999999982
214983190JBRRussiaNN Solutionaido2-LF-sim-validationstep1-simulationhost-errorno-0:05:45
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3190/step1-simulation-ip-172-31-40-253-32059-job21498/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.