Duckietown Challenges Home Challenges Submissions

Submission 3348

Submission3348
Competingyes
Challengeaido2-LF-sim-testing
UserAnastasiya Nikolskaya 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22383
Next
User labelJetBrains Research
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22383step1-simulationsuccessyes0:38:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.273824304807302
survival_time_median14.950000000000076
deviation-center-line_median1.0668153788232435
in-drivable-lane_median1.500000000000021


other stats
agent_compute-ego_max0.06309568881988525
agent_compute-ego_mean0.058333863800833864
agent_compute-ego_median0.0587743133123667
agent_compute-ego_min0.055319011211395264
deviation-center-line_max1.5062416131527931
deviation-center-line_mean1.0457914848974963
deviation-center-line_min0.22317703701956493
deviation-heading_max3.4075076597310834
deviation-heading_mean2.1436092158056166
deviation-heading_median2.2782070982995237
deviation-heading_min0.36812461770094246
driven_any_max2.8683646404459044
driven_any_mean2.403693438129074
driven_any_median2.555289046363012
driven_any_min0.4855518448567236
driven_lanedir_consec_max2.7041921280815258
driven_lanedir_consec_mean2.203661173057359
driven_lanedir_consec_min0.4795213350198617
driven_lanedir_max2.7041921280815258
driven_lanedir_mean2.203661173057359
driven_lanedir_median2.273824304807302
driven_lanedir_min0.4795213350198617
in-drivable-lane_max3.1500000000000137
in-drivable-lane_mean1.1800000000000113
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.555289046363012, "sim_physics": 0.05443640549977621, "survival_time": 14.950000000000076, "driven_lanedir": 2.273824304807302, "sim_render-ego": 0.05341917355855306, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.06309568881988525, "deviation-heading": 2.3621550484365375, "set_robot_commands": 0.07464634656906127, "deviation-center-line": 0.8966618140946153, "driven_lanedir_consec": 2.273824304807302, "sim_compute_sim_state": 0.03540565888086955, "sim_compute_performance-ego": 0.05754215796788534, "sim_compute_robot_state-ego": 0.058050514062245685}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.7676883774671817, "sim_physics": 0.05243040323257446, "survival_time": 14.950000000000076, "driven_lanedir": 2.7041921280815258, "sim_render-ego": 0.052100710074106854, "in-drivable-lane": 0, "agent_compute-ego": 0.0595928422609965, "deviation-heading": 2.472052742137097, "set_robot_commands": 0.07270831028620402, "deviation-center-line": 1.5062416131527931, "driven_lanedir_consec": 2.7041921280815258, "sim_compute_sim_state": 0.03436344544092814, "sim_compute_performance-ego": 0.05737790902455648, "sim_compute_robot_state-ego": 0.057094788551330565}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.8683646404459044, "sim_physics": 0.0527336311340332, "survival_time": 14.950000000000076, "driven_lanedir": 2.5797102550734525, "sim_render-ego": 0.052995885213216146, "in-drivable-lane": 1.8499999999999988, "agent_compute-ego": 0.06139525413513183, "deviation-heading": 1.797389722201714, "set_robot_commands": 0.07245214780171712, "deviation-center-line": 1.2588365308721297, "driven_lanedir_consec": 2.5797102550734525, "sim_compute_sim_state": 0.03509277900060018, "sim_compute_performance-ego": 0.05821548382441203, "sim_compute_robot_state-ego": 0.058182325363159176}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.704179415154952, "sim_physics": 0.0537701153755188, "survival_time": 14.950000000000076, "driven_lanedir": 2.6642010650537253, "sim_render-ego": 0.05135207096735636, "in-drivable-lane": 0, "agent_compute-ego": 0.05919340928395589, "deviation-heading": 2.308801569836406, "set_robot_commands": 0.07176581382751465, "deviation-center-line": 1.1484100585578727, "driven_lanedir_consec": 2.6642010650537253, "sim_compute_sim_state": 0.03473668098449707, "sim_compute_performance-ego": 0.057226155598958335, "sim_compute_robot_state-ego": 0.05778359015782674}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.719038698500618, "sim_physics": 0.05306801160176595, "survival_time": 14.950000000000076, "driven_lanedir": 2.6786944387095533, "sim_render-ego": 0.05023046731948853, "in-drivable-lane": 0, "agent_compute-ego": 0.05668161471684774, "deviation-heading": 2.1996381411156896, "set_robot_commands": 0.07027098417282104, "deviation-center-line": 1.060058237622659, "driven_lanedir_consec": 2.6786944387095533, "sim_compute_sim_state": 0.033995301723480226, "sim_compute_performance-ego": 0.054287681579589846, "sim_compute_robot_state-ego": 0.05717600663503011}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.494533527845001, "sim_physics": 0.05107132037480672, "survival_time": 14.950000000000076, "driven_lanedir": 2.0905967571555673, "sim_render-ego": 0.049561015764872235, "in-drivable-lane": 2.4500000000000224, "agent_compute-ego": 0.05563167413075765, "deviation-heading": 3.4075076597310834, "set_robot_commands": 0.07072275320688884, "deviation-center-line": 1.136068407298624, "driven_lanedir_consec": 2.0905967571555673, "sim_compute_sim_state": 0.0337887438138326, "sim_compute_performance-ego": 0.05458221197128296, "sim_compute_robot_state-ego": 0.05745431184768677}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.239600126176044, "sim_physics": 0.05310539219730584, "survival_time": 12.900000000000048, "driven_lanedir": 2.197148841206322, "sim_render-ego": 0.05191352663114089, "in-drivable-lane": 0, "agent_compute-ego": 0.05752133676248004, "deviation-heading": 2.178391145543189, "set_robot_commands": 0.07043030280475468, "deviation-center-line": 0.852357429224793, "driven_lanedir_consec": 2.197148841206322, "sim_compute_sim_state": 0.03433204251666402, "sim_compute_performance-ego": 0.05539678603179695, "sim_compute_robot_state-ego": 0.0572224966315336}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.4726017198086345, "sim_physics": 0.053763383229573566, "survival_time": 14.950000000000076, "driven_lanedir": 2.021303661972752, "sim_render-ego": 0.05101868073145548, "in-drivable-lane": 3.1500000000000137, "agent_compute-ego": 0.05635892868041992, "deviation-heading": 3.087614911323524, "set_robot_commands": 0.07040470123291015, "deviation-center-line": 1.0540088474401867, "driven_lanedir_consec": 2.021303661972752, "sim_compute_sim_state": 0.03388851006825765, "sim_compute_performance-ego": 0.05472349723180135, "sim_compute_robot_state-ego": 0.05639050165812175}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.8644804225835885, "sim_physics": 0.05067379077275594, "survival_time": 14.950000000000076, "driven_lanedir": 2.5413637189409974, "sim_render-ego": 0.05029419342676798, "in-drivable-lane": 2.050000000000029, "agent_compute-ego": 0.05603278636932373, "deviation-heading": 1.6689643180803893, "set_robot_commands": 0.07129679520924886, "deviation-center-line": 1.263360628633708, "driven_lanedir_consec": 2.5413637189409974, "sim_compute_sim_state": 0.0337441086769104, "sim_compute_performance-ego": 0.05453669865926107, "sim_compute_robot_state-ego": 0.05716479857762655}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.4855518448567236, "sim_physics": 0.05145642892369684, "survival_time": 2.6499999999999986, "driven_lanedir": 0.4795213350198617, "sim_render-ego": 0.05143121953280467, "in-drivable-lane": 0, "agent_compute-ego": 0.05947297923969773, "deviation-heading": 0.36812461770094246, "set_robot_commands": 0.07269542622116376, "deviation-center-line": 0.22317703701956493, "driven_lanedir_consec": 0.4795213350198617, "sim_compute_sim_state": 0.032597019987286265, "sim_compute_performance-ego": 0.05754252649703115, "sim_compute_robot_state-ego": 0.05736344265487959}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.3228510177628343, "sim_physics": 0.04634830191895202, "survival_time": 13.65000000000006, "driven_lanedir": 2.075214165628065, "sim_render-ego": 0.04977102768726838, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.057449153054764855, "deviation-heading": 2.2782070982995237, "set_robot_commands": 0.07121204543899703, "deviation-center-line": 0.986204444737575, "driven_lanedir_consec": 2.075214165628065, "sim_compute_sim_state": 0.031187274953821204, "sim_compute_performance-ego": 0.0551736328628037, "sim_compute_robot_state-ego": 0.055195031148610095}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.4629741679348673, "sim_physics": 0.04943120082219442, "survival_time": 14.950000000000076, "driven_lanedir": 2.119868394908984, "sim_render-ego": 0.05097667694091797, "in-drivable-lane": 2.5000000000000355, "agent_compute-ego": 0.05954811334609986, "deviation-heading": 2.166312880806245, "set_robot_commands": 0.0719173502922058, "deviation-center-line": 1.174547681745238, "driven_lanedir_consec": 2.119868394908984, "sim_compute_sim_state": 0.03388941367467244, "sim_compute_performance-ego": 0.05606005430221558, "sim_compute_robot_state-ego": 0.05688421726226807}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.7559820469796574, "sim_physics": 0.04803266525268555, "survival_time": 14.950000000000076, "driven_lanedir": 2.622313992283995, "sim_render-ego": 0.04968736330668132, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.055319011211395264, "deviation-heading": 2.4219058603883936, "set_robot_commands": 0.07088095426559449, "deviation-center-line": 1.3134077311291827, "driven_lanedir_consec": 2.622313992283995, "sim_compute_sim_state": 0.031873509883880616, "sim_compute_performance-ego": 0.05547487417856852, "sim_compute_robot_state-ego": 0.05476775884628296}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.7539355822900795, "sim_physics": 0.04702183723449707, "survival_time": 14.950000000000076, "driven_lanedir": 2.431634826550561, "sim_render-ego": 0.04895177046457926, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.05894085168838501, "deviation-heading": 2.5221633263256855, "set_robot_commands": 0.0729051955540975, "deviation-center-line": 1.0668153788232435, "driven_lanedir_consec": 2.431634826550561, "sim_compute_sim_state": 0.03130180358886719, "sim_compute_performance-ego": 0.05371969938278198, "sim_compute_robot_state-ego": 0.054546981652577715}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.588330937767021, "sim_physics": 0.048822250834271955, "survival_time": 8.14999999999998, "driven_lanedir": 1.575329710467725, "sim_render-ego": 0.04987404975423052, "in-drivable-lane": 0, "agent_compute-ego": 0.0587743133123667, "deviation-heading": 0.9149091951578248, "set_robot_commands": 0.0723045662136897, "deviation-center-line": 0.7467164331102603, "driven_lanedir_consec": 1.575329710467725, "sim_compute_sim_state": 0.03292984465148551, "sim_compute_performance-ego": 0.05515455907107862, "sim_compute_robot_state-ego": 0.055928070852361574}}
set_robot_commands_max0.07464634656906127
set_robot_commands_mean0.07177424620645792
set_robot_commands_median0.07176581382751465
set_robot_commands_min0.07027098417282104
sim_compute_performance-ego_max0.05821548382441203
sim_compute_performance-ego_mean0.0558009285456016
sim_compute_performance-ego_median0.05539678603179695
sim_compute_performance-ego_min0.05371969938278198
sim_compute_robot_state-ego_max0.058182325363159176
sim_compute_robot_state-ego_mean0.05674698906010274
sim_compute_robot_state-ego_median0.05716479857762655
sim_compute_robot_state-ego_min0.054546981652577715
sim_compute_sim_state_max0.03540565888086955
sim_compute_sim_state_mean0.0335417425230702
sim_compute_sim_state_median0.03388851006825765
sim_compute_sim_state_min0.031187274953821204
sim_physics_max0.05443640549977621
sim_physics_mean0.05107767589362723
sim_physics_median0.05145642892369684
sim_physics_min0.04634830191895202
sim_render-ego_max0.05341917355855306
sim_render-ego_mean0.05090518875822932
sim_render-ego_median0.05097667694091797
sim_render-ego_min0.04895177046457926
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.453333333333395
survival_time_min2.6499999999999986
No reset possible
21915step1-simulationsuccessno0:51:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21914step1-simulationhost-errorno0:36:43
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3348/step1-simulation-ip-172-31-38-104-5317-job21914/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible