Duckietown Challenges Home Challenges Submissions

Submission 2364

Submission2364
Competingyes
Challengeaido2-LFV-sim-testing
UserAndrea Censi 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23235
Next
User labelrandom_agent
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
23235step1-simulationsuccessyes0:13:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.09273098707199096
agent_compute-ego_mean0.08230540420316697
agent_compute-ego_median0.08123965012399774
agent_compute-ego_min0.07971321105957031
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.09381542823932788, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.03893580701616075, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.08201687424271195, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.05803256123154252, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.02465939963305438, "sim_compute_performance-ego": 0.042388982243008085, "sim_compute_robot_state-ego": 0.044423968703658494, "sim_compute_robot_state-npc0": 0.04388406100096526, "sim_compute_robot_state-npc1": 0.04251080972177011, "sim_compute_robot_state-npc2": 0.04284393787384033, "sim_compute_robot_state-npc3": 0.04230967274418584}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1115969467163086, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.03789063453674316, "in-drivable-lane": 0, "agent_compute-ego": 0.07971321105957031, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.055962953567504886, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.02420210838317871, "sim_compute_performance-ego": 0.04079850196838379, "sim_compute_robot_state-ego": 0.0443079662322998, "sim_compute_robot_state-npc0": 0.042649965286254886, "sim_compute_robot_state-npc1": 0.043189687728881834, "sim_compute_robot_state-npc2": 0.041452159881591795, "sim_compute_robot_state-npc3": 0.04299847602844238}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.10508913429159868, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.03863061729230379, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.08146321773529053, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.05644265287800839, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.024169128192098516, "sim_compute_performance-ego": 0.04165795916005185, "sim_compute_robot_state-ego": 0.043673072990618254, "sim_compute_robot_state-npc0": 0.04352562992196334, "sim_compute_robot_state-npc1": 0.042055986429515635, "sim_compute_robot_state-npc2": 0.04230459112870066, "sim_compute_robot_state-npc3": 0.0418746879226283}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.10383457473561732, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.03770413278024408, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.0809011308452751, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.05753641188899173, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.023772583732122102, "sim_compute_performance-ego": 0.0410875881774516, "sim_compute_robot_state-ego": 0.04254104819478867, "sim_compute_robot_state-npc0": 0.043224153639395024, "sim_compute_robot_state-npc1": 0.04145054575763171, "sim_compute_robot_state-npc2": 0.04139711283430268, "sim_compute_robot_state-npc3": 0.04131410997125167}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1004319361277989, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.037190062659127374, "in-drivable-lane": 0, "agent_compute-ego": 0.08169209957122803, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.05633191551480975, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.023633761065346853, "sim_compute_performance-ego": 0.04033600432532174, "sim_compute_robot_state-ego": 0.04220713887895856, "sim_compute_robot_state-npc0": 0.04253906011581421, "sim_compute_robot_state-npc1": 0.0409467305455889, "sim_compute_robot_state-npc2": 0.04128919328962054, "sim_compute_robot_state-npc3": 0.04037755727767944}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.09213305844200982, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.03791122966342502, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.08043166443153664, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.0562767364360668, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.02366626262664795, "sim_compute_performance-ego": 0.03985828823513455, "sim_compute_robot_state-ego": 0.04296978756233498, "sim_compute_robot_state-npc0": 0.04253504011366102, "sim_compute_robot_state-npc1": 0.0424619162524188, "sim_compute_robot_state-npc2": 0.04153762040314851, "sim_compute_robot_state-npc3": 0.04147899150848389}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.0927717376638342, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.03722485348030373, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.08008499498720523, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.05655577447679308, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.023874658125418204, "sim_compute_performance-ego": 0.04099614531905563, "sim_compute_robot_state-ego": 0.04310697096365469, "sim_compute_robot_state-npc0": 0.04190852023937084, "sim_compute_robot_state-npc1": 0.04254287702065927, "sim_compute_robot_state-npc2": 0.04070967215078848, "sim_compute_robot_state-npc3": 0.04214137571829336}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.11584308942159018, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.03911176787482368, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.08053103023105197, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.056720140245225696, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.02436809009975857, "sim_compute_performance-ego": 0.04111679924858941, "sim_compute_robot_state-ego": 0.04488192134433323, "sim_compute_robot_state-npc0": 0.04252863989935981, "sim_compute_robot_state-npc1": 0.04219637446933323, "sim_compute_robot_state-npc2": 0.0415876653459337, "sim_compute_robot_state-npc3": 0.04180100758870443}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.09731057415837828, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.03915119689443837, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.08154135165007217, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.05786226106726605, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.024352882219397503, "sim_compute_performance-ego": 0.041433774906656014, "sim_compute_robot_state-ego": 0.04383506982222847, "sim_compute_robot_state-npc0": 0.04288636083188264, "sim_compute_robot_state-npc1": 0.04225253022235373, "sim_compute_robot_state-npc2": 0.0420362897541212, "sim_compute_robot_state-npc3": 0.04293013655621072}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.11084618091583252, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.03906970024108887, "in-drivable-lane": 0, "agent_compute-ego": 0.08178653717041015, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.05836556911468506, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.024625420570373535, "sim_compute_performance-ego": 0.042728304862976074, "sim_compute_robot_state-ego": 0.04457656860351562, "sim_compute_robot_state-npc0": 0.04342511177062988, "sim_compute_robot_state-npc1": 0.0429574966430664, "sim_compute_robot_state-npc2": 0.04248351097106934, "sim_compute_robot_state-npc3": 0.04297650337219238}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.12055598497390747, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.03864039182662963, "in-drivable-lane": 0, "agent_compute-ego": 0.09273098707199096, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.05679248571395874, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.024163079261779782, "sim_compute_performance-ego": 0.04164844751358032, "sim_compute_robot_state-ego": 0.043072950839996335, "sim_compute_robot_state-npc0": 0.042217469215393065, "sim_compute_robot_state-npc1": 0.04246331453323364, "sim_compute_robot_state-npc2": 0.041651594638824466, "sim_compute_robot_state-npc3": 0.04174659252166748}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.09589512724625436, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.036544272774144224, "in-drivable-lane": 0, "agent_compute-ego": 0.08123965012399774, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.05615556867499101, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.024162819511012023, "sim_compute_performance-ego": 0.041020217694734275, "sim_compute_robot_state-ego": 0.04313403681704873, "sim_compute_robot_state-npc0": 0.04288162683185778, "sim_compute_robot_state-npc1": 0.04184385349876002, "sim_compute_robot_state-npc2": 0.041947051098472195, "sim_compute_robot_state-npc3": 0.04087298794796592}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.09184821605682374, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.03766915798187256, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.0806904125213623, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.05655341625213623, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.024083428382873535, "sim_compute_performance-ego": 0.0403921365737915, "sim_compute_robot_state-ego": 0.043624353408813474, "sim_compute_robot_state-npc0": 0.04169531345367432, "sim_compute_robot_state-npc1": 0.04195714950561523, "sim_compute_robot_state-npc2": 0.041856703758239744, "sim_compute_robot_state-npc3": 0.04175406455993652}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.11767477338964288, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.03891458294608376, "in-drivable-lane": 0, "agent_compute-ego": 0.08103394508361816, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.057267156514254486, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.02411584420637651, "sim_compute_performance-ego": 0.041258562694896354, "sim_compute_robot_state-ego": 0.043608817187222565, "sim_compute_robot_state-npc0": 0.042932737957347526, "sim_compute_robot_state-npc1": 0.04274197058244185, "sim_compute_robot_state-npc2": 0.04198368029160933, "sim_compute_robot_state-npc3": 0.04158584638075395}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.10962223520084304, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.03838856852784449, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.08872395632218341, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.056527726504267475, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.024063270919176996, "sim_compute_performance-ego": 0.04065101487295968, "sim_compute_robot_state-ego": 0.042978904685195614, "sim_compute_robot_state-npc0": 0.04244661331176758, "sim_compute_robot_state-npc1": 0.04182218532173001, "sim_compute_robot_state-npc2": 0.04172826786430515, "sim_compute_robot_state-npc3": 0.041336667780973474}}
set_robot_commands_max0.05836556911468506
set_robot_commands_mean0.0568922220053668
set_robot_commands_median0.05655577447679308
set_robot_commands_min0.055962953567504886
sim_compute_performance-ego_max0.042728304862976074
sim_compute_performance-ego_mean0.04115818185310605
sim_compute_performance-ego_median0.0410875881774516
sim_compute_performance-ego_min0.03985828823513455
sim_compute_robot_state-ego_max0.04488192134433323
sim_compute_robot_state-ego_mean0.043529505082311154
sim_compute_robot_state-ego_median0.043608817187222565
sim_compute_robot_state-ego_min0.04220713887895856
sim_compute_robot_state-npc0_max0.04388406100096526
sim_compute_robot_state-npc0_mean0.042752020239289146
sim_compute_robot_state-npc0_median0.042649965286254886
sim_compute_robot_state-npc0_min0.04169531345367432
sim_compute_robot_state-npc1_max0.043189687728881834
sim_compute_robot_state-npc1_mean0.0422262285488667
sim_compute_robot_state-npc1_median0.04225253022235373
sim_compute_robot_state-npc1_min0.0409467305455889
sim_compute_robot_state-npc2_max0.04284393787384033
sim_compute_robot_state-npc2_mean0.04178727008563787
sim_compute_robot_state-npc2_median0.04172826786430515
sim_compute_robot_state-npc2_min0.04070967215078848
sim_compute_robot_state-npc3_max0.04299847602844238
sim_compute_robot_state-npc3_mean0.041833245191957975
sim_compute_robot_state-npc3_median0.04175406455993652
sim_compute_robot_state-npc3_min0.04037755727767944
sim_compute_sim_state_max0.02465939963305438
sim_compute_sim_state_mean0.02412751579524101
sim_compute_sim_state_median0.024162819511012023
sim_compute_sim_state_min0.023633761065346853
sim_physics_max0.12055598497390747
sim_physics_mean0.10395126650531786
sim_physics_median0.10383457473561732
sim_physics_min0.09184821605682374
sim_render-ego_max0.03915119689443837
sim_render-ego_mean0.03819846509968223
sim_render-ego_median0.03838856852784449
sim_render-ego_min0.036544272774144224
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
No reset possible
23032step1-simulationabortedyes0:17:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21381step1-simulationsuccessno0:20:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21375step1-simulationhost-errorno0:16:43
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2364/step1-simulation-ip-172-31-25-98-2062-job21375/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20623step1-simulationsuccessno0:10:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19676step1-simulationsuccessno0:06:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18925step1-simulationsuccessno0:13:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18557step1-simulationsuccessno0:11:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17922step1-simulationsuccessno0:07:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17584step1-simulationsuccessno0:06:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17558step1-simulationabortedno0:07:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible