AI Driving Olympics Home Challenges Submissions Jobs

Submission 3314

Submission3314
Competingyes
Challengeaido2-LFVI-sim-testing
Useralmasip
Date submitted
Completecomplete
Resulterror
Jobsstep1-simulation: 22422
Next
User labelBaseline solution using reinforcement learning
Admin priority50
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
224223314almasipBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerroryes-0:56:04
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
218463314almasipBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationsuccessno-0:39:31(hidden)
driven_lanedir_consec_median0.7075224519796235
survival_time_median4.699999999999991
deviation-center-line_median0.241246897205332
in-drivable-lane_median1.0999999999999963


other stats
agent_compute-ego_max0.24591786023732776
agent_compute-ego_mean0.23959657220374533
agent_compute-ego_median0.2405333377347134
agent_compute-ego_min0.2328220453668148
deviation-center-line_max0.7997296163978556
deviation-center-line_mean0.30492416367116004
deviation-center-line_min0.10965310739058189
deviation-heading_max3.781536482371169
deviation-heading_mean1.3463378458126651
deviation-heading_median1.1824972447884343
deviation-heading_min0.6187574567546937
driven_any_max2.9498029106040247
driven_any_mean1.2584072110234166
driven_any_median1.079503435724163
driven_any_min0.5847021062385441
driven_lanedir_consec_max2.489916945389319
driven_lanedir_consec_mean0.902995086323476
driven_lanedir_consec_min0.23915926451304292
driven_lanedir_max2.492773855607556
driven_lanedir_mean0.9292452531527716
driven_lanedir_median0.7640836040259655
driven_lanedir_min0.25728842688620457
in-drivable-lane_max3.7999999999999874
in-drivable-lane_mean1.156666666666665
in-drivable-lane_min0.14999999999999947
per-episodes
details{"udem1-0-0": {"driven_any": 2.2994230111249037, "sim_physics": 0.12351900951282398, "survival_time": 9.249999999999996, "driven_lanedir": 2.149586645070193, "sim_render-ego": 0.07325436875626848, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.24591786023732776, "deviation-heading": 1.3846365381065882, "set_robot_commands": 0.08091886107986038, "deviation-center-line": 0.5446514164923788, "driven_lanedir_consec": 2.149407152717952, "sim_compute_sim_state": 0.04519633860201449, "sim_compute_performance-ego": 0.0731043325888144, "sim_compute_robot_state-ego": 0.06637918755814835, "sim_compute_robot_state-npc0": 0.08074465700097987, "sim_compute_robot_state-npc1": 0.07945716832135175, "sim_compute_robot_state-npc2": 0.0783392468014279, "sim_compute_robot_state-npc3": 0.07772064337859283}, "udem1-1-0": {"driven_any": 1.119802249229225, "sim_physics": 0.12997295905132683, "survival_time": 4.899999999999991, "driven_lanedir": 0.7640836040259655, "sim_render-ego": 0.0735386342418437, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.2424184789462965, "deviation-heading": 1.017561645796187, "set_robot_commands": 0.07997785295758929, "deviation-center-line": 0.3330478368695291, "driven_lanedir_consec": 0.7640836040259655, "sim_compute_sim_state": 0.0456951126760366, "sim_compute_performance-ego": 0.0745613550653263, "sim_compute_robot_state-ego": 0.06822214077930061, "sim_compute_robot_state-npc0": 0.08390703249950798, "sim_compute_robot_state-npc1": 0.08018744964988864, "sim_compute_robot_state-npc2": 0.07950582309645049, "sim_compute_robot_state-npc3": 0.07900266501368308}, "udem1-2-0": {"driven_any": 1.1003576018017642, "sim_physics": 0.13933611388253694, "survival_time": 5.04999999999999, "driven_lanedir": 0.7738766174511265, "sim_render-ego": 0.07486878527273046, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.2439149535528504, "deviation-heading": 1.1824972447884343, "set_robot_commands": 0.08013120500167997, "deviation-center-line": 0.27846646791537827, "driven_lanedir_consec": 0.7738766174511265, "sim_compute_sim_state": 0.0452838935474358, "sim_compute_performance-ego": 0.07478525378916523, "sim_compute_robot_state-ego": 0.07075050561734945, "sim_compute_robot_state-npc0": 0.08076348871287733, "sim_compute_robot_state-npc1": 0.08075876519231513, "sim_compute_robot_state-npc2": 0.07900945738990708, "sim_compute_robot_state-npc3": 0.07905547217567369}, "udem1-3-0": {"driven_any": 2.9498029106040247, "sim_physics": 0.12746146486160603, "survival_time": 11.750000000000032, "driven_lanedir": 2.492773855607556, "sim_render-ego": 0.07290213666063675, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.23986006087445197, "deviation-heading": 2.4464536842051254, "set_robot_commands": 0.07995028089969716, "deviation-center-line": 0.6813493400859474, "driven_lanedir_consec": 2.489916945389319, "sim_compute_sim_state": 0.04515442138022565, "sim_compute_performance-ego": 0.07492287209693421, "sim_compute_robot_state-ego": 0.07037342152696975, "sim_compute_robot_state-npc0": 0.08071639385629208, "sim_compute_robot_state-npc1": 0.07940035475061295, "sim_compute_robot_state-npc2": 0.07878847426556526, "sim_compute_robot_state-npc3": 0.07842719402719052}, "udem1-4-0": {"driven_any": 1.061806193642234, "sim_physics": 0.11748681285164574, "survival_time": 4.399999999999992, "driven_lanedir": 0.9126711834686468, "sim_render-ego": 0.07282048734751614, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.23766887187957764, "deviation-heading": 1.2857170174131431, "set_robot_commands": 0.07900062745267694, "deviation-center-line": 0.241246897205332, "driven_lanedir_consec": 0.9126711834686468, "sim_compute_sim_state": 0.043374630537900055, "sim_compute_performance-ego": 0.07389355789531361, "sim_compute_robot_state-ego": 0.06953328847885132, "sim_compute_robot_state-npc0": 0.07949389652772383, "sim_compute_robot_state-npc1": 0.07581604068929498, "sim_compute_robot_state-npc2": 0.07499848712574352, "sim_compute_robot_state-npc3": 0.07389879768544977}, "udem1-5-0": {"driven_any": 1.0832737420224503, "sim_physics": 0.12552918018178738, "survival_time": 4.699999999999991, "driven_lanedir": 0.8191112617520089, "sim_render-ego": 0.07284241534293966, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.2328220453668148, "deviation-heading": 0.7403286775631476, "set_robot_commands": 0.07890713975784626, "deviation-center-line": 0.17926711308547813, "driven_lanedir_consec": 0.8191112617520089, "sim_compute_sim_state": 0.04578971609156182, "sim_compute_performance-ego": 0.07422796969718122, "sim_compute_robot_state-ego": 0.07012865391183407, "sim_compute_robot_state-npc0": 0.08026950917345413, "sim_compute_robot_state-npc1": 0.07936634408666733, "sim_compute_robot_state-npc2": 0.07886559658862174, "sim_compute_robot_state-npc3": 0.07908476667201265}, "udem1-6-0": {"driven_any": 0.747445310900609, "sim_physics": 0.13590684655594498, "survival_time": 3.649999999999995, "driven_lanedir": 0.42666440612702994, "sim_render-ego": 0.07466262987215225, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.24082077692632808, "deviation-heading": 1.585775822231818, "set_robot_commands": 0.07938370965931514, "deviation-center-line": 0.18868173813171704, "driven_lanedir_consec": 0.3975820833889147, "sim_compute_sim_state": 0.04505633001458155, "sim_compute_performance-ego": 0.07337423220072707, "sim_compute_robot_state-ego": 0.06981138660483165, "sim_compute_robot_state-npc0": 0.08000757596264146, "sim_compute_robot_state-npc1": 0.07674032041471299, "sim_compute_robot_state-npc2": 0.07636981141077329, "sim_compute_robot_state-npc3": 0.07739324112461038}, "udem1-7-0": {"driven_any": 0.7844821842260253, "sim_physics": 0.14846415922675335, "survival_time": 3.5499999999999954, "driven_lanedir": 0.3858382473701054, "sim_render-ego": 0.07357490566414847, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.2412203164167807, "deviation-heading": 1.0069375029181975, "set_robot_commands": 0.07910823150419853, "deviation-center-line": 0.15297893267782434, "driven_lanedir_consec": 0.3858382473701054, "sim_compute_sim_state": 0.0436434376407677, "sim_compute_performance-ego": 0.07271878820070078, "sim_compute_robot_state-ego": 0.06994589953355386, "sim_compute_robot_state-npc0": 0.08003993101522956, "sim_compute_robot_state-npc1": 0.07925015771892709, "sim_compute_robot_state-npc2": 0.07879645723692129, "sim_compute_robot_state-npc3": 0.07655238433622978}, "udem1-8-0": {"driven_any": 2.2825094993686386, "sim_physics": 0.11471164334904065, "survival_time": 11.00000000000002, "driven_lanedir": 1.981908107743878, "sim_render-ego": 0.07220513387159867, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.23746697252446955, "deviation-heading": 3.781536482371169, "set_robot_commands": 0.08009944937445901, "deviation-center-line": 0.7997296163978556, "driven_lanedir_consec": 1.981908107743878, "sim_compute_sim_state": 0.044031945141879, "sim_compute_performance-ego": 0.07237928238782015, "sim_compute_robot_state-ego": 0.06379971395839344, "sim_compute_robot_state-npc0": 0.08016235503283414, "sim_compute_robot_state-npc1": 0.07845145789059725, "sim_compute_robot_state-npc2": 0.07819349223917181, "sim_compute_robot_state-npc3": 0.07742313688451594}, "udem1-9-0": {"driven_any": 1.079503435724163, "sim_physics": 0.12277321060105126, "survival_time": 5.04999999999999, "driven_lanedir": 0.9964834697684464, "sim_render-ego": 0.07390260224295135, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.2405333377347134, "deviation-heading": 1.389996532923492, "set_robot_commands": 0.08276782177462436, "deviation-center-line": 0.4115530306155443, "driven_lanedir_consec": 0.6891399420484474, "sim_compute_sim_state": 0.04593403504626586, "sim_compute_performance-ego": 0.0713035021678056, "sim_compute_robot_state-ego": 0.06263709540414338, "sim_compute_robot_state-npc0": 0.08026673298070927, "sim_compute_robot_state-npc1": 0.07983241458930591, "sim_compute_robot_state-npc2": 0.08022374445849126, "sim_compute_robot_state-npc3": 0.07933746706141104}, "udem1-10-0": {"driven_any": 0.6057425971353636, "sim_physics": 0.11930869496057904, "survival_time": 3.149999999999997, "driven_lanedir": 0.2967279644779448, "sim_render-ego": 0.07577680027674115, "in-drivable-lane": 1.0999999999999963, "agent_compute-ego": 0.2386052759866866, "deviation-heading": 1.0331032057691596, "set_robot_commands": 0.07899166288829985, "deviation-center-line": 0.11006650329854537, "driven_lanedir_consec": 0.29460327794996055, "sim_compute_sim_state": 0.04546992362491668, "sim_compute_performance-ego": 0.07469044034443205, "sim_compute_robot_state-ego": 0.06345526755802215, "sim_compute_robot_state-npc0": 0.08093509976826017, "sim_compute_robot_state-npc1": 0.0802182848491366, "sim_compute_robot_state-npc2": 0.07848747192867218, "sim_compute_robot_state-npc3": 0.07763655223543682}, "udem1-11-0": {"driven_any": 1.1154292006223516, "sim_physics": 0.1228835561254003, "survival_time": 5.549999999999988, "driven_lanedir": 0.3175142327911922, "sim_render-ego": 0.07376240180419372, "in-drivable-lane": 3.7999999999999874, "agent_compute-ego": 0.24150771063727303, "deviation-heading": 0.6187574567546937, "set_robot_commands": 0.07940190762012929, "deviation-center-line": 0.10965310739058189, "driven_lanedir_consec": 0.3175142327911922, "sim_compute_sim_state": 0.04581973574183008, "sim_compute_performance-ego": 0.07386373614405727, "sim_compute_robot_state-ego": 0.06275477065696372, "sim_compute_robot_state-npc0": 0.08029138504921852, "sim_compute_robot_state-npc1": 0.07901640840478845, "sim_compute_robot_state-npc2": 0.07858846209070704, "sim_compute_robot_state-npc3": 0.07912953265078433}, "udem1-12-0": {"driven_any": 1.0584181616647903, "sim_physics": 0.11704572222449562, "survival_time": 4.399999999999992, "driven_lanedir": 0.7415588524893215, "sim_render-ego": 0.07342115315524014, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.2421420758420771, "deviation-heading": 0.8114822018609718, "set_robot_commands": 0.0794204906983809, "deviation-center-line": 0.25882757045739846, "driven_lanedir_consec": 0.7075224519796235, "sim_compute_sim_state": 0.04457402229309082, "sim_compute_performance-ego": 0.07406210628422824, "sim_compute_robot_state-ego": 0.06269672783938321, "sim_compute_robot_state-npc0": 0.08070160313086076, "sim_compute_robot_state-npc1": 0.08021959391507236, "sim_compute_robot_state-npc2": 0.08010741797360507, "sim_compute_robot_state-npc3": 0.07910238070921465}, "udem1-13-0": {"driven_any": 1.0034099610461609, "sim_physics": 0.10935029638818948, "survival_time": 4.149999999999993, "driven_lanedir": 0.6225919222619569, "sim_render-ego": 0.07278811787984457, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.236213069364249, "deviation-heading": 0.6412779843899429, "set_robot_commands": 0.08026765053530774, "deviation-center-line": 0.16132770565450014, "driven_lanedir_consec": 0.6225919222619569, "sim_compute_sim_state": 0.04370472517358251, "sim_compute_performance-ego": 0.07314045170703566, "sim_compute_robot_state-ego": 0.06349238142909774, "sim_compute_robot_state-npc0": 0.07989169603370759, "sim_compute_robot_state-npc1": 0.07819323654634407, "sim_compute_robot_state-npc2": 0.07691683826676335, "sim_compute_robot_state-npc3": 0.07680630683898926}, "udem1-14-0": {"driven_any": 0.5847021062385441, "sim_physics": 0.12794635213654618, "survival_time": 2.8999999999999977, "driven_lanedir": 0.25728842688620457, "sim_render-ego": 0.07370706262259648, "in-drivable-lane": 1.0499999999999985, "agent_compute-ego": 0.23283677676628375, "deviation-heading": 1.2690056900979034, "set_robot_commands": 0.08276375819896829, "deviation-center-line": 0.12301517878938915, "driven_lanedir_consec": 0.23915926451304292, "sim_compute_sim_state": 0.046354256827255774, "sim_compute_performance-ego": 0.0716942754285089, "sim_compute_robot_state-ego": 0.06313189555858743, "sim_compute_robot_state-npc0": 0.08003933676357927, "sim_compute_robot_state-npc1": 0.08002760903588657, "sim_compute_robot_state-npc2": 0.07932846710599702, "sim_compute_robot_state-npc3": 0.07834964785082586}}
set_robot_commands_max0.08276782177462436
set_robot_commands_mean0.0800727099602022
set_robot_commands_median0.07995028089969716
set_robot_commands_min0.07890713975784626
sim_compute_performance-ego_max0.07492287209693421
sim_compute_performance-ego_mean0.07351481039987004
sim_compute_performance-ego_median0.07386373614405727
sim_compute_performance-ego_min0.0713035021678056
sim_compute_robot_state-ego_max0.07075050561734945
sim_compute_robot_state-ego_mean0.06647415576102868
sim_compute_robot_state-ego_median0.06637918755814835
sim_compute_robot_state-ego_min0.06263709540414338
sim_compute_robot_state-npc0_max0.08390703249950798
sim_compute_robot_state-npc0_mean0.08054871290052507
sim_compute_robot_state-npc0_median0.08026950917345413
sim_compute_robot_state-npc0_min0.07949389652772383
sim_compute_robot_state-npc1_max0.08075876519231513
sim_compute_robot_state-npc1_mean0.07912904040366013
sim_compute_robot_state-npc1_median0.07940035475061295
sim_compute_robot_state-npc1_min0.07581604068929498
sim_compute_robot_state-npc2_max0.08022374445849126
sim_compute_robot_state-npc2_mean0.07843461653192121
sim_compute_robot_state-npc2_median0.07878847426556526
sim_compute_robot_state-npc2_min0.07499848712574352
sim_compute_robot_state-npc3_max0.07933746706141104
sim_compute_robot_state-npc3_mean0.07792801257630805
sim_compute_robot_state-npc3_median0.07834964785082586
sim_compute_robot_state-npc3_min0.07389879768544977
sim_compute_sim_state_max0.046354256827255774
sim_compute_sim_state_mean0.04500550162262296
sim_compute_sim_state_median0.04519633860201449
sim_compute_sim_state_min0.043374630537900055
sim_physics_max0.14846415922675335
sim_physics_mean0.12544640146064853
sim_physics_median0.12351900951282398
sim_physics_min0.10935029638818948
sim_render-ego_max0.07577680027674115
sim_render-ego_mean0.07360184233409345
sim_render-ego_median0.0735386342418437
sim_render-ego_min0.07220513387159867
simulation-passed1
survival_time_max11.750000000000032
survival_time_mean5.56333333333333
survival_time_min2.8999999999999977
218453314almasipBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:12:08
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission3314/step1-simulation-ip-172-31-40-253-32125-job21845/logs/challenges-runner/stdout.html'
(hidden)