AI Driving Olympics Home Challenges Submissions Jobs

Submission 3345

Submission3345
Competingyes
Challengeaido2-LFVI-sim-testing
UserJBRRussia
Date submitted
Completecomplete
Resulterror
Jobsstep1-simulation: 22385
Next
User labelJetBrains Research
Admin priority50
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
223853345JBRRussiaJetBrains Researchaido2-LFVI-sim-testingstep1-simulationerroryes-0:59:24
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
218963345JBRRussiaJetBrains Researchaido2-LFVI-sim-testingstep1-simulationsuccessno-1:02:31(hidden)
driven_lanedir_consec_median1.8620998693923148
survival_time_median14.40000000000007
deviation-center-line_median0.9347971921544856
in-drivable-lane_median0


other stats
agent_compute-ego_max0.24715962281098236
agent_compute-ego_mean0.13974688456789067
agent_compute-ego_median0.08411300420761109
agent_compute-ego_min0.07207128524780274
deviation-center-line_max1.2565179192685756
deviation-center-line_mean0.7663588346786857
deviation-center-line_min0.22884411704361543
deviation-heading_max3.987079897483487
deviation-heading_mean2.234873731428926
deviation-heading_median2.2644137008587495
deviation-heading_min0.40464229920421896
driven_any_max2.8496189269421723
driven_any_mean1.7508096216499782
driven_any_median2.3653758440257504
driven_any_min0.4534788647261307
driven_lanedir_consec_max2.5096385278415263
driven_lanedir_consec_mean1.554055488528583
driven_lanedir_consec_min0.4088281047113515
driven_lanedir_max2.8098575510306483
driven_lanedir_mean1.6060829193700057
driven_lanedir_median2.1282323382814283
driven_lanedir_min0.4088281047113515
in-drivable-lane_max2.3000000000000327
in-drivable-lane_mean0.6566666666666713
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.5531778583396973, "sim_physics": 0.11857956647872923, "survival_time": 14.950000000000076, "driven_lanedir": 2.2236143956588648, "sim_render-ego": 0.06491161664326986, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.07207128524780274, "deviation-heading": 2.334719726160128, "set_robot_commands": 0.07645190477371216, "deviation-center-line": 1.0647794990528332, "driven_lanedir_consec": 2.221741378338581, "sim_compute_sim_state": 0.0378337295850118, "sim_compute_performance-ego": 0.06815478801727295, "sim_compute_robot_state-ego": 0.06652977307637532, "sim_compute_robot_state-npc0": 0.07415751139322917, "sim_compute_robot_state-npc1": 0.06767609437306722, "sim_compute_robot_state-npc2": 0.0666737190882365, "sim_compute_robot_state-npc3": 0.06775479555130005}, "udem1-1-0": {"driven_any": 2.3653758440257504, "sim_physics": 0.12338754653930664, "survival_time": 14.950000000000076, "driven_lanedir": 2.3039369769622207, "sim_render-ego": 0.06801078557968139, "in-drivable-lane": 0, "agent_compute-ego": 0.07607455889383952, "deviation-heading": 2.9069174209342727, "set_robot_commands": 0.07828869740168254, "deviation-center-line": 1.0227284488677553, "driven_lanedir_consec": 2.28182466196243, "sim_compute_sim_state": 0.038954766591389973, "sim_compute_performance-ego": 0.06841989119847615, "sim_compute_robot_state-ego": 0.06771827936172485, "sim_compute_robot_state-npc0": 0.07558602571487427, "sim_compute_robot_state-npc1": 0.06994963804880779, "sim_compute_robot_state-npc2": 0.06886124610900879, "sim_compute_robot_state-npc3": 0.06938162326812744}, "udem1-2-0": {"driven_any": 0.4534788647261307, "sim_physics": 0.13143394106910342, "survival_time": 3.149999999999997, "driven_lanedir": 0.42895643092242475, "sim_render-ego": 0.06896297515384735, "in-drivable-lane": 0, "agent_compute-ego": 0.07273784137907482, "deviation-heading": 0.8409091829156253, "set_robot_commands": 0.077486238782368, "deviation-center-line": 0.2604438679662917, "driven_lanedir_consec": 0.42895643092242475, "sim_compute_sim_state": 0.03849399657476516, "sim_compute_performance-ego": 0.07044175692967006, "sim_compute_robot_state-ego": 0.06421995541406056, "sim_compute_robot_state-npc0": 0.07562472328307136, "sim_compute_robot_state-npc1": 0.07106717806013804, "sim_compute_robot_state-npc2": 0.07113158135187059, "sim_compute_robot_state-npc3": 0.07004050602988592}, "udem1-3-0": {"driven_any": 0.5166645439171497, "sim_physics": 0.12254036887217376, "survival_time": 2.9499999999999975, "driven_lanedir": 0.5067610539051713, "sim_render-ego": 0.07138717376579673, "in-drivable-lane": 0, "agent_compute-ego": 0.08093405173996747, "deviation-heading": 0.40464229920421896, "set_robot_commands": 0.0827094498327223, "deviation-center-line": 0.22884411704361543, "driven_lanedir_consec": 0.5067610539051713, "sim_compute_sim_state": 0.04006498951022908, "sim_compute_performance-ego": 0.06988242521124371, "sim_compute_robot_state-ego": 0.06440146090620655, "sim_compute_robot_state-npc0": 0.07672136112795037, "sim_compute_robot_state-npc1": 0.07199678986759508, "sim_compute_robot_state-npc2": 0.07408095214326503, "sim_compute_robot_state-npc3": 0.07271119295540503}, "udem1-4-0": {"driven_any": 1.8906003250560337, "sim_physics": 0.1188273765824058, "survival_time": 11.00000000000002, "driven_lanedir": 1.6196224584726508, "sim_render-ego": 0.0689084681597623, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.07521045316349376, "deviation-heading": 1.999672155148583, "set_robot_commands": 0.08014834252270785, "deviation-center-line": 0.9347971921544856, "driven_lanedir_consec": 1.6196224584726508, "sim_compute_sim_state": 0.039258856123143976, "sim_compute_performance-ego": 0.0702510107647289, "sim_compute_robot_state-ego": 0.0653785998171026, "sim_compute_robot_state-npc0": 0.07673211097717285, "sim_compute_robot_state-npc1": 0.07128930308602073, "sim_compute_robot_state-npc2": 0.0707022406838157, "sim_compute_robot_state-npc3": 0.0695440183986317}, "udem1-5-0": {"driven_any": 2.4602618468778177, "sim_physics": 0.11346720298131308, "survival_time": 14.950000000000076, "driven_lanedir": 2.1323324876129424, "sim_render-ego": 0.06814182043075562, "in-drivable-lane": 2.050000000000022, "agent_compute-ego": 0.07403058290481568, "deviation-heading": 3.069617027395513, "set_robot_commands": 0.07740259170532227, "deviation-center-line": 1.114428697145443, "driven_lanedir_consec": 2.1323324876129424, "sim_compute_sim_state": 0.03900906483332316, "sim_compute_performance-ego": 0.06889311869939169, "sim_compute_robot_state-ego": 0.06413334608078003, "sim_compute_robot_state-npc0": 0.07573591152826945, "sim_compute_robot_state-npc1": 0.07029728015263875, "sim_compute_robot_state-npc2": 0.06926568508148194, "sim_compute_robot_state-npc3": 0.06942709922790527}, "udem1-6-0": {"driven_any": 2.8496189269421723, "sim_physics": 0.11934678792953492, "survival_time": 14.950000000000076, "driven_lanedir": 2.8098575510306483, "sim_render-ego": 0.07113358736038208, "in-drivable-lane": 0, "agent_compute-ego": 0.08074488878250122, "deviation-heading": 2.2644137008587495, "set_robot_commands": 0.08254700263341268, "deviation-center-line": 1.202793472739602, "driven_lanedir_consec": 2.4735408526890144, "sim_compute_sim_state": 0.04272331237792969, "sim_compute_performance-ego": 0.07148837248484294, "sim_compute_robot_state-ego": 0.06256757259368896, "sim_compute_robot_state-npc0": 0.07878607749938965, "sim_compute_robot_state-npc1": 0.07697884480158489, "sim_compute_robot_state-npc2": 0.07499091148376465, "sim_compute_robot_state-npc3": 0.07415241082509359}, "udem1-7-0": {"driven_any": 0.5258263776522483, "sim_physics": 0.12939133221590066, "survival_time": 3.949999999999994, "driven_lanedir": 0.4217276610378802, "sim_render-ego": 0.07555970360961141, "in-drivable-lane": 0, "agent_compute-ego": 0.08428949344007275, "deviation-heading": 2.1163673190467738, "set_robot_commands": 0.085488026655173, "deviation-center-line": 0.2479575072307097, "driven_lanedir_consec": 0.4217276610378802, "sim_compute_sim_state": 0.04547739330726334, "sim_compute_performance-ego": 0.0706516640095771, "sim_compute_robot_state-ego": 0.06427327892448328, "sim_compute_robot_state-npc0": 0.08198084710519525, "sim_compute_robot_state-npc1": 0.07939994486072395, "sim_compute_robot_state-npc2": 0.08015816724753078, "sim_compute_robot_state-npc3": 0.07950096794321568}, "udem1-8-0": {"driven_any": 2.8436966839246476, "sim_physics": 0.11835334459940593, "survival_time": 14.950000000000076, "driven_lanedir": 2.641370084605078, "sim_render-ego": 0.0750165605545044, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.08411300420761109, "deviation-heading": 2.1995104496094737, "set_robot_commands": 0.08534870783487956, "deviation-center-line": 1.2565179192685756, "driven_lanedir_consec": 2.5096385278415263, "sim_compute_sim_state": 0.045370782216389974, "sim_compute_performance-ego": 0.07424398899078369, "sim_compute_robot_state-ego": 0.06475643157958984, "sim_compute_robot_state-npc0": 0.08191383202870686, "sim_compute_robot_state-npc1": 0.08008635361989339, "sim_compute_robot_state-npc2": 0.0790910800298055, "sim_compute_robot_state-npc3": 0.07853475332260132}, "udem1-9-0": {"driven_any": 2.522399655858679, "sim_physics": 0.12024323642253876, "survival_time": 14.40000000000007, "driven_lanedir": 2.4201013069785, "sim_render-ego": 0.07515151136451298, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.1798239681455824, "deviation-heading": 3.081090121625137, "set_robot_commands": 0.08504981133672926, "deviation-center-line": 1.097951933554236, "driven_lanedir_consec": 2.3991224532515565, "sim_compute_sim_state": 0.04466947913169861, "sim_compute_performance-ego": 0.07376544260316426, "sim_compute_robot_state-ego": 0.0656322224272622, "sim_compute_robot_state-npc0": 0.08155704455243216, "sim_compute_robot_state-npc1": 0.07942041920291053, "sim_compute_robot_state-npc2": 0.07893148809671402, "sim_compute_robot_state-npc3": 0.07837582296795315}, "udem1-10-0": {"driven_any": 2.5082059731986144, "sim_physics": 0.12229947090148924, "survival_time": 14.950000000000076, "driven_lanedir": 2.4371384770445057, "sim_render-ego": 0.0755756409962972, "in-drivable-lane": 0, "agent_compute-ego": 0.24600341796875, "deviation-heading": 3.2070083285384507, "set_robot_commands": 0.08507819096247356, "deviation-center-line": 0.8531977539565403, "driven_lanedir_consec": 2.435871924464488, "sim_compute_sim_state": 0.04463384707768758, "sim_compute_performance-ego": 0.07462750275929769, "sim_compute_robot_state-ego": 0.06439820051193237, "sim_compute_robot_state-npc0": 0.08231335004170735, "sim_compute_robot_state-npc1": 0.0800525959332784, "sim_compute_robot_state-npc2": 0.07988556385040284, "sim_compute_robot_state-npc3": 0.07904468139012655}, "udem1-11-0": {"driven_any": 0.5449588364395069, "sim_physics": 0.11813372534674568, "survival_time": 3.699999999999995, "driven_lanedir": 0.4634144234605242, "sim_render-ego": 0.07504742209975784, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.24147462844848633, "deviation-heading": 0.6386008133627101, "set_robot_commands": 0.08377521102492874, "deviation-center-line": 0.3441603997307835, "driven_lanedir_consec": 0.4634144234605242, "sim_compute_sim_state": 0.0450740859315202, "sim_compute_performance-ego": 0.07458546032776704, "sim_compute_robot_state-ego": 0.06530593214808283, "sim_compute_robot_state-npc0": 0.08152847998851054, "sim_compute_robot_state-npc1": 0.0783993811220736, "sim_compute_robot_state-npc2": 0.07966345065348857, "sim_compute_robot_state-npc3": 0.07790092197624413}, "udem1-12-0": {"driven_any": 0.4905900054789347, "sim_physics": 0.1302215279759587, "survival_time": 3.699999999999995, "driven_lanedir": 0.4088281047113515, "sim_render-ego": 0.07652331687308647, "in-drivable-lane": 0, "agent_compute-ego": 0.24715962281098236, "deviation-heading": 1.9246735949181828, "set_robot_commands": 0.08661000148670094, "deviation-center-line": 0.2561445685805111, "driven_lanedir_consec": 0.4088281047113515, "sim_compute_sim_state": 0.04627269023173564, "sim_compute_performance-ego": 0.0758184645626996, "sim_compute_robot_state-ego": 0.06561862133644722, "sim_compute_robot_state-npc0": 0.08166998141520732, "sim_compute_robot_state-npc1": 0.07903726358671447, "sim_compute_robot_state-npc2": 0.08084254651456266, "sim_compute_robot_state-npc3": 0.0793232080098745}, "udem1-13-0": {"driven_any": 1.255794119356377, "sim_physics": 0.12484201695184288, "survival_time": 7.94999999999998, "driven_lanedir": 1.145350039865891, "sim_render-ego": 0.07480758690983995, "in-drivable-lane": 0, "agent_compute-ego": 0.2427198736922546, "deviation-heading": 2.5478839342325914, "set_robot_commands": 0.08419102092958847, "deviation-center-line": 0.5964799696990308, "driven_lanedir_consec": 1.145350039865891, "sim_compute_sim_state": 0.0448736994521423, "sim_compute_performance-ego": 0.07418524694142851, "sim_compute_robot_state-ego": 0.0641083447438366, "sim_compute_robot_state-npc0": 0.0811813177552613, "sim_compute_robot_state-npc1": 0.07928314898748817, "sim_compute_robot_state-npc2": 0.07849548147909297, "sim_compute_robot_state-npc3": 0.07898431304115919}, "udem1-14-0": {"driven_any": 2.481494462955914, "sim_physics": 0.11411628087361654, "survival_time": 14.950000000000076, "driven_lanedir": 2.1282323382814283, "sim_render-ego": 0.07430917660395304, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.2388155976931254, "deviation-heading": 3.987079897483487, "set_robot_commands": 0.0846027406056722, "deviation-center-line": 1.014157173189872, "driven_lanedir_consec": 1.8620998693923148, "sim_compute_sim_state": 0.04469840367635091, "sim_compute_performance-ego": 0.0723412815729777, "sim_compute_robot_state-ego": 0.0631628958384196, "sim_compute_robot_state-npc0": 0.08182313044865926, "sim_compute_robot_state-npc1": 0.08013572216033936, "sim_compute_robot_state-npc2": 0.07976834853490193, "sim_compute_robot_state-npc3": 0.07855564673741658}}
set_robot_commands_max0.08661000148670094
set_robot_commands_mean0.0823451958992049
set_robot_commands_median0.08377521102492874
set_robot_commands_min0.07645190477371216
sim_compute_performance-ego_max0.0758184645626996
sim_compute_performance-ego_mean0.0718500276715548
sim_compute_performance-ego_median0.07148837248484294
sim_compute_performance-ego_min0.06815478801727295
sim_compute_robot_state-ego_max0.06771827936172485
sim_compute_robot_state-ego_mean0.06481366098399952
sim_compute_robot_state-ego_median0.06440146090620655
sim_compute_robot_state-ego_min0.06256757259368896
sim_compute_robot_state-npc0_max0.08231335004170735
sim_compute_robot_state-npc0_mean0.07915411365730914
sim_compute_robot_state-npc0_median0.0811813177552613
sim_compute_robot_state-npc0_min0.07415751139322917
sim_compute_robot_state-npc1_max0.08013572216033936
sim_compute_robot_state-npc1_mean0.07567133052421829
sim_compute_robot_state-npc1_median0.0783993811220736
sim_compute_robot_state-npc1_min0.06767609437306722
sim_compute_robot_state-npc2_max0.08084254651456266
sim_compute_robot_state-npc2_mean0.07550283082319616
sim_compute_robot_state-npc2_median0.07849548147909297
sim_compute_robot_state-npc2_min0.0666737190882365
sim_compute_robot_state-npc3_max0.07950096794321568
sim_compute_robot_state-npc3_mean0.07488213077632935
sim_compute_robot_state-npc3_median0.07790092197624413
sim_compute_robot_state-npc3_min0.06775479555130005
sim_compute_sim_state_max0.04627269023173564
sim_compute_sim_state_mean0.04249393977470542
sim_compute_sim_state_median0.04463384707768758
sim_compute_sim_state_min0.0378337295850118
sim_physics_max0.13143394106910342
sim_physics_mean0.12167891504933769
sim_physics_median0.12024323642253876
sim_physics_min0.11346720298131308
sim_render-ego_max0.07652331687308647
sim_render-ego_mean0.07222982307367057
sim_render-ego_median0.07430917660395304
sim_render-ego_min0.06491161664326986
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.36333333333337
survival_time_min2.9499999999999975