AI Driving Olympics Home Challenges Submissions Jobs

Submission 4166

Submission4166
Competingyes
Challengeaido3-LFV-sim-validation
Userg12tan
Date submitted
Complete
Details
Violations...
Sister in aido3-LF-sim-validation:
  better-than-bea-straight: Sister 4163 has rank 887 > 877
Sisters4163
Result💔
Jobs
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessing50
User priority

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
249774166g12tanchallenge-aido_LF-template-randomaido3-LFV-sim-validationstep1-simulationerrorno-0:01:51
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
243504166g12tanchallenge-aido_LF-template-randomaido3-LFV-sim-validationstep1-simulationsuccessno-0:05:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.02087731602825696
agent_compute-ego_mean0.017267079433197857
agent_compute-ego_median0.01820743966985632
agent_compute-ego_min0.013429641723632812
deviation-center-line_max0.17439134565029044
deviation-center-line_mean0.1265175655253199
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599271
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811225
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589055
driven_any_mean1.0272530755098268
driven_any_median1.0243289631429704
driven_any_min0.4119037580118985
driven_lanedir_consec_max1.2433038249708372
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708372
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.11180269718170166, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.010868050433971264, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.01820743966985632, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.007124547605161314, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004236340522766113, "sim_compute_performance-ego": 0.006057160872000235, "sim_compute_robot_state-ego": 0.007130874527825249, "sim_compute_robot_state-npc0": 0.007901668548583984, "sim_compute_robot_state-npc1": 0.006835747648168493, "sim_compute_robot_state-npc2": 0.006999951821786386, "sim_compute_robot_state-npc3": 0.006926289311161748}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.09657049179077148, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.00753352165222168, "in-drivable-lane": 0, "agent_compute-ego": 0.013429641723632812, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.005259923934936524, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.003027410507202148, "sim_compute_performance-ego": 0.004053478240966797, "sim_compute_robot_state-ego": 0.005245628356933593, "sim_compute_robot_state-npc0": 0.0050232791900634765, "sim_compute_robot_state-npc1": 0.004862031936645508, "sim_compute_robot_state-npc2": 0.004876642227172851, "sim_compute_robot_state-npc3": 0.0048312187194824215}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.1084708759659215, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.008328268402501157, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.014994787542443528, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.005761193601708663, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.003366128394478246, "sim_compute_performance-ego": 0.004637219403919421, "sim_compute_robot_state-ego": 0.005944230054554187, "sim_compute_robot_state-npc0": 0.005616743313638787, "sim_compute_robot_state-npc1": 0.005493832261938798, "sim_compute_robot_state-npc2": 0.005456783269581042, "sim_compute_robot_state-npc3": 0.005420656580674021}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.14087724685668945, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.01068426385710511, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.02087731602825696, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.007491977908943273, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.004069907755791386, "sim_compute_performance-ego": 0.00591614578343645, "sim_compute_robot_state-ego": 0.007391027257412295, "sim_compute_robot_state-npc0": 0.007015578354461284, "sim_compute_robot_state-npc1": 0.006902350655084924, "sim_compute_robot_state-npc2": 0.006891304933572117, "sim_compute_robot_state-npc3": 0.006831633893749382}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.104316098349435, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.009801949773515974, "in-drivable-lane": 0, "agent_compute-ego": 0.018826212201799666, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.006499460765293666, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.0036134890147617887, "sim_compute_performance-ego": 0.00533778326851981, "sim_compute_robot_state-ego": 0.0067936863218035016, "sim_compute_robot_state-npc0": 0.00621312005179269, "sim_compute_robot_state-npc1": 0.0062360337802342, "sim_compute_robot_state-npc2": 0.006296260016305106, "sim_compute_robot_state-npc3": 0.006364583969116211}}
set_robot_commands_max0.007491977908943273
set_robot_commands_mean0.006427420763208689
set_robot_commands_median0.006499460765293666
set_robot_commands_min0.005259923934936524
sim_compute_performance-ego_max0.006057160872000235
sim_compute_performance-ego_mean0.0052003575137685425
sim_compute_performance-ego_median0.00533778326851981
sim_compute_performance-ego_min0.004053478240966797
sim_compute_robot_state-ego_max0.007391027257412295
sim_compute_robot_state-ego_mean0.006501089303705765
sim_compute_robot_state-ego_median0.0067936863218035016
sim_compute_robot_state-ego_min0.005245628356933593
sim_compute_robot_state-npc0_max0.007901668548583984
sim_compute_robot_state-npc0_mean0.006354077891708045
sim_compute_robot_state-npc0_median0.00621312005179269
sim_compute_robot_state-npc0_min0.0050232791900634765
sim_compute_robot_state-npc1_max0.006902350655084924
sim_compute_robot_state-npc1_mean0.0060659992564143835
sim_compute_robot_state-npc1_median0.0062360337802342
sim_compute_robot_state-npc1_min0.004862031936645508
sim_compute_robot_state-npc2_max0.006999951821786386
sim_compute_robot_state-npc2_mean0.0061041884536835
sim_compute_robot_state-npc2_median0.006296260016305106
sim_compute_robot_state-npc2_min0.004876642227172851
sim_compute_robot_state-npc3_max0.006926289311161748
sim_compute_robot_state-npc3_mean0.0060748764948367565
sim_compute_robot_state-npc3_median0.006364583969116211
sim_compute_robot_state-npc3_min0.0048312187194824215
sim_compute_sim_state_max0.004236340522766113
sim_compute_sim_state_mean0.003662655238999937
sim_compute_sim_state_median0.0036134890147617887
sim_compute_sim_state_min0.003027410507202148
sim_physics_max0.14087724685668945
sim_physics_mean0.11240748202890384
sim_physics_median0.1084708759659215
sim_physics_min0.09657049179077148
sim_render-ego_max0.010868050433971264
sim_render-ego_mean0.009443210823863036
sim_render-ego_median0.009801949773515974
sim_render-ego_min0.00753352165222168
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
243454166g12tanchallenge-aido_LF-template-randomaido3-LFV-sim-validationstep1-simulationsuccessno-0:04:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.027319147617002076
agent_compute-ego_mean0.02659247658259431
agent_compute-ego_median0.026682472229003905
agent_compute-ego_min0.02569963313915111
deviation-center-line_max0.17439134565029044
deviation-center-line_mean0.1265175655253199
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599271
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811225
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589055
driven_any_mean1.0272530755098268
driven_any_median1.0243289631429704
driven_any_min0.4119037580118985
driven_lanedir_consec_max1.2433038249708372
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708372
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.0977104902267456, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.012385655332494664, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.02569963313915111, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.008273901762785736, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0048000724227340134, "sim_compute_performance-ego": 0.007142376016687464, "sim_compute_robot_state-ego": 0.008762001991271973, "sim_compute_robot_state-npc0": 0.007975666611282914, "sim_compute_robot_state-npc1": 0.007827670485885055, "sim_compute_robot_state-npc2": 0.007807272451895254, "sim_compute_robot_state-npc3": 0.007665179393909595}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.12369553565979004, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.013315792083740235, "in-drivable-lane": 0, "agent_compute-ego": 0.026682472229003905, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.008522224426269532, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.005166873931884765, "sim_compute_performance-ego": 0.007639884948730469, "sim_compute_robot_state-ego": 0.009327678680419922, "sim_compute_robot_state-npc0": 0.008839139938354492, "sim_compute_robot_state-npc1": 0.008678979873657226, "sim_compute_robot_state-npc2": 0.008605356216430665, "sim_compute_robot_state-npc3": 0.008367948532104492}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.1168243226252104, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.013266717132769132, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.026944461621736224, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.00870721277437712, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.005264523782228169, "sim_compute_performance-ego": 0.007500977892624705, "sim_compute_robot_state-ego": 0.009097102441285788, "sim_compute_robot_state-npc0": 0.008670126136980559, "sim_compute_robot_state-npc1": 0.008524907262701737, "sim_compute_robot_state-npc2": 0.00841385753531205, "sim_compute_robot_state-npc3": 0.008501037171012476}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.12058118325245532, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.013307148897195163, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.027319147617002076, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.008737328686291658, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.005260310595548606, "sim_compute_performance-ego": 0.007739881925945041, "sim_compute_robot_state-ego": 0.009439109246942062, "sim_compute_robot_state-npc0": 0.008742579930945288, "sim_compute_robot_state-npc1": 0.008633441562894025, "sim_compute_robot_state-npc2": 0.008453254458270495, "sim_compute_robot_state-npc3": 0.008381451232523858}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.11001714638301303, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.01351066998073033, "in-drivable-lane": 0, "agent_compute-ego": 0.02631666830607823, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.008482788290296282, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.005207266126360212, "sim_compute_performance-ego": 0.00784850972039359, "sim_compute_robot_state-ego": 0.00934722593852452, "sim_compute_robot_state-npc0": 0.008920465196881975, "sim_compute_robot_state-npc1": 0.00882106167929513, "sim_compute_robot_state-npc2": 0.008715118680681502, "sim_compute_robot_state-npc3": 0.008512488433292933}}
set_robot_commands_max0.008737328686291658
set_robot_commands_mean0.008544691188004064
set_robot_commands_median0.008522224426269532
set_robot_commands_min0.008273901762785736
sim_compute_performance-ego_max0.00784850972039359
sim_compute_performance-ego_mean0.007574326100876254
sim_compute_performance-ego_median0.007639884948730469
sim_compute_performance-ego_min0.007142376016687464
sim_compute_robot_state-ego_max0.009439109246942062
sim_compute_robot_state-ego_mean0.009194623659688851
sim_compute_robot_state-ego_median0.009327678680419922
sim_compute_robot_state-ego_min0.008762001991271973
sim_compute_robot_state-npc0_max0.008920465196881975
sim_compute_robot_state-npc0_mean0.008629595562889045
sim_compute_robot_state-npc0_median0.008742579930945288
sim_compute_robot_state-npc0_min0.007975666611282914
sim_compute_robot_state-npc1_max0.00882106167929513
sim_compute_robot_state-npc1_mean0.008497212172886636
sim_compute_robot_state-npc1_median0.008633441562894025
sim_compute_robot_state-npc1_min0.007827670485885055
sim_compute_robot_state-npc2_max0.008715118680681502
sim_compute_robot_state-npc2_mean0.008398971868517994
sim_compute_robot_state-npc2_median0.008453254458270495
sim_compute_robot_state-npc2_min0.007807272451895254
sim_compute_robot_state-npc3_max0.008512488433292933
sim_compute_robot_state-npc3_mean0.008285620952568672
sim_compute_robot_state-npc3_median0.008381451232523858
sim_compute_robot_state-npc3_min0.007665179393909595
sim_compute_sim_state_max0.005264523782228169
sim_compute_sim_state_mean0.005139809371751154
sim_compute_sim_state_median0.005207266126360212
sim_compute_sim_state_min0.0048000724227340134
sim_physics_max0.12369553565979004
sim_physics_mean0.11376573562944288
sim_physics_median0.1168243226252104
sim_physics_min0.0977104902267456
sim_render-ego_max0.01351066998073033
sim_render-ego_mean0.013157196685385904
sim_render-ego_median0.013307148897195163
sim_render-ego_min0.012385655332494664
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004