Duckietown Challenges Home Challenges Submissions

Submission 5643

Submission5643
Competingyes
Challengeaido3-LFV-sim-testing
UserFrank (Chude) Qian 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 29125
Next
User label2019-12-05|FrankNet|v3
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
29125step1-simulationsuccessyes0:51:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.254114701992409
survival_time_median14.950000000000076
deviation-center-line_median0.8641239514493788
in-drivable-lane_median2.549999999999991


other stats
agent_compute-ego_max0.051959628204129776
agent_compute-ego_mean0.048508175465282743
agent_compute-ego_median0.04780573750797071
agent_compute-ego_min0.046254406770070394
deviation-center-line_max1.2127520719563585
deviation-center-line_mean0.8605672677352421
deviation-center-line_min0.4329197423706256
deviation-heading_max3.904264833632927
deviation-heading_mean3.152558845616788
deviation-heading_median3.2225072495959552
deviation-heading_min1.5781140001511975
driven_any_max6.749572155974129
driven_any_mean5.238460693729977
driven_any_median5.378607318971057
driven_any_min2.584178678003996
driven_lanedir_consec_max5.9420811909561735
driven_lanedir_consec_mean4.139602243301526
driven_lanedir_consec_min2.235812899980158
driven_lanedir_max5.9420811909561735
driven_lanedir_mean4.139602243301526
driven_lanedir_median4.254114701992409
driven_lanedir_min2.235812899980158
in-drivable-lane_max5.05000000000002
in-drivable-lane_mean2.543333333333342
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 5.5547315472047645, "sim_physics": 0.12591736555099486, "survival_time": 14.950000000000076, "driven_lanedir": 4.516107749221899, "sim_render-ego": 0.012076342900594075, "in-drivable-lane": 1.8500000000000076, "agent_compute-ego": 0.04856043815612793, "deviation-heading": 3.904264833632927, "set_robot_commands": 0.008457934856414795, "deviation-center-line": 0.9827357554254644, "driven_lanedir_consec": 4.516107749221899, "sim_compute_sim_state": 0.004997158050537109, "sim_compute_performance-ego": 0.007071113586425782, "sim_compute_robot_state-ego": 0.00865047295888265, "sim_compute_robot_state-npc0": 0.008423047065734863, "sim_compute_robot_state-npc1": 0.00824113686879476, "sim_compute_robot_state-npc2": 0.008459345499674479, "sim_compute_robot_state-npc3": 0.008075629870096843}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.292586029636205, "sim_physics": 0.14020514329274494, "survival_time": 14.950000000000076, "driven_lanedir": 4.551594968622555, "sim_render-ego": 0.011860015392303467, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.046987266540527345, "deviation-heading": 3.2225072495959552, "set_robot_commands": 0.008639214833577474, "deviation-center-line": 0.869178458123416, "driven_lanedir_consec": 4.551594968622555, "sim_compute_sim_state": 0.004954946835835775, "sim_compute_performance-ego": 0.007137513955434163, "sim_compute_robot_state-ego": 0.008564733664194742, "sim_compute_robot_state-npc0": 0.008556016286214193, "sim_compute_robot_state-npc1": 0.008649858633677164, "sim_compute_robot_state-npc2": 0.008443092505137126, "sim_compute_robot_state-npc3": 0.008349858125050862}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.485621007236376, "sim_physics": 0.15057355801264444, "survival_time": 14.950000000000076, "driven_lanedir": 3.706948052763467, "sim_render-ego": 0.012268985112508138, "in-drivable-lane": 3.95, "agent_compute-ego": 0.046254406770070394, "deviation-heading": 3.8865656319250537, "set_robot_commands": 0.008601980209350586, "deviation-center-line": 0.8531784623560618, "driven_lanedir_consec": 3.706948052763467, "sim_compute_sim_state": 0.00510845422744751, "sim_compute_performance-ego": 0.007173465887705485, "sim_compute_robot_state-ego": 0.008962436517079671, "sim_compute_robot_state-npc0": 0.00827437957127889, "sim_compute_robot_state-npc1": 0.008402558167775472, "sim_compute_robot_state-npc2": 0.008461280663808187, "sim_compute_robot_state-npc3": 0.008278525670369467}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.1629032201951075, "sim_physics": 0.1373606570561727, "survival_time": 14.950000000000076, "driven_lanedir": 3.2970725202104862, "sim_render-ego": 0.01326629638671875, "in-drivable-lane": 5.05000000000002, "agent_compute-ego": 0.049635151227315266, "deviation-heading": 3.69433074880444, "set_robot_commands": 0.009331071376800537, "deviation-center-line": 0.8193724146981198, "driven_lanedir_consec": 3.2970725202104862, "sim_compute_sim_state": 0.005241618951161702, "sim_compute_performance-ego": 0.007838892141977945, "sim_compute_robot_state-ego": 0.009487810929616291, "sim_compute_robot_state-npc0": 0.009143657684326172, "sim_compute_robot_state-npc1": 0.008827375570933023, "sim_compute_robot_state-npc2": 0.0089646848042806, "sim_compute_robot_state-npc3": 0.008874533971150716}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.584178678003996, "sim_physics": 0.14081348086658277, "survival_time": 7.599999999999981, "driven_lanedir": 2.235812899980158, "sim_render-ego": 0.013570534555535568, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.04780573750797071, "deviation-heading": 1.5781140001511975, "set_robot_commands": 0.008690432498329565, "deviation-center-line": 0.4714077658926852, "driven_lanedir_consec": 2.235812899980158, "sim_compute_sim_state": 0.004937275459891872, "sim_compute_performance-ego": 0.007377795482936658, "sim_compute_robot_state-ego": 0.009218559453361912, "sim_compute_robot_state-npc0": 0.00905918604449222, "sim_compute_robot_state-npc1": 0.008369106995432, "sim_compute_robot_state-npc2": 0.008410781621932983, "sim_compute_robot_state-npc3": 0.00846363055078607}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 5.6580910507130024, "sim_physics": 0.14567745288213094, "survival_time": 14.950000000000076, "driven_lanedir": 3.832544474037934, "sim_render-ego": 0.012575433254241944, "in-drivable-lane": 4.600000000000022, "agent_compute-ego": 0.04728010654449463, "deviation-heading": 3.144234153660598, "set_robot_commands": 0.010879271030426026, "deviation-center-line": 0.8300756170217601, "driven_lanedir_consec": 3.832544474037934, "sim_compute_sim_state": 0.005042577584584554, "sim_compute_performance-ego": 0.007216192881266276, "sim_compute_robot_state-ego": 0.008862825234731038, "sim_compute_robot_state-npc0": 0.008599030176798502, "sim_compute_robot_state-npc1": 0.008305203914642335, "sim_compute_robot_state-npc2": 0.008200968106587728, "sim_compute_robot_state-npc3": 0.008180909951527914}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 5.378607318971057, "sim_physics": 0.14700015226999918, "survival_time": 14.950000000000076, "driven_lanedir": 4.254114701992409, "sim_render-ego": 0.012949639956156412, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.048848308722178144, "deviation-heading": 3.8966969820427337, "set_robot_commands": 0.008952571551005045, "deviation-center-line": 0.9500733282888776, "driven_lanedir_consec": 4.254114701992409, "sim_compute_sim_state": 0.005188896656036377, "sim_compute_performance-ego": 0.00757667620976766, "sim_compute_robot_state-ego": 0.00911959727605184, "sim_compute_robot_state-npc0": 0.00882657766342163, "sim_compute_robot_state-npc1": 0.008762806256612143, "sim_compute_robot_state-npc2": 0.008550366560618083, "sim_compute_robot_state-npc3": 0.008620632489522299}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 3.8287945444886455, "sim_physics": 0.1486742912598376, "survival_time": 10.600000000000016, "driven_lanedir": 2.679699574472857, "sim_render-ego": 0.013226307787985172, "in-drivable-lane": 3.400000000000033, "agent_compute-ego": 0.051959628204129776, "deviation-heading": 1.659679215754435, "set_robot_commands": 0.00929344375178499, "deviation-center-line": 0.4329197423706256, "driven_lanedir_consec": 2.679699574472857, "sim_compute_sim_state": 0.005192168478695852, "sim_compute_performance-ego": 0.007543307430339309, "sim_compute_robot_state-ego": 0.009415379110372293, "sim_compute_robot_state-npc0": 0.00908914826950937, "sim_compute_robot_state-npc1": 0.008656501770019531, "sim_compute_robot_state-npc2": 0.008824410303583686, "sim_compute_robot_state-npc3": 0.008739056452265326}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 6.2492221073593175, "sim_physics": 0.13874239524205526, "survival_time": 14.950000000000076, "driven_lanedir": 5.693262846686313, "sim_render-ego": 0.012603902022043863, "in-drivable-lane": 0.8499999999999996, "agent_compute-ego": 0.048836552302042646, "deviation-heading": 2.6342840249834483, "set_robot_commands": 0.009151206016540528, "deviation-center-line": 0.8641239514493788, "driven_lanedir_consec": 5.693262846686313, "sim_compute_sim_state": 0.0051742847760518395, "sim_compute_performance-ego": 0.007735277016957601, "sim_compute_robot_state-ego": 0.009130264123280845, "sim_compute_robot_state-npc0": 0.009496793746948244, "sim_compute_robot_state-npc1": 0.008840650717417398, "sim_compute_robot_state-npc2": 0.008856510321299235, "sim_compute_robot_state-npc3": 0.008602142333984375}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 5.743196488471419, "sim_physics": 0.13439647912979125, "survival_time": 14.950000000000076, "driven_lanedir": 4.415718887304012, "sim_render-ego": 0.0133159073193868, "in-drivable-lane": 2.950000000000002, "agent_compute-ego": 0.05032353162765503, "deviation-heading": 3.7329204722440448, "set_robot_commands": 0.009700887203216551, "deviation-center-line": 0.9574411290650408, "driven_lanedir_consec": 4.415718887304012, "sim_compute_sim_state": 0.0052112722396850586, "sim_compute_performance-ego": 0.007771593729654948, "sim_compute_robot_state-ego": 0.00958232323328654, "sim_compute_robot_state-npc0": 0.00925381580988566, "sim_compute_robot_state-npc1": 0.008855087757110596, "sim_compute_robot_state-npc2": 0.0090861177444458, "sim_compute_robot_state-npc3": 0.008732779026031494}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 4.73674682699667, "sim_physics": 0.1555797322591146, "survival_time": 14.950000000000076, "driven_lanedir": 4.627268170683488, "sim_render-ego": 0.012802549997965497, "in-drivable-lane": 0, "agent_compute-ego": 0.047633810838063555, "deviation-heading": 2.951530825521461, "set_robot_commands": 0.008640383084615072, "deviation-center-line": 0.8073754537578048, "driven_lanedir_consec": 4.627268170683488, "sim_compute_sim_state": 0.005041675567626953, "sim_compute_performance-ego": 0.007120554447174072, "sim_compute_robot_state-ego": 0.008796134789784749, "sim_compute_robot_state-npc0": 0.008666669527689616, "sim_compute_robot_state-npc1": 0.008729974428812662, "sim_compute_robot_state-npc2": 0.008478514353434245, "sim_compute_robot_state-npc3": 0.008240540822347006}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 5.968037297439007, "sim_physics": 0.14973493178685507, "survival_time": 14.950000000000076, "driven_lanedir": 4.823496711894922, "sim_render-ego": 0.012439440886179608, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.04730839093526205, "deviation-heading": 3.7584108639798153, "set_robot_commands": 0.008891376654307047, "deviation-center-line": 1.0775264240672349, "driven_lanedir_consec": 4.823496711894922, "sim_compute_sim_state": 0.005035372575124105, "sim_compute_performance-ego": 0.007239473660786947, "sim_compute_robot_state-ego": 0.00901122252146403, "sim_compute_robot_state-npc0": 0.00853605349858602, "sim_compute_robot_state-npc1": 0.00850717544555664, "sim_compute_robot_state-npc2": 0.008444645404815675, "sim_compute_robot_state-npc3": 0.008395439783732096}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 6.749572155974129, "sim_physics": 0.1323996122678121, "survival_time": 14.950000000000076, "driven_lanedir": 5.9420811909561735, "sim_render-ego": 0.01246221383412679, "in-drivable-lane": 1.5000000000000044, "agent_compute-ego": 0.04753982384999593, "deviation-heading": 2.5493469299227867, "set_robot_commands": 0.00895484209060669, "deviation-center-line": 1.2127520719563585, "driven_lanedir_consec": 5.9420811909561735, "sim_compute_sim_state": 0.004893113772074381, "sim_compute_performance-ego": 0.007393972873687744, "sim_compute_robot_state-ego": 0.008850362300872803, "sim_compute_robot_state-npc0": 0.00849097728729248, "sim_compute_robot_state-npc1": 0.00859611749649048, "sim_compute_robot_state-npc2": 0.008508345286051433, "sim_compute_robot_state-npc3": 0.008227279186248779}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 5.14759268576042, "sim_physics": 0.14543181498845417, "survival_time": 14.950000000000076, "driven_lanedir": 3.577516325619765, "sim_render-ego": 0.012585280736287436, "in-drivable-lane": 3.950000000000016, "agent_compute-ego": 0.04737507502237956, "deviation-heading": 3.604455383997316, "set_robot_commands": 0.00882723887761434, "deviation-center-line": 0.948184601768994, "driven_lanedir_consec": 3.577516325619765, "sim_compute_sim_state": 0.00516145388285319, "sim_compute_performance-ego": 0.007713725566864013, "sim_compute_robot_state-ego": 0.009048439661661785, "sim_compute_robot_state-npc0": 0.008881186644236247, "sim_compute_robot_state-npc1": 0.008821828365325928, "sim_compute_robot_state-npc2": 0.00866498867670695, "sim_compute_robot_state-npc3": 0.00860284169514974}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 5.037029447499551, "sim_physics": 0.14018721024195352, "survival_time": 14.950000000000076, "driven_lanedir": 3.940794575076436, "sim_render-ego": 0.013054203192392986, "in-drivable-lane": 2.950000000000003, "agent_compute-ego": 0.05127440373102824, "deviation-heading": 3.0710413680356106, "set_robot_commands": 0.009345037937164308, "deviation-center-line": 0.8321638397868076, "driven_lanedir_consec": 3.940794575076436, "sim_compute_sim_state": 0.005143059889475505, "sim_compute_performance-ego": 0.007798154354095459, "sim_compute_robot_state-ego": 0.009578173160552978, "sim_compute_robot_state-npc0": 0.009166502157847086, "sim_compute_robot_state-npc1": 0.008812545935312907, "sim_compute_robot_state-npc2": 0.009396357536315918, "sim_compute_robot_state-npc3": 0.00856590986251831}}
set_robot_commands_max0.010879271030426026
set_robot_commands_mean0.00909045946478357
set_robot_commands_median0.008952571551005045
set_robot_commands_min0.008457934856414795
sim_compute_performance-ego_max0.007838892141977945
sim_compute_performance-ego_mean0.007447180615004938
sim_compute_performance-ego_median0.007393972873687744
sim_compute_performance-ego_min0.007071113586425782
sim_compute_robot_state-ego_max0.00958232323328654
sim_compute_robot_state-ego_mean0.00908524899567961
sim_compute_robot_state-ego_median0.009048439661661785
sim_compute_robot_state-ego_min0.008564733664194742
sim_compute_robot_state-npc0_max0.009496793746948244
sim_compute_robot_state-npc0_mean0.008830869428950746
sim_compute_robot_state-npc0_median0.00882657766342163
sim_compute_robot_state-npc0_min0.00827437957127889
sim_compute_robot_state-npc1_max0.008855087757110596
sim_compute_robot_state-npc1_mean0.008625195221594202
sim_compute_robot_state-npc1_median0.008656501770019531
sim_compute_robot_state-npc1_min0.00824113686879476
sim_compute_robot_state-npc2_max0.009396357536315918
sim_compute_robot_state-npc2_mean0.008650027292579476
sim_compute_robot_state-npc2_median0.008508345286051433
sim_compute_robot_state-npc2_min0.008200968106587728
sim_compute_robot_state-npc3_max0.008874533971150716
sim_compute_robot_state-npc3_mean0.008463313986052086
sim_compute_robot_state-npc3_median0.00846363055078607
sim_compute_robot_state-npc3_min0.008075629870096843
sim_compute_sim_state_max0.005241618951161702
sim_compute_sim_state_mean0.005088221929805451
sim_compute_sim_state_median0.00510845422744751
sim_compute_sim_state_min0.004893113772074381
sim_physics_max0.1555797322591146
sim_physics_mean0.14217961847380955
sim_physics_median0.14081348086658277
sim_physics_min0.12591736555099486
sim_render-ego_max0.013570534555535568
sim_render-ego_mean0.012737136888961768
sim_render-ego_median0.012603902022043863
sim_render-ego_min0.011860015392303467
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.170000000000066
survival_time_min7.599999999999981
No reset possible
29115step1-simulationsuccessyes0:47:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
29113step1-simulationerroryes0:43:24
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible