Duckietown Challenges Home Challenges Submissions

Submission 4332

Submission4332
Competingyes
Challengeaido3-LFV-sim-testing
UserSoroush Saryazdi 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27580
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
27580step1-simulationsuccessyes0:14:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.589083599962416
survival_time_median2.499999999999999
deviation-center-line_median0.10394712677689665
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.027587285408606894
agent_compute-ego_mean0.02529150728018436
agent_compute-ego_median0.025498550671797533
agent_compute-ego_min0.02340096235275269
deviation-center-line_max0.21987764564000128
deviation-center-line_mean0.11513253205557164
deviation-center-line_min0.05814541708622475
deviation-heading_max0.8045266837904589
deviation-heading_mean0.39336027445136423
deviation-heading_median0.358997137510946
deviation-heading_min0.1882128425868148
driven_any_max1.0848350093870085
driven_any_mean0.803850154643931
driven_any_median1.0028751755303635
driven_any_min0.28821608451855396
driven_lanedir_consec_max0.9094271662452732
driven_lanedir_consec_mean0.5442692575816761
driven_lanedir_consec_min0.2384328100932288
driven_lanedir_max0.9094271662452732
driven_lanedir_mean0.5442692575816761
driven_lanedir_median0.589083599962416
driven_lanedir_min0.2384328100932288
in-drivable-lane_max1.3999999999999997
in-drivable-lane_mean0.49666666666666576
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0078896084088962, "sim_physics": 0.16458940964478713, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6642632200434848, "sim_render-ego": 0.014522116917830247, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.024674768631274883, "deviation-heading": 0.5050851849885492, "set_robot_commands": 0.00848086063678448, "deviation-center-line": 0.07065220523066396, "driven_lanedir_consec": 0.6642632200434848, "sim_compute_sim_state": 0.005104298775012677, "sim_compute_performance-ego": 0.008186642940227803, "sim_compute_robot_state-ego": 0.009275555610656738, "sim_compute_robot_state-npc0": 0.009726845301114596, "sim_compute_robot_state-npc1": 0.009153191859905535, "sim_compute_robot_state-npc2": 0.008962585375859188, "sim_compute_robot_state-npc3": 0.008084489749028133}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0132908922270336, "sim_physics": 0.16158160976335115, "survival_time": 2.549999999999999, "driven_lanedir": 0.6920556363090382, "sim_render-ego": 0.014191174039653705, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.02581483710045908, "deviation-heading": 0.37637669020263664, "set_robot_commands": 0.012919533486459769, "deviation-center-line": 0.07530023298116417, "driven_lanedir_consec": 0.6920556363090382, "sim_compute_sim_state": 0.005737860997517903, "sim_compute_performance-ego": 0.00782450040181478, "sim_compute_robot_state-ego": 0.010032335917154947, "sim_compute_robot_state-npc0": 0.009430436527027804, "sim_compute_robot_state-npc1": 0.00913547067081227, "sim_compute_robot_state-npc2": 0.00869294241362927, "sim_compute_robot_state-npc3": 0.009181303136488971}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8741778194087728, "sim_physics": 0.1721025394356769, "survival_time": 2.3, "driven_lanedir": 0.2384328100932288, "sim_render-ego": 0.013514674228170645, "in-drivable-lane": 1.3999999999999997, "agent_compute-ego": 0.025109534678251846, "deviation-heading": 0.23890637906938705, "set_robot_commands": 0.008957743644714355, "deviation-center-line": 0.10394712677689665, "driven_lanedir_consec": 0.2384328100932288, "sim_compute_sim_state": 0.005621345146842625, "sim_compute_performance-ego": 0.007772932881894319, "sim_compute_robot_state-ego": 0.009286253348640774, "sim_compute_robot_state-npc0": 0.00952792685964833, "sim_compute_robot_state-npc1": 0.00929285132366678, "sim_compute_robot_state-npc2": 0.009572791016620138, "sim_compute_robot_state-npc3": 0.008680872295213781}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3128706606735367, "sim_physics": 0.2063946843147278, "survival_time": 1.0000000000000002, "driven_lanedir": 0.29198509228963654, "sim_render-ego": 0.014120924472808835, "in-drivable-lane": 0, "agent_compute-ego": 0.02340096235275269, "deviation-heading": 0.358997137510946, "set_robot_commands": 0.00937502384185791, "deviation-center-line": 0.05814541708622475, "driven_lanedir_consec": 0.29198509228963654, "sim_compute_sim_state": 0.005079436302185059, "sim_compute_performance-ego": 0.008143532276153564, "sim_compute_robot_state-ego": 0.008763277530670166, "sim_compute_robot_state-npc0": 0.009421122074127198, "sim_compute_robot_state-npc1": 0.008590245246887207, "sim_compute_robot_state-npc2": 0.00897444486618042, "sim_compute_robot_state-npc3": 0.008391118049621582}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0329853511679177, "sim_physics": 0.1800578900103299, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5740093707976381, "sim_render-ego": 0.013360540821867169, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.023628117903223576, "deviation-heading": 0.38611619731107066, "set_robot_commands": 0.00913193090906683, "deviation-center-line": 0.10855323755564342, "driven_lanedir_consec": 0.5740093707976381, "sim_compute_sim_state": 0.005995538999449532, "sim_compute_performance-ego": 0.007808509862647866, "sim_compute_robot_state-ego": 0.009122088270367316, "sim_compute_robot_state-npc0": 0.009354235990992133, "sim_compute_robot_state-npc1": 0.00917651968182258, "sim_compute_robot_state-npc2": 0.009201225244774009, "sim_compute_robot_state-npc3": 0.00882591391509434}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0093722066717894, "sim_physics": 0.15976312527289757, "survival_time": 2.5999999999999988, "driven_lanedir": 0.5897896409204744, "sim_render-ego": 0.01357785096535316, "in-drivable-lane": 0.949999999999998, "agent_compute-ego": 0.025498550671797533, "deviation-heading": 0.32726405081166476, "set_robot_commands": 0.008645919653085561, "deviation-center-line": 0.10959907909937194, "driven_lanedir_consec": 0.5897896409204744, "sim_compute_sim_state": 0.005900525129758394, "sim_compute_performance-ego": 0.007775801878709059, "sim_compute_robot_state-ego": 0.009472122559180628, "sim_compute_robot_state-npc0": 0.00944661177121676, "sim_compute_robot_state-npc1": 0.009560474982628455, "sim_compute_robot_state-npc2": 0.00878311120546781, "sim_compute_robot_state-npc3": 0.008892659957592305}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.28821608451855396, "sim_physics": 0.20036910709581876, "survival_time": 0.9500000000000004, "driven_lanedir": 0.27925052723936306, "sim_render-ego": 0.015220993443539268, "in-drivable-lane": 0, "agent_compute-ego": 0.02637716343528346, "deviation-heading": 0.2202042086876065, "set_robot_commands": 0.009725683613827354, "deviation-center-line": 0.08350947933924269, "driven_lanedir_consec": 0.27925052723936306, "sim_compute_sim_state": 0.013930596803364, "sim_compute_performance-ego": 0.04957298228615209, "sim_compute_robot_state-ego": 0.011069624047530324, "sim_compute_robot_state-npc0": 0.009573183561626234, "sim_compute_robot_state-npc1": 0.009385297172947936, "sim_compute_robot_state-npc2": 0.009338278519479852, "sim_compute_robot_state-npc3": 0.008953734448081568}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0028751755303635, "sim_physics": 0.15533020917107077, "survival_time": 2.549999999999999, "driven_lanedir": 0.589083599962416, "sim_render-ego": 0.014341952754001993, "in-drivable-lane": 0.8499999999999981, "agent_compute-ego": 0.026056799234128465, "deviation-heading": 0.34154347845828836, "set_robot_commands": 0.009283860524495443, "deviation-center-line": 0.0989171276835034, "driven_lanedir_consec": 0.589083599962416, "sim_compute_sim_state": 0.005993165221868777, "sim_compute_performance-ego": 0.007680439481548234, "sim_compute_robot_state-ego": 0.00965264731762456, "sim_compute_robot_state-npc0": 0.00974582223331227, "sim_compute_robot_state-npc1": 0.010208962010402306, "sim_compute_robot_state-npc2": 0.008743917240816005, "sim_compute_robot_state-npc3": 0.010232172760308958}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0052678246450475, "sim_physics": 0.1437867155262068, "survival_time": 2.549999999999999, "driven_lanedir": 0.8169200609869163, "sim_render-ego": 0.014075756072998049, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.025563852459776635, "deviation-heading": 0.5031800143488017, "set_robot_commands": 0.009965873232074813, "deviation-center-line": 0.21987764564000128, "driven_lanedir_consec": 0.8169200609869163, "sim_compute_sim_state": 0.005935818541283701, "sim_compute_performance-ego": 0.007775601218728458, "sim_compute_robot_state-ego": 0.009489872876335593, "sim_compute_robot_state-npc0": 0.00911256378772212, "sim_compute_robot_state-npc1": 0.009594510583316578, "sim_compute_robot_state-npc2": 0.008930524190266928, "sim_compute_robot_state-npc3": 0.009551001530067594}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0848350093870085, "sim_physics": 0.14862950642903647, "survival_time": 2.6999999999999984, "driven_lanedir": 0.4403016734098912, "sim_render-ego": 0.014654707025598596, "in-drivable-lane": 1.1500000000000004, "agent_compute-ego": 0.02617890304989285, "deviation-heading": 0.8045266837904589, "set_robot_commands": 0.009536235420792192, "deviation-center-line": 0.1574967504892399, "driven_lanedir_consec": 0.4403016734098912, "sim_compute_sim_state": 0.00582411112608733, "sim_compute_performance-ego": 0.008119706754331235, "sim_compute_robot_state-ego": 0.01035341951582167, "sim_compute_robot_state-npc0": 0.009977874932465727, "sim_compute_robot_state-npc1": 0.009485522905985514, "sim_compute_robot_state-npc2": 0.009899006949530708, "sim_compute_robot_state-npc3": 0.009380892471030909}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.4264377555317492, "sim_physics": 0.14729607105255127, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4137491306771582, "sim_render-ego": 0.015110034209031325, "in-drivable-lane": 0, "agent_compute-ego": 0.027587285408606894, "deviation-heading": 0.3207236980821958, "set_robot_commands": 0.008928528198829064, "deviation-center-line": 0.08121382878296723, "driven_lanedir_consec": 0.4137491306771582, "sim_compute_sim_state": 0.005488900037912222, "sim_compute_performance-ego": 0.007956541501558743, "sim_compute_robot_state-ego": 0.010603959743793192, "sim_compute_robot_state-npc0": 0.010102968949538013, "sim_compute_robot_state-npc1": 0.011294209040128268, "sim_compute_robot_state-npc2": 0.009327338292048529, "sim_compute_robot_state-npc3": 0.009725543168874888}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.922294498135926, "sim_physics": 0.15505467851956686, "survival_time": 2.3999999999999995, "driven_lanedir": 0.9094271662452732, "sim_render-ego": 0.013357584675153095, "in-drivable-lane": 0, "agent_compute-ego": 0.023672277728716537, "deviation-heading": 0.31845322864720915, "set_robot_commands": 0.009308839837710062, "deviation-center-line": 0.1538466024680805, "driven_lanedir_consec": 0.9094271662452732, "sim_compute_sim_state": 0.0051191747188568115, "sim_compute_performance-ego": 0.007850637038548788, "sim_compute_robot_state-ego": 0.009269391496976215, "sim_compute_robot_state-npc0": 0.009175087014834086, "sim_compute_robot_state-npc1": 0.008157367507616678, "sim_compute_robot_state-npc2": 0.009312679370244345, "sim_compute_robot_state-npc3": 0.008927191297213236}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7185035020690835, "sim_physics": 0.19156265258789065, "survival_time": 1.900000000000001, "driven_lanedir": 0.7137557371068559, "sim_render-ego": 0.01516152683057283, "in-drivable-lane": 0, "agent_compute-ego": 0.024886470091970345, "deviation-heading": 0.1882128425868148, "set_robot_commands": 0.008703595713565224, "deviation-center-line": 0.14938153418232997, "driven_lanedir_consec": 0.7137557371068559, "sim_compute_sim_state": 0.005597283965662906, "sim_compute_performance-ego": 0.00822100513859799, "sim_compute_robot_state-ego": 0.009529151414570057, "sim_compute_robot_state-npc0": 0.009751232046830026, "sim_compute_robot_state-npc1": 0.00913908607081363, "sim_compute_robot_state-npc2": 0.009194819550765189, "sim_compute_robot_state-npc3": 0.0098637907128585}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.35066115709520385, "sim_physics": 0.15393155554066534, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32389369486849695, "sim_render-ego": 0.01354675707609757, "in-drivable-lane": 0, "agent_compute-ego": 0.02347101335940154, "deviation-heading": 0.41625225022180623, "set_robot_commands": 0.007900476455688477, "deviation-center-line": 0.06699354519906157, "driven_lanedir_consec": 0.32389369486849695, "sim_compute_sim_state": 0.005892649940822435, "sim_compute_performance-ego": 0.007599571476811948, "sim_compute_robot_state-ego": 0.008914429208506708, "sim_compute_robot_state-npc0": 0.008797573006671408, "sim_compute_robot_state-npc1": 0.008032156073528788, "sim_compute_robot_state-npc2": 0.009197722310605255, "sim_compute_robot_state-npc3": 0.008709658747134}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.0080747741880831, "sim_physics": 0.17451514720916747, "survival_time": 2.499999999999999, "driven_lanedir": 0.6271215027752698, "sim_render-ego": 0.014727835655212402, "in-drivable-lane": 0.5999999999999981, "agent_compute-ego": 0.027452073097229003, "deviation-heading": 0.5945620720530285, "set_robot_commands": 0.009554047584533692, "deviation-center-line": 0.1895541683191835, "driven_lanedir_consec": 0.6271215027752698, "sim_compute_sim_state": 0.0055821466445922854, "sim_compute_performance-ego": 0.008438739776611328, "sim_compute_robot_state-ego": 0.010400228500366211, "sim_compute_robot_state-npc0": 0.010060291290283204, "sim_compute_robot_state-npc1": 0.00880544662475586, "sim_compute_robot_state-npc2": 0.008559165000915527, "sim_compute_robot_state-npc3": 0.010217671394348144}}
set_robot_commands_max0.012919533486459769
set_robot_commands_mean0.009361210183565684
set_robot_commands_median0.009283860524495443
set_robot_commands_min0.007900476455688477
sim_compute_performance-ego_max0.04957298228615209
sim_compute_performance-ego_mean0.010715142994289082
sim_compute_performance-ego_median0.007850637038548788
sim_compute_performance-ego_min0.007599571476811948
sim_compute_robot_state-ego_max0.011069624047530324
sim_compute_robot_state-ego_mean0.00968229049054634
sim_compute_robot_state-ego_median0.009489872876335593
sim_compute_robot_state-ego_min0.008763277530670166
sim_compute_robot_state-npc0_max0.010102968949538013
sim_compute_robot_state-npc0_mean0.009546918356493994
sim_compute_robot_state-npc0_median0.00952792685964833
sim_compute_robot_state-npc0_min0.008797573006671408
sim_compute_robot_state-npc1_max0.011294209040128268
sim_compute_robot_state-npc1_mean0.009267420783681226
sim_compute_robot_state-npc1_median0.00917651968182258
sim_compute_robot_state-npc1_min0.008032156073528788
sim_compute_robot_state-npc2_max0.009899006949530708
sim_compute_robot_state-npc2_mean0.009112703436480213
sim_compute_robot_state-npc2_median0.009194819550765189
sim_compute_robot_state-npc2_min0.008559165000915527
sim_compute_robot_state-npc3_max0.010232172760308958
sim_compute_robot_state-npc3_mean0.009174534242197128
sim_compute_robot_state-npc3_median0.008953734448081568
sim_compute_robot_state-npc3_min0.008084489749028133
sim_compute_sim_state_max0.013930596803364
sim_compute_sim_state_mean0.0061868568234144435
sim_compute_sim_state_median0.005737860997517903
sim_compute_sim_state_min0.005079436302185059
sim_physics_max0.2063946843147278
sim_physics_mean0.167664326771583
sim_physics_median0.16158160976335115
sim_physics_min0.1437867155262068
sim_render-ego_max0.015220993443539268
sim_render-ego_mean0.014232295279192592
sim_render-ego_median0.014191174039653705
sim_render-ego_min0.013357584675153095
simulation-passed1
survival_time_max2.6999999999999984
survival_time_mean2.113333333333333
survival_time_min0.9500000000000004
No reset possible
27578step1-simulationsuccessyes0:14:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible