Duckietown Challenges Home Challenges Submissions

Submission 2758

Submission2758
Competingyes
Challengeaido2-LFV-sim-testing
UserBhairav Mehta
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22790
Next
User labelchallenge-aido_LF-template-ros - Template solution using ROS
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22790step1-simulationsuccessyes0:25:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.30314311735235044
survival_time_median2.6499999999999986
deviation-center-line_median0.1192462800776758
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.07432775884061246
agent_compute-ego_mean0.06975004347226439
agent_compute-ego_median0.06882601724544042
agent_compute-ego_min0.06565781270176911
deviation-center-line_max0.2294363663374862
deviation-center-line_mean0.12653708755488874
deviation-center-line_min0.06426934298501713
deviation-heading_max0.6986268167330368
deviation-heading_mean0.44799520296706863
deviation-heading_median0.41847631252347706
deviation-heading_min0.2596285487829774
driven_any_max1.599733354117788
driven_any_mean0.8095342605803044
driven_any_median0.7336463183586153
driven_any_min0.26903550091980144
driven_lanedir_consec_max1.021002447119848
driven_lanedir_consec_mean0.448904809024379
driven_lanedir_consec_min0.2407721645627201
driven_lanedir_max1.021002447119848
driven_lanedir_mean0.448904809024379
driven_lanedir_median0.30314311735235044
driven_lanedir_min0.2407721645627201
in-drivable-lane_max4.799999999999986
in-drivable-lane_mean1.1466666666666634
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.1540208265814983, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.05997373688388878, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.06882601724544042, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09592004225287638, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.03983219240752744, "sim_compute_performance-ego": 0.06814802532464685, "sim_compute_robot_state-ego": 0.07158260949900452, "sim_compute_robot_state-npc0": 0.07195853179609271, "sim_compute_robot_state-npc1": 0.06645745962438449, "sim_compute_robot_state-npc2": 0.07073905770207795, "sim_compute_robot_state-npc3": 0.06792111463949714}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.18080736696720123, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.0596233531832695, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.06865407526493073, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.09778907895088196, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.04177996516227722, "sim_compute_performance-ego": 0.06946403533220291, "sim_compute_robot_state-ego": 0.07639049738645554, "sim_compute_robot_state-npc0": 0.07028883695602417, "sim_compute_robot_state-npc1": 0.07002780586481094, "sim_compute_robot_state-npc2": 0.07062426209449768, "sim_compute_robot_state-npc3": 0.0713689923286438}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.17743856173295242, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.06101412498033964, "in-drivable-lane": 0, "agent_compute-ego": 0.06756363923733051, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.09201855384386502, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.039723061598264255, "sim_compute_performance-ego": 0.06740517341173612, "sim_compute_robot_state-ego": 0.06961554747361404, "sim_compute_robot_state-npc0": 0.07009500723618728, "sim_compute_robot_state-npc1": 0.0695504225217379, "sim_compute_robot_state-npc2": 0.06943411551989041, "sim_compute_robot_state-npc3": 0.06916749935883743}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.18078195664190477, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.0632013479868571, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0690075735892019, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.09663544675355316, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.04020143324329007, "sim_compute_performance-ego": 0.06882720608865062, "sim_compute_robot_state-ego": 0.0734566257845971, "sim_compute_robot_state-npc0": 0.07140036808547154, "sim_compute_robot_state-npc1": 0.0715378253690658, "sim_compute_robot_state-npc2": 0.07095216679316695, "sim_compute_robot_state-npc3": 0.07208017892734979}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.16157871200924828, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.06246841521490188, "in-drivable-lane": 0, "agent_compute-ego": 0.07285218011765253, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.09561602274576823, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.0383491629645938, "sim_compute_performance-ego": 0.06572297641209193, "sim_compute_robot_state-ego": 0.07067956243242536, "sim_compute_robot_state-npc0": 0.0666666030883789, "sim_compute_robot_state-npc1": 0.07030345144725982, "sim_compute_robot_state-npc2": 0.0674788270677839, "sim_compute_robot_state-npc3": 0.06575374376206171}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.599733354117788, "sim_physics": 0.15671748169197525, "survival_time": 6.0499999999999865, "driven_lanedir": 0.26415979567759074, "sim_render-ego": 0.056938742803148, "in-drivable-lane": 4.799999999999986, "agent_compute-ego": 0.06565781270176911, "deviation-heading": 0.39392468133084674, "set_robot_commands": 0.08969351279834085, "deviation-center-line": 0.1277842828221673, "driven_lanedir_consec": 0.26415979567759074, "sim_compute_sim_state": 0.03472676355976704, "sim_compute_performance-ego": 0.06353610803273098, "sim_compute_robot_state-ego": 0.06892952643150141, "sim_compute_robot_state-npc0": 0.06311877305842628, "sim_compute_robot_state-npc1": 0.06125996723647945, "sim_compute_robot_state-npc2": 0.061518511496299555, "sim_compute_robot_state-npc3": 0.06377241237104432}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0951392646085512, "sim_physics": 0.15509009077435448, "survival_time": 4.199999999999993, "driven_lanedir": 0.5659790827231905, "sim_render-ego": 0.060111681620279946, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.0679771587962196, "deviation-heading": 0.5971215168818823, "set_robot_commands": 0.09259143329802014, "deviation-center-line": 0.11288019725884578, "driven_lanedir_consec": 0.5659790827231905, "sim_compute_sim_state": 0.03744381098520188, "sim_compute_performance-ego": 0.06857428664252871, "sim_compute_robot_state-ego": 0.07153810773577009, "sim_compute_robot_state-npc0": 0.06985156592868623, "sim_compute_robot_state-npc1": 0.06849339746293567, "sim_compute_robot_state-npc2": 0.06984922999427431, "sim_compute_robot_state-npc3": 0.0720046843801226}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0452441176451972, "sim_physics": 0.19648959185626055, "survival_time": 3.699999999999995, "driven_lanedir": 1.021002447119848, "sim_render-ego": 0.06424295580064929, "in-drivable-lane": 0, "agent_compute-ego": 0.07432775884061246, "deviation-heading": 0.6206310196168163, "set_robot_commands": 0.10320934089454444, "deviation-center-line": 0.14363020423695483, "driven_lanedir_consec": 1.021002447119848, "sim_compute_sim_state": 0.03856238158973488, "sim_compute_performance-ego": 0.0739033351073394, "sim_compute_robot_state-ego": 0.08515744595914274, "sim_compute_robot_state-npc0": 0.07339002312840642, "sim_compute_robot_state-npc1": 0.07267796026693808, "sim_compute_robot_state-npc2": 0.07246800048931225, "sim_compute_robot_state-npc3": 0.07285673231691928}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0535850482576197, "sim_physics": 0.17439686258633932, "survival_time": 3.599999999999995, "driven_lanedir": 0.30314311735235044, "sim_render-ego": 0.06420793135960896, "in-drivable-lane": 2.2999999999999945, "agent_compute-ego": 0.07364252540800306, "deviation-heading": 0.40636604380954594, "set_robot_commands": 0.10411360528733996, "deviation-center-line": 0.10907487511555897, "driven_lanedir_consec": 0.30314311735235044, "sim_compute_sim_state": 0.03990657130877177, "sim_compute_performance-ego": 0.07189069191614787, "sim_compute_robot_state-ego": 0.08072119620111254, "sim_compute_robot_state-npc0": 0.07177453570895725, "sim_compute_robot_state-npc1": 0.07211274902025859, "sim_compute_robot_state-npc2": 0.06965064340167576, "sim_compute_robot_state-npc3": 0.07236040963066949}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.4799799001882503, "sim_physics": 0.20863887751213855, "survival_time": 5.349999999999989, "driven_lanedir": 0.5481518397312493, "sim_render-ego": 0.0636183168286475, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.07071336407527745, "deviation-heading": 0.5514444521435958, "set_robot_commands": 0.09759873764537204, "deviation-center-line": 0.10072735470855042, "driven_lanedir_consec": 0.5481518397312493, "sim_compute_sim_state": 0.036861475383009865, "sim_compute_performance-ego": 0.07197020878301602, "sim_compute_robot_state-ego": 0.07690778179703472, "sim_compute_robot_state-npc0": 0.06816396980642159, "sim_compute_robot_state-npc1": 0.06920572753264526, "sim_compute_robot_state-npc2": 0.07026394282545999, "sim_compute_robot_state-npc3": 0.06869303400271407}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.29610946631760215, "sim_physics": 0.21313930440832068, "survival_time": 1.3500000000000003, "driven_lanedir": 0.27060744077321397, "sim_render-ego": 0.058762938887984666, "in-drivable-lane": 0, "agent_compute-ego": 0.06730907051651566, "deviation-heading": 0.5373504765871612, "set_robot_commands": 0.09256628707603172, "deviation-center-line": 0.08269292286428997, "driven_lanedir_consec": 0.27060744077321397, "sim_compute_sim_state": 0.04048465799402307, "sim_compute_performance-ego": 0.0655067143616853, "sim_compute_robot_state-ego": 0.0721876444639983, "sim_compute_robot_state-npc0": 0.0649390662157977, "sim_compute_robot_state-npc1": 0.06510766347249348, "sim_compute_robot_state-npc2": 0.06521411295290347, "sim_compute_robot_state-npc3": 0.06896437538994683}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.27791471406425977, "sim_physics": 0.15246843338012694, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2638710416011838, "sim_render-ego": 0.06276453018188477, "in-drivable-lane": 0, "agent_compute-ego": 0.06786126136779785, "deviation-heading": 0.3105689945980953, "set_robot_commands": 0.0901283359527588, "deviation-center-line": 0.1192462800776758, "driven_lanedir_consec": 0.2638710416011838, "sim_compute_sim_state": 0.037719135284423826, "sim_compute_performance-ego": 0.0628310775756836, "sim_compute_robot_state-ego": 0.06911808967590333, "sim_compute_robot_state-npc0": 0.06791640281677246, "sim_compute_robot_state-npc1": 0.06374403953552246, "sim_compute_robot_state-npc2": 0.06541704177856446, "sim_compute_robot_state-npc3": 0.06672852516174316}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7174039891727135, "sim_physics": 0.1762189190342741, "survival_time": 2.6499999999999986, "driven_lanedir": 0.29766819613667395, "sim_render-ego": 0.06442303477593188, "in-drivable-lane": 1.249999999999998, "agent_compute-ego": 0.07290980950841364, "deviation-heading": 0.3122593881578996, "set_robot_commands": 0.10194483343160378, "deviation-center-line": 0.14209620948179827, "driven_lanedir_consec": 0.29766819613667395, "sim_compute_sim_state": 0.03994434284714033, "sim_compute_performance-ego": 0.07450340828805599, "sim_compute_robot_state-ego": 0.0804070031867837, "sim_compute_robot_state-npc0": 0.07229701078163003, "sim_compute_robot_state-npc1": 0.07149638769761571, "sim_compute_robot_state-npc2": 0.07093394927258762, "sim_compute_robot_state-npc3": 0.07184551796823177}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3170173854101942, "sim_physics": 0.1800591253465222, "survival_time": 1.5500000000000007, "driven_lanedir": 0.30712670008511367, "sim_render-ego": 0.06275711521025627, "in-drivable-lane": 0, "agent_compute-ego": 0.06881255488241872, "deviation-heading": 0.2996283459319333, "set_robot_commands": 0.09695117704329952, "deviation-center-line": 0.13363659833059607, "driven_lanedir_consec": 0.30712670008511367, "sim_compute_sim_state": 0.03855878306973365, "sim_compute_performance-ego": 0.06869995978570753, "sim_compute_robot_state-ego": 0.07127148105252173, "sim_compute_robot_state-npc0": 0.0685418882677632, "sim_compute_robot_state-npc1": 0.07089544880774713, "sim_compute_robot_state-npc2": 0.07301961991094774, "sim_compute_robot_state-npc3": 0.06938422879865093}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6739360049522848, "sim_physics": 0.19452392353731043, "survival_time": 2.549999999999999, "driven_lanedir": 0.27812483555624423, "sim_render-ego": 0.06313891971812528, "in-drivable-lane": 1.2499999999999984, "agent_compute-ego": 0.07013585053238214, "deviation-heading": 0.550481042305602, "set_robot_commands": 0.09775773684183756, "deviation-center-line": 0.07768321004180687, "driven_lanedir_consec": 0.27812483555624423, "sim_compute_sim_state": 0.040839466394162645, "sim_compute_performance-ego": 0.06529936135983934, "sim_compute_robot_state-ego": 0.07334041595458984, "sim_compute_robot_state-npc0": 0.06933931275910023, "sim_compute_robot_state-npc1": 0.071853894813388, "sim_compute_robot_state-npc2": 0.06977493155236338, "sim_compute_robot_state-npc3": 0.06770693554597743}}
set_robot_commands_max0.10411360528733996
set_robot_commands_mean0.0963022763210729
set_robot_commands_median0.09663544675355316
set_robot_commands_min0.08969351279834085
sim_compute_performance-ego_max0.07450340828805599
sim_compute_performance-ego_mean0.06841883789480421
sim_compute_performance-ego_median0.06857428664252871
sim_compute_performance-ego_min0.0628310775756836
sim_compute_robot_state-ego_max0.08515744595914274
sim_compute_robot_state-ego_mean0.07408690233563033
sim_compute_robot_state-ego_median0.0721876444639983
sim_compute_robot_state-ego_min0.06892952643150141
sim_compute_robot_state-npc0_max0.07339002312840642
sim_compute_robot_state-npc0_mean0.06931612637560773
sim_compute_robot_state-npc0_median0.06985156592868623
sim_compute_robot_state-npc0_min0.06311877305842628
sim_compute_robot_state-npc1_max0.07267796026693808
sim_compute_robot_state-npc1_mean0.06898161337821886
sim_compute_robot_state-npc1_median0.07002780586481094
sim_compute_robot_state-npc1_min0.06125996723647945
sim_compute_robot_state-npc2_max0.07301961991094774
sim_compute_robot_state-npc2_mean0.06915589419012035
sim_compute_robot_state-npc2_median0.06984922999427431
sim_compute_robot_state-npc2_min0.061518511496299555
sim_compute_robot_state-npc3_max0.07285673231691928
sim_compute_robot_state-npc3_mean0.069373892305494
sim_compute_robot_state-npc3_median0.06916749935883743
sim_compute_robot_state-npc3_min0.06377241237104432
sim_compute_sim_state_max0.04177996516227722
sim_compute_sim_state_mean0.038995546919461464
sim_compute_sim_state_median0.039723061598264255
sim_compute_sim_state_min0.03472676355976704
sim_physics_max0.21313930440832068
sim_physics_mean0.17749133560402847
sim_physics_median0.17743856173295242
sim_physics_min0.15246843338012694
sim_render-ego_max0.06442303477593188
sim_render-ego_mean0.061816476362384895
sim_render-ego_median0.06275711521025627
sim_render-ego_min0.056938742803148
simulation-passed1
survival_time_max6.0499999999999865
survival_time_mean3.046666666666663
survival_time_min1.0500000000000005
No reset possible