AI Driving Olympics Home Challenges Submissions Jobs

Submission 2948

Submission2948
Competingyes
Challengeaido2-LFV-sim-testing
UserBhairav Mehta
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 22698
Next
User labelBaseline solution using reinforcement learning
Admin priority50
Blessing50
User priority

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
226982948Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationerroryes-0:12:51
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
209172948Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessno-0:33:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06481553712617039
survival_time_median1.6000000000000008
deviation-center-line_median0.08053590386253318
in-drivable-lane_median0.4500000000000004


other stats
agent_compute-ego_max0.18929727615848663
agent_compute-ego_mean0.1644376292033725
agent_compute-ego_median0.16009040439830108
agent_compute-ego_min0.15344068637261024
deviation-center-line_max0.7986806623683785
deviation-center-line_mean0.17971802946020424
deviation-center-line_min0.025758639196128363
deviation-heading_max6.052239721856253
deviation-heading_mean1.732074367672169
deviation-heading_median0.6758109176661168
deviation-heading_min0.6012851139729924
driven_any_max1.757078449678158
driven_any_mean0.4538001271754034
driven_any_median0.15632563756824455
driven_any_min0.09527766237505804
driven_lanedir_consec_max0.6156158615248244
driven_lanedir_consec_mean0.16233288798354242
driven_lanedir_consec_min0.04188700493005726
driven_lanedir_max0.6156158615248244
driven_lanedir_mean0.16233288798354242
driven_lanedir_median0.06481553712617039
driven_lanedir_min0.04188700493005726
in-drivable-lane_max7.650000000000039
in-drivable-lane_mean1.7166666666666734
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.6595498753473366, "sim_physics": 0.16429112593332926, "survival_time": 14.950000000000076, "driven_lanedir": 0.5829868447427584, "sim_render-ego": 0.057361466884613035, "in-drivable-lane": 6.800000000000027, "agent_compute-ego": 0.1556210970878601, "deviation-heading": 6.052239721856253, "set_robot_commands": 0.08798375050226848, "deviation-center-line": 0.6996489108842836, "driven_lanedir_consec": 0.5829868447427584, "sim_compute_sim_state": 0.03631045023600261, "sim_compute_performance-ego": 0.06331748882929485, "sim_compute_robot_state-ego": 0.0684581724802653, "sim_compute_robot_state-npc0": 0.06453133742014568, "sim_compute_robot_state-npc1": 0.063465629418691, "sim_compute_robot_state-npc2": 0.06277633349100749, "sim_compute_robot_state-npc3": 0.0628265905380249}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.757078449678158, "sim_physics": 0.16125000397364295, "survival_time": 14.950000000000076, "driven_lanedir": 0.5118497433661302, "sim_render-ego": 0.06041930516560872, "in-drivable-lane": 7.650000000000039, "agent_compute-ego": 0.1607869855562846, "deviation-heading": 5.93210529647649, "set_robot_commands": 0.09188658714294434, "deviation-center-line": 0.7986806623683785, "driven_lanedir_consec": 0.5118497433661302, "sim_compute_sim_state": 0.0377777361869812, "sim_compute_performance-ego": 0.0678668737411499, "sim_compute_robot_state-ego": 0.0714549700419108, "sim_compute_robot_state-npc0": 0.06824642976125081, "sim_compute_robot_state-npc1": 0.06694263617197672, "sim_compute_robot_state-npc2": 0.06727129936218262, "sim_compute_robot_state-npc3": 0.0683403746287028}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09927131392417624, "sim_physics": 0.18745054801305136, "survival_time": 1.2000000000000004, "driven_lanedir": 0.05817704532029033, "sim_render-ego": 0.05827202399571737, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15966572364171347, "deviation-heading": 0.6459851913949295, "set_robot_commands": 0.08133623003959656, "deviation-center-line": 0.09847253119841116, "driven_lanedir_consec": 0.05817704532029033, "sim_compute_sim_state": 0.03729638457298279, "sim_compute_performance-ego": 0.061439961194992065, "sim_compute_robot_state-ego": 0.07258235414822896, "sim_compute_robot_state-npc0": 0.05641176303227743, "sim_compute_robot_state-npc1": 0.06363168358802795, "sim_compute_robot_state-npc2": 0.063417782386144, "sim_compute_robot_state-npc3": 0.06420780221621196}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.09527766237505804, "sim_physics": 0.20899818340937296, "survival_time": 1.2000000000000004, "driven_lanedir": 0.04739903502737919, "sim_render-ego": 0.06722187995910645, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.18842445810635888, "deviation-heading": 0.6305895418735279, "set_robot_commands": 0.09510867794354756, "deviation-center-line": 0.08695938405747548, "driven_lanedir_consec": 0.04739903502737919, "sim_compute_sim_state": 0.03857185443242391, "sim_compute_performance-ego": 0.07031347354253133, "sim_compute_robot_state-ego": 0.08252933621406555, "sim_compute_robot_state-npc0": 0.10826231042544048, "sim_compute_robot_state-npc1": 0.06777151425679524, "sim_compute_robot_state-npc2": 0.06486206253369649, "sim_compute_robot_state-npc3": 0.0666106641292572}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15632563756824455, "sim_physics": 0.1584007740020752, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06013919488479624, "sim_render-ego": 0.06359090010325114, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1649387836456299, "deviation-heading": 0.7928984796735065, "set_robot_commands": 0.09008013407389324, "deviation-center-line": 0.04252712694956964, "driven_lanedir_consec": 0.06013919488479624, "sim_compute_sim_state": 0.03414951165517171, "sim_compute_performance-ego": 0.06653377215067545, "sim_compute_robot_state-ego": 0.0695821205774943, "sim_compute_robot_state-npc0": 0.07268795172373453, "sim_compute_robot_state-npc1": 0.06445353825887044, "sim_compute_robot_state-npc2": 0.06502546469370524, "sim_compute_robot_state-npc3": 0.06909305254618327}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.693640022206611, "sim_physics": 0.16750123262405395, "survival_time": 14.950000000000076, "driven_lanedir": 0.6156158615248244, "sim_render-ego": 0.05892645438512167, "in-drivable-lane": 6.850000000000033, "agent_compute-ego": 0.16424763917922974, "deviation-heading": 5.904144285652466, "set_robot_commands": 0.09224626302719116, "deviation-center-line": 0.4325592402773382, "driven_lanedir_consec": 0.6156158615248244, "sim_compute_sim_state": 0.03698911190032959, "sim_compute_performance-ego": 0.06665172417958577, "sim_compute_robot_state-ego": 0.07210466066996256, "sim_compute_robot_state-npc0": 0.06670098543167115, "sim_compute_robot_state-npc1": 0.06786844650904338, "sim_compute_robot_state-npc2": 0.0653201691309611, "sim_compute_robot_state-npc3": 0.06491451660792033}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.11942613073422918, "sim_physics": 0.18210075451777533, "survival_time": 1.3000000000000005, "driven_lanedir": 0.06481553712617039, "sim_render-ego": 0.05924355983734131, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15344068637261024, "deviation-heading": 0.6503807351360573, "set_robot_commands": 0.09508889455061692, "deviation-center-line": 0.07502324503973785, "driven_lanedir_consec": 0.06481553712617039, "sim_compute_sim_state": 0.037120929131141074, "sim_compute_performance-ego": 0.06584718594184288, "sim_compute_robot_state-ego": 0.07033398518195519, "sim_compute_robot_state-npc0": 0.06711895649249737, "sim_compute_robot_state-npc1": 0.0680236999805157, "sim_compute_robot_state-npc2": 0.06919794816237229, "sim_compute_robot_state-npc3": 0.06637866680438702}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.14995924614593897, "sim_physics": 0.2080952659729988, "survival_time": 1.5500000000000007, "driven_lanedir": 0.08509676720036063, "sim_render-ego": 0.07166978620713757, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.18929727615848663, "deviation-heading": 0.6258454103811075, "set_robot_commands": 0.0984033461539976, "deviation-center-line": 0.0839074818395644, "driven_lanedir_consec": 0.08509676720036063, "sim_compute_sim_state": 0.03733797227182696, "sim_compute_performance-ego": 0.07414014877811555, "sim_compute_robot_state-ego": 0.07684820698153588, "sim_compute_robot_state-npc0": 0.07384800141857516, "sim_compute_robot_state-npc1": 0.0738211908648091, "sim_compute_robot_state-npc2": 0.07362407253634545, "sim_compute_robot_state-npc3": 0.0715084768110706}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.18707780959653236, "sim_physics": 0.17578075383160566, "survival_time": 1.850000000000001, "driven_lanedir": 0.0732936044711896, "sim_render-ego": 0.06102698558085674, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.15971587799690865, "deviation-heading": 0.6914397861499748, "set_robot_commands": 0.09369566633894635, "deviation-center-line": 0.0292885267833539, "driven_lanedir_consec": 0.0732936044711896, "sim_compute_sim_state": 0.03645200987119932, "sim_compute_performance-ego": 0.06627299978926375, "sim_compute_robot_state-ego": 0.07351957140742121, "sim_compute_robot_state-npc0": 0.0677844898120777, "sim_compute_robot_state-npc1": 0.0649556727022738, "sim_compute_robot_state-npc2": 0.06448165146080223, "sim_compute_robot_state-npc3": 0.06586719848014214}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1735994713764654, "sim_physics": 0.17584635229671702, "survival_time": 1.7000000000000008, "driven_lanedir": 0.04742463041065603, "sim_render-ego": 0.06507856004378375, "in-drivable-lane": 0.7500000000000006, "agent_compute-ego": 0.16962327676660874, "deviation-heading": 0.6430169211583546, "set_robot_commands": 0.0937200153575224, "deviation-center-line": 0.026977474889226676, "driven_lanedir_consec": 0.04742463041065603, "sim_compute_sim_state": 0.036986645530251896, "sim_compute_performance-ego": 0.07344323747298297, "sim_compute_robot_state-ego": 0.07827916566063375, "sim_compute_robot_state-npc0": 0.07122137967277975, "sim_compute_robot_state-npc1": 0.07081244272344253, "sim_compute_robot_state-npc2": 0.06765982683967142, "sim_compute_robot_state-npc3": 0.06750111720141243}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.15208197713548166, "sim_physics": 0.17977002263069153, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04188700493005726, "sim_render-ego": 0.06070402264595032, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.15376143902540207, "deviation-heading": 0.748046304025355, "set_robot_commands": 0.08966068178415298, "deviation-center-line": 0.025758639196128363, "driven_lanedir_consec": 0.04188700493005726, "sim_compute_sim_state": 0.03692294657230377, "sim_compute_performance-ego": 0.06671988219022751, "sim_compute_robot_state-ego": 0.06660931557416916, "sim_compute_robot_state-npc0": 0.06386034935712814, "sim_compute_robot_state-npc1": 0.06154506653547287, "sim_compute_robot_state-npc2": 0.06312277913093567, "sim_compute_robot_state-npc3": 0.06149169057607651}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.09678849122717076, "sim_physics": 0.16304415464401245, "survival_time": 1.2000000000000004, "driven_lanedir": 0.047711499008281866, "sim_render-ego": 0.060817062854766846, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.17243204514185587, "deviation-heading": 0.6012851139729924, "set_robot_commands": 0.09780473510424297, "deviation-center-line": 0.08053590386253318, "driven_lanedir_consec": 0.047711499008281866, "sim_compute_sim_state": 0.03821874658266703, "sim_compute_performance-ego": 0.06685907642046611, "sim_compute_robot_state-ego": 0.07253339886665344, "sim_compute_robot_state-npc0": 0.0696623722712199, "sim_compute_robot_state-npc1": 0.07015801469484965, "sim_compute_robot_state-npc2": 0.06594756245613098, "sim_compute_robot_state-npc3": 0.06452138225237529}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.2038146161237436, "sim_physics": 0.16495829093747022, "survival_time": 2.0500000000000007, "driven_lanedir": 0.06648992496691108, "sim_render-ego": 0.057670587446631456, "in-drivable-lane": 0.8000000000000003, "agent_compute-ego": 0.15501721312360064, "deviation-heading": 0.7148369409772203, "set_robot_commands": 0.08602174898473228, "deviation-center-line": 0.06434703655678954, "driven_lanedir_consec": 0.06648992496691108, "sim_compute_sim_state": 0.03628352793251595, "sim_compute_performance-ego": 0.06219751660416766, "sim_compute_robot_state-ego": 0.06533288374179747, "sim_compute_robot_state-npc0": 0.06436554397024759, "sim_compute_robot_state-npc1": 0.06193810555993057, "sim_compute_robot_state-npc2": 0.06538067794427639, "sim_compute_robot_state-npc3": 0.06349419965976622}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.10142299287014674, "sim_physics": 0.17874651369841202, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05548765935886468, "sim_render-ego": 0.058134939359581986, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15950153184973676, "deviation-heading": 0.6724908686881838, "set_robot_commands": 0.08791869619618291, "deviation-center-line": 0.0830789755667409, "driven_lanedir_consec": 0.05548765935886468, "sim_compute_sim_state": 0.03738846986190132, "sim_compute_performance-ego": 0.06894000716831374, "sim_compute_robot_state-ego": 0.06981244294539742, "sim_compute_robot_state-npc0": 0.06597391418788744, "sim_compute_robot_state-npc1": 0.06148063618203868, "sim_compute_robot_state-npc2": 0.060370497081590736, "sim_compute_robot_state-npc3": 0.0638261256010636}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1616882113217577, "sim_physics": 0.16675789917216582, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07661896741446572, "sim_render-ego": 0.06011756728677189, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.16009040439830108, "deviation-heading": 0.6758109176661168, "set_robot_commands": 0.09075436171363382, "deviation-center-line": 0.0680053024335324, "driven_lanedir_consec": 0.07661896741446572, "sim_compute_sim_state": 0.03646157769595876, "sim_compute_performance-ego": 0.06765529688666849, "sim_compute_robot_state-ego": 0.07033402779523064, "sim_compute_robot_state-npc0": 0.06554879160488353, "sim_compute_robot_state-npc1": 0.06768021864049575, "sim_compute_robot_state-npc2": 0.0776597962659948, "sim_compute_robot_state-npc3": 0.06729046737446505}}
set_robot_commands_max0.0984033461539976
set_robot_commands_mean0.09144731926089798
set_robot_commands_median0.09188658714294434
set_robot_commands_min0.08133623003959656
sim_compute_performance-ego_max0.07414014877811555
sim_compute_performance-ego_mean0.06721324299268519
sim_compute_performance-ego_median0.06671988219022751
sim_compute_performance-ego_min0.061439961194992065
sim_compute_robot_state-ego_max0.08252933621406555
sim_compute_robot_state-ego_mean0.0720209741524481
sim_compute_robot_state-ego_median0.0714549700419108
sim_compute_robot_state-ego_min0.06533288374179747
sim_compute_robot_state-npc0_max0.10826231042544048
sim_compute_robot_state-npc0_mean0.06974830510545445
sim_compute_robot_state-npc0_median0.06711895649249737
sim_compute_robot_state-npc0_min0.05641176303227743
sim_compute_robot_state-npc1_max0.0738211908648091
sim_compute_robot_state-npc1_mean0.06630323307248222
sim_compute_robot_state-npc1_median0.06694263617197672
sim_compute_robot_state-npc1_min0.06148063618203868
sim_compute_robot_state-npc2_max0.0776597962659948
sim_compute_robot_state-npc2_mean0.06640786156505446
sim_compute_robot_state-npc2_median0.0653201691309611
sim_compute_robot_state-npc2_min0.060370497081590736
sim_compute_robot_state-npc3_max0.0715084768110706
sim_compute_robot_state-npc3_mean0.06585815502847062
sim_compute_robot_state-npc3_median0.06586719848014214
sim_compute_robot_state-npc3_min0.06149169057607651
sim_compute_sim_state_max0.03857185443242391
sim_compute_sim_state_mean0.036951191628910536
sim_compute_sim_state_median0.03698911190032959
sim_compute_sim_state_min0.03414951165517171
sim_physics_max0.20899818340937296
sim_physics_mean0.1761994583771583
sim_physics_median0.17578075383160566
sim_physics_min0.1584007740020752
sim_render-ego_max0.07166978620713757
sim_render-ego_mean0.06135034011708269
sim_render-ego_median0.06041930516560872
sim_render-ego_min0.057361466884613035
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean4.190000000000016
survival_time_min1.1500000000000004
207832948Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessno-0:15:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07336884822093293
survival_time_median1.4000000000000006
deviation-center-line_median0.0732871370133959
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.2054191082715988
agent_compute-ego_mean0.17042379751882183
agent_compute-ego_median0.1674383735656738
agent_compute-ego_min0.15852483419271615
deviation-center-line_max0.09927559900980888
deviation-center-line_mean0.06883283127434418
deviation-center-line_min0.02984780938027378
deviation-heading_max0.8403546411494442
deviation-heading_mean0.713675317570529
deviation-heading_median0.7127266116702192
deviation-heading_min0.5859166488737421
driven_any_max0.25976669683285925
driven_any_mean0.16195883875875125
driven_any_median0.1612170316471997
driven_any_min0.09164340014056983
driven_lanedir_consec_max0.14880946860988287
driven_lanedir_consec_mean0.0819097162362669
driven_lanedir_consec_min0.05072700220150361
driven_lanedir_max0.14880946860988287
driven_lanedir_mean0.0819097162362669
driven_lanedir_median0.07336884822093293
driven_lanedir_min0.05072700220150361
in-drivable-lane_max0.5500000000000005
in-drivable-lane_mean0.2133333333333335
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21051028050498505, "sim_physics": 0.16633456200361252, "survival_time": 1.6000000000000008, "driven_lanedir": 0.0963425936883926, "sim_render-ego": 0.0645846500992775, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.2054191082715988, "deviation-heading": 0.80550285007791, "set_robot_commands": 0.11682388931512833, "deviation-center-line": 0.07236174745674463, "driven_lanedir_consec": 0.0963425936883926, "sim_compute_sim_state": 0.04015665501356125, "sim_compute_performance-ego": 0.07366325706243515, "sim_compute_robot_state-ego": 0.08264992386102676, "sim_compute_robot_state-npc0": 0.07471173256635666, "sim_compute_robot_state-npc1": 0.07551795989274979, "sim_compute_robot_state-npc2": 0.07312508672475815, "sim_compute_robot_state-npc3": 0.0695357546210289}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2203880496612171, "sim_physics": 0.15231763232838025, "survival_time": 1.6500000000000008, "driven_lanedir": 0.08427062679418329, "sim_render-ego": 0.05944902969129158, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.16193174593376392, "deviation-heading": 0.8403546411494442, "set_robot_commands": 0.10058883464697636, "deviation-center-line": 0.0612900800920389, "driven_lanedir_consec": 0.08427062679418329, "sim_compute_sim_state": 0.03970965472134677, "sim_compute_performance-ego": 0.0677167357820453, "sim_compute_robot_state-ego": 0.08318624351963852, "sim_compute_robot_state-npc0": 0.06779555118445194, "sim_compute_robot_state-npc1": 0.06834076390121922, "sim_compute_robot_state-npc2": 0.0686325232187907, "sim_compute_robot_state-npc3": 0.06857726790688255}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.10613853499021232, "sim_physics": 0.13537915893222974, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06396634751537045, "sim_render-ego": 0.06299128739730171, "in-drivable-lane": 0, "agent_compute-ego": 0.16092376087022864, "deviation-heading": 0.6344723107144671, "set_robot_commands": 0.09477081506148628, "deviation-center-line": 0.09927559900980888, "driven_lanedir_consec": 0.06396634751537045, "sim_compute_sim_state": 0.037165289339811905, "sim_compute_performance-ego": 0.06332438925038213, "sim_compute_robot_state-ego": 0.07294202887493631, "sim_compute_robot_state-npc0": 0.0700441547062086, "sim_compute_robot_state-npc1": 0.06505175258802331, "sim_compute_robot_state-npc2": 0.06656365809233292, "sim_compute_robot_state-npc3": 0.06687510531881581}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.0974878218929462, "sim_physics": 0.151317430579144, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05417911680147869, "sim_render-ego": 0.06250050793523373, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16443399761034094, "deviation-heading": 0.6101214557687102, "set_robot_commands": 0.0940440323041833, "deviation-center-line": 0.08686164342757771, "driven_lanedir_consec": 0.05417911680147869, "sim_compute_sim_state": 0.04066746131233547, "sim_compute_performance-ego": 0.06296098750570546, "sim_compute_robot_state-ego": 0.07556292285089908, "sim_compute_robot_state-npc0": 0.06105033211086107, "sim_compute_robot_state-npc1": 0.06476829362952191, "sim_compute_robot_state-npc2": 0.06700925205064856, "sim_compute_robot_state-npc3": 0.06903785207997197}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13752311256913655, "sim_physics": 0.14432857513427735, "survival_time": 1.2500000000000004, "driven_lanedir": 0.05786806377695575, "sim_render-ego": 0.0625808048248291, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.1674383735656738, "deviation-heading": 0.7687805796792904, "set_robot_commands": 0.0909904670715332, "deviation-center-line": 0.04117156285120275, "driven_lanedir_consec": 0.05786806377695575, "sim_compute_sim_state": 0.03550129890441894, "sim_compute_performance-ego": 0.06949165344238281, "sim_compute_robot_state-ego": 0.07608709335327149, "sim_compute_robot_state-npc0": 0.06754276275634766, "sim_compute_robot_state-npc1": 0.06270689010620117, "sim_compute_robot_state-npc2": 0.06710735321044922, "sim_compute_robot_state-npc3": 0.06328781127929688}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.22416469398745703, "sim_physics": 0.15242879920535618, "survival_time": 1.800000000000001, "driven_lanedir": 0.10717809538602908, "sim_render-ego": 0.060624380906422935, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1663951145278083, "deviation-heading": 0.8068043332951751, "set_robot_commands": 0.09407791164186266, "deviation-center-line": 0.06023510197645899, "driven_lanedir_consec": 0.10717809538602908, "sim_compute_sim_state": 0.04030623700883654, "sim_compute_performance-ego": 0.06722021102905273, "sim_compute_robot_state-ego": 0.07264224025938246, "sim_compute_robot_state-npc0": 0.06982033120261298, "sim_compute_robot_state-npc1": 0.06496633423699273, "sim_compute_robot_state-npc2": 0.07418561644024319, "sim_compute_robot_state-npc3": 0.06843414571550158}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.12325169386004514, "sim_physics": 0.13839645819230514, "survival_time": 1.1000000000000003, "driven_lanedir": 0.08218386800002253, "sim_render-ego": 0.06469035148620605, "in-drivable-lane": 0, "agent_compute-ego": 0.17232257669622247, "deviation-heading": 0.5859166488737421, "set_robot_commands": 0.08945060860026967, "deviation-center-line": 0.07718980767164355, "driven_lanedir_consec": 0.08218386800002253, "sim_compute_sim_state": 0.03541482578624378, "sim_compute_performance-ego": 0.06771005283702504, "sim_compute_robot_state-ego": 0.07400864904577081, "sim_compute_robot_state-npc0": 0.0670571977441961, "sim_compute_robot_state-npc1": 0.0650386160070246, "sim_compute_robot_state-npc2": 0.06298741427334872, "sim_compute_robot_state-npc3": 0.06621949239210649}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.1400466022073499, "sim_physics": 0.14211932512430045, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09956581797234998, "sim_render-ego": 0.05974249656383808, "in-drivable-lane": 0, "agent_compute-ego": 0.15852483419271615, "deviation-heading": 0.6644532476315568, "set_robot_commands": 0.08986346538250263, "deviation-center-line": 0.09873360836728098, "driven_lanedir_consec": 0.09956581797234998, "sim_compute_sim_state": 0.03896515186016376, "sim_compute_performance-ego": 0.06692642431992751, "sim_compute_robot_state-ego": 0.07288177196796124, "sim_compute_robot_state-npc0": 0.06460335621467003, "sim_compute_robot_state-npc1": 0.06951280740591195, "sim_compute_robot_state-npc2": 0.07169834467080924, "sim_compute_robot_state-npc3": 0.06883712915273812}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.1612170316471997, "sim_physics": 0.1523604052407401, "survival_time": 1.4000000000000006, "driven_lanedir": 0.07336884822093293, "sim_render-ego": 0.05799331835338047, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17838817834854126, "deviation-heading": 0.7698789733603542, "set_robot_commands": 0.0985828297478812, "deviation-center-line": 0.04157525376988617, "driven_lanedir_consec": 0.07336884822093293, "sim_compute_sim_state": 0.03599071502685547, "sim_compute_performance-ego": 0.06697362661361694, "sim_compute_robot_state-ego": 0.06678639139447894, "sim_compute_robot_state-npc0": 0.06761880431856428, "sim_compute_robot_state-npc1": 0.06269233567374093, "sim_compute_robot_state-npc2": 0.06590077706745692, "sim_compute_robot_state-npc3": 0.06532543046133858}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1697873881619318, "sim_physics": 0.14261201120192005, "survival_time": 1.5500000000000007, "driven_lanedir": 0.05072700220150361, "sim_render-ego": 0.056172001746393016, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1766384417010892, "deviation-heading": 0.7044519204322229, "set_robot_commands": 0.09795713424682616, "deviation-center-line": 0.031953343451368625, "driven_lanedir_consec": 0.05072700220150361, "sim_compute_sim_state": 0.03893840697503859, "sim_compute_performance-ego": 0.06452805765213505, "sim_compute_robot_state-ego": 0.0721176593534408, "sim_compute_robot_state-npc0": 0.06976044562555128, "sim_compute_robot_state-npc1": 0.07142766060367707, "sim_compute_robot_state-npc2": 0.07192680912633095, "sim_compute_robot_state-npc3": 0.06907743792380056}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.17578804771209616, "sim_physics": 0.1730941851933797, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06053104045808455, "sim_render-ego": 0.07036693890889485, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1747828722000122, "deviation-heading": 0.7127266116702192, "set_robot_commands": 0.1000562032063802, "deviation-center-line": 0.02984780938027378, "driven_lanedir_consec": 0.06053104045808455, "sim_compute_sim_state": 0.04100948174794515, "sim_compute_performance-ego": 0.07461055914560953, "sim_compute_robot_state-ego": 0.08141412734985351, "sim_compute_robot_state-npc0": 0.06758159796396891, "sim_compute_robot_state-npc1": 0.07090198993682861, "sim_compute_robot_state-npc2": 0.06758381525675455, "sim_compute_robot_state-npc3": 0.07160505453745523}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.09164340014056983, "sim_physics": 0.1303141951560974, "survival_time": 1.0000000000000002, "driven_lanedir": 0.05144946345821699, "sim_render-ego": 0.06189124584197998, "in-drivable-lane": 0, "agent_compute-ego": 0.16693544387817383, "deviation-heading": 0.6229540685221542, "set_robot_commands": 0.10379698276519776, "deviation-center-line": 0.08438683824082889, "driven_lanedir_consec": 0.05144946345821699, "sim_compute_sim_state": 0.040281486511230466, "sim_compute_performance-ego": 0.07045433521270753, "sim_compute_robot_state-ego": 0.07771904468536377, "sim_compute_robot_state-npc0": 0.07220423221588135, "sim_compute_robot_state-npc1": 0.07226500511169434, "sim_compute_robot_state-npc2": 0.0745496392250061, "sim_compute_robot_state-npc3": 0.07752554416656494}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.25976669683285925, "sim_physics": 0.16448379174256936, "survival_time": 1.950000000000001, "driven_lanedir": 0.126854357664394, "sim_render-ego": 0.060164219293838896, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16935187119704026, "deviation-heading": 0.7367450418714607, "set_robot_commands": 0.09552159064855333, "deviation-center-line": 0.0732871370133959, "driven_lanedir_consec": 0.126854357664394, "sim_compute_sim_state": 0.037775339224399664, "sim_compute_performance-ego": 0.06383678240653796, "sim_compute_robot_state-ego": 0.06877852097535744, "sim_compute_robot_state-npc0": 0.06860972673465045, "sim_compute_robot_state-npc1": 0.06871603696774213, "sim_compute_robot_state-npc2": 0.06807153041546161, "sim_compute_robot_state-npc3": 0.06336234777401654}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.110695936196308, "sim_physics": 0.14271215959028763, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07135103299620615, "sim_render-ego": 0.0627175352790139, "in-drivable-lane": 0, "agent_compute-ego": 0.16949028318578546, "deviation-heading": 0.6220573442431828, "set_robot_commands": 0.08941971171985973, "deviation-center-line": 0.08592848657170857, "driven_lanedir_consec": 0.07135103299620615, "sim_compute_sim_state": 0.039582469246604225, "sim_compute_performance-ego": 0.06669584187594327, "sim_compute_robot_state-ego": 0.07525601170279762, "sim_compute_robot_state-npc0": 0.06756622141057794, "sim_compute_robot_state-npc1": 0.066169489513744, "sim_compute_robot_state-npc2": 0.06917135281996294, "sim_compute_robot_state-npc3": 0.06831638379530473}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.20097329101695496, "sim_physics": 0.14240445295969645, "survival_time": 1.5000000000000009, "driven_lanedir": 0.14880946860988287, "sim_render-ego": 0.060965681076049806, "in-drivable-lane": 0, "agent_compute-ego": 0.16338036060333253, "deviation-heading": 0.819909736268047, "set_robot_commands": 0.09483475685119629, "deviation-center-line": 0.08839444983494438, "driven_lanedir_consec": 0.14880946860988287, "sim_compute_sim_state": 0.03727382024129232, "sim_compute_performance-ego": 0.06303073565165201, "sim_compute_robot_state-ego": 0.07095150947570801, "sim_compute_robot_state-npc0": 0.06690742174784342, "sim_compute_robot_state-npc1": 0.06642405986785889, "sim_compute_robot_state-npc2": 0.06611153284708658, "sim_compute_robot_state-npc3": 0.06401472091674805}}
set_robot_commands_max0.11682388931512833
set_robot_commands_mean0.09671861554732249
set_robot_commands_median0.09483475685119629
set_robot_commands_min0.08941971171985973
sim_compute_performance-ego_max0.07461055914560953
sim_compute_performance-ego_mean0.06727624331914389
sim_compute_performance-ego_median0.06697362661361694
sim_compute_performance-ego_min0.06296098750570546
sim_compute_robot_state-ego_max0.08318624351963852
sim_compute_robot_state-ego_mean0.07486560924465913
sim_compute_robot_state-ego_median0.07400864904577081
sim_compute_robot_state-ego_min0.06678639139447894
sim_compute_robot_state-npc0_max0.07471173256635666
sim_compute_robot_state-npc0_mean0.06819159123351617
sim_compute_robot_state-npc0_median0.06761880431856428
sim_compute_robot_state-npc0_min0.06105033211086107
sim_compute_robot_state-npc1_max0.07551795989274979
sim_compute_robot_state-npc1_mean0.0676333330295287
sim_compute_robot_state-npc1_median0.06642405986785889
sim_compute_robot_state-npc1_min0.06269233567374093
sim_compute_robot_state-npc2_max0.0745496392250061
sim_compute_robot_state-npc2_mean0.06897498036262936
sim_compute_robot_state-npc2_median0.06807153041546161
sim_compute_robot_state-npc2_min0.06298741427334872
sim_compute_robot_state-npc3_max0.07752554416656494
sim_compute_robot_state-npc3_mean0.06800209853610473
sim_compute_robot_state-npc3_median0.06843414571550158
sim_compute_robot_state-npc3_min0.06328781127929688
sim_compute_sim_state_max0.04100948174794515
sim_compute_sim_state_mean0.03858255286133896
sim_compute_sim_state_median0.03896515186016376
sim_compute_sim_state_min0.03541482578624378
sim_physics_max0.1730941851933797
sim_physics_mean0.14870687617228642
sim_physics_median0.14432857513427735
sim_physics_min0.1303141951560974
sim_render-ego_max0.07036693890889485
sim_render-ego_mean0.06182896329359678
sim_render-ego_median0.06189124584197998
sim_render-ego_min0.056172001746393016
simulation-passed1
survival_time_max1.950000000000001
survival_time_mean1.4000000000000006
survival_time_min1.0000000000000002
207702948Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessno-0:21:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08125410474402717
survival_time_median1.4500000000000006
deviation-center-line_median0.07537701414282494
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.25328267138937244
agent_compute-ego_mean0.21976651087962487
agent_compute-ego_median0.21870014884255148
agent_compute-ego_min0.1845753110688308
deviation-center-line_max0.5858780085285282
deviation-center-line_mean0.1271459137932151
deviation-center-line_min0.02330008870744929
deviation-heading_max5.790187149856562
deviation-heading_mean1.1937780455207834
deviation-heading_median0.656981583008281
deviation-heading_min0.5133897130594258
driven_any_max1.965702080492551
driven_any_mean0.392692292347106
driven_any_median0.1526075029427891
driven_any_min0.10016873234208631
driven_lanedir_consec_max0.6712953032723252
driven_lanedir_consec_mean0.13262099295602442
driven_lanedir_consec_min0.03869131770750256
driven_lanedir_max0.6712953032723252
driven_lanedir_mean0.13262099295602442
driven_lanedir_median0.08125410474402717
driven_lanedir_min0.03869131770750256
in-drivable-lane_max10.700000000000085
in-drivable-lane_mean1.4233333333333422
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.237418770007153, "sim_physics": 0.09279367251273914, "survival_time": 1.950000000000001, "driven_lanedir": 0.09554856513265442, "sim_render-ego": 0.05132582860115247, "in-drivable-lane": 0.7500000000000007, "agent_compute-ego": 0.1941361855237912, "deviation-heading": 0.6411229830268466, "set_robot_commands": 0.07376827337802985, "deviation-center-line": 0.060903239401645555, "driven_lanedir_consec": 0.09554856513265442, "sim_compute_sim_state": 0.03227949753785745, "sim_compute_performance-ego": 0.05544372093983185, "sim_compute_robot_state-ego": 0.05793614876575959, "sim_compute_robot_state-npc0": 0.05894668285663311, "sim_compute_robot_state-npc1": 0.05730584340217786, "sim_compute_robot_state-npc2": 0.05599443117777506, "sim_compute_robot_state-npc3": 0.05602508324843187}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.965702080492551, "sim_physics": 0.09493139743804932, "survival_time": 14.950000000000076, "driven_lanedir": 0.2960853685373239, "sim_render-ego": 0.050653738180796305, "in-drivable-lane": 10.700000000000085, "agent_compute-ego": 0.22688084443410236, "deviation-heading": 3.5390504101606384, "set_robot_commands": 0.07235106627146402, "deviation-center-line": 0.4526109885080373, "driven_lanedir_consec": 0.2960853685373239, "sim_compute_sim_state": 0.03244741598765055, "sim_compute_performance-ego": 0.05512680451075236, "sim_compute_robot_state-ego": 0.05630595286687215, "sim_compute_robot_state-npc0": 0.05983154137929281, "sim_compute_robot_state-npc1": 0.0567173687616984, "sim_compute_robot_state-npc2": 0.05682112058003744, "sim_compute_robot_state-npc3": 0.05704877217610677}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11263085516350092, "sim_physics": 0.08236111294139516, "survival_time": 1.1000000000000003, "driven_lanedir": 0.08125410474402717, "sim_render-ego": 0.05022788047790527, "in-drivable-lane": 0, "agent_compute-ego": 0.21870014884255148, "deviation-heading": 0.5133897130594258, "set_robot_commands": 0.07159565795551646, "deviation-center-line": 0.09633201866283723, "driven_lanedir_consec": 0.08125410474402717, "sim_compute_sim_state": 0.032413276759060944, "sim_compute_performance-ego": 0.05750739574432373, "sim_compute_robot_state-ego": 0.056451212276111946, "sim_compute_robot_state-npc0": 0.056041164831681686, "sim_compute_robot_state-npc1": 0.05755360559983687, "sim_compute_robot_state-npc2": 0.0569758957082575, "sim_compute_robot_state-npc3": 0.0574462197043679}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.12308452290112558, "sim_physics": 0.0822709436001985, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09044621865142188, "sim_render-ego": 0.05070488349251125, "in-drivable-lane": 0, "agent_compute-ego": 0.20819538572560187, "deviation-heading": 0.5136040991452098, "set_robot_commands": 0.07426817520805028, "deviation-center-line": 0.09192704118007426, "driven_lanedir_consec": 0.09044621865142188, "sim_compute_sim_state": 0.030364917672198753, "sim_compute_performance-ego": 0.05279443574988324, "sim_compute_robot_state-ego": 0.05607377964517345, "sim_compute_robot_state-npc0": 0.05617748136105745, "sim_compute_robot_state-npc1": 0.05469382327535878, "sim_compute_robot_state-npc2": 0.05646080556123153, "sim_compute_robot_state-npc3": 0.05237731726273247}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14240790291648484, "sim_physics": 0.07746782796136265, "survival_time": 1.4500000000000006, "driven_lanedir": 0.04032078066999312, "sim_render-ego": 0.05013736363114982, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.1845753110688308, "deviation-heading": 0.6563304351488924, "set_robot_commands": 0.06835191825340534, "deviation-center-line": 0.02330008870744929, "driven_lanedir_consec": 0.04032078066999312, "sim_compute_sim_state": 0.0335322906231058, "sim_compute_performance-ego": 0.05282547556120774, "sim_compute_robot_state-ego": 0.05620852010003451, "sim_compute_robot_state-npc0": 0.057320915419479895, "sim_compute_robot_state-npc1": 0.05562908073951458, "sim_compute_robot_state-npc2": 0.05762420029475771, "sim_compute_robot_state-npc3": 0.05808503874417009}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.917330474368609, "sim_physics": 0.09465835491816205, "survival_time": 14.950000000000076, "driven_lanedir": 0.6712953032723252, "sim_render-ego": 0.05013545989990234, "in-drivable-lane": 7.300000000000042, "agent_compute-ego": 0.2106169239679972, "deviation-heading": 5.790187149856562, "set_robot_commands": 0.07082108020782471, "deviation-center-line": 0.5858780085285282, "driven_lanedir_consec": 0.6712953032723252, "sim_compute_sim_state": 0.03132914066314697, "sim_compute_performance-ego": 0.05558475255966187, "sim_compute_robot_state-ego": 0.05652730147043864, "sim_compute_robot_state-npc0": 0.0600600004196167, "sim_compute_robot_state-npc1": 0.056628555456797285, "sim_compute_robot_state-npc2": 0.05576972881952921, "sim_compute_robot_state-npc3": 0.0564684542020162}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.10956461568938526, "sim_physics": 0.07996948905613112, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05833453400622435, "sim_render-ego": 0.05116615088089653, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.25328267138937244, "deviation-heading": 0.6160132607967304, "set_robot_commands": 0.07226856895115065, "deviation-center-line": 0.07036243416892665, "driven_lanedir_consec": 0.05833453400622435, "sim_compute_sim_state": 0.03258215862771739, "sim_compute_performance-ego": 0.05581307411193848, "sim_compute_robot_state-ego": 0.05738803614740786, "sim_compute_robot_state-npc0": 0.05972584434177564, "sim_compute_robot_state-npc1": 0.05670993224434231, "sim_compute_robot_state-npc2": 0.05548857605975607, "sim_compute_robot_state-npc3": 0.055971290754235306}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.10361730802044604, "sim_physics": 0.08184009552001953, "survival_time": 1.2500000000000004, "driven_lanedir": 0.04729171487181016, "sim_render-ego": 0.05034503936767578, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.23073323249816893, "deviation-heading": 0.5921758168148729, "set_robot_commands": 0.07052184104919433, "deviation-center-line": 0.07537701414282494, "driven_lanedir_consec": 0.04729171487181016, "sim_compute_sim_state": 0.031579408645629886, "sim_compute_performance-ego": 0.05515504837036133, "sim_compute_robot_state-ego": 0.0587306022644043, "sim_compute_robot_state-npc0": 0.058150196075439455, "sim_compute_robot_state-npc1": 0.057707090377807614, "sim_compute_robot_state-npc2": 0.056950035095214846, "sim_compute_robot_state-npc3": 0.05516061782836914}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.22709567759249108, "sim_physics": 0.09016624838113783, "survival_time": 1.6000000000000008, "driven_lanedir": 0.1556847444569125, "sim_render-ego": 0.05194299668073654, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.21775221079587936, "deviation-heading": 0.8686166182701663, "set_robot_commands": 0.07087279856204987, "deviation-center-line": 0.06372783712327289, "driven_lanedir_consec": 0.1556847444569125, "sim_compute_sim_state": 0.030630074441432953, "sim_compute_performance-ego": 0.05376510322093963, "sim_compute_robot_state-ego": 0.05708611011505127, "sim_compute_robot_state-npc0": 0.05715220421552658, "sim_compute_robot_state-npc1": 0.05457018315792084, "sim_compute_robot_state-npc2": 0.05500569939613342, "sim_compute_robot_state-npc3": 0.055051736533641815}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.15460720086105725, "sim_physics": 0.08037033388691564, "survival_time": 1.5500000000000007, "driven_lanedir": 0.04098474611989866, "sim_render-ego": 0.050624824339343656, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.22575748351312452, "deviation-heading": 0.6891695006435927, "set_robot_commands": 0.07141130970370385, "deviation-center-line": 0.02754514299197247, "driven_lanedir_consec": 0.04098474611989866, "sim_compute_sim_state": 0.032836114206621726, "sim_compute_performance-ego": 0.05598561994491085, "sim_compute_robot_state-ego": 0.05603661075715096, "sim_compute_robot_state-npc0": 0.057841593219387914, "sim_compute_robot_state-npc1": 0.056215078599991336, "sim_compute_robot_state-npc2": 0.0549272644904352, "sim_compute_robot_state-npc3": 0.057020079705023}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1526075029427891, "sim_physics": 0.09080828469375084, "survival_time": 1.4500000000000006, "driven_lanedir": 0.03869131770750256, "sim_render-ego": 0.050073007057453024, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.2421310359034045, "deviation-heading": 0.7323563019808079, "set_robot_commands": 0.07204486583841258, "deviation-center-line": 0.02606821456042504, "driven_lanedir_consec": 0.03869131770750256, "sim_compute_sim_state": 0.032382397816098966, "sim_compute_performance-ego": 0.05433542975063982, "sim_compute_robot_state-ego": 0.05849460897774532, "sim_compute_robot_state-npc0": 0.05964158321249074, "sim_compute_robot_state-npc1": 0.056305326264480066, "sim_compute_robot_state-npc2": 0.05617767366869696, "sim_compute_robot_state-npc3": 0.056402535274110994}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.10016873234208631, "sim_physics": 0.07173144249689012, "survival_time": 1.0500000000000005, "driven_lanedir": 0.05837723359629221, "sim_render-ego": 0.048823027383713496, "in-drivable-lane": 0, "agent_compute-ego": 0.1940067041487921, "deviation-heading": 0.656981583008281, "set_robot_commands": 0.07129153751191639, "deviation-center-line": 0.09168780824461494, "driven_lanedir_consec": 0.05837723359629221, "sim_compute_sim_state": 0.03196535791669573, "sim_compute_performance-ego": 0.053889830907185875, "sim_compute_robot_state-ego": 0.05548709914797828, "sim_compute_robot_state-npc0": 0.05761421294439407, "sim_compute_robot_state-npc1": 0.05830290204002744, "sim_compute_robot_state-npc2": 0.055223328726632256, "sim_compute_robot_state-npc3": 0.05593956084478469}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.25160952693352406, "sim_physics": 0.09157546361287434, "survival_time": 1.950000000000001, "driven_lanedir": 0.11849164023938918, "sim_render-ego": 0.05052590370178223, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.239337499325092, "deviation-heading": 0.6889918567436955, "set_robot_commands": 0.07124049235612918, "deviation-center-line": 0.06740893083143204, "driven_lanedir_consec": 0.11849164023938918, "sim_compute_sim_state": 0.0335382559360602, "sim_compute_performance-ego": 0.05459904670715332, "sim_compute_robot_state-ego": 0.05741173793108035, "sim_compute_robot_state-npc0": 0.0614160268734663, "sim_compute_robot_state-npc1": 0.0571292975010016, "sim_compute_robot_state-npc2": 0.05813160309424767, "sim_compute_robot_state-npc3": 0.06072360430008326}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.11349454795732568, "sim_physics": 0.07891671553902004, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06900160533496225, "sim_render-ego": 0.050628662109375, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.20721050967340884, "deviation-heading": 0.6222895475655594, "set_robot_commands": 0.0713530105093251, "deviation-center-line": 0.08436300838416091, "driven_lanedir_consec": 0.06900160533496225, "sim_compute_sim_state": 0.030965587367182194, "sim_compute_performance-ego": 0.05593289499697478, "sim_compute_robot_state-ego": 0.0571874535602072, "sim_compute_robot_state-npc0": 0.056396131930143936, "sim_compute_robot_state-npc1": 0.05509500918181046, "sim_compute_robot_state-npc2": 0.057249836299730385, "sim_compute_robot_state-npc3": 0.056555592495462166}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.17904466701806143, "sim_physics": 0.08303246826961122, "survival_time": 1.4500000000000006, "driven_lanedir": 0.12750701699962885, "sim_render-ego": 0.05544115757120067, "in-drivable-lane": 0, "agent_compute-ego": 0.2431815163842563, "deviation-heading": 0.7863914065904671, "set_robot_commands": 0.07100890422689504, "deviation-center-line": 0.0896969314620252, "driven_lanedir_consec": 0.12750701699962885, "sim_compute_sim_state": 0.03323508953226024, "sim_compute_performance-ego": 0.05705692850310227, "sim_compute_robot_state-ego": 0.05562788864661907, "sim_compute_robot_state-npc0": 0.05841047188331341, "sim_compute_robot_state-npc1": 0.05618423429028741, "sim_compute_robot_state-npc2": 0.056809137607442925, "sim_compute_robot_state-npc3": 0.05752727903168777}}
set_robot_commands_max0.07426817520805028
set_robot_commands_mean0.07154463333220451
set_robot_commands_median0.0713530105093251
set_robot_commands_min0.06835191825340534
sim_compute_performance-ego_max0.05750739574432373
sim_compute_performance-ego_mean0.05505437077192447
sim_compute_performance-ego_median0.05515504837036133
sim_compute_performance-ego_min0.05279443574988324
sim_compute_robot_state-ego_max0.0587306022644043
sim_compute_robot_state-ego_mean0.05686353751146899
sim_compute_robot_state-ego_median0.05652730147043864
sim_compute_robot_state-ego_min0.05548709914797828
sim_compute_robot_state-npc0_max0.0614160268734663
sim_compute_robot_state-npc0_mean0.05831507006424663
sim_compute_robot_state-npc0_median0.058150196075439455
sim_compute_robot_state-npc0_min0.056041164831681686
sim_compute_robot_state-npc1_max0.05830290204002744
sim_compute_robot_state-npc1_mean0.05644982205953685
sim_compute_robot_state-npc1_median0.056628555456797285
sim_compute_robot_state-npc1_min0.05457018315792084
sim_compute_robot_state-npc2_max0.05813160309424767
sim_compute_robot_state-npc2_mean0.05637395577199188
sim_compute_robot_state-npc2_median0.05646080556123153
sim_compute_robot_state-npc2_min0.0549272644904352
sim_compute_robot_state-npc3_max0.06072360430008326
sim_compute_robot_state-npc3_mean0.056520212140348226
sim_compute_robot_state-npc3_median0.0564684542020162
sim_compute_robot_state-npc3_min0.05237731726273247
sim_compute_sim_state_max0.0335382559360602
sim_compute_sim_state_mean0.03213873224884798
sim_compute_sim_state_median0.032382397816098966
sim_compute_sim_state_min0.030364917672198753
sim_physics_max0.09493139743804932
sim_physics_mean0.08485959005521716
sim_physics_median0.08236111294139516
sim_physics_min0.07173144249689012
sim_render-ego_max0.05544115757120067
sim_render-ego_mean0.05085039489170629
sim_render-ego_median0.050624824339343656
sim_render-ego_min0.048823027383713496
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean3.210000000000011
survival_time_min1.0500000000000005
202782948Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessno-0:09:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.062022045298948725
survival_time_median1.2500000000000004
deviation-center-line_median0.06367263209683718
in-drivable-lane_median0.20000000000000015


other stats
agent_compute-ego_max0.26552375880154694
agent_compute-ego_mean0.19188546731521053
agent_compute-ego_median0.17399880409240723
agent_compute-ego_min0.17003538157488848
deviation-center-line_max0.09235503759619666
deviation-center-line_mean0.06677903886860923
deviation-center-line_min0.03636486940047102
deviation-heading_max0.7997265771535362
deviation-heading_mean0.669299074807683
deviation-heading_median0.6876974904005794
deviation-heading_min0.5425159606207464
driven_any_max0.2333169249222232
driven_any_mean0.15682149971094142
driven_any_median0.13817713243418897
driven_any_min0.09786744043340422
driven_lanedir_consec_max0.09434724319464571
driven_lanedir_consec_mean0.0677402015112041
driven_lanedir_consec_min0.05370683158025358
driven_lanedir_max0.09434724319464571
driven_lanedir_mean0.0677402015112041
driven_lanedir_median0.062022045298948725
driven_lanedir_min0.05370683158025358
in-drivable-lane_max0.6500000000000006
in-drivable-lane_mean0.30000000000000027
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2333169249222232, "sim_physics": 0.171918688593684, "survival_time": 1.850000000000001, "driven_lanedir": 0.09434724319464571, "sim_render-ego": 0.06183778273092734, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.17003538157488848, "deviation-heading": 0.6876974904005794, "set_robot_commands": 0.09544511743493982, "deviation-center-line": 0.06367263209683718, "driven_lanedir_consec": 0.09434724319464571, "sim_compute_sim_state": 0.03853230218629579, "sim_compute_performance-ego": 0.07011429039207664, "sim_compute_robot_state-ego": 0.07719074068842707, "sim_compute_robot_state-npc0": 0.07047954121151485, "sim_compute_robot_state-npc1": 0.06891423302727777, "sim_compute_robot_state-npc2": 0.07052418347951528, "sim_compute_robot_state-npc3": 0.06798199705175452}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20325863373162156, "sim_physics": 0.15626079194685993, "survival_time": 1.7000000000000008, "driven_lanedir": 0.05370683158025358, "sim_render-ego": 0.05867436352898093, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.17122549169203816, "deviation-heading": 0.7997265771535362, "set_robot_commands": 0.1034177120994119, "deviation-center-line": 0.053364118877278766, "driven_lanedir_consec": 0.05370683158025358, "sim_compute_sim_state": 0.0397406395743875, "sim_compute_performance-ego": 0.06744058693156522, "sim_compute_robot_state-ego": 0.0752182076959049, "sim_compute_robot_state-npc0": 0.0692053893033196, "sim_compute_robot_state-npc1": 0.06582143727470846, "sim_compute_robot_state-npc2": 0.07219572628245634, "sim_compute_robot_state-npc3": 0.07150168278638054}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09786744043340422, "sim_physics": 0.15463064027869183, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05496427285117811, "sim_render-ego": 0.06329139419223952, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17864390041517175, "deviation-heading": 0.5962568805053253, "set_robot_commands": 0.09685848070227582, "deviation-center-line": 0.09235503759619666, "driven_lanedir_consec": 0.05496427285117811, "sim_compute_sim_state": 0.040069497149923576, "sim_compute_performance-ego": 0.06497030672819717, "sim_compute_robot_state-ego": 0.06978291013966435, "sim_compute_robot_state-npc0": 0.06870944603629735, "sim_compute_robot_state-npc1": 0.07754169339719026, "sim_compute_robot_state-npc2": 0.06788867452870244, "sim_compute_robot_state-npc3": 0.07178190480107846}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.11148736703326911, "sim_physics": 0.1778471903367476, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07366061463099438, "sim_render-ego": 0.06499561396512119, "in-drivable-lane": 0, "agent_compute-ego": 0.26552375880154694, "deviation-heading": 0.5425159606207464, "set_robot_commands": 0.11745527657595548, "deviation-center-line": 0.08813853637226249, "driven_lanedir_consec": 0.07366061463099438, "sim_compute_sim_state": 0.040841102600097656, "sim_compute_performance-ego": 0.0704135461287065, "sim_compute_robot_state-ego": 0.08560953357002953, "sim_compute_robot_state-npc0": 0.07576862248507413, "sim_compute_robot_state-npc1": 0.07950913906097412, "sim_compute_robot_state-npc2": 0.077734036879106, "sim_compute_robot_state-npc3": 0.0709182999350808}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13817713243418897, "sim_physics": 0.1341552257537842, "survival_time": 1.2500000000000004, "driven_lanedir": 0.062022045298948725, "sim_render-ego": 0.06138493537902832, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.17399880409240723, "deviation-heading": 0.7202984653582282, "set_robot_commands": 0.09775976181030271, "deviation-center-line": 0.03636486940047102, "driven_lanedir_consec": 0.062022045298948725, "sim_compute_sim_state": 0.0394734001159668, "sim_compute_performance-ego": 0.06831073760986328, "sim_compute_robot_state-ego": 0.07931803703308106, "sim_compute_robot_state-npc0": 0.0686339282989502, "sim_compute_robot_state-npc1": 0.07543515205383301, "sim_compute_robot_state-npc2": 0.0686737823486328, "sim_compute_robot_state-npc3": 0.06864395141601562}}
set_robot_commands_max0.11745527657595548
set_robot_commands_mean0.10218726972457716
set_robot_commands_median0.09775976181030271
set_robot_commands_min0.09544511743493982
sim_compute_performance-ego_max0.0704135461287065
sim_compute_performance-ego_mean0.06824989355808177
sim_compute_performance-ego_median0.06831073760986328
sim_compute_performance-ego_min0.06497030672819717
sim_compute_robot_state-ego_max0.08560953357002953
sim_compute_robot_state-ego_mean0.07742388582542138
sim_compute_robot_state-ego_median0.07719074068842707
sim_compute_robot_state-ego_min0.06978291013966435
sim_compute_robot_state-npc0_max0.07576862248507413
sim_compute_robot_state-npc0_mean0.07055938546703122
sim_compute_robot_state-npc0_median0.0692053893033196
sim_compute_robot_state-npc0_min0.0686339282989502
sim_compute_robot_state-npc1_max0.07950913906097412
sim_compute_robot_state-npc1_mean0.07344433096279672
sim_compute_robot_state-npc1_median0.07543515205383301
sim_compute_robot_state-npc1_min0.06582143727470846
sim_compute_robot_state-npc2_max0.077734036879106
sim_compute_robot_state-npc2_mean0.07140328070368258
sim_compute_robot_state-npc2_median0.07052418347951528
sim_compute_robot_state-npc2_min0.06788867452870244
sim_compute_robot_state-npc3_max0.07178190480107846
sim_compute_robot_state-npc3_mean0.070165567198062
sim_compute_robot_state-npc3_median0.0709182999350808
sim_compute_robot_state-npc3_min0.06798199705175452
sim_compute_sim_state_max0.040841102600097656
sim_compute_sim_state_mean0.03973138832533426
sim_compute_sim_state_median0.0397406395743875
sim_compute_sim_state_min0.03853230218629579
sim_physics_max0.1778471903367476
sim_physics_mean0.15896250738195353
sim_physics_median0.15626079194685993
sim_physics_min0.1341552257537842
sim_render-ego_max0.06499561396512119
sim_render-ego_mean0.06203681795925946
sim_render-ego_median0.06183778273092734
sim_render-ego_min0.05867436352898093
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.4100000000000006
survival_time_min1.1000000000000003
202372948Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationhost-errorno-0:26:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20237-910651', 'ps', '-q', 'solution']' returned non-zero exit status 255.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20237-910651', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20237-910651', 'ps', '-q', 'solution']' returned non-zero exit status 255.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
192552948Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessno-0:05:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.14589703623790085
survival_time_median1.3500000000000003
deviation-center-line_median0.06185882086381747
in-drivable-lane_median0


other stats
agent_compute-ego_max0.4367453410075261
agent_compute-ego_mean0.4211987688427879
agent_compute-ego_median0.4302873346540663
agent_compute-ego_min0.3765024588658259
deviation-center-line_max0.06519734454592505
deviation-center-line_mean0.06191605945285415
deviation-center-line_min0.05855458373648231
deviation-heading_max0.6501588819097284
deviation-heading_mean0.6340939725981807
deviation-heading_median0.6439278475665279
deviation-heading_min0.6084523727596898
driven_any_max0.21682273583798217
driven_any_mean0.19712412369654425
driven_any_median0.1902234532099736
driven_any_min0.18001120653487984
driven_lanedir_consec_max0.16955904227791274
driven_lanedir_consec_mean0.14976235586831868
driven_lanedir_consec_min0.1320015023164376
driven_lanedir_max0.16955904227791274
driven_lanedir_mean0.14976235586831868
driven_lanedir_median0.14589703623790085
driven_lanedir_min0.1320015023164376
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20844306090907477, "sim_physics": 0.02854985660976834, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1644671217790643, "sim_render-ego": 0.05991972817314996, "in-drivable-lane": 0, "agent_compute-ego": 0.4302873346540663, "deviation-heading": 0.6084523727596898, "set_robot_commands": 0.07763851130450214, "deviation-center-line": 0.06519734454592505, "driven_lanedir_consec": 0.1644671217790643, "sim_compute_sim_state": 0.03425349129570855, "sim_compute_performance-ego": 0.05979062892772533, "sim_compute_robot_state-ego": 0.0608668327331543, "sim_compute_robot_state-npc0": 0.06315796463577836, "sim_compute_robot_state-npc1": 0.06211257863927771, "sim_compute_robot_state-npc2": 0.06084983437149613, "sim_compute_robot_state-npc3": 0.06018722498858416}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1902234532099736, "sim_physics": 0.02971009854917173, "survival_time": 1.3500000000000003, "driven_lanedir": 0.14589703623790085, "sim_render-ego": 0.053771645934493455, "in-drivable-lane": 0, "agent_compute-ego": 0.42946015463935006, "deviation-heading": 0.6464074228863094, "set_robot_commands": 0.07868944274054633, "deviation-center-line": 0.06185882086381747, "driven_lanedir_consec": 0.14589703623790085, "sim_compute_sim_state": 0.03636227713690864, "sim_compute_performance-ego": 0.06019228476065176, "sim_compute_robot_state-ego": 0.06344635398299606, "sim_compute_robot_state-npc0": 0.06437932120429145, "sim_compute_robot_state-npc1": 0.0614273018307156, "sim_compute_robot_state-npc2": 0.0626220526518645, "sim_compute_robot_state-npc3": 0.0633234977722168}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.19012016199081097, "sim_physics": 0.031934463060819186, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1368870767302779, "sim_render-ego": 0.05585153286273663, "in-drivable-lane": 0, "agent_compute-ego": 0.4367453410075261, "deviation-heading": 0.6501588819097284, "set_robot_commands": 0.0728991490143996, "deviation-center-line": 0.058808633419945334, "driven_lanedir_consec": 0.1368870767302779, "sim_compute_sim_state": 0.035269636374253496, "sim_compute_performance-ego": 0.06244216515467717, "sim_compute_robot_state-ego": 0.06299763459425706, "sim_compute_robot_state-npc0": 0.06712597150069016, "sim_compute_robot_state-npc1": 0.062038577519930325, "sim_compute_robot_state-npc2": 0.06226526773892916, "sim_compute_robot_state-npc3": 0.06200766563415527}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.21682273583798217, "sim_physics": 0.034293336527688165, "survival_time": 1.4000000000000006, "driven_lanedir": 0.16955904227791274, "sim_render-ego": 0.05531763178961618, "in-drivable-lane": 0, "agent_compute-ego": 0.43299855504717144, "deviation-heading": 0.621523337868648, "set_robot_commands": 0.07256175790514265, "deviation-center-line": 0.06516091469810065, "driven_lanedir_consec": 0.16955904227791274, "sim_compute_sim_state": 0.035209877150399346, "sim_compute_performance-ego": 0.060613581112452915, "sim_compute_robot_state-ego": 0.0642571108681815, "sim_compute_robot_state-npc0": 0.06344062089920044, "sim_compute_robot_state-npc1": 0.06384835072926112, "sim_compute_robot_state-npc2": 0.06188276835850307, "sim_compute_robot_state-npc3": 0.05807033606937954}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18001120653487984, "sim_physics": 0.02758639592390794, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1320015023164376, "sim_render-ego": 0.055975024516765885, "in-drivable-lane": 0, "agent_compute-ego": 0.3765024588658259, "deviation-heading": 0.6439278475665279, "set_robot_commands": 0.07239993718954232, "deviation-center-line": 0.05855458373648231, "driven_lanedir_consec": 0.1320015023164376, "sim_compute_sim_state": 0.03476705917945275, "sim_compute_performance-ego": 0.06265362409444955, "sim_compute_robot_state-ego": 0.060051752970768854, "sim_compute_robot_state-npc0": 0.06526259275583121, "sim_compute_robot_state-npc1": 0.06310896690075214, "sim_compute_robot_state-npc2": 0.061717721132131725, "sim_compute_robot_state-npc3": 0.060692897209754355}}
set_robot_commands_max0.07868944274054633
set_robot_commands_mean0.07483775963082659
set_robot_commands_median0.0728991490143996
set_robot_commands_min0.07239993718954232
sim_compute_performance-ego_max0.06265362409444955
sim_compute_performance-ego_mean0.061138456809991346
sim_compute_performance-ego_median0.060613581112452915
sim_compute_performance-ego_min0.05979062892772533
sim_compute_robot_state-ego_max0.0642571108681815
sim_compute_robot_state-ego_mean0.06232393702987156
sim_compute_robot_state-ego_median0.06299763459425706
sim_compute_robot_state-ego_min0.060051752970768854
sim_compute_robot_state-npc0_max0.06712597150069016
sim_compute_robot_state-npc0_mean0.06467329419915832
sim_compute_robot_state-npc0_median0.06437932120429145
sim_compute_robot_state-npc0_min0.06315796463577836
sim_compute_robot_state-npc1_max0.06384835072926112
sim_compute_robot_state-npc1_mean0.06250715512398738
sim_compute_robot_state-npc1_median0.06211257863927771
sim_compute_robot_state-npc1_min0.0614273018307156
sim_compute_robot_state-npc2_max0.0626220526518645
sim_compute_robot_state-npc2_mean0.06186752885058492
sim_compute_robot_state-npc2_median0.06188276835850307
sim_compute_robot_state-npc2_min0.06084983437149613
sim_compute_robot_state-npc3_max0.0633234977722168
sim_compute_robot_state-npc3_mean0.060856324334818024
sim_compute_robot_state-npc3_median0.060692897209754355
sim_compute_robot_state-npc3_min0.05807033606937954
sim_compute_sim_state_max0.03636227713690864
sim_compute_sim_state_mean0.03517246822734456
sim_compute_sim_state_median0.035209877150399346
sim_compute_sim_state_min0.03425349129570855
sim_physics_max0.034293336527688165
sim_physics_mean0.030414830134271077
sim_physics_median0.02971009854917173
sim_physics_min0.02758639592390794
sim_render-ego_max0.05991972817314996
sim_render-ego_mean0.05616711265535242
sim_render-ego_median0.05585153286273663
sim_render-ego_min0.053771645934493455
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.3400000000000003
survival_time_min1.3000000000000005
192382948Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessno-0:05:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.10595285730710112
survival_time_median1.3000000000000005
deviation-center-line_median0.0516002469587028
in-drivable-lane_median0


other stats
agent_compute-ego_max0.10055638211114068
agent_compute-ego_mean0.09592923371346444
agent_compute-ego_median0.09539349262530988
agent_compute-ego_min0.09224483489990234
deviation-center-line_max0.06364803338789915
deviation-center-line_mean0.05276115073584177
deviation-center-line_min0.04496223327933722
deviation-heading_max0.7423081602723693
deviation-heading_mean0.706354001635945
deviation-heading_median0.7257234415602533
deviation-heading_min0.6251697915122961
driven_any_max0.17494687927580566
driven_any_mean0.16386340069691524
driven_any_median0.16643366112180488
driven_any_min0.1529405704553876
driven_lanedir_consec_max0.12683359081609202
driven_lanedir_consec_mean0.10340657091932522
driven_lanedir_consec_min0.07990628509734776
driven_lanedir_max0.12683359081609202
driven_lanedir_mean0.10340657091932522
driven_lanedir_median0.10595285730710112
driven_lanedir_min0.07990628509734776
in-drivable-lane_max0.10000000000000007
in-drivable-lane_mean0.04000000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.17104645991035444, "sim_physics": 0.017384162970951626, "survival_time": 1.4000000000000006, "driven_lanedir": 0.10595285730710112, "sim_render-ego": 0.034735841410500665, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.10055638211114068, "deviation-heading": 0.6962976839596691, "set_robot_commands": 0.05287831170218331, "deviation-center-line": 0.04496223327933722, "driven_lanedir_consec": 0.10595285730710112, "sim_compute_sim_state": 0.020825343472617015, "sim_compute_performance-ego": 0.03781572410038539, "sim_compute_robot_state-ego": 0.039602109364100864, "sim_compute_robot_state-npc0": 0.03867538486208234, "sim_compute_robot_state-npc1": 0.0422368049621582, "sim_compute_robot_state-npc2": 0.04074951580592564, "sim_compute_robot_state-npc3": 0.03792569466999599}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16643366112180488, "sim_physics": 0.016175013322096605, "survival_time": 1.3000000000000005, "driven_lanedir": 0.111446048767041, "sim_render-ego": 0.03724742852724515, "in-drivable-lane": 0, "agent_compute-ego": 0.0945669412612915, "deviation-heading": 0.7423081602723693, "set_robot_commands": 0.0523829826941857, "deviation-center-line": 0.06364803338789915, "driven_lanedir_consec": 0.111446048767041, "sim_compute_sim_state": 0.021325184748722956, "sim_compute_performance-ego": 0.04028038795177753, "sim_compute_robot_state-ego": 0.039310611211336575, "sim_compute_robot_state-npc0": 0.03803267845740685, "sim_compute_robot_state-npc1": 0.03852298626532921, "sim_compute_robot_state-npc2": 0.03975553695972149, "sim_compute_robot_state-npc3": 0.038277433468745306}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17494687927580566, "sim_physics": 0.016562538146972658, "survival_time": 1.2500000000000004, "driven_lanedir": 0.12683359081609202, "sim_render-ego": 0.034457311630249024, "in-drivable-lane": 0, "agent_compute-ego": 0.09688451766967772, "deviation-heading": 0.6251697915122961, "set_robot_commands": 0.05343120574951172, "deviation-center-line": 0.058409659239654486, "driven_lanedir_consec": 0.12683359081609202, "sim_compute_sim_state": 0.021089019775390624, "sim_compute_performance-ego": 0.03650299072265625, "sim_compute_robot_state-ego": 0.03797980308532715, "sim_compute_robot_state-npc0": 0.03961817741394043, "sim_compute_robot_state-npc1": 0.04098153114318848, "sim_compute_robot_state-npc2": 0.038289146423339845, "sim_compute_robot_state-npc3": 0.03881333351135254}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1529405704553876, "sim_physics": 0.017611301862276517, "survival_time": 1.3000000000000005, "driven_lanedir": 0.07990628509734776, "sim_render-ego": 0.03370848985818716, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.09539349262530988, "deviation-heading": 0.7257234415602533, "set_robot_commands": 0.05211328543149508, "deviation-center-line": 0.04518558081361517, "driven_lanedir_consec": 0.07990628509734776, "sim_compute_sim_state": 0.02116105189690223, "sim_compute_performance-ego": 0.036444480602557845, "sim_compute_robot_state-ego": 0.0409094370328463, "sim_compute_robot_state-npc0": 0.03979046528155987, "sim_compute_robot_state-npc1": 0.038733528210566595, "sim_compute_robot_state-npc2": 0.03866158081935002, "sim_compute_robot_state-npc3": 0.03779121545644907}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15394943272122358, "sim_physics": 0.015527515411376954, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09289407260904414, "sim_render-ego": 0.03529136657714844, "in-drivable-lane": 0, "agent_compute-ego": 0.09224483489990234, "deviation-heading": 0.742270930875137, "set_robot_commands": 0.05401811599731445, "deviation-center-line": 0.0516002469587028, "driven_lanedir_consec": 0.09289407260904414, "sim_compute_sim_state": 0.02076101303100586, "sim_compute_performance-ego": 0.03781256675720215, "sim_compute_robot_state-ego": 0.03876467704772949, "sim_compute_robot_state-npc0": 0.03978848457336426, "sim_compute_robot_state-npc1": 0.03835688591003418, "sim_compute_robot_state-npc2": 0.038443374633789065, "sim_compute_robot_state-npc3": 0.03845947265625}}
set_robot_commands_max0.05401811599731445
set_robot_commands_mean0.05296478031493805
set_robot_commands_median0.05287831170218331
set_robot_commands_min0.05211328543149508
sim_compute_performance-ego_max0.04028038795177753
sim_compute_performance-ego_mean0.037771230026915834
sim_compute_performance-ego_median0.03781256675720215
sim_compute_performance-ego_min0.036444480602557845
sim_compute_robot_state-ego_max0.0409094370328463
sim_compute_robot_state-ego_mean0.03931332754826807
sim_compute_robot_state-ego_median0.039310611211336575
sim_compute_robot_state-ego_min0.03797980308532715
sim_compute_robot_state-npc0_max0.03979046528155987
sim_compute_robot_state-npc0_mean0.03918103811767075
sim_compute_robot_state-npc0_median0.03961817741394043
sim_compute_robot_state-npc0_min0.03803267845740685
sim_compute_robot_state-npc1_max0.0422368049621582
sim_compute_robot_state-npc1_mean0.03976634729825533
sim_compute_robot_state-npc1_median0.038733528210566595
sim_compute_robot_state-npc1_min0.03835688591003418
sim_compute_robot_state-npc2_max0.04074951580592564
sim_compute_robot_state-npc2_mean0.03917983092842521
sim_compute_robot_state-npc2_median0.03866158081935002
sim_compute_robot_state-npc2_min0.038289146423339845
sim_compute_robot_state-npc3_max0.03881333351135254
sim_compute_robot_state-npc3_mean0.03825342995255858
sim_compute_robot_state-npc3_median0.038277433468745306
sim_compute_robot_state-npc3_min0.03779121545644907
sim_compute_sim_state_max0.021325184748722956
sim_compute_sim_state_mean0.021032322584927737
sim_compute_sim_state_median0.021089019775390624
sim_compute_sim_state_min0.02076101303100586
sim_physics_max0.017611301862276517
sim_physics_mean0.016652106342734875
sim_physics_median0.016562538146972658
sim_physics_min0.015527515411376954
sim_render-ego_max0.03724742852724515
sim_render-ego_mean0.03508808760066608
sim_render-ego_median0.034735841410500665
sim_render-ego_min0.03370848985818716
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.3000000000000005
survival_time_min1.2500000000000004
192302948Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationhost-errorno-0:00:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1026, in _send_output
    self.send(msg)
  File "/usr/lib/python3.6/http/client.py", line 964, in send
    self.connect()
  File "/usr/local/lib/python3.6/dist-packages/docker/transport/unixconn.py", line 43, in connect
    sock.connect(self.unix_socket)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/dist-packages/urllib3/util/retry.py", line 367, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/packages/six.py", line 685, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1026, in _send_output
    self.send(msg)
  File "/usr/lib/python3.6/http/client.py", line 964, in send
    self.connect()
  File "/usr/local/lib/python3.6/dist-packages/docker/transport/unixconn.py", line 43, in connect
    sock.connect(self.unix_socket)
urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionRefusedError(111, 'Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown-shell/lib/dt_shell/env_checks.py", line 60, in check_docker_environment
    containers = client.containers.list(filters=dict(status='running'))
  File "/usr/local/lib/python3.6/dist-packages/docker/models/containers.py", line 918, in list
    since=since)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/container.py", line 208, in containers
    res = self._result(self._get(u, params=params), True)
  File "/usr/local/lib/python3.6/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/requests/adapters.py", line 498, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionRefusedError(111, 'Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 571, in run_single
    timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 646, in run_one
    client = check_docker_environment()
  File "/project/src/duckietown-shell/lib/dt_shell/env_checks.py", line 67, in check_docker_environment
    raise InvalidEnvironment(msg)
dt_shell.exceptions.InvalidEnvironment: I cannot communicate with Docker:
('Connection aborted.', ConnectionRefusedError(111, 'Connection refused'))

Make sure the docker service is running.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
191122948Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessno-0:07:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07179001331996626
survival_time_median1.7000000000000008
deviation-center-line_median0.03475202883081557
in-drivable-lane_median0.5000000000000004


other stats
agent_compute-ego_max0.26492850920733285
agent_compute-ego_mean0.22379267462222124
agent_compute-ego_median0.2136208450092989
agent_compute-ego_min0.21087892616496368
deviation-center-line_max0.045840464281330026
deviation-center-line_mean0.036001887564649566
deviation-center-line_min0.03181446965987815
deviation-heading_max0.7143297362676483
deviation-heading_mean0.6661904609323562
deviation-heading_median0.6675311192971669
deviation-heading_min0.6130925161246024
driven_any_max0.19043924071075288
driven_any_mean0.17267671197493786
driven_any_median0.17205930246389672
driven_any_min0.16180443455343235
driven_lanedir_consec_max0.10149193983173666
driven_lanedir_consec_mean0.075913373034416
driven_lanedir_consec_min0.06130330911019399
driven_lanedir_max0.10149193983173666
driven_lanedir_mean0.075913373034416
driven_lanedir_median0.07179001331996626
driven_lanedir_min0.06130330911019399
in-drivable-lane_max0.5500000000000005
in-drivable-lane_mean0.5000000000000004
in-drivable-lane_min0.4500000000000004
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.17484617187554558, "sim_physics": 0.026218673762153175, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07887380319174353, "sim_render-ego": 0.06725950100842644, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.26492850920733285, "deviation-heading": 0.6130925161246024, "set_robot_commands": 0.0777956668068381, "deviation-center-line": 0.03181446965987815, "driven_lanedir_consec": 0.07887380319174353, "sim_compute_sim_state": 0.03381968245786779, "sim_compute_performance-ego": 0.06354049374075497, "sim_compute_robot_state-ego": 0.06384637075311997, "sim_compute_robot_state-npc0": 0.06788821080151726, "sim_compute_robot_state-npc1": 0.06628307875464945, "sim_compute_robot_state-npc2": 0.06187393384821275, "sim_compute_robot_state-npc3": 0.062159033382640165}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16180443455343235, "sim_physics": 0.02674838374642765, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06130330911019399, "sim_render-ego": 0.06387982648961685, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.21087892616496368, "deviation-heading": 0.7143297362676483, "set_robot_commands": 0.07480772803811465, "deviation-center-line": 0.03475202883081557, "driven_lanedir_consec": 0.06130330911019399, "sim_compute_sim_state": 0.03674321314867805, "sim_compute_performance-ego": 0.06604848188512466, "sim_compute_robot_state-ego": 0.06938819324269015, "sim_compute_robot_state-npc0": 0.06880610830643598, "sim_compute_robot_state-npc1": 0.06697961863349466, "sim_compute_robot_state-npc2": 0.06352043853086584, "sim_compute_robot_state-npc3": 0.06372066806344424}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1642344102710617, "sim_physics": 0.02789988662257339, "survival_time": 1.6500000000000008, "driven_lanedir": 0.06610779971843961, "sim_render-ego": 0.06172331896695224, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.2120760643120968, "deviation-heading": 0.6675311192971669, "set_robot_commands": 0.07525480877269398, "deviation-center-line": 0.03239491258340806, "driven_lanedir_consec": 0.06610779971843961, "sim_compute_sim_state": 0.03662162116079619, "sim_compute_performance-ego": 0.06245949774077445, "sim_compute_robot_state-ego": 0.06258403893673059, "sim_compute_robot_state-npc0": 0.06782411084030614, "sim_compute_robot_state-npc1": 0.06531039151278409, "sim_compute_robot_state-npc2": 0.06376746929053104, "sim_compute_robot_state-npc3": 0.0719880840995095}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19043924071075288, "sim_physics": 0.02814633004805621, "survival_time": 1.7000000000000008, "driven_lanedir": 0.10149193983173666, "sim_render-ego": 0.06749185393838321, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.2136208450092989, "deviation-heading": 0.6772187407031505, "set_robot_commands": 0.07547553146586698, "deviation-center-line": 0.045840464281330026, "driven_lanedir_consec": 0.10149193983173666, "sim_compute_sim_state": 0.03721381636226878, "sim_compute_performance-ego": 0.06441081972683177, "sim_compute_robot_state-ego": 0.06480191034429214, "sim_compute_robot_state-npc0": 0.0716551191666547, "sim_compute_robot_state-npc1": 0.06568673778982724, "sim_compute_robot_state-npc2": 0.06581790306988884, "sim_compute_robot_state-npc3": 0.06732368469238281}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.17205930246389672, "sim_physics": 0.02402712359572902, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07179001331996626, "sim_render-ego": 0.06862767537434895, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.21745902841741388, "deviation-heading": 0.658780192269213, "set_robot_commands": 0.07640118309945772, "deviation-center-line": 0.035207562467816, "driven_lanedir_consec": 0.07179001331996626, "sim_compute_sim_state": 0.03612880273298784, "sim_compute_performance-ego": 0.06831974694223115, "sim_compute_robot_state-ego": 0.06490694392811168, "sim_compute_robot_state-npc0": 0.0732040260777329, "sim_compute_robot_state-npc1": 0.0674905776977539, "sim_compute_robot_state-npc2": 0.06819628224228368, "sim_compute_robot_state-npc3": 0.0678746628038811}}
set_robot_commands_max0.0777956668068381
set_robot_commands_mean0.07594698363659429
set_robot_commands_median0.07547553146586698
set_robot_commands_min0.07480772803811465
sim_compute_performance-ego_max0.06831974694223115
sim_compute_performance-ego_mean0.06495580800714339
sim_compute_performance-ego_median0.06441081972683177
sim_compute_performance-ego_min0.06245949774077445
sim_compute_robot_state-ego_max0.06938819324269015
sim_compute_robot_state-ego_mean0.06510549144098891
sim_compute_robot_state-ego_median0.06480191034429214
sim_compute_robot_state-ego_min0.06258403893673059
sim_compute_robot_state-npc0_max0.0732040260777329
sim_compute_robot_state-npc0_mean0.06987551503852939
sim_compute_robot_state-npc0_median0.06880610830643598
sim_compute_robot_state-npc0_min0.06782411084030614
sim_compute_robot_state-npc1_max0.0674905776977539
sim_compute_robot_state-npc1_mean0.06635008087770186
sim_compute_robot_state-npc1_median0.06628307875464945
sim_compute_robot_state-npc1_min0.06531039151278409
sim_compute_robot_state-npc2_max0.06819628224228368
sim_compute_robot_state-npc2_mean0.06463520539635643
sim_compute_robot_state-npc2_median0.06376746929053104
sim_compute_robot_state-npc2_min0.06187393384821275
sim_compute_robot_state-npc3_max0.0719880840995095
sim_compute_robot_state-npc3_mean0.06661322660837157
sim_compute_robot_state-npc3_median0.06732368469238281
sim_compute_robot_state-npc3_min0.062159033382640165
sim_compute_sim_state_max0.03721381636226878
sim_compute_sim_state_mean0.03610542717251973
sim_compute_sim_state_median0.03662162116079619
sim_compute_sim_state_min0.03381968245786779
sim_physics_max0.02814633004805621
sim_physics_mean0.02660807955498789
sim_physics_median0.02674838374642765
sim_physics_min0.02402712359572902
sim_render-ego_max0.06862767537434895
sim_render-ego_mean0.06579643515554554
sim_render-ego_median0.06725950100842644
sim_render-ego_min0.06172331896695224
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.6800000000000008
survival_time_min1.6500000000000008