24 04, 2017

Goodbye Robots

By | 2017-04-24T15:08:28+00:00 April 24th, 2017|Technology|0 Comments

Decided to stop including robots.txt in my WordPress sites for the time being. With Google presenting fully rendered pages in search results I prefer not blocking those webcrawlers and preventing them from finding required css and js files. The smart people at Yoast wrote up a good article explaining in more detail.