Robots.txt file is the one of the most important thing to take care of if you are performing SEO of your wordpress website or blog. Robots.txt file is a text based file which helps you to decide which part of your website you want to be crawlable by search engine […]