I've published a website and, due to a misunderstanding not depending on me, I had to block all the pages before indexing. Some of these pages had been already linked on social networks, so to avoid a bad user-experience I've decided to insert the following code into "robots.txt"
I've received a "critical problem" alert on webmaster tools and I'm a bit worried about it. In your experience, would it be sufficient (whenever possible) to restore the original "robots.txt"? May the current situation leave consequences (penalizations or similar) on the website if it lasts for long time (and if it does, how can I fix it)?. I'm sorry if the question may sound a bit generic, but I'm not able to find specific answers. Thanks in advance.
Best How To :
The "critical problem" occurs because Google cannot index pages on your site with your robots.txt configuration. If you're still developing the site, it is standard procedure to have this robots.txt configuration. Webmaster tools treats your site as if it was in production however it sounds like you are still developing so this is something of a false-positive error message in this case.
Having this robots.txt configuration has no long-term negative effects for search engine ranking, however the longer that search engines are able to access your site the better the ranking will be. For Google it's something like 3 months of stable crawling will earn it some kind of trusted status. So it really depends on the domain and whether or not it has been previously indexed by Google and for how long, but there would still be no long-term consequences at the very most you will have to wait another 3 months to "earn Google's trust" again.
Most social networks will read the robots.txt file as and when the user shares, search engines on the other hand vary in their indexing rate and will take anything from a few hours to a couple of weeks to detect changes in your robots.txt file and update the index.
Hope this helps, if you can provide more details about your circumstances I may be able to help further, but this should at least answer your question.