Making your robots.txt unaffected by Drupal core upgrade
Today’s post is a quick tip that will help you keep your robots.txt after you update the site’s Drupal core with drush.
Most likely, you know the problem, too: each time you update the Drupal core (with drush, first of all), you lose all changes you may have introduced to robots.txt manually. A good idea is to always have a backup of this file handy, but every now and then you only have an outdated version of robots.txt and you learn that only when you check the updated site with webmaster tools.