Blog

Feed Informer now complies with robots.txt rules

In order to retrieve up-to-date data from web feeds, our software engine (“crawler”), periodically revisits publicly available feeds.

Today we officially announce that our crawler now complies with Robots Exclusion Protocol, so, as a webmaster, you can block access to your feeds using appropriate robots.txt instructions.

We have modified our Terms of Service accordingly, the section Feed Crawler has been added.