.Google.com limits robots.txt assistance to four fields, clarifying its stance on in need of support regulations.Google just supports 4 certain robots.txt areas.In need of support regulations in robots.txt will certainly be actually ignored.Think about auditing your robots.txt documents because of this improve.