.Google.com limits robots.txt support to four industries, clarifying its viewpoint on unsupported instructions.Google only sustains 4 details robots.txt areas.In need of support instructions in robots.txt will certainly be actually ignored.Look at auditing your robots.txt files taking into account this upgrade.