.Google limits robots.txt help to four fields, clarifying its standpoint on unsupported regulations.Google only assists four specific robots.txt areas.Unsupported ordinances in robots.txt will definitely be disregarded.Take into consideration bookkeeping your robots.txt files in light of this improve.