Why is not recognized robots.txt Google?

In General, decided to do the optimization of the site, went to google tools for webmasters, showed error in robots.txt. The website is on WordPress, the file is converted "on the fly". When you hover over the red dot shows "/ufeff". I understand google wants robots.txt was in utf-8 w/o BOM. A website on a dedicated server under CentOS. To create a file robots.txt "handles" is an extreme measure, I want to work "regular". Anyone have any ideas?
12d714c4054944709f0966b35ea67887.png
September 19th 19 at 00:23
3 answers
September 19th 19 at 00:25
Well, you fix the script generator.
September 19th 19 at 00:27
And the button "read More" what's it say ?
September 19th 19 at 00:29
And what is there in front of the User-agent can't see...?
Red dot. When you hover over it says "/ufeff". The problem is encoding. But hell, how and where to change it, if robots.txt is created on the fly. In the file that generates the prescribed encoding is UTF-8 - Francisca_Denesik commented on September 19th 19 at 00:32
Look at the code of the server response on the file. Does the charset encoding of the document, what response code the server last modified? - johnpaul_Huels commented on September 19th 19 at 00:35

Find more questions by tags robots.txtGoogle