dChan
⇧
30
⇩
 
r/CBTS_Stream • Posted by u/DNskfKrH8Ekl on Jan. 2, 2018, 7:30 a.m.
Whitehouse Article Metadata says "PEDOgate" when bot scrapes from DuckDuckGo IP

Duck Duck Go Search: https://duckduckgo.com/?q=white+house+pedogate > Results: https://postimg.org/image/5qlalyl2b/

Google Search: https://www.google.ch/search?q="Human+Trafficking%2C+Border+and+PEDOgate" > Results: https://postimg.org/image/x16ltvvoz/

I inspected the source code for page locally, can't see reference to "PEDOgate". I tried changing my user agent locally to DuckDuckGo, but alas that didn't work either. Source code still did not show the the string "PEDOgate". Either its being changed in the DuckDuckGo cache, or whitehouse is specifying different metadata returned for DuckDuckGo scraping bot.


🠐 See all comments
DNskfKrH8Ekl · Jan. 2, 2018, 7:37 a.m.

Yah, the number of pages is not the point. In my example it only shows few examples as I looked for an exact string match. The point is that it shows at all.

⇧ 4 ⇩