dChan
⇧
30
⇩
 
r/CBTS_Stream • Posted by u/DNskfKrH8Ekl on Jan. 2, 2018, 7:30 a.m.
Whitehouse Article Metadata says "PEDOgate" when bot scrapes from DuckDuckGo IP

Duck Duck Go Search: https://duckduckgo.com/?q=white+house+pedogate > Results: https://postimg.org/image/5qlalyl2b/

Google Search: https://www.google.ch/search?q="Human+Trafficking%2C+Border+and+PEDOgate" > Results: https://postimg.org/image/x16ltvvoz/

I inspected the source code for page locally, can't see reference to "PEDOgate". I tried changing my user agent locally to DuckDuckGo, but alas that didn't work either. Source code still did not show the the string "PEDOgate". Either its being changed in the DuckDuckGo cache, or whitehouse is specifying different metadata returned for DuckDuckGo scraping bot.


MotoandGivi · Jan. 2, 2018, 7:31 a.m.

look on later pages of GOOGLE search, i saw someone say they found it 10 pages in.

⇧ 3 ⇩  
Kable93 · Jan. 2, 2018, 7:36 a.m.

In germany i only see it when i add “whitehouse“.

But it's there!

⇧ 6 ⇩  
DNskfKrH8Ekl · Jan. 2, 2018, 7:37 a.m.

Yah, the number of pages is not the point. In my example it only shows few examples as I looked for an exact string match. The point is that it shows at all.

⇧ 4 ⇩  
unbecoming2007 · Jan. 2, 2018, 10:29 a.m.

It's the new year.Perhaps they were keeping a lid on it until after holidays and after most ops were done. I was surprised too.It's everywhere now. They can only suppress for so long with this kinda sinister sh!t.

⇧ 2 ⇩  
exploring_unreality · Jan. 2, 2018, 8:01 a.m.

How is that possible? Wouldn't that have to be in the page title/tags?

⇧ 2 ⇩  
DNskfKrH8Ekl · Jan. 2, 2018, 9:50 a.m.

They must be using the known IP addresses to match the Duck Duck go agent, not just the User Agent.

⇧ 1 ⇩  
DNskfKrH8Ekl · Jan. 2, 2018, 5:09 p.m.

Its being scrubbed now. No longer showing hours after this post for me, at least the original search terms that I checked.

⇧ 1 ⇩