305 ： 名無し編集部員 [sage] ： 2014/03/13 (水) 12:58:56 ID: gjTm2MLv

I think that obvious crawler should be denied at htaccess level,
for servers health. such as this. (sakura.ne.jp is the rental server
company)

http://bbon.geo.jp/HOST=www7345uf.sakura.ne.jp

318 ： 名無し編集部員 [sage] ： 2014/03/13 (水) 14:14:13 ID: gjTm2MLv

>>312
hmmm...I see. There are lots of "sakura.ne.jp" BBONed.
This one is also a legitimate crawler?
http://bbon.geo.jp/HOST=2078.sakura.ne.jp