Somebody posted this a long time ago
I don't use wget to harvest memes, since part of what I do is categorizing them for access by giving them human-readable filenames.
Cop yourselves some D A N K M E M E S
Use wget to download all images in a thread
wget -P [download-folder] -nd -r -l 1 -H -D media.8ch.net -A png,gif,jpg,jpeg,webm,mp4 [thread-url]
Example (Download all memes from Memes34 thread):
wget -P /home/anon/memes/ -nd -r -l 1 -H -D media.8ch.net -A png,gif,jpg,jpeg,webm,mp4 https://8ch.net/qresearch/res/3690162.html
Build your arsenal and take to Twatter!
Post last edited at 11/06/18 (Tue) 01:57:34
——————————
and here's a nother, that I haven't tried.
wget is a bitch. Too many weird options that interact with one another, producing unpredictable results. At least that's what I observed when using wget to scrape another website.
this archives on a per bread basis, i couldn't get the -m option to work in a way that kept the links straight, could use suggestions.
muhshellprompt% wget -k -nH -p -np -H -e robots=off -I stylesheets,static,js,file_store,file_dl,qresearch,res -U "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.6) Gecko/20070802 SeaMonkey/1.1.4" –wait=5 –random-wait –no-check-certificate http://8ch.net/qresearch/res/1272773.html
then install recoll and let it index ur bread repository, total searchability.