Anonymous ID: 8143cc Feb. 26, 2018, 11:24 a.m. No.502752   🗄️.is 🔗kun

>>502660

>>>502453

>

>>Research Threads Ideas. Please claim or create yours, let us know of more subject ideas

>

>>Quest for Research Searchability Thread

>

>>>494745 (You) (You)

>

>Thanks for including my thread. I'm not a coder so I'm not much more than a cheerleader. I am quite sincere in my belief that we have to make it all searchable. I'm not naive enough to expect a volunteer to tackle it. Without doxxing themselves, can any anon point me to a service or company that could accomplish this Quest?

Anonymous ID: 8143cc Feb. 26, 2018, 11:27 a.m. No.502773   🗄️.is 🔗kun   >>2802 >>2951 >>3685 >>2910

>>502660

 

>>494745 (You) (You)

 

Thanks for including my thread. I'm not a coder so I'm not much more than a cheerleader. I am quite sincere in my belief that we have to make it all searchable. I'm not naive enough to expect a volunteer to tackle it. Without doxxing themselves, can any anon point me to a service or company that could accomplish this Quest?

Anonymous ID: 8143cc Feb. 26, 2018, 2:42 p.m. No.503938   🗄️.is 🔗kun

>>503685

That's a good suggestion. Do you know off the top of your head how many archive sites have been used at 4ch and 8ch? I know about archive.is and 4plebs, but I've seen a lot more. I'm pretty sure the threads are scattered about the internet.

Anonymous ID: 8143cc Feb. 26, 2018, 5:16 p.m. No.505196   🗄️.is 🔗kun

>>505181

> excised from threads and posted in these subs?

Sorry, didn't finish my thought, and they might not be captured in a search of posts in Qresearch? Not sure why you posted these.

Anonymous ID: 8143cc Feb. 27, 2018, 5:47 a.m. No.509646   🗄️.is 🔗kun   >>0581 >>9706 >>4543 >>1528

>>503685

>person running the 4plebs archive be a good place to look for tools/code in this quest?

 

For the archives 4plebs uses sphinx search (http:// sphinxsearch.com/). It's used to index from the database and display search results very quickly.

Easy to implement but I would say it's worth it only if you have a lot of data to search through. For smaller datasets you can use full text search included in a regular database engine.

Also you can take a look at other search engines like Solr (http:// lucene.apache.org/solr/) and elasticsearch (https:// www.elastic.co/)

Anonymous ID: 8143cc March 3, 2018, 6:25 a.m. No.538775   🗄️.is 🔗kun

>>524543

>There are over 750,000 total posts from both sites and all boards containing Q related posts.

Yes, and that's the challenge. Making the Q "related" post searchable. Making Q's posts searchable is arguably not as important as making the body of related posts searchable as that's where the body of knowledge resides.

"You have more than you know" taunts us with its promise. We get pointed to Loop Capital, or Stanislav Lunev. We need to be able to search/aggregate all of the posts over weeks/months with a single search. The dedicated research threads are great as far as they go but we're missing a lot of other info posted as snippets.

Anonymous ID: 8143cc March 3, 2018, 6:29 a.m. No.538787   🗄️.is 🔗kun

>>530994

>few of the images uploaded into the threads are obscene.

That does complicate it, but a lot of the information in the Q "related" posts is graphic. It seems culling of obscene content would need to be done manually to avoid throwing the baby out with the bathwater.