Codefag #1

This is a thread where codefags can gather and collaborate on projects, provide updates on things like CSS and user.js, or discuss new ideas and solutions to old problems. Codefags in The GreatAwakening don't endorse #qanoning anyone's IPs. There's a 600 char restriction in order to create a new bread, so I apologize for this becoming wordy.

I have no idea if this bread will even fill to 751. There have been a few other codefag breads that can be found in the archives, and they ended up sliding off the catalog, so who knows.

NOT ENDORSEMENTS

Review code before using

>>7672772 bakertools v0.4.0 RELEASED https://pastebin.com/i9sF0Rd3

>>5223217 NopeScript https://pastebin.com/WjzNqPDC

What are you working on or thinking about?

>>>qrb/15636 QRB Codefags : Moar user.js

Back in >>7762363 (PB) Anon had suggested a 'preview before posting' concept and it seemed to me that it could be done in JS, using the current hover code in main.js. If we added some 'preview' buttons to the reply windows, and called the hover code it wouldn't be too bad.

I also have been thinking about a (PB) script. Seems like it wouldn't be too hard to do in JS either. I see a lot of anons post about wanting it. I've got some time today to see if I can hack something together on it.

This custom user.js script will add a green (PB) to all referenced posts that are not in the current bread.

Read thru the code before using.

Linkerizer v1

https://pastebin.com/RkJWAcSF

https://pastebin.com/RkJWAcSF

>Build timeline

If we had a single timeline of events populated from data in a bun, it would be simpler to understand and tell the whole story of what's been dug.

So I got this idea I've been thinking about, but I don't know if I could do it by myself. codefags++

It's a collaborative timeline of everything that we as anons have voted on. The idea is that it's agreed upon by everyanon here. I think it can be done completely on 8kun using js to display and an active anon/BO controlled board / thread.

Here's the idea.

Everything is now archivable to the blockchain for verification. Every thread here is available as JSON data. Timeline.js makes it easy to make timelines https://timeline.knightlab.com/.

Make a locked Timeline and an unlocked Timeline BunVote series of breads, committing all to Susucoin. Run it like a congress and vote on each datetime bun on the timeline. Each is a confirmed datetime/PostID then posted in the Timeline thread. If the Timeline thread is locked and pruned, then the JSON data available for that thread can be used to populate the data needed for Timeline.js. We could possibly jigger up a user.js/timeline.js that can be used here to display. Possibly need BO's help to get that to go.

Commit all to Susucoin

[Timeline Bun++ or QR post]

Anons submit their bun containing any data they want committed to the timeline.

[Timeline Bun Vote++] Thread for each day. Baker leads the votes with limited time for each vote.

Anons place their votes on each.

[Timeline++] Locked

Bun Post by BO Referencing the PostId of the Bun contained in the BunVote.

Thats all I got.

>Build timeline

If we had a single timeline of events populated from data in a bun, it would be simpler to understand and tell the whole story of what's been dug.

So I got this idea I've been thinking about, but I don't know if I could do it by myself.

It's a collaborative timeline of everything that we as anons have voted on. The idea is that it's agreed upon by everyanon here. I think it can be done completely on 8kun using js to display and an active anon/BO controlled board / thread.

Here's the idea.

Everything is now archivable to the blockchain for verification. Every thread here is available as JSON data. Timeline.js makes it easy to make timelines https://timeline.knightlab.com/.

Make a locked Timeline and an unlocked TimelineVote series of breads, committing all to Susucoin. Run it like a congress and vote on each datetime bun on the timeline. Each is a confirmed datetime/PostID then posted in the Timeline thread. If the Timeline thread is locked and pruned, then the JSON data available for that thread can be used to populate the data needed for Timeline.js. We could possibly jigger up a user.js/timeline.js that can be used here to display. Possibly need BO's help to get that to go.

>Build timeline

If we had a single timeline of events populated from data in a bun, it would be simpler to understand and tell the whole story of what's been dug.

So I got this idea I've been thinking about, but I don't know if I could do it by myself.

It's a collaborative timeline of everything that we as anons have voted on. The idea is that it's agreed upon by everyanon here. I think it can be done completely on 8kun using js to display and an active anon/BO controlled board / thread.

>Build timeline

If we had a single timeline of events populated from data in a bun, it would be simpler to understand and tell the whole story of what's been dug.

So I got this idea I've been thinking about, but I don't know if I could do it by myself.

It's a collaborative timeline of everything that we as anons have voted on. The idea is that it's agreed upon by everyanon here. I think it can be done completely on 8kun using js to display and an active anon/BO controlled board / thread.

Here's the idea.

Make a locked Timeline and an unlocked Timeline BunVote series of breads, committing all to Susucoin. Run it like a congress and vote on each datetime bun on the timeline. Each is a confirmed datetime/PostID then posted in the Timeline thread. If the Timeline thread is locked and pruned, then the JSON data available for that thread can be used to populate the data needed for Timeline.js. We could possibly jigger up a user.js/timeline.js that can be used here to display. https://timeline.knightlab.com/.

Maybe I'll just spam the fuck out of it sorry. Let it be known I have discovered that if you overshoot the 500 char limit on archiving when shitposting, it posts anyways, just not to susucoin.

>>7829888

Sparkely doesn't work on projectdcomms because it's a custom css BO added. AFAIK that only works on QR.

Try this.

>>7356017 (PB)

>>7831672

>If someone out there knows where all the q trips are and their timelines i could make the q highlighter smarter by knowing the exactly date ranges specific trips were used

I can probably get that. Lemme check

>>7832225

o7

>>7831672

This is from my archive.

!ITPb.qbhqo — First Seen:2017-11-10 04:07:15Z — Last Seen:2017-12-15 06:04:43Z — Count: 223

!UW.yye1fxo — First Seen:2017-12-15 06:04:06Z — Last Seen:2018-03-24 13:09:02Z — Count: 583

!xowAT4Z3VQ — First Seen:2018-03-24 13:09:37Z — Last Seen:2018-05-04 20:02:22Z — Count: 351

!2jsTvXXmXs — First Seen:2018-05-04 20:01:19Z — Last Seen:2018-05-08 23:46:39Z — Count: 9

!4pRcUA0lBE — First Seen:2018-05-08 23:47:17Z — Last Seen:2018-05-19 22:06:20Z — Count: 94

!CbboFOtcZs — First Seen:2018-05-19 22:07:06Z — Last Seen:2018-08-05 20:12:52Z — Count: 399

!A6yxsPKia. — First Seen:2018-08-05 20:14:24Z — Last Seen:2018-08-10 18:24:24Z — Count: 16

!!mG7VJxZNCI — First Seen:2018-08-10 18:26:08Z — Last Seen:2019-11-25 22:35:45Z — Count: 1799

!!Hs1Jq13jV6 — First Seen:2019-12-02 17:55:59Z — Last Seen:2019-12-29 18:06:19Z — Count: 136

>>7832665

5:5

>>7837776

>>7835684

Speaking of Python. I wonder if we can do anything with this?

https://github.com/bdheath/Big-Cases

>>7852871

Thanks for all you do archiveanon!

Have you been archiving JSON? My archive has #365+ and I managed to get some from CBTS before that board got nuked.

I looked into elasticsearch and discovered that I just wasn't going to be able to run it on my host in a cost effective manner. I have been playing around with a Lucene search component, but have been sidetracked working on other stuff.

I've got the notables all parsed out into their own threads and started working on a way to do the same thing.

>>7855083

>Were you trying to run elasticsearch in a multi node cluster?

Elasticsearch requires console access to install the service. I'm on shared hosting and so didn't have console access.

I settled in on this since I'm a C# codefag.

https://lucenenet.apache.org/

A searchable meme database would be hella handy. I wonder if you could use some of the MEGA.nz archives somehow. https://docs.mega.nz/sdk/doc/api.html

>>7855303

>would require massive server capacity to run text recognition

I don't know. Depends on what you are using or how you are doing it. The OCR stuff I do at work, we just send an image into the machine and it returns it's results. Sometimes it works, sometimes it doesn't. OCR is a difficult tech to master, it's one of the reasons why we use them - because their tech can't read memes theoretically. It's the context of the meme that makes it difficult to read. It's an interesting idea though. Agree on the textless memes unless the machine had a way of contextualizing the image itself, but seems prone to error. IE: AOC head on bewbs.jpg.

>>7855424

The stuff we use is all bolted onto a large commercial engine. There's alot of stuff on github if you dig around there. Tesseract looks pretty good/active

https://github.com/tesseract-ocr/

>>7855549

Training is KEY. I'm personally averse to doing a bunch of work for the Cabalamazon, although I'm sure they can read simple text in a meme already. It would be worth a few test runs just to see how it worked.

>>7898255

Great work anon!

I wrote some code to gather up all the filenames that Q has posted, and then search all the Q drops for the text of each of those file names.

This is a visualization of the matches of filenames Q posts in a handy expandable zoomable format. Hover to see text of the drop.

Still working out the kinks.

Analysis of Q image filenames and post text

>https://qanon.news/Analytics/FileNameMap

>>8076170

Thx. Ya, I like it. Lots of examples and tons you can do. There seems to be a click event wired up wrong or something. Clicking on the Drop node causes it to redraw the line. Ima try to get some links on there for the drops next.

>>8079346

Look interesting! Broadcaster component is the link to the socials? I'd like to hear more about it. Mine is similar design, but I've been thinking about doing a a rebuild in .NET Core. Currently testing and making up my mind if I want to do that or just let it run and do something new.

Archiveanon! You and I started up about the same time. I think 'member your scrape DB.

>>8088753

Know exactly what you are talking about on the extra_files. I missed those for a long time too. Targeting a Raspberry Pi sounds interesting too.

>>8121498

Not QMapAnon. Are you talking about archiving breads?

>>8149364

You may not have seen this. Had to repost for you

>>8149187 (PB)

Decided to go ahead and rework some of the backend of the scrape machine. I fell victim to some poor file layout choices when first building out the archive in the beginning and now it's getting to where it's causing performance problems. All the file assets will now have their own (sub)folders and it will make backups and restores alot easier in the future. Once I can get this finished off I think I may rebuild my Q posts page with some different tech, or go back to building out a search engine, maybe finish off the notable scraper. If only I wasn't so ADD I could get so much more done.

>>8310146

>>8128395 Memes53

Allright - lets get a status report. What's everybody working on?

I wrote an app to posts memes + hashtags on Twatter using the API. Pretty sure it's gotten me deboosted but I'm 100% sure it doesn't violate any of their terms. It's step 1 in a new project I'm thinking about.