Yea the broadcaster is what I am thinking of for pushing out info automatically once info comes in. With the amount of data constantly coming in, it will need to be specifically allowed for certain criteria. I have a couple of things in mind to start with from the main board and will probably use telegram first since I'm not on socials. Once I have my specific use cases down, I'll think about some other options to push out info.
I just did a bunch of work over the past 2 weeks on the archive system. I had it on an old laptop that started giving me a lot of problems so I started working on an update. I dockerized it so its self-contained, easily portable and can run almost anywhere, installed Tor in the image, configured the code to run over Tor and upgraded the MongoDB version and also upgraded the hard drive. I also found an issue where I wasn't saving all the linked content. In the API there are 'extra_files' that could have additional files and I was only saving the main file on each reply. After that update its looking like Im getting ~30% more data per day now.
I could push this out and anyone could build the docker image and start running this with an old computer (I'm tempted to try on a raspberry pi) and start their own archiving service with searchable database within minutes.