Now before you shoot me, hear me out. I have an incredibly scattered brain and it can be hard for me to put scattered ideas and constraints together in my projects, and I kind of just have to walk around while ranting. Problem: no-one would ever wanna listen to that. And while it helps me organize things in my head slightly, I still have to do it multiple times over before I can start writing down something useful, and I can't stop until I do. This can often keep my up and make it difficult to sleep. If only I could have someone who would listen to my half schizophrenic ramblings and then work through how it all fits together and summarize it all for me and maybe point out some mistakes...
RIGHT!! Maybe no humans wants to listen to me, but I sure can have an abusive relationship with the sand in my computer that TSMC forced to think and force it to think even more and worse, listen to me.
I present to you, Speech to Text which I then let an LLM analyze, all running locally through alpaca. (shout out to alpaca) Although I didn't get the built-in dictation, so audacity and importing the resulting mp3 files works for now.
I had this rambling about the protocol I'm working on where the routing servers wouldn't wanna store some proof, because it's just really big and would increase barrier of entry for someone to host it. So I kind of had a solution in my head, but I needed to do my rant about it first, a few times over, but I had an idea, why not let an LLM help me with that? So I did. And instead of having to dwell over it the entire night, in 10 minutes I had a way better grasp over the situation and could immediately go back to updating the protocol specification and code.
What would've been a massive roadblock for me mentally, dissolved in just about 10 minutes. All with smaller LLM + speech to text models that can almost run in real time on my computer on 100% renewable energy. No massive server farms running on coked up techno-dictators uranium fuel rods.
Hold up, one might say, you forgot about the training of said models, and to that I say, you might be right. but uhhhhh, you know what, I could download it for free legally and it helped me a lot. Maybe it can help other people as well.
That's all for now chat, please take care, goodnight internet.