

I think I should have been more clear, this is exactly what I’m asking about. I’m somewhat surprised by the reaction this post got, this seems like a very normal thing to want to host.
Doesn’t help that some people here are replying as if I was asking to locally host the “trick” that is feeding a chatbot text and asking it whether it’s machine-generated. Ideally the software I think I’m looking for would be something that has a bank of LLM models and can kind of do some sort of statistical magic to see how likely a block of tokens is to be generated by them. Would probably need to have quantized models just to make it run at a reasonable speed. So it would, for example, feed the first x tokens in, take stock of how the probability table looks for the next token, compare it to the actual next token in the block, and so on.
Maybe this is already a thing and I just don’t know the jargon for it. I’m pretty sure I’m more informed about how these transformer algorithms work than the average user of them, but only just.





Few years ago, people literally had to rob the bank for their own money here. Thing was, when you went to the bank and you asked for your money and they didn’t give it to you, they were technically breaking the law, and you brandishing a weapon to while asking for something that is legally yours is not a particular crime. The thought of threatening a bank employee whose job was to be a verbal punching bag for an evil financial system wasn’t appealing to many people, and most people didn’t have enough in there for it to be worth it, so it wasn’t as common as the media made it out to be.
A lot of “robbers” used obviously fake “weapons” and that did work - while also giving plausible deniability towards the law (“I didn’t really make a threat”) and for the employee (“I was being threatened and complied” without actually being in danger).
You’d think our sordid history with capitalism would instill a lesson or two in our society but vapid “entrepreneur” culture and socio-economic pick-me-ism are at an all time high here and every day I am drawn more to the mountain hermit life and this is not a joke.