You would just need a computer which can fit 2 3090s in order to run those to run something like TheBloke/airoboros-65B-gpt4-1.3-GPTQ
https://www.reddit.com/r/LocalLLaMA/wiki/models/ gives you a list of VRAM requirements to load the model into GPU VRAM. the more VRAM the computer has, the larger the model you can load in, thus making 3090s the current consumer grade king due to price to max VRAM.
This being said however most models are LLAMA based which all fall under that specific research license.
So following the rules, you would be limited to a subset of models which are foundational models which allow for commercial use
Reddit is nice because with 1,000s of eyes information moves quickly. Discord is nice because when you can't get the quantity of reddit, you can mimic the quantity via discord because the rate of chat goes up enormously due to the nature of being realtime
Also good news was that running olive and downloading the ONNX converter to run stable diffusion shows something like 120% speedup on Nvidia and 50% speedup on AMD from the numbers I see. Some UIs are beginning to support ONNX format. ONNX being the format that has Microsoft's support behind it for AI models to my understanding.
In discord you see a room of people in voice chat which features drop in drop out.
You can them independently drop in and drop out of any text chat room.
The most common way to share text channel based content is to say "hey I'm posting an image in voice chat check it out"
The important part here is making voice the first class primary communication while not prohibiting the use of any text channels because there is no coupling.
Complete independence is better than coupling imo.
Separation can be done with permissions for both a single text and voice channel.
Also as long as someone has access to the voice channel they have access to the video channel of all active live streams.
I wanted to see their viewpoint on at the time "the hot topic" and confirm my suspicions that I truly don't consider their viewpoint rational or valid. It's like they start from a conclusion and work backwards to excuse it.
> It's like they start from a conclusion and work backwards to excuse it.
Almost everything political is like this. What allows you to see the flaw clearly here is your bias is against theirs. It's harder to see this process when you align with the conclusion.
Come on, that subreddit was insane. We should attempt to understand and empathise with people we disagree with, but that doesn’t mean we abandon all intellectual standards. And frankly validating a space like that as a legitimate viewpoint for conservatism is an insult to conservatism and a kind of bigotry of low expectations.
> It's like they start from a conclusion and work backwards to excuse it.
Without getting into any of the politics, isn't this exactly what you said you did in the preceding sentence?
> I wanted to see their viewpoint on at the time "the hot topic" and confirm my suspicions that I truly don't consider their viewpoint rational or valid.
But generally these ideas are immediately discountable by reality. T_D was generally conspiracy theories or even if there is an attempt at some genuine political or economic discussion, its never fact based (or cherry picked/lie through ommision/or presenting a paper thats 50+ years old as if its true in light of new evidence). How can you even give those sorts of opinion credence? If those posts were made in good faith, then those people are ignorant, but that's just giving too much credit.
I love reading foxnews.com and some of my deeply conservative relatives' Facebook feeds, because they give a perspective I'd never see otherwise (even if I generally disagree). I'm on there daily, and I'd say I get just as much news from those sources as from others, like washingtonpost.com. I also sometimes go to some old school conservative blogs like nationalreview.com/corner/, as well as sites like Drudge and Breitbart to see what they think.
But /r/the_donald was just toxic. Even when I was in the mood to see more of that kind of content, I couldn't stand more than about 5 minutes of browsing that subreddit before closing the tab in frustration and disgust.
I really value information and learning how different people think and what's important to them, but it's really hard to do that on forums so I prefer just talking to ppl. Preferably in a non-campaign year to get a less emotional account. Plus it helps me have a more balanced perspective b/c I can put face(s) to different sides and that prevents me from saying things that I can't take back
Honest question: how do you manage to work your way through that stuff without feeling incredibly shitty afterwards? Because whenever I have tried to make sense of them it was genuinely unpleasant for me to "reason along" with people that unreasonable (I'd almost call it painful, but perhaps that's a bit too strong).
I would highly recommend "The Righteous Mind: Why Good People are Divided by Politics and Religion" by Jonathan Haidt. He's a left leaning psychologist, and it's basically a PHD level dive into how morality works at a psychological level, with quite a few dips into cultural anthropology. Once I understood how my own moral systems worked and how very different moral systems function, it helped me avoid these pitfalls of negative emotion blocking my empathy and understanding of other people.
> Unfortunately all I could think of was "that sounds cool but I'd want to stick to dash instead of bash"
Well, POSIX sh, ideally. That way you get free portability to ~everything; it's not a great burden to install bash or dash on ex. NetBSD or AIX, but sh is as close to universally preinstalled as you're going to get.
> Also didn't realize it wasn't agentless which is pretty critical imo
https://www.reddit.com/r/LocalLLaMA/wiki/models/ gives you a list of VRAM requirements to load the model into GPU VRAM. the more VRAM the computer has, the larger the model you can load in, thus making 3090s the current consumer grade king due to price to max VRAM.
This being said however most models are LLAMA based which all fall under that specific research license.
So following the rules, you would be limited to a subset of models which are foundational models which allow for commercial use