ChatGPT suffered a worldwide outage from 06:36 UTC Tuesday morning. The servers weren’t totally down, but queries kept returning errors. OpenAI finally got it mostly fixed later in the day. [OpenAI…
So firstly, shut up, nerd. You’ve clearly never worked a corporate job and don’t understand the compulsion to in-house nothing.
I WISH. Would have saved so much headache from rolling our own framework for the millionth time instead of using standard solution that already exists… Tell me you’ve never worked in corporate software without telling me you’ve never worked in corporate software.
Secondly, approximately 0.0% of chatbot users will ever run an LLM at home.
Wut. Individual models on huggingface have monthly downloads in the hundreds of thousands… Just Deepseek R1 was downloaded 550,000 times in the last month alone. Gemma 3n was downloaded over 120,000 times in the last 7 days.
Thirdly, it’s slow as hell even on a top-end home Nvidia card — and the data centre cards are expensive.
They literally run well on mobile phones and laptops lol.
The author is desperately grasping at straws at best, intentionally making up false claims at worst… either way, they aren’t qualified to write on this subject.
4GB card can run smol models, bigger ones require an nvidia and lots of system RAM, and performance will be proportionally worse by VRAM / DRAM usage balance.
Not only that, but the “They spent $2 for every $1”…
Yeah, that doesn’t account for the $20/hr middle management job that they don’t have to pay for another 5 meetings this week with a poor powerpoint presentation. Of course they’re spending to make their company as competitive as possible. And sure, AI hallucinates, but have you seen MAGA fanatics? I’ve seen a 1b parameter model hallucinate less than that. And they have jobs – and VOTE…
Yeah, screw this guy. I came across him on YT. He goes out of his way to paint all AI as if it were an ineffectual, hype-only, resource hog with absolutely no redeeming qualities being foisted on us by EvilCorps everywhere who are simultaneously too dumb to know that it’s a farce.
What told me he was just going for eyeballs (gotta admit, his marketing is good! I see this mofo everywhere these days) was a YT post about a grift — that predates AI — which used AI and he blamed AI for the grift! Not the human, but the technology.
I WISH. Would have saved so much headache from rolling our own framework for the millionth time instead of using standard solution that already exists… Tell me you’ve never worked in corporate software without telling me you’ve never worked in corporate software.
Wut. Individual models on huggingface have monthly downloads in the hundreds of thousands… Just Deepseek R1 was downloaded 550,000 times in the last month alone. Gemma 3n was downloaded over 120,000 times in the last 7 days.
They literally run well on mobile phones and laptops lol.
The author is desperately grasping at straws at best, intentionally making up false claims at worst… either way, they aren’t qualified to write on this subject.
LocalLMs run pretty good on a 12GB RTX 2060. They’re pretty cheap, if a bit rare now.
So 12GB is what you need?
Asking because my 4GB card clearly doesn’t cut it 🙍🏼♀️
4GB card can run smol models, bigger ones require an nvidia and lots of system RAM, and performance will be proportionally worse by VRAM / DRAM usage balance.
Big models work great on macbooks or AMD GPUs or AMD APUs with unified memory
Not only that, but the “They spent $2 for every $1”…
Yeah, that doesn’t account for the $20/hr middle management job that they don’t have to pay for another 5 meetings this week with a poor powerpoint presentation. Of course they’re spending to make their company as competitive as possible. And sure, AI hallucinates, but have you seen MAGA fanatics? I’ve seen a 1b parameter model hallucinate less than that. And they have jobs – and VOTE…
Yeah, screw this guy. I came across him on YT. He goes out of his way to paint all AI as if it were an ineffectual, hype-only, resource hog with absolutely no redeeming qualities being foisted on us by EvilCorps everywhere who are simultaneously too dumb to know that it’s a farce.
What told me he was just going for eyeballs (gotta admit, his marketing is good! I see this mofo everywhere these days) was a YT post about a grift — that predates AI — which used AI and he blamed AI for the grift! Not the human, but the technology.
deleted by creator