Skip Navigation

User banner
nagaram @ nagaram @startrek.website
Posts
7
Comments
135
Joined
2 yr. ago

  • Removed

    AI in Education: Doomed?

    Jump

  • A few months ago now, Arizona? Arkansas maybe? Some state legalized "AI powered" home schooling systems. But it was mostly clickbait and the system is less like ChatGPT and more like the YouTube Algorithm machine learning. It takes into account the stuff that students do well at and let's them advance beyond "grade level" limitations while also learning how to present problem areas in ways the student responds to.

    I had asked my home schooled AI researcher buddy his thoughts and he obviously liked it. I like the idea too, but my hang up was on socializing kids. That to me is the more important role of schools.

    I wouldn't trust an LLM in this set up though. A human tutor would still need to step in for questions outside of a FAQ IMO. I love working with an LLM by giving it all the manuals, guides, and config files I used then asking where I went wrong because it can usually give me a good enough interpretation to see where to go next. But that's just a rubber duck. My mind and skills are developed. A kid learning math for Tue first time can't do that.

  • "Very dramatic shift" - Linus Tech Tips opens up about the channel's declining viewership

    Jump

  • As a floatplane subscriber, you're really not missing much. I don't even watch most of the exclusives.

  • "Very dramatic shift" - Linus Tech Tips opens up about the channel's declining viewership

    Jump

  • Oh the rossman video.

    I hate how obsessed on dumb shit he gets. The man is legitimately doing great work usually, and then he takes something minor that an otherwise ally says or does and blows it out of proportion.

    This man would have made a great tankie. Unfortunately he made a whole 20 minute video on why AOC is stupid for saying unskilled labor doesn't exist and then explaining exactly the points she was making.

    I legitimately love this mans work and I wanna support him, but man is he petty.

  • Smallest modem I can put into bridge mode and feed into a router?

    Jump

  • I'm mad you started your citation at 0.

    I'm telling Chicago style!

  • New To linux- Memes

    Jump

  • A Microsoft glazing botnet leveraging copilot and all of r/linuxsucks training data to shitpost on Lemmy made by a developer who took a Janatorial job at Microsoft to "get his foot in the door" during an internal hackathon he was accidentally invited to.

  • 1U mini PC for AI?

    Jump

  • From what I understand its not as fast as a consumer Nvdia card but but close.

    And you can have much more "Vram" because they do unified memory. I think the max is 75% of total system memory goes to the GPU. So a top spec Mac mini M4 Pro with 48GB of Ram would have 32gb dedicated to GPU/NPU tasks for $2000

    Compare that to JUST a 5090 32GB for $2000 MSRP and its pretty compelling.

    $200 and its the 64GB model with 2x 4090's amounts of Vram.

    Its certainly better than the AMD AI experience and its the best price for getting into AI stuff so says nerds with more money and experience than me.

  • 1U mini PC for AI?

    Jump

  • From what I understand its not as fast as a consumer Nvdia card but but close.

    And you can have much more "Vram" because they do unified memory. I think the max is 75% of total system memory goes to the GPU. So a top spec Mac mini M4 Pro with 48GB of Ram would have 32gb dedicated to GPU/NPU tasks for $2000

    Compare that to JUST a 5090 32GB for $2000 MSRP and its pretty compelling.

    $200 and its the 64GB model with 2x 4090's amounts of Vram.

    Its certainly better than the AMD AI experience and its the best price for getting into AI stuff so says nerds with more money and experience than me.

  • Alternative to github for hosting portfolio pieces, personal projects, etc. ?

    Jump

  • Funny domain names for hosting code is why godaddy exists.

    I'm excited to submit my future CS assignments with

    Ihatecode.com

  • 1U mini PC for AI?

    Jump

  • Honestly if you're not gaming or playing with new hardware, there is absolutely no point.

    I've considered swapping this computer over to Fedora for a hot minute, but it really is a gaming PC and I should stop trying to break it.

  • 1U mini PC for AI?

    Jump

  • True, but I have an addiction and that's buying stuff to cope with all the drawbacks of late stage capitalism.

    I am but a consumer who must be given reasons to consume.

  • 1U mini PC for AI?

    Jump

  • The Lenovo Thinkcentre M715q were $400 total after upgrades. I fortunately had 3 32 GB kits of ram from my work's e-waste bin but if I had to add those it would probably be $550 ish The rack was $120 from 52pi I bought 2 extra 10in shelves for $25 each the Pi cluster rack was also $50 (shit I thought it was $20. Not worth) Patch Panel was $20 There's a UPS that was $80 And the switch was $80

    So in total I spent $800 on this set up

    To fully replicate from scratch you would need to spend $160 on raspberry pis and probably $20 on cables

    So $1000 theoratically

  • Am I the only person who likes removal of evil races?

    Jump

  • Gonna write my short story about the orc barbarians who destroy human colonies that get too close to orc territory, not because they're inherently evil, but because they've seen what human greed for power and domination does to subjugated races, the flow of magic, and the health of the earth. So they view humans as evil.

    "Your kind knows nothing but exploitation! You drain the lands of their nutrients to feed cities of sycophants until they are fat! Tell me, adventurer, when was the last time you heard of a dragon attacking an orc caravan? We have no fear of such beings as they only attack the depraved greed of man."

    "Attacked the village? Do your handlers even lie to hired blades? Yes we burned the village you call Argath, but no one was harmed. Humans, as dangerous as you are, are still cowards. Surrounding a mining village and telling them to leave when they're outnumbered ten to one is hardly, what you would call, a negotiation. We sent hunters to escort them out of the mountains of Gri'ut Kar and burned the village to ensure the trek was one way."

  • 1U mini PC for AI?

    Jump

  • The PIs were honestly because I had them.

    I think I'd rather use them for something else like robotics or a Birdnet pi.

    But the pi rack was like $20 and hilarious.

    The objectively correct answer for more compute is more mini PCs though. And I'm really thinking about the Mac Mini option for AI.

  • 1U mini PC for AI?

    Jump

  • Ollama and all that runs on it its just the firewall rules and opening it up to my network that's the issue.

    I cannot get ufw, iptables, or anything like that running on it. So I usually just ssh into the PC and do a CLI only interaction. Which is mostly fine.

    I want to use OpenWebUI so I can feed it notes and books as context, but I need the API which isn't open on my network.

  • 1U mini PC for AI?

    Jump

  • I was thinking about that now that I have Mac Minis on the mind. I might even just set a mac mini on top next to the modem.

  • 1U mini PC for AI?

    Jump

  • Ollama + Gemma/Deepseek is a great start. I have only ran AI on my AMD 6600XT and that wasn't great and everything that I know is that AMD is fine for gaming AI tasks these days and not really LLM or Gen AI tasks.

    A RTX 3060 12gb is the easiest and best self hosted option in my opinion. New for <$300 and used even less. However, I was running with a Geforce 1660 ti for a while and thats <$100

  • 1U mini PC for AI?

    Jump

  • A mac is a very funny and objectively correct option

  • 1U mini PC for AI?

    Jump

  • I think I'm going to have a harder time fitting a threadripper in my 10 inch rack than I am getting any GPU in there.

  • 1U mini PC for AI?

    Jump

  • I do already have a NAS. It's in another box in my office.

    I was considering replacing the PIs with a BOD and passing that through to one of my boxes via USB and virtualizing something. I compromised by putting 2tb Sata SSDs in each box to use for database stuff and then backing that up to the spinning rust in the other room.

    How do I do that? Good question. I take suggestions.

  • Selfhosted @lemmy.world
    nagaram @startrek.website

    1U mini PC for AI?

  • Selfhosted @lemmy.world
    nagaram @startrek.website

    Best Practice Ideas

  • Selfhosted @lemmy.world
    nagaram @startrek.website

    New to Kubernetes and Pi clusters

  • Selfhosted @lemmy.world
    nagaram @startrek.website

    Simple Blog options?

  • Selfhosted @lemmy.world
    nagaram @startrek.website

    how to set up a remote managed node for mom

  • Selfhosted @lemmy.world
    nagaram @startrek.website

    getting 522 error Cloudflaired + Jellyfin + fail2ban

  • Selfhosted @lemmy.world
    nagaram @startrek.website

    SIEM