Looking for a recommendation on an LLM that can guide a user on how to manually set up a home server that runs Jellyfin, Arr Stack, etc. Have a couple of friends interested and I have some spare old NUCs I was going to give them, so I was going to download the software for them and then walk them through it.

But it’ll be difficult to align our schedules for the next month or so (school starting and different time zones) so then I thought maybe I could just run an LLM they could use on my main PC for when they have time.

Why not just use one of the existing services? Those cost extra money and none of us want to financially support those companies.

    • Lumisal@lemmy.worldOPEnglish
      1·
      16 days ago

      And the Arr Stack, and KitchenOwl, and LibreCloset. They also want something for YouTube, but haven’t decided what they might like the most yet - was thinking of testing KDE’s new Plasma BigScreen and seeing how Waydroid does at running S-tube.

      If that worked well enough, then I’d probably try setting them up with that

  • mortalic@lemmy.worldEnglish
    2·
    16 days ago

    Probably setup ollama with qwen and aider first. Then give it the docs for the things you want to set up.

  • irmadlad@lemmy.worldEnglish
    2·
    15 days ago

    Either way OP, you will need to install something like Rust, because you will become the network admin/IT dept.

    • Lumisal@lemmy.worldOPEnglish
      2·
      15 days ago

      Already planning on them adding Rustdesk in case of issues in the future actually 😅

  • irmadlad@lemmy.worldEnglish
    2·
    16 days ago

    GPT4All can accommodate a plethora of models all the way until you run out of VRAM. LOL Maybe play around with some of them. Right now I’m experimenting with DeepSeek R1 Distill Qwen 14 B, and Qwen 2.5 Coder -32B Instruct GGUF. Pretty neat stuff.

    • Lumisal@lemmy.worldOPEnglish
      21·
      16 days ago

      Is GPT4all still up to date though? I see the last release was in 2024

      • irmadlad@lemmy.worldEnglish
        3·
        16 days ago

        Release v3.10.0 dropped on Feb 24, 2025, so yeah it does have a little age. I’m not sure how often they would need to update the front end, as it seems the models are the driving force.