- 11 Posts
- 213 Comments
1·7 hours agoI think I’m going to put a declarations.md that says something like “I made this for me, but I’m sharing it with the world. If you find it useful, use it and let me know! If you find issues, submit request and I’ll look but no promises. And if you want feature X … fork it and build it. The code’s yours, with my blessings. PS: I don’t accept PRs, sorry”.
I code for fun; I’m not looking for a third unpaid job. That’s what parenting is for.
Please tell me that’s ai slop parody.
I mean…it has to be. And the fact YouTube is just merrily injecting it into their streams is amazing.
I use Smartube and PipePipe and haven’t seen ads on YT since forever. Is this really what it’s like now?
Interesting question. If you are asking for an LLM (that is self-hosted and can do that?), you’re going to need to provide some significant tooling, like rag / documentation, troubleshooting, sort out concurrency, front end etc. Honestly…it just easier to point them at a YouTube (network chuck has good stuff).
It absolutely can be done and it absolutely can be valuable - for you personally. But if they’re having trouble doing basic things like installing jelly fin, they have zero chance of doing something like that themselves.
Honestly, I think your easiest option for your non-technical friends is just to point them at one of the cloud providers, like chatGPT or Claude.
OTOH, how much work are you willing to put into this and what’s your GPU / LLM set up like? There
Your basic foot in door starting point is going to be installing and provisioning OpenWebui, getting a good local model up and running (Qwen3.6-35B or Qwen3.6-27B) and creating a “Knowledge Base” in OWUI with requisite documentation. You’ll need to set up tailscale / headscale so they can access your OWUI instance from their homes, too.
If you’re serious about this, write back and I’ll thumbnail sketch it out for you. It’s a good project and I’ve done similar. There are real complexities to something like this beyond just “install ollama, lol done”.
Brilliant!
How does it go for chewing thru the phone battery tho?
deleted by creator
Nope, not me. The article popped up in my feed, I commented on it (over on /c/rtfa) and then shared if here. Feel free to check.
For context, that comes for the HN thread and blog post, not from anything I have written. Let’s attribute things to respective sources :)
Dunno if you can do this with ipads, but I’ve been (idly) considering using old phones to create an Alfred camera system
Probably not…but it’s a fun idea.
That’s nice and clean…and I love that you have both random fact and XKCD. Too many front ends look like a space shuttle launch control; this one has soul
Hope it helps!
Sounds good. And Meilisearch handles that OK?
I am simpatico with her position.
For what it’s worth, self-hosting doesn’t mean you need to be able to reach all your services off-site.
LAN only access is perfectly valid and something that I prefer myself.
Case in point -
Last year I went to Japan for 5 weeks and rather than opening up dodgy ports to my home media services, I ended up taking a 128GB USB stick, my Chromecast and installing Nova Player.
https://github.com/nova-video-player/aos-AVP
Nova Player populates on device from your attached storage to create essentially a jellyfin like front-end. Install it, plug the chrome cast or whatever into HDMI on any TV and you’re off to the races.
It’s wonderful and it’s actually now my primary streaming media source in the house; I just plug in my hard drive to my router, Nova sees it and my media sources are cross-populated to all of my Android devices.
Are you optimizing for a polished experience or for simplicity?
If for something polished that works very well, you’ve probably already found the best solution - immich. There’s also Piwigo, Photoprism etc.
If you’re looking for something simpler, can I suggest using syncthing (think: like a local version of Dropbox, sorta), with PiGallery2?
https://en.wikipedia.org/wiki/Syncthing
https://github.com/bpatrik/pigallery2
The idea here is that it creates a website that you can access on your Wi-Fi that is populated by the files that you push into the folder using your sync thing.
That’s not as elegant as immich, but it’s another option if you’re looking for low-end hardware.
Here’s the OG
https://gist.github.com/karpathy/442a6bf555914893e9891c11519de94f
And the clanker write up https://blog.starmorph.com/blog/karpathy-llm-wiki-knowledge-base-guide
Molly still have SMS integration? It use to have ability to act as an SMS/MMS client.
I just break things enough times until I internalize the knowledge into my soul.
Kidding aside, I do wish I was more disciplined about documentation.
It could have really helped me earlier in the week in fact. I figured out something really clever a couple of months ago, promptly wiped the computer. And now I can’t recreate it. I’ve come up with a halfway solution, but it’s not as elegant as it used to be.
To be honest with you, this is a really good use case for a large language model - self hosted or other wise. You know Karpathy’s LLM-wiki method?
…and the fact that their website uses AI generated templates, colours, fonts, call to action sure makes me believe that uncritically :/
I don’t care to spelunk their code base, but the old “how you do one thing is how you do everything” adage comes to mind.
EDIT: fwiw
Looks like human steered, AI assisted. Nothing wrong with that but by all rights it should get 1) disclosure 2) [AIT] tag, if OP is dev
At the very least, it deserves more than just a naked URL drop without explanation.
Edit: fwiw
It also says -
“So it’s all vibe-coded slop.”
The idea is over 4 years old: a trustless, decentralized network with no central entity that can censor who you connect with. I sketched it for years. What an LLM changed was the speed: the prototype came together in a day. The trigger was the release of iroh v1.
Make of that what you will.
You never cease to amaze me, irmadlad.