For people self hosting LLMs.. I have a couple docker images I maintain
github.com/…/text-generation-webui-docker (updated to 1.3.1 and has a fix for gqa to run llama2 70B)...
This magazine is from a federated server and may be incomplete. Browse more on the original instance.
github.com/…/text-generation-webui-docker (updated to 1.3.1 and has a fix for gqa to run llama2 70B)...
BookWyrm is a social network for tracking your reading, talking about books, writing reviews, and discovering what to read next. Federation allows BookWyrm users to join small, trusted communities that can connect with one another, and with other ActivityPub services like Mastodon and Pleroma.
I have a lot of different services which I self host for me and my family like:...
Hot on the heels of last week’s announcement that Intel would end their NUC line, Intel and ASUS have struck a non-exclusive deal that will see ASUS assume manufacturing, sales, and support of 10th to 13th Gen NUCs. ASUS will also be able to develop future NUC designs; all under a new business unit called ASUS NUC BU.
Hi y’all! Sorry for asking so much on this sub! Y’all have been so helpful!...
I’ve been using gparted live for the most part to repair all sorts of stuff, but I’m wondering if anyone else has any other more modern recommendations, preferably even ones with Wifi or more graphics card support!...
Hello, This is my first website and I want some feedback from you guys. It’s very basic and I haven’t added much. just wanted to host something so I threw invidious and whoogle instance there. My ISP doesn’t provide a static IP so I had to host it on tor :( what else do you think I should host there? server spec: 15 year...
I’ve been eyeing these devices for some time now. The price point is… delicious!...
So everyone is talking about cloudflare tunnels and I decided to give it a shot....
So, I have some idea on what a reverse proxy does and will be using nginx (with the neat proxy manager UI) for my setup....
I currently use a Droplet from DigitalOcean which gives me 1 gb of RAM, 25 gb of storage and a bandwidth limit of 1 TB which is priced at 6 dollars per month, I think this might be a good offer, but I also think I’m overpaying because the only thing that I use from that is Wireguard to get around CGNAT at my home (which I...
A recent post here about 4th July sales has made me consider buying a VPS but the cost still seems a little steep. What are the main advantages of using a VPS?
I’ve been using “Podlet” recently to convert my docker-compose.yaml files over to quadlet files. For those who aren’t familiar, Quadlet is basically a halfway point between a compose file and a systemd entry and it simplifies the process for using systemd to manage your podman containers. This tool can convert podman run...
Short guide how to use traefik-forward-auth to use SSO for any traefik ingress, so even simple dashboard with your self-hosted services can be hidden behind login....
Currently I have my services accessible through subdomains, with account password protection, my only experiences building websites is Google Pages and Geocities (20 years ago)....
I’m already hosting pihole, but i know there’s so much great stuff out there! I want to find some useful things that I can get my hands on. Thanks!...
So, I’ve recently started torrenting more, but I wanted to be safe about it, or a safe as can be....
I call this nonsense host ‘Ghost’, for me it’s similar to a tape backup solution. Fairly simple concept, it’s an old Pi1 + external mechanical drive that sits dormant with its ethernet off. Once a month, at a random time and random date it enables the ethernet, spins up the drive and pulls data from the main server to...
I have a domain name that I own but am not making use of and was thinking of setting up my own personal Lemmy instance, partly so I can have a Lemmy id and instance that I can completely control, partly so that I can contribute directly to my hosting cost, and partly because it might be fun to tinker with (or it might just end...
It was one of the easiest to setup and it works flawlessly. I'm a bit paranoid about losing my data even with the backups.. Any recommendation?
What do you have, what do you recommend, and why?...
My 2.5 year old loves watching classic Pokemon. I'll be honest, so do I. But have you tried doing that? It's fucking insane....
What is the best format settings to store a physical music?...
*What rights do you have to the digital movies, TV shows and music you buy online? That question was on the minds of Telstra TV Box Office customers this month after the company announced it would shut down the service in June. Customers were told that unless they moved over to another service, Fetch, they would no longer be...