@wyri@haxim.us
@wyri@haxim.us avatar

wyri

@wyri@haxim.us

Maintains :wyrimaps:, :reactphp:, a couple dozen asynchronous #PHP (:php8:+) packages, and destroyer of servers.

Hashtags: #php, #fedi22, #kubernetes, #reactphp, #devops, #opensource, #helm, #k8s

This profile is from a federated server and may be incomplete. Browse more on the original instance.

wyri, to Ubiquiti
@wyri@haxim.us avatar

First part of a new long term home project coming in. An PoE+ switch to power a small cluster built using nodes. Going to blog about every step once it has been completed. But it is going to be a few quarters long project doing bit by bit

wyri,
@wyri@haxim.us avatar

For those interested, the set up to see the error (this is Ubuntu 21.04 server, which is either stuck or very slowly booting)

wyri,
@wyri@haxim.us avatar

amd64 image is looking promising!

wyri,
@wyri@haxim.us avatar

🎉🎉🎉🎉!

wyri,
@wyri@haxim.us avatar

Kubernetes home lab using lego thread imported from Bird site

wyri,
@wyri@haxim.us avatar

And barely using power! (Ok ok it's idle and not using the SSD yet.)

wyri,
@wyri@haxim.us avatar

Ow and of course the power usage is graphed:

wyri, (edited )
@wyri@haxim.us avatar

Alright! Take over cluster from @ocramius just came in from Germany. This should speed up the project, plus makes it makes slightly repurposing those nodes in the future easier. (Yes there is a plan beyond jus the cluster and it's housing.)

wyri,
@wyri@haxim.us avatar
wyri,
@wyri@haxim.us avatar

And exactly this is why I want to use Technic for the skeleton. (Moved it from the box it was on the yellow thing it's on right now. The grey underplate is now fully resting on the surface it's on.))

wyri,
@wyri@haxim.us avatar

Temporary set up, next up is setting up Thinkerbell

wyri,
@wyri@haxim.us avatar
wyri,
@wyri@haxim.us avatar

😱😱😱😱

wyri,
@wyri@haxim.us avatar

Ok been digger a bit deeper, is 64bit hardware required? Given the missing symbol naming:

wyri,
@wyri@haxim.us avatar

Hah success! Had to do the cert steps on a 64 bit machine tho

wyri,
@wyri@haxim.us avatar
wyri,
@wyri@haxim.us avatar

Figured out what's wrong today and what is causing this error, TL;DR I need a custom kernel/bootloader to be able to run workflows, to be continued:

wyri,
@wyri@haxim.us avatar

Decided to skip auto provisioning for now. Not because of but due to the fact that the RPI4 set up I've been following requires a custom kernel and initramfs to be able to run workflows from netboot: https://t.co/VejBOwwTP0

wyri,
@wyri@haxim.us avatar

Still figuring out how to create that kernel and initramfs and that's going to take a while. And I really wanted to have at least SOMETHING running. So this is my MVP home cluster running . Didn't bother with the SSD yet, running purely from SDcards for now.

wyri,
@wyri@haxim.us avatar

Got something else to fix for booting from SSD, but will also fix that later.

For now, the next step is getting GitHub Action runners on it to start building applications for it and have a way to deploy directly to it. There are several solutions for that, should be fun :D

wyri,
@wyri@haxim.us avatar

If anything, I learned that arm and arm64 support for many Helm charts/Docker images out there aren't as good as I hoped for.

This is partially why I'm doing this project, aside from having some use cases in the house

wyri,
@wyri@haxim.us avatar

This literally sums up my day: https://t.co/szbGzcHxiu

wyri,
@wyri@haxim.us avatar

Essentially lots of Docker images only have an amd64 version, maybe an arm64 but rarely an arm(7) image so running anything on the RPI3's in the cluster is unlikely unless I start building images for it.

Now the GitHub Actions Runner Helm chart I'm using also only has amd64 and

wyri,
@wyri@haxim.us avatar

arm64 versions.

So that is going to be fun. The cool thing is setting that up is really really easy, like scary easy. Writing a Helm chart to add all the of the runner deployment and autoscaling definitions for that. Also considering putting them directly in a projects

wyri,
@wyri@haxim.us avatar

deployment. But that results in the chicken and egg problem, so either the first deployment to the cluster has to be done manually or I'll have to store them at a central location.

However the first thing on the menu is getting Helm to work and be able to deploy from within the

wyri,
@wyri@haxim.us avatar

cluster using a GitHub Actions Runner.

When that works, I'm locking all network and permissions within the cluster and the network as much as possible.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • megavids
  • modclub
  • DreamBathrooms
  • mdbf
  • Durango
  • ngwrru68w68
  • magazineikmin
  • thenastyranch
  • InstantRegret
  • Youngstown
  • slotface
  • everett
  • kavyap
  • cisconetworking
  • JUstTest
  • ethstaker
  • tacticalgear
  • GTA5RPClips
  • osvaldo12
  • khanakhh
  • rosin
  • Leos
  • normalnudes
  • anitta
  • cubers
  • tester
  • provamag3
  • lostlight
  • All magazines