@mvilain@jerry I’m kinda getting close to having it running in a swarm like setup - once I’ve figured out how to get S3 working (with s3 compatible instead of aws), I should have it decoupled from any file sharing / shared sockets between containers.
@jerry@mvilain that’s what all us current K8s users feel like, and then a new release drops with more APIs! How do I set up an ingress now? Just choose your own adventure and hope it’s not deprecated in the next release!
@jerry lots of experience with docker. Not sure what your exact issue is.
Maybe obvious, nevertheless, to troubleshoot I like to setup a docker swarm with simple connection/ping containers, to know that the basics of the overlay network work.
Then, in theory, Kbin shouldn't be aware and just connect to hostnames in your overlay network.
If that doesn't work then there might be some "magic" going on within Kbin.
@jerry
That ought to change 👨🔧
I'll give a go at it during the weekend.
Are you using the docker compose yaml provided in the repo?
Are you managing the services like the db, rabbitmq and redis externally or using the ones in the docker-compose?
@jerry@derek
I have not used swarm since the container wars.
It seems that kbin needs the .env just to build the OCI, which means that there's no (easy) way to build a generic image that would work on different installs...
I was wondering why I couldn't find one anywhere, now I know.
@jerry I managed to build the image with the .env.example instead, but it's for the example configuration so 💩
By looking at the volumes that the different services share between them you'll probably need an NFS share of some sorts to be able to run on multiple hosts.
Maybe it will work with compose in multiple hosts and just mounting the shared volumes like this?
@jerry@derek@migas can you commit what you have so far so we can troubleshoot? I was going to dive into kbin w/ compose this weekend but if I can FF to swarm with your work that’d save some time.
@jerry@derek@migas how are you sharing the php unix socket storage volume across hosts? Did you figure how to set a port? Everything works fine in compose but to move this to swarm I’m stuck either moving php-fpm from socket to port or multi-mounting the storage volume. Would love y’all’s thoughts.
@davidvasandani@derek@migas I gave up on swarm. I’m trying to install it on bare metal now, splitting nginx, php/mercure, and postgres/redis on to separate systems. I have /public mounted to an s3 bucket.
@jerry@migas from my experience helm charts/Kubernetes is often overkill.
If you don't need any fancy scaling and load balancing functionality then even going native and editing your hosts file and docker-compose or a daemon setup brings you quite far with good reliability. (Especially if your machines are single use)
Add comment