johanot has quit [Quit: WeeChat 2.2]
johanot has joined #nixos-kubernetes
johanot has quit [Ping timeout: 244 seconds]
johanot has joined #nixos-kubernetes
johanot has quit [Quit: WeeChat 2.2]
ixxie has joined #nixos-kubernetes
simpson has joined #nixos-kubernetes
therealwaphire[m has joined #nixos-kubernetes
<ixxie> the room has been active therealwaphire[m, I guarentee it
<therealwaphire[m> maybe I can't see the old chats then
<simpson> This room is so much more active than #nixos-hercules. Wow.
<ixxie> its just been some months since the last bursts
<therealwaphire[m> so yeah, guys, help :P
<ixxie> johanot and srhb have had professional experience with NixOS based Kube clusters at least
<therealwaphire[m> any of you running kubernetes on 18.09?
<ixxie> therealwaphire[m: I ran some basic tests but haven't touched them in months
<ixxie> therealwaphire[m: johanot maintains a pretty simple example cluster here https://github.com/johanot/machines-mirror/tree/master/configurations/nixos
<ixxie> was helpful to me at least
<therealwaphire[m> yeah, I already looked around but that is google compute based though
<therealwaphire[m> I'm doing baremetal
<therealwaphire[m> anyways, I'm checking it out again
<ixxie> therealwaphire[m: this is mine which is running of Hetzner https://github.com/fluxcraft/fluxcluster
<therealwaphire[m> I'm doing hetzner too
<therealwaphire[m> damn, that will be helpful for sure
<therealwaphire[m> is that hetzner cloud or baremetal?
<ixxie> therealwaphire[m: cloud
<therealwaphire[m> I see
<ixxie> therealwaphire[m: the scripts for deploying are buggy and this is outdated clearly
<therealwaphire[m> I'll make my own, that's no problem
<therealwaphire[m> but I just need the basic stuff to work, haha
<therealwaphire[m> updating to 19.03 didn't help
<ixxie> the main issue with the deploy script is that once kexec does its magic the machine reboots and the connection breaks
<ixxie> so breaking the script in half and executing the second half manually would make it work
<therealwaphire[m> are you talking about installing nix on hetzner?
<ixxie> yeah
<ixxie> there are images now
<therealwaphire[m> I did that today morning
<therealwaphire[m> same, kexec
<therealwaphire[m> works beautifully
<ixxie> yeah indeed
<therealwaphire[m> have reinstalled like 10+ times with zfs
<ixxie> donno if its easier/better to use the image Hetzner has
<therealwaphire[m> hetzner must have the image on cloud though
<therealwaphire[m> robot doesn't have it
<ixxie> donno about robot but the wierdness was that the image isn't available when you first setup the machine, but is available only afterwards in some other menu
<therealwaphire[m> I automated the preinstallation stuff using a shell script but still have to do the kexec thing manually and copy-paste the script
<therealwaphire[m> <freenode_ixx "donno about robot but the wierdn"> oh, that is weird
<therealwaphire[m> the support could help you out though
<therealwaphire[m> in my experience, they're really cool
<therealwaphire[m> so this is something that's been happening...
<ixxie> therealwaphire[m: not sure... I am not the expert here. I recommend stalking here until srhb, johanot or colemickens are in
<therealwaphire[m> sure thing
<therealwaphire[m> now I think zfs is the problem
<therealwaphire[m> docker was previously using `devicemapper` as the storage driver
<therealwaphire[m> made it work but it's a big hack
<therealwaphire[m> oh well, nope still doesn't work
<srhb> therealwaphire[m: Hey, sorry, I don't have time tonight, but I'll be around tomorrow in the morning and early affternoon EU time
<srhb> I'll poke johanot to show up as well if he can.
<therealwaphire[m> no problem, mate
<therealwaphire[m> I appreciate your concern :)
<therealwaphire[m> finally got a pod to run but it's all a big hack; a lot of errors and warnings
<therealwaphire[m> there's been many issues raised regarding docker with zfs btw: https://github.com/moby/moby/issues/30551
ixxie has quit [Ping timeout: 250 seconds]
ixxie has joined #nixos-kubernetes
ixxie has quit [Ping timeout: 245 seconds]
ixxie has joined #nixos-kubernetes
ixxie has quit [Ping timeout: 245 seconds]