sphalerite changed the topic of #nixos-dev to: NixOS Development (#nixos for questions) | NixOS 19.03 released! https://discourse.nixos.org/t/nixos-19-03-release/2652 | https://hydra.nixos.org/jobset/nixos/trunk-combined https://channels.nix.gsc.io/graph.html https://r13y.com | 19.03 RMs: samueldr,sphalerite | https://logs.nix.samueldr.com/nixos-dev
drakonis has joined #nixos-dev
Synthetica has quit [Quit: Connection closed for inactivity]
cjpbirkbeck has joined #nixos-dev
jtojnar has quit [Quit: jtojnar]
jtojnar has joined #nixos-dev
orivej has quit [Ping timeout: 248 seconds]
andi- has quit [Remote host closed the connection]
andi- has joined #nixos-dev
<ryantm> gchristensen: How does the "no hard drive" part work? Does everything have to be in RAM?
cjpbirkbeck has quit [Quit: Quitting now.]
drakonis has quit [Quit: WeeChat 2.4]
FRidh2 has joined #nixos-dev
Jackneill has joined #nixos-dev
ixxie has joined #nixos-dev
<arianvp> gchristensen: remote builders for development are useful as well
<arianvp> E.g. developing patches for systemd has quite a slow turnaround time
<arianvp> Esp if you want to run tests. As a lot has to recompile
<arianvp> Would be nice to have a remote builder up for grabs for that
andi- has quit [Remote host closed the connection]
johanot has joined #nixos-dev
andi- has joined #nixos-dev
clever has quit [Ping timeout: 246 seconds]
cransom has quit [Quit: WeeChat 2.4]
orivej has joined #nixos-dev
justanotheruser has quit [Ping timeout: 268 seconds]
<domenkozar[m]> gchristensen: we are building turnkey solution for agents, so we could hook those up to hercules ci and give it for free for OSS
<domenkozar[m]> that allows for eval-and-build for any github project
johanot has quit [Ping timeout: 245 seconds]
johanot has joined #nixos-dev
justanotheruser has joined #nixos-dev
<domenkozar[m]> gchristensen: are these spot instances?
<domenkozar[m]> gchristensen: what is the startup time for those?
<yorick> on packet.com, about 10 minutes. on AWS, about 1 minute
<yorick> (the 10 minutes is too much for spot instances, tbh)
<yorick> I guess you could save about 5 by having a local cache, prebaking the ipxe with the right kernel+initrd and pivot_rooting into it
<domenkozar[m]> with 10minutes we can only do shared builders
<domenkozar[m]> and one cluster
<domenkozar[m]> so using the binary would be "insecure"
<domenkozar[m]> binary cache*
johanot has quit [Ping timeout: 245 seconds]
johanot has joined #nixos-dev
orivej has quit [Ping timeout: 268 seconds]
clever has joined #nixos-dev
clever has joined #nixos-dev
clever has quit [Changing host]
__monty__ has joined #nixos-dev
jtojnar has quit [Remote host closed the connection]
orivej has joined #nixos-dev
orivej has quit [Ping timeout: 272 seconds]
<gchristensen> these will boot in about 5m
<gchristensen> or 45s if I deploy my own "boot faster, dangit!" fix
johanot has quit [Quit: WeeChat 2.4]
<gchristensen> domenkozar[m]: I'll have to talk to my account manager about if that would be okay with them. I'll send them a note :)
<domenkozar[m]> 45s is pretty good :)
<domenkozar[m]> gchristensen: are those spot instances?
<gchristensen> I have several customers for them as soon as they make their boots fast, or decide to deploy my fix for their slow boots https://gist.github.com/grahamc/99cbfb4e828f24d97c7abb1bd53a35b8#file-loris-py
<gchristensen> no they're not spot instances
<domenkozar[m]> alright :)
<gchristensen> they actually can't be deprovisioned :)
<gchristensen> ryantm: yes, everything has to be in ram
<__monty__> Is that a pun on slow loris?
<gchristensen> which is no doubt a significant limitation
<gchristensen> __monty__: it literally utilizes the slow loris attack to make these servers boot quickly
<__monty__> Ah, think I've seen this before. You keep the PXE boot busy until you actually want to boot the machine?
<gchristensen> right
justan0theruser has joined #nixos-dev
justanotheruser has quit [Ping timeout: 246 seconds]
psyanticy has joined #nixos-dev
__monty__ has quit [Ping timeout: 258 seconds]
__monty__ has joined #nixos-dev
<yorick> does packet like their servers idling at max power in the pxe thing instead of off?
* gchristensen shrugs
<yorick> hm, you could port coreboot to these things, the chipset is supported
<gchristensen> yeah, I don't know. they already make decisions about which machines are "hot" with ubuntu, and which are in standby and which are off
jtojnar has joined #nixos-dev
layus[m] has joined #nixos-dev
avn has joined #nixos-dev
orivej has joined #nixos-dev
orivej has quit [Ping timeout: 272 seconds]
cransom has joined #nixos-dev
__monty__ has quit [Ping timeout: 245 seconds]
__monty__ has joined #nixos-dev
ajs124 has quit [Quit: Gateway shutdown]
ajs124 has joined #nixos-dev
FRidh2 has quit [Quit: Konversation terminated!]
orivej has joined #nixos-dev
<thoughtpolice> lol @ slow loris'ing your PXE server
<gchristensen> anything to save those 5m
<ryantm> gchristensen: How much of the RAM does the base OS take up?
<gchristensen> ryantm: maybe we should PM about your project and its requirements?
v0|d has joined #nixos-dev
Jackneill has quit [Remote host closed the connection]
orivej has quit [Ping timeout: 245 seconds]
<aristid> gchristensen: woah, how does slow loris make servers boot faster?
<gchristensen> it skips the slow part about booting: booting. it keeps the server right at the moment of deciding how to boot
<simpson> gchristensen: I am reminded of the classic HTTP technique, "long polling".
<gchristensen> yeah very similar
<gchristensen> but I think that typically requires the client to consent
<simpson> Or at least to not time out.
<aristid> gchristensen: and you can still use the server in that state?!
<gchristensen> aristid: what do you mean?
<gchristensen> it is not usable until it receives the "do the boot" instruction
<aristid> but that takes less than 5 minutes, unlike the normal boot?
<gchristensen> it takes only as long as it takes to download and execute your iPXE image. which in my tests is about 45s
<aristid> so what does the server do normally in the 5 minutes?
<aristid> let timeouts expire?
<averell> no, the trick is to wait the 5 minutes at the beginning, then poll until an actual provisioning which is fast
<gchristensen> normally, the first five minutes are spent initializing the CPU, RAM, disks, NICs, etc.
<gchristensen> the 5 minutes still happen, but if you keep some hardware hot and at this spot, you experience a 45s boot
<aristid> gchristensen: is averell's explanation right? because i understand that, but i'm not sure if it's what you mean :)
<aristid> gchristensen: ok and the reason you don't just boot the system earlier is that you might not have the right ipxe image yet?
<gchristensen> right, you may not know what you want to boot yet
<aristid> or does packet only charge after the bootup is complete?
<gchristensen> as a customer on Packet, you probably don't want to implement this yourself, as you'll be billed for all the time it is sitting at this slow loris stage
<gchristensen> but Packet might want to implement this
<aristid> gchristensen: oh so you suggest that they just never powerdown their machines, and instead boot them into slowloris
<gchristensen> right (but maybe not "never", but keeping some % of their hardware hot in this spot would make a difference)
<averell> do you contract for them? i think the engineers might hang a wanted poster.
<gchristensen> I don't
<gchristensen> and yes, they are hiring :)
<averell> haha, not that kind.
<gchristensen> oh! haha
<samueldr> WANTED for crimes of high availability. offline or online. reward: 99.999% SLA
<arianvp> who here was collecting totally useless --show-trace's ?
<gchristensen> the Nix bug tracker please, and CC me :)
<arianvp> oh wait this is maybe sort of useful
<arianvp> but I still dont understand whit it's failing
<arianvp> pkgsCross.aarch64-android-prebuilt.llvmPackages_5 exists
phreedom has quit [Ping timeout: 260 seconds]
psyanticy has quit [Quit: Connection closed for inactivity]
johanot has joined #nixos-dev
gchristensen has quit [Quit: WeeChat 2.4]
{^_^} has quit [Remote host closed the connection]
__monty__ has quit [Quit: rebootying]
{^_^} has joined #nixos-dev
__monty__ has joined #nixos-dev
johanot has quit [Quit: WeeChat 2.4]
gchristensen has joined #nixos-dev
<{^_^}> nixos-weekly#98 (by domenkozar, 6 days ago, open): Call for Content: 2019/12
marek has quit [Ping timeout: 248 seconds]
justan0theruser is now known as justanotheruser
marek has joined #nixos-dev
<jtojnar> aargh cmake
ixxie has quit [Ping timeout: 268 seconds]
<zimbatm> dat 2.0 protocol serving 11 million files: https://twitter.com/pfrazee/status/1158744190995578883
<zimbatm> maybe Dat as a binary cache will become feasible
Jackneill has joined #nixos-dev
<simpson> zimbatm: Maybe. I don't trust Dat's authors to be honest with benchmarks, and it's not clear whether the bandwidth is there.
<simpson> It's certainly exciting times, but are those read speeds real or arranged?
Jackneill has quit [Remote host closed the connection]
__monty__ has quit [Quit: leaving]
<worldofpeace> jtojnar: think we should merge #63790 ?
<{^_^}> https://github.com/NixOS/nixpkgs/pull/63790 (by chpatrick, 5 weeks ago, open): nixos/gdm: add autoSuspend option
<jtojnar> worldofpeace: yeah, if you tested it, it should be fine
<worldofpeace> jtojnar: only change that we had to make was https://github.com/NixOS/nixpkgs/pull/63790#discussion_r298850154
<worldofpeace> i can't really remember if that's really important since that is different from how it was before
<jtojnar> worldofpeace: the sed-insertion looks fine
<jtojnar> I am not sure about “GDM dconf profile changed, please update gdm.nix”, how is one supposed to update it?
<worldofpeace> I don't really see if it would ever change that "user-db:user" wouldn't be the first line, but I guess if it does it would prevent someone from building their system
<worldofpeace> which reminds me that our gnome-gdm test doesn't block the channel jtojnar
<jtojnar> worldofpeace: I misread it, now I understand it checks for upstream changes
<zimbatm> simpson: the achievement is more that they are able to serve a snapshot of 11 million files. in DAT 1.0 a site could only contain a small number of files. IPFS has similar problems I think.
<simpson> zimbatm: Ah, sure. It's definitely improvement, for sure.
<worldofpeace> anyone know why the lightdm test is commented out of release-combined.nix?
<worldofpeace> it's the default DM and it's untested
<worldofpeace> that's not true anymore
<samueldr> since this is the most recent blame on that line, it sounds like "because no one changed it since" :/
<worldofpeace> yep, will change that since it's already tested in the pantheon test fine
<samueldr> though you're right it should be re-enabled I figure
<worldofpeace> only thing I'm not sure of is if the pantheon test shouldn't test lightdm that way anymore
<samueldr> it uses a custom greeter, right?
orivej has joined #nixos-dev
<worldofpeace> not yet, its greeter is broken
<worldofpeace> will be fixed their next release though, so I guess I should keep that till then
<jtojnar> I am being told CMake does not really have os.path.join-like function https://stackoverflow.com/questions/57382992/joining-paths-in-cmake/57383772
<worldofpeace> jtojnar: so the solution that person proposed is macros?
<worldofpeace> cmake makes me feel tired 🥴
<jtojnar> yup, going to open an issue upstrem
<jtojnar> I do not see how can CMake not contain something so essential
<worldofpeace> exactly, like no path joining? really.
<worldofpeace> jtojnar: great, let's hope someone produces the feature
<worldofpeace> jtojnar: what do you think about having just a gdm test?
<jtojnar> how would that work?
<jtojnar> worldofpeace: maybe we could check if debian has somehing we could steal
<worldofpeace> pretty much similar to all the other DM tests. and think we could get through it with just sendchars
<worldofpeace> jtojnar: ooh have you seen openQA in fedora and opensuse?
<jtojnar> I have heard of it but have not looked into it yet
<worldofpeace> this one is pretty nice for gnome https://openqa.fedoraproject.org/tests/426622 jtojnar
<worldofpeace> firefox gets it nice too https://openqa.fedoraproject.org/tests/426620
alienpirate5 has quit [Changing host]
alienpirate5 has joined #nixos-dev
alienpirate5 has joined #nixos-dev