samueldr changed the topic of #nixos-infra to: NixOS infrastructure | logs: https://logs.nix.samueldr.com/nixos-infra/
tilpner_ has joined #nixos-infra
tilpner has quit [Ping timeout: 240 seconds]
tilpner_ is now known as tilpner
tilpner_ has joined #nixos-infra
tilpner has quit [Ping timeout: 256 seconds]
tilpner_ is now known as tilpner
qyliss- has joined #nixos-infra
qyliss has quit [Ping timeout: 256 seconds]
qyliss- is now known as qyliss
cole-h has quit [Ping timeout: 272 seconds]
tilpner has quit [Quit: tilpner]
tilpner has joined #nixos-infra
<gchristensen> I'm about to roll out Hydra schema updates: https://github.com/NixOS/nixpkgs/issues/111017
<ikwildrpepper> \o/
<ikwildrpepper> gchristensen: don't break it :-p
<gchristensen> ikwildrpepper: I happen to know our backups are really good :P
<gchristensen> I tested all the migrations using a copy of the live dataset, using this script: https://gsc.io/content-addressed/fef6d85c4f4bca1f2f5d79d444ef42632e875ebcf23ce097979673e041cca858
<gchristensen> it is pretty surreal spinning up a test database with data from not even a couple minutes ago
<lukegb> `echo "Compromising the security of the server ..."` love it
<gchristensen> hah
<ikwildrpepper> gchristensen: should've livestreamed it
<ikwildrpepper> I need some entertainment
<ikwildrpepper> waiting for my dough to rise
<ikwildrpepper> well, I meant video, screenshare, audio! snarky comments etc
<ikwildrpepper> swearing
<ikwildrpepper> you know
<gchristensen> hehe
<ikwildrpepper> anyway, thanks for doing it gchristensen :)
<gchristensen> :P
<gchristensen> ikwildrpepper: I think the foundation should probably buy a mac for ofborg
<gchristensen> to bring it back up as a well supported target
<ikwildrpepper> gchristensen: m1?
<gchristensen> mmmmmmaybe not yet
<gchristensen> ofborg doens't have any macs (intel flavored) to run builds on right now
<ikwildrpepper> maybe should do both?
<gchristensen> yeah probably should
<gchristensen> I'm not used to having budget
<gchristensen> :P
<ikwildrpepper> will ask the others on the board if they are ok with it
<gchristensen> cool
<gchristensen> my priority would definitely be intel then-maybe arm
<adisbladis> gchristensen: Fun fact "Haumea" sounds exactly like "this food is delicious" in cantonese
<gchristensen> hah!
<adisbladis> "Ho mei r"
<adisbladis> Where r is not the rolling r, but sounds more like "aaa"
<gchristensen> like the Boston R?!
<adisbladis> I don't know what that sounds like
<ikwildrpepper> gchristensen: looks like the intel mac mini is only available for expensive 1250 euro with jsut 8GB mem
<gchristensen> wow
<ikwildrpepper> maybe we should just use one of the existing ones for it
<ikwildrpepper> and then order a m1 mac exta?
<ikwildrpepper> extra
<ikwildrpepper> or we just take the hit
<ikwildrpepper> I just hate apple for it :D
<ikwildrpepper> afk to feed the pigs for a bit
<gchristensen> maybe there are refurbished intel macs? I'd rather not cut the intel darwin build capacity if we can avoid it
<andi-> Just wait a few more years until Apple starts producing server grade hardware again and Intel lost all the market share *dreams*
<ikwildrpepper> gchristensen: yeah, I can look if I can get a refurbished one somewhere
<ikwildrpepper> gchristensen: would you need 8 or 16GB?
<gchristensen> 16 would be nice but not strictly required
<gchristensen> it'll be running builds, doing almost no evaluation
<ikwildrpepper> ok, will see what is available
<gchristensen> nice, the first migration is done
<ikwildrpepper> \o/
<ikwildrpepper> one beer for gchristensen!
<gchristensen> and the second
<ikwildrpepper> another beer for gchristensen!
<lukegb> sounds like it's going mi-great!
<tilpner> Perhaps hand out the beer after the migration, ikwildrpepper?
<ikwildrpepper> tilpner: come on, live a little :-p
<ikwildrpepper> I think gchristensen can handle his beers... (at 11a, oops)
<ikwildrpepper> am
<gchristensen> looks like we're done
<gchristensen> ikwildrpepper: at one place I was at the person who was best at mysql would drink an entire bottle of wine as the migrations proceeded ....
<gchristensen> that was, uh, intense
<ikwildrpepper> I used to deploy with vodka-redbull :)
<ikwildrpepper> everything went smooth, obviously :D
<gchristensen> I'm tempted to run a vacuum
<gchristensen> any opinions?
<ikwildrpepper> nope
<domenkozar[m]> it always goes smoothly if you don't remember it
<domenkozar[m]> ikwildrpepper: I first read that as deploy-vodka-redbull and I thought: oh finally something anyone can use
<gchristensen> I started a tmux session on bastion connected to haumea to run VACUUM VERBOSE; this shouldn't take any locks
<gchristensen> it decided to start with the very biggest table, of course
<gchristensen> hydra=# VACUUM VERBOSE;
<gchristensen> INFO: vacuuming "public.builds"
<ikwildrpepper> gchristensen: only a few GB :)
<gchristensen> lol :)
<gchristensen> only a few .....
<gchristensen> hydra=# SELECT pg_size_pretty(pg_total_relation_size('builds'));
<gchristensen> pg_size_pretty
<gchristensen> ----------------
<gchristensen> 326 GB
<gchristensen> (1 row)
<gchristensen> hehe: INFO: scanned index "builds_pkey" to remove 16,081,187 row versions
<gchristensen> ikwildrpepper: did you know haumea isn't sending to your machine anymore?
<ikwildrpepper> gchristensen: no, I thought we re-enabled it. cooking atm, I can check in an hour or two if account etc on my side is ok. if so, we can re-enable it
<gchristensen> cool
<gchristensen> let's wait for the vacuum to finish so we don't 2x load the system
<gchristensen> INFO: index "jobsetevalmembers_pkey" now contains 1,489,069,013 row versions in 4,380,330 pages
<gchristensen> vacuum finished
<gchristensen> okay wheres the beers
<ikwildrpepper> yay!
<ikwildrpepper> gchristensen: don't forget to reenable the queue runner
<gchristensen> I think it is up, checking
<ikwildrpepper> that's what I usually forget
<gchristensen> it was not ) thank you
<ikwildrpepper> :)
* gchristensen watches his backup try to catch up with all the new writes
<gchristensen> w00t caught up. time to play with more migrations.
cole-h has joined #nixos-infra
niksnut has quit [Remote host closed the connection]