gchristensen changed the topic of #nixos-borg to: https://www.patreon.com/ofborg https://monitoring.nix.ci/dashboard/db/ofborg?refresh=10s&orgId=1&from=now-1h&to=now "I get to skip reviewing the PHP code and just wait until it is rewritten in something sane, like POSIX shell. || https://logs.nix.samueldr.com/nixos-borg
orivej has quit [Ping timeout: 240 seconds]
orivej has joined #nixos-borg
orivej has quit [Quit: No Ping reply in 180 seconds.]
orivej has joined #nixos-borg
orivej has quit [Read error: Connection timed out]
orivej has joined #nixos-borg
<flokli> gchristensen: could it be grahamc-aarch64-community-4 went out of disk space?
<flokli> missing it from monitoring.nix.ci, reason for the stupid question ;-)
orivej has quit [Quit: No Ping reply in 180 seconds.]
orivej has joined #nixos-borg
orivej has quit [Client Quit]
orivej has joined #nixos-borg
orivej has quit [Quit: No Ping reply in 180 seconds.]
orivej has joined #nixos-borg
<gchristensen> I ... don't think so?
<gchristensen> tmpfs 63G 56G 7.2G 89% /
<gchristensen> /dev/disk/by-label/scratch-space 434G 21G 391G 6% /nix/.rw-store
<gchristensen> huh.
<gchristensen> I'll check out the monitoringissue this evening
orivej has quit [Ping timeout: 245 seconds]
orivej has joined #nixos-borg
<samueldr> gchristensen: possibly caused by 34G /var/lib/gc-of-borg/
<samueldr> looks like repos aren't being cleaned?
<samueldr> though I may be entirely wrong and it always did that
orivej_ has joined #nixos-borg
orivej has quit [Ping timeout: 272 seconds]
<Mic92> btw. I can only recommend git worktree for space-efficient git checkouts.
<gchristensen> samueldr: want to check out more details about why?
<samueldr> I don't know what to check
<samueldr> but it's a bunch of nixpkgs checkouts
<gchristensen> oh right b/c each builder has a check out, and it has like 30 builders
<samueldr> though it would have been an issue beforehand?
<samueldr> or something changed?
<gchristensen> I would have too
<gchristensen> did someone check a big file in?
<gchristensen> oh maybe something changed about the tmpfs
<samueldr> it sure did, but what?
<gchristensen> well, no, I don't think so, since, lol it is all on a tmpfs
<samueldr> though beforehand the store too was in tmpfs, this would have made the issue worse imho
<samueldr> sure, I'm using a bit of the tmpfs right now for $thing, but compared to the store? I think it shouldn't be an issue?
<samueldr> maybe it is?
<gchristensen> maybe should create a second overlay on /var ?
<gchristensen> need to each lunch first, though. in the short term you can reboot it
<samueldr> what if / in whole was overlaid? it's used as a tmpfs?
<gchristensen> can it?
<samueldr> I don't know
<gchristensen> like overlayfs requires pointing to a position on disk as the workdir and upperdir, not sure if that can be done with /
<gchristensen> happy to look in to that (or if you want to :)) after my queue lunch and learn.
<samueldr> maybe only at stage-1 before pivoting
<samueldr> (and then it becomes a real chore to do right?)
<gchristensen> since those paths def. don't exist after the pivot, you're probably right
<gchristensen> /dev/loop0 377M 377M 0 100% /nix/.ro-store
<gchristensen> /dev/disk/by-label/scratch-space 434G 17G 396G 4% /nix/.rw-store
<gchristensen> not sure ...
<gchristensen> ah let me push my changes!
<gchristensen> pushed
<gchristensen> anyway, lunch. back in a bit.
orivej_ has quit [Ping timeout: 250 seconds]
orivej has joined #nixos-borg
orivej has quit [Ping timeout: 250 seconds]
orivej has joined #nixos-borg