<infinisil>
Would be nice if Nix printed updates while deleting garbage
<infinisil>
Currently it just says "deleting '/nix/store/trash'", which can take hours without any extra output
<gchristensen>
you mean the last step?
<infinisil>
Yea
<gchristensen>
yea
<gchristensen>
sudo strace -e unlink -fp ...
<gchristensen>
but only run it for a second and ctrl-c it
<infinisil>
Neat, why ctrl-c?
<samueldr>
nix has to delete *all* files, so it's quite slow; though I wonder if it could print once per top-level thing it's deleting, or some progress status thing
<gchristensen>
strace slows it down significantly
<infinisil>
I'd love some "X out of Y paths deleted"
<infinisil>
On the other hand, maybe I should just GC more often than once a year :P
<gchristensen>
lol
<gchristensen>
you could learn about filesystems, kernels, zfs, performance counters, etc. and try to learn about tuning ZFS to delete faster
<ajs124>
hm. something's weird. when I locally build "nix-build nixos/release.nix -A netboot.x86_64-linux" on release-20.09, $out/nix-support/hydra-build-products exists and contains the right data, but https://hydra.nixos.org/build/129492856 has an empty nix-support folder
<gchristensen>
lassulus found that earlier I think
<ajs124>
how does something like that happen? is hydra up to something strange? it seems to keep the build-products for the iso jobs.
<andi->
What is the current status around nix on the new Apple Arm platform? Does that work yet?
<LnL>
thefloweringash has some WIP stuff
<LnL>
and the 10.11 changes are being tested on hydra, but hydra is going through the queue a bit slowly
<thefloweringash>
I have a cross compiled set of bootstrap tools, an implementation of ad-hoc code signing, and a natively built hello using those bootstrap tools.
<thefloweringash>
the catch is that it relies a lot on apple's sdk for header files and library definitions
<clever>
this is another project i did recently, even more stripped down then not-os
<clever>
the initrd contains busybox, a few select kernel modules, and a tiny .c binary to measure boottime
<clever>
then a shell script (line 42) configures things
<siraben>
I see. Could this compile in darwin as well?
<clever>
not sure
<clever>
its setup to cross-compile to arm
<matthewkenigsber>
Is there a good reason python packages should depend on bash? Like the python wrapper uses bash to set a few env variables, but that's all I've seen. That could be done in Python without the extra dependency
costrouc has joined #nixos-dev
costrouc has quit [Quit: costrouc]
costrouc has joined #nixos-dev
<niksnut>
matthewkenigsber: yes, ideally we would have some notion of an "intrusive" makeWrapper that sets env vars *inside* the program it's wrapping (for supported scripting languages)
alp has joined #nixos-dev
<matthewkenigsber>
niksnut: that would get rid of an unnecessary fork as well, right?
<niksnut>
an unnecessary exec
<matthewkenigsber>
Thanks
<aminechikhaoui>
Hey niksnut, any chance this tiny change can be merged https://github.com/NixOS/nix/pull/4116 ? I've been using it locally for few weeks and didn't notice any issues
<{^_^}>
nix#4116 (by AmineChikhaoui, 3 weeks ago, open): support name attribute in fetchGit
costrouc has quit [Quit: costrouc]
costrouc has joined #nixos-dev
<siraben>
clever: how can I take the output of not-os and turn it into a disk image to flash?
<siraben>
It's already a .img but I'm not sure what to do next.
misuzu_ has joined #nixos-dev
colemickens has quit [*.net *.split]
domenkozar[m] has quit [*.net *.split]
ryantm has quit [*.net *.split]
cstrahan has quit [*.net *.split]
flokli has quit [*.net *.split]
worldofpeace has quit [*.net *.split]
nh2[m] has quit [*.net *.split]
JJJollyjim has quit [*.net *.split]
rnhmjoj has quit [*.net *.split]
Ericson2314 has quit [*.net *.split]
thefloweringash has quit [*.net *.split]
Dandellion has quit [*.net *.split]
ajs124 has quit [*.net *.split]
regnat has quit [*.net *.split]
misuzu has quit [*.net *.split]
pikajude has quit [*.net *.split]
worldofpeace has joined #nixos-dev
Ericson2314 has joined #nixos-dev
Dandellion has joined #nixos-dev
thefloweringash has joined #nixos-dev
JJJollyjim has joined #nixos-dev
regnat has joined #nixos-dev
rnhmjoj has joined #nixos-dev
cstrahan has joined #nixos-dev
ryantm has joined #nixos-dev
domenkozar[m] has joined #nixos-dev
nh2[m] has joined #nixos-dev
pikajude has joined #nixos-dev
flokli has joined #nixos-dev
ajs124 has joined #nixos-dev
flokli has quit [Max SendQ exceeded]
Ericson2314 has quit [Max SendQ exceeded]
alp has quit [Ping timeout: 272 seconds]
maralorn has quit [Ping timeout: 244 seconds]
bennofs[m] has quit [Ping timeout: 244 seconds]
michaelpj has quit [Ping timeout: 246 seconds]
ryantm has quit [Ping timeout: 246 seconds]
worldofpeace has quit [Ping timeout: 246 seconds]
JJJollyjim has quit [Ping timeout: 246 seconds]
jonge[m] has quit [Ping timeout: 240 seconds]
jtojnar has quit [Ping timeout: 270 seconds]
kraem has quit [Ping timeout: 244 seconds]
siraben has quit [Ping timeout: 270 seconds]
domenkozar[m] has quit [Ping timeout: 246 seconds]
Dandellion has quit [Ping timeout: 246 seconds]
thefloweringash has quit [Ping timeout: 246 seconds]
aanderse has quit [Ping timeout: 244 seconds]
Valodim[m] has quit [Ping timeout: 244 seconds]
bbigras has quit [Ping timeout: 272 seconds]
aterius has quit [Ping timeout: 246 seconds]
Ox4A6F has quit [Ping timeout: 246 seconds]
regnat has quit [Ping timeout: 246 seconds]
nh2[m] has quit [Ping timeout: 246 seconds]
rnhmjoj has quit [Ping timeout: 246 seconds]
Irenes[m] has quit [Ping timeout: 272 seconds]
philipp[m] has quit [Ping timeout: 240 seconds]
DamienCassou has quit [Ping timeout: 244 seconds]
treed[m] has quit [Ping timeout: 244 seconds]
timokau[m] has quit [Ping timeout: 244 seconds]
danielrf[m] has quit [Ping timeout: 244 seconds]
matthewkenigsber has quit [Ping timeout: 246 seconds]
bk1603[m]1 has quit [Ping timeout: 244 seconds]
puzzlewolf has quit [Ping timeout: 244 seconds]
emily has quit [Ping timeout: 244 seconds]
roberth has quit [Ping timeout: 260 seconds]
rycee has quit [Ping timeout: 260 seconds]
ma27[m] has quit [Ping timeout: 260 seconds]
alexarice[m] has quit [Ping timeout: 272 seconds]
flokli has joined #nixos-dev
<Taneb>
I've hit an error running hydra-backfill-ids for my work's Hydra server
<Taneb>
I get this error: main::backfillJobsJobsetId(): DBI Exception: DBD::Pg::st execute failed: ERROR: duplicate key value violates unique constraint "jobs_pkey"
kraem has joined #nixos-dev
Valodim[m] has joined #nixos-dev
bennofs[m] has joined #nixos-dev
siraben has joined #nixos-dev
michaelpj has joined #nixos-dev
aanderse has joined #nixos-dev
maralorn has joined #nixos-dev
jtojnar has joined #nixos-dev
ryantm has joined #nixos-dev
worldofpeace has joined #nixos-dev
jonringer has joined #nixos-dev
aterius has joined #nixos-dev
bbigras has joined #nixos-dev
jonge[m] has joined #nixos-dev
domenkozar[m] has joined #nixos-dev
thefloweringash has joined #nixos-dev
Dandellion has joined #nixos-dev
nh2[m] has joined #nixos-dev
rnhmjoj has joined #nixos-dev
Ox4A6F has joined #nixos-dev
regnat has joined #nixos-dev
Irenes[m] has joined #nixos-dev
colemickens has joined #nixos-dev
kraem has quit [Quit: Bridge terminating on SIGTERM]
aanderse has quit [Quit: Bridge terminating on SIGTERM]
michaelpj has quit [Quit: Bridge terminating on SIGTERM]
Valodim[m] has quit [Quit: Bridge terminating on SIGTERM]
siraben has quit [Quit: Bridge terminating on SIGTERM]
maralorn has quit [Quit: Bridge terminating on SIGTERM]
bennofs[m] has quit [Quit: Bridge terminating on SIGTERM]
jtojnar has quit [Quit: Bridge terminating on SIGTERM]
ryantm has quit [Quit: Bridge terminating on SIGTERM]
jonge[m] has quit [Quit: Bridge terminating on SIGTERM]
aterius has quit [Quit: Bridge terminating on SIGTERM]
bbigras has quit [Quit: Bridge terminating on SIGTERM]
Dandellion has quit [Quit: Bridge terminating on SIGTERM]
domenkozar[m] has quit [Quit: Bridge terminating on SIGTERM]
regnat has quit [Client Quit]
nh2[m] has quit [Quit: Bridge terminating on SIGTERM]
rnhmjoj has quit [Quit: Bridge terminating on SIGTERM]
Ox4A6F has quit [Quit: Bridge terminating on SIGTERM]
colemickens has quit [Client Quit]
worldofpeace has quit [Quit: Bridge terminating on SIGTERM]
thefloweringash has quit [Quit: Bridge terminating on SIGTERM]
saschagrunert has quit [Remote host closed the connection]
saschagrunert has joined #nixos-dev
cole-h has joined #nixos-dev
<__red__>
Potentially silly question. When we compile for say arm, in our arm build environment - that's going to create a different result than say cross-compiling to arm
<__red__>
Can nix cross-compile packages to other architectures?
<__red__>
ie: Can I get an amd64 installation of nix to build an arm boot image
<cole-h>
(I assume that's the reason nixos-unstable hasn't updated yet, despite a successful eval+build completed ~8 hours ago
<cole-h>
)
<sorear>
you could set up qemu (boot.binfmt.emulatedSystems, configuration.nix) and do a "native" build, which would be a bit more likely to be the same (expect a 5-10x slowdown from emulation)
<srhb>
cole-h: That was the reason I asked about memory, before I realized about swap.
<srhb>
cole-h: The service seems to be "activating" for a long while, and then it isn't.
<cole-h>
right
* srhb
shrugs
<__red__>
Wow
<__red__>
"It Just Works"
alp has quit [Ping timeout: 246 seconds]
<supersandro2000>
gchristensen LnL Who do I need to ask to get the darwin machine attached to ofborg? Should I create an issue?
misuzu_ has quit [Quit: leaving]
misuzu has joined #nixos-dev
ris has joined #nixos-dev
<FRidh>
is there a way to have substituteAllInplace fail when a replacement cannot be made?
alp has joined #nixos-dev
<supersandro2000>
wrap the command in if command; then true; else false; fi ?
alp has quit [Remote host closed the connection]
alp has joined #nixos-dev
<samueldr>
supersandro2000: that won't work substituteAllInPlace returns a success when it doesn't substitute anything
<samueldr>
I would suggest not proposing solutions when it's only a supposition
<supersandro2000>
most linux tools return something not 0 if they fail
<FRidh>
where to draw the line regarding backwards-incompatible changes in Nixpkgs
<FRidh>
I am changing the wrapping of Python packages, so the wrapping is separated from propagating builds. That is, you don't get all these other non-Python packages in your wrappers that happened to be propagated
<FRidh>
fixing this throughout is some work, but doable
<samueldr>
maybe describe *what* the incompatibility means?
<FRidh>
next step, is to get rid of the propagation alltogether, or at least, do it differently
<gchristensen>
I'm seeing a lot of problems with nixUnstable, even the version just backported. a lot of random mysterious failures with remote builds, deadlocks in the client, unreleased store path locks, deadlocks in the daemon which ultimately get killed after the system reaches shutdown.target, etc.
<gchristensen>
anyone seeing these?
<supersandro2000>
Do python packages rely on binaries in dependencies normally?
<FRidh>
in that first step, it means writing `requiredPythonModules` instead of `propagatedBuildInputs`
<supersandro2000>
I am having a lot of troubles with remote builds getting killed but I am not sure if it is cause if nix
<FRidh>
gchristensen: not using remote builds, but i keep having issues with running out of file descriptors
<samueldr>
FRidh: if you use propagatedBuildInputs it would fail silently, right? is there a way to make it fail loudly?
<samueldr>
or would there still be reasons to propagate a python package?
<FRidh>
samueldr: I cannot think of a way, you will really only notice during runtime that your wrappers aren't complete anymore
<samueldr>
right, the worst kind of backward incompatibilities, those that break things silently :/
<FRidh>
indeed
<supersandro2000>
only had file descriptors running out with nix when I used watchman
<samueldr>
I was thinking that python "modules" (do we have a terminology for that?) could somehow export something through passthru or $out/nix-support that tells the python builders they're python modules so that the builder could break things, FRidh
<FRidh>
anyway, now step 2) is to stop using `propagatedBuildInputs` altogether for Python packages.
<FRidh>
samueldr: exactly! That's what I am implementing now. a) using requiredPythonModules in nix, as much as possible. And b) using $out/nix-support/required-python-modules to build up $PYTHONPATH during a build
<samueldr>
could the python builders bail when a propagatedBuildInput includes that?
<samueldr>
if so, you have an annoying thing to deal with to fix builds, but magnitudes better than silently failing
<samueldr>
silently not-failing-but-not-working!
<FRidh>
yes, but I think it should still be possiblre to propagate python applications
<FRidh>
right
<samueldr>
yeah, that was what I was asking first
<FRidh>
b), creating PYTHONPATH, is done by Python's setup hook. However, I am of the opinion that packages should not have hooks. Instead, hooks should refer to the package. In that case, Python packages would only propagate the hook, but not the interpreter. That will solve certain issues when you have multiple interpreters
<gchristensen>
sigh. recursive nix is deadlocking now too. fool's errand.
<FRidh>
but for b), it would mean replacing `python` with `pythonHook` everywhere...
<FRidh>
or at least, many places
zarco has joined #nixos-dev
<FRidh>
maybe actually not that many, given python packages will propagate the hook
<FRidh>
hmm
<samueldr>
how common is it to really want to propagate a python package?