03:03
lassulus_ has joined #nixos-dev
03:05
lassulus has quit [Ping timeout: 240 seconds]
03:05
lassulus_ is now known as lassulus
05:55
Cale has quit [Remote host closed the connection]
08:42
orivej has joined #nixos-dev
10:31
<
domenkozar >
/nix/store/ckq71kkymh1ji2b44xn80wmr7fmi6wr5-clang-wrapper-5.0.2/bin/cc: line 183: /nix/store/bcl9zj60h52p47dy85s326mdrqx52417-clang-5.0.2/bin/clang: Argument list too long
10:32
<
domenkozar >
haskell is 10% and 90% fighting limits :D
10:33
goibhniu has joined #nixos-dev
10:36
<
domenkozar >
LnL: is that a known issue?
10:37
<
domenkozar >
what's interesting is, why did my project compile with 18.03 and GHC 8.2?
10:37
<
domenkozar >
oh this is the old linker limit
10:37
<
srhb >
domenkozar: The only change I'm aware of that drastically changed this was during 17.09 cycle, I think
10:38
<
domenkozar >
just a different error :)
10:39
<
LnL >
kind of, something recent increased the amount of flags significantly
10:39
<
srhb >
Really? I thought most of the unintentional cross blowup was fixed recently, with strictDeps and such
10:39
<
domenkozar >
wish I had a macos to debug this
10:40
<
srhb >
domenkozar: can't you just lower ARG_MAX to emulate this specific issue?
10:41
<
srhb >
Oh, it wasn't merged yet...
10:41
<
srhb >
41420 was what I was talking about.
10:42
<
domenkozar >
the breakage seems to have occurred sometime after commit 91ca88b and before commit d91c701
10:44
<
domenkozar >
I really think we should just revert whatever broke this
10:46
<
LnL >
that looks like a pretty big diff, you can probably get a better delta from hydra
10:47
<
domenkozar >
yikes :D
10:47
<
srhb >
I'm really not certain that the breakage occurred between those commits. As far as I've seen, the limit was hit during before 18.03 for a lot of things
10:48
<
srhb >
But since it's just a limit, and dependencies can change that, it's hard to tell
10:48
<
LnL >
that's like half
10:48
<
domenkozar >
yeah, but it got lower
10:48
<
domenkozar >
I was easily able to build my project before
10:48
<
domenkozar >
angerman actually fixed this properly in ghc
10:48
<
domenkozar >
but it will only hit 8.6
10:50
<
domenkozar >
oh it's actually in master
10:52
<
domenkozar >
I'm trying nixpkgs commit 91ca88b3e6b4d57640c213e755077b2d93d0a8bd
10:56
taktoa has joined #nixos-dev
11:06
<
angerman >
Yep the dylib stuff was baclported for 8.2 and 8.4
11:07
<
angerman >
It reduces the load command size by ~66%
11:10
<
domenkozar >
yeah I think this error is not about linker command but rather actualy clang arg list
11:12
<
LnL >
yes, this is something different
11:13
<
LnL >
ghc isn't the only thing that suffers from it either
11:14
<
domenkozar >
nor gcc it seems :)
11:14
<
srhb >
Really? I can't imagine that any clang call that isn't related to linking is long enough to hit arg_max when combined with the environment.
11:14
<
srhb >
Unless the env is already really large.
11:14
<
srhb >
(Which it probably is...)
11:15
<
LnL >
maybe arg_max is a bit lower on darwin?
11:17
<
domenkozar >
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/sys/syslimits.h
11:17
<
domenkozar >
need to check that for each macos version
11:17
<
srhb >
LnL: Yes, about one eighth of that of Linux
11:18
<
LnL >
eh, /Library/Developer/CommandLineTools?
11:18
<
domenkozar >
well <sys/syslimits.h>
11:19
<
domenkozar >
it's 256k
11:24
<
domenkozar >
should have a set structure in nix :P
11:26
<
domenkozar >
or unique list that's not O(n^2)
11:29
taktoa has quit [Remote host closed the connection]
11:37
<
domenkozar >
down to 318 commits :)
11:38
<
domenkozar >
anyone has a macos I can borrow?
11:38
<
angerman >
Ahh that clang args limit.
11:38
<
angerman >
I’ve a fix for that in my local nixpkgs branch as well.
11:39
<
angerman >
Essentially you need to stop the Haskell builder from producing `lib` folders.
11:40
<
domenkozar >
is it a ghc fix?
11:40
<
domenkozar >
or nix builder?
11:40
<
angerman >
the nix builder.
11:41
<
domenkozar >
angerman: if you can dig up that fix I'd be grateful :)
11:41
<
angerman >
The underlying issue is the following: we have `$out/lib` for each haskell library we build. However that folder is mostly useless for anything but haskell.
11:42
<
angerman >
However the cc-wrapper logic, puts any `$out/lib` folder of the dependencies into the NIX_CLFAGS.
11:42
<
angerman >
Now you end up with $pkg/lib for each haskell dependency, as well as `$pkg/lib/ghc8.4.../` that GHC forwards to the compiler/linker.
11:42
<
angerman >
and that overruns your limit.
11:43
<
angerman >
So a qhick fix is to just mutilate the haskell pkg builder, to stop it from generating `lib` folders.
11:43
<
angerman >
The
*proper* fix would be to use response-files in the cc-wrapper, so that we pass `@args-file` to `clang` or `gcc` instead of passing the flags on the command line.
11:44
<
domenkozar >
does clang support that?
11:44
<
angerman >
Stopping the cc-wrapper from adding `$pkg/lib` for haskell packages, is also sensible.
11:47
<
domenkozar >
I wonder if /lib reliance breaks anything
11:47
<
angerman >
hasn't for me :-)
11:48
<
angerman >
of course if you try to link against haskell libraries from else where, you might end up with issues.
11:49
<
domenkozar >
interesting :)
11:49
<
angerman >
but even taht wouldn't work yet properly, as you'd need to custom-add the proper search path's anyway.
11:49
<
angerman >
in $out/lib, there's nothing you could properly link against. It's all in `$out/lib/ghc-$version`.
11:50
<
domenkozar >
this also pushes the linker limit a few 100 chars further :P
12:37
<
domenkozar >
LnL: btw, is /usr/bin/security allowed in macos sandbox?
12:37
<
domenkozar >
right now lots of haskell packages on macos depend on x509, which brings in SecurityTool
12:37
<
domenkozar >
which pulls in the world
12:39
<
LnL >
no, what's wrong with darinw.security_tool?
12:42
<
domenkozar >
pulls in ton of stuff
12:44
<
LnL >
like what? just some frameworks afaik
12:44
<
domenkozar >
$ nix-store -qR /nix/store/gsvjs6fp1hrpxady3hgb7d6c1264y1z8-SecurityTool-55115 | wc -l
12:45
<
domenkozar >
$ nix-store -qR /nix/store/gsvjs6fp1hrpxady3hgb7d6c1264y1z8-SecurityTool-55115 | du -sh
12:45
<
domenkozar >
2.2G .
12:46
<
LnL >
huh, that's probably one culprit the most of those paths should be really small
12:47
<
domenkozar >
eh, du doesn't work as a pipe, lol
12:49
<
LnL >
yeah, the sdk shouldn''t be in there
12:50
<
domenkozar >
and there's duplicate store paths
12:50
<
domenkozar >
31M /nix/store/blawd9czgsl7bxb4i63z9rw0bmfxn073-ICU-osx-10.10.5
12:50
<
domenkozar >
31M /nix/store/x17m259z4cac95y0py8s4y78b6s95iii-ICU-osx-10.10.5
12:50
<
domenkozar >
2.5M /nix/store/wv04hpqqfvr23m6f2kksv7ad5kaj69r3-CF-osx-10.10.5
12:50
<
domenkozar >
2.5M /nix/store/z9imly1f3lwc90irij4gx9j9b1nn43ij-CF-osx-10.10.5
12:51
<
LnL >
and might be possible to avoid python, not sure
12:52
<
domenkozar >
"/nix/store/x38ln6gxa3myclbcw8a2mcg140s3mmmn-Libsystem-osx-10.11.6" -> "/nix/store/wv04hpqqfvr23m6f2kksv7ad5kaj69r3-CF-osx-10.10.5" [color = "red"];
12:52
<
domenkozar >
"/nix/store/x38ln6gxa3myclbcw8a2mcg140s3mmmn-Libsystem-osx-10.11.6" -> "/nix/store/z9imly1f3lwc90irij4gx9j9b1nn43ij-CF-osx-10.10.5" [color = "green"];
12:53
* domenkozar
scratches head
12:55
<
LnL >
that's darwin.CF and stdenv.__bootPackages.darwin.CF
12:56
<
domenkozar >
so the latter shouldn't be propagated?
12:56
<
LnL >
yeah, not sure how it ends up in the closure
12:57
<
domenkozar >
$ grep -Ra /nix/store/12r38kqsdlgn9h1k49l43hzhjgrnkaxx-python-2.7.15 /nix/store/a75h1bpv686dachi1wg5rcrcvc5rvk9y-MacOS_SDK-10.10 2>/dev/null
12:57
<
domenkozar >
/nix/store/a75h1bpv686dachi1wg5rcrcvc5rvk9y-MacOS_SDK-10.10/Library/Frameworks/Python.framework/Examples/PyObjC/2.5.1/AppKit/SimpleService/rebuild.py:#!/nix/store/12r38kqsdlgn9h1k49l43hzhjgrnkaxx-python-2.7.15/bin/python
12:57
<
domenkozar >
/nix/store/a75h1bpv686dachi1wg5rcrcvc5rvk9y-MacOS_SDK-10.10/Library/Frameworks/Python.framework/Examples/PyObjC/2.5.1/AppKit/TinyURLService/rebuild.py:#!/nix/store/12r38kqsdlgn9h1k49l43hzhjgrnkaxx-python-2.7.15/bin/python
12:57
<
domenkozar >
/nix/store/a75h1bpv686dachi1wg5rcrcvc5rvk9y-MacOS_SDK-10.10/Library/Frameworks/Python.framework/Examples/PyObjC/2.5.1/Scripts/autoreadme.py:#!/nix/store/12r38kqsdlgn9h1k49l43hzhjgrnkaxx-python-2.7.15/bin/python
12:58
<
domenkozar >
lots of low hanging fruit apparently
12:59
<
LnL >
ah the sdk pulls in python, that's good news since it shouldn't be in the closure anyway
13:00
<
domenkozar >
oh it shouldn't?
13:00
<
LnL >
probably a good idea to use disallowedReferences for basically anything that uses the sdkk
13:02
<
LnL >
didn't you fix a bunch of stuff to copy headers over instead of symlinking them a while back?
13:03
<
domenkozar >
yeah for private sdk
13:03
<
domenkozar >
that was low hanging fruit back then
13:04
<
LnL >
ah, well same goes for the sdk no need to download the headers of
_all_ frameworks if you just depend on Foundation
13:04
<
domenkozar >
nice :)
13:05
<
domenkozar >
ok let me open an issue, go surfing and fix that once I'm back :)
13:08
<
LnL >
heh, have fun! :)
13:14
goibhniu has quit [Ping timeout: 256 seconds]
13:18
goibhniu has joined #nixos-dev
15:17
orivej has quit [Ping timeout: 264 seconds]
15:52
Lisanna has joined #nixos-dev
15:52
obadz has quit [Ping timeout: 265 seconds]
15:53
obadz has joined #nixos-dev
16:19
aszlig has quit [Quit: Kerneling down for reboot NOW.]
16:21
aszlig has joined #nixos-dev
16:24
<
aszlig >
niksnut/ikwildrpepper: what was the last time a kernel upgrade has been done on the Hydra build slaves?
16:26
<
aszlig >
and when i force a rebuild for 892a0e8ff40e8282fb09ee6c8a132979c5539191^ it still fails on my kernel, so i suppose the build has passed on a machine with an older kernel
16:28
<
aszlig >
s/already/fix is &/
16:32
<
aszlig >
so my idea would be to add a patch to openblas which is only used on i686-linux and the next staging merge will drop that patch so we avoid a mass-rebuild
16:32
<
aszlig >
does that sound good or should i just bump to 3.0.1?
16:35
<
niksnut >
aszlig: last week or so
16:36
<
niksnut >
upgraded to 18.03
16:36
<
aszlig >
niksnut: okay, that would explain that
16:38
<
aszlig >
so bumping openblas would mean 4795 rebuilds
16:40
<
aszlig >
so i'd go for just bumping without going through staging, any objections?
16:42
<
niksnut >
why does so much depend on openblas btw?
16:42
<
aszlig >
niksnut: probably because of boost
16:42
<
dtz >
"nix why-depend everything openblas", lol :P (dunno)
16:44
<
aszlig >
well, opencv would be a larger one, but that's it
16:47
<
niksnut >
I guess the real question is "why do the tests of a math package depend on the kernel version"
16:59
<
aszlig >
niksnut: i haven't dug into that sufficently but from what i can see it seems that it wasn't just the tests
17:04
<
aszlig >
hm, even looking through swap.S i can't see why anything would depend on the kernel version
17:05
aristid has quit [Ping timeout: 260 seconds]
17:07
aristid has joined #nixos-dev
17:08
<
aszlig >
niksnut: ah, it's numpy and boost indeed, because it depends on numpy
17:09
<
niksnut >
boost depends on numpy? :o
17:09
<
aszlig >
niksnut: if enablePython is true, yes
17:09
<
aszlig >
and/or enableNumpy
17:09
<
niksnut >
then that should be disabled by default
17:10
<
niksnut >
we can't have boost pulling in crap like that
17:19
<
aszlig >
you already turned it off
17:20
<
aszlig >
let's see how much will break now
17:23
<
aszlig >
i guess it should only be a small fraction of packages, for that we can still override boost with python support
17:32
orivej has joined #nixos-dev
17:38
orivej has quit [Ping timeout: 256 seconds]
18:10
Sonarpulse has joined #nixos-dev
18:22
Sonarpulse has quit [Ping timeout: 245 seconds]
18:27
<
dtz >
\o/ good find
18:38
goibhniu has quit [Ping timeout: 240 seconds]
18:41
<
domenkozar >
gchristensen: btw I'm not on the list for 2FA issue
18:41
<
domenkozar >
is that a bad script or?
18:41
<
domenkozar >
ah probably because I have 2FA :D
18:42
<
gchristensen >
I assume it is because, indeed, you have 2FA :)
18:42
<
domenkozar >
always a minority
18:43
<
gchristensen >
luckily the majority of nixpkgs committers have 2fa turned on
18:43
<
gchristensen >
(they were majority by like 2 people when we made the list)
18:43
<
domenkozar >
nice :)
18:44
<
domenkozar >
either most of people are working for cryptocurrency startups or we've been hacked a couple of times
18:44
<
domenkozar >
ok I'm back to serious now :P
18:46
<
gchristensen >
I have to leave my hotel tomorrow at 5am to get to the flight on time ...
18:46
<
domenkozar >
from london?
18:46
<
gchristensen >
yeah
18:47
<
domenkozar >
well at least it's tomorrow, france ATC were having strikes over all weekends in June
18:47
<
gchristensen >
oh man
18:47
<
domenkozar >
was stuck in Milano eating just rice
18:47
<
domenkozar >
(they have to provide meals)
19:10
orivej has joined #nixos-dev
20:59
<
infinisil >
Literally unreadable
21:41
goibhniu has joined #nixos-dev
22:43
Sonarpulse has joined #nixos-dev
23:47
Sonarpulse has quit [Ping timeout: 265 seconds]