Moredread has quit [(Ping timeout: 252 seconds)]
Moredread has joined joined #nixos-dev
mbrgm has quit [(Ping timeout: 248 seconds)]
mbrgm has joined joined #nixos-dev
srodal has joined joined #nixos-dev
zraexy has joined joined #nixos-dev
srodal has quit [(Ping timeout: 258 seconds)]
JosW has joined joined #nixos-dev
srodal has joined joined #nixos-dev
octe has quit [(Ping timeout: 240 seconds)]
MichaelRaskin has quit [(Remote host closed the connection)]
octe has joined joined #nixos-dev
FRidh has joined joined #nixos-dev
<Mic92> it is quite unexpected that libsForQt5 defines its own mkDerivation instead of using the default version.
<clever> that does sound strange
<Mic92> I mean it does not do much, but to name it the same is quite sneaky
<clever> ah, i see
<clever> i would have done that with a setup hook
<clever> Mic92: also, the qt stuff exposes a nasty bug in nix-env
<clever> Mic92: basically, propagated-user-env-packages will silently collide, and one will just win over the other, leading to fun breakage
<clever> you have no way of detecting that until after it breaks things, and its not easy to track down what caused qt 5.9.0 to be installed, since nix-env -q says you never asked for it
<Mic92> clever: yes, for the same reason you can no longer use qt apps in a nix-shell properly
<Mic92> it used to have a shell wrapper before
<clever> i feel that any use of propagated-user-env-packages defeats the entire point of nix
<clever> because you can no longer have conflicting versions of qt co-existing
<Mic92> clever: background story: https://github.com/NixOS/nixpkgs/pull/26336
<Mic92> `Qt plugins are now installed in a different prefix for each minor version to prevent conflicts`
<clever> Mic92: oh, i just had a thought
<clever> the plugins are burried under ~/.nix-profile/lib/qt-5.9/
<clever> what if they where instead under /lib/qt-5.9.0/ ?
<clever> one more version element, and the conflicting ones can co-exist
<Mic92> lib/<hash>-qt-<version>
<clever> adding a hash makes it harder to provide plugins to everything the user has installed
<clever> it would only be able to update things built against the exact version the desktop env was built with
<Mic92> maybe something similar like `texlive.combine`
<clever> any kind of functional stuff to combine things would pull everything from the same nixpkgs, and it would all be the same version
<clever> so the problem wouldnt even exist
<Mic92> but then you can have still mix stuff
<Mic92> in dependent function
goibhniu has joined joined #nixos-dev
srodal has quit [(Ping timeout: 252 seconds)]
FRidh has quit [(Quit: Konversation terminated!)]
FRidh has joined joined #nixos-dev
srodal has joined joined #nixos-dev
FRidh has quit [(Ping timeout: 246 seconds)]
Mic92 has quit [(Quit: WeeChat 1.9.1)]
Mic92 has joined joined #nixos-dev
jtojnar_ has joined joined #nixos-dev
FRidh has joined joined #nixos-dev
<copumpkin> niksnut: would you expect the batch binary cache existence check to be slower for S3 binary caches than for HTTP ones? I have a vague sense that it is but haven't done any precise measurements
kuznero has joined joined #nixos-dev
<aminechikhaoui> niksnut: do you think the queries of valid paths done by nix copy --all for example could be made parallel somehow ? from what I see currently in the threads running, only one thread is doing the queries
<aminechikhaoui> eu-stack output: http://termbin.com/89kw
<kuznero> Hi All! I would like to express the desire to become a nixos github org member (eventually).
<niksnut> aminechikhaoui: yes
<niksnut> copumpkin: no
<gchristensen> copumpkin: the only thing about s3 is it is actually a bit slow
srodal has quit [(Ping timeout: 240 seconds)]
<gchristensen> so maybe s3 is just slower than your other http one
<copumpkin> maybe that's it, but it's S3 via unauthenticated HTTP vs. S3 authenticated
<copumpkin> I guess the authentication has some overhead but it doesn't seem like it would affect this much
<copumpkin> anyway, I'll measure and see if it's substantial
<aminechikhaoui> niksnut: also does nix copy caches the results in the local disk binary cache ?
<niksnut> the NAR cache?
<aminechikhaoui> niksnut: I mean the results of the queries done by nix copy
<aminechikhaoui> in a way that if I stop the nix copy cmd, it doesn't start over from the beginning and get the queries results direcly from .cache/nix/binary* stuff
<niksnut> yes, it should be cached
seppellll has joined joined #nixos-dev
<aminechikhaoui> cool, thanks
<aminechikhaoui> niksnut: also btw nix copy doesn't seem to respect SIGINT signal and keep running even if I do Ctrl-c
<niksnut> yeah there are a couple of places with sigint isn't working properly atm
<niksnut> please make an issue about it
<aminechikhaoui> sure :)
<gchristensen> or a PR! :)
<aminechikhaoui> oh I would love to start with tiny fixes like this as PRs :D maybe I'll try playing with it
<copumpkin> niksnut: btw, if you need some signal about suitability of 1.12 for release, I've been "testing" 1.12 pretty hard over the past few months and it's been working pretty well for me/my team, apart from the occasional random deadlock ;)
<niksnut> great :-)
* gchristensen should switch
<copumpkin> haven't done too much with the new UI, though
<gchristensen> that seems like the most hugely important thing to be testing!
<copumpkin> `nix copy` all over the place but I mostly still use the older tools
<copumpkin> well, everything else got rewritten in C++ too, plus all the store hierarchy getting redone
<copumpkin> so still a fair amount of new code being covered :)
<gchristensen> yeah, true
<copumpkin> oh, I do occasionally use `nix show-derivation` to explain things
<copumpkin> :D
<aminechikhaoui> `nix show-derivation` together with jq is the shit :D
<aminechikhaoui> (where is the shit == is the best ) :p
<copumpkin> sure :)
<copumpkin> aminechikhaoui: does your binary cache have WantMassQuery: 1?
<copumpkin> or whatever that field is called?
<aminechikhaoui> copumpkin: donnow it's a testing bucket, I didn't set anything really so nix-cache-info file is auto generatede
<aminechikhaoui> generated *
<copumpkin> ah
<copumpkin> anyway, might be worth that WantMassQuery: 1 in nix-cache-info
<copumpkin> not sure if it'll make it less serial
<aminechikhaoui> hm not sure from what I see in src/libstore/store-api.cc:393 it's a for loop over the paths
<aminechikhaoui> I guess that could be wrapped in a ThreadPool or something
<aminechikhaoui> something like what nix verify do
<niksnut> 699 people in #nixos!
<copumpkin> niksnut: you've created a monster!
<aminechikhaoui> haha
<goibhniu> 700 o/
<gchristensen> nice!
<copumpkin> I see a lot more random talk of Nix around the interwebz these days
<niksnut> probably they're all bots :p
<gchristensen> I only have one IRC bot thank you :P
<copumpkin> * copumpkinofborg has joined the channel
<gchristensen> so cool, I remember kmicu (where did they get off to) making announcements of milestones around ~400 people
<copumpkin> :)
<copumpkin> do we have an "avoid success at all costs" mantra?
<copumpkin> otherwise this might get out of control
kuznero has quit [(Quit: http://www.kiwiirc.com/ - A hand crafted IRC client)]
kuznero has joined joined #nixos-dev
<aminechikhaoui> copumpkin: niksnut this seems to be working https://github.com/AmineChikhaoui/nix/commit/598f0810e466ce08695bb670166f56cc41601a54 but it's just a copy paste if the nix verify behavior
<aminechikhaoui> let me know if it makes sense
kuznero has quit [(Quit: http://www.kiwiirc.com/ - A hand crafted IRC client)]
<copumpkin> probably makes sense and would help me out a lot :) also possibly of interest to you: https://github.com/NixOS/nix/issues/1619
<aminechikhaoui> copumpkin: not sure what you're trying to do there, why not just nix copy --all --to <s3_uri> ?
<aminechikhaoui> or is that a different use case
<copumpkin> I'm saying if the S3 binary cache already has all the stuff in it
<copumpkin> I don't want to download it all, build, and then have nix copy decide it's not worth uploading it all
<copumpkin> anyway, I could use --all, but that doesn't really cover my core question
<copumpkin> right now my internal expressions have a closure of about 15GB
<copumpkin> so every machine that tries to populate the cache needs to download a decent amount of crap each time for no reason
<aminechikhaoui> copumpkin: ah I see your point
<copumpkin> in my case I only use throwaway build machines
<copumpkin> so they have no real persistent cache
<cransom> re: random talk around interwebz - i was in a presentation about reproducible builds and my heart fluttered a little bit when they mentioned other projects also working on it, including nix.
FRidh has quit [(Ping timeout: 255 seconds)]
<aminechikhaoui> hm weird, after a good ~30min of querying I got this
<aminechikhaoui> $ /nix/store/wmhfbkahf212y1ydf01jfc9f9hkkakfg-nix-1.12pre1234_abcdef/bin/nix copy --all --to s3://amine-testing/
<aminechikhaoui> AWS error '' (Unable to connect to endpoint), will retry in 0 ms
<aminechikhaoui> error: AWS error fetching 'zzwpmdxvwag4s9nf3saiaq896wa6hkvg.narinfo': The AWS Access Key Id you provided does not exist in our records.
<aminechikhaoui> strange, it's like the nix-daemon suddenly ignored the env vars credentials even-though it was querying just fine in the beginning
<copumpkin> are they temporary creds?
<copumpkin> like AssumeRole or similar? those expire
<copumpkin> I didn't think they access key ID changed but I haven't paid close attention
<aminechikhaoui> copumpkin: nope valid creds passed through systemd.services.nix-daemon.serviceConfig.EnvironmentFile
<copumpkin> so IAM user creds (just access key and secret key)
<aminechikhaoui> right yeah
<copumpkin> not sure then, unless someone revoked your access key :P
<copumpkin> could also be a weird S3 thing (if you try again, does it work?
<copumpkin> like this stuff fails for all sorts of unpredictable reasons behind the scenes
<aminechikhaoui> copumpkin: seems more like an S3 weird thing :P re-running the cmd now and it seems working fine
<aminechikhaoui> but pretty frustrating if it fails at the end
<copumpkin> yeah
goibhniu has quit [(Ping timeout: 258 seconds)]
FRidh has joined joined #nixos-dev
nocent has joined joined #nixos-dev
MichaelRaskin has joined joined #nixos-dev
MoreTea has joined joined #nixos-dev
nixer has joined joined #nixos-dev
nixer has quit [(Quit: Page closed)]
goibhniu has joined joined #nixos-dev
FRidh has quit [(Quit: Konversation terminated!)]
JosW has quit [(Quit: Konversation terminated!)]
kuznero has joined joined #nixos-dev
kuznero has quit [(Quit: http://www.kiwiirc.com/ - A hand crafted IRC client)]
chaker has quit [(Quit: WeeChat 1.9.1)]
Sonarpulse has quit [(Ping timeout: 258 seconds)]
infinisil has quit [(Quit: ZNC 1.6.5 - http://znc.in)]
infinisil has joined joined #nixos-dev
srodal has joined joined #nixos-dev
goibhniu has quit [(Ping timeout: 258 seconds)]
MoreTea has quit [(Ping timeout: 255 seconds)]
<gchristensen> if anyone wants to hack on grahamcofborg: https://github.com/grahamc/network/tree/master/zoidberg/gh-event-forwarder#grahamcofborg feel free to rewrite bits in other languages :) PM me and I'll send you creds
<gchristensen> cc copumpkin ^
MichaelRaskin has quit [(Ping timeout: 258 seconds)]
LnL has quit [(Ping timeout: 252 seconds)]