gchristensen changed the topic of #nixos-dev to: NixOS Development (#nixos for questions) | https://hydra.nixos.org/jobset/nixos/trunk-combined https://channels.nix.gsc.io/graph.html | 18.03 release managers: fpletz and vcunat | https://logs.nix.samueldr.com/nixos-dev
timokau has joined #nixos-dev
jcrben has left #nixos-dev ["The Lounge - https://thelounge.github.io"]
<infinisil> samueldr: Thanks for requesting my review on #44923 :)
<{^_^}> https://github.com/NixOS/nixpkgs/pull/44923 (by Vodurden, 20 hours ago, open): nixos/thermald: add manual config generation
<samueldr> in my eyes you're kinda the best one to find everything wrong with modules :)
<infinisil> I'm a bit conflicted on this PR, because on one hand the NixOS checked config is nice, but on the other hand I'm not sure if it's worth adding almost 40 new options for something that will be used by very few
<samueldr> yeah, I was wondering if this would affect the speed
<samueldr> at a glance, I think they create xml strings by concatenation, isn't there a way to create XML from structured attrsets?
<samueldr> (that's lazy-me not even looking things up)
<infinisil> Unfortunately builtins.toXML doesn't do that
phreedom has quit [Remote host closed the connection]
<infinisil> (I just checked myself earlier)
phreedom has joined #nixos-dev
<samueldr> ah, thanks
<samueldr> though, for the options, is there an issue/meta-issue tracking whatever is being done to reduce the issue of having too many options?
<samueldr> I kinda hope one day to have everything possible through nix :/
<infinisil> I don't know of any :(
<infinisil> A possibly better alternative to these 40 new options is to do something similar like I did in #41467
<{^_^}> https://github.com/NixOS/nixpkgs/pull/41467 (by Infinisil, 9 weeks ago, open): [WIP] znc: more flexible module
<infinisil> (I should finish this, yeah..)
<infinisil> This only adds 1 option, but is better than just using a string as a config file. Like this you also get the guarantee of a syntactically correct file.
<samueldr> infinisil: yeah, such a thing could very well work, they seem like a bright individual, they probably can run with the idea
<infinisil> Maybe it's possible to run thermald on the config file during build time to check whether the options are correct
<samueldr> infinisil: lazy-me again: I don't think there's documentation *about* structuring modules that way, right?
<infinisil> Nope, not that I know of either
<samueldr> okay, then please indulge a bit of questioning :)
<infinisil> I am the first I see try this
<infinisil> Will do
<samueldr> would they show up under `man configuration.nix`?
<infinisil> In my znc PR it only shows 1 option, and the user is asked to look up available ones in the packages docs
<samueldr> hmmm, ah right, it's all "non-binding", "just" outputting the attrsets structured for their conf format
<samueldr> right?
<infinisil> Yup pretty much
<samueldr> would it be realistic to figure out a way to make it still be one option, but be introspectable?
<infinisil> Hmm..
<samueldr> not *forcibly*, but a well-intentioned contributor could document available options
<samueldr> then (with changes possibly) they could show up in configuration.nix
<infinisil> Maybe an example of a full config?
<infinisil> Oh I see
<samueldr> I'm mostly thinking about options.html and man configuration.nix
<samueldr> (and a bit of spitballing)
<infinisil> Actually that doesn't sound as impossible as I first thought it would
<ekleog> Can someone (re)review two PRs and consider merging? they're adding new packages :) https://github.com/NixOS/nixpkgs/pull/44148 / https://github.com/NixOS/nixpkgs/pull/44288
<{^_^}> #44148 (by Ekleog, 2 weeks ago, open): javacard-devkit: init at 2.2.2
<{^_^}> #44288 (by Ekleog, 1 week ago, open): global-platform-pro: init at 0.3.10-rc11
<infinisil> samueldr: Although, I'm not even sure now: Do submodules options add to the evaluation time?
<samueldr> infinisil: you're the expert, that's why I'm deferring to you!
<infinisil> Heh right
* infinisil thinks
<gchristensen> yes they do
lassulus_ has joined #nixos-dev
<infinisil> gchristensen: Hmm, but in my thinking I'm coming to the conclusion that it doesn't have to be that way
<infinisil> Unless I'm missing something
<gchristensen> no idea, better ping nbp :)
lassulus has quit [Ping timeout: 272 seconds]
lassulus_ is now known as lassulus
<infinisil> I should really just test this quickly
<infinisil> Add a module with 100000 suboptions and see if it's slower :)
<infinisil> gchristensen: Does indeed, you were right
Lisanna has quit [Remote host closed the connection]
_rvl has joined #nixos-dev
Taneb has quit [Quit: I seem to have stopped.]
Drakonis has quit [Remote host closed the connection]
orivej has quit [Ping timeout: 244 seconds]
<ekleog> ,
<{^_^}> All commands: -A IFD NUR arm ask bootfull callPackage channels cloudfront context dnw error escape" escape'' escape-special fancy-uninstall github hardware haskell help home-manager howoldis library logs nix-env-r nix-info nix-repl nixGL nixcon nixeval nixpkgsVersion not-os notfound outPath overlay paste pills pinning pr profiling pure-eval python qt replaceModule runtimeDeps stateVersion stuck thesis timer todeclarative tofu unfree unstable which-ch
<ekleog> ,help
<{^_^}> Use `,` to list all commands, `,foo = Foo!` to define foo as "Foo!", `,foo =` to undefine it, `,foo` to output "Foo!", `,foo somebody` to send "Foo!" to the nick somebody
<ekleog> hmm was there no command to ask {^_^} to tell something to someone when they come back on IRC?
<MichaelRaskin> I think this list is about abbreviations, and other functionality is not described here
<ekleog> !help
<ekleog> hmmm no that's not it…
<ekleog> ,tell ekleog test
<{^_^}> ekleog: I'll pass that on to ekleog
<ekleog> ,tell abc123azerty
<{^_^}> ekleog: 21 seconds ago <ekleog> test
<{^_^}> ekleog: I'll pass that on to abc123azerty
<ekleog> hmm obviously it's +r so I can't actually test with abc123azerty without registering it… anyway, it looks like it works, thanks MichaelRaskin!
<ekleog> ,tell Sonarpulse Hey! Sorry to bother you, but do you have any opinion about https://github.com/NixOS/nixpkgs/pull/44439#pullrequestreview-144181130 ? :)
<{^_^}> ekleog: I'll pass that on to Sonarpulse
<MichaelRaskin> #44439
<{^_^}> https://github.com/NixOS/nixpkgs/pull/44439 (by Ekleog, 1 week ago, open): [RFC] Use `meta.tests` to link from packages to the tests that test them
obadz- has joined #nixos-dev
obadz has quit [Ping timeout: 240 seconds]
obadz- is now known as obadz
goibhniu has joined #nixos-dev
Taneb has joined #nixos-dev
__Sander__ has joined #nixos-dev
<infinisil> ekleog: I'll improve the bots docs eventually when I have more time :)
<ekleog> :D
__Sander__ has quit [Ping timeout: 256 seconds]
__Sander__ has joined #nixos-dev
<srhb> Is it intentional that colons have become illegal in hydra jobset identifiers?
Lisanna_ has joined #nixos-dev
<srhb> huh, or maybe it's numeric jobsets...
init_6 has joined #nixos-dev
MichaelRaskin has quit [Quit: MichaelRaskin]
<LnL> that doesn't count
orivej has joined #nixos-dev
lopsided98 has quit [Ping timeout: 240 seconds]
lopsided98 has joined #nixos-dev
Drakonis has joined #nixos-dev
vcunat has joined #nixos-dev
<aminechikhaoui> is there a way to make builtins.fetchMercurial/nix-prefetch-hg return the same store path :( ?
<manveru> aminechikhaoui: no, they're completeley different ways of fetching :|
<gchristensen> y'all nerdsniped me in to trying to do this testing with qemu and I'm not sure it was the right choice
<vcunat> :-)
<aminechikhaoui> manveru: yeah bummer, it makes my hydra binary cache useless
<aminechikhaoui> was looking if there was a hack to make them compatible
<vcunat> aminechikhaoui: builtins.fetch* can't work with binary caches
<vcunat> in principle
<vcunat> At least in the variant where you call them without a fixed hash.
<aminechikhaoui> yeah well a rev is equivalent I think
<aminechikhaoui> niksnut: would it make sense to switch hydra to use builtins.fetch* instead of nix-prefetch-* ?
<vcunat> I assumed hydra jobsets are using something that caches the repository.
<aminechikhaoui> vcunat: yeah, same for the builtins, it just uses a different path .cache/nix/{hg/git}
<aminechikhaoui> hydra also stores the metadata uri/branch/rev etc in the db I think, but that can be kept I guess
<vcunat> some of these are shown in the UI and must be kept in some way
__Sander__ has quit [Quit: Konversation terminated!]
<niksnut> aminechikhaoui: yeah, that would be pretty nice
<aminechikhaoui> niksnut: cool, I'll experiment with updating the current plugins
<Dezgeg> gchristensen: what's wrong with qemu?
<gchristensen> doing it in nix-build specifically, I mean, where I need to mock out cachen.ixos.org and more
<niksnut> aminechikhaoui: though vcunat is right that the scm cache is currently used in the web interface, though I'm not sure we should keep that
<Dezgeg> the nixos test interface doesn't necessarily have to run inside a nix-build though
<aminechikhaoui> niksnut: oh probably used in the diff thingy ?
<vcunat> I primarily meant showing the commit hashes in evaluation listings (which should be kept). The cache part isn't something I even have access to on Hydra.nixos.org :-)
<vcunat> so I don't know of any practical cases when it can be useful.
<vcunat> In *our particular* case the diff thingy might benefit from being a github URL instead.
<aminechikhaoui> vcunat: I think that part is done through the database but probably what could also be impacted is the api view (https://hydra.nixos.org/api/scmdiff)
<aminechikhaoui> but I think if builtins.fetch* and nix-prefetch-* use the same hashing of urls for the cloned paths then we can probably make the scm folder a hydra config that can be updated to .cache/nix/
<timokau[m]> Is there any way I can directly build something on the lucifer build machine? The ntl tests are still failing and I can neither reproduce it nor find anybody else that can.
<gchristensen> timokau[m]: so do you have patches you want to directly test there?
<gchristensen> I don't think hydra has a way to do it, but we might be able to sort something out for a specific patch
<timokau[m]> gchristensen: Kind of. I could think of three things to try: 1. just repeat the build as-is, check if it is a transient failure 2. set the architecture to "generic" in the build (currently is x86 and the failure is sigint) 3. try to build gmp on that machine
<timokau[m]> 3. is because the ntl author suggested that he does not believe the problem is actually an ntl problem: https://github.com/NixOS/nixpkgs/pull/43679
<{^_^}> #43679 (by timokau, 3 weeks ago, merged): ntl: 9.11.0 -> 11.2.1
<timokau[m]> So it might actually be a problem of a dependency that just happened to be built on another machine that doesn't trigger the error
<gchristensen> it would be neat if each machine had a feature of its own name so you could temporarily pin one to the other
<timokau[m]> I meant to directly link to the authors comment: https://github.com/NixOS/nixpkgs/pull/43679#issuecomment-406447954
tv has quit [Ping timeout: 276 seconds]
<timokau[m]> Yeah for this purpose it would be nice to be able to explicitly select a builder
<timokau[m]> That would still require pushing experimental changes to master and waiting for a rebuild though
<gchristensen> or creating a jobset, yeah
<timokau[m]> That would exceed my privileges, but at least it would be an option with help of somebody that has those privileges
<timokau[m]> Otherwise I'll just have to go the very slow route and start by setting the arch to generic. Then see if it fails at some time in the future when it happens to hit the same builder again. But maybe I'd be setting the arch to generic for no reason at all and the performance of ntl suffers
<gchristensen> sounds painful :)
<timokau[m]> Yes, thats why I haven't fixed the failure yet :/
<gchristensen> I'm seeing if I can help you
<Dezgeg> anybody capable of uploading to tarballs.nixos.org? updating to new bootstrap tools would fix https://github.com/NixOS/nixpkgs/issues/24954 and workaround https://github.com/NixOS/nixpkgs/issues/36947 so it'd be nice to do it soonish before the release
<{^_^}> #24954 (by hsenag, 1 year ago, open): busybox in bootstrap-tools doesn't work in WSL
<{^_^}> #36947 (by dtzWill, 21 weeks ago, open): libgcc_s is from bootstrap tools??
Drakonis has quit [Remote host closed the connection]
<clever> Dezgeg: oh, i recently discovered that texinfo leaks a dep on the bootstrap-tools
<gchristensen> niksnut, copumpkin[m], LnL ^ bootstrap tool update?
<vcunat> the leak shouldn't be really related to the update AFAIK
<vcunat> (wrt. what needs to be done)
<clever> ah, already handled here https://github.com/NixOS/nixpkgs/pull/44932
<{^_^}> #44932 (by oxij, 1 day ago, open): stdenv: linux: inherit texinfo in stage4 instead of the final stdenv
<LnL> gchristensen: hmm?
<gchristensen> LnL: can you upload? I don't remember
<LnL> ah yes
<LnL> but ai think the linux tarball hasn't changed in a long time
<LnL> has it?
<Dezgeg> it's not that old I think
tv has joined #nixos-dev
<Dezgeg> hm, 2014, longer than I thought
<Dezgeg> oh, no, 2016, I missed some commit
vcunat has quit [Quit: Leaving.]
<LnL> heh, so I'd be surprised if this is an issue before it's unpacked
<LnL> the darwin tarball is different, 'cause apple
<timokau[m]> gchristensen: ping? (lucifer issue)
<gchristensen> yep, still trying :P
<timokau[m]> gchristensen: Oh, thanks. What are you trying? Just to get hold of somebody with privileges?
<gchristensen> I'm waiting for the big garbage collector lock...
vcunat has joined #nixos-dev
Ericson2314 has joined #nixos-dev
Ericson2314 has quit [Read error: Connection reset by peer]
Ericson2314 has joined #nixos-dev
init_6 has quit [Ping timeout: 260 seconds]
<gchristensen> niksnut: I wonder if the queue runner is able to adequately feed many build hosts
<LnL> I don't think the queue-runner does much
<gchristensen> isn't it actually distributing the work
<gchristensen> ?
<niksnut> yeah, it can certainly become a bottleneck
<LnL> does it do anything except start an ssh connection? we don't have _that_ many builders
<gchristensen> well if it is doing, say, a load of linux x86 builds it won't do macs or aarch64
<vcunat> I/O
<vcunat> all outputs are streamed through it, at least
<LnL> oh!
<vcunat> which means, it does the signing, etc. right?
<LnL> right it does the upload (and compression?)
<vcunat> We might run something like a hundred build steps at once with the current machines.
<gchristensen> even beyond IO, will it even try to use all the cores of every machine if it is prioritizing a job with no aarch64 jobs?
<vcunat> I have no idea about the implementation. I might have a look at the scheduling algorithm one day, if that will be considered a bottleneck.
<gchristensen> me either :)
<vcunat> The platforms are disjunct problems, really. (three groups ATM)
<gchristensen> right
<timokau[m]> gchristensen: No luck? (lucifer, sorry for continually bothering you with this)
<gchristensen> timokau[m]: sorry, it doesn't seem to be in the cards for today
<gchristensen> more irons in the fire than I can watch right now.
<timokau[m]> gchristensen: alright thanks anyways. Do you have any idea what I can do myself?
<gchristensen> no iead :/
<gchristensen> ping me again tomorrow-ish?
<timokau[m]> gchristensen: okay
vcunat has quit [Ping timeout: 256 seconds]
elvishjerricco_ has joined #nixos-dev
angerman_ has joined #nixos-dev
vcunat has joined #nixos-dev
terrorjack_ has joined #nixos-dev
dtz[m] has quit [*.net *.split]
angerman has quit [*.net *.split]
andi- has quit [*.net *.split]
terrorjack has quit [*.net *.split]
elvishjerricco has quit [*.net *.split]
hiberno has quit [*.net *.split]
cocreature has quit [*.net *.split]
angerman_ is now known as angerman
elvishjerricco_ is now known as elvishjerricco
terrorjack_ is now known as terrorjack
cocreature has joined #nixos-dev
andi- has joined #nixos-dev
hiberno has joined #nixos-dev
Lisanna_ has quit [Quit: Lisanna_]
vcunat has quit [Quit: Leaving.]
lopsided98 has quit [Quit: Disconnected]
lopsided98 has joined #nixos-dev
Lisanna has joined #nixos-dev
init_6 has joined #nixos-dev
init_6 has quit []