gchristensen changed the topic of #nixos-borg to: https://www.patreon.com/ofborg https://monitoring.nix.ci/dashboard/db/ofborg?refresh=10s&orgId=1&from=now-1h&to=now "I get to skip reviewing the PHP code and just wait until it is rewritten in something sane, like POSIX shell. || https://logs.nix.samueldr.com/nixos-borg
orivej has joined #nixos-borg
<samueldr> hmmm, ofborg seems to have trouble responding to `build` commands?
<samueldr> (I know everyone concerned is probably asleep, and anyways I'm about to do the same)
<samueldr> though, ofborg is fine building PRs with x -> y commits
<samueldr> and from the dashboard, there's something that looks like a big difference here https://monitoring.nix.ci/d/000000002/ofborg?panelId=9&fullscreen&orgId=1&from=1540581257851&to=1541562042827
orivej has quit [Ping timeout: 272 seconds]
<gchristensen> hrm!
<gchristensen> oeutnhoenutho
<gchristensen> there is a bug where amqp loses its connection but the process doesn't die
{^_^} has quit [Remote host closed the connection]
{^_^} has joined #nixos-borg
NinjaTrappeur has quit [Ping timeout: 252 seconds]
<gchristensen> lol funny
<gchristensen> if many builds are running and sending back logs, it can overload the rabbitmq serverand it can't accept new connections for abit
<gchristensen> (can't until the logs cool down their rate)
NinjaTrappeur has joined #nixos-borg
<gchristensen> (that is, at 500 log lines per second, it gets a bit bogged down)
<LnL> that's annoying, there's no way to make it die?
<gchristensen> must be
orivej has joined #nixos-borg
<gchristensen> LnL, globin: mind giving advice on prometheus metrics?
<LnL> what's up?
<gchristensen> search for root@lucifer.ewi.tudelft.nl
<gchristensen> I think name, mandatoryFeatures, supportedFeatures, systemTypes are labels andthe rest are metrics, but how would I convert thoselists to labels?
<LnL> ah, not sure
<gchristensen> or let me pose the question differently
<gchristensen> what metrics would you emit?
<LnL> remapping labels, etc. is a bit of black magic to me
<gchristensen> oh, not remapping
<gchristensen> just like ...
<gchristensen> if you were to make prom metric output for this machine data, what would it look like?
<LnL> oh like the metrics line?
<gchristensen> yea
<LnL> never did that manually, but I could probably find something
<gchristensen> :/ not looking for that either. but how should the data look
<gchristensen> heh
<gchristensen> like
<LnL> but I think you just use a separate line for each value
<gchristensen> current_jobs{host="root@ike.ewi.tudelft.nl" systemtypes="i686-linux,x86_64-linux"} 1 ?
<gchristensen> current_jobs{host="root@ike.ewi.tudelft.nl" i686-linux="1" x86_64-linux="1"} 1 ?
<LnL> no I mean 'metric{features="x86_64-linux"}' and 'metric{features="i686-linux"}'
<LnL> then you can sum() by()
<gchristensen> ah cool!
<LnL> or is that not what you want
<gchristensen> that might do!
<LnL> it's not entirely correct tho since the value is only for one of those
<gchristensen> yea
<gchristensen> :/
<gchristensen> ugly for machineTypes too
MichaelRaskin has joined #nixos-borg
{^_^} has quit [Read error: Connection reset by peer]
{^_^} has joined #nixos-borg