01:20
ryantrinkle has joined #nixos-aarch64
01:25
orivej has quit [Ping timeout: 276 seconds]
02:09
<
samueldr >
the NixOS on ARM section of the Wiki really needs a rework
02:09
<
samueldr >
well, the main page, mainly
02:13
<
gchristensen >
the ZFS article does too
02:13
<
samueldr >
the difference is I don't have the domain knowledge for ZFS :)
02:44
<
samueldr >
if you haven't seen, gchristensen, #75069 actually packages neatly the ODROID-C2 u-boot build
02:52
h0m1 has quit [Ping timeout: 252 seconds]
02:52
<
simpson >
Exciting.
02:54
h0m1 has joined #nixos-aarch64
03:14
<
samueldr >
oops, all mobile-nixos devices have the serial number 012345789 as a placeholder in adb
03:14
<
samueldr >
not useful for debugging another device
03:17
cptchaos83 has joined #nixos-aarch64
05:35
<
samueldr >
lopsided98++
05:35
<
{^_^} >
lopsided98's karma got increased to 11
05:54
zupo has joined #nixos-aarch64
07:06
orivej has joined #nixos-aarch64
07:16
zupo has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
07:25
vika_nezrimaya has joined #nixos-aarch64
07:28
zupo has joined #nixos-aarch64
07:51
zupo has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
08:25
Aleksejs is now known as kurogizesa
08:44
sphalerite_ is now known as sphalerite
09:55
vika_nezrimaya has quit [Ping timeout: 250 seconds]
10:21
FRidh2 has joined #nixos-aarch64
11:09
zupo has joined #nixos-aarch64
11:10
zupo has quit [Client Quit]
11:12
kurogizesa is now known as Aleksejs
11:12
Aleksejs is now known as kurogizesa
11:16
<
gchristensen >
nice!
11:18
kurogizesa is now known as Aleksejs
11:20
zupo has joined #nixos-aarch64
11:34
FRidh2 has quit [Ping timeout: 240 seconds]
11:34
FRidh2 has joined #nixos-aarch64
12:16
vika_nezrimaya has joined #nixos-aarch64
12:48
zupo has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
13:01
zupo has joined #nixos-aarch64
13:04
vika_nezrimaya has quit [Ping timeout: 265 seconds]
13:13
zupo has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
13:17
zupo has joined #nixos-aarch64
13:27
chris| has quit [Ping timeout: 245 seconds]
13:33
chris| has joined #nixos-aarch64
13:41
zupo has quit [Ping timeout: 250 seconds]
13:42
zupo has joined #nixos-aarch64
14:00
<
flokli >
anybody importing nixos/modules/installer/cd-dvd/sd-image.nix from their nixos config and running into infinite recustion issues?
14:08
FRidh2 has quit [Ping timeout: 265 seconds]
14:08
FRidh2 has joined #nixos-aarch64
14:16
<
flokli >
hmm, turned out, I'm not supposed to use pkgs.path from INSIDE my configuration. At least not while importing other stuff.
14:20
<
gchristensen >
samueldr: export NIX_PATH="nixpkgs=$PWD/../nixpkgs" ?
14:27
ryantrinkle has quit [Ping timeout: 276 seconds]
14:28
ehmry is now known as ehmry_
14:32
ehmry_ has left #nixos-aarch64 [#nixos-aarch64]
14:42
<
tilpner >
flokli: Possible workaround: modulesPath
14:43
<
tilpner >
flokli: { modulesPath, ... }: { imports = [ "${modulesPath}/installer/cd-dvd/sd-image.nix" ]; }
14:43
<
flokli >
gchristensen: NIX_PATH is empty, all is pinned and self-contained
14:43
<
gchristensen >
except $PWD/../nixpkgs is outside of the repository and unspecified :)
14:44
<
flokli >
ah wait, gchristensen's reply wasn't related to my question
14:44
<
flokli >
tilpner: sweet, will give it a try, too :-)
15:08
zupo has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
15:36
ryantrinkle has joined #nixos-aarch64
15:46
<
gchristensen >
dang
15:47
<
flokli >
hmm, in fact, I probably shouldn't import the module from the generic config, but only load it if I want to produce an SD card…
15:47
<
gchristensen >
it took about 1.5h but I was able to almost cross compile this nixos system to armvg0
15:47
<
gchristensen >
armv7l*
15:47
<
gchristensen >
it failed on a few and then I realized I was on 19.03
15:47
<
{^_^} >
#73344 (by ebkalderon, 3 weeks ago, merged): makeFontsCache: Fix cross-compilation, use nativeBuildInputs
15:48
<
gchristensen >
nice!
15:49
<
flokli >
well, even more nice if it'd work
15:49
<
gchristensen >
reposting an idea from -dev, we should make all of stdenv's bootstrapping big-parallel
15:51
FRidh2 has quit [Quit: Konversation terminated!]
15:53
orivej has quit [Ping timeout: 268 seconds]
15:57
<
flokli >
we should probably shape up cross, and cross-build the minimal installers for aarch64 and armv7l ;-)
16:11
<
gchristensen >
it would be nice for nix-build to support some features
16:11
<
gchristensen >
like reserve 25 cores for big-parallel jobs, and run one big-parallel job at a time. and then for all the others, run 5 jobs at a time with 5 cores each
16:12
kai_w has quit [Quit: Konversation terminated!]
16:17
vika_nezrimaya has joined #nixos-aarch64
16:48
mcfrank has left #nixos-aarch64 ["WeeChat 1.9.1"]
16:53
<
gchristensen >
good grief samueldr it worked
16:53
<
gchristensen >
I have a armv7l image
16:57
orivej has joined #nixos-aarch64
17:08
<
samueldr >
what worked?
17:08
<
samueldr >
the cross-system build?
17:09
<
samueldr >
and duh, yeah, that's not exactly friendly to do it outside of the repo
17:09
<
samueldr >
especially without docs
17:09
<
gchristensen >
yeah cross-system build worked
17:09
<
gchristensen >
pointing at regular 19.09
17:58
<
tilpner >
Has anyone seen a make error 2 while cross-compiling linux to aarch64? Full log:
https://tx0.co/aZ7
17:58
<
tilpner >
I updated my pinned sources, and forgot this would take another 6 hours if compiled with qemu :/
17:59
<
samueldr >
<3>/build/ccLmconz.s:50: Error: selected processor does not support `aese v7.16b,v1.16b'
17:59
<
samueldr >
with a kernel build, search error: to find the actual error
17:59
<
samueldr >
it's highly parallel
18:00
<
samueldr >
I got the error, too
18:00
<
tilpner >
That makes sense, thank you :)
18:00
<
{^_^} >
#74744 (by alexvorobiev, 5 days ago, open): Updating Raspberry Pi 3 on unstable channel fails with assembler errors trying to compile the kernel (aarch64)
18:02
<
{^_^} >
#64916 (by thefloweringash, 20 weeks ago, open): Linux kernel versions 4.4 and 4.10 don't build on nixos-unstable Aarch64
18:04
<
tilpner >
Are the *.s names at all relevant? They differ, but I can't tell if they're random
18:04
<
samueldr >
not sure
18:04
<
samueldr >
<3>make[2]:
*** [../scripts/Makefile.build:266: crypto/aegis128-neon-inner.o] Error 1
18:05
<
samueldr >
but this tells me that it's the same part
18:05
<
samueldr >
so I assume random
18:09
<
tilpner >
I'll just try disabling this for now
18:09
<
tilpner >
What could possibly go wrong
18:11
* tilpner
CRYPTO_AEGIS128 n, CRYPTO_AEGIS128_SIMD n
18:11
<
samueldr >
if I remember right, you only need to disable the SIMD option
19:13
ryantrinkle has quit [Ping timeout: 265 seconds]
19:29
ryantrinkle has joined #nixos-aarch64
19:35
* tilpner
spent an hour waiting on hydra to finish before realising it was still a qemu build :(
19:36
<
tilpner >
The new one seems to build though, with just _SIMD off :)
19:36
<
samueldr >
it built for me on my pinebook a64
19:49
zupo has joined #nixos-aarch64
20:39
zupo has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
20:44
zupo has joined #nixos-aarch64
21:02
zupo has quit [Ping timeout: 240 seconds]
21:02
zupo has joined #nixos-aarch64
21:12
<
flokli >
tilpner: running into this while cross-compiling too?
21:12
<
tilpner >
flokli: Yes, this was cross-compiled
21:13
<
flokli >
tilpner: so do you have some binfmt hackery, or a nixpkgs checkout where it doesn't break that way?
21:13
<
flokli >
The log clearly reads like it tries to execute a armv7l fc-cache binary…
21:14
<
tilpner >
My log or your log?
21:20
<
samueldr >
how are you testing?
21:20
<
samueldr >
(I don't know what to build)
21:21
<
tilpner >
Oh, I'm not cross-compiling everything
21:21
<
tilpner >
Just the kernel and a few select packages
21:22
<
tilpner >
That way, I get cache.n.o for most things, and only have to build the things I care about
21:22
<
tilpner >
When I try to cross-compile the whole thing, it starts building a lot more dependencies
21:22
zupo has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
21:22
<
flokli >
tilpner: I'm trying to build a full sd card image for some armv7l box
21:24
<
flokli >
and I do a nix-build -A hosts.pynq.config.system.build.sdImage
21:26
* samueldr
checks the state of cross-compiling stock sd-card on current nixos-unstable
21:26
<
flokli >
hosts/pynq.nix is just a regular nixos conf, like you'd use for nixos-rebuild switch -I config=… I disabled grub, enabled extlinux, configured the fstab, hostname and kernel
21:26
<
samueldr >
not sure all my PRs were merged
21:26
<
samueldr >
in fact I see they are not
21:27
<
{^_^} >
#73088 (by samueldr, 3 weeks ago, open): groff: Fix cross-compilation
21:27
<
{^_^} >
#73606 (by samueldr, 2 weeks ago, open): valgrind: Add perl as a native build input
21:27
<
samueldr >
I've been leaving this to the staging peeps to merge
21:28
<
flokli >
ah, ran into the groff issue too
21:28
<
flokli >
but I don't really understand the fc-cache one
21:29
<
flokli >
the PR looks fine, it says it fixes it, and I'm inclined to believe it does.
21:29
<
flokli >
But it still doesn't work afterwards
21:29
<
flokli >
and my nixpkgs surely contains the fix :-)
21:41
<
flokli >
samueldr: can confirm groff is fixed
21:41
<
samueldr >
hm? fixed without or with the PR?
21:41
<
flokli >
with the PR
21:41
<
flokli >
I'm inclined to press that green button… it's staging, right?
21:41
<
samueldr >
right, staging
21:42
<
flokli >
so what's the new process of waiting for sb to merge things into staging?
21:42
<
flokli >
I assumed it's fine to merge to staging
21:42
<
flokli >
sometimes, magic happens, and things are in staging-next
21:42
<
flokli >
and then in master
21:42
<
samueldr >
I don't know anything about the process for staging so I was leaving this all in the hand of anyone-by-me
21:43
<
flokli >
I pressed the button.
21:43
<
samueldr >
though yeah, I assume in staging it's going to be fine, since it's stabilizing at some point in staging-next
21:44
<
flokli >
and as for valgrind, Ericson approved. So this should really be fine :-)
21:44
<
flokli >
Merged, too
21:45
<
samueldr >
with those in staging, cross-system should be back to "good enough" soon
21:46
<
flokli >
what's with udisks, gpgme and friends?
21:46
<
flokli >
any idea why those are broken?
21:46
<
samueldr >
well, if nothing broke since last time I ran it
21:47
<
samueldr >
that's what I mean
21:47
<
samueldr >
with the cross-system workarounds it's going to be enough :D
21:47
<
samueldr >
still needs to all be actually fixed
21:47
<
samueldr >
IIRC gojbect-introspection has a meson-side issue with needing two pythons, host and build one
21:48
<
flokli >
I really think we should aim to build armv7l and aarch64 "minimal sd card installers"
21:48
<
flokli >
this will uncover these cross issues much quicker
21:48
<
samueldr >
I think there was some talks about maybe doing this at some point, in a less-often scheduled jobset
21:51
<
flokli >
yeah, it obviously shouldn't block a channel. At least not in the near future
21:51
<
flokli >
but it should be exercised often enough so breakages are easily spotted
21:52
<
flokli >
we're not yet lineageos and build firmware for hundreds of devices every night :-)
21:52
<
gchristensen >
we could
21:52
<
gchristensen >
holy hell
21:53
<
flokli >
oh yes :-)
21:53
<
gchristensen >
hydra's nixpkgs:trunk jobset is up to 80,000 jobs
21:53
<
gchristensen >
and only 4,000 fail :o
21:53
<
gchristensen >
this is amazing
21:53
<
samueldr >
it's not over 9000
21:53
<
flokli >
it goes up to eleven
21:54
<
samueldr >
armv[67]l and aarch64 cross of sd_image, and uefi iso, what's missing to get this in hydra?
21:54
<
samueldr >
I mean, we could also dump the whole nixpkgs release in there and build all, but I figure that's less useful?
21:54
<
flokli >
samueldr: It'll be too much I think
21:55
<
gchristensen >
I never could get that thing to boot :(
21:55
<
flokli >
but sd_image should be a target
21:55
<
samueldr >
yeah flokli, that's what I was thinking too
21:55
<
samueldr >
sd_image
_and_ uefi iso
21:56
<
samueldr >
(except for armv6, for uefi iso)
21:57
<
gchristensen >
scaleway is writing to a "local SSD" at 7MiB/s
21:57
<
samueldr >
local on a network storage
21:57
<
flokli >
the cloud native experience
21:58
<
gchristensen >
correct, it is networked storage :(
21:59
<
gchristensen >
"/dev/nbd1" "not big data"
21:59
<
flokli >
I can't blame them. Nobody wants have disks connected to individual boards as a SPOF.
22:00
<
gchristensen >
I do
22:00
<
gchristensen >
then again they still haven't managed to shut that server down
22:03
zupo has joined #nixos-aarch64
22:04
<
gchristensen >
come ON scaleway
22:04
<
gchristensen >
shut the dang thing DOWN.
22:07
zupo has quit [Client Quit]
22:10
<
gchristensen >
scaleway is just a UI over openstack right?
22:10
<
gchristensen >
obviously, right?
22:10
<
flokli >
gchristensen: you could call them and ask if you should pull the cable yourself
22:10
Thra11 has joined #nixos-aarch64
22:10
<
flokli >
they say they have custom hardware
22:10
<
samueldr >
I don't know that they are
22:10
<
flokli >
or at least had
22:11
<
gchristensen >
oh yikes
22:11
<
gchristensen >
can't boot a C1 from a snapshot
22:11
<
gchristensen >
okay I guess this just won't work
22:11
<
flokli >
gchristensen: no pxe?
22:12
<
gchristensen >
nor kexec
22:25
<
samueldr >
my current cross-compile did start from an awfully cold cache
22:42
<
gchristensen >
I
_think_ I want to take the cross-system stuff and merge it with a netboot like system description
22:58
<
gchristensen >
> C1 instances are unfortunately pretty old instances, and are based on a old architecture. As such, those servers do not support local boot, and only boot through "bootscripts", via PXE.It should be possible to hijack the PXE process at boot time using the web console, but that would be extremely inconvenient as it would have to be done at every reboot.
22:58
<
{^_^} >
error: syntax error, unexpected ',', expecting ')', at (string):271:52
23:01
<
clever >
gchristensen: in the past, i have mentioned doing that on purpose, and using a ipxe script to configure pxe to try the local hdd next
23:01
<
gchristensen >
fancy
23:01
<
clever >
gchristensen: oh, is packet.net pxe purely "enter a url" based, or can you give them a 10-line script, and they host it at a url for you?
23:01
<
gchristensen >
I
*think* there is a secret way to do the second
23:01
<
gchristensen >
but usually just "enter a URL"
23:02
<
gchristensen >
but this is for Scaleway
23:06
ryantrinkle has quit [Ping timeout: 240 seconds]
23:14
<
gchristensen >
oops
23:14
<
gchristensen >
kexec worked
23:14
<
gchristensen >
but no ssh :)
23:14
<
clever >
gchristensen: ip or auth?
23:15
<
clever >
gchristensen: is it not answering at the ip, or the auth not letting you in?
23:15
<
gchristensen >
ssh isn't enabled on the kexec image
23:16
<
flokli >
gchristensen: build your own! :-)
23:16
<
gchristensen >
I did
23:16
<
gchristensen >
and still managed to not enable ssh
23:16
<
clever >
my kexec image has ssh, and will reboot itself if you lack a management console
23:23
<
ornxka >
hello, so, i think ive managed to compile uboot (u-boot-sunxi-with-spl.bin) + a nixos sd image (nixos-sd-image-20.03pre-git-armv7l-linux.img.bz2) for my system, my question is, how do i write these two files to an sd card?
23:23
<
ornxka >
or does the .img file have the uboot code already in it?
23:26
<
ornxka >
i write the img, then the bootloader code, i think
23:27
<
clever >
ornxka: i think for sunxi, the uboot has to be at a certain offset within the sd image
23:28
<
clever >
which can either be automated by nix (and already in the sdimage) or manually done afterwards
23:28
<
clever >
also, is the SD card using mbr or gpt?
23:29
<
ornxka >
was i supposed to partition it o_o;
23:29
<
clever >
the .img file already contains a partition table
23:29
<
clever >
gpt has a harder time with uboot at seek=8
23:30
<
ornxka >
its mbr, according to file
23:30
<
clever >
should be fine then
23:33
<
ornxka >
whoa hot damn it actually booted
23:33
<
ornxka >
<<< Welcome to NixOS 20.03pre-git (armv7l) - ttyS0 >>>
23:34
<
gchristensen >
woo!
23:34
<
ornxka >
that was a lot easier than i was expecting it to be
23:37
<
samueldr >
ornxka: yeah, the general order in sunxi images is "dd the image, then dd the bootloader at the right location"
23:37
<
samueldr >
which is what uboot-with-spl is
23:37
<
clever >
in theory, you could have a nix derivation that does the 2nd step
23:38
<
samueldr >
in practice that'd make n amount of images to generate
23:38
<
samueldr >
what could be more useful is a derivation that takes the sd image in input, and the board name, and generates a "burn-me.sh"
23:38
<
clever >
they could all reuse a uboot-less base image
23:38
<
samueldr >
clever: yes they could
23:38
<
samueldr >
but it still makes n images
23:39
<
clever >
yeah, the final image could be outside of hydra
23:39
<
clever >
and the user generates it locally
23:39
<
clever >
ornxka: this also exists, to allow uboot on gpt
23:39
<
samueldr >
to allow some setups of secondary bootloaders on the main storage to use gpt
23:40
<
samueldr >
amlogic won't play nice with this
23:40
<
samueldr >
unverified still on rockchip
23:40
<
ornxka >
ah thats interesting, i was just reading earlier about boot processes, for something totally unrelated
23:41
<
clever >
the custom rpi firmware ive been working on would also open up the option of gpt on rpi
23:41
<
samueldr >
gpt already works on rpi3
23:41
<
samueldr >
not 100% sure though
23:42
<
samueldr >
though imo, the real solution is to treat the sd card on rpi as an opaque blob and just put tianocore on it
23:42
<
samueldr >
then boot from usb (or network I suppose)
23:42
<
samueldr >
much less painful in my experience
23:42
<
clever >
samueldr: the spi flash of the rpi4 basically takes that place
23:43
<
samueldr >
as long as tianocore can't fit in there, the sd card has to be a useless blob to me :)
23:43
<
samueldr >
(u-boot would be sufficient)
23:44
<
clever >
ive also got some dt issues i been to iron out
23:44
<
clever >
i can get linux to "boot" on my rpi3, but it fails in 3 ways
23:44
<
clever >
1: some of the page table stuff isnt generating right, ive commented out a check to make it ignore the problem
23:44
<
clever >
2: the bug detection code doesnt detect the bug properly and hard-hangs
23:45
<
clever >
3: irq's are 100% non-functional, so it hangs when figuring out the clock speeds
23:45
<
clever >
4: attempting to fix irq's has caused it to just fail with an error i cant solve