gchristensen changed the topic of #nixos-chat to: NixOS but much less topical || https://logs.nix.samueldr.com/nixos-chat
jackdk has joined #nixos-chat
thePirateKing has joined #nixos-chat
Irenes has quit [Ping timeout: 240 seconds]
Irenes has joined #nixos-chat
thePirateKing has quit [Ping timeout: 250 seconds]
<gchristensen> hi friends
<samueldr> hi?
<gchristensen> I have a big file which I'd like to transfer between some machines, and have each machine hosting it able to assist in seeding its contents. (it is starting to sound a lot like bittorrent). I don't want the file to be publicly downloadable at all. any suggestions on how to do this? ideally the sw would be able to determine some peers are in the same LAN and sync locally as well as externally
<gchristensen> (big file = 15g)
<gchristensen> (this file is immutable)
<samueldr> (if it fits in ram it's not big data)
<samueldr> sorry, had to say it :)
<gchristensen> lol
<samueldr> can't help though :/
<gchristensen> aye :)
<gchristensen> I want to do some processing on this file on some transient servers, so getting it downloaded as fast as possible is important
<jackdk> possibly stupid question - has anyone built an auth layer atop bittorrent?
<gchristensen> so maybe syncthing is the thing
<gchristensen> ah, no, it requires configuration and I'd want this to be hands-free
<infinisil> gchristensen: How about splitting the file up into <number of seeding hosts> pieces
<infinisil> Ah, not every machine is the same speed, nvm
<colemickens> I don't know if it has "LAN only" but it ticks some of the other boxes potentially.
<colemickens> although, I doubt it meets the "hands-free" or "no config" part, if I had to guess
<gchristensen> hmm!
<gchristensen> thank you, colemickens!
<gchristensen> maybe ipfs + a wrapping encryption?
<gchristensen> nope. not that.
<infinisil> gchristensen: Would you be content with a stupid simple bash script?
<gchristensen> what for?
<infinisil> For that transfer thing between machines
<gchristensen> sure :)
<gchristensen> it might not do the business, but maybe it will!
<infinisil> Well I wrote this idea down which should just be a couple lines of bash
<gchristensen> awesome
<infinisil> Split the file into 1MB fragments (`split` command), sequentially numbered. The requesting machine starts a download thread for each available seed machine, getting the next fragment, and writing to a file which fragments have been downloaded, repeat until everything is downloaded
<gchristensen> it is way past my bed time (what are you doing up? :o) so I'll have to look in the AM
<infinisil> The idea is so simple, but it might just work
drakonis_ has quit [Read error: Connection reset by peer]
MichaelRaskin has quit [Quit: MichaelRaskin]
<elvishjerricco> gchristensen: I don't know anything advanced about bittorent, but can it just be bittorrent? If auth is needed, gate it behind VPN or encrypt the file.
Myhlamaeus has quit [Ping timeout: 240 seconds]
disasm has quit [Ping timeout: 246 seconds]
disasm has joined #nixos-chat
dashkal has quit [Ping timeout: 250 seconds]
endformationage has quit [Ping timeout: 246 seconds]
<NinjaTrappeur> gchristensen, fyi, there's a bittorent auth extension https://libtorrent.org/auth.html . If you want to go the bittorent way, you'll probably need to setup your own tracker. It's not necessary complicated as long as you can spin up an embedded tracker (qbittorent for instance) on the machine having your (almost) big file on the first place.
<NinjaTrappeur> ^ Definitely not 0-config though :)
jackdk has quit [Ping timeout: 250 seconds]
ixxie has joined #nixos-chat
pie_ has joined #nixos-chat
<joepie91> gchristensen: I dunno if aria2c has a seeding-only mode, but if it does, maybe that might work here?
<joepie91> dunno if it does auth though
pie_ has quit [Quit: Leaving]
pie_ has joined #nixos-chat
__monty__ has joined #nixos-chat
ixxie has quit [Ping timeout: 255 seconds]
<gchristensen> interesting
lassulus has quit [Ping timeout: 245 seconds]
drakonis_ has joined #nixos-chat
drakonis has quit [Ping timeout: 268 seconds]
drakonis has joined #nixos-chat
drakonis_ has quit [Read error: Connection reset by peer]
drakonis_ has joined #nixos-chat
drakonis1 has joined #nixos-chat
drakonis has quit [Read error: Connection reset by peer]
drakonis has joined #nixos-chat
drakonis_ has quit [Read error: Connection reset by peer]
drakonis_ has joined #nixos-chat
drakonis1 has quit [Read error: Connection reset by peer]
drakonis1 has joined #nixos-chat
drakonis has quit [Read error: Connection reset by peer]
drakonis_ has quit [Ping timeout: 246 seconds]
drakonis has joined #nixos-chat
drakonis_ has joined #nixos-chat
drakonis1 has quit [Ping timeout: 268 seconds]
drakonis has quit [Ping timeout: 264 seconds]
drakonis_ has quit [Ping timeout: 250 seconds]
drakonis_ has joined #nixos-chat
<gchristensen> I decided to just put it on Wasabi (s3-like) instead of fretting about p2p stuff
<__monty__> Is this still about p2p nix caches?
<__monty__> Oh, or your personal dropbox replacement?
<gchristensen> I have a big file I want some machines to use during some computation :)
drakonis_ has quit [Ping timeout: 255 seconds]
<gchristensen> the file is immutable, though, so not really dropbox-y
drakonis_ has joined #nixos-chat
drakonis_ has quit [Ping timeout: 255 seconds]
drakonis_ has joined #nixos-chat
waleee has joined #nixos-chat
andi- has quit [Ping timeout: 250 seconds]
andi- has joined #nixos-chat
drakonis_ has quit [Ping timeout: 264 seconds]
endformationage has joined #nixos-chat
andi- has quit [Excess Flood]
drakonis has joined #nixos-chat
andi- has joined #nixos-chat
lassulus has joined #nixos-chat
andi- has quit [Ping timeout: 240 seconds]
pie_ has quit [Ping timeout: 264 seconds]
andi- has joined #nixos-chat
drakonis has quit [Ping timeout: 252 seconds]
<gchristensen> `zpool create -O mountpoint=none rpool /dev/disk/by-id/*` YOLO zpool creation`
drakonis has joined #nixos-chat
<LnL> euh
<LnL> you forgot -f
<gchristensen> ack! thank you!
<gchristensen> :D
<LnL> most virtualisation doesn't populate by-id by default tho
<LnL> I assume this isn't a real machine :)
<gchristensen> hrm
<gchristensen> is there a nice /dev/disk/... bit which is populated?
<LnL> unless I'm thinking of by-uuid
<gchristensen> it is actually a real machine X)
<gchristensen> but I wanted to test it in a VM
<LnL> you can tell qemu to generate disk serials with a flag IIRC
<joepie91> so, this is the sort of shit why I recommend everybody to stay away from hosting providers that are in any way related to ColoCrossing: https://www.lowendtalk.com/discussion/156891/are-you-out-of-your-fucking-mind-colocrossing
<joepie91> and yes, I'm angry
drakonis_ has joined #nixos-chat
drakonis1 has joined #nixos-chat
drakonis has quit [Ping timeout: 250 seconds]
<gchristensen> daaaangit. I did a whole system provisioning process and VM bootup to find out I forgot to put my ssh key in either the interior VM or the host system.
drakonis_ has quit [Ping timeout: 252 seconds]
<joepie91> (tl;dr they send fake vulnerability notifications to market their shit)
<averell> type out the ssh key into authorized_keys as penance
drakonis1 has quit [Read error: Connection reset by peer]
<averell> oh hey, i got that email. i have them on my junk list for a long time.
<averell> and they still don't have IPv6, noobs.
lassulus has quit [Ping timeout: 255 seconds]
Myhlamaeus has joined #nixos-chat
<simpson> I wrote a short narrative to accompany the Mailpile author's recent complaint of burnout. I wonder what we, as distro folks, can do better next time around. https://lobste.rs/s/hgzcv4/mailpile_burned_out_happy#c_6anfh3
<joepie91> simpson: the original post sounds like a pretty typical case of exactly this; trying to control too much, and burning out as a result of juggling too many plates and having too few other people to share the decisionmaking load
lassulus has joined #nixos-chat
<sphalerite> gchristensen: you'll also want to use only one type of id, and make sure to exclude partitions
<sphalerite> gchristensen: probably using `/dev/sd? /dev/nvme?n?` (with shopt -s nullglob) is better
<simpson> joepie91: Indeed. I wonder whether it will only get worse as we transition further away from ambient/systemwide package management.
<sphalerite> gchristensen: also, what was the state of your secure boot stuff and have you published it anywhere?
<joepie91> simpson: I think packaging plays a relatively small role in it
waleee has quit [Quit: WeeChat 2.4]
drakonis has joined #nixos-chat
<andi-> has anyone used the rust support in nix to build webassembly yet?
<gchristensen> https://www.bbc.com/news/world-europe-47941794 yikes, Notre-Dame is on fire
<gchristensen> sphalerite: one type of id?
<gchristensen> sphalerite: it works-ish, but is error prone and doesn't handle out of space erros nicely -- which it hits frequently, since the secureboot efi programs are quite large
<gchristensen> omg, Notre Dame's spire collapsode,
<samueldr> pretty much all the roof is gone, I was listening to a live stream off of periscope
<samueldr> (but they ran out of battery)
<samueldr> the way it burnt up looks like everything combustible is going to be gone, what's up in the air is: everyone safe?
<gchristensen> my word
<LnL> whoa
<gchristensen> my coworkers in Paris say they watched it collapse :(
<gchristensen> ouch
<infinisil> Wow
<eyJhb> Changed to "Unknown (Fire damaged)"now
<eyJhb> Holy hell they are quick on Wiki
<eyJhb> But damn, that sucks
<eyJhb> Does anybody know how it started?
<samueldr> only rumours!
<gchristensen> which is construction accident
<samueldr> in that one stream, reported by other standbyers, some said it started from the inside, some from a construction accident
<samueldr> (though both may be true)
<samueldr> (an inside construction incident)
<eyJhb> Sound plausbile... :/
<eyJhb> Surprised nobody has said terrorism yet
<samueldr> you don't go to that orange site
<samueldr> at one point it was up there in the comments :/
<gchristensen> baseless FUD is useless
<samueldr> exactly
<samueldr> what's more important is not the cause but: could everyone (presumably working on the structure) evacuate?
<gchristensen> +1
<samueldr> that's a hell of a scaffold to run down https://stuff.samueldr.com/screenshots/2019/04/20190415144047.png
<samueldr> (presumably less fire damaged at the start)
<gchristensen> my goodness
<eyJhb> And then there is the teeny tiny water hoose
<eyJhb> _one_ (at least visible)
<__monty__> Water damage on such an old structure might not be much better than fire damage though?
<samueldr> they must be working more on ensuring what few buildings that are close are kept safe
<eyJhb> __monty__ water damage would be easier to fix, as it is slower than .. fire damage
<eyJhb> Can't remember what buildings it is close to, long time since I last visited it
<__monty__> That's not true. Fire probably does minor damage to concrete/stone, water may make the entire structure unstable. Putting out fires is more than just pouring water onto things, unfortunately.
<gchristensen> well ... we'll find out what happens when it is done
<gchristensen> presumably they have emergency plans for such iconic buildings
<samueldr> not many buildings so it's likely to not affect much else than the cathedral https://www.google.com/maps/place/Cath%C3%A9drale+Notre-Dame+de+Paris/@48.8512633,2.3536278,407a,35y,299.68h,40.71t/data=!3m1!1e3!4m5!3m4!1s0x47e671e19ff53a01:0x36401da7abfa068d!8m2!3d48.8529682!4d2.3499021
<eyJhb> __monty__ But I would still guess you have more than a couple of hours to fix it
<__monty__> Can't exactly replace just a hundreds of years old wall though. No matter how long you have.
<eyJhb> But makes it easier to try at least :p But either sucks basically
<eyJhb> Choosing between a turd and a douche ;)
<__monty__> Safest way to deal with most fires is to just let them burn themselves out.
<sphalerite> gchristensen: /dev/disk/by-id has wwn-* as well as ata-* for ATA disks
<sphalerite> gchristensen: what sort of out-of-space errors?
<gchristensen> ahh
<gchristensen> I changed it to by-path and it seemed to work ok
<gchristensen> well /boot just runs out of space, and then the bootloader creator doesn't really handle it very well
pie_ has joined #nixos-chat
<sphalerite> gchristensen: aaah that kind, right
<infinisil> That's the kind of stuff i like to see haha https://www.reddit.com/r/Simulated/comments/bdjw5t/walking_hair/
drakonis has quit [Read error: Connection reset by peer]
<pie_> besides the collision problems um that looks prettz real
<pie_> i wonder is the walking mocap
<pie_> because that might be a lot of the realism
<pie_> well and the lighting
<pie_> and the hair simulation
__monty__ has quit [Quit: leaving]
<samueldr> nixos-homepage#260 feels so weird, like there's an echo
<{^_^}> https://github.com/NixOS/nixos-homepage/pull/260 (by davidak, 10 weeks ago, open): [WIP] Add licenses
<gchristensen> hehe
pie_ has quit [Ping timeout: 252 seconds]
jackdk has joined #nixos-chat
<infinisil> "This release also marks a change in ripgrep's versioning. Where as the previousversion was 0.10.0, this version is 11.0.0. Moving forward, ripgrep'smajor version will be increased a few times per year."
<infinisil> Why though :/
<joepie91> dunno why 11 instead of 1
<joepie91> but otherwise it's just semver
<joepie91> which makes sense
<samueldr> it's kind of "I'm attached to 10th release, so make it 11th" I think
<samueldr> not the first project I see doing that when they decide they move from the 0.0.* to the *.x.y
<joepie91> as in, sidestepping the impression of 1.0 meaning "done"?
<samueldr> no idea, maybe they've been referring it as "ten" in their mind for so long that "one" seems foreign?
jasongrossman has joined #nixos-chat