• 0 Posts
  • 9 Comments
Joined 2 years ago
cake
Cake day: July 30th, 2023

help-circle



  • I think it would be fine. Friend of mine has Immich on a N100, like you mentioned, the initial ML tasks on a big library takes over 24 hours but once it’s done it doesn’t need much. I don’t have experience running next cloud but the others you mentioned don’t need much RAM/CPU.

    ZFS doesn’t need much RAM, especially for a two disk 4TB mirror. It soaks up free RAM to use as a cache which makes people think it needs a lot. If the cache is tiny you just end up hitting the actual speed of the HDDs more often, which sounds within your expectations. I dare say you could get by with 8 GB, but 16GB would be plenty.

    I’d only point out if you’re looking for it to last 10 years, a neat package like the ugreen might bite you. A more standard diy PC will have more replaceable parts. Would be bigger and more power hungry though.


  • Ah kay, definitely not a RAM size problem then.

    iostat -x 5 Will print out per drive stats every 5 seconds. The first output is an average since boot. Check all of the drives have similar values while performing a write. Might be one drive is having problems and slows everything down, hopefully unlikely if they are brand new drives.

    zpool iostat -w Will print out a latency histogram. Check if any have a lot above 1s and if it’s in the disk or sync queues. Here’s mine with 4 HDDs in z1 working fairly happily for comparison:

    Here's mine with 4 HDDs  in z1 working fairly happily for comparison

    The init_on_alloc=0 kernel flag I mentioned below might still be worth trying.



  • After some googling:

    Some Linux distributions (at least Debian, Ubuntu) enable init_on_alloc option as security precaution by default. This option can help to prevent possible information leaks and make control-flow bugs that depend on uninitialized values more deterministic.

    Unfortunately, it can lower ARC throughput considerably (see bug).

    If you’re ready to cope with these security risks 6, you may disable it by setting init_on_alloc=0 in the GRUB kernel boot parameters.

    I think it’s set to 1 on Raspberry Pi OS, you set it in /boot/cmdline.txtI think.

    Exhaustive ZFS performance tuning guide


  • sync=disabled will make ZFS write to disk every 5 seconds instead of when software demands it, which maybe explains your LED behavior.

    Jeff Geerling found that writes with Z1 was 74 MB/sec using the Radxa Penta SATA HAT with SSDs. Any HDD should be that fast, the SATA hat is likely the bottleneck.

    Are you performing writes locally, or over smb?

    Can try iostat or zpool iostat to monitor drive writes and latencies, might give a clue.

    How much RAM does the Pi 5 have?