• topperharlie@lemmy.world
    link
    fedilink
    arrow-up
    8
    ·
    1 day ago

    Everyone defending swap like crazy in the comments… so let me give a counter argument specifically for desktop:

    Many years ago I stopped using swap on all my computers (I exclusively use linux) and the reason is: every time anything regarding interactivity went to swap, my system would freeze and literally become unusable for a really long time until I killed something. Since I got tired if that behaviour I decided I prefer for random shit to die but my computer still be usable.

    It wasn’t very often, but I don’t get OOM killer often either (as in I don’t remember the last time it happened and I use linux every day for both work and fun), and the freezing situation was way more annoying, to the point I sometimes ended up cold switching off the computer. I’m surprised on how many people run out of memory constantly. I guess you all are just using linux for servers and have crazy processing of infinite data…

    • JamesBoeing737MAX@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      1
      ·
      19 hours ago

      Or shotcut. I once ran it on 8GB, minimal arch with no swap. Well.

      And I’m not even trying to build android on my new relatively modern laptop. It won’t work.

    • boonhet@lemmy.zip
      link
      fedilink
      arrow-up
      4
      arrow-down
      1
      ·
      1 day ago

      Were you using a HDD for swap? It’s nearly unnoticeable on an NVMe drive.

      • topperharlie@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        1 day ago

        yep it was HDD, but with the low amount of times I have any OOM issue, I’m way more worried about NVMe flash burning than a random process being killed once every blue moon.

        In fact I didn’t mention, but since the advent of flash drives what I’ve done is trying to locate heavy disk writing apps and find alternatives for them, amid disabling many logs.

        For swap, it hunts me to think some automatic process I don’t have control over will burn those sweet erase cycles without me noticing just because someone programmed it poorly. I’m way more happy knowing I have some control over it.

    • cannedtuna@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      21
      ·
      1 day ago

      Shit did I botch it? I made this on my phone and the toot I copied the script from was just text. Wanted to make it look more interesting so I found this site that let you make the windows. I just went with what I thought looked best.

  • diaphragmwp@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    4
    ·
    22 hours ago

    Once tortured myself with having to go through…

    The Android build system. Booo, scary.

    I only wanted a LineageOS boot image built. The recommended specs list 64GiB RAM. Figured wouldn’t apply to me until I tried to build a target literally called “nothing”. It just used up all of the RAM and OOMed about 2 minutes in, building the “build cache” or whatever the fuck it needs to do to “warm up”.

    After a few fucktons of swapspace, turning off some of my daemons, some sysctl fuckery (there were options for limiting process virtual memory size IIRC? I put it all the way up) and taskset -p 0-15:1 (use logical CPUs 0, 2, 4…), I had my laptop allocating 50 something GiB. I have 16GB (decimal) physical RAM installed and I consider that already way too much for my usual needs.

    After about half an hour of the build system build systeming, it just stopped doing that then built the kernel in 4 minutes with everything else in some time too.

    Yes, I have tried just running make directly. That just resulted in an image that did nothing but toggle on and off an empty (no percentage) charging circle via power button.

  • RustyNova@lemmy.world
    link
    fedilink
    arrow-up
    3
    ·
    21 hours ago

    I don’t really need swap until I need to compile blender… Need somewhere around 64Gb (with compression) to deal with the peaks

  • OwOarchist@pawb.social
    link
    fedilink
    English
    arrow-up
    25
    ·
    1 day ago

    Yes, swap partitions are shit.

    The real hotness is swap drives.

    Just the use that your old 64GB SSDs were waiting for!

    (Fun fact: in Linux, if you have multiple swap partitions mounted, the kernel will automatically use striping (like RAID) in order to read and write from them as fast as possible. If you have multiple small SSDs used for swap, the read/write speed from swap can actually become pretty fast.)

      • OwOarchist@pawb.social
        link
        fedilink
        English
        arrow-up
        5
        ·
        1 day ago

        You’re going to run into issues with your motherboard’s SATA or NVME (or PCIE) controller throughput well before you get close to actual RAM speeds.

        Once you reach that bottleneck, the speed won’t increase anymore when you add more drives. The motherboard architecture just doesn’t support accessing any kind of storage device at that speed.

  • Zenorbi@lemmy.world
    link
    fedilink
    arrow-up
    34
    ·
    1 day ago

    I used to be this guy. We have huge amount of memory in our storage server. Why would we need swap? Well, once the system started killing programs I read up on swap and how the system handles its caches, especially ZFS ARC.

    Short version is that while the system can evict its caches syncronously, it can only async notify ZFS that it should also shrink its caches, but the out-of-memory killer will start killing before ZFS and its kernel counterpart can start to free up memory.

    A tiny bit of swap completely solved this, since swapping is sync for the kernel and the OOM killer will wait for it.

    • Fizz@lemmy.nz
      link
      fedilink
      arrow-up
      7
      ·
      1 day ago

      As well as oom situations, swapping allows the memory to be used more effectively by swapping out anonymous pages that aren’t likely to be used but can’t be dropped.

    • grrgyle@slrpnk.net
      link
      fedilink
      arrow-up
      1
      ·
      23 hours ago

      I found that with swap the applications would slow to a crawl and then basically lock up entirely until I hauled my ass over and manually power cycled the machine.

    • j3tt@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      1 day ago

      I sometimes cannot do hibernate when I did a scrub on my ZFS. But the first try always frees up the swap and so the second attempts works every time.

  • Jul@piefed.blahaj.zone
    link
    fedilink
    English
    arrow-up
    54
    ·
    2 days ago

    There are good use cases for swap. I work with very performance sensitive memory hogging applications that tend to process in bursts as incoming batched data arrives. We also have a lot of required background “security” applications.

    Having the idle applications move out to swap so that a significant amount of free RAM to allow for the active, real-time applications to expand into is a major boon. RAM is expensive now, so it’s become even more critical to not waste it.

    But even in self-hosting at home I take advantage of it since I have a limited number of servers with limited RAM and a bunch of applications and/or docker containers running, many of which don’t need to be active at all times, but if they were all active, would have trouble with the limited RAM. Swap allows for inactive applications to free up RAM for the active ones and leave enough available at all times to allow an application to quickly spin up new jobs.

    Anyway, sure, for a simple desktop computer without a bunch of junk background applications running for “security” or whatever, and an overabundance of RAM installed, it’s probably not useful. But for high performance, memory hungry applications with lots of background stuff running, it can be a big help.

    That said, there are use cases where the opposite is useful and using a RAM drive is better than writing to disk for cache and temporary logs when you have enough RAM. My opnsense router for instance uses a RAM drive to store cache and logs (logs are mirrored to the NAS for long term storage, so just the local copy is lost on reboot). That system has enough RAM and I’d rather reduce disk wear, and I don’t plan to add too many other applications to that server that it would run low.

    • Kangae_Hishiryo@scribe.disroot.org
      link
      fedilink
      arrow-up
      4
      ·
      1 day ago

      Actually, there are more than these. For example, hibernation and/or hybrid suspension. It’s, AFAIK, mandatory to have a swap partition to be able to hibernate and/or hybrid suspend your device.

    • Supercrunchy@programming.dev
      link
      fedilink
      arrow-up
      3
      ·
      2 days ago

      I also found it useful to do some one-off batch processing of a big file without thinking of chunking and doing too complicated things. Imagine something like a 60GB file in a custom format that need to be deduplicated. It’s easier to just load it all up in memory and do run the algorithm 2-3x slower using a 50GB swapfile than spend hours to complicate the algorithm.

      • OwOarchist@pawb.social
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        1 day ago

        Yep. That’s why it can be nice to just have like an old 1TB drive completely used for swap. Things might get slow once it exceeds your physical memory, but at least it will eventually finish successfully – no out of memory crashes here!

      • dan@upvote.au
        link
        fedilink
        arrow-up
        9
        ·
        2 days ago

        I’ve seen so many setups where people encrypt their data but forget to encrypt their swap.

        • DevDave@piefed.social
          link
          fedilink
          English
          arrow-up
          5
          ·
          1 day ago

          what’s the problem? it’s not like you dump the entire contents of your system’s ram to disk any time use hibernate /s

          • dan@upvote.au
            link
            fedilink
            arrow-up
            3
            ·
            1 day ago

            Even without hibernation, data in apps you have open will end up in the swap if your system is ever RAM-constrained.

            • redjard@reddthat.com
              link
              fedilink
              arrow-up
              1
              ·
              1 day ago

              Generally it only happens to programs you keep running in the background and might not use for a long time that also don’t have much background activity. For example password managers.

              • dan@upvote.au
                link
                fedilink
                arrow-up
                1
                ·
                1 day ago

                It depends on what you set your swappiness to, too. I think Linux distros still have pretty aggressive defaults that swap more than they probably need to.

      • PervServer@fedinsfw.app
        link
        fedilink
        English
        arrow-up
        7
        ·
        2 days ago

        Nope, I hibernate with a swap file and it’s in a LUKS partition. Although IIRC that whole setup requires me to use systemd boot.

        • redjard@reddthat.com
          link
          fedilink
          arrow-up
          1
          ·
          1 day ago

          I do the same and use ugrd. I think dracut would also work.
          You just set the resume kernel parameter to the decrypted memory device with the swapfile offset.
          As long as the initrd attempts a resume after it decrypted all volumes it’ll work, and the initrd doesn’t even need to understand why and what was resumed from

      • Ooops@feddit.org
        link
        fedilink
        arrow-up
        3
        ·
        1 day ago

        It’s doable with a swap file instead. But some filesystems are more supportive than others.

        For example BTRFS doesn’t support swapfiles over multiple devices (so my raid1c3 spanning 3 differently sized disks for example) and also swapfiles must be completely pre-allocated.

        And no matter the filesystem you need to manually tell the kernel device and physical offset for the file via kernel parameters. Which can again be easier on some than on others (also causing the no-multiple-device filesystem problem mentioned above.

        • redjard@reddthat.com
          link
          fedilink
          arrow-up
          1
          ·
          1 day ago

          btrfs’s handling makes sense. The kernel talks to the disk directly, the file is just a pointer for what range it uses, and a placeholder for the filesystem. Something like raid, balancing, cow, all won’t work because the kernel doesn’t even go through btrfs to change the swap"file".
          If you want a proper file as swapfile, with the corresponding overhead, you can make a regular file and mount it via loopback then use it as a swap device.

        • redjard@reddthat.com
          link
          fedilink
          arrow-up
          2
          ·
          1 day ago

          So you shut your pc down like a caveman when you do hardware upgrades or repairs or move apartments?

          • dan@upvote.au
            link
            fedilink
            arrow-up
            3
            ·
            1 day ago

            Yeah I shut down every day. It boots up fast enough that it’s really not an issue.

    • adarza@lemmy.ca
      link
      fedilink
      arrow-up
      2
      ·
      1 day ago

      that’s what trixie’s netinst defaults to when i set up new desktops using encrypted lvm… root and swap volumes inside that, unlocking together at boot. my use doesn’t hit swap much, so it’s nbd. i just leave it like it is. only where an installer doesn’t support encrypted swap partitions do i use a file or ram-based swap instead.

      • dan@upvote.au
        link
        fedilink
        arrow-up
        4
        ·
        1 day ago

        It’s not as bad with LVM since LVM is more flexible. A swap file does still make it easier to change the size as needed though. If you need more swap, you can spin up a new swap file pretty much instantly while the system is running, without having to repartition. You can have both a swap partition and a swap file active at the same time though.

        On systems where the data is encrypted, also encrypting the swap makes sense so I’m glad Debian does that.

  • Blue_Morpho@lemmy.world
    link
    fedilink
    arrow-up
    16
    ·
    2 days ago

    “Unresizeable block device at end of disk”

    Classically the swap partition was located at the physical middle of the drive so that on average, no matter where the heads where, the swap partition wasn’t far away

    • InnerScientist@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      22 hours ago

      Also “unresizeable” as if you can’t just swapoff and just delete and recreated it anywhere (update the path in fstab) and then swapon again.

  • 87Six@lemmy.zip
    link
    fedilink
    arrow-up
    15
    ·
    2 days ago

    All I know is that I had 16GB RAM and 4GB swap and I used to get crashes sometimes.

    Set that fucker to 32GB out of spite, now no crashes. No idea why that helped. But I guess I do have like 15 tabs open on the regular (web dev)

    • JasonDJ@lemmy.zip
      link
      fedilink
      English
      arrow-up
      13
      ·
      2 days ago

      15 tabs? Those are rookie numbers. Unless you mean “before 8:07 Monday morning”.

      • tal@lemmy.today
        link
        fedilink
        English
        arrow-up
        8
        ·
        2 days ago

        I don’t recall that, but IIRC it does need to be a minimum of installed RAM if you want to be able to hibernate, since then you write out the contents of your memory to swap. That makes having at least as much swap as RAM a good rule of thumb for many systems.

        IIRC kernel crash dumps also make use of swap in a similar way, though I assume that in most sane scenarios, it’s not going to actually require as much swap as physical memory, because you won’t have all of your physical memory allocated to the kernel.

        On non-exotic Linux systems, I always make sure to have more swap than physical RAM.

        • j3tt@lemmy.world
          link
          fedilink
          arrow-up
          2
          ·
          1 day ago

          I use 1.5-2x the swap on new installations these days. I want hibernate to always work.

        • rumschlumpel@feddit.org
          link
          fedilink
          arrow-up
          2
          ·
          1 day ago

          I don’t recall that, but IIRC it does need to be a minimum of installed RAM if you want to be able to hibernate, since then you write out the contents of your memory to swap.

          IF RAM used + swap used don’t exceed total swap space. Yeah, sometimes I run into that. Solved by killing webbrowsers, which suggests that most of the swap space is filled with unused webpages…

    • treadful@lemmy.zip
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 days ago

      But I guess I do have like 15 tabs open on the regular (web dev)

      Minor league shit.

  • 7rokhym@lemmy.ca
    link
    fedilink
    arrow-up
    7
    ·
    1 day ago

    Definitely configure swap, but I don’t think there is much benefit of a swap partition over a swap file these days and swap files are trivial to configure.