Hi,
Do you have suggestions for kernel tweaks for getting the most out of a RAM limited system?
I am running a service requiring 2GB of RAM (netbird) on a VPS which has just 1 GB of memory. I am doing so because I am a stingy bastard and I use only free VPSs for my personal use so I get what I am paying for.
Because of this hardware limit in about 12 hours from service start I begin swapping a bit too much. This would still be manageable but soon the hypervisor gets really pissed and steals up to 90% of the CPU. So the only solution so far is restarting the docker containers every 12 hours (not great, not terrible).
Looking to improve this, Iam now experimenting with ZRAM and swappiness and it seems some benefit can be achieved by using some of the Linux kernel feaures. Is there anything else I should look into?
Wow you’re right. You are a stingy bastard.
Never run anything on a free tier if you want to keep it. My legit Oracle account got flagged and deleted for no reason so they’re dead to me, and I’ll tell anyone who will listen. They’re thieving assholes and will snatch away free tier the moment it’s convenient for them.
Do you really need netbird? What for?
Spend some money, consider it the cost of education
To tag onto this… for a low end VPS I love Hetzner. No, they aren’t the cheapest, but the cheaper options are generally bottom-of-the-barrel unstable garbage or require promotions that expire. Hetzner is stable, professional, and cheap. Great choice for a simple personal VPS.
Netcup is cheaper (as far as I know) and really reliable too. Also based in Germany. I use one of their VPS to host my stuff.
Nice! Love to learn new options.
Can really recommend them. They guarantee the lowest price for VPSs and are very reliable. My company (more than 250 people) uses them to host some stuff too.
I’ve only had good experiences. Very reliable.
I’m going to chime in and recommend Racknerd. Inexpensive and rock solid for me.
As long as you’re not running Plex lol
I use Vultr and OVH.
I’ve heard good things about OVH.
If you’re using Oracle cloud (just guessing based off 1GB), they also offer free ARM VMs with 24GB of RAM, and netbird looks to support ARM.
Yes, this is a possibility. the ARM VPS is already running something else, but if I manage to run netbird behind a reverse proxy I can also move it there. BTW there are also 1 GB free VPS on azure (for students) and Google Cloud, but you guessed right.
Yeah good luck getting one. I tried for a month before giving up.
Turn on swap! That way more of your actual ram can be used by the application. Yes, it will probably be slow as crud but it should use more memory than it has. If swap is already on… sorry
I forgot to mention, I had plenty of swap available, now I disabled swap to force zram usage. I still need to see what happens running with both, it’s hard when each trial takes 12-24 hours to show its result.
Oh yikes yeah I would not be good at that pace 😅 I know you can rebuild the kernel with less features to reduce ram usage, but other than that I would be looking at what you’re already doing.
Have you considered removing docker from the equation and running directly on the host os?
Running without docker is out of question, is a bundle of 6 docker containers. Deployment and management without it would be too complicated. Luckily somebody in another reply made me realize that the RAM eating container (cockroach DB) is far less essential than I thought and I can look for a replacement.
Awesome, lol also you may be able to make a new email and free vps just to run cockroach db
Oracle free tier is 24GB of RAM. I hate Oracle as much as the next person, but worst thing they do is shut it off and you have to migrate.
Yes, this is a possible fallback plan.
why use docker here? you’re just adding layers of abstraction in an environment that can’t seem to really support them.
that said, switching to 32bit linux, if the VPS supports it, will save you memory.
[This comment has been deleted by an automated system]
I use Docker on a VPS with 512MB of RAM
🙂💄🎨🤡
This service consist of several docker containers, without docker I would not even know where to start for deploying it. Maintainance as well would be a mess, totally not an option
I think the advice should be taken to heart here — you’re dealing with a userspace problem but you’re trying to get the kernel to make it all better.
You’ve already mentioned the two big things, compressed RAM and swap; optimizing userspace (or paying for more RAM) may be the only option at some point.
If you want to get creative, is there a reason you can’t use a local computer for some of these services? An old raspberry pi or similar could potentially run some of your services. You could run some containers on your home server and call it a day. Quick search turned up this https://www.linuxserver.io/blog/routing-docker-host-and-container-traffic-through-wireguard
Get an oracle cloud account and use their free arm server. You’ll have 24 gb of ram to play with. For free.
Thanks for the suggestion, but my 24 GB are well employed already. I wanted at least to outsource the VPN manager to a smaller VPS.
It seems to me you are already looking into all the possible options besides getting a VPS with more RAM. I am a bit confused on why you are seeing increased CPU usage by the hypervisor for this though.
The server is clearly overloaded, as soon as I start using some 10% of CPU frequently for some minutes (due to swap operations), the Hypervisor starts to throttle my instance and this of course makes the thing worse with an avalanche effect. When this happens steal time displayed from top can go literally as high as 90%.
On AWS they have something called “bursting”. Basically they will let you use 100% of your vCPU, but not all the time. If you use it constantly they start to throttle you. That’s explicitly stated when you rent an EC2 instance (which is their VPS). Perhaps your provider is doing something similar.
Yes exactly, burstable instances it’s common jargon for AWS and GCP, but applies to all major providers.
Yeah, those are great for something that will be sitting idle most of the time, awful for anything else.
Ask the provider not to throttle you then? Are you not entitled to the entire cpu?
I use only free VPSs
So probably not entitled to anything from them.
I believe it’s a shared VCPU intentionally, I will recheck the terms and conditions, but I think I am not in the position to claim much.
zram or a cloud instance with more ram https://paul.totterman.name/posts/free-clouds/
Try using zram? You could probably get around 5gb of ram if you compress it. https://wiki.archlinux.org/title/Zram
I am experimenting with ZRAM, it is indeed better than ZSWAP, that’s why i am asking if any other kernel features can help.
Zram (compression), uksmd (deduplication) and swap.
For a different project, but in my blog I document how to set those up: https://moonpiedumplings.github.io/projects/setting-up-kasm/
What are you trying to do? I read “hypervisor” and am not sure if you mean the one managing your VPS or if you installed one in your VPS.
The one managing my VPS, controlled solely by Oracle corporation
