• 0 Posts
  • 18 Comments
Joined 1 year ago
cake
Cake day: June 21st, 2023

help-circle

  • This was a real bummer for anyone interested in running local LLMs. Memory bandwidth is the limiting factor for performance in inference, and the Mac unified memory architecture is one of the relatively cheaper ways to get a lot of memory rather than buying a specialist AI GPU for $5-10k. I was planning to upgrade the memory a bit further than normal on my next MBP upgrade in order to experiment with AI, but now I’m questioning whether the pro chip will be fast enough to be useful.




  • I am conflicted on this one. On one hand, yeah they’re just a platform, and realistically these kids would just go to another messaging service instead, but it also feels like they’re asleep at the wheel when it comes to investigating user reports of abuse.

    It’s sort of an all social media thing, because I’ve reported posts selling drugs on FB marketplace too and they ignored them after review.

    They quote one of the families in the article reporting a drug dealers account and Snapchat taking no action for months. I’d be willing to bet moderation is an afterthought and likely understaffed for the sheer volume of content on the app.






  • Makes sense. I think you’d be fine with pretty much any modern(post DDR4) motherboard/CPU combo these days. I feel Linux hardware support is only really shakey if you’re using a SoC without upstream patches or if you’re using brand new hardware/laptops. With that being said if you’re running a lot of containers on one host have you looked into docker compose or kubernetes(k8s)? Maybe k8s is overkill for home use, but both offer support to restart containers if a health check fails. With k8s you also can spread out containers across multiple physical node, so you could just add a second RPI and “double” your resources.


  • For $350-500 you could easily get a used desktop and processor with 16-32 gb ddr4. But it sort of depends on your home lab goals and workloads. Do you need a lot of storage? Are you CPU bound or memory bound? Some people will suggest used Dell/HP servers, and they’ll look affordable, but keep in mind enterprise gear will eat power and is usually loud. Personally I’d go for a used AMD 5800 or 5900 processor and mobo, install your favorite Linux, and call it a day. AMD processors don’t have quick sync which makes them slightly worse for plex hosting but better for everything else.








  • Teslas have some serious issues and shortcomings. And I say that as an owner. FSD is a mess and I don’t trust it. The model 3 has some very opinionated design choices. I don’t like how it’s frameless. The interior is nowhere near as nice as cars in the same price range. There’s only 2 usb ports and you need to use one of them for dashcam storage. Maintenance is a pain in the ass to DIY. They remove key features over OTA updates(they took away radar sensors for parking in older model 3s).

    However, if you’re in the market for a used EV under 30k, you’ve only got basically 3 options: a rwd model 3, a leaf, or a bolt. The model 3 is the only one of those that has fast charging and can be taken on any sort of longer road trip. And they’re cheap to charge at home. And even if you’re shopping new, I’m fairly sure the base model 3 is the cheapest EV on the market if you qualify for the full tax credit.