• 9 Posts
  • 292 Comments
Joined 2 years ago
cake
Cake day: June 8th, 2023

help-circle
  • CubitOom@infosec.pubtoMemes@sopuli.xyzSame
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 day ago

    My guess is that if a 4090 is bottlenecked 5% on pcie 3.0 (although I think it’s closer to 10%). Also if pcie 4.0 is double the speed as 3.0, and pcie 5.0 is double 4.0. Then the bottleneck will be closer to 10% if running a 5080 on pcie 3.0.




  • If someone is complaining about windows, or raising privacy concerns that Linux would solve, or just talking about price options, then I think it’s perfectly fair to mention Linux.

    Right now the biggest issue with Linux is that some software is not made for it. With more Linux market share, devs have a higher incentive to build software for Linux. Like imagine if videogame devs didn’t think they needed windows to work, or Mac to run adobe.









  • I used to think this way. Until I found that with emacs you can edit any file on an SSH enabled computer remotely. Meaning that not only are you no longer constrained by what the computer has installed. But you can use your personality configured editor while editing that file. It’s called tramp.

    BTW, with Emacs you can use vim key bindings evil-mode, so don’t stress about that.








  • You are right that something that most others will host for free are going to be censored since otherwise they might have some kind of responsibility legally. I learned this while trying to diagnose an issue with my cars door lock.

    At the end of the day, anything you ask some hosted llm is being recorded so if you actually want something uncensored or something that gives you a sense of freedom then the only real option is to self host.

    Luckily, it’s very simple and can even be done on a low spec device if you pick the right model. The amount and type of ram you have a will dictate how many parameters you can run at a decent speed.

    Here’s 3 options with increasing difficulty (not much however) written for Arch Linux: https://infosec.pub/comment/13623228