SocialistVibes01@lemmy.ml to Linux@lemmy.mlEnglish · 8 days ago

Which specs are as low as reasonable possible for local LLM models? Do you recommend some distro in particular?

6

9

Which specs are as low as reasonable possible for local LLM models? Do you recommend some distro in particular?

SocialistVibes01@lemmy.ml to Linux@lemmy.mlEnglish · 8 days ago

6

Something to handle code, text and math.

Chat

thedeadwalking4242@lemmy.world
link
fedilink
arrow-up
1·
7 days ago
https://apxml.com/tools/vram-calculator

Linux@lemmy.ml

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !linux@lemmy.ml

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word “Linux” in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Posts must be relevant to operating systems running the Linux kernel. GNU/Linux or otherwise.
No misinformation
No NSFW content
No hate speech, bigotry, etc

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

153 users / day
1.01K users / week
2.5K users / month
6.84K users / 6 months
1 local subscriber
65.4K subscribers
2.23K Posts
17.8K Comments
Modlog