Portable LLMs with llamafile
Portable LLMs with llamafile
Posted May 15, 2024 16:55 UTC (Wed) by ben.alkov (guest, #171521)In reply to: Portable LLMs with llamafile by taladar
Parent article: Portable LLMs with llamafile
Specifically addressing Torch - their recently-available binary distro downloadable from PyPi *does* bundle everything, so that there's no need to try to figure out which one you need. Of course, the download is significantly larger than the individual platform packages.
