Portable LLMs with llamafile
Portable LLMs with llamafile
Posted May 15, 2024 18:18 UTC (Wed) by geofft (subscriber, #59789)In reply to: Portable LLMs with llamafile by taladar
Parent article: Portable LLMs with llamafile
I mean, there was/is a thing called just Torch, but PyTorch, a set of Python bindings to it, got popular because you do want some sort of REPL / interpreted language to work with it and Python is a pretty good one, especially for the problem domain of scientific computing + interfacing with data sets. (I think OG Torch came with Lua, which is a little easier to embed into a C codebase but much less popular for scientific computing.)
Would it be helpful if PyTorch were additionally available as a standalone application with an embedded Python interpreter (probably an embedded Jupyter or something) so it was one thing to download and install and it was independent of any other Python version/environment you might have on your aystem?
