This video shows how to install exllamav2 locally and run any model in exl2 format locally.
Showing posts with label exl2. Show all posts
Showing posts with label exl2. Show all posts
Monday, May 6, 2024
Subscribe to:
Posts (Atom)
This video shows how to install exllamav2 locally and run any model in exl2 format locally.