Hugging Face's logo

bradhutchings
/
DemoMachine-LLMs

GGUF
llamafile
Inference Endpoints
Model card Files Community
2
DemoMachine-LLMs / README.md
bradhutchings's picture
bradhutchings
Update README.md
c748f52 verified
preview code
|
raw
history blame
2.46 kB
metadata
license: apache-2.0

Hello

Thanks for your interest in my llamafiles packages. These are free for your use. These packages run on macOS, Windows, and Linux. Smaller models will even run on a Rasberry Pi! You should be familiar with running scripts on your computer. If you're not, please get help from someone who is.

If you would like paid assistance or need help with AI projects, please email me or start a discussion in the community. I do not accept pull requests.

-Brad
Brad Hutchings
[email protected]

Windows Instructinns

  1. Go to the Files and versions tab of this web page.
  2. Download the file DemoMachine LLMs (Windows).zip.
  3. Once downloaded, move the file to your Desktop and extract there.
  4. Open that new folder. right-click the Start-Apple-OpenELM-1.1B-Instruct.ps1. Choose Run with PowerShell*.
    • The script will download a .gguf model for Apple OpenELM 1.1B Instruct that I have prepared to the models sub-folder. This may take a few minutes.
    • The script will launch my DemoMachine-llamafile.exe executable to run the model.
    • A web browser window will open. Follow instuctions there.
  5. When you're finished with the model, close the web browser tab and close the PowerShell or Command window.

macOS, Linux, Raspberry Pi. etc.

  1. Go to the Files and versions tab of this web page.
  2. Download the file DemoMachine LLMs (macOS-Linux).zip.
  3. Once downloaded, move the file to your Desktop and extract there.
  4. Open a Terminal. Type commands:
    cd ~Desktop\DemoMachine\ LLMs\ \(macOS-Linux\)
chmod a+x *
exit
  5. Open that new folder. right-click the Start-Apple-OpenELM-1.1B-Instruct.sh. There should be a menu item to "run" the script. Choose that.
    • The script will download a .gguf model for Apple OpenELM 1.1B Instruct that I have prepared to the models sub-folder. This may take a few minutes.
    • The script will launch my DemoMachine-llamafile.exe executable to run the model.
    • A web browser window will open. Follow instuctions there.
  6. When you're finished with the model, close the web browser tab and close the PowerShell or Command window.

Note: macOS users, you may be asked to enable Developer Tools or some such when you launch the Terminal app for the first time. If this isn't a familiar place for you, please get some basic help from someone who knows their way around the Terminal.