orca_mini_v3_13B-GGML / Dockerfile

Commit History

feat: converted readme.md to index.html
7652cb7

limcheekin commited on

chore: add copy main.py
28ee0f2

limcheekin commited on

chore: updated docker file to copy readme
00f23ad

limcheekin commited on

chore: reverted model download link, confirmed that ggml model size cannot greater than 10GB
12be50e

limcheekin commited on

chore: added apt-get install pkg-config to fix the 'Could NOT find PkgConfig' error
ac36b1f

limcheekin commited on

chore: updated CMAKE_ARGS, added --verbose for troubleshooting and updated model download link
9767187

limcheekin commited on

feat: updated to orca_mini_v3_13b.ggmlv3.q5_K_S model
f112f68

limcheekin commited on

feat: updated to 13B ggmlv3.q5_K_S model as q6_K model size > 10GB
1dd7ff1

limcheekin commited on

chore: reverted to old installation config as the latest one caused ERROR: Could not build wheels for llama-cpp-python, which is required to install pyproject.toml-based projects
e87aa8c

limcheekin commited on

chore: updated installation command and model download link
dc445d6

limcheekin commited on

feat: updated to 13B ggmlv3.q6_K model
a5da896

limcheekin commited on

feat: first import
73cc25e

limcheekin commited on