anonderpling
commited on
Commit
•
2f9ef61
1
Parent(s):
8eb931a
Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
# A mirror of anything interesting on civitai or elsewhere on the web.
|
2 |
|
3 |
This repo is *mostly* organized around the structure
|
@@ -23,6 +32,9 @@ version of git to use `sparse-checkout --add`.
|
|
23 |
|
24 |
## How to upload and download files
|
25 |
|
|
|
|
|
|
|
26 |
```bash
|
27 |
!GIT_LFS_SPARSE_CHECKOUT=1 git clone [email protected]:anonderpling/civitai_mirror # this is my command so I can push changes, you'll need to use the https://hf.co/ instead of [email protected]:
|
28 |
!cd civitai_mirror
|
@@ -41,8 +53,17 @@ version of git to use `sparse-checkout --add`.
|
|
41 |
!find models embeddings --type f --size -2 | while read a; do echo "https://huggingface.co/anonderpling/civitai_mirror/resolve/main/${a}"; echo " out=${a}"; rm "${a}"; done | tee aria2.in.txt
|
42 |
!aria2 -x16 --split=16 -i aria2.in.txt
|
43 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
44 |
|
45 |
-
|
|
|
|
|
|
|
46 |
|
47 |
```bash
|
48 |
# enable the git lfs filters
|
@@ -67,8 +88,10 @@ print('https://hf.co/settings/keys')
|
|
67 |
!git commit -m "add a message..."
|
68 |
!git push
|
69 |
```
|
|
|
70 |
|
71 |
-
|
|
|
72 |
|
73 |
```python
|
74 |
inurl=api.upload_folder( # https://huggingface.co/docs/huggingface_hub/v0.14.1/en/package_reference/hf_api#huggingface_hub.HfApi.upload_folder
|
@@ -82,9 +105,11 @@ inurl=api.upload_folder( # https://huggingface.co/docs/huggingface_hub/v0.14.1/e
|
|
82 |
)
|
83 |
print("Uploaded files. Check them out at "+inurl)
|
84 |
```
|
|
|
85 |
|
86 |
-
|
87 |
-
|
|
|
88 |
```python
|
89 |
inurl=api.upload_folder( # https://huggingface.co/docs/huggingface_hub/v0.14.1/en/package_reference/hf_api#huggingface_hub.HfApi.upload_folder
|
90 |
token="hf_token", # only needed if you didn't already use huggingface_hub.login() previously.
|
@@ -99,9 +124,9 @@ inurl=api.upload_folder( # https://huggingface.co/docs/huggingface_hub/v0.14.1/e
|
|
99 |
)
|
100 |
print("Uploaded files. Check them out at "+inurl)
|
101 |
```
|
|
|
102 |
|
103 |
-
|
104 |
-
#### It's extremely important to remove the ssh key from your HF repo after you're done with it. this ensures that nobody else can access your account.
|
105 |
|
106 |
Paperspace makes free notebooks public, and I'm not sure
|
107 |
if that includes filesystem access or outputs; if someone
|
@@ -130,6 +155,6 @@ afaik)
|
|
130 |
|
131 |
## License
|
132 |
|
133 |
-
I like WTFPL. That means anything generated by @anonderpling is licensed WTFPL. That means pretty much only this readme, since everything else is someone else's work.
|
134 |
|
135 |
-
Other files? You'll have to find their official sources to find their licenses. The licenses for the civitai uploads *might* be in the .civitai.info files, which are standard json
|
|
|
1 |
+
---
|
2 |
+
license: wtfpl
|
3 |
+
pipeline_tag: text-to-image
|
4 |
+
tags:
|
5 |
+
- Civitai
|
6 |
+
- mirror
|
7 |
+
- stable diffusion
|
8 |
+
---
|
9 |
+
|
10 |
# A mirror of anything interesting on civitai or elsewhere on the web.
|
11 |
|
12 |
This repo is *mostly* organized around the structure
|
|
|
32 |
|
33 |
## How to upload and download files
|
34 |
|
35 |
+
<details>
|
36 |
+
<summary>sparse checkout with git, bypassing LFS, download with aria2c</summary>
|
37 |
+
|
38 |
```bash
|
39 |
!GIT_LFS_SPARSE_CHECKOUT=1 git clone [email protected]:anonderpling/civitai_mirror # this is my command so I can push changes, you'll need to use the https://hf.co/ instead of [email protected]:
|
40 |
!cd civitai_mirror
|
|
|
53 |
!find models embeddings --type f --size -2 | while read a; do echo "https://huggingface.co/anonderpling/civitai_mirror/resolve/main/${a}"; echo " out=${a}"; rm "${a}"; done | tee aria2.in.txt
|
54 |
!aria2 -x16 --split=16 -i aria2.in.txt
|
55 |
```
|
56 |
+
</details>
|
57 |
+
|
58 |
+
#### Uploading files:
|
59 |
+
|
60 |
+
- [repo uploader](https://anonderpling-repo-uploader.hf.space), for single files. requires write permission to repo.
|
61 |
+
- [Civitai model uploader](https://mirroring-upload-civitai-model.hf.space), for uploading a model from Civitai. can create PR. intended for uploading model previews and civitai's API response json as well as the model, for use by Civitai unofficial extension.
|
62 |
|
63 |
+
</details>
|
64 |
+
|
65 |
+
<details>
|
66 |
+
<summary>to upload more files via git</summary>
|
67 |
|
68 |
```bash
|
69 |
# enable the git lfs filters
|
|
|
88 |
!git commit -m "add a message..."
|
89 |
!git push
|
90 |
```
|
91 |
+
</details>
|
92 |
|
93 |
+
<details>
|
94 |
+
<summary>to upload a single file via huggingface_hub:</summary>
|
95 |
|
96 |
```python
|
97 |
inurl=api.upload_folder( # https://huggingface.co/docs/huggingface_hub/v0.14.1/en/package_reference/hf_api#huggingface_hub.HfApi.upload_folder
|
|
|
105 |
)
|
106 |
print("Uploaded files. Check them out at "+inurl)
|
107 |
```
|
108 |
+
</details>
|
109 |
|
110 |
+
<details>
|
111 |
+
<summary>to upload multiple files via huggingface_hub:</summary>
|
112 |
+
|
113 |
```python
|
114 |
inurl=api.upload_folder( # https://huggingface.co/docs/huggingface_hub/v0.14.1/en/package_reference/hf_api#huggingface_hub.HfApi.upload_folder
|
115 |
token="hf_token", # only needed if you didn't already use huggingface_hub.login() previously.
|
|
|
124 |
)
|
125 |
print("Uploaded files. Check them out at "+inurl)
|
126 |
```
|
127 |
+
</details>
|
128 |
|
129 |
+
#### Using paperspace: It's extremely important to remove the ssh key from your HF repo after you're done with it. this ensures that nobody else can access your account.
|
|
|
130 |
|
131 |
Paperspace makes free notebooks public, and I'm not sure
|
132 |
if that includes filesystem access or outputs; if someone
|
|
|
155 |
|
156 |
## License
|
157 |
|
158 |
+
I like WTFPL. That means anything generated by @anonderpling is licensed WTFPL. That means pretty much only this readme and a couple scripts, since everything else is someone else's work.
|
159 |
|
160 |
+
Other files? You'll have to find their official sources to find their licenses. The licenses for the civitai uploads *might* be in the .civitai.info files, which are standard json as returned by the civitai API.
|