anonderpling commited on
Commit
2f9ef61
1 Parent(s): 8eb931a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +33 -8
README.md CHANGED
@@ -1,3 +1,12 @@
 
 
 
 
 
 
 
 
 
1
  # A mirror of anything interesting on civitai or elsewhere on the web.
2
 
3
  This repo is *mostly* organized around the structure
@@ -23,6 +32,9 @@ version of git to use `sparse-checkout --add`.
23
 
24
  ## How to upload and download files
25
 
 
 
 
26
  ```bash
27
  !GIT_LFS_SPARSE_CHECKOUT=1 git clone [email protected]:anonderpling/civitai_mirror # this is my command so I can push changes, you'll need to use the https://hf.co/ instead of [email protected]:
28
  !cd civitai_mirror
@@ -41,8 +53,17 @@ version of git to use `sparse-checkout --add`.
41
  !find models embeddings --type f --size -2 | while read a; do echo "https://huggingface.co/anonderpling/civitai_mirror/resolve/main/${a}"; echo " out=${a}"; rm "${a}"; done | tee aria2.in.txt
42
  !aria2 -x16 --split=16 -i aria2.in.txt
43
  ```
 
 
 
 
 
 
44
 
45
- to upload more files via git:
 
 
 
46
 
47
  ```bash
48
  # enable the git lfs filters
@@ -67,8 +88,10 @@ print('https://hf.co/settings/keys')
67
  !git commit -m "add a message..."
68
  !git push
69
  ```
 
70
 
71
- to upload a single file via huggingface_hub:
 
72
 
73
  ```python
74
  inurl=api.upload_folder( # https://huggingface.co/docs/huggingface_hub/v0.14.1/en/package_reference/hf_api#huggingface_hub.HfApi.upload_folder
@@ -82,9 +105,11 @@ inurl=api.upload_folder( # https://huggingface.co/docs/huggingface_hub/v0.14.1/e
82
  )
83
  print("Uploaded files. Check them out at "+inurl)
84
  ```
 
85
 
86
- to upload multiple files via huggingface_hub:
87
-
 
88
  ```python
89
  inurl=api.upload_folder( # https://huggingface.co/docs/huggingface_hub/v0.14.1/en/package_reference/hf_api#huggingface_hub.HfApi.upload_folder
90
  token="hf_token", # only needed if you didn't already use huggingface_hub.login() previously.
@@ -99,9 +124,9 @@ inurl=api.upload_folder( # https://huggingface.co/docs/huggingface_hub/v0.14.1/e
99
  )
100
  print("Uploaded files. Check them out at "+inurl)
101
  ```
 
102
 
103
-
104
- #### It's extremely important to remove the ssh key from your HF repo after you're done with it. this ensures that nobody else can access your account.
105
 
106
  Paperspace makes free notebooks public, and I'm not sure
107
  if that includes filesystem access or outputs; if someone
@@ -130,6 +155,6 @@ afaik)
130
 
131
  ## License
132
 
133
- I like WTFPL. That means anything generated by @anonderpling is licensed WTFPL. That means pretty much only this readme, since everything else is someone else's work.
134
 
135
- Other files? You'll have to find their official sources to find their licenses. The licenses for the civitai uploads *might* be in the .civitai.info files, which are standard json (AFAIK) as returned by the civitai API.
 
1
+ ---
2
+ license: wtfpl
3
+ pipeline_tag: text-to-image
4
+ tags:
5
+ - Civitai
6
+ - mirror
7
+ - stable diffusion
8
+ ---
9
+
10
  # A mirror of anything interesting on civitai or elsewhere on the web.
11
 
12
  This repo is *mostly* organized around the structure
 
32
 
33
  ## How to upload and download files
34
 
35
+ <details>
36
+ <summary>sparse checkout with git, bypassing LFS, download with aria2c</summary>
37
+
38
  ```bash
39
  !GIT_LFS_SPARSE_CHECKOUT=1 git clone [email protected]:anonderpling/civitai_mirror # this is my command so I can push changes, you'll need to use the https://hf.co/ instead of [email protected]:
40
  !cd civitai_mirror
 
53
  !find models embeddings --type f --size -2 | while read a; do echo "https://huggingface.co/anonderpling/civitai_mirror/resolve/main/${a}"; echo " out=${a}"; rm "${a}"; done | tee aria2.in.txt
54
  !aria2 -x16 --split=16 -i aria2.in.txt
55
  ```
56
+ </details>
57
+
58
+ #### Uploading files:
59
+
60
+ - [repo uploader](https://anonderpling-repo-uploader.hf.space), for single files. requires write permission to repo.
61
+ - [Civitai model uploader](https://mirroring-upload-civitai-model.hf.space), for uploading a model from Civitai. can create PR. intended for uploading model previews and civitai's API response json as well as the model, for use by Civitai unofficial extension.
62
 
63
+ </details>
64
+
65
+ <details>
66
+ <summary>to upload more files via git</summary>
67
 
68
  ```bash
69
  # enable the git lfs filters
 
88
  !git commit -m "add a message..."
89
  !git push
90
  ```
91
+ </details>
92
 
93
+ <details>
94
+ <summary>to upload a single file via huggingface_hub:</summary>
95
 
96
  ```python
97
  inurl=api.upload_folder( # https://huggingface.co/docs/huggingface_hub/v0.14.1/en/package_reference/hf_api#huggingface_hub.HfApi.upload_folder
 
105
  )
106
  print("Uploaded files. Check them out at "+inurl)
107
  ```
108
+ </details>
109
 
110
+ <details>
111
+ <summary>to upload multiple files via huggingface_hub:</summary>
112
+
113
  ```python
114
  inurl=api.upload_folder( # https://huggingface.co/docs/huggingface_hub/v0.14.1/en/package_reference/hf_api#huggingface_hub.HfApi.upload_folder
115
  token="hf_token", # only needed if you didn't already use huggingface_hub.login() previously.
 
124
  )
125
  print("Uploaded files. Check them out at "+inurl)
126
  ```
127
+ </details>
128
 
129
+ #### Using paperspace: It's extremely important to remove the ssh key from your HF repo after you're done with it. this ensures that nobody else can access your account.
 
130
 
131
  Paperspace makes free notebooks public, and I'm not sure
132
  if that includes filesystem access or outputs; if someone
 
155
 
156
  ## License
157
 
158
+ I like WTFPL. That means anything generated by @anonderpling is licensed WTFPL. That means pretty much only this readme and a couple scripts, since everything else is someone else's work.
159
 
160
+ Other files? You'll have to find their official sources to find their licenses. The licenses for the civitai uploads *might* be in the .civitai.info files, which are standard json as returned by the civitai API.