znation HF Staff commited on
Commit
0bf9b37
·
1 Parent(s): 426980c

fix: 256 -> back to 64

Browse files
Files changed (1) hide show
  1. index.html +1 -1
index.html CHANGED
@@ -19,7 +19,7 @@
19
  <div class="card">
20
  <h1>Visualizing Repo-level Dedupe</h1>
21
  <p>This visualization demonstrates the amount of <a target="_blank" rel="noopener noreferrer" href="https://huggingface.co/blog/from-files-to-chunks">chunk-level dedupe</a> across all public repos.</p>
22
- <p>"Dedupe factor" is defined as the number of re-uses of a given "xorb". A "xorb" is a collection of content-defined chunks, typically around 1,000 chunks comprising up to 256 MB of total data.</p>
23
  </div>
24
  <div id="vis"></div>
25
  <script>
 
19
  <div class="card">
20
  <h1>Visualizing Repo-level Dedupe</h1>
21
  <p>This visualization demonstrates the amount of <a target="_blank" rel="noopener noreferrer" href="https://huggingface.co/blog/from-files-to-chunks">chunk-level dedupe</a> across all public repos.</p>
22
+ <p>"Dedupe factor" is defined as the number of re-uses of a given "xorb". A "xorb" is a collection of content-defined chunks, typically around 1,000 chunks comprising up to 64 MB of total data.</p>
23
  </div>
24
  <div id="vis"></div>
25
  <script>