rajatarya/xet-prod
Updated
Rajat Arya
rajatarya
AI & ML interests
None yet
Recent Activity
published
a model
8 days ago
rajatarya/xet-prod
Organizations
rajatarya's activity
published
a
model
8 days ago
Let's go! Get on the waitlist - can't wait to get you onboarded with Xet. From a customer onboarding last week, "Yeah, it's pretty seamless.... oh wait, that was fast."
reacted to
jsulz's
post with ❤️🚀
24 days ago
Post
1407
It's finally here ❤️
Build faster than ever with lightning fast upload and download speeds starting today on the Hub ⚡
Xet storage is rolling out access across the Hub - join the waitlist here https://huggingface.co/join/xet
You can apply for yourself, or your entire organization. Head over to your account settings for more information or join anywhere you see the Xet logo on a repository you know.
Have questions? Join the conversation below 👇 or open a discussion on the Xet team page xet-team/README
Build faster than ever with lightning fast upload and download speeds starting today on the Hub ⚡
Xet storage is rolling out access across the Hub - join the waitlist here https://huggingface.co/join/xet
You can apply for yourself, or your entire organization. Head over to your account settings for more information or join anywhere you see the Xet logo on a repository you know.
Have questions? Join the conversation below 👇 or open a discussion on the Xet team page xet-team/README
-
- 6 replies
upvoted
an
article
about 2 months ago
Article
From Chunks to Blocks: Accelerating Uploads and Downloads on the Hub
•
55
reacted to
jsulz's
post with 👀👍🔥
4 months ago
Post
1427
Doing a lot of benchmarking and visualization work, which means I'm always searching for interesting repos in terms of file types, size, branches, and overall structure.
To help, I built a Space jsulz/repo-info that lets you search for any repo and get back:
- Treemap of the repository, color coded by file/directory size
- Repo branches and their size
- Cumulative size of different file types (e.g., the total size of all the safetensors in the repo)
And because I'm interested in how this will fit in our work to leverage content-defined chunking for versioning repos on the Hub
- https://huggingface.co/blog/from-files-to-chunks - everything has the number of chunks (1 chunk = 64KB) as well as the total size in bytes.
Some of the treemaps are pretty cool. Attached are black-forest-labs/FLUX.1-dev and for fun laion/laion-audio-preview (which has nearly 10k .tar files 🤯)
To help, I built a Space jsulz/repo-info that lets you search for any repo and get back:
- Treemap of the repository, color coded by file/directory size
- Repo branches and their size
- Cumulative size of different file types (e.g., the total size of all the safetensors in the repo)
And because I'm interested in how this will fit in our work to leverage content-defined chunking for versioning repos on the Hub
- https://huggingface.co/blog/from-files-to-chunks - everything has the number of chunks (1 chunk = 64KB) as well as the total size in bytes.
Some of the treemaps are pretty cool. Attached are black-forest-labs/FLUX.1-dev and for fun laion/laion-audio-preview (which has nearly 10k .tar files 🤯)
-
- 2 replies
replied to
cfahlgren1's
post
5 months ago
Also - easily reference your datasets in your research, giving conference committees greater confidence in the reproducibility of your results (ex. share the dataset, the model, the paper, and the analysis - all on the Hub).
Research needs reproducibility, use HF Hub for collaboration & dissemination:
- Data: Hub Dataset (https://huggingface.co/new-dataset)
- Model: Hub Model (https://huggingface.co/new)
- Paper: Hub Papers (https://huggingface.co/papers)
- Analysis / Results: Hub Spaces (https://huggingface.co/spaces)
upvoted
an
article
6 months ago
Article
Improving Parquet Dedupe on Hugging Face Hub
•
32
upvoted
2
articles
8 months ago
Article
The 5 Most Under-Rated Tools on Hugging Face
•
87
Article
XetHub is joining Hugging Face!
•
89