Touhou AI Experimental Group (MOFU)

community

AI & ML interests

nyan

Recent Activity

touhou-ai-experimental's activity

lunarfluΒ 
posted an update 20 days ago
not-lainΒ 
posted an update about 1 month ago
view post
Post
1820
ever wondered how you can make an API call to a visual-question-answering model without sending an image url πŸ‘€

you can do that by converting your local image to base64 and sending it to the API.

recently I made some changes to my library "loadimg" that allows you to make converting images to base64 a breeze.
πŸ”— https://github.com/not-lain/loadimg

API request example πŸ› οΈ:
from loadimg import load_img
from huggingface_hub import InferenceClient

# or load a local image
my_b64_img = load_img(imgPath_url_pillow_or_numpy ,output_type="base64" ) 

client = InferenceClient(api_key="hf_xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx")

messages = [
	{
		"role": "user",
		"content": [
			{
				"type": "text",
				"text": "Describe this image in one sentence."
			},
			{
				"type": "image_url",
				"image_url": {
					"url": my_b64_img # base64 allows using images without uploading them to the web
				}
			}
		]
	}
]

stream = client.chat.completions.create(
    model="meta-llama/Llama-3.2-11B-Vision-Instruct", 
	messages=messages, 
	max_tokens=500,
	stream=True
)

for chunk in stream:
    print(chunk.choices[0].delta.content, end="")
lunarfluΒ 
posted an update 4 months ago
not-lainΒ 
posted an update 5 months ago
lunarfluΒ 
posted an update 5 months ago
view post
Post
1879
Cool things this week from @huggingface !

🌎AI math olympiad winner NuminaMath is here!
πŸ€—Announcing New Hugging Face and Keras NLP integration
✨UI overhaul to HF tokens!
🧊 Embed our dataset viewer on any webpage!

https://huggingface.co/blog/winning-aimo-progress-prize
https://huggingface.co/blog/keras-nlp-integration
https://huggingface.co/settings/tokens
https://x.com/julien_c/status/1812099420726456457

Check out the full list on our discord! πŸ‘‡
https://discord.com/invite/JfAtkvEtRb
not-lainΒ 
posted an update 5 months ago
view post
Post
7696
I am now a huggingface fellow πŸ₯³
Β·
not-lainΒ 
posted an update 6 months ago
view post
Post
2660
I have finished writing a blogpost about building an image-based retrieval system, This is one of the first-ever approaches to building such a pipeline using only open-source models/libraries πŸ€—

You can checkout the blogpost in https://huggingface.co/blog/not-lain/image-retriever and the associated space at not-lain/image-retriever .

✨ If you want to request another blog post consider letting me know down below or you can reach out to me through any of my social media

πŸ“– Happy reading !
not-lainΒ 
posted an update 6 months ago
view post
Post
1434
Hello beautiful people.
I wanted to thank everyone that read my blogpost and I am glad to share that we have achieved 11000 readers πŸ₯³
I couldn't have done this without you, so once again thanks a lot everyone for the support πŸ’–
If you haven't already you can read my blog post at: https://huggingface.co/blog/not-lain/rag-chatbot-using-llama3
not-lainΒ 
posted an update 7 months ago
view post
Post
2075
It is with great pleasure I inform you that huggingface's ModelHubMixin reached 200+ models on the hub πŸ₯³

ModelHubMixin is a class developed by HF to integrate AI models with the hub with ease and it comes with 3 methods :
* save_pretrained
* from_pretrained
* push_to_hub

Shoutout to @nielsr , @Wauplin and everyone else on HF for their awesome work πŸ€—

If you are not familiar with ModelHubMixin and you are looking for extra resources you might consider :
* docs: https://huggingface.co/docs/huggingface_hub/main/en/package_reference/mixins
πŸ”—blog about training models with the trainer API and using ModelHubMixin: https://huggingface.co/blog/not-lain/trainer-api-and-mixin-classes
πŸ”—GitHub repo with pip integration: https://github.com/not-lain/PyTorchModelHubMixin-template
πŸ”—basic guide: https://huggingface.co/posts/not-lain/884273241241808
lunarfluΒ 
posted an update 7 months ago
view post
Post
2313
By popular demand, HF activity tracker v1.0 is here! πŸ“Š let's build it together!πŸ€—

Lots of things to improve, feel free to open PRs in the community tab!

good PR ideas:
- track more types of actions that include date+time
- bigger plot
- track discord activity too 🀯
- link github? ⚑

https://huggingface.co/spaces/huggingface-projects/LevelBot
  • 2 replies
Β·
not-lainΒ 
posted an update 7 months ago
view post
Post
1923
I will be delivering an introductory coding session this Sunday 7Pm gmt+1 time about huggingface, if you are new to HF and don't know where to begin, you are welcome to join us πŸ€—
πŸ“ŒPlace: huggingface discord server
πŸ”—Link : https://discord.gg/hugging-face-879548962464493619?event=1245406127668203541
  • 2 replies
Β·
lunarfluΒ 
posted an update 7 months ago
view post
Post
1961
Weekly highlights for the HF ecosystem!

πŸš€ Phi 3
πŸ¦… Falcon VLM
πŸ€— sentence-transformers v3.0 is here! Train and finetune embedding models with multi-GPU training, bf16 support, loss logging, callbacks and more!
πŸ₯³ Gradio launch event 6/6! We're launching 1.0 versions of two new libraries, Python + JS client libraries to programmatically query Gradio apps, and several new features making it easier to use Gradio apps in production!
✨ Tools now available in HuggingChat! Use any AI apps built by the community! πŸ”₯
🧊 ML for 3D Course Unit 3 is here! Covering Gaussian splatting, how it fits in the generative 3D pipeline, and hands-on code to build your own demo!

See the full list here!
https://discord.com/channels/879548962464493619/897387888663232554/1245036889539612764 !
  • 2 replies
Β·
lunarfluΒ 
posted an update 7 months ago
view post
Post
1933
cooking up something....anyone interested in a daily activity tracker for HF?
Β·
not-lainΒ 
posted an update 7 months ago
view post
Post
1532
If you're a researcher or developing your own model πŸ‘€ you might need to take a look at huggingface's ModelHubMixin classes.
They are used to seamlessly integrate your AI model with huggingface and to save/ load your model easily πŸš€

1️⃣ make sure you're using the appropriate library version
pip install -qU "huggingface_hub>=0.22"

2️⃣ inherit from the appropriate class
from huggingface_hub import PyTorchModelHubMixin
from torch import nn

class MyModel(nn.Module,PyTorchModelHubMixin):
  def __init__(self, a, b):
    super().__init__()
    self.layer = nn.Linear(a,b)
  def forward(self,inputs):
    return self.layer(inputs)

first_model = MyModel(3,1)

4️⃣ push the model to the hub (or use save_pretrained method to save locally)
first_model.push_to_hub("not-lain/test")

5️⃣ Load and initialize the model from the hub using the original class
pretrained_model = MyModel.from_pretrained("not-lain/test")

lunarfluΒ 
posted an update 7 months ago
not-lainΒ 
posted an update 7 months ago
view post
Post
1128
I'm looking for open-source image embedding models for RAG applications and/or multimodel embedding models if they exist in the first place.

if you have any extra resources about using, creating, or finetuning them feel free to share them below πŸ€—
not-lainΒ 
posted an update 8 months ago
view post
Post
1222
πŸ₯³celebrating 5K readers in one of my blog posts πŸ₯³
I came back with another one this time πŸ€“
in this blog you will learn πŸ“– :
* How to train custom AI models with the trainer API πŸš€
* integrate your AI models with HF using the mixin classes πŸ”₯

happy reading everyone πŸ€—
πŸ”—link: https://huggingface.co/blog/not-lain/trainer-api-and-mixin-classes
  • 2 replies
Β·
not-lainΒ 
posted an update 8 months ago
not-lainΒ 
posted an update 8 months ago
view post
Post
1781
πŸš€ just reached 3K+ readers on this blog post about RAG using only HFπŸ€— related tools in just a little over 1 week from publishing.

πŸ“ƒthe most interesting thing about it is that you can use the FAISS index in the datasets library to retrieve your most similar documents.

πŸ”—https://huggingface.co/blog/not-lain/rag-chatbot-using-llama3

Happy reading everyone ✨
not-lainΒ 
posted an update 8 months ago
view post
Post
2289
πŸ”₯ **transformers** 4.40.0 is out πŸ”₯

βš™οΈ you can now push your custom pipelines easily to πŸ€—, allowing people to easily use your model in a more friendly, unified way.

πŸ€“ I already updated my blog to match the new feature https://huggingface.co/blog/not-lain/custom-architectures-with-huggingface.

πŸ“ƒA list of some repos that have custom pipelines :
* briaai/RMBG-1.4
* p1atdev/siglip-tagger-test-3
* sgugger/test-dynamic-pipeline