Hanna Yukhymenko's picture

1 2 4

Hanna Yukhymenko

hannayukhymenko

·

https://ayukh.com

AI & ML interests

Multilingual LLM, privacy/safety @ ETHZ

Recent Activity

updated a dataset about 15 hours ago

hannayukhymenko/math-500-qwen-2.5-rpm-post-training

published a dataset 1 day ago

hannayukhymenko/math-500-qwen-2.5-rpm-post-training

reacted to stefan-it's post with ❤️ 12 days ago

My latest project is the outcome of the last 2+ years working with TPUs from the amazing TPU Research Cloud (TRC) program and training Encoder-only LMs with the TensorFlow Model Garden library. 👉 Link: https://github.com/stefan-it/model-garden-lms An overview of some features: - Cheatsheet for setting-up a TPU VM Pod (with all necessary dependencies) to pretrain LMs with TF Model Garden - Conversion scripts that convert TF Model Garden weights to Hugging Face Transformers-compatible models - Supported architectures include BERT, BERT with Token Dropping and TEAMS I also released BERT-based models pretrained on the great Hugging Face FineWeb and FineWeb-Edu datasets (10BT subset). With more to come! 👉 Model Hub Link: https://huggingface.co/model-garden-lms If you find these resources useful, please give them a like! Made from Bavarian Oberland with ❤️ and 🥨.

View all activity

Organizations

Papers 1

arxiv:2406.07217

spaces 1

Synthpai Inference

models

None public yet

datasets 1

hannayukhymenko/math-500-qwen-2.5-rpm-post-training

Viewer • Updated about 15 hours ago • 20 • 15