PaSa: An LLM Agent for Comprehensive Academic Paper Search
Paper
•
2501.10120
•
Published
•
42
dev7halo
dev7halo
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
15 days ago
PaSa: An LLM Agent for Comprehensive Academic Paper Search
updated
a model
26 days ago
dev7halo/ModernBERT-base-ko-test-v2
reacted
to
singhsidhukuldeep's
post
with 👍
26 days ago
Exciting breakthrough in e-commerce recommendation systems!
Walmart Global Tech researchers have developed a novel Triple Modality Fusion (TMF) framework that revolutionizes how we make product recommendations.
>> Key Innovation
The framework ingeniously combines three distinct data types:
- Visual data to capture product aesthetics and context
- Textual information for detailed product features
- Graph data to understand complex user-item relationships
>> Technical Architecture
The system leverages a Large Language Model (Llama2-7B) as its backbone and introduces several sophisticated components:
Modality Fusion Module
- All-Modality Self-Attention (AMSA) for unified representation
- Cross-Modality Attention (CMA) mechanism for deep feature integration
- Custom FFN adapters to align different modality embeddings
Advanced Training Strategy
- Curriculum learning approach with three complexity levels
- Parameter-Efficient Fine-Tuning using LoRA
- Special token system for behavior and item representation
>> Real-World Impact
The results are remarkable:
- 38.25% improvement in Electronics recommendations
- 43.09% boost in Sports category accuracy
- Significantly higher human evaluation scores compared to traditional methods
Currently deployed in Walmart's production environment, this research demonstrates how combining multiple data modalities with advanced LLM architectures can dramatically improve recommendation accuracy and user satisfaction.
Organizations
dev7halo's activity
upvoted
a
paper
15 days ago
upvoted
an
article
5 months ago
Article
Selective fine-tuning of Language Models with Spectrum
By
•
•
32
upvoted
an
article
6 months ago
Article
Tokenization Is A Dead Weight (Tokun Part 1)
By
•
•
16
upvoted
6
articles
7 months ago
Article
Docmatix - a huge dataset for Document Visual Question Answering
•
72
Article
Mergoo: Efficiently Build Your Own MoE LLM
By
•
•
44Article
Rank-Stabilized LoRA: Unlocking the Potential of LoRA Fine-Tuning
By
•
•
19Article
Merge Large Language Models with mergekit
By
•
•
90Article
Train a Llama model from scratch
By
•
•
49Article
Fine-tuning LLMs with Singular Value Decomposition
By
•
•
11
upvoted
an
article
8 months ago
Article
Uncensor any LLM with abliteration
By
•
•
415