74 23 120

Yaowei Zheng

hiyouga

https://github.com/hiyouga

AI & ML interests

LLM Knowledge Management

Articles

GaLore: Advancing Large Model Training on Consumer-grade Hardware

Mar 20

• 24

Organizations

hiyouga's activity

upvoted a collection 1 day ago

Qwen2.5

Collection

Qwen2.5 language models, including pretrained and instruction-tuned models of 7 sizes, including 0.5B, 1.5B, 3B, 7B, 14B, 32B, and 72B. • 45 items • Updated 1 day ago • 105

upvoted an article 14 days ago

Article

Meet Yi-Coder: A Small but Mighty LLM for Code

•

15 days ago

• 11

upvoted a paper 15 days ago

OLMoE: Open Mixture-of-Experts Language Models

Paper • 2409.02060 • Published 16 days ago • 74

upvoted an article 15 days ago

Article

Understanding Vector Quantization in VQ-VAE

•

23 days ago

• 9

upvoted 2 papers 16 days ago

Mini-Omni: Language Models Can Hear, Talk While Thinking in Streaming

Paper • 2408.16725 • Published 21 days ago • 49

LongRecipe: Recipe for Efficient Long Context Generalization in Large Languge Models

Paper • 2409.00509 • Published 19 days ago • 38

upvoted a paper 21 days ago

Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts

Paper • 2408.15664 • Published 23 days ago • 11

upvoted a paper about 1 month ago

I-SHEEP: Self-Alignment of LLM from Scratch through an Iterative Self-Enhancement Paradigm

Paper • 2408.08072 • Published Aug 15 • 31

upvoted a paper about 2 months ago

OpenDevin: An Open Platform for AI Software Developers as Generalist Agents

Paper • 2407.16741 • Published Jul 23 • 67

upvoted 3 papers 2 months ago

upvoted a paper 3 months ago

Mixture-of-Agents Enhances Large Language Model Capabilities

Paper • 2406.04692 • Published Jun 7 • 54

upvoted 2 papers 4 months ago

DiveR-CT: Diversity-enhanced Red Teaming with Relaxing Constraints

Paper • 2405.19026 • Published May 29 • 7

OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Framework

Paper • 2405.11143 • Published May 20 • 33

upvoted a collection 5 months ago

ZeroGPU Spaces

Collection

ZeroGPU Spaces made by the community • 17 items • Updated Jun 6 • 217

upvoted an article 5 months ago

Article

GaLore: Advancing Large Model Training on Consumer-grade Hardware

Mar 20

• 24

upvoted 3 papers 5 months ago

Rho-1: Not All Tokens Are What You Need

Paper • 2404.07965 • Published Apr 11 • 83

Adapting Large Language Models via Reading Comprehension

Paper • 2309.09530 • Published Sep 18, 2023 • 75

ReFT: Representation Finetuning for Language Models

Paper • 2404.03592 • Published Apr 4 • 86

upvoted a paper 6 months ago

LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models

Paper • 2403.13372 • Published Mar 20 • 58

upvoted a paper 7 months ago

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

Paper • 2403.03507 • Published Mar 6 • 182

upvoted a collection 8 months ago

Qwen1.5

Collection

Qwen1.5 is the improved version of Qwen, the large language model series developed by Alibaba Cloud. • 55 items • Updated 1 day ago • 205