Huiqiang Jiang's picture

Huiqiang Jiang PRO

iofu728

·

https://www.microsoft.com/en-us/research/people/hjiang/

AI & ML interests

None yet

Articles

How to Optimize TTFT of 8B LLMs with 1M Tokens to 20s

Organizations

iofu728's activity

upvoted an article 1 day ago

Article

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

2 days ago

• 96

upvoted a paper 3 days ago

RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval

Paper • 2409.10516 • Published 3 days ago • 26

upvoted a paper 29 days ago

MagicDec: Breaking the Latency-Throughput Tradeoff for Long Context Generation with Speculative Decoding

Paper • 2408.11049 • Published about 1 month ago • 10

upvoted an article about 1 month ago

Article

A failed experiment: Infini-Attention, and why we should keep trying?

Aug 14

• 40

upvoted 2 articles 2 months ago

Article

RegMix: Data Mixture as Regression for Language Model Pre-training

By

•

Jul 11

• 8

Article

MInference 1.0: 10x Faster Million Context Inference with a Single GPU

By

•

Jul 11

• 10

upvoted a paper 3 months ago

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Paper • 2407.02490 • Published Jul 2 • 23

upvoted a paper 6 months ago

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

Paper • 2403.12968 • Published Mar 19 • 24

upvoted 2 papers 7 months ago

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 590

Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning

Paper • 2402.06619 • Published Feb 9 • 52

upvoted 3 papers 11 months ago

Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time

Paper • 2310.17157 • Published Oct 26, 2023 • 11

LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models

Paper • 2310.05736 • Published Oct 9, 2023 • 4

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Paper • 2310.06839 • Published Oct 10, 2023 • 3

upvoted a paper about 1 year ago

Unleashing Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration

Paper • 2307.05300 • Published Jul 11, 2023 • 18