1 billion parameter models, quantized with AWQ.
SolidRusT Networks
company
Verified
AI & ML interests
Self-hosting, Open Source and AI Unalignment
Organization Card
Organization for sorting and categorizing collections of quantized models, featured on solidrust.net.
Currently focused on models that can be quantized by AWQ from: https://github.com/casper-hansen/AutoAWQ using https://github.com/SolidRusT/srt-model-quantizing/tree/main/awq
models
495
solidrust/Magic_8B-AWQ
Text Generation
•
Updated
solidrust/ChimeraLlama-3-8B-v3-AWQ
Text Generation
•
Updated
•
8
solidrust/Llama-3.1-8B-TitanFusion-AWQ
Text Generation
•
Updated
solidrust/LLama-3.1-8B-Matrix-AWQ
Text Generation
•
Updated
solidrust/Gemma2-9B-TitanFusion-AWQ
Text Generation
•
Updated
solidrust/Vapor_7B-AWQ
Text Generation
•
Updated
solidrust/Qwen2-7B-TitanFusion-AWQ
Text Generation
•
Updated
solidrust/Gemma2-9B-TitanFusion-v2-AWQ
Text Generation
•
Updated
•
1
solidrust/Apollo-2.0-Llama-3.1-8B-AWQ
Text Generation
•
Updated
solidrust/LLama-3.1-8B-TitanFusion-v2-AWQ
Text Generation
•
Updated
datasets
None public yet