GLM-130B  by zai-org

Bilingual model for research and evaluation

Created 3 years ago
7,684 stars

Top 6.8% on SourcePulse

GitHubView on GitHub
Project Summary

GLM-130B is an open-source, 130-billion parameter, bilingual (English/Chinese) language model designed for researchers and developers working with large-scale NLP models. It offers strong performance on various benchmarks and supports efficient inference through quantization and optimized libraries.

How It Works

GLM-130B utilizes the General Language Model (GLM) pre-training approach, which combines autoregressive blank infilling with bidirectional context. This allows it to excel at both left-to-right generation and filling in masked segments of text. The model is designed for efficient deployment, supporting INT4 quantization to enable inference on consumer-grade hardware.

Quick Start & Requirements

Health Check
Last Commit

2 years ago

Responsiveness

1 day

Pull Requests (30d)
0
Issues (30d)
0
Star History
11 stars in the last 30 days

Explore Similar Projects

Starred by Yineng Zhang Yineng Zhang(Inference Lead at SGLang; Research Scientist at Together AI).

dots.llm1 by rednote-hilab

0.2%
462
MoE model for research
Created 4 months ago
Updated 4 weeks ago
Starred by Shizhe Diao Shizhe Diao(Author of LMFlow; Research Scientist at NVIDIA), Yineng Zhang Yineng Zhang(Inference Lead at SGLang; Research Scientist at Together AI), and
8 more.

EAGLE by SafeAILab

10.6%
2k
Speculative decoding research paper for faster LLM inference
Created 1 year ago
Updated 1 week ago
Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), Simon Willison Simon Willison(Coauthor of Django), and
10 more.

Yi by 01-ai

0%
8k
Open-source bilingual LLMs trained from scratch
Created 1 year ago
Updated 9 months ago
Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), Jeff Hammerbacher Jeff Hammerbacher(Cofounder of Cloudera), and
4 more.

ChatGLM-6B by zai-org

0.0%
41k
Bilingual dialogue language model for research
Created 2 years ago
Updated 1 year ago
Feedback? Help us improve.