Time-LLM  by KimMeen

Research paper for time series forecasting using LLMs

Created 1 year ago
2,249 stars

Top 20.2% on SourcePulse

GitHubView on GitHub
Project Summary

Time-LLM offers a framework for repurposing Large Language Models (LLMs) for time series forecasting tasks. It targets researchers and practitioners seeking to leverage LLM capabilities for predictive analysis by treating time series data as a form of language. The primary benefit is enabling off-the-shelf LLMs to perform time series forecasting without altering their core architecture.

How It Works

Time-LLM reprograms LLMs by converting time series data into text-based representations that LLMs can process. It augments this with declarative prompts, incorporating domain knowledge and task instructions to guide the LLM's reasoning process. This approach allows existing LLMs to be adapted for forecasting tasks, treating them as a novel "language task."

Quick Start & Requirements

  • Install dependencies via pip install -r requirements.txt.
  • Requires Python 3.11, PyTorch 2.2.2, and specific versions of libraries like transformers (4.31.0) and deepspeed (0.14.0).
  • Datasets need to be downloaded from a provided Google Drive link and placed in the ./dataset directory.
  • Example execution scripts are available in the ./scripts folder (e.g., ./scripts/TimeLLM_ETTh1.sh).
  • Official paper, YouTube talks, and Medium blog are linked for further details.

Highlighted Details

  • Official implementation for the ICLR 2024 paper "Time-LLM: Time Series Forecasting by Reprogramming Large Language Models."
  • Supports general time series forecasting by keeping LLM backbones intact.
  • Defaults to Llama-7B and is compatible with GPT-2 and BERT by adjusting model and dimension parameters.
  • Adopted by XiMou Optimization Technology Co., Ltd. for solar, wind, and weather forecasting.

Maintenance & Community

  • Project has been included in NeuralForecast.
  • Open to contributions and suggestions.
  • Links to multiple Chinese interpretation articles are provided.

Licensing & Compatibility

  • The repository does not explicitly state a license.
  • Compatibility for commercial use or closed-source linking is not specified.

Limitations & Caveats

The project relies on specific versions of dependencies, which may require careful environment management. The absence of an explicit license raises questions about commercial use and redistribution.

Health Check
Last Commit

10 months ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
59 stars in the last 30 days

Explore Similar Projects

Starred by Junyang Lin Junyang Lin(Core Maintainer at Alibaba Qwen), Shizhe Diao Shizhe Diao(Author of LMFlow; Research Scientist at NVIDIA), and
1 more.

LMaaS-Papers by txsun1997

0%
549
Curated list of LMaaS research papers
Created 3 years ago
Updated 1 year ago
Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), Junyang Lin Junyang Lin(Core Maintainer at Alibaba Qwen), and
1 more.

chameleon-llm by lupantech

0%
1k
Research paper code for plug-and-play compositional reasoning with LLMs
Created 2 years ago
Updated 1 year ago
Feedback? Help us improve.