gollm  by teilomillet

Go SDK for LLM integration

created 1 year ago
536 stars

Top 60.0% on sourcepulse

GitHubView on GitHub
Project Summary

This Go package provides a unified interface for interacting with multiple Large Language Model (LLM) providers, simplifying AI integration for developers. It offers advanced prompt engineering, model comparison, and structured output validation, enabling the creation of sophisticated AI applications with flexible configuration and robust error handling.

How It Works

gollm abstracts away the complexities of different LLM APIs by providing a consistent Go interface. It supports providers like OpenAI, Anthropic, Groq, Ollama, and OpenRouter, allowing seamless switching between models. Key features include a prompt optimizer for refining instructions, memory retention for conversational context, and tools for comparing model performance, all designed to enhance AI development efficiency and output quality.

Quick Start & Requirements

  • Install via: go get github.com/teilomillet/gollm
  • Requires Go. API keys for specific LLM providers are necessary.
  • See Quick Start and Basic Usage for examples.

Highlighted Details

  • Unified API for OpenAI, Anthropic, Groq, Ollama, Mistral, and OpenRouter.
  • Advanced prompt engineering with context, directives, and output specifications.
  • Prompt Optimizer for automatic prompt refinement.
  • Structured output with JSON schema validation.
  • Model comparison tools to evaluate different LLMs.
  • Memory retention for conversational context.

Maintenance & Community

  • Project appears actively maintained by teilomillet.
  • Community links are not explicitly mentioned in the README.

Licensing & Compatibility

  • The README does not explicitly state a license.

Limitations & Caveats

  • The license is not specified, which may impact commercial use or integration into closed-source projects.
Health Check
Last commit

3 weeks ago

Responsiveness

1+ week

Pull Requests (30d)
2
Issues (30d)
1
Star History
79 stars in the last 90 days

Explore Similar Projects

Feedback? Help us improve.