funsearch  by google-deepmind

LLM-driven program synthesis for mathematical discovery

Created 2 years ago
964 stars

Top 38.2% on SourcePulse

GitHubView on GitHub
Project Summary

FunSearch is a framework for discovering mathematical solutions through program search guided by large language models (LLMs). It enables researchers and practitioners to leverage LLMs for automated mathematical discovery across various combinatorial problems, such as constructing large cap sets and admissible sets, and solving bin packing challenges. The project facilitates reproducible research by providing implementations and datasets associated with a Nature publication.

How It Works

The core of FunSearch involves an evolutionary algorithm combined with code manipulation routines. It uses LLMs to generate candidate programs (solutions) and a sandbox environment to evaluate them. The system iteratively refines these programs based on performance metrics, demonstrating a novel approach to automated mathematical discovery by integrating symbolic reasoning with the generative capabilities of LLMs.

Quick Start & Requirements

No installation is required; all functionality is accessible via Google Colab notebooks. Specific notebooks are provided for cap_set, admissible_set, bin_packing, cyclic_graphs, and corner_free_sets. Users will need a Google account to run these notebooks.

Highlighted Details

  • Accompanies a publication in Nature (Romera-Paredes et al., 2023), validating its research significance.
  • Demonstrates AI-driven discovery for complex combinatorial problems including cap sets, admissible sets, bin packing heuristics, and independent sets in cyclic graphs.
  • Provides numerical datasets for discovered mathematical structures for convenience and further analysis.

Maintenance & Community

The repository is maintained by Google DeepMind. No specific community channels (like Discord or Slack) or detailed roadmap information are provided in the README.

Licensing & Compatibility

Software components are licensed under the Apache License, Version 2.0 (Apache 2.0), which is permissive for commercial use. Other materials are under the Creative Commons Attribution 4.0 International License (CC-BY).

Limitations & Caveats

The provided implementation directory is a component of the full FunSearch pipeline and notably excludes the language models, code execution sandbox, and distributed infrastructure. Users must provide or integrate these components themselves. The code appears to be research-oriented and may require adaptation for production environments.

Health Check
Last Commit

1 year ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
18 stars in the last 30 days

Explore Similar Projects

Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), Wei-Lin Chiang Wei-Lin Chiang(Cofounder of LMArena), and
13 more.

awesome-tensor-compilers by merrymercy

0.4%
3k
Curated list of tensor compiler projects and papers
Created 5 years ago
Updated 1 year ago
Starred by Shengjia Zhao Shengjia Zhao(Chief Scientist at Meta Superintelligence Lab), Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and
14 more.

BIG-bench by google

0.2%
3k
Collaborative benchmark for probing and extrapolating LLM capabilities
Created 4 years ago
Updated 1 year ago
Starred by Lysandre Debut Lysandre Debut(Chief Open-Source Officer at Hugging Face), Shizhe Diao Shizhe Diao(Author of LMFlow; Research Scientist at NVIDIA), and
14 more.

simpletransformers by ThilinaRajapakse

0.0%
4k
Rapid NLP task implementation
Created 6 years ago
Updated 3 months ago
Starred by Aravind Srinivas Aravind Srinivas(Cofounder of Perplexity), Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and
16 more.

text-to-text-transfer-transformer by google-research

0.1%
6k
Unified text-to-text transformer for NLP research
Created 6 years ago
Updated 3 weeks ago
Starred by Vaibhav Nivargi Vaibhav Nivargi(Cofounder of Moveworks), Chuan Li Chuan Li(Chief Scientific Officer at Lambda), and
5 more.

awesome-mlops by visenger

0.1%
13k
Curated MLOps knowledge hub
Created 5 years ago
Updated 1 year ago
Feedback? Help us improve.