DeepInnovator  by HKUDS

AI research assistant for scientific discovery and idea generation

Created 4 months ago
267 stars

Top 95.7% on SourcePulse

GitHubView on GitHub
Project Summary

DeepInnovator is an AI research copilot designed to accelerate scientific discovery by generating novel research ideas, identifying cross-disciplinary connections, and analyzing research gaps. It targets researchers and scientists, aiming to transform the ideation process by providing AI-powered assistance for problem-solving and hypothesis formation. The project offers a significant benefit by uncovering unexplored opportunities and synthesizing breakthrough concepts from vast scientific literature.

How It Works

DeepInnovator employs a multi-faceted approach centered around an "Intelligent Knowledge Synthesis Pipeline" that transforms dense literature into structured cognitive primitives like insights, research trends, and serendipity, mimicking human scientific reasoning through hierarchical abstraction. Its "Next Idea Prediction Training Paradigm" models research idea generation as an iterative, sequential process, akin to the "conjectures and refutations" methodology. A novel "Decoupled Reward-Comment RL Architecture" separates guidance from scoring in reinforcement learning for creative tasks, preventing reward hacking and ensuring optimization for genuine idea quality rather than exploitation of reward models. This architecture maintains computational efficiency while preserving semantic completeness.

Quick Start & Requirements

  • Primary install: pip install openai omegaconf python-dotenv feedparser requests PyPDF2 tqdm python-dateutil datasets numpy torch transformers
  • Prerequisites: Python 3.8+, CUDA-capable GPU (for training), configured environment variables for API access (e.g., OPENAI_API_BASE, OPENAI_API_KEY).
  • Setup: Involves configuring environment variables, running data preparation scripts (recipe/DeepInnovator/data_preparation/run.sh), preprocessing data (recipe/DeepInnovator/preprocess.sh), and then training using recipe/DeepInnovator/train_rl.sh.
  • Links:

Highlighted Details

  • DeepInnovator-14B significantly outperforms Qwen-14B-Instruct across evaluation dimensions, achieving win rates of 80.53%-93.81%.
  • It matches the performance of GPT-4o and Gemini-2.5-pro despite a smaller parameter size, even surpassing GPT-4o in well-justified rationale evaluation (82.3% vs 77.9%).
  • Demonstrates strong zero-shot cross-domain generalization, generating high-quality ideas in law, education, and biotechnology despite STEM training.
  • Achieves a 100% win rate in Biotech Feasibility against Qwen2.5-14B-IT and a 60.0% win rate in Education Novelty against GPT-4o.

Maintenance & Community

No specific details regarding maintainers, community channels (like Discord or Slack), or project roadmap are provided in the README.

Licensing & Compatibility

This project is licensed under the MIT License, which is permissive and generally suitable for commercial use and integration into closed-source projects.

Limitations & Caveats

Training DeepInnovator requires a CUDA-capable GPU. The setup involves configuring external API keys and running multi-step data preparation and preprocessing pipelines, indicating a potentially complex and resource-intensive setup for training. The project is based on recent research (arXiv 2026), and while performance claims are strong, it may still be considered early-stage.

Health Check
Last Commit

4 months ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
25 stars in the last 30 days

Explore Similar Projects

Feedback? Help us improve.