InfiniteGPT is a Python script designed to process text inputs of unlimited size with OpenAI's chat models, eliminating the need for manual chunking or re-prompting. It is intended for users who frequently interact with large documents or datasets via the OpenAI API, offering a streamlined workflow.

How It Works

The script leverages OpenAI's API to handle large text inputs by breaking them down into manageable segments. This approach avoids the token limits of individual API calls and the manual effort of splitting and reassembling text, allowing for continuous processing of extensive content.

Quick Start & Requirements

• Install dependencies: pip install openai
• Requires Python 3 and an OpenAI API key.
• Clone the repository: git clone https://github.com/emmethalm/infiniteGPT.git

Highlighted Details

• Supports all OpenAI chat models (e.g., gpt-3.5-turbo, gpt4).
• Eliminates manual text chunking and re-prompting for large inputs.
• Single Python script for ease of use.

Maintenance & Community

The project is maintained by @ehalm_, who shares AI tool insights on Twitter.

Licensing & Compatibility

Licensed under the MIT License, permitting commercial use and integration into closed-source applications.

Limitations & Caveats

The script does not automatically hide API keys, requiring users to manage their keys securely if integrating into public applications.