September 3rd, 2024

Full-stack RAG app built on Cloudflare

The Cloudflare RAG project is a fullstack application utilizing Cloudflare technologies, featuring a streaming UI, hybrid search, and support for multiple AI providers, with detailed development instructions provided.

Read original articleLink Icon
Full-stack RAG app built on Cloudflare

The Cloudflare RAG project is a fullstack application that showcases the development of a Retrieval Augmented Generation (RAG) app using various Cloudflare technologies. It integrates Cloudflare Workers, Pages, D1, KV, R2, AI Gateway, and Workers AI to create a robust application. Key features include a streaming user interface, hybrid search capabilities combining full-text and vector searches, support for multiple AI providers with fallback options, rate limiting, and OCR functionality. The project provides detailed development and deployment instructions, requiring tools like Node, pnpm, and wrangler CLI. Users can set up the application by installing dependencies, configuring necessary files, and running a local development server. The hybrid search mechanism involves rewriting user input into multiple queries, executing them against both D1 and Vectorize, and merging results for optimal response generation. The project is licensed under the MIT License, and the author is open to consulting on AI applications.

- The project demonstrates a fullstack RAG application using Cloudflare technologies.

- It features a streaming UI, hybrid search, and support for multiple AI providers.

- Detailed instructions for development and deployment are provided.

- The hybrid search mechanism enhances query execution and result merging.

- The project is licensed under the MIT License.

Link Icon 1 comments
By @its_down_again - 8 months
Nice work! I saw that the prompt will generate 5 different queries to test, but I'm not sure if metadata is included/needed in this project. Let's say I have an encyclopedia of birds with sections that look similar, like "Species Name: {NAME}" or "First Discovered: {Date}", and I upload all the pages. If I search for something like "peregrine falcon habitat" or "hummingbird diet," will it give me the right results?