August 28th, 2024

Show HN: Warehouse OpenAI requests to your own database

Velvet AI is a tool for engineers that warehouses AI requests in PostgreSQL, enabling analysis and optimization. It supports caching, batching, and is free to start with minimal setup.

Read original articleLink Icon
Show HN: Warehouse OpenAI requests to your own database

Velvet AI is a tool designed for engineers utilizing OpenAI and Anthropic APIs, enabling them to warehouse every AI request to a PostgreSQL database. The platform allows users to analyze, evaluate, and fine-tune their AI features by logging requests and storing data as customizable JSON objects. Velvet supports caching and batching to optimize performance and reduce costs, providing transparency into API usage. Users can easily get started by creating an account, reading the documentation, and setting their base URL to the Velvet gateway. Common use cases include analyzing model usage, optimizing AI features, and generating datasets for training. The service is free to start, with additional features available based on user requirements. Velvet is trusted by various startups for its ability to monitor AI features in production and streamline the engineering process.

- Velvet AI warehouses requests to PostgreSQL for analysis and optimization.

- The platform supports caching and batching to reduce costs and latency.

- Users can generate datasets for fine-tuning and evaluate model performance.

- Getting started with Velvet is free and requires minimal setup.

- The service is designed for engineers working with OpenAI and Anthropic APIs.

Link Icon 3 comments
By @toomuchtodo - 6 months
This is great for folks who need to proxy and/or log for compliance and regulatory purposes.
By @samstave - 6 months
Can we please have this as a VS-Code|Cursor Extension such that All copilot operations flow through a dash like this for a personal version of all your code prompting through vscode/cursor/positron.

Then, in positron, you can just have a viewer that can run and graph the queries in the IDE