August 5th, 2024

Show HN: Telemetry.sh – Simplifying Telemetry Measurement

Telemetry provides a solution for measuring data in applications without infrastructure management, allowing users to log events, perform SQL queries, analyze data, and collaborate efficiently.

Read original articleLink Icon
Show HN: Telemetry.sh – Simplifying Telemetry Measurement

Telemetry offers a streamlined solution for measuring telemetry data in applications without the need for managing infrastructure. Users can easily log and query telemetry data by integrating the service into their applications using a simple API key. The logging process allows developers to record specific events, such as rides in a ride-sharing application, along with relevant details like city, price, and timestamp. Additionally, users can perform SQL queries to analyze the logged data, such as calculating the average price of rides grouped by city. The platform also includes tools for data analysis, export options in CSV format, and collaborative workspaces for sharing insights. Built on Rust and Datafusion, Telemetry ensures high performance and efficiency in handling telemetry data.

- Telemetry simplifies data measurement without infrastructure management.

- Users can log events and query data using SQL.

- The platform supports data analysis and export options.

- Collaboration features are available for sharing insights.

- Built for performance using Rust and Datafusion technology.

Link Icon 8 comments
By @thebuilderjr - 6 months
Hi HN,

I’m excited to introduce telemetry.sh, a service designed to streamline telemetry measurement in your applications. Our API/SDKs accept any JSON object, making it easy to get started with just a few lines of code.

Under the hood, telemetry.sh converts JSON into Parquet schemas, stores data in S3, caches data locally based on tenant locality, and updates metadata stores for fast querying.

Once your data is in our system, you can leverage our AI-augmented UI to quickly write SQL queries in plain English. We also offer robust visualization tools, including line charts, bar charts, and scatter plots, to help you easily plot and understand your data.

We’ve prioritized team collaboration by integrating teams and memberships as core features, making it simple to work with your co-workers on telemetry coverage and analysis.

Additionally, our query API allows you to integrate your telemetry data into your own products or internal dashboards seamlessly.

This project has been a labor of love over the past year, and I’m thrilled to share it with the HN community. I look forward to your feedback.

Thanks,

JR

By @anon91 - 6 months
Super interesting! Congrats on the launch.

The use of parquet files and S3 as the main data storage seems interesting, but can you elaborate on how telemetry is optimized for frequent data inserts, since S3 only allows replacing a full file and data cannot be appended directly to it?

Does it mean you use some sort of partitions with many files under the hood or a local buffer (memory/file/db) to make batch updates every x seconds on S3 for better performance?

Would be happy to give it a try!

By @autocole - 6 months
I love the simplicity, but I would be hesitant to try it since I don’t know what 10MB of logs looks like. I would be interested in trying this if it could be set to auto-evicting past 10MB so I could start to understand that boundary better.
By @bcjordan - 6 months
This is a really nice dev-friendly API, could see it becoming a compelling go-to for eg indie hackers who have moved simple view analytics to reasonably priced tools like Plausible/SimpleAnalytics over the years.

In some ways it feels like Loggly, worth taking a look at their query/dashboard system as it has some really nice tools for clicking around to slice and dice graphs using unstructured data.

Will have to give it a try some time!

By @msnkarthik - 6 months
Awesome product. congrats. I'm curious, can you share more about the security measures in place to protect the telemetry data stored in S3?
By @halfdan - 6 months
I'm not quite sure how to place this. For general app telemetry there's https://opentelemetry.io and for tracking user behavior similar to how it's explained in your docs it looks like https://segment.io would be the closest competitor.

How is telemetry.sh different from the above-mentioned?

By @QuiCasseRien - 6 months
Screenshot !

i'm lazy and i don't even test or register/login without screenshot.

By @throwaway63820 - 6 months
big fan of the approach & simplicity!