Dogsheep: Tools for personal analytics using SQLite and Datasette
Dogsheep offers tools for personal data analytics using SQLite, enabling users to export data from platforms like Twitter and Google, promoting understanding and ownership of personal information.
Read original articleDogsheep is a project that provides tools for personal analytics using SQLite and Datasette, allowing users to export their data from various platforms into a SQLite database for analysis. The initiative aims to empower individuals by enabling them to understand what big internet companies know about them. Key tools include twitter-to-sqlite, which creates a database of Twitter data; healthkit-to-sqlite, which converts Apple HealthKit data; and google-takeout-to-sqlite, which imports data from Google services. Other tools facilitate the import of data from platforms like Foursquare, iNaturalist, GitHub, and Evernote. Additionally, there are tools developed by others that align with the Dogsheep philosophy, such as beeminder-to-sqlite for tracking goals and goodreads-to-sqlite for reading history. The project emphasizes the importance of reclaiming personal data for self-analysis and insights.
- Dogsheep provides tools for exporting personal data into SQLite databases.
- Key tools include imports from Twitter, Apple HealthKit, Google Takeout, and more.
- The project aims to help users understand the data collected by large internet companies.
- Additional tools by other developers enhance the Dogsheep functionality.
- The initiative promotes personal data ownership and analytics.
Related
Optimizing Large-Scale OpenStreetMap Data with SQLite
The article discusses optimizing large-scale OpenStreetMap data with SQLite. Converting OSMPBF to SQLite enhanced search functionalities. Indexing, full-text search, and compression improved query performance, despite some false positives.
DB Browser for SQLite (Windows, macOS, and Most Versions of Linux)
DB Browser for SQLite (DB4S) is an open-source tool for SQLite databases, supporting Windows, macOS, Linux, and Unix. It enables table management, data manipulation, SQL queries, and visualization features. Version 3.12.2 is current, with a 3.13.x-rc1 release. Nightly builds are also available for testing.
Storing Scraped Data in an SQLite Database on GitHub
The article explains Git scraping, saving data to a Git repository with GitHub Actions. Benefits include historical tracking and using SQLite for storage. Limitations and Datasette for data visualization are discussed.
Open Source Tools to Query OpenStreetMap
OpenStreetMap offers extensive geographical data, but its size complicates usage. Tools like Overpass Turbo, osm2pgsql, DuckDB, and QLever facilitate querying, each with unique advantages for data analysis.
Surfer: Centralize all your personal data from online platforms
Surfer centralizes personal data from various online platforms by scraping and exporting it to local storage. It is available for download, with community support through Discord and a roadmap for future enhancements.
Related
Optimizing Large-Scale OpenStreetMap Data with SQLite
The article discusses optimizing large-scale OpenStreetMap data with SQLite. Converting OSMPBF to SQLite enhanced search functionalities. Indexing, full-text search, and compression improved query performance, despite some false positives.
DB Browser for SQLite (Windows, macOS, and Most Versions of Linux)
DB Browser for SQLite (DB4S) is an open-source tool for SQLite databases, supporting Windows, macOS, Linux, and Unix. It enables table management, data manipulation, SQL queries, and visualization features. Version 3.12.2 is current, with a 3.13.x-rc1 release. Nightly builds are also available for testing.
Storing Scraped Data in an SQLite Database on GitHub
The article explains Git scraping, saving data to a Git repository with GitHub Actions. Benefits include historical tracking and using SQLite for storage. Limitations and Datasette for data visualization are discussed.
Open Source Tools to Query OpenStreetMap
OpenStreetMap offers extensive geographical data, but its size complicates usage. Tools like Overpass Turbo, osm2pgsql, DuckDB, and QLever facilitate querying, each with unique advantages for data analysis.
Surfer: Centralize all your personal data from online platforms
Surfer centralizes personal data from various online platforms by scraping and exporting it to local storage. It is available for download, with community support through Discord and a roadmap for future enhancements.