Show HN: 40M embeddings to find who knows what on HN
Wilson Lin and Robert embed 40 million Hacker News posts to create a semantic map, prioritizing individuals over content. They aim to highlight trusted voices and knowledge expertise within the community.
Read original article
Wilson Lin discusses embedding 40 million posts and comments from Hacker News to create a semantic map, aiming to identify trusted voices across topics by prioritizing individuals over content. Collaborating with Robert, they explore how to discover and explore individuals knowledgeable in various subjects and their relationships within the community. They introduce an app allowing users to explore their semantic contributions on Hacker News and search for specific topics based on who knows what. By mapping the community's knowledge landscape, they aim to highlight individuals and their expertise. The project focuses on organizing people based on their knowledge rather than just information, prompting discussions on social knowledge challenges. Interested individuals can join the waitlist to participate in further exploration of this initiative.
Related
Insights from over 10,000 comments on "Ask HN: Who Is Hiring" using GPT-4o
The analysis of over 10,000 Hacker News comments using GPT-4o and LangChain revealed job market trends like remote work opportunities, visa sponsorship stability, and skill demands. Insights suggest potential SaaS product development.
Evaluating a Decade of Hacker News Predictions: An Open-Source Approach
The blog post evaluates a decade of Hacker News predictions using LLMs and ClickHouse. Results show a 50% success rate, highlighting challenges in prediction nuances. Future plans include expanding the project. Website: https://hn-predictions.eamag.me/.
Show HN: RAG on HN comments in 34 LOC
The tool hackerNewsRAG uses Algolia to search HackerNews comments, extracting and summarizing content with Substrate. Users can fork it on Substrate for free credits. Val Town offers JavaScript hosting services.
Satya Nadella Reads/Games Hacker News (2018)
Satya Nadella engages with Hacker News to boost Azure, competing with Amazon. The discussion questions ethics of influencing online communities and delves into algorithm manipulation's impact on content visibility.
7 commentsFew questions:
1. Did you create embeddings for the whole comment or you used chunking?
2. How do you determine the effective keywords in comments?
I don't want to just start cold emailing strangers.
"Grill Cleaning Techniques and Tools* is among my full zoom-out expertises.
AMA.
Related
Insights from over 10,000 comments on "Ask HN: Who Is Hiring" using GPT-4o
The analysis of over 10,000 Hacker News comments using GPT-4o and LangChain revealed job market trends like remote work opportunities, visa sponsorship stability, and skill demands. Insights suggest potential SaaS product development.
Evaluating a Decade of Hacker News Predictions: An Open-Source Approach
The blog post evaluates a decade of Hacker News predictions using LLMs and ClickHouse. Results show a 50% success rate, highlighting challenges in prediction nuances. Future plans include expanding the project. Website: https://hn-predictions.eamag.me/.
Show HN: RAG on HN comments in 34 LOC
The tool hackerNewsRAG uses Algolia to search HackerNews comments, extracting and summarizing content with Substrate. Users can fork it on Substrate for free credits. Val Town offers JavaScript hosting services.
Satya Nadella Reads/Games Hacker News (2018)
Satya Nadella engages with Hacker News to boost Azure, competing with Amazon. The discussion questions ethics of influencing online communities and delves into algorithm manipulation's impact on content visibility.