Vote on which of Hacker News' challenges for AI have been met
A crowdsourced voting site tracks whether historical Hacker News comments' predictions and challenges regarding AI capabilities have been met.
summary is enough While the interactive voting site is a fun meta-exercise, the comment thread offers a more engaging debate on how goalposts have shifted over the years.
The article could not be read automatically; this analysis is based on the title and discussion.
summary
A community member built a website compiling past Hacker News comments where users set specific thresholds and predictions for AI capabilities. Visitors can now vote on whether these diverse challenges, ranging from ASCII art and tax returns to research-level math, have actually been accomplished by modern models. Commenters debate whether historical predictions were poorly phrased, whether goalposts are constantly shifting, and how frontier models compare to free tiers. The overall reception highlights amusement and skepticism regarding how fast expectations have evolved.
key points
- The site aggregates historical user predictions and AI challenges from Hacker News threads, allowing the community to vote on their current status.
- Commenters note that many historical predictions lacked precise definitions, making it difficult to objectively judge whether they were met.
- Discussion reveals sharp divisions over reliability: while models can occasionally perform complex tasks like math proofs, they frequently fail unpredictably on edge cases.
who should read it
AI enthusiasts and researchers interested in tracking how community expectations and model capabilities have evolved over time.
discussion positive
consensus
Commenters generally find the project a fun and revealing meta-analysis of AI expectations, though many point out that original predictions were often vaguely worded.
pushback
Some participants argue that modern models still lack practical reliability and consistency, making binary votes on complex challenges misleading.
At least 1/3rd of these predictions aren't clear enough to determine exactly what is being claimed/predicted. Even after reading the full comment multiple times, on a lot of them I couldn't tell where the author had set the goalposts well enough to say whether we've crossed it or not.
It highlights the core difficulty of evaluating these challenges, noting that many historical predictions were too vague to objectively verify.
Generated by an LLM from the article and thread. Check the sources before relying on it.