karpathy/arxiv-sanity-preserver

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

5772 stars · 1352 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A self-hostable web application for browsing, searching, and filtering recent arXiv submissions, with personalized paper recommendations based on TF-IDF similarity and SVM models. It combines a scraping/indexing pipeline with a Flask/Tornado/SQLite web interface.

Use cases

• track new arxiv papers in my research area
• get personalized recommendations of arxiv papers
• search and filter recent machine learning papers
• find papers similar to a given paper
• build my own arxiv paper feed for a custom category
• keep a personal library of research papers

When to choose

• you want to self-host a paper discovery site for a specific set of arxiv categories
• you want content-based recommendations over a paper corpus you control
• you prefer the original feature-rich version with accounts and libraries

When to avoid

• you want a maintained, actively developed tool - the author recommends arxiv-sanity-lite instead
• you need a lightweight setup - the pipeline has many dependencies (ImageMagick, pdftotext, scikit-learn, etc.)
• you only need to read papers without self-hosting

Facets

application · maturity maintenance

search-engine web-framework nlp web-scraping web-development machine-learning python self-hosted arxiv paper-discovery tfidf recommendation-system flask academic-papers recommendation search natural-language-processing research web-server

Member repositories

For agents

markdown · JSON · MCP: product_card(name="karpathy/arxiv-sanity-preserver")