dadoonet/fscrawler

Health v2 · maintenance only

Adoption not part of the score

1450 stars · 308 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

FSCrawler is a Java-based file system crawler that indexes binary documents (PDF, MS Office, Open Office) into Elasticsearch, tracking new, updated, and deleted files. It supports local and remote (SSH/FTP) file systems and offers a REST interface for uploading documents directly.

Use cases

• index pdf and office documents into elasticsearch
• crawl a local folder and keep an elasticsearch index in sync
• extract text from binary documents for full-text search
• upload documents to elasticsearch via a rest endpoint
• crawl files over ssh or ftp and index them
• build a document search engine from a file share

When to choose

• you need to full-text search binary documents stored on a file system with elasticsearch
• you want automatic syncing of file additions, updates, and deletions into an index
• you need tika-based text extraction without writing your own pipeline

When to avoid

• you use a search engine other than elasticsearch
• you only need to crawl web pages rather than local or remote file systems
• you want a fully managed cloud ingestion service

Facets

application · maturity active

search-engine etl ocr parser files pdf developer-tools jvm cross-platform cli elasticsearch tika file-crawler binary-documents indexing rest-upload search docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="dadoonet/fscrawler")