littlstar/s3-lambda

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1059 stars · 47 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A Node.js library that lets you run lambda-style functions (forEach, map, reduce, filter) over S3 objects with concurrency control. It enables quick prototyping of data jobs over large numbers of S3 files without infrastructure like Hadoop or Spark.

Use cases

• process all files in an s3 prefix with a function
• run map reduce over s3 objects in node
• batch transform files stored in s3
• filter s3 objects matching a regex
• parallel data pipelining over aws s3 without hadoop
• aggregate analytics over many s3 files quickly

When to choose

• you need to process many S3 objects in parallel from Node.js
• you want lightweight data pipelining without standing up Spark or Hadoop
• you need functional-style iteration (map/reduce/filter) over S3 keys

When to avoid

• you need AWS Lambda service integration - this library does not use it
• you need an actively maintained project (last release 2017)
• you need distributed processing beyond a single machine

Facets

library · maturity abandoned

etl streaming concurrency developer-tools cloud-computing developer-tools cli s3 aws lambda-functions map-reduce data-pipelining batch-processing data-engineering automation nodejs

Member repositories

For agents

markdown · JSON · MCP: product_card(name="littlstar/s3-lambda")