maxpumperla/elephas

Health v2 · maintenance only

Adoption not part of the score

1577 stars · 303 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Elephas is a Python library that extends Keras to run distributed deep learning training on Apache Spark. It serializes Keras models on the Spark driver, ships them to workers for data-parallel training, and aggregates gradients back on the driver.

Use cases

• train keras models on spark clusters
• distributed deep learning on large datasets
• data-parallel training of neural networks with spark rdds
• integrate keras models into spark ml pipelines
• distributed training of ensemble models
• use keras with spark mllib

When to choose

• you already use keras and need to scale training across a spark cluster
• your training data lives in spark rdds or dataframes
• you want keras-style simplicity for distributed model prototyping

When to avoid

• you need actively maintained software - development moved to a fork (danielenricocahall/elephas)
• you need distributed hyper-parameter optimization, which was removed in 3.0.0
• you use pytorch or tensorflow's native distributed strategies instead of keras on spark

Facets

library · maturity maintenance

deep-learning machine-learning etl deep-learning machine-learning big-data microservices python jvm keras spark distributed-training data-parallel rdd mllib

Member repositories

For agents

markdown · JSON · MCP: product_card(name="maxpumperla/elephas")