Dobiasd/frugally-deep

Health v2 · maintenance only

Adoption not part of the score

1128 stars · 238 forks observed · 2026-10-12

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

frugally-deep is a lightweight header-only C++ library for running inference (forward passes) on Keras/TensorFlow models without linking against TensorFlow. It re-implements the subset of TensorFlow operations needed for prediction, supporting sequential and functional-API models on CPU.

Use cases

• run keras models in c++ without tensorflow
• deploy trained neural network in c++ application
• small binary size deep learning inference
• cpu-only model prediction in embedded or edge application
• load keras model file in c++
• parallel batch inference on multiple cpu cores
• avoid tensorflow dependency in production c++ build

When to choose

• you trained a model in Keras and need C++ inference without TensorFlow's large dependency
• binary size and easy integration matter more than GPU acceleration
• you need fast single-core prediction with easy multi-core scaling
• targeting 32-bit or resource-constrained environments

When to avoid

• you need GPU acceleration for inference
• you need training, not just prediction
• your model uses layer types or operations outside the supported subset

Facets

library · maturity active

machine-learning deep-learning llm-inference deep-learning machine-learning cross-platform cpp cross-platform keras tensorflow header-only inference neural-networks edge-computing tinyml cpu-only

Member repositories

For agents

markdown · JSON · MCP: product_card(name="Dobiasd/frugally-deep")