PyTables/PyTables

Health v2 · maintenance only

Adoption not part of the score

1372 stars · 282 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

PyTables is a Python package for managing hierarchical datasets built on top of the HDF5 library and NumPy. It provides a fast, object-oriented interface for storing, browsing, and querying extremely large amounts of data with efficient compression and memory/disk optimization.

Use cases

• store very large numerical datasets in Python
• save and retrieve large arrays and tables efficiently
• compress large scientific datasets on disk
• organize simulation or data acquisition output hierarchically
• query large tables without loading everything into memory
• replace cluttered relational storage for multidimensional data

When to choose

• you need to persist huge NumPy arrays or structured tables in HDF5 format
• you want fast I/O with state-of-the-art compression like Blosc
• you work with scientific or simulation data that fits a hierarchical layout
• you need interactive browsing and searching of large datasets from Python

When to avoid

• you need a full relational database with joins, transactions, and SQL
• your data is small and fits comfortably in memory or plain files
• you need concurrent multi-user write access
• you require a document or key-value store rather than typed tabular/array data

Facets

library · maturity stable

database serialization compression data-science data-science big-data databases files python cross-platform hdf5 numpy large-datasets scientific-computing blosc columnar-storage

Member repositories

For agents

markdown · JSON · MCP: product_card(name="PyTables/PyTables")