domain: big-data
477 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| gchq/Gaffer Gaffer is a large-scale graph database framework for storing very large graphs with rich properties, supporting backends like Accumulo, HBa… | 10 | 1787 | abandoned |
| discoproject/disco Disco is an open-source distributed MapReduce framework written in Erlang with a Python job API, originally developed at Nokia Research Cen… | 32 | 1630 | abandoned |
| mongodb/mongo-hadoop A Java library that lets MongoDB (or BSON backup files) serve as an input source or output destination for Hadoop MapReduce jobs, with inte… | 10 | 1552 | abandoned |
| alibaba/mdrill Mdrill is an open-source distributed OLAP (online analytical processing) engine from Alibaba's AdMom team, built in Java on top of JStorm/H… | 10 | 1543 | abandoned |
| tensorbase/tensorbase TensorBase is a Rust-based open-source OLAP data warehouse designed as a ClickHouse-compatible, high-performance alternative for big data a… | 23 | 1460 | abandoned |
| mesos/spark This is the original UC Berkeley AMPLab repository for Apache Spark, a fast cluster computing system supporting Java, Scala, and Python. Th… | 32 | 1418 | abandoned |
| yahoo/CaffeOnSpark CaffeOnSpark is a Spark package that brings the Caffe deep learning framework to Hadoop and Spark clusters, enabling distributed neural net… | 10 | 1261 | abandoned |
| uber-archive/AthenaX AthenaX is a SQL-based streaming analytics platform open sourced by Uber, built on Apache Flink and Apache Calcite. It lets users run produ… | 10 | 1223 | abandoned |
| foolcage/fooltrader fooltrader is a Python quantitative analysis and trading framework that crawls, cleans, and structures market data (stocks, futures, forex,… | 23 | 1198 | abandoned |
| killrweather/killrweather KillrWeather is a Scala reference application demonstrating integration of Apache Spark Streaming, Apache Kafka, Apache Cassandra, and Akka… | 32 | 1178 | abandoned |
| eventql/eventql EventQL is a distributed, columnar SQL database written in C++ for large-scale data collection and analytics, supporting streaming writes, … | 23 | 1176 | abandoned |
| twitter-archive/ambrose Twitter Ambrose is a platform for visualization and real-time monitoring of MapReduce data workflows on Hadoop clusters. It provides a web … | 10 | 1170 | abandoned |
| antonmks/Alenka Alenka is a GPU-based column-store database engine written in CUDA that leverages vectorized processing and GPU memory bandwidth for fast a… | 32 | 1167 | abandoned |
| spring-attic/spring-cloud-dataflow Spring Cloud Data Flow is a microservices-based toolkit for orchestrating streaming and batch data processing pipelines built from Spring B… | 10 | 1140 | abandoned |
| kubernetes-retired/kube-batch kube-batch is a batch scheduler for Kubernetes designed for high-performance workloads such as AI/ML, Big Data, and HPC jobs. It was the pr… | 10 | 1090 | abandoned |
| databricks/spark-sklearn A deprecated Python library from Databricks that integrates scikit-learn with Apache Spark, primarily to distribute grid-search cross-valid… | 10 | 1071 | abandoned |
| jorgecarleitao/arrow2 A Rust implementation of the Apache Arrow columnar in-memory format, supporting IO with Parquet, Avro, CSV, IPC, and Flight, plus compute k… | 10 | 1064 | abandoned |
| sitewhere/sitewhere SiteWhere is an open-source, multi-tenant IoT application enablement platform built on Java/Spring microservices, offering device and asset… | 66 | 1045 | abandoned |
| TIBCOSoftware/snappydata SnappyData (TIBCO ComputeDB) is a distributed, memory-optimized analytics database that fuses an in-memory hybrid OLTP/OLAP store inside Ap… | 23 | 1033 | abandoned |
| klbostee/dumbo Dumbo is a Python module that makes writing and running Hadoop Streaming programs easy, providing a convenient Python API for MapReduce pro… | 32 | 1030 | abandoned |
| facebookarchive/bistro Bistro is a C++ distributed task scheduler framework from Facebook that schedules and runs distributed tasks, including data-parallel jobs,… | 10 | 1026 | abandoned |
| DuckDB DuckDB is an in-process analytical SQL database management system (OLAP) written in C++, designed to be fast, portable, and easy to embed. … | 97 | 40675 | stable |
| seaweedfs/seaweedfs SeaweedFS is a fast distributed storage system written in Go that provides S3-compatible object storage, a POSIX-compliant distributed file… | 95 | 34299 | active |
| timescale/timescaledb TimescaleDB is an open-source PostgreSQL extension that turns Postgres into a high-performance time-series database for real-time analytics… | 99 | 23423 | active |
| thingsboard/thingsboard ThingsBoard is an open-source IoT platform for device management, telemetry data collection, processing, and visualization. It supports sta… | 99 | 22316 | stable |
| questdb/questdb QuestDB is an open-source, high-performance time-series database with a column-oriented, SIMD-vectorized SQL engine written in zero-GC Java… | 99 | 17279 | stable |
| Data-Centric-AI-Community/fg-data-profiling A Python library that generates one-line data quality profiling and exploratory data analysis reports for Pandas and Spark DataFrames. It p… | 83 | 13682 | active |
| elastic/beats Elastic Beats is a family of lightweight data shippers written in Go that collect logs, metrics, network packets, audit data, and uptime si… | 95 | 12640 | active |
| ibis-project/ibis Ibis is a portable Python dataframe library that provides a single lazy dataframe API across more than 20 execution backends including Duck… | 89 | 6643 | active |
| apache/iotdb Apache IoTDB is an open-source time-series database management system designed for industrial IoT, providing integrated collection, storage… | 92 | 6382 | stable |
| volcano-sh/volcano Volcano is a CNCF-hosted, Kubernetes-native batch scheduling system that extends kube-scheduler for high-performance workloads like AI/ML t… | 98 | 5899 | stable |
| aidlearning/AidLearning-FrameWork AidLux (originally AidLearning) is an AIoT development platform that runs a native Ubuntu Linux environment with GUI, deep learning tooling… | 70 | 5797 | active |
| googleapis/google-cloud-python The official monorepo of idiomatic Python client libraries for Google Cloud Platform services, covering APIs like BigQuery, Storage, AI Pla… | 95 | 5376 | stable |
| memgraph/memgraph Memgraph is a high-performance, in-memory graph database written in C++ that is Cypher-compatible and ACID-compliant, with built-in vector,… | 97 | 4364 | stable |
| Spark NLP Spark NLP is an open-source natural language processing library built natively on Apache Spark, providing scalable NLP annotations and tran… | 96 | 4159 | stable |
| aws/aws-sdk-pandas AWS SDK for pandas (awswrangler) is a Python library that extends pandas with high-level APIs for reading and writing data across AWS servi… | 94 | 4118 | active |
| borisdj/EFCore.BulkExtensions A .NET library extending Entity Framework Core with high-performance bulk CRUD operations (Insert, Update, Delete, Read, Upsert, Sync, Save… | 66 | 4000 | active |
| unitycatalog/unitycatalog Unity Catalog is an open-source, multimodal data and AI catalog that provides a unified metadata and governance layer for tables, files, fu… | 86 | 3501 | active |
| googleapis/google-cloud-node The official Google Cloud Client Library for Node.js, a monorepo containing idiomatic npm client libraries for interacting with individual … | 95 | 3195 | stable |
| polardb/PolarDB-for-PostgreSQL PolarDB for PostgreSQL is a cloud-native, PostgreSQL-compatible database system developed by Alibaba Cloud. It uses a shared-storage archit… | 95 | 3194 | active |
| lindb/lindb LinDB is an open-source distributed time series database written in Go, offering high performance, high availability, and horizontal scalab… | 65 | 3066 | active |
| hosseinmoein/DataFrame A high-performance, templatized C++ library providing a heterogeneous DataFrame container for in-memory data exploration, transformation, a… | 94 | 2981 | active |
| chdb-io/chdb chDB is an in-process SQL OLAP engine powered by ClickHouse, embeddable in Python (plus Go, Rust, Node.js, and Bun bindings) without runnin… | 97 | 2879 | active |
| opencurve/curve Curve is a cloud-native distributed storage system developed by NetEase and hosted as a CNCF sandbox project, supporting both block storage… | 23 | 2387 | active |
| apconw/Aix-DB Aix-DB is an AI-powered data analysis system (ChatBI) built on LangChain/LangGraph with an MCP Skills multi-agent architecture, converting … | 72 | 2234 | active |
| openmeterio/openmeter OpenMeter is an open-source metering and billing platform for AI, API, and DevOps products that ingests high-volume usage events, aggregate… | 95 | 2231 | active |
| jackchen0120/vueDataV A Vue + Echarts based data visualization platform offering cool big-screen dashboard templates and a reusable chart component library. It p… | 32 | 2176 | active |
| apache/tinkerpop Apache TinkerPop is a graph computing framework providing the Gremlin traversal language, drivers, Gremlin Server, and a reference in-memor… | 77 | 2144 | stable |
| EvgSkv/logica Logica is an open-source declarative logic programming language in the Datalog family that compiles to SQL. It lets users write logic-style… | 77 | 2130 | active |
| alibaba/SREWorks SREWorks is Alibaba's open-source cloud-native operations and maintenance (O&M) SaaS platform built on Kubernetes, applying DataOps and AIO… | 48 | 2003 | active |
| moosefs/moosefs MooseFS is an open-source, POSIX-compliant, petabyte-scale network distributed file system written in C. It spreads data across commodity s… | 83 | 1999 | stable |
| NVIDIA/aistore AIStore (AIS) is a lightweight, distributed object storage stack built by NVIDIA specifically for AI workloads. It provides linear scalabil… | 95 | 1915 | active |
| cnosdb/cnosdb CnosDB is an open-source, cloud-native distributed time-series database written in Rust, supporting standard SQL, schemaless writes, and ou… | 53 | 1756 | active |
| polardb/polardbx-sql PolarDB-X is a cloud native distributed SQL database built in Java with a shared-nothing architecture that decouples compute from storage. … | 49 | 1682 | stable |
| Bruin Bruin is an end-to-end data platform whose CLI combines data ingestion (via its ingestr tool), SQL/Python/R transformations, and data quali… | 91 | 1678 | active |
| filodb/FiloDB FiloDB is a distributed, in-memory, Prometheus-compatible time series database written in Scala, designed for real-time ingestion of metric… | 67 | 1467 | active |
| sql-machine-learning/sqlflow SQLFlow is a compiler that extends SQL with AI-oriented syntax (training, prediction, evaluation, explanation, and mathematical programming… | 23 | 5188 | maintenance |
| apache/cassandra-python-driver The official Python client driver for Apache Cassandra (and DataStax Enterprise/Astra), communicating via Cassandra's binary protocol and C… | 74 | 1427 | stable |
| sensorsdata/sa-sdk-android Sensors Analytics' official Android SDK for lightweight user behavior data collection, supporting manual code tracking, auto (full) trackin… | 95 | 1375 | stable |
| SpiderClub/weibospider A distributed web crawler for Sina Weibo (Chinese microblogging platform) built with Python, Celery, and requests. It scrapes user profiles… | 32 | 4793 | maintenance |
| datavane/tis TIS is an AI-native data integration platform built on DataX, Flink, and Flink-CDC that provides a visual Web-UI for zero-code batch and re… | 90 | 1339 | active |
| logicalclocks/hopsworks Hopsworks is an open-source, data-intensive AI platform (an 'AI Lakehouse') built around a Python-centric Feature Store with online/offline… | 26 | 1303 | active |
| pmacct/pmacct pmacct is a set of multi-purpose passive network monitoring daemons written in C that collect, aggregate, replicate and export IP traffic a… | 67 | 1237 | active |
| openGemini/openGemini openGemini is a cloud-native distributed time-series database written in Go, designed for storing and analyzing massive telemetry data such… | 84 | 1172 | active |
| sagframe/sagacity-sqltoy sqltoy-orm is a Java ORM framework that combines JPA-style object CRUD with powerful, flexible SQL query capabilities. It provides advanced… | 96 | 1151 | active |
| Tencent/TencentKona-8 Tencent Kona 8 is a no-cost, production-ready distribution of OpenJDK 8 with long-term support and quarterly updates, serving as the defaul… | 92 | 1004 | stable |
| dbt-labs/dbt-core dbt Core is an open-source command-line tool that lets data analysts and engineers transform data in warehouses using SQL select statements… | 95 | 13696 | experimental |
| BlazingDB/blazingsql BlazingSQL is a GPU-accelerated distributed SQL engine for Python, built on the RAPIDS ecosystem and cuDF GPU DataFrames. It lets users run… | 23 | 2011 | maintenance |
| shzlw/poli Poli is a self-hosted business intelligence server for writing SQL queries and building interactive dashboards and reports. It connects to … | 23 | 1973 | maintenance |
| littleark/githut GitHut is a web-based visualization of programming language popularity across GitHub repositories, built on data from the GitHub Archive. I… | 32 | 1289 | maintenance |
| pixiedust/pixiedust PixieDust is an open-source Python helper library that acts as an add-on to Jupyter notebooks, simplifying data visualization and Spark pac… | 23 | 1040 | maintenance |
| madnight/githut A web application that visualizes GitHub language statistics, showing top programming languages, licenses, and pull request activity over t… | 32 | 1005 | maintenance |
| square/cube Cube is a system for collecting timestamped events and deriving metrics, built on MongoDB and Node.js, with time series visualization. It c… | 10 | 3873 | abandoned |
| airbnb/airpal Airpal is a web-based query execution UI for PrestoDB that lets users find tables, browse metadata, write queries, and export results as CS… | 10 | 2743 | abandoned |
| DataBrewery/cubes Cubes is a lightweight Python framework for Online Analytical Processing (OLAP), providing multidimensional analysis and browsing of aggreg… | 32 | 1480 | abandoned |
| citp/BlockSci BlockSci is a high-performance C++ tool and analysis library for blockchain science, featuring a custom in-memory blockchain database with … | 23 | 1396 | abandoned |
| twitter/fatcache Fatcache is a networked, memcached-protocol-compatible cache that uses SSD storage as an extension of DRAM, allowing terabyte-scale caching… | 10 | 1299 | abandoned |
← prev page 5 / 5