Open-source data-science software
1215 open-source libraries, tools and applications tagged data-science, ranked by how closely data-science is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
1215 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| foolcage/fooltrader fooltrader is a Python quantitative analysis and trading framework that crawls, cleans, and structures market data (stocks, futures, forex,… | 23 | 1198 | abandoned |
| killrweather/killrweather KillrWeather is a Scala reference application demonstrating integration of Apache Spark Streaming, Apache Kafka, Apache Cassandra, and Akka… | 32 | 1177 | abandoned |
| misoproject/dataset Dataset.js is a JavaScript library for managing data behind client-side visualizations, handling loading, parsing, sorting, filtering, and … | 32 | 1172 | abandoned |
| Jinnrry/getAwayBSG A Go CLI web crawler that scrapes job listings from Zhilian Zhaopin and housing (rental and second-hand) data from Lianjia across Chinese c… | 10 | 1144 | abandoned |
| jorgecarleitao/arrow2 A Rust implementation of the Apache Arrow columnar in-memory format, supporting IO with Parquet, Avro, CSV, IPC, and Flight, plus compute k… | 10 | 1086 | abandoned |
| seemethere/nba_py nba_py is a Python client library wrapping the stats.nba.com API for retrieving NBA statistics. It returns data as pandas DataFrames or JSO… | 10 | 1061 | abandoned |
| LockerProject/Locker Locker is an open-source personal data platform ('the me platform') that collects a user's data from various online services, apps, and dev… | 32 | 1060 | abandoned |
| paulyoder/LinqToExcel A .NET library that lets developers query Excel spreadsheets and CSV files using LINQ syntax, mapping worksheet rows to strongly-typed obje… | 32 | 1055 | abandoned |
| google/lightweight_mmm LightweightMMM is a Python library for Bayesian Marketing Mix Modeling (MMM) built on JAX and Numpyro, helping advertisers measure media ch… | 10 | 1053 | abandoned |
| uscensusbureau/citysdk CitySDK is a JavaScript (ClojureScript-compiled) library that simplifies access to US Census Bureau APIs, providing utilities for fetching … | 10 | 1040 | abandoned |
| bcbio-nextgen bcbio-nextgen is a validated, community-developed pipeline toolkit for high-throughput sequencing analysis, including variant calling, RNA-… | 23 | 1032 | abandoned |
| fashiontec/sewing-machines-app A mobile application from the FashionTec project for cataloguing and browsing sewing machine models and related hardware data. It appears t… | 32 | 1023 | abandoned |
| TradingAgents TradingAgents is a Python framework that orchestrates multiple LLM-powered agents to analyze financial markets and make trading decisions. … | 87 | 109273 | active |
| BettaFish MiroFish is a Python-based swarm intelligence prediction engine that builds high-fidelity parallel digital worlds populated by thousands of… | 67 | 76494 | active |
| X Recommendation Algorithm The open-source source code for X's (formerly Twitter) recommendation algorithm, a set of services and jobs that serve personalized feeds o… | 46 | 73957 | active |
| OpenBB OpenBB is an open-source Python library that provides a unified data integration layer for financial, economic, and crypto data. It powers … | 85 | 73550 | active |
| virattt/ai-hedge-fund An educational AI-powered hedge fund simulator where LLM-driven agents modeled after famous investors analyze stocks and make simulated tra… | 87 | 63827 | active |
| VeighNa VeighNa (vnpy) is an open‑source Python framework for building quantitative trading systems. It provides a modular architecture, data‑feed … | 83 | 45695 | active |
| Apache Spark Apache Spark is a unified analytics engine for large-scale data processing, providing high-level APIs in Scala, Java, Python, and R over an… | 77 | 44159 | stable |
| BettaFish MiroFish is a Python‑based multi‑agent AI engine that creates a high‑fidelity digital twin of real‑world scenarios. It lets users inject se… | 75 | 42341 | active |
| BettaFish BettaFish (微舆) is a from-scratch multi-agent public opinion analysis system in Python that monitors 30+ social media platforms, analyzes mi… | 75 | 42341 | active |
| anthropics/financial-services A collection of reference AI agents, skills, and data connectors for financial-services workflows like investment banking, equity research,… | 59 | 38868 | active |
| SheetJS SheetJS Community Edition is an open‑source JavaScript library for reading, writing, and manipulating spreadsheet files in many formats. It… | 32 | 36347 | active |
| HKUDS/Vibe-Trading Vibe-Trading is an open-source AI finance research agent that turns natural-language prompts into runnable market research, backtests, and … | 82 | 35591 | active |
| Apache Kafka Apache Kafka is an open-source distributed event streaming platform for building high-performance data pipelines, streaming analytics, and … | 76 | 33918 | stable |
| hsliuping/TradingAgents-CN A Chinese-enhanced fork of the TradingAgents multi-agent LLM framework for stock analysis and trading research, supporting A-shares, Hong K… | 62 | 32318 | active |
| MLflow MLflow is an open source AI engineering platform for agents, LLMs, and traditional ML models, providing experiment tracking, model registry… | 100 | 28441 | stable |
| LeRobot LeRobot is a Python library that provides a unified interface for controlling real robots, recording datasets, and training/deploying polic… | 90 | 28232 | active |
| LeRobot LeRobot is Hugging Face's PyTorch library for real-world robotics, providing a hardware-agnostic Python interface for controlling robots, a… | 90 | 28232 | active |
| fastai fastai is a deep learning library built on PyTorch that offers high-level components for quickly achieving state-of-the-art results in visi… | 92 | 28224 | stable |
| sinaptik-ai/pandas-ai PandasAI is a Python library that lets users query data in SQL, CSV, or parquet format using natural language, powered by LLMs and RAG. It … | 52 | 23808 | active |
| marimo marimo is a reactive Python notebook stored as pure Python files, where running a cell automatically re-runs dependent cells to keep code a… | 90 | 22981 | active |
| Airbyte Airbyte is an open-source data integration platform that enables ELT pipelines and real-time data access for AI agents. It provides a catal… | 77 | 22234 | active |
| QuantConnect LEAN LEAN is an open-source, event-driven algorithmic trading engine by QuantConnect supporting backtesting, optimization, and live trading acro… | 66 | 21779 | stable |
| DB-GPT DB-GPT is an open‑source agentic AI data assistant that connects to databases, files and knowledge bases, then generates SQL, code and visu… | 91 | 20127 | active |
| louis-e/arnis Arnis is a free, open-source desktop application that generates detailed Minecraft Java and Bedrock Edition worlds from real-world geograph… | 99 | 18332 | active |
| pytorch/vision torchvision is the official PyTorch companion library providing datasets, model architectures, and image/video transformations for computer… | 92 | 17926 | stable |
| Neo4j Neo4j is the leading open-source native graph database, storing and querying connected data as nodes and relationships using the Cypher que… | 66 | 17253 | stable |
| cvat-ai/cvat CVAT (Computer Vision Annotation Tool) is an open-source, self-hosted platform for annotating images, videos, and 3D point clouds to build … | 95 | 16896 | active |
| xbtlin/ai-berkshire A collection of AI research skills for Claude Code and Codex that systematizes the value investing methodologies of Buffett, Munger, Duan Y… | 60 | 16597 | active |
| FinRL FinRL is the first open-source deep reinforcement learning framework for financial markets, providing end-to-end pipelines to build, train,… | 77 | 16558 | active |
| dagster-io/dagster Dagster is an open-source Python data orchestration platform for developing, producing, and observing data assets, with integrated lineage,… | 95 | 16287 | active |
| DVC DVC (Data Version Control) is an open-source command line tool and VS Code extension for versioning data and models, building lightweight M… | 88 | 15892 | active |
| apitable/apitable APITable is an open-source, API-oriented low-code platform for building collaborative database-spreadsheet applications, positioned as an o… | 83 | 15633 | active |
| Unstructured Unstructured is an open-source ETL library and platform for converting complex documents (PDF, DOCX, HTML, images, and 65+ file types) into… | 95 | 15556 | active |
| OpenMetadata OpenMetadata is an open-source metadata management platform that unifies data cataloging, lineage, data quality, governance, and business s… | 95 | 15506 | active |
| elastic/logstash Logstash is an open-source server-side data processing pipeline that ingests data from multiple sources simultaneously, transforms it, and … | 95 | 14966 | stable |
| NLTK NLTK is a leading open-source Python library for natural language processing, providing interfaces to over 50 corpora and lexical resources… | 95 | 14732 | stable |
| AI Scientist The AI Scientist is a system that uses large language models to autonomously perform end-to-end scientific research, from idea generation a… | 46 | 14620 | active |
| dlib Dlib is a modern C++ toolkit containing machine learning algorithms, deep learning tools, computer vision, linear algebra, and general-purp… | 84 | 14458 | stable |
| dmlc/dgl DGL (Deep Graph Library) is a Python package for deep learning on graph-structured data, built on top of existing frameworks like PyTorch, … | 34 | 14281 | stable |
| semantica-agi/semantica Semantica is a Python library providing graph-native infrastructure for building context graphs, knowledge graphs, and decision intelligenc… | 84 | 13821 | active |
| instaloader/instaloader Instaloader is a Python command-line tool and library for downloading pictures, videos, captions, comments, and metadata from Instagram. It… | 91 | 13598 | active |
| getomni-ai/zerox Zerox is a library (Node.js and Python packages) that performs OCR and document extraction by converting files like PDFs, DOCX, and images … | 32 | 12249 | active |
| Bisheng BISHENG is an open-source LLM DevOps (LLMOps) platform for building enterprise AI applications, offering GenAI workflow orchestration, RAG,… | 92 | 12032 | active |
| NVIDIA/cosmos NVIDIA Cosmos is an open platform of omnimodal world foundation models, datasets, and tools for building Physical AI systems such as robots… | 69 | 11892 | active |
| ludwig-ai/ludwig Ludwig is a declarative, low-code deep learning framework for training, fine-tuning, and deploying AI models — from LLMs to tabular, image,… | 96 | 11775 | active |
| CocoIndex CocoIndex is an open-source incremental data framework for AI, with a Rust engine and a declarative Python API that keeps sources (files, S… | 84 | 11711 | active |
| FiftyOne FiftyOne is an open-source Python library and GUI app for building high-quality computer vision datasets and models. It enables visualizing… | 98 | 11184 | active |
| StockSharp StockSharp (S#) is an open-source algorithmic and quantitative trading platform for .NET and Python, providing a trading API, 70+ broker/ex… | 68 | 10925 | active |
| jsvine/pdfplumber pdfplumber is a Python library for extracting detailed information from PDFs, including every character, line, rectangle, and table, built … | 89 | 10827 | active |
| X-AnyLabeling X-AnyLabeling is a cross-platform desktop application for AI-assisted annotation of text, image, video, and multimodal data. It bundles bui… | 96 | 10642 | active |
| Metaflow Metaflow is a human-centric Python framework from Netflix for building, managing, and deploying real-life AI/ML and data science systems. I… | 92 | 10280 | stable |
| drivendataorg/cookiecutter-data-science Cookiecutter Data Science (CCDS) is a Python CLI tool that scaffolds standardized, flexible data science project structures with best pract… | 78 | 10086 | active |
| OpenMined/PySyft PySyft is a Python library that lets data scientists run computations on private data that stays on the data owner's server, with results s… | 73 | 10034 | active |
| qiye45/wechatDownload A desktop tool for batch downloading WeChat Official Account (公众号) articles, saving them as html/mhtml/md/pdf/docx/csv and preserving embed… | 84 | 9560 | active |
| apache/datafusion Apache DataFusion is an extensible query engine written in Rust that uses Apache Arrow as its in-memory columnar format. It provides SQL an… | 77 | 9505 | active |
| Spyder Spyder is a free, open-source scientific Python IDE built with PyQt, featuring an editor, interactive console, variable explorer, and plott… | 93 | 9372 | stable |
| Deep Lake Deep Lake is an open-source database for AI that stores multimodal data (images, video, audio, text, embeddings, annotations) in a format o… | 75 | 9249 | active |
| polakowo/vectorbt VectorBT is a Python library for backtesting and analyzing trading strategies at scale, operating on pandas and NumPy objects accelerated b… | 88 | 9175 | active |
| pyro-ppl/pyro Pyro is a deep universal probabilistic programming library built on Python and PyTorch, supporting Bayesian modeling with variational infer… | 65 | 9059 | stable |
| Delta Lake Delta Lake is an open-source storage framework and table format that brings ACID transactions, scalable metadata handling, schema enforceme… | 95 | 9053 | stable |
| mage-ai/mage-ai Mage OSS is a self-hosted data pipeline tool for building, running, and orchestrating ETL/ELT workflows in a notebook-style UI using Python… | 91 | 8835 | active |
| MONAI MONAI is a PyTorch-based open-source framework for deep learning in healthcare imaging, providing domain-specific transforms, 3D architectu… | 91 | 8788 | stable |
| redpanda-data/connect Redpanda Connect (formerly Benthos) is a declarative stream processor that moves data between hundreds of sources and sinks with transforma… | 94 | 8778 | active |
| pentaho/pentaho-kettle Pentaho Data Integration (Kettle) is an open-source ETL application for designing and running data extraction, transformation, and loading … | 66 | 8400 | active |
| AI4Finance-Foundation/FinRobot FinRobot is an open-source AI agent platform for financial applications built on large language models, unifying LLMs, reinforcement learni… | 78 | 8140 | active |
| TomWright/dasel Dasel is a command-line tool and Go library for querying, modifying, and transforming structured data across JSON, YAML, TOML, XML, CSV, IN… | 94 | 8046 | active |
| google-deepmind/weathernext Google DeepMind's WeatherNext family of AI weather forecasting models, including WeatherNext 2, GraphCast, and GenCast, with code and pretr… | 82 | 7709 | active |
| Kaggle/kaggle-cli The official Kaggle command-line interface for interacting with Kaggle competitions, datasets, models, notebooks, and discussion forums. It… | 95 | 7607 | active |
| AlaSQL/alasql AlaSQL is a lightweight in-memory SQL database written in pure JavaScript that runs in the browser, Node.js, and mobile apps. It queries bo… | 100 | 7291 | active |
| Zipstack/unstract Unstract is an open-source, LLM-driven platform that extracts structured JSON data from unstructured documents such as PDFs, images, and sc… | 87 | 7270 | active |
| Alluxio/alluxio Alluxio is an open-source distributed caching and data orchestration platform that sits between compute frameworks (Spark, Presto, Trino, P… | 64 | 7248 | stable |
| AI Scientist An end-to-end autonomous AI research system that generates hypotheses, runs machine learning experiments, analyzes data, and writes complet… | 43 | 7222 | active |
| tensortrade-org/tensortrade TensorTrade is an open-source Python framework for building, training, and evaluating reinforcement learning agents for algorithmic trading… | 58 | 7194 | active |
| Lance Lance is an open lakehouse data format (file format, table format, and catalog spec) for multimodal AI, implemented in Rust with Python and… | 95 | 7182 | active |
| Snowplow Snowplow is a Customer Data Infrastructure platform that collects, validates, enriches, and streams event-level behavioral data from web, m… | 59 | 7034 | stable |
| mahmoud/boltons Boltons is a set of 250+ pure-Python utility constructs, recipes, and snippets that extend the Python standard library with no external dep… | 92 | 6940 | stable |
| eriklindernoren/ML-From-Scratch A Python library providing bare-bones NumPy implementations of fundamental machine learning models and algorithms, from linear regression t… | 32 | 32980 | maintenance |
| ClearML ClearML is an open-source Python SDK and platform for MLOps/LLMOps that provides auto-logged experiment tracking, data versioning, pipeline… | 96 | 6903 | stable |
| haifengl/smile SMILE is a comprehensive, high-performance machine learning framework for the JVM with idiomatic APIs for Java, Scala, and Kotlin. It cover… | 100 | 6423 | active |
| Apache IoTDB Apache IoTDB is an open-source time-series database management system designed for industrial IoT, providing integrated collection, storage… | 94 | 6420 | stable |
| csvkit csvkit is a suite of Python-based command-line tools for converting to and working with CSV files. It includes utilities like csvcut, csvst… | 75 | 6415 | stable |
| WonderTrader WonderTrader is a high-performance C++-core quantitative trading framework covering the full lifecycle from data ingestion and backtesting … | 74 | 6373 | active |
| Apache Hudi Apache Hudi is an open data lakehouse platform built on a high-performance open table format that brings database functionality like transa… | 96 | 6336 | stable |
| PaddlePaddle/PaddleX PaddleX is a low-code, all-in-one AI development tool built on the PaddlePaddle framework, bundling 200+ pretrained models into 33 producti… | 86 | 6268 | active |
| apache/nifi Apache NiFi is an easy-to-use, powerful, and reliable system to process and distribute data, built on the JVM. It provides a browser-based … | 93 | 6249 | stable |
| jihe520/MathModelAgent MathModelAgent is a multi-agent LLM application that automates mathematical modeling competitions end-to-end: it analyzes a problem, builds… | 87 | 6220 | active |
| FATE FATE (Federated AI Technology Enabler) is an industrial-grade open-source federated learning framework hosted by the Linux Foundation. It e… | 23 | 6107 | active |
| MontFerret/ferret Ferret is a declarative, expression-oriented query language (FQL) with an embeddable Go runtime for querying, transforming, and automating … | 79 | 6013 | active |