Open-source data-science software
1215 open-source libraries, tools and applications tagged data-science, ranked by how closely data-science is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
1215 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| ridhwaans/homehost Homehost is a self-hosted, Netflix-like web application for streaming your personal media collection (movies, TV shows, and music) within a… | 58 | 1200 | active |
| Oxen Oxen is a fast data version control system written in Rust that versions large datasets (images, audio, video, text, parquet) with a git-li… | 96 | 1199 | active |
| iDC-NEU/YiGraph YiGraph is an LLM-driven agent system for autonomous graph data analytics built on the Analytics-Augmented Generation (AAG) framework. It e… | 75 | 1192 | active |
| shenwei356/csvtk csvtk is a cross-platform command-line toolkit written in Go for manipulating CSV/TSV tabular data. It provides many subcommands for filter… | 93 | 1171 | active |
| davidfowl/tally Tally is a local rule engine CLI that classifies bank transactions from CSV exports using plain-English rules, designed to be driven by AI … | 58 | 1167 | active |
| lhotse-speech/lhotse Lhotse is a Python library for flexible, scalable preparation of multimodal (speech, audio, video, image, text) data for machine learning, … | 85 | 1160 | active |
| naurril/SUSTechPOINTS SUSTechPOINTS is a web-based 3D point cloud annotation platform for labeling LiDAR data with 3D bounding boxes, aimed at autonomous driving… | 58 | 1160 | active |
| chengtan9907/OpenSTL OpenSTL is a comprehensive benchmark and modular framework for spatio-temporal predictive learning, covering video prediction methods acros… | 50 | 1158 | active |
| ClawBio/ClawBio ClawBio is a bioinformatics-native AI agent skill library offering 97 curated, reproducible skills for genomics tasks like pharmacogenomics… | 80 | 1155 | active |
| sagframe/sagacity-sqltoy sqltoy-orm is a Java ORM framework that combines JPA-style object CRUD with powerful, flexible SQL query capabilities. It provides advanced… | 96 | 1150 | active |
| CellProfiler CellProfiler is a free, open-source desktop application for quantitative analysis of biological images, letting biologists build modular im… | 67 | 1137 | active |
| InternRobotics/InternNav InternNav is an open-source PyTorch-based toolbox for building embodied navigation foundation models, supporting vision-language navigation… | 52 | 1135 | active |
| multiprocessio/dsq dsq is a Go command-line tool that lets you run SQL queries directly against data files such as JSON, CSV, TSV, Excel, and Parquet, powered… | 23 | 3864 | maintenance |
| prometheus-eval/prometheus-eval Prometheus-Eval is a Python library for evaluating LLM generation outputs using the Prometheus family of open evaluator models and GPT-4 as… | 20 | 1117 | active |
| Code Interpreter API A Python library providing an open-source implementation of the ChatGPT Code Interpreter, built on LangChain. It lets LLM agents execute sa… | 20 | 3844 | maintenance |
| whchien/ai-trader A config-driven backtesting framework for algorithmic trading built on Backtrader, with 20+ built-in strategies and multi-market support (U… | 62 | 1109 | active |
| waymo-research/waymax Waymax is a lightweight, multi-agent autonomous driving simulator built entirely in JAX, based on the Waymo Open Motion Dataset. It support… | 46 | 1108 | active |
| PharMolix/OpenBioMed OpenBioMed is an open-source toolkit and agent platform for biomedicine and life science, offering multimodal models like BioMedGPT-Mol, 45… | 69 | 1104 | active |
| NVIDIA/DreamDojo NVIDIA's official PyTorch codebase for DreamDojo, a generalist robot world model pretrained on 44k hours of human egocentric video and post… | 45 | 1099 | active |
| TrueBlocks/trueblocks-core TrueBlocks (chifra) is a local-first command-line tool suite and optional API server that indexes address appearances on Ethereum and other… | 73 | 1095 | active |
| ydkhatri/mac_apt mac_apt is a Python-based DFIR framework that parses macOS and iOS disk images or live systems to extract forensic artifacts like Safari hi… | 90 | 1088 | stable |
| Data Contract An open-source Python CLI for working with data contracts using the Open Data Contract Standard (ODCS). It lints contracts, connects to dat… | 91 | 1085 | active |
| OranAi-Ltd/oransim Oransim is an open-source causal digital twin engine for marketing, simulating a large virtual consumer society with LLM-backed personas to… | 58 | 1073 | active |
| klsdf/GreenResourcesManager Green Resources Manager is a free, all-in-one local multimedia resource manager for 'data hoarder' users, built with Electron and Vue 3. It… | 84 | 1058 | active |
| alibaba/Alink Alink is a machine learning algorithm platform built on Apache Flink, developed by Alibaba's PAI team. It provides a large library of batch… | 23 | 3612 | maintenance |
| star23/Day1Global-Skills A collection of investment analysis skills for AI agents, covering tech earnings deep dives, Buffett-style value investing, US market senti… | 56 | 1053 | active |
| wu-yc/LabClaw LabClaw is a modular library of 240 SKILL.md agent skills for biomedical AI research, covering biology, drug discovery, medicine, data scie… | 44 | 1053 | active |
| NVIDIA/raft NVIDIA RAFT (Reusable Accelerated Functions and Tools) is a C++/Python library of CUDA-accelerated algorithms and primitives for machine le… | 96 | 1047 | active |
| turicas/brasil.io The backend of Brasil.IO, a platform that collects, cleans, and publishes Brazilian public open datasets in accessible formats. It automate… | 74 | 1047 | active |
| facebookresearch/pytorchvideo PyTorchVideo is a deep learning library from Facebook Research focused on video understanding research, built on PyTorch. It provides reusa… | 55 | 3570 | maintenance |
| tidyverse/readr readr is an R package from the tidyverse for fast, friendly reading of rectangular data from delimited files such as CSV, TSV, fixed-width,… | 64 | 1041 | stable |
| badlogic/heissepreise A self-hostable grocery price search app that daily scrapes product and price data from major Austrian supermarket chains (Billa, Spar, Hof… | 57 | 1041 | active |
| AlexWan/OsEngine OsEngine is an open-source algorithmic trading platform written in C# that bundles a robot-creation layer, historical data downloader (OsDa… | 81 | 1032 | active |
| ustcllm/RecFM RecFM is a collection of tools and frameworks from USTCLLM for developing foundation models tailored to recommendation systems. It bundles … | 37 | 1031 | active |
| DREAM-DK/MAKRO MAKRO is a large-scale macroeconomic model of the Danish economy developed by DREAM for the Danish Ministry of Finance, written in GAMS wit… | 67 | 1025 | active |
| vscodethemes/web A web application that lets users search and preview color themes from the VS Code Marketplace before installing them. It scans the marketp… | 57 | 1021 | active |
| thuml/Large-Time-Series-Model Official code, datasets, and checkpoints for Timer and Sundial, generative pre-trained Transformer foundation models for general time serie… | 55 | 1020 | active |
| Towhee Towhee is a Python framework for building ETL pipelines that process unstructured data (images, video, text, audio) into embeddings using s… | 23 | 3451 | maintenance |
| sematic-ai/sematic Sematic is an open-source ML pipeline development platform that lets engineers write end-to-end pipelines in pure Python. Pipelines can run… | 23 | 1003 | active |
| chrislusf/glow Glow is a pure-Go distributed computation library providing MapReduce-style flow APIs (Map, Filter, Reduce) that can run in parallel on a s… | 32 | 3216 | maintenance |
| weld-project/weld Weld is a language and high-performance runtime that optimizes data-intensive analytics workflows by expressing computations in a common in… | 54 | 3008 | maintenance |
| CodeRayZhang/Movie_Recommend A full-stack movie recommendation system built on Spark, including a Scrapy crawler, an SSM-based movie website, an admin backend, and a Sp… | 32 | 3008 | maintenance |
| kotartemiy/newscatcher A Python package that programmatically collects normalized news articles from thousands of news websites, filterable by topic, country, and… | 32 | 2988 | maintenance |
| stanford-crfm/helm HELM is a Python framework from Stanford's CRFM for holistic, reproducible evaluation of foundation models including LLMs and multimodal mo… | 87 | 2924 | maintenance |
| blmoistawinde/HarvestText HarvestText is a Python library for Chinese text mining and preprocessing using unsupervised or weakly supervised methods. It integrates do… | 23 | 2633 | maintenance |
| dbt dbt Core is an open-source command-line tool that lets data analysts and engineers transform data in warehouses using SQL select statements… | 95 | 14039 | experimental |
| shirosaidev/stocksight stocksight is an open-source Python application that analyzes stock market sentiment using Twitter streams and news headlines, storing data… | 23 | 2541 | maintenance |
| dmlc/gluon-nlp GluonNLP is a Python toolkit built on Apache MXNet that provides text data loading, processing tools, pretrained model zoos, and training u… | 10 | 2538 | maintenance |
| dmlc/decord Decord is a C++ library with Python bindings that provides efficient video and audio decoding for deep learning pipelines. It wraps hardwar… | 23 | 2525 | maintenance |
| huggingface/evaluate Hugging Face's library for easily evaluating machine learning models and datasets with dozens of standardized metrics, comparisons, and mea… | 74 | 2491 | maintenance |
| geekyouth/SZT-bigdata A big data passenger flow analysis system for the Shenzhen Metro, built on Shenzhen Tong smart-card swipe data. It demonstrates ETL and ana… | 56 | 2475 | maintenance |
| alephdata/aleph Aleph is a self-hosted platform for indexing, searching, and browsing large volumes of documents (PDF, Word, HTML) and structured data (CSV… | 63 | 2441 | maintenance |
| RameenAbdal/StyleFlow StyleFlow is a research implementation of attribute-conditioned exploration of StyleGAN-generated images using conditional continuous norma… | 32 | 2441 | maintenance |
| Texar Texar is a modularized Python toolkit for machine learning, especially natural language processing and text generation, built on TensorFlow… | 61 | 2390 | maintenance |
| jsbroks/coco-annotator COCO Annotator is a web-based image annotation tool for labeling images with segments, bounding boxes, keypoints, and object tracking to cr… | 23 | 2286 | maintenance |
| chartbeat-labs/textacy textacy is a Python NLP library built on spaCy that handles tasks before and after spaCy's core pipeline, such as text cleaning, informatio… | 23 | 2240 | maintenance |
| bytewax/bytewax Bytewax is a Python-first framework with a Rust-based distributed engine for stateful event and stream processing, inspired by Apache Flink… | 68 | 2056 | maintenance |
| apache/drill Apache Drill is a distributed MPP (massively parallel processing) SQL query engine for self-describing data such as JSON, Parquet, and othe… | 67 | 2024 | maintenance |
| HazyResearch/deepdive DeepDive is a Stanford-developed system for extracting structured data from unstructured sources and building knowledge bases using distant… | 23 | 1979 | maintenance |
| google/sling SLING is a natural language frame semantics parser that annotates text with frame semantic graph representations using bi-directional LSTMs… | 10 | 1932 | maintenance |
| snap-stanford/GraphGym GraphGym is a platform for designing and evaluating Graph Neural Networks (GNNs), built around a highly modularized pipeline covering data … | 23 | 1908 | maintenance |
| nlplab/brat brat is a web-based collaborative text annotation tool for creating text-bound and relational annotations, originally built for NLP and Bio… | 32 | 1879 | maintenance |
| ZhengyaoJiang/PGPortfolio PGPortfolio is a Python library implementing a deep reinforcement learning framework for financial portfolio management, based on the paper… | 23 | 1852 | maintenance |
| byzer-org/byzer-lang Byzer (formerly MLSQL) is a low-code, SQL-like distributed programming language and engine for data pipelines, analytics, and AI, built aro… | 23 | 1835 | maintenance |
| THUDM/CogDL CogDL is a Python/PyTorch toolkit for graph deep learning that lets researchers train and compare GNN and graph embedding models on tasks l… | 23 | 1820 | maintenance |
| Trusted-AI/AIX360 AI Explainability 360 is an open-source Python library from IBM Research offering a comprehensive set of algorithms for interpreting and ex… | 65 | 1806 | maintenance |
| RedisBloom RedisBloom is a Redis module written in C that adds probabilistic data structures—Bloom filters, Cuckoo filters, Count-min sketch, Top-K, a… | 95 | 1783 | maintenance |
| OryxProject/oryx Oryx 2 is a Java framework implementing the lambda architecture on Apache Spark and Apache Kafka, specialized for real-time large-scale mac… | 10 | 1782 | maintenance |
| Tencent/Metis Metis is a learnware platform for AIOps from Tencent, currently open-sourcing a time-series anomaly detection learnware. It combines statis… | 10 | 1756 | maintenance |
| Lightning-Universe/lightning-bolts Lightning Bolts is a toolbox of pre-built models, callbacks, and datasets that extend PyTorch Lightning for AI/ML research and production. … | 10 | 1753 | maintenance |
| Lightning-Universe/lightning-flash Lightning Flash is a high-level PyTorch library built on PyTorch Lightning that provides ready-made 'recipes' for over 15 AI tasks across 7… | 10 | 1726 | maintenance |
| facebookresearch/pytorch_GAN_zoo A PyTorch toolbox of GAN implementations including Progressive Growing GAN, DCGAN, and StyleGAN (beta), plus tools like GDPP, AC-GAN condit… | 10 | 1627 | maintenance |
| den4uk/andriller Andriller CE is a Python-based forensic toolkit for Android smartphones that performs read-only, non-destructive data acquisition from devi… | 23 | 1618 | maintenance |
| ExpDev07/coronavirus-tracker-api A fast REST API built with Python and FastAPI that provides up-to-date global COVID-19 statistics including confirmed cases, deaths, and re… | 23 | 1568 | maintenance |
| genforce/interfacegan InterFaceGAN is a Python research library that interprets the latent space of pretrained GANs (PGGAN, StyleGAN) to find semantic subspaces … | 32 | 1561 | maintenance |
| NLPchina/nlp-lang A Java base library from NLPchina that packages common utilities used across NLP projects, such as trie/double-array trie structures, word … | 63 | 1507 | maintenance |
| DLTK DLTK is a Python neural networks toolkit built on TensorFlow for deep learning on medical images. It provides reference model implementatio… | 32 | 1460 | maintenance |
| xisuo67/XHS-Spider XHS-Spider is a polished Windows desktop (WPF, .NET 6) tool for collecting Xiaohongshu (Little Red Book) data, including keyword and user s… | 59 | 1443 | maintenance |
| logpai/loglizer Loglizer is a machine learning toolkit for log-based anomaly detection, implementing classic supervised and unsupervised models (LR, Decisi… | 32 | 1431 | maintenance |
| google-research/disentanglement_lib disentanglement_lib is an open-source Python library for research on learning disentangled representations, supporting models like BetaVAE,… | 10 | 1425 | maintenance |
| vas3k/TaxHacker TaxHacker is a self-hosted AI-powered accounting app for freelancers, indie-hackers, and small businesses. It uses LLMs to OCR and analyze … | 82 | 6729 | experimental |
| loklak Loklak is a distributed Java server application that anonymously collects, indexes, and shares social media messages (especially tweets) us… | 23 | 1393 | maintenance |
| lauripiispanen/most-active-github-users-counter A Go CLI tool that queries the GitHub GraphQL API to rank GitHub users by their number of contributions, with preset locations and CSV outp… | 10 | 1272 | maintenance |
| AlgoTraders/stock-analysis-engine A distributed stock analysis and backtesting framework that ingests automated pricing data from IEX Cloud, Tradier, and FinViz and runs tho… | 32 | 1247 | maintenance |
| xueqiu/rdr RDR (redis data reveal) is a fast command-line tool written in Go that parses Redis RDB dump files. It extracts all keys and serves statist… | 23 | 1203 | maintenance |
| kexinhuang12345/DeepPurpose DeepPurpose is a PyTorch-based deep learning library for molecular modeling, supporting drug-target interaction (DTI), drug property, drug-… | 23 | 1197 | maintenance |
| apache/griffin Apache Griffin is a model-driven data quality service platform for defining, executing, and reporting data quality measures across multiple… | 10 | 1171 | maintenance |
| rosinality/style-based-gan-pytorch A PyTorch implementation of the StyleGAN paper (A Style-Based Generator Architecture for Generative Adversarial Networks), including traini… | 32 | 1110 | maintenance |
| maelfabien/Multimodal-Emotion-Recognition A real-time multimodal emotion recognition web app built with Flask that analyzes emotions from text, audio, and video inputs using deep le… | 32 | 1093 | maintenance |
| comet-ml/kangas Kangas is a Python library and tool for exploring, analyzing, and visualizing large-scale multimedia datasets via its DataGrid format. It o… | 23 | 1078 | maintenance |
| keras-team/keras-cv KerasCV is a library of modular computer vision components built on Keras 3 that work natively with TensorFlow, JAX, or PyTorch. It provide… | 10 | 1055 | maintenance |
| zepen/predict_Lottery_ticket A Python application that scrapes historical draw data for Chinese lotteries (双色球/Double Color Ball and 大乐透/Super Lotto) and trains deep le… | 75 | 1043 | maintenance |
| Kismuz/btgym BTGym is a Python library that wraps the Backtrader algorithmic trading engine in an OpenAI Gym environment API, enabling event-driven back… | 32 | 1037 | maintenance |
| mpplab/mnssp3 MNSSp3 is a privacy protection sharing platform for medical big data, built on the Malleable Network System Simulator (MNSS) platform. It a… | 32 | 1036 | maintenance |
| supzhang/epg A Python/Django-based system that scrapes TV program schedules (EPG) from multiple Chinese and Hong Kong/Taiwan sources and generates XMLTV… | 31 | 1029 | maintenance |
| mbrossar/ai-imu-dr Python/PyTorch implementation of the AI-IMU dead reckoning algorithm from the authors' IEEE/ArXiv paper, combining an invariant Kalman filt… | 32 | 1008 | maintenance |
| blaze/odo Odo is a Python library for migrating data between different containers, from in-memory structures like lists and pandas DataFrames to out-… | 23 | 1005 | maintenance |
| bitmagnet-io/bitmagnet bitmagnet is a self-hosted BitTorrent indexer, DHT crawler, content classifier and torrent search engine with a web UI, GraphQL API and Ser… | 59 | 4395 | experimental |
| gsh199449/spider Gather Platform is a Java-based configurable web crawler built on the WebMagic kernel, with a web console for configuring and managing scra… | 57 | 996 | maintenance |
| Orion Orion is a Python machine learning library for unsupervised time series anomaly detection, offering verified ML pipelines that flag rare pa… | 73 | 1370 | experimental |