Open-source data-science software
1215 open-source libraries, tools and applications tagged data-science, ranked by how closely data-science is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
1215 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| mapbox/tippecanoe A C++ command-line tool that builds vector tilesets from large collections of GeoJSON, Geobuf, or CSV features. It creates scale-independen… | 60 | 3133 | maintenance |
| shogun-toolbox/shogun Shogun is a C++ machine learning toolbox offering unified, efficient implementations of many ML algorithms with automatically generated bin… | 23 | 3081 | maintenance |
| stellargraph/stellargraph StellarGraph is a Python library for machine learning on graphs and networks, offering state-of-the-art graph neural network algorithms suc… | 23 | 3059 | maintenance |
| bigscience-workshop/promptsource PromptSource is a Python toolkit and repository for creating, sharing, and applying natural language prompts to Hugging Face datasets. It h… | 23 | 3037 | maintenance |
| ffcv FFCV is a fast data loading system for PyTorch that dramatically increases data throughput in model training by replacing standard data loa… | 23 | 2996 | maintenance |
| x0rz/tweets_analyzer A Python command-line script that scrapes a Twitter profile's tweets and analyzes metadata such as activity patterns, timezone, sources, ge… | 23 | 2982 | maintenance |
| jbesomi/texthero Texthero is a Python toolkit for text preprocessing, representation, and visualization, designed to work on top of Pandas Series and DataFr… | 23 | 2905 | maintenance |
| TeamHG-Memex/eli5 ELI5 is a Python library for debugging, inspecting, and explaining machine learning classifiers and regressors. It supports scikit-learn, X… | 63 | 2847 | maintenance |
| scikit-optimize/scikit-optimize Scikit-Optimize (skopt) is a Python library for sequential model-based optimization of expensive and noisy black-box functions, built on Nu… | 10 | 2830 | maintenance |
| phanein/deepwalk DeepWalk is a Python command-line tool that learns low-dimensional vector representations of vertices in graphs using short random walks an… | 23 | 2756 | maintenance |
| mars-project/mars Mars is a tensor-based unified framework for large-scale data computation that provides NumPy-, pandas-, and scikit-learn-compatible APIs w… | 23 | 2742 | maintenance |
| aditya-grover/node2vec Reference implementation of the node2vec algorithm for learning continuous low-dimensional node representations from arbitrary (un)directed… | 32 | 2739 | maintenance |
| douban/dpark DPark is a Python clone of Apache Spark, providing a MapReduce-like distributed computing framework that supports iterative computation. Jo… | 10 | 2662 | maintenance |
| Code Maat Code Maat is a command line tool written in Clojure that mines and analyzes data from version-control systems to reveal technical, social, … | 32 | 2636 | maintenance |
| Yelp/mrjob mrjob is a Python library for writing and running Hadoop Streaming MapReduce jobs, with support for Amazon EMR, Google Cloud Dataproc, self… | 62 | 2613 | maintenance |
| justinzm/gopup GoPUP is a Python library that provides convenient interfaces to a wide range of public Chinese data sources, including Baidu/Weibo/Google … | 23 | 2545 | maintenance |
| unslothai/hyperlearn HyperLearn is a Python library providing optimized reimplementations of classical machine learning and statistical algorithms (SVD, eigende… | 32 | 2520 | maintenance |
| zouxiaohang/TinySTL TinySTL is a C++11 reimplementation of a subset of the C++ Standard Template Library, plus extra containers and algorithms not found in the… | 32 | 2492 | maintenance |
| anandanand84/technicalindicators A JavaScript/TypeScript library of technical analysis indicators (SMA, EMA, RSI, MACD, Bollinger Bands, ADX, etc.) for stock and crypto tra… | 23 | 2454 | maintenance |
| nicolaspanel/numjs NumJs is a JavaScript library for scientific computing that provides an N-dimensional array object, linear algebra functions, FFT, and basi… | 32 | 2451 | maintenance |
| decaywood/XueQiuSuperSpider A Java 8 web scraping framework for collecting stock data from Xueqiu (Snowball) and other Chinese financial sites. It is built around comp… | 32 | 2439 | maintenance |
| timhutton/twitter-archive-parser A Python script that parses a downloaded Twitter archive and converts tweets and DMs into Markdown and HTML with embedded media, de-obfusca… | 32 | 2437 | maintenance |
| dflemstr/rq rq (Record Query) is a Rust command-line tool for ad-hoc analysis and transformation of streams of structured records, similar to awk/sed b… | 23 | 2300 | maintenance |
| approximatelabs/sketch Sketch is an AI code-writing assistant for pandas users that understands the context of your dataframe content to generate relevant suggest… | 32 | 2281 | maintenance |
| salesforce/TransmogrifAI TransmogrifAI is an AutoML library written in Scala that runs on Apache Spark for building modular, reusable, strongly typed machine learni… | 57 | 2276 | maintenance |
| peerchemist/finta FinTA is a Python library implementing over 80 common financial technical indicators (SMA, EMA, MACD, RSI, Bollinger Bands, etc.) on top of… | 10 | 2263 | maintenance |
| sfu-db/dataprep DataPrep is a Python library for low-code data preparation, offering modules to collect data from common APIs (connector), run fast explora… | 23 | 2261 | maintenance |
| incanter/incanter Incanter is a Clojure-based, R-like statistical computing and graphics environment for the JVM. It provides statistical functions, matrix/l… | 32 | 2248 | maintenance |
| H2O H2O-2 is a Java-based distributed machine learning and math engine that scales statistics and predictive modeling over Big Data platforms l… | 10 | 2240 | maintenance |
| WillKoehrsen/feature-selector A Python library for feature selection that identifies features to remove from machine learning datasets using five methods: missing values… | 32 | 2228 | maintenance |
| SheffieldML/GPy GPy is a Python framework for Gaussian process modeling, providing kernels, regression, classification, and sparse GP methods. It is a rese… | 91 | 2165 | maintenance |
| RJT1990/pyflux PyFlux is an open source Python library for time series analysis and forecasting, offering a broad range of models such as ARIMA, GARCH, GA… | 32 | 2136 | maintenance |
| dotnet/spark .NET for Apache Spark provides high-performance C# and F# bindings for Apache Spark, exposing DataFrames, SparkSQL, and Structured Streamin… | 74 | 2095 | maintenance |
| UniversalDataTool/universal-data-tool Universal Data Tool is a web and desktop application for collaboratively annotating images, text, audio, and documents, supporting tasks li… | 24 | 2073 | maintenance |
| vim-awesome/vim-awesome Vim Awesome is an open-source web application that serves as a comprehensive directory of Vim plugins, aggregating data from GitHub, Vim.or… | 23 | 2063 | maintenance |
| BlazingDB/blazingsql BlazingSQL is a GPU-accelerated distributed SQL engine for Python, built on the RAPIDS ecosystem and cuDF GPU DataFrames. It lets users run… | 23 | 2014 | maintenance |
| vaguileradiaz/tinfoleak tinfoleak is an open-source Python tool for OSINT/SOCMINT analysis of Twitter accounts, extracting structured intelligence such as user act… | 32 | 1986 | maintenance |
| ICT-BDA/EasyML EasyML is a general-purpose dataflow-based machine learning platform where tasks are defined as directed acyclic graphs of operations. It i… | 23 | 1979 | maintenance |
| bitly/data_hacks A collection of small Python command-line utilities for quick data analysis over piped streams, including text histograms, 95th percentile … | 66 | 1970 | maintenance |
| jasonstrimpel/volatility-trading A Python library providing a complete set of volatility estimators (Garman Klass, Parkinson, Rogers Satchell, Yang Zhang, etc.) based on Eu… | 32 | 1958 | maintenance |
| Tencent/plato Plato is Tencent's high-performance distributed graph computation framework, developed for graph processing and graph machine learning at W… | 23 | 1912 | maintenance |
| Palashio/libra Libra is a Python autoML library that lets users build, train, and evaluate machine learning models with one-line natural-language-style qu… | 37 | 1905 | maintenance |
| uber/petastorm Petastorm is a Python data access library from Uber that enables single-machine or distributed training and evaluation of deep learning mod… | 52 | 1894 | maintenance |
| tradytics/surpriver Surpriver is a Python application that uses machine learning and anomaly detection to find stocks with unusual price and volume patterns th… | 32 | 1880 | maintenance |
| h2oai/datatable datatable is a Python package for manipulating 2-dimensional tabular data structures (data frames), inspired by R's data.table. It emphasiz… | 64 | 1877 | maintenance |
| minimaxir/automl-gs automl-gs is a Python AutoML tool that takes an input CSV and a target prediction field and automatically generates a trained machine learn… | 23 | 1866 | maintenance |
| alvarobartt/investpy investpy is a Python package for retrieving recent and historical financial data from Investing.com, covering stocks, funds, ETFs, indices,… | 54 | 1858 | maintenance |
| fmilthaler/FinQuant FinQuant is a Python library for financial portfolio management, analysis, and optimisation. It lets users build portfolio objects from sto… | 23 | 1835 | maintenance |
| DQinYuan/chinese_province_city_area_mapper A Python library (pip package 'cpca') that extracts province, city, and district names from simplified Chinese address strings and maps the… | 32 | 1793 | maintenance |
| Embulk Embulk is an open-source, plugin-based parallel bulk data loader written in Java that transfers data between databases, storages, file form… | 67 | 1784 | maintenance |
| crossfilter/crossfilter Crossfilter is a JavaScript library for fast n-dimensional filtering and grouping of large multivariate datasets, designed for interactive … | 23 | 1759 | maintenance |
| AlphaPy AlphaPy is a Python machine learning framework built on scikit-learn, pandas, Keras, XGBoost, LightGBM, and CatBoost for building classific… | 36 | 1756 | maintenance |
| enzoampil/fastquant fastquant is a Python library that makes backtesting and optimizing trading strategies accessible with as few as 3 lines of code. It also p… | 32 | 1756 | maintenance |
| gaowenliang/imu_utils A ROS package written in C++ that analyzes IMU performance by computing Allan variance from stationary sensor data. It estimates gyroscope … | 62 | 1740 | maintenance |
| OpenNE OpenNE is an open-source Python toolkit for network embedding (graph representation learning) that unifies training and testing interfaces … | 32 | 1705 | maintenance |
| mcdallas/wallstreet Wallstreet is a Python 3 library for monitoring and analyzing real-time stock and option data, with quotes sourced from Google Finance or Y… | 32 | 1696 | maintenance |
| bytedance/bitsail BitSail is ByteDance's open-source distributed data integration engine built on Flink, supporting batch, streaming, and incremental data sy… | 10 | 1674 | maintenance |
| topepo/caret caret (Classification And Regression Training) is an R package providing a unified interface for training, tuning, and evaluating classific… | 64 | 1669 | maintenance |
| datamllab/tods TODS is a full-stack automated machine learning system for outlier detection on multivariate time-series data, developed by DATA Lab at Ric… | 32 | 1667 | maintenance |
| Coder-Yu/QRec QRec is a Python framework built on TensorFlow 1.x for quickly implementing and evaluating recommender system models. It ships with many st… | 32 | 1640 | maintenance |
| dbrojas/optlib A Python library for pricing financial options using closed-form solutions like Generalized Black-Scholes, Asian options, spread options (K… | 32 | 1635 | maintenance |
| kevinschaich/mintable Mintable is a free, open-source CLI tool that automates personal finance tracking by aggregating account balances and transactions from ban… | 23 | 1632 | maintenance |
| jaybaird/python-bloomfilter pybloom is a Python module implementing Bloom Filters and Scalable Bloom Filters as a probabilistic set membership data structure. It grows… | 10 | 1620 | maintenance |
| dotnet/infer Infer.NET is a .NET framework for running Bayesian inference in graphical models, also usable for probabilistic programming. It compiles mo… | 70 | 1615 | maintenance |
| python-bonobo/bonobo Bonobo is a lightweight extract-transform-load (ETL) framework for Python 3.5+ that streams data through a directed acyclic graph of plain … | 32 | 1612 | maintenance |
| Fast AutoAugment Official PyTorch implementation of Fast AutoAugment (NeurIPS 2019), which learns image augmentation policies via density-matching search. I… | 32 | 1604 | maintenance |
| iam-abbas/Reddit-Stock-Trends A Python application that scrapes Reddit via the PRAW API to identify trending stock tickers and analyzes their performance with yfinance. … | 32 | 1592 | maintenance |
| lqqyt2423/wechat_spider A Node.js WeChat crawler that uses a man-in-the-middle proxy (AnyProxy) to batch-collect WeChat official account article data, including co… | 72 | 1591 | maintenance |
| jundongl/scikit-feature scikit-feature is an open-source Python feature selection library built on scikit-learn, NumPy, and SciPy. It implements around 40 popular … | 32 | 1588 | maintenance |
| vdaubry/github-awards Git Awards (formerly GitHub Awards) is a web application that ranks GitHub users by programming language and by location (city, country, wo… | 32 | 1576 | maintenance |
| HIPS/Spearmint Spearmint is a Python package for Bayesian optimization that automatically tunes experiment parameters to minimize an objective in as few r… | 32 | 1573 | maintenance |
| san089/goodreads_etl_pipeline An end-to-end ETL pipeline that ingests Goodreads API data into an AWS S3 data lake, transforms it with Spark on EMR, and loads it into a R… | 32 | 1545 | maintenance |
| AxeldeRomblay/MLBox MLBox is a Python automated machine learning (AutoML) library that handles data preprocessing, feature selection, leak detection, and hyper… | 23 | 1534 | maintenance |
| veekun/pokedex A Python library and dataset containing extensive Pokémon game data scraped from the games, powering the veekun.com website. It includes a … | 32 | 1526 | maintenance |
| mlouielu/twstock A Python library and CLI tool for fetching Taiwan stock price data from the Taiwan Stock Exchange (TWSE) and Taipei Exchange (TPEX), includ… | 82 | 1520 | maintenance |
| quantopian/empyrical A Python library of common financial risk and performance metrics such as max drawdown, alpha, beta, and capture ratios, built on NumPy and… | 23 | 1514 | maintenance |
| eBay/tsv-utils A suite of command line utilities from eBay for manipulating large tabular (TSV/CSV) data files, written in D. It provides fast filtering, … | 23 | 1484 | maintenance |
| Ashishgup1/Competitive-Coding A curated collection of C++ templates, algorithms, and data structures for competitive programming contests. It serves as a reusable refere… | 32 | 1463 | maintenance |
| OpnTec/open-spectrometer-hardware An open-source visible-light spectrometer project providing hardware schematics, bill of materials, and Python scripts for a DIY instrument… | 32 | 1459 | maintenance |
| liyaguang/DCRNN A TensorFlow implementation of the Diffusion Convolutional Recurrent Neural Network (DCRNN) from the ICLR 2018 paper on data-driven traffic… | 32 | 1448 | maintenance |
| quandl/quandl-python The official Python client for the Quandl RESTful API, used to retrieve financial and economic datasets as pandas DataFrames. It has been s… | 10 | 1430 | maintenance |
| Backbone.Paginator Backbone.Paginator provides Backbone.PageableCollection, a drop-in replacement for Backbone.Collection that adds pagination and sorting. It… | 10 | 1396 | maintenance |
| glouw/ctl CTL is a header-only, template-like container library for ISO C99/C11 that reimplements C++ STL containers such as vector, list, deque, set… | 23 | 1383 | maintenance |
| nathanmarz/cascalog Cascalog is a Clojure/Java data processing and querying library built on Hadoop, offering a high-level Datalog-like abstraction as a replac… | 32 | 1373 | maintenance |
| PKUJohnson/OpenData OpenDataTools is a Python library that scrapes financial and investment data from various websites and exposes it through simple, easy-to-u… | 32 | 1369 | maintenance |
| zalandoresearch/pytorch-ts PyTorchTS is a PyTorch-based probabilistic time series forecasting library that uses GluonTS as its backend API for loading, transforming, … | 23 | 1369 | maintenance |
| martinsbalodis/web-scraper-chrome-extension Web Scraper is a Chrome browser extension for extracting data from web pages without writing code. Users define sitemaps describing how to … | 32 | 1363 | maintenance |
| yhat/pandasql pandasql is a Python library that lets you query pandas DataFrames using SQL syntax, similar to sqldf in R. It translates SQL queries (SQLi… | 10 | 1346 | maintenance |
| mdipierro/nlib A pure-Python numerical computing library (nlib.py) accompanied by the open book 'Annotated Algorithms in Python', covering linear algebra,… | 62 | 1336 | maintenance |
| lda-project/lda A Python library implementing latent Dirichlet allocation (LDA) topic modeling via collapsed Gibbs sampling, with a scikit-learn-style API.… | 32 | 1314 | maintenance |
| mandiant/ThreatPursuit-VM ThreatPursuit-VM is an open-source Windows-based virtual machine distribution from Mandiant preloaded with tools for threat intelligence an… | 10 | 1304 | maintenance |
| python-streamz/streamz Streamz is a Python library for building pipelines that manage continuous streams of real-time data. It supports complex pipelines with bra… | 75 | 1303 | maintenance |
| rocketlaunchr/dataframe-go dataframe-go is a lightweight Go library providing DataFrame and Series data structures for statistics, machine-learning, and data manipula… | 32 | 1291 | maintenance |
| SelfExplainML/PiML-Toolbox PiML is a Python toolbox for developing, diagnosing, and validating inherently interpretable machine learning models such as GLMs, GAMs, de… | 26 | 1286 | maintenance |
| manu354/cryptocurrency-arbitrage A Node.js cryptocurrency arbitrage opportunity calculator that scans over 800 currencies across 50 markets, comparing prices to find the hi… | 23 | 1284 | maintenance |
| iskandr/fancyimpute A Python library offering a variety of multivariate imputation and matrix completion algorithms such as KNN, SoftImpute, and NuclearNormMin… | 23 | 1280 | maintenance |
| google-research/deduplicate-text-datasets A Rust implementation of ExactSubstr deduplication for language model training datasets, with Python scripts for running deduplication and … | 10 | 1273 | maintenance |
| Trill Trill is a high-performance, single-node, one-pass in-memory streaming analytics engine from Microsoft Research, built on a temporal data a… | 32 | 1271 | maintenance |
| TheEconomist/us-potus-model Code for The Economist's dynamic multilevel Bayesian model to forecast US presidential elections, written in R and Stan. It aggregates stat… | 32 | 1269 | maintenance |
| ycjuan/kaggle-2014-criteo The winning '3 Idiots' solution code for the 2014 Kaggle Criteo Display Advertising Challenge, built around field-aware factorization machi… | 10 | 1255 | maintenance |