# soxoj/socid-extractor

⛏️ The extraction engine behind Maigret: turn any profile URL into a structured OSINT record  across 150+ sites

Repository: https://github.com/soxoj/socid-extractor
Canonical: https://ross.abutalabs.com/products/socid-extractor
Homepage: https://socid-extractor.readthedocs.io
Language: Python
License: MIT
License Family: permissive
Topics: socmint, osint, scraping, data-extraction, html-parsing, osint-framework, osint-python, osint-tool, account-extraction, socid
Last push: 2026-08-18T00:02:49+00:00

## Health v2 (maintenance only)
Score: 92/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 98, release rhythm 81, longevity 100
- inputs: {"age_days": 2481, "days_push": 16, "days_rel": 51, "gap_med": 48, "n_releases_24m": 4}
- flags: none
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 1073, forks 118 (observed 2026-08-28T04:03:28.756894+00:00)

## What it is
socid_extractor is a Python library and CLI that extracts structured account metadata and stable internal identifiers (usernames, UIDs, GAIA IDs, etc.) from public profile pages across 130+ platforms. It powers Maigret and returns a flat, normalized dictionary of fields from HTML or API responses without requiring API keys.

## Use cases
- extract account info from a social media profile url
- get stable user ids that survive username changes
- scrape profile metadata from 150+ sites without api keys
- correlate accounts across platforms for osint investigations
- parse profile pages into structured  for pipelines
- find linked social accounts from a profile page

## When to choose
- you need uniform profile extraction across many platforms in Python
- you want stable internal identifiers for cross-site account correlation
- you're building OSINT tooling like Maigret and need a battle-tested extraction engine

## When to avoid
- you need a full username search across sites rather than extraction from a known URL (use Maigret)
- target sites require JavaScript rendering or authentication
- you need a no-code GUI investigation tool

## Facets
- artifact type: library
- maturity: active
- function: web-scraping, parser, nlp, developer-tools
- domain: osint, crawlers, security
- platform: python, cli, cross-platform
- tags: osint, profile-extraction, identity-resolution, html-parsing, account-identifiers, maigret, natural-language-processing

## Member repositories
- soxoj/socid-extractor (main) score 92

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:03:28.756894+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T06:53:38.843897+00:00, confidence not recorded.
  - readme: https://github.com/soxoj/socid-extractor (fetched 2026-08-28T04:03:28.756894+00:00, sha 45ffa862b6c6)
  - registry_pypi: https://pypi.org/pypi/socid-extractor/json (fetched 2026-08-29T12:56:17.820116+00:00, sha 4ef5d1d24f64)
- Data as of 2026-08-30T08:39:29.467469+00:00.