# Anemll/Anemll

Artificial Neural Engine Machine Learning Library

Repository: https://github.com/Anemll/Anemll
Canonical: https://ross.abutalabs.com/products/anemll
Language: Python
License Family: other
Last push: 2026-03-10T21:53:23+00:00

## Health v2 (maintenance only)
Score: 61/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 71, release rhythm 58, longevity 43
- inputs: {"age_days": 605, "days_push": 176, "days_rel": 200, "gap_med": 36.0, "n_releases_24m": 7}
- flags: prerelease_only, no_license
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 1647, forks 77 (observed 2026-08-28T04:05:16.508573+00:00)

## What it is
ANEMLL is an open-source Python library and toolchain for converting and running large language models on the Apple Neural Engine (ANE) via CoreML. It includes conversion scripts, a chat CLI, and a reference iOS/macOS/visionOS chat app for on-device LLM inference.

## Use cases
- convert llama or qwen models to run on apple neural engine
- run llms locally on iphone or mac with coreml
- benchmark ane inference against huggingface models
- reduce coreml model size with weight deduplication
- evaluate converted models with lm-evaluation-harness
- build an ios chat app with on-device llm

## When to choose
- you want to deploy small-to-mid LLMs on Apple Silicon or iOS devices using the ANE
- you need a conversion pipeline from HuggingFace models to CoreML with chunking support
- you want low-power on-device inference instead of cloud APIs

## When to avoid
- you target NVIDIA/AMD GPUs or non-Apple hardware
- you need the very latest model architectures not yet supported
- you require a permissively licensed dependency and cannot accept a missing license

## Facets
- artifact type: library
- maturity: active
- function: machine-learning, llm-inference, llm-training, compiler
- domain: machine-learning, large-language-models, apple-ecosystem, developer-tools
- platform: python, cross-platform
- tags: apple-neural-engine, coreml, model-conversion, on-device-inference, tensor-processors, llm-porting, chat-app, macos, ios, swift

## Member repositories
- Anemll/Anemll (main) score 61

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:05:16.508573+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T03:45:16.334530+00:00, confidence not recorded.
  - readme: https://github.com/Anemll/Anemll (fetched 2026-08-28T04:05:16.508573+00:00, sha ee3f758aeda0)
- Data as of 2026-08-30T08:39:29.467469+00:00.