Macrokit

Pre-release · Launching Q3 2026

Weak and local LLMs that work like frontier models — on narrow workflows.

Macrokit is an open-source SDK for shipping LLM applications under cloud-API constraints — data residency, compliance, air-gapped networks, or budget.

View on GitHub How it works

The pattern, in 60 seconds

The hard part for weak models is multi-step reasoning. The easy part is routing. Macrokit pushes the hard part offline so cheap and local models can do the routing reliably.

1

Design-time

A strong model (Claude, GPT-4o) solves a workflow once, supervised by a developer, and encodes it as a deterministic, parameterized macro.

2

Runtime

A weak or local model receives a user request and only has to do intent classification — one-shot routing — to the matching macro.

3

Distillation gate

Every session that touched a workflow without a macro must encode one before ending. macrokit gate enforces it. The macro library compounds.

What you get

  • @macrokit/runtime — macro registry, dispatcher, session log, intent router.
  • @macrokit/llm — one transport for OpenAI-compatible providers (OpenAI, DeepSeek, Qwen, OpenRouter, …) plus Ollama; bail-out detector that catches weak-model failure modes before they reach your app.
  • @macrokit/browser — Playwright service with annotated screenshots and DOM action menus. Weak models pick numbered elements instead of estimating coordinates.
  • @macrokit/authoring — defineMacro(), schema helpers, a test harness with recording mode.
  • macrokit CLI — init, lint, and the headline gate command that enforces the distillation discipline.

How it differs

Not an agent framework.
Agent frameworks compete on letting LLMs reason. Macrokit competes by eliminating runtime reasoning. Different philosophy.
Not a model.
BYO-model. Ships adapters for OpenAI-compatible APIs and Ollama out of the box.
Not RPA.
RPA records UI clicks at the pixel level. Macros are recorded at the semantic level — typed tool calls with named arguments — and are diff-reviewable code.
Not a no-code platform.
Authoring a macro assumes a developer plus a strong model in the loop. End users see only the chat interface.

Status

Pre-release. Targeting public launch in Q3 2026. The pattern Macrokit codifies has been running in a private production deployment since early 2026. Macrokit is the vertical-agnostic extraction of that work into a reusable SDK.

The docs site, quickstart, API reference, and reference implementation land at launch. Until then this page is the canonical pointer.