LLMs.txt for Magento 2 — AI Crawler & GEO Generator

LLMs.txt is a Magento 2 module that publishes an llms.txt manifest — a robots.txt for AI crawlers. It serves /llms.txt as a summary, /llms-full.txt with your products, categories, CMS pages and blog as clean Markdown, and an opt-in /llms-products.json for vector-database ingestion.

Make your store legible to AI search

Some AI tools may fetch a site's llms.txt file. This proposed Markdown format gives them a curated summary at /llms.txt. The module also serves a fuller llms-full.txt file, cached per store view, and an optional llms-products.json endpoint. Whether an assistant reads or cites any of these files depends on that assistant.

Composer install · Per-domain licence · Updates via Composer · Ticket support · Clean URLs · No third-party dependencies · Check release-specific Magento and PHP compatibility

The llms.txt standard	A clean /llms.txt that gives AI assistants a curated, readable map of your store.
Refresh timing	The short file is generated on request; the full file is cached per store view and refreshed by cron every six hours.
Three formats	llms.txt (concise), llms-full.txt (full), and llms-products.json (structured product data).
You choose the contents	Include categories, products, CMS pages and blog posts; set your own site description and URL keys.

What you'll use it for

• Publish a site summary — offer tools that choose to fetch the file a readable overview of selected catalogue and site content.
• Describe selected pages — list the product, category and content links you choose; each assistant decides whether and how to use them.
• Feed product data to AI — the JSON file exposes your products (optionally with deep attributes) in a clean, machine-readable form.
• Refresh automatically — the short file reads source data on request, while the full file is cached and scheduled to refresh every six hours.

How it works

What's generated, and where

Three endpoints are served at clean URLs (the URL keys are configurable):

/llms.txt · /llms-full.txt · /llms-products.json

llms.txt is the concise, curated overview — your site description plus links to the content you choose to include. llms-full.txt is the fuller version. llms-products.json is a machine-readable product feed, with an optional deep attribute export for richer detail. You decide whether to include products, categories, CMS pages and blog posts. Output is scoped per store view; the full file is cached and normally refreshed every six hours.

Specifications

Magento	Check release-specific compatibility
PHP	Check release-specific compatibility
Outputs	/llms.txt, /llms-full.txt, /llms-products.json (URL keys configurable)
Includes	Categories, products, CMS pages, blog posts; configurable site description
Products JSON	Structured product data, with optional deep-attribute export
Generation	Short file on request; full file cached per store view with six-hour scheduled refresh
Access control	Configuration permission
Dependencies	None — no third-party libraries
Delivery & licence	Composer install, per-domain licence key, updates via Composer

Works with

Part of the AgenticEcom suite for SEO & Content:

Included in the AgenticEcom Suite.