Generate AI-Ready llms.txt Files from Screaming Frog Website Crawls
23 nodes · textClassifier, lmChatOpenAi, filter, summarize, form, extractFromFile
- Engine
- n8n
- Nodes
- 23
- Trigger
- scheduled/triggered
- Source file
- 1791_Filter_Summarize_Create_Triggered.json
Workflow flow
OpenAI Chat Model
@n8n/n8n-nodes-langchain.lmChatOpenAi
upload file anywhere
NoOp
Form - Screaming frog internal_html.csv upload
Form
Extract data from Screaming Frog file
ExtractFromFile
Set useful fields
Set
Filter URLs
Filter
Text Classifier
@n8n/n8n-nodes-langchain.textClassifier
No Operation, do nothing
NoOp
Set Field - llms.txt Row
Set
Summarize - Concatenate
Summarize
Set Fields - llms.txt Content
Set
Generate llms.txt file
ConvertToFile
12 steps · flows top to bottom, branches left to right
Browse by integration
Browse all integrations →Import into n8n
- Download the n8n JSON file (full or sanitized).
- In n8n: Workflows → Import from file.
- Open each node and reconnect credentials to your accounts.
- Test with manual execution before enabling triggers.
Sanitized JSON removes credential IDs — safer for sharing. Flow graph JSON is OpenRuna's lightweight format for diagrams and other tools, not n8n import.
Overview
Free n8n workflow: Generate AI-Ready llms.txt Files from Screaming Frog Website Crawls. 23 nodes across textClassifier, lmChatOpenAi, filter, summarize, form, extractFromFile, convertToFile, with a downloadable JSON and a visual flow diagram on OpenRuna.
What this workflow does
This n8n workflow, "Generate AI-Ready llms.txt Files from Screaming Frog Website Crawls", wires together textClassifier, lmChatOpenAi, filter, summarize, form, extractFromFile, convertToFile in 23 nodes. 23 nodes · textClassifier, lmChatOpenAi, filter, summarize, form, extractFromFile A scheduled/triggered entry point kicks it off, and each node passes data to the next until the run completes. OpenRuna shows the full flow diagram, an integration breakdown, and a one-click JSON export for n8n's "Import from file". Use it to learn integration patterns, fork it for your own use case, or deploy it quickly after reconnecting credentials.
Use cases
- Fork it to add error handling, retries, or a notification step without designing the 23-node flow from scratch.
- Benchmark it against your current textClassifier integration to spot missing steps or redundant nodes.
- Import "Generate AI-Ready llms.txt Files from Screaming Frog Website Crawls" into n8n, reconnect credentials for textClassifier, lmChatOpenAi, filter, summarize, form, extractFromFile, convertToFile, and run the same automation in your own workspace.
- Use it as a starting template when wiring textClassifier, lmChatOpenAi, filter, summarize, form, extractFromFile, convertToFile — adjust node parameters to your accounts and record IDs.
Example output
Imported into n8n, "Generate AI-Ready llms.txt Files from Screaming Frog Website Crawls" exposes 23 configured nodes. Trigger type: scheduled/triggered. Integrations: textClassifier, lmChatOpenAi, filter, summarize, form, extractFromFile, convertToFile. Reconnect the textClassifier credential first, then walk the remaining nodes top to bottom. Run it once in test mode to verify any branch logic (Switch/IF nodes) before enabling production triggers.
Tips by platform
Claude
Ask Claude to turn the "Generate AI-Ready llms.txt Files from Screaming Frog Website Crawls" JSON into a plain-English runbook, node by node. It can flag where textClassifier rate limits or missing retries might bite before you go live.
ChatGPT
Drop the workflow JSON or this OpenRuna page URL into ChatGPT and ask for a step-by-step runbook: triggers, branches, and which fields to customise for textClassifier, lmChatOpenAi, filter, summarize, form, extractFromFile, convertToFile. Handy for onboarding teammates new to n8n.
Cursor
In Cursor, ask Agent mode to parameterise "Generate AI-Ready llms.txt Files from Screaming Frog Website Crawls" — extract textClassifier IDs and secrets into environment variables without changing the 23-node structure.
Frequently asked questions
- How do I import "Generate AI-Ready llms.txt Files from Screaming Frog Website Crawls" into n8n?
- Click Download n8n JSON on this page, then in n8n choose Workflows → Import from file and select the downloaded file. Reconnect credentials on each node — the export carries credential IDs from the original author's instance, not working secrets.
- Which integrations does "Generate AI-Ready llms.txt Files from Screaming Frog Website Crawls" use?
- It uses: textClassifier, lmChatOpenAi, filter, summarize, form, extractFromFile, convertToFile. The flow diagram above shows how each service connects across the 23 nodes. Filter OpenRuna by integration to find related workflows and tools.
- Can I import a sanitized export without credentials?
- Yes. Use "Download sanitized JSON" to strip credential references before sharing internally. You will still add your own textClassifier and lmChatOpenAi credentials in n8n after import.
- What trigger type does "Generate AI-Ready llms.txt Files from Screaming Frog Website Crawls" use?
- Trigger type: scheduled/triggered. After import, confirm the trigger node (webhook, schedule, or app event) matches your environment, then activate the workflow when you are ready to run it.
- Is "Generate AI-Ready llms.txt Files from Screaming Frog Website Crawls" free to use?
- OpenRuna catalogs community n8n workflows under open licenses. Check the source corpus link for the original license; commercial use may require verifying the third-party API terms for textClassifier, lmChatOpenAi, filter, summarize, form, extractFromFile, convertToFile.
Related resources
- Agent
PraisonAI
24/7 AI employee team for automating complex challenges. Low-code multi-agent framework with handoffs, guardrails, memory, RAG, and 100+ LLM providers
- Agent
Prompt Optimizer
AI prompt optimization tool with multi-round iterative improvements, dual-mode optimization for system and user prompts, and multi-model support. Available as web app, desktop app, Chrome extension, and Docker deployment. AGPL-3.0 licensed
- Agent
Archon
Workflow engine for deterministic AI coding agents. Define development processes as YAML workflows (planning → implementation → validation → review → PR) with isolated Git worktrees for parallel execution. MIT licensed
- Agent
A2A Protocol
Agent2Agent (A2A) open protocol enabling communication and interoperability between opaque agentic applications. Donated to Linux Foundation by Google with 50+ technology partners. Apache 2.0 licensed
- Agent
CAMEL
First and best multi-agent framework for building scalable agent systems. Apache 2.0 licensed with extensive tooling for agent communication and task automation
- Agent
Neuron AI
PHP Agentic Framework for building production-ready AI driven applications. Connect components (LLMs, vector DBs, memory) to agents that can interact with your data. MIT licensed
- Agent
smolagents
Lightweight agent framework centered on tool use and code-executing workflows
- Agent
Supermemory
Memory API and app for AI agents that provides fast, scalable, context-aware storage and retrieval across projects. MIT licensed
