Data-Driven SEO Content Brief Generation using AI and Web Scraping - n8n Workflow

SEO Managers who need scalable solutions for generating content outlines.
Content Strategists looking to automate competitive analysis.
Agencies requiring quick, data-validated content briefs.
Anyone interested in advanced web scraping and AI capabilities within an n8n workflow.

Creating high-ranking content requires meticulous analysis of existing search results (SERP). Manually performing this audit for every keyword is time-consuming. This specialized n8n workflow solves this by completely automating the competitive research phase.

Using the power of Bright Data for reliable web scraping and high-performance LLMs (via OpenRouter), the n8n workflow starts with a single keyword and returns a comprehensive, strategic content brief. This brief not only identifies the search intent and core topics but also detects crucial content gaps, providing a definitive H2 outline designed to help your content outrank the current leaders. This sophisticated use of an n8n template transforms hours of manual labor into an instant, data-validated output.

This powerful n8n workflow operates in distinct phases:

1. Trigger and SERP Capture: The automation is initiated by the When chat message received n8n trigger, where the user inputs the target keyword. The workflow immediately uses the Bright Data n8n node (Google SERP) to scrape the top 10 results from Google.


2. Data Structuring: A Code n8n node (extract url) converts the SERP organic results into individual items, passing each URL down the pipeline.


3. Individual Page Scraping: The Loop Over Items n8n node iterates through each link. Another Bright Data n8n node (Access and extract data...) uses a Web Unlocker to reliably scrape the full HTML content of the competing page.


4. Cleaning and Extraction: Specialized Code n8n nodes clean the raw HTML (removing unnecessary elements like scripts and navigation) and then structurally extract data points such as page titles, meta descriptions, H1-H6 headings, and total word count.


5. Synthesis and Aggregation: An LLM (analyse site) summarizes the content of each page. All extracted data for all ten competing pages is then collected by the Aggregate n8n node.


6. Strategic Analysis: The core of the automation, the Analysis n8n node (a LangChain Chain LLM), takes the entire dataset (keyword + 10 synthesized content summaries) and asks the LLM to perform a strategic audit. This audit determines search intent, mandatory topics, and content differentiation strategies, outputting the result in a highly structured JSON format.


7. Final Output: A final LangChain n8n node (Format Output) takes the structured JSON and formats it into a clean, professional Markdown report, which is then instantly delivered back to the user via the chat interface using a Respond to Chat n8n node.

To deploy this comprehensive n8n template, follow these steps:

1. Import the n8n Workflow: Copy the provided JSON data and import it directly into your n8n instance via the Workflows section (New > Import from JSON).


2. Bright Data Credentials: This n8n workflow requires valid Bright Data credentials to perform the SERP and web page scraping. Set up a connection named 'BrightData Inforeole' (or update the credential reference in the Bright Data nodes).


3. OpenRouter Credentials: The AI analysis leverages OpenRouter (which can connect to high-quality models like GPT-4o or GPT-5-nano). You must create an OpenRouter API credential named 'OpenRouter PrestaM' (or similarly update the credential references in the OpenRouter Chat Model n8n nodes).


4. Activate the Trigger: Since the When chat message received is the initiating n8n trigger, ensure the workflow is active and access the provided public webhook URL to interact with the SEO Content Strategist assistant.

This advanced n8n workflow utilizes several specialized n8n node types:

When chat message received (LangChain Chat Trigger): Acts as the primary n8n trigger. It initiates the workflow upon receiving a user's target keyword input.
Google SERP (Bright Data n8n node): Executes a Google search query for the input keyword, returning the top 10 organic results in JSON format.
Access and extract data from a specific URL (Bright Data n8n node): Utilizes the Web Unlocker service to reliably scrape the full, clean HTML content of each target URL, bypassing anti-bot measures.
Code (extract url, clean html, extract html1): These custom n8n node scripts are essential for data preparation: they flatten the SERP results, clean the raw HTML (removing scripts, navigation, etc.), and use regex to extract key structural SEO data (headings, word count).
Loop Over Items / Aggregate (n8n node): Manages the iteration process, ensuring every URL is scraped, analyzed, and finally collects all the disparate data points from all 10 scraped pages into a single item for the final AI analysis step.
Analysis (LangChain Chain LLM n8n node): The core intelligence n8n node. It uses a detailed SEO prompt and external LLM (OpenRouter) to perform strategic analysis on the aggregated data, determining search intent, content gaps, and structural requirements, enforced by a rigorous JSON output structure.

• Format Output (LangChain Chain LLM n8n node): This final processing n8n node transforms the complex JSON output from the analysis phase into a highly readable, client-ready Markdown content brief.