Use this powerful n8n workflow to automatically scrape competitor product prices from complex websites using Bright Data's MCP Agent, log the data in Google Sheets, and send notifications.
Download this n8n workflow template and start using it instantly.
E-commerce Managers needing to monitor market prices instantly.
Data Analysts requiring automated competitor intelligence feeds.
Users looking for advanced web scraping n8n templates that handle anti-bot measures.
Automation Specialists interested in leveraging the n8n AI Agent framework with external tools.
This automation solves the critical business problem of maintaining competitive pricing without constant manual monitoring. Modern e-commerce sites often use anti-bot measures, making standard scraping difficult. This specific n8n workflow leverages the power of an AI Agent alongside Bright Dataโs Mobile Carrier Proxy (MCP) to reliably access and extract product data, even from heavily protected sites like Nike.
By deploying this n8n automation, you set up a robust, repeatable process triggered by an n8n trigger. The extracted, structured data is immediately stored in Google Sheets for analysis and decision-making, ensuring you never miss a critical price change from your competition. This advanced n8n node combination represents a highly effective, low-maintenance pricing intelligence solution.
The entire process is controlled by the central n8n workflow, starting with a scheduled n8n trigger.
๐
Run weekly Check Schedule n8n trigger initiates the automation every Monday at 9 AM. It passes control to the ๐ Product Page URL n8n node, which defines the specific competitor URL (e.g., a product category page) to target.๐ค Scrape Competitor Prices (MCP Agent) LangChain Agent takes the URL and a specific instruction (scrape all the details about every product). This sophisticated n8n node uses the connected OpenAI Chat Model for reasoning and the MCP Client (Bright Data) tool to perform the actual web browsing and data extraction.Auto-fixing Output Parser and Structured Output Parser n8n nodes, guaranteeing that the potentially messy, unstructured scrape results are converted into clean, standardized JSON data.๐งน Format Products for Google Sheets Code n8n node processes the array of products from the scraper. It splits the array, ensuring that each individual product (name, price, description, url) becomes a separate item in the n8n workflow for easier handling by Google Sheets.๐ Save to Google Sheets n8n node takes these individual items and appends them as new rows to the designated 'Competitor Pricing Log' spreadsheet.๐ง Notify: Prices Logged in Sheet Gmail n8n node sends a notification email, confirming the successful capture and logging of the latest competitor pricing data.To deploy this n8n template, follow these steps:
๐ Save to Google Sheets n8n node, select the correct Document ID and Sheet Name, ensuring your target sheet has columns matching the expected data fields (Name, Price, Description, URL).๐ Product Page URL n8n node to match the specific competitor page you wish to track. ๐
Run weekly Check (Schedule Trigger): This n8n trigger starts the workflow based on a defined time interval. Key configuration: Set to run weekly.
๐ Product Page URL (Set n8n node): Defines the static input URL used by the scraping agent. Key configuration: Sets the variable url to the target competitor product page.
๐ค Scrape Competitor Prices (MCP Agent) (Agent n8n node): The core intelligence, instructing the AI to use the MCP tool to scrape product details from the input URL. Key configuration: Uses gpt-4o-mini and is connected to the MCP Client tool.
OpenAI Chat Model (Language Model n8n node): Provides the language model backend for the Agent's decision-making and tool-use planning.
MCP Client (Tool n8n node): Integrates Bright Data's Mobile Carrier Proxy service, allowing the Agent to reliably perform web scraping on complex, dynamic websites.
Auto-fixing Output Parser (Parser n8n node): Ensures that the data scraped by the Agent conforms to the required structured JSON format, increasing data reliability.
๐งน Format Products for Google Sheets (Code n8n node): Transforms the single JSON item containing an array of products into multiple n8n items, one per product, suitable for batch insertion into the Google Sheets n8n node. Key configuration: Custom JavaScript to iterate and reformat the output array.
๐ Save to Google Sheets (Google Sheets n8n node): Writes the clean, formatted product data to the specified log sheet. Key configuration: Operation set to append, mapping fields like Name, Price, and URL.
Automate Gmail organization using this powerful n8n workflow. It leverages an OpenAI Text Classifier n8n node to instantly sort emails into categories like High Priority, Promotions, and Finance, ensuring efficient inbox management.

Automate mass WhatsApp group joining using a list of invitation codes stored in Google Sheets. This n8n workflow uses the Evolution API to manage groups and track join status.

Use this robust n8n workflow to automatically synchronize your Meta Threads posts, including text and media, into a structured Notion database, ensuring persistent archiving.

Implement a self-improving AI prompt optimization loop (OPRO/DSPy) within n8n. This powerful n8n workflow automatically evaluates and refines system prompts to achieve high accuracy.

Use this robust n8n workflow to automatically monitor specified Reddit subreddits, filter announcement posts, extract direct image URLs using a custom n8n node, and mirror the content instantly to a Discord channel.

Use this powerful n8n workflow to automatically analyze unread Gmail PDF attachments with GPT-4o-mini, rename them descriptively using an AI Agent, and save them cleanly to Google Drive. Explore useful n8n templates for AI file management.

Building AI Agents and Automations | Growth Marketer | Entrepreneur | Book Author & Podcast Host If you need any help with Automations, feel free to reach out via linkedin: https://www.linkedin.com/in/yaronbeen/ And check out my Youtube channel: https://www.youtube.com/@YaronBeen/videos







































