Extract Amazon Bestseller Data with Bright Data and Gemini LLM - n8n Workflow

Market researchers who require real-time, structured data on top-selling products.
E-commerce analysts looking to monitor competitive pricing and trends on Amazon.
Developers needing a robust, scalable web scraping solution integrated into an n8n workflow.
Users interested in leveraging the Google Gemini n8n node for advanced information extraction tasks.

This automation provides a robust solution for extracting high-quality, structured data from complex e-commerce sites like Amazon. Traditional scraping methods often fail due to anti-bot measures, but this n8n workflow successfully integrates with Bright Data's Web Unlocker for reliable data acquisition. The real value is added by the subsequent step, where the raw, potentially messy HTML is processed by the Google Gemini n8n node. This AI component uses a strict JSON schema to clean, validate, and standardize the product listings, transforming raw scrape data into actionable business intelligence. This specific n8n template demonstrates advanced AI/scraping synergy, offering tremendous efficiency gains.

The entire process is initiated by the manual n8n trigger, designed for testing or scheduled execution.

1. URL Setup: The 'Set Amazon URL with the Bright Data Zone' n8n node initializes the execution by defining the specific Amazon Best Sellers URL (e.g., Electronics category) and setting the necessary Bright Data zone parameter (webunlocker1).


2. Data Fetch: The 'HTTP Request to fetch the Amazon Best Seller Products' n8n node contacts the Bright Data API, using the previously defined URL and credential headers, to perform the actual web scraping and retrieve the raw product listing HTML data.


3. LLM Preparation: The raw data is passed to the 'Structured Data Extractor' n8n node. This node is powered by the 'Google Gemini Chat Model' n8n node (specifically using gemini-2.0-flash-exp).


4. Structured Extraction: The extractor uses a detailed JSON Schema defining fields like rank, title, rating, and producturl. It instructs the LLM to extract only the relevant product information from the raw text, resulting in a perfectly formatted, structured JSON object. This is a crucial step in this n8n workflow.


5. Notification: Finally, the 'Webhook Notifier for structured data extractor' n8n node sends the complete, cleaned, structured JSON output (the Amazon Bestsellers list) to an external webhook URL for immediate use or integration.

To deploy this powerful n8n workflow, follow these steps:

1. Import: Copy the provided n8n workflow JSON code and paste it into your n8n instance using the 'New' -> 'Import from JSON' option.


2. Bright Data Credentials: Configure the 'HTTP Request to fetch the Amazon Best Seller Products' n8n node. You will need to set up a 'Header Auth' credential type containing your Bright Data API key.


3. Google Gemini Credentials: Configure the 'Google Gemini Chat Model' n8n node with your appropriate Google Gemini (PaLM) API key.


4. Configuration Check (Crucial): Open the 'Set Amazon URL with the Bright Data Zone' n8n node and verify that the url and zone parameters match your scraping requirements.


5. Webhook Update: Open the 'Webhook Notifier for structured data extractor' n8n node and replace the placeholder URL with your actual desired receiving endpoint (e.g., a service that accepts structured data).


6. Activation: Ensure the n8n workflow is active, and click the 'Test workflow' trigger to confirm functionality.

When clicking ‘Test workflow’ (n8n trigger): The starting point of the n8n workflow. Used for manual execution or testing the subsequent steps.
Set Amazon URL with the Bright Data Zone (n8n node): A core logic n8n node that defines two critical variables: the Amazon URL to scrape and the Bright Data zone identifier (web_unlocker1) used for bypassing anti-bot measures.
HTTP Request to fetch the Amazon Best Seller Products (n8n node): Executes the scraping request to the Bright Data API. It uses generic HTTP header authentication linked to your Bright Data API key.
Google Gemini Chat Model (n8n node): Provides the large language model backend (models/gemini-2.0-flash-exp) necessary for advanced natural language processing and understanding raw text input. This n8n node enables the extraction logic.
Structured Data Extractor (n8n node): This specialized Langchain n8n node takes the raw HTML output from the Bright Data request and uses the Gemini model, guided by a sophisticated JSON schema, to reliably extract structured fields like product title, rank, rating, and URLs.
Webhook Notifier for structured data extractor (n8n node): The final action n8n node, sending the completely processed, structured JSON data payload to an external webhook endpoint for integration into downstream systems.