Remote Job Scraper, Data Cleansing, and Notification Pipeline - n8n Workflow

Recruiters and Talent Acquisition: Centralize remote job market data for analysis.
Active Job Seekers: Get real-time alerts for highly specific remote positions.
Developers and Data Engineers: Users looking for a complex n8n workflow example involving heavy data transformation and custom n8n node usage.
Automation Enthusiasts: Anyone needing to implement reliable API scraping and data persistence into n8n templates.

Keeping track of new remote job listings across multiple platforms can be time-consuming. This comprehensive n8n workflow provides a robust solution by automating the entire pipeline. It ensures data quality by utilizing specialized Code n8n nodes to strip out HTML and clean text from job descriptions.

This architecture not only centralizes valuable job data in an Airtable database using an efficient upsert mechanism but also provides immediate notification via the Telegram n8n node. This particular n8n workflow demonstrates best practices in data handling, making it a valuable n8n template for any user dealing with external API data extraction and transformation.

The entire process is initiated by the Schedule Trigger n8n node, ensuring the job fetching runs periodically (e.g., hourly or daily).

1. Data Fetching: The Schedule n8n trigger calls the Remote ok (HTTP Request) n8n node, which connects to the RemoteOK API to pull the latest job listings in JSON format.


2. Initial Cleaning & Structuring: The Cleaning the received input Code n8n node filters out unnecessary metadata and standardizes the primary fields (ID, company, URL, etc.).


3. Deep Text Cleansing: The subsequent Clean text1 and Text-clean Code n8n nodes perform critical data transformation. This custom n8n node logic is designed to remove HTML tags, decode special HTML entities, and normalize whitespace in the lengthy job descriptions, ensuring clean data quality.


4. Data Enhancement: The Salary to string Code n8n node standardizes the salary range fields into a single, readable string for easier use in Airtable and Telegram.


5. Data Persistence (Airtable): The RemoteOK Jobs (Airtable) n8n node uses the job ID to perform an Upsert operation. This prevents duplicate entries while ensuring all job details are updated if they change, making your Airtable base a reliable source of truth.


6. Notification Preparation: The Table to a single message Code n8n node formats the clean, enriched job data into a single, human-readable Telegram message string.


7. Final Notification: Finally, the Telegram n8n node sends the formatted message to the designated Telegram chat, completing the automated alert process. This entire process demonstrates the power of a scheduled n8n workflow.

To deploy this n8n workflow successfully, follow these steps:

1. Import the n8n template: Copy the provided JSON code and import it directly into your n8n instance.


2. Set up Credentials:

1. Configure Airtable Node: Ensure the Base ID and Table ID in the RemoteOK Jobs n8n node match your specific Airtable setup. The column mapping relies on fields like id, company, position, and description.


2. Configure the n8n Trigger: Adjust the Schedule Trigger n8n node to run at your desired interval (e.g., every 4 hours).


3. Activate: Save and activate the n8n workflow. The schedule n8n trigger will handle execution automatically.

Schedule Trigger (n8n trigger): Initiates the entire n8n workflow based on a defined schedule, providing periodic execution.
Remote ok (HTTP Request n8n node): Fetches raw job listing data by executing a GET request against the RemoteOK public API (https://remoteok.com/api).
Cleaning the received input (Code n8n node): Filters metadata and extracts the core job fields, standardizing the data structure for downstream processing.
Clean text1 (Code n8n node): Executes advanced regex and string manipulation to meticulously remove HTML tags and complex encoding from job descriptions.
Salary to string (Code n8n node): Custom logic within this n8n node converts discrete salarymin and salarymax fields into a unified, descriptive text field (salary_string).
RemoteOK Jobs (Airtable n8n node): Performs an Upsert operation, using the job id as the unique identifier to either create a new record or update an existing one, ensuring data integrity.
Table to a single message (Code n8n node): Transforms the structured data into a concise Markdown-formatted message string, ready for immediate delivery.
Telegram1 (Telegram n8n node): Sends the final formatted message to a designated Telegram chat, using the configured Telegram API credentials.