Web Scraping + AI Webinar Replay

Web scraping is the automated extraction of data from any webpage or website. It is a powerful tool for gathering information from the internet, which can then be used for various purposes like market research, lead generation, and competitive analysis.

Our latest webinar demonstrates how anyone can carry out advanced scraping with Hexomatic and AI tools.

Here is the replay of the webinar for you. You can also find the tutorial written below the webinar:

Setting Up Your Scraping Environment with Hexomatic

Step 1: Understand the Platform

Hexomatic is a cloud-based platform that simplifies the process of web scraping by providing tools to automate the scraping process without the need for manual coding. 

Here are some of its awesome features: 

– User-friendly interface: Hexomatic has an intuitive interface for users of varying technical proficiencies. Whether you’re a beginner or a seasoned expert, you can kickstart your data scraping efforts within minutes.

– Cloud-based operation: Operate in the cloud with Hexomatic, enabling you to automate scraping tasks and access pre-configured automations from any location.

– Pre-made automations: Access a repository of over 100 pre-built automations tailored for sales, marketing, and research tasks. These ready-to-deploy automations streamline workflows, enhancing efficiency and productivity.

– Simplified scraping: Hexomatic simplifies the process with user-friendly recipes designed for popular websites. No coding or intricate configuration is necessary – simply select your desired data and let Hexomatic handle the rest.

– Integration with ChatGPT: Use the power of our ChatGPT integration for advanced insights and analysis.

Step 2: Identify the Target

For this tutorial, let’s assume we are interested in scraping a bookstore website like Forbidden Planet, which has a structured layout that includes books and collectibles. 

The first step in scraping is to identify the catalog page00987 that lists all the items you want to scrape. Then, we want to scrape a single product page, which we will later use to scrape all the product pages of the website.

Step 3: Create a Scraping Recipe for a Product Page

Head over to the dashboard of Hexomatic and create a new scraping recipe. Start by picking a single product page to understand the structure of the data.

Copy the URL of the product page and paste it into the relevant field. Then click on the Preview button and start selecting the elements you want to scrape.

Click on the element you want to grab and choose the “Select single” option. Select all the data points you want to scrape, such as the book title, price, and description.

Don’t forget to specify the type of each element:

• -Text
• -Numbers
• -Link URLS
• -Source URLS (for example image URLs)
• -HTML tags
• -Email addresses
• -Phone numbers
• -Dates

Save the scraping recipe and move on to the next step!

Step 4: Create a Scraping Recipe for the Listing Page

Now we need to grab the URLs of all the products from the listing page to scrape all of the product pages by combining this scraping recipe with the one we’ve created before.

Simply copy the URL of the listing page and start creating a new recipe by pasting it in the relevant field. 

Then, click on the name of any product and choose the “Select all” option. Choose Link URL as your element type. 

Save the scraping recipe and let’s create a workflow!

Step 5: Create a Workflow

Head over to the Hexomatic dashboard and create a new blank workflow.

From the right side of your screen, select the product listing scraping recipe, then add the scraping recipe we created for a single page.

Choose the URL as the source.

Now you can run the workflow and wait for the results. You can download the latter in your preferred file format once the results are ready.

Step 6: Use AI for Content Creation

With Hexomatic, you can integrate AI tools like ChatGPT to generate marketing content based on the descriptions scraped from the bookstore.

A key benefit of this integration is the elimination of manual copy-pasting. With Hexomatic, you can set up a single prompt that automatically applies to each product scraped from the website.

Simply add the ChatGPT automation from the right side of the screen, choose the source, and add a custom prompt.

For this tutorial, we’ve used a prompt to create a short Instagram post for each scraped product.

Hexomatic not only scrapes valuable information within seconds but also serves as a great AI assistant. It can handle a wide array of tasks, including summarizing texts, conducting marketing research, crafting social media updates, writing blog articles, and more.

The opportunities are endless with Hexomatic. Try it yourself and see how much time you can save with it!

---

Automate & scale time-consuming tasks like never before