Today we will show how to utilize a data extraction tool to scrape a website like Autotrader!
Autotrader is the best website to get car details from both dealerships and private sellers.
If you're having a car franchise, working in the auto business is having competition because clients have a high swapping cost. Gaining a modest advantage is significant to make a sale.
If you're a customer, finding the right car that fits your requirements and rate can be a boring procedure with so many dealerships and cars available.
In all cases, you can utilize a free data scraping tool like Web Screen Scraping to extract Autotrader data to assist you to make the correct decisions.
Today, we are going to scrape Autotrader data and scrape data like highlights, models, prices, specs, and many more.
Scraping Information from Autotrader
We are going to scrape car data from Autotrader for 2020 Honda vehicles here in Toronto. We scrape details like highlights, models, Image URLs, specs, price comparisons to price and market. We are going to export it in CSV, JSON, and Excel format.
Getting Started
- You need to first install and download Web Screen Scraping for free. We will utilize this data scraping tool for this plan.
- Once Web Screen Scraping is open, you need to click on “New Project” and utilize the URL from the Autotrader outcome page. The page will now be reduced inside the application.
Extracting Data Behind Pop-up Windows
Let your website gets load first in the app, after that, you will see an Autotrader pop-up asking you to recall your search, you require to tell Web Screen Scraping so that it doesn’t ruin your project.
- To execute this, utilizing the select command, you need to click on the "got it" button on the pop-up to choose it. You can retitle this command to something more expressive by clicking on the command itself. Let's name it "closePopup".
- You need to click on the button next to "Select & Extract closePopup", and select the Click command from the toolbox.
Extracting Car Details on the Results Page
- You need to click on plus (+) sign next to the page choose and select the select command.
- You need to click on the name first of the first classic on the listing. It will be painted in green to specify it has been choosing. On the left sidebar, rename your selection to “car model”.
- Web Screen Scraping will now recommend other data you need to be scraped in yellow. You need to click on the second classic on the list to choose them. All models on the first page will be displayed in green now. You are now gathering the URL and name lists of the models.
- Now let’s scrape Autotrader data like location, price, price comparison, and image URL to the market. To do this, you will require doing a relative choose command. Start by clicking on the (+) sign next to your car model choices and selecting the Relative Select command.
- Using the Comparative Select command, you need to click on the model of the first car which is tinted in orange, and then on its rates. An arrow will display to show the suggestion you’re making.
- You may have to reprise this procedure for another item to fully train the web scraper. On the left sidebar, rename your selection to “price”.
- Repeat steps 4-6 to pull more information for each Car. In such a case, we will also pull the location; image URL, price comparison and, description of the market value.
Scraping More Car Information from Every Car Listing
Web Screen Scraping scrapes data from web pages like price and names but let's scrape specs and features of the authorization website if they have one.
We will require telling Web Screen Scraping to click on each listing and scrape what data we want.
- Click on the (+) sign next to your “car model” choose and select the Click command.
- A pop-up will display asking you if this is a “next page” link. Click on “no” and enter a title for this template. We will call it “car listing”. You will now be taken to the model of the first listing on the page.
- The car page will reduce in a new browser tab and you will be able to do your first choice of data to scrape. In this situation, we will select the specs and highlights of the dealership and car website.
- Click on the (+) sign of the “page” and select the command and you will be able to make new commands and click on more information to scrape. Scroll down pending you see “specifications” and click one of the specific labels like the kilometers of the car.
- Now make a comparative select command and scrape data the specs information.
- Reprise the former step to scrape financing highlights, dealership, and payments website. Your car listing pattern should look like this:
Adding Pagination
Now Web Screen Scraping is scraping the data and results page from each listing on the first page. But let's scrape details from various pages.
- Return to your main_template utilizing the left-hand-side tabs. Utilize the browser tabs to go back to the search outcome page.
- Click on the (+) sign which is next to your “page” choosing and selecting the Select command. Scroll to the lowest of the page and click on the 1st page. Retitle your selection to “current page”.
- Click on the (+) next to your current_page click and selection on the comparative select command. Now click on the current page (1) and click on the second page (2) to make the relation. Let's retitle this relative select command to "next_page".
- Click on the (+) sign which is on “next_page” select and choose the Click command.
- A pop-up will perform asking you if this is a “next page” link. Click on “Yes” and enter the digit of other pages you would like to extract. In such a case, we will extract 5 more pages for this project. Be sure to select "uses AJAX".
Running Our Data Scraping Project
Now it's time for the best part, run your data scraping project! You need to click on the green “Get Data” button.
On the shown screen, you can test, schedule, and run your project. If you need to constantly get the up-to-date data scraped on a weekly or daily basis, the schedule option allows you to.
Conclusion
You’re a client or a car dealer; you can utilize our free data scraping tool to extract websites like Autotrader to assist you to make the correct decision. The best price to sell your vehicle or to find the finest vehicle within your specific requirements and price.
If you are looking for the best Autotrader Data Scraping Service, then you can contact Web Screen Scraping for all your queries.
Comments
Post a Comment