How to collect information about products
API integration. Receiving information directly from retailers. Your system will send requests via the API to the sites of trading platforms, get the necessary data (price, availability, colors, images, delivery terms, etc.) and enter them into your database. This is a simple and convenient method that allows you to get accurate and relevant information.
API integration is not an easy option. We need money and time, and there may be difficulties associated with the specifics of individual sites and / or product categories. Fortunately, recently sites are starting to make listings according to industry standards (retail, insurance, real estate, travel, etc.), this simplifies the task with the integration of API.
It’s worth using this method if most price providers use APIs and are ready to give you access to them. In most cases, you will get access for free, because in this way sellers can increase sales without doing anything. To withdraw the commission will need to connect to the affiliate program of the store, for example, to Amazon Associates. eBay, Alibaba and other large marketplaces also have affiliate programs.
Web scraping. Collecting information through web scanners (or spiders), who with a certain frequency visit pre-selected sites and "scrape" the necessary data for your database. A fairly common method that allows you to collect information from all sites, if their design meets certain criteria (or a spider is configured for this design) and if these sites have not set up protection against spiders (a frequent occurrence).
Web scraping is used where there is no developed market for affiliate marketing (affiliate programs and integration via API). In addition, it can be useful to quickly grow the database to the level of competitors.
Manual addition from retailers feeds. Sellers who do not have an API can provide you with information about their listings as XML and CSV files or enter information manually. If you use XML and CSV files, you will need employees who will transfer data from them to your database. If sellers will enter information themselves, then this will require the appropriate interface.
This approach is used when it comes to products and services with static prices (insurance, loans, digital services) or when the list is made up of experts. The latter option is characteristic where prices are simply not enough. For example, when choosing a credit card, the user will want to know its advantages and disadvantages, whether there are hidden charges or unacceptable additional conditions - an expert opinion is necessary for all this.
Manual add by buyers. A rare method that is used to increase the relevance and accuracy of prices. Usually this function is an element of feedback and serves to identify problems collecting information by other methods. For example, if you used web scraping and some site introduced protection from it. It is important to have people to check the information from users, since this function can be used in competition, for example, to increase the value of competitors' goods.
Required price comparison site features
Listing Comparison and Listing Information Pages. The first is a listing showing prices, short descriptions and small photos. Clicking on the list, the user will go to the detailed description of the product or the seller’s website to make a purchase. The characteristics and product image are taken from the databases where they come in using one of the information collection methods.
Listing can be presented in a variety of ways, but as a rule, it is either a list in the form of a table, like on the Broadband site, or a list in the form of tiles, like on the Shopbot site. The first option is better suited for products where you need to bet on the description, the second - on the appearance.
Search and filters
. There are several ways to implement this feature. The simplest and most popular - search based on keywords and filters by category. To make the listing more convenient, they can add sorting options by price, rating, popularity, and more. So do Skyscanner, Google Shopping,
CompareTheMarket, Skyscanner, Google Shopping.
Google Shopping Search is based on keywords and categories
The second search option is location based. The service shows goods or services on a map within a certain radius (search for people on Tinder
) or within a certain region, city, country (search for gas prices on GasBuddy).
Search function on GasBuddy is tied to a location
The third option works according to the scheme: you fill out a form with requirements, the price comparison site sends a request to the suppliers, who then submit their offers to the site.
This is how Kitchify, Compare IP and Parcel2go work.
Price alert. Allows you to track the change in value for the selected or best products in the listing. It can be subtracted in the form of push-notifications, SMS or email. Some sites provide users with the ability to specify a price limit, at the intersection of which you need to send a notification.
. The ability to track the dynamics of prices within a certain time. You can create the “Search for the cheapest month” or “Compare by month” filters so that users can independently track trends.
Shopbot Price History Feature
Reviews. Studies show
that up to 90% of buyers trust reviews as well as recommendations from friends and acquaintances. At the same time, more than half of online users read 2-4 reviews before making a purchase. Thus, the function "Reviews" is required for price comparison sites. And need some feedback for products and service providers.
Awards. Glasses and badges (TripAdvisor) cashback, gift cards, discount coupons (Pricewatch) and gift distribution motivate people to make more purchases. There can be a lot of such ways to encourage people. The best option is to participate in the draw with a 50/50 probability of reward, even if it is a trifle.
Scan QR code and bar code. Helps buyers compare prices in local stores using a smartphone camera. Implemented on ShopSavvy and BuyVia sites.