BUSINESS CHALLENGE

Develop an application to analyze photos made by a drone while flying over rice fields. Count the number of plants that have sprouted on the plots in the photo.

SOLUTION

The IBA Group team implemented image processing algorithms to accurately calculate the number of objects located on them. For end users, we created an application that processes photos, determines the number of plants on them and generates reports in *.csv and *.pdf formats.

Application algorithm:

• Create a polygonal image of the region of interest.
• Download satellite image for it (requires Internet connection).
• Take a calibration photo (taken at the desired measurement height containing two highly visible objects placed on the ground at a distance of 1 m from each other).
• Take a photo above the field for measurements.
• Perform calibration procedure using the calibration image.
• Generate report.

OUTCOME

Thanks to the application, the customer can receive reliable information about the state of rice fields using drones. The project is continuously improving.

Background

Manufacturers, distributors and retailers sell the same product groups on the same shelves. Market actors need timely and reliable information about the actions of competitors and their own situation against their background. Assessment is performed manually by merchandisers, sales representatives, supervisors and marketers. This process involves a lot of manual labor and is affected by human factor. Marketers do not have time to process all the photos and reports. As a result, decisions are made based on incomplete data.

Business Challenge

The Customer desires to monitor the performance of merchandisers and analyze shelf display information.

Solution

The goods are laid out at the store by store employees or merchandisers. They take photos of product display (realograms) and send them for verification. The IBA Group team obtained several thousand of these photos. Each of them was checked manually, and as a result, almost 100,000 items were marked.

In the course of work, the team faced challenges that needed to be addressed:

• select for analysis only those photos that contain equipment with goods;
• determine the type of equipment correctly;
• subdivide similar products within one category (for example, bottles of water of different sizes);
• process photos of poor quality: light-struck, cropped and with other defects;
• develop a separate process for the introduction of new products;
• come up with a way to merge several photos of long shelves into one using a neural network.

Our experts coped with all the difficulties and developed a SaaS solution to assess photos of realograms:

1. Merchandisers and supervisors upload photos of stock keeping units (SKUs) on the shelves.
2. Photos are uploaded to the IBA Group data center instead of the company’s local server.
3. AI module Plano Checker analyzes the photo, evaluates its quality, searches for SKUs and classifies them according to predetermined scenario. If necessary, several photos are merged into one.
4. Plano Checker module saves reports on the server.
5. Users may access the reports and analytics through a web browser immediately after uploading a photo.

Outcome

Goods Checker shows which goods are in their place on the shelves and which need to be rearranged. It helps merchandisers to work more efficiently and earn bonuses.

The system uses computer vision to determine if the photo shows the equipment containing the product, what kind of equipment it is, and also what types of SKUs are placed on it. Recognition accuracy ranges from 90% to 98% depending on the category of products and the quality of photos.

Automation leaves time to analyze the information obtained. The solution allows tracking surges in demand and actions of competitors 24/7. The system processes data and generates analytical reports for the needs of each manager.