Solution overview discussed two loss scenarios in which Malong RetailAI Protect can reduce retail loss: mis-scans and ticket switching. A review of the key components of the solution enables us to better understand how the components of the solution work together to detect these scenarios. A high definition camera monitors retail items as they are scanned. The Malong AI model uses this video stream and the UPC barcode for the scanned item to ensure that there is no loss. The AI algorithm tries to predict the UPC barcode that is based on the video feed of the scanned item to verify the transaction. If the scanned UPC barcode does not match the predicted UPC barcode that is associated with the visual information from the video feed, the transaction is marked as “needs attention.”
The following scenarios help us understand how this process works:
Solution in action with a valid scan—When items are scanned, the Malong AI model uses the visual information to predict the correct UPC barcode and compares it with the scanned UPC barcode. When the scanned UPC barcode matches the predicted UPC barcode value that is based on the visual image in the camera, the transaction proceeds without interruption. The customer can then scan the next item or complete the purchase, as shown in the following figure:
Figure 7. Valid scan
Ticket switching and mis-scan—Ticket-switching occurs when a customer substitutes a product's barcode with a barcode from a less expensive item. The Malong AI model detects that the predicted UPC barcode is not consistent with the item’s visual information and the scanned barcode. The Malong AI model immediately notifies the alerting system, as shown in the following figure:
Figure 8. Ticket-switching scan
The transaction is paused. Typically, a retail associate is notified to assist the customer to rescan the item correctly. If configured, a recorded video clip of the transaction event is available to the retail associate.
A mis-scan occurs when the scanned item does not register with the SCO scanner because the customer avoided scanning the UPC barcode intentionally or accidently. Accidental mis-scans occur when a part of the hand obscures the barcode or the customer scans the wrong side of the package. In this scenario, the Malong AI model detects that there is no scanned code to match the visual information of an item and waits for the scan to register. If the model detects that the transaction is being completed or another item is being scanned, the Malong AI model notifies the alerting system and the transaction is paused.