AI Image Recognition

Warning

This page describes a function that has not yet been publicly released, or has been released in beta / preview quality. Subject to change.

Resco can integrate with Azure's Custom Vision service to classify images. This essentially allows functions similar to barcode scanning - except you don't need barcodes!

Prerequisites

Mind the following prerequisites for using this function:

• Azure Custom Vision license or subscription and at least one model for classifying images
• Connection to the Internet to access Azure servers that perform the necessary image analysis
• Proper configuration in Woodford (see below)

Change field format to barcode

The entity where you want to use AI Vision has to include a field with barcode format.

1. Using Woodford, edit an app project and select the entity from the Project menu.
2. Select the field. It must have the type Single Line of Text.
3. On the Properties pane, set Formatting to Barcode.
4. Click Save.

For more information about managing entities and fields in Woodford, see Managing entities.

Set up connection to Azure services

1. Edit an app project and select Settings > AI Vision from the Project menu.
2. Click New to define a new model.
3. As Name, enter the name of the configuration model.
4. As Entity, enter the entity where the model should be used.
5. As Service type, use Azure.
6. For Prediction key and URL, use the values from your Azure Custom Vision site.
7. Click OK to save the model.

You can define multiple models as needed.

Use case: Find a record in a view

For entities that include a barcode field and have at least one model created, there's an additional button in the views for AI Vision. It allows you to take a photo. The picture is then analyzed by Azure. If the resulting tag equals the primary name of a record in the list, that record is opened. In effect, this is similar to barcode scanning, using image tag instead of a barcode for record identification.

Use case: Place image classifier to a field in a form

If you add the field with barcode format to your form, the app displays a custom button that initiates camera and image classification. If the image matches the model (with a probability above a customizable threshold), the name of the model is saved to the field.