Column profiling in Microsoft Dataflows

Microsoft Dataflows on the Power Platform is a powerful and useful data integration tool that works for our customers. When importing large datasets, you may encounter an error like this during the data load (sync) process:

Couldn’t refresh the entity because of an issue with the mashup document MashupException.Error: We cannot convert the value null to type Logical. Details: Reason = Expression.Error;ErrorCode = 10277;….

The cause of this issue is that some of the records have a value of “null”. The problem is that it’s challenging to find which records do. The preview functionality uses a limited dataset, and the problem records may not be visible.

This is where column profiling comes to the rescue. This helpful feature can analyse the entire dataset and show the count of records that have a valid value, are empty, or contain errors in them.

To enable it, go to the  “Options” section and select “Enable column profile” as well as set the column profile evaluation to “Based on the entire dataset” (see the screenshots):

Column profiling - clean records

Here is the column with some invalid data:

Column profiling - recoords with invalid data

With this, you will see straight away if any records cause issues in the dataflow load, and you can troubleshoot them.

Reach out to us if you have any questions on Dataflows!

Leave a Reply

Discover more from Technomancy

Subscribe now to keep reading and get access to the full archive.

Continue reading