How to actually use the Validator transformation

adam_element

The Validator transformation can be a bit non-intuitive to use - even I get puzzled sometimes. But there's a small trick I use to make it much easier to understand.

Before I place the Validator transformation in my pipeline I add a SQL Query transformation - which I use to get the number of rows in the data flow.

The SQL Query transformation uses the below query. Where the output column in row_count.

Then, in the Validator transformation I can create rules that are much easier to understand.

kanyinsa

I really like this @adam_element ! this is a cool way to use the Validator transformation. I will be using this trick on my next pipeline! thx for sharing.