10 Oct’19

Power BIRemove Duplicate in Power Query

In this blog, we are going to see how to remove duplicate from the column using Power Query, as we know that we can directly apply a transformation on the column and then use remove duplicate. But there is situation when remove duplicate does not work.

Situation 1:- Consider the following scenario, we have the same GUID but the case is different in that case duplicate will not get removed.

Solution:- Power Query is case sensitive language here both abcdefg123  and Abcdefg123 are considered as different. If you are going to do remove duplicates despite their case of letters, then you have to apply a transformation to change them all to one case; either UPPERCASE or lowercase.

Situation 2:- In other scenarios sometimes we have data with leading or trailing space is present so changing it to UPPERCASE, you would still have the extra space, which makes the two texts differ. So, to deal with that we have to use Trim Transformation to remove extra space.

Written by

Yogesh Gore

Associate Software Engineer - BI and D365 Finance and Operations

Leave a Reply

Your email address will not be published. Required fields are marked *

Want to streamline your business processes?

  • This field is for validation purposes and should be left unchanged.

Recent Articles

  • How to create Dynamics 365 Finance & Operations (formerly Dynamics AX) connection in SSIS

    12 December’ 2019

    Introduction: Creating a Connection is one of the first Steps during the integration of data. While performing Integrati...

    Read more
  • How to create AX (D365 F&0) Connection in SSIS

    12 December’ 2019

    Introduction: Creating a Connection is one of the first Steps during integration of data. While performing Integration w...

    Read more
  • First cut review of new D365 Project Service

    12 December’ 2019

    The new Project Service coming up is a much-advanced version of PSA. Even more, than it will be called as Project Servic...

    Read more
  • Business Central Wave 2 Features – Section 4

    11 December’ 2019

    Introduction: In this blog, I will be attempting to provide information about the new Modern Client features of Business...

    Read more
  • Business Central Wave 2 Features – Section 5

    11 December’ 2019

    Introduction: In this blog, I will be attempting to provide information about the new Modern Client features of Business...

    Read more

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.

Close