TOTAL rows 4 OLD DEDUPLICATE 0 0 0 1 1 1 2 1 1 1 3 1 DEDUPLICATE BY * 0 0 0 1 1 1 2 1 1 1 3 1 DEDUPLICATE BY * EXCEPT mat 0 0 0 1 1 1 2 1 1 1 3 1 DEDUPLICATE BY pk,sk,val,mat,partition_key 0 0 0 1 1 1 2 1 1 1 3 1 Can not remove full duplicates OLD DEDUPLICATE 4 DEDUPLICATE BY pk,sk,val,mat 4 Remove partial duplicates DEDUPLICATE BY * 3 DEDUPLICATE BY * EXCEPT mat 0 0 0 1 1 1 2 1 1 1 3 1 DEDUPLICATE BY COLUMNS("*") EXCEPT mat 0 0 0 1 1 1 2 1 1 1 3 1 DEDUPLICATE BY pk,sk 0 0 0 1 1 1 2 1 DEDUPLICATE BY COLUMNS(".*k") 0 0 0 1 1 1 2 1