Exact duplicates should represent different people about bga-payroll HOT 6 CLOSED

Please provide some examples

from bga-payroll.

yeah, here's a spreadsheet of all the exact duplicates and the number of times they appear in the source data. i generated it with the command tail +2 raw/2017_payroll.csv | sort --field-separator=',' -k2 -k6 -k5 -k4 -k3 | uniq -c | grep -v '^ * 1 ' > duplicates.csv and added the header by hand in the spreadsheet.

from bga-payroll.

From Jared:

If all of the fields are the same, the duplicates could be eliminated.

from bga-payroll.

In order to avoid collapsing salaries that should not be collapsed, we should not remove exact duplicates automatically. Have advised Jared that we will treat exact duplicates as different people –perhaps we should flag records that look exactly the same in the upload wizard. 

from bga-payroll.

related to #55.

from bga-payroll.

we may want to flag exact dupes within a given year to the user. it could be a case of three john smiths in the cpd from the same recruiting class, making the same pay, but it could be an error.

from bga-payroll.