Turning messy merchant uploads into review-ready data.
This simulated fintech data-quality project uses Microsoft Excel and Power Query to standardize 1,000 merchant inventory records, reconcile uploaded prices and categories against a reference CRM dataset, and flag 109 records requiring review. It demonstrates practical skills in data cleaning, data validation, reconciliation, and operational exception reporting.
Merchant bulk uploads can contain inconsistent product identifiers, incorrect data types, missing values, and discrepancies against existing records. These issues can affect data accuracy and downstream operations if they are not identified before processing.
This project simulates that workflow using two datasets: incoming Merchant Upload Data and a reference CRM Master Data table. I used Power Query to clean and standardize the merchant data, reconcile it against the reference dataset, and identify records requiring further review.
The project also includes Excel data-validation controls designed to reduce common data-entry errors.
Disclaimer: This is a fully simulated portfolio project. All datasets, product records, CRM reference data, and business rules were created or simulated for demonstration purposes. No real fintech company data or proprietary systems were used.
- Clean and standardize incoming merchant inventory data.
- Correct inconsistent SKU formats and category values.
- Handle corrupted values, missing dates, and data-type inconsistencies.
- Compare merchant-uploaded values against reference records.
- Flag price and category discrepancies for review.
- Implement spreadsheet validation controls to reduce future input errors.
- Prepare a cleaned CSV for downstream processing.
- Microsoft Excel — working environment, data validation, and discrepancy reporting.
- Power Query — data cleaning, transformation, merging, and reconciliation.
- CSV — source datasets and processed data exports.
The project uses two simulated datasets:
| Dataset | Purpose |
|---|---|
| Merchant Upload Data | Incoming inventory records requiring cleaning and validation. |
| CRM Master Data | Reference product information used to check the accuracy of the merchant upload. |
Product_ID serves as the matching key between the two datasets.
- Import: Load the Merchant Upload Data and CRM Master Data into the Excel/Power Query environment.
- Clean: Standardize SKU codes and categories, convert numeric fields to appropriate data types, and handle corrupted values and missing dates.
- Reconcile: Merge the cleaned merchant data with the CRM reference data using
Product_ID. - Identify discrepancies: Compare price and category values and flag mismatches.
- Review exceptions: Isolate records requiring review in a discrepancy audit report.
- Validate inputs: Configure Excel data-validation rules for product identifiers, SKU codes, categories, and dates.
- Export: Prepare the cleaned merchant dataset as a UTF-8 CSV.
The reconciliation process produced the following results:
| Quality Check | Result |
|---|---|
| Merchant inventory records | 1,000 |
| Price mismatches identified | 67 |
| Category mismatches identified | 44 |
| Records requiring review | 109 |
The discrepancy report consolidates records requiring review based on the configured reconciliation checks. These figures describe identified exceptions, not necessarily records that were subsequently corrected against the reference data.
The cleaning process also standardized SKU codes to eight characters, aligned category values with the approved categories, converted price and stock fields to appropriate numeric types, and handled missing date values.
The working Excel template includes:
- Category dropdown: Restricts entries to the approved category list.
- SKU length validation: Requires SKU codes to contain exactly eight characters.
- Date validation: Requires valid dates later than 1 January 2024.
- Product ID uniqueness validation: Uses a custom Excel rule to reject duplicate product identifiers.
These controls are intended to reduce common data-entry errors during subsequent use of the template.
fintech-merchant-data-quality/
├── README.md
├── .gitignore
├── data/
│ ├── raw/
│ │ ├── merchant_upload_data.csv
│ │ └── crm_master_data.csv
│ └── processed/
│ ├── merchant_upload_clean.csv
│ └── discrepancy_report.csv
├── workbook/
│ └── fintech_merchant_data_quality.xlsx
└── documentation/
└── data_cleaning_changelog.md
Repository contents:
- Raw data — simulated input datasets.
- Processed — cleaned merchant data and discrepancy report.
- Workbook — Excel working file containing the cleaning, reconciliation, and validation workflow.
- Changelog — detailed record of transformations, reconciliation checks, validation rules, and quality-assurance results.
- Data entry and quality control
- Data cleaning and standardization
- Microsoft Excel
- Power Query transformations and merging
- Data-type conversion and missing-value handling
- Reference-data reconciliation
- Discrepancy identification and exception reporting
- Excel data validation
- CSV export and data preparation
This project demonstrates how a structured spreadsheet workflow can help improve the consistency of incoming inventory data, identify discrepancies against a reference dataset, and prepare records for further processing.
The central principle is to clean incoming data, validate it against a reference source, and flag discrepancies for review rather than silently overwrite conflicting values.