New: Practical guidance for AI-assisted quality engineering
AI & Data Quality · Cornerstone Guide 12

Data Reconciliation Testing

Learn how to reconcile source and target data using row counts, keys, totals, aggregates, transformations, missing records, duplicates, and exception analysis.

12 min readFor QA professionals, quality engineers, data teams, AI product teams, architects, and delivery leaders.

What reconciliation proves

Data reconciliation compares source, intermediate, and target data to determine whether records and values were transferred and transformed as intended.

Source ↓ Expected Records / Values ↓ Transformation ↓ Target ↓ Compare ↓ Exceptions

Start with record-level control totals

  • Source row count
  • Accepted row count
  • Rejected row count
  • Target row count
  • Insert count
  • Update count
  • Delete count
  • Duplicate count

Reconcile business keys

Compare key identifiers to detect missing and unexpected records.

Example
Source customer IDs = 1,000
Target customer IDs = 998

The two missing keys should be identified and explained—not hidden by aggregate totals.

Reconcile financial or numeric totals

For monetary, quantity, or metric data, compare totals and grouped totals by relevant business dimensions such as date, product, region, or account.

Validate transformations

TransformationReconciliation approach
MappingCompare source code to expected target category
CalculationRecompute formula independently
AggregationCompare source detail totals with target summary
JoinValidate matched/unmatched records and cardinality
DeduplicationConfirm survivor rule and removed duplicates

Investigate exceptions explicitly

Differences should be classified as expected transformation, source-quality issue, rejected record, late arrival, duplicate, defect, or unresolved exception.

Automate repeatable reconciliation

SQL comparisons, data-diff utilities, validation frameworks, and pipeline checks can automate high-volume reconciliation while preserving exception detail.

Do not stop at “counts match.” Two datasets can contain the same number of rows and still contain different records or incorrect values.

Make AI and data quality measurable

Connect AI-assisted QA, AI evaluation, data validation, pipelines, governance, and enterprise delivery decisions.

Ask a QA Question

AskAQA AI assistant

Ask a QA

Ask me about AI testing, LLM evaluation, RAG quality, hallucination testing, data validation, ETL testing, or data quality.

Do not include passwords, confidential information, or personal data in your question.