e5f6f4ee0c
Implement database-level deduplication using ROW_NUMBER() window function to remove duplicate material records based on MaterialCode field. Changes: - Add query_all_distinct_by_material_code() to deduplicate full table results - Add query_by_source_numbers_distinct() to deduplicate filtered results - Update validator to use new deduplication methods with statistics logging - Retention strategy: keep earliest record (CreateDate ASC, SequenceNumber ASC) Benefits: - Reduces data redundancy from 54,358 to 1,679 records (96.91% reduction) - Improves validation result readability by removing duplicate materials - Maintains backward compatibility with existing query methods Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>