Optimize excel-report-converter verification for large files
Add guidance to verify only first 10 records when validating large export files, avoiding processing time and memory issues. Also add temp/ to .gitignore. Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
This commit is contained in:
5
.gitignore
vendored
5
.gitignore
vendored
@@ -40,4 +40,7 @@ Thumbs.db
|
|||||||
*.xls
|
*.xls
|
||||||
|
|
||||||
# .claude
|
# .claude
|
||||||
.claude/
|
.claude/
|
||||||
|
|
||||||
|
#temp files
|
||||||
|
temp/
|
||||||
@@ -152,7 +152,8 @@ python3 scripts/custom_converter.py input.xlsx output.xlsx
|
|||||||
Use `excel-to-markdown` to verify the output:
|
Use `excel-to-markdown` to verify the output:
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
python3 scripts/excel_to_markdown.py output.xlsx -o /tmp/verify.md --show-rows --show-cols
|
# For large files, only verify first 10 records
|
||||||
|
python3 scripts/excel_to_markdown.py output.xlsx -o /tmp/verify.md --show-rows --show-cols --rows 1:11
|
||||||
```
|
```
|
||||||
|
|
||||||
Read `/tmp/verify.md` and verify:
|
Read `/tmp/verify.md` and verify:
|
||||||
@@ -162,6 +163,8 @@ Read `/tmp/verify.md` and verify:
|
|||||||
4. Footer fields are correctly populated
|
4. Footer fields are correctly populated
|
||||||
5. No data loss or corruption
|
5. No data loss or corruption
|
||||||
|
|
||||||
|
**Important:** For large output files with many records, use `--rows 1:11` to only convert and verify the first 10 data records (plus header row). This avoids processing time and memory issues when verifying large exports.
|
||||||
|
|
||||||
### Step 4: Iterate if Needed
|
### Step 4: Iterate if Needed
|
||||||
|
|
||||||
If verification reveals issues:
|
If verification reveals issues:
|
||||||
|
|||||||
Reference in New Issue
Block a user