refactor: optimize material deletion with exact code matching and database queries
- Change from fuzzy material name matching to exact material code matching - Migrate from MaterialsTypeToBeDeleted to MaterialsToBeDeleted table - Add should_delete_material() for on-demand database queries - Remove in-memory material list loading to reduce memory footprint - Update documentation to reflect new matching logic - Remove main scripts from git tracking (contain user-specific config) Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
This commit is contained in:
Misaka_Company
345
docs/MAIN_CLEAN_FLOW.md
Normal file
345
docs/MAIN_CLEAN_FLOW.md
Normal file
@@ -0,0 +1,345 @@
|
||||
# main_clean.py 流程说明
|
||||
|
||||
## 概述
|
||||
|
||||
`main_clean.py` 是离散备料计划维护数据清理工具的主程序入口。该工具通过 Playwright 自动化登录用友 BIP 系统，读取生产订单号，然后逐个清理订单中不需要的物料数据。
|
||||
|
||||
---
|
||||
|
||||
## 系统架构图
|
||||
|
||||
```mermaid
|
||||
flowchart TB
|
||||
Start([开始]) --> Init[初始化 DiscreteMaterialPlanCleaner]
|
||||
|
||||
Init --> QueryDB[(查询数据库<br/>获取待删除物料列表)]
|
||||
|
||||
QueryDB --> Login[登录用友BIP系统]
|
||||
|
||||
Login --> OpenMenu[点击功能菜单]
|
||||
OpenMenu --> OpenPage[打开离散生产订单维护页面]
|
||||
|
||||
OpenPage --> SetupQuery[设置查询界面]
|
||||
SetupQuery --> ReadFile[(读取ProductionID.txt)]
|
||||
ReadFile --> GetOrders[(查询数据库<br/>获取生产订单号)]
|
||||
|
||||
GetOrders --> LoopStart{遍历订单}
|
||||
|
||||
LoopStart --> ProcessOrder[处理单个订单]
|
||||
ProcessOrder --> QueryOrder[查询订单详情]
|
||||
QueryOrder --> OpenPlanPage[打开备料计划页面]
|
||||
OpenPlanPage --> WaitLoad[等待页面加载完成]
|
||||
|
||||
WaitLoad --> CheckData{检查数据状态}
|
||||
|
||||
CheckData -->|detail_count = 0| SkipOrder[跳过该订单]
|
||||
CheckData -->|status != 审批通过| SkipOrder
|
||||
CheckData -->|detail_count > 0<br/>status = 审批通过| ClickModify[点击修改按钮]
|
||||
|
||||
ClickModify --> ExpandForm[展开详细信息表单]
|
||||
ExpandForm --> LoopMaterials{遍历物料}
|
||||
|
||||
LoopMaterials --> GetMaterial[获取物料信息]
|
||||
GetMaterial --> CheckDelete{需要删除?}
|
||||
|
||||
CheckDelete -->|是| MarkDelete[标记待删除]
|
||||
CheckDelete -->|否| KeepMaterial[保留物料]
|
||||
|
||||
MarkDelete --> NextMaterial{下一个物料?}
|
||||
KeepMaterial --> NextMaterial
|
||||
|
||||
NextMaterial -->|是| LoopMaterials
|
||||
NextMaterial -->|否| ClosePlanPage[关闭备料计划页面]
|
||||
|
||||
SkipOrder --> ClosePlanPage
|
||||
ClosePlanPage --> NextOrder{下一个订单?}
|
||||
|
||||
NextOrder -->|是| LoopStart
|
||||
NextOrder -->|否| Logout[注销账号]
|
||||
|
||||
Logout --> CloseBrowser[关闭浏览器]
|
||||
CloseBrowser --> End([结束])
|
||||
|
||||
style Init fill:#e1f5ff
|
||||
style QueryDB fill:#fff4e1
|
||||
style Login fill:#e1f5ff
|
||||
style End fill:#ffe1e1
|
||||
style CheckDelete fill:#fff4e1
|
||||
style CheckData fill:#fff4e1
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 详细流程说明
|
||||
|
||||
### 1. 初始化阶段
|
||||
|
||||
```mermaid
|
||||
flowchart LR
|
||||
A[main函数] --> B[创建 DiscreteMaterialPlanCleaner 实例]
|
||||
B --> C[配置参数:<br/>username, password,<br/>manager_name, headless, verbose]
|
||||
|
||||
style A fill:#e1f5ff
|
||||
style B fill:#e1f5ff
|
||||
style C fill:#e1f5ff
|
||||
```
|
||||
|
||||
**代码位置**: `main_clean.py:9-24`
|
||||
|
||||
```python
|
||||
cleaner = DiscreteMaterialPlanCleaner(
|
||||
username="BLDpengqiangqiang",
|
||||
password="Cqbld123456.",
|
||||
manager_name="彭羽",
|
||||
headless=False,
|
||||
verbose=True,
|
||||
)
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
### 2. 数据准备阶段
|
||||
|
||||
```mermaid
|
||||
flowchart TB
|
||||
A[clean.clean方法] --> B[查询数据库<br/>MaterialsToBeDeleted表]
|
||||
B --> C[获取指定负责人的<br/>待删除物料编码列表]
|
||||
|
||||
style A fill:#fff4e1
|
||||
style B fill:#fff4e1
|
||||
style C fill:#fff4e1
|
||||
```
|
||||
|
||||
**代码位置**: `utils/离散备料计划维护数据清理.py:292-304`
|
||||
|
||||
| 模块 | 功能 | 文件 |
|
||||
|------|------|------|
|
||||
| `get_materials_to_delete()` | 查询待删除物料编码 | `db/materials_to_delete.py` |
|
||||
|
||||
---
|
||||
|
||||
### 3. 登录与导航
|
||||
|
||||
```mermaid
|
||||
sequenceDiagram
|
||||
participant Main as main_clean.py
|
||||
participant Auth as auth.py
|
||||
participant Browser as Chromium Browser
|
||||
participant ERP as 用友BIP系统
|
||||
|
||||
Main->>Auth: login(playwright, username, password)
|
||||
Auth->>Browser: launch(headless=False)
|
||||
Auth->>Browser: new_context()
|
||||
Auth->>Browser: new_page()
|
||||
Auth->>ERP: goto(登录页面URL)
|
||||
Auth->>ERP: 填写用户名和密码
|
||||
Auth->>ERP: 点击登录按钮
|
||||
alt 有强制登录弹窗
|
||||
ERP-->>Auth: 显示弹窗
|
||||
Auth->>ERP: 点击确定
|
||||
end
|
||||
Auth-->>Main: 返回 (browser, context, page, main_frame)
|
||||
```
|
||||
|
||||
**代码位置**: `utils/auth.py:8-72`
|
||||
|
||||
---
|
||||
|
||||
### 4. 设置查询界面
|
||||
|
||||
```mermaid
|
||||
flowchart TB
|
||||
A[点击图标按钮] --> B[选择"订单号查询"]
|
||||
B --> C[点击"全部"标签]
|
||||
C --> D{填充显示条数}
|
||||
D --> E{成功?}
|
||||
E -->|否| F[重试<br/>最多3次]
|
||||
F --> D
|
||||
E -->|是| G[继续]
|
||||
|
||||
style D fill:#fff4e1
|
||||
style E fill:#fff4e1
|
||||
style F fill:#ffe1e1
|
||||
```
|
||||
|
||||
**代码位置**: `utils/离散备料计划维护数据清理.py:263-290`
|
||||
|
||||
---
|
||||
|
||||
### 5. 获取生产订单号
|
||||
|
||||
```mermaid
|
||||
flowchart LR
|
||||
A[read_production_ids] --> B[读取ProductionID.txt]
|
||||
B --> C[解析总排号列表]
|
||||
C --> D[query_production_order_numbers]
|
||||
D --> E[查询数据库<br/>获取生产订单号]
|
||||
|
||||
style A fill:#fff4e1
|
||||
style D fill:#fff4e1
|
||||
```
|
||||
|
||||
**代码位置**: `utils/离散备料计划维护数据清理.py:41-59`
|
||||
|
||||
| 函数 | 功能 | 数据库表 |
|
||||
|------|------|----------|
|
||||
| `read_production_ids()` | 读取总排号文件 | 文件输入 |
|
||||
| `query_production_order_numbers()` | 查询生产订单号 | ProductionOrder |
|
||||
|
||||
---
|
||||
|
||||
### 6. 订单处理流程
|
||||
|
||||
```mermaid
|
||||
flowchart TB
|
||||
Start([开始处理订单]) --> FillInput[填充生产订单号]
|
||||
FillInput --> ClickQuery[点击查询按钮]
|
||||
ClickQuery --> WaitLoad[等待加载完成]
|
||||
|
||||
WaitLoad --> ClickMore[点击"更多"按钮]
|
||||
ClickMore --> OpenPlan[打开"备料计划"页面]
|
||||
|
||||
OpenPlan --> GetIframe[获取嵌套iframe]
|
||||
GetIframe --> WaitPlanLoad[等待备料计划页面加载]
|
||||
|
||||
WaitPlanLoad --> ExtractInfo[提取信息:<br/>- 编码<br/>- 详细信息数量<br/>- 备料状态]
|
||||
|
||||
ExtractInfo --> CheckStatus{状态检查}
|
||||
|
||||
style Start fill:#e1f5ff
|
||||
style CheckStatus fill:#fff4e1
|
||||
```
|
||||
|
||||
**代码位置**: `utils/离散备料计划维护数据清理.py:61-167`
|
||||
|
||||
---
|
||||
|
||||
### 7. 物料清理流程
|
||||
|
||||
```mermaid
|
||||
flowchart TB
|
||||
Check{detail_count > 0<br/>&<br/>status = 审批通过} -->|否| Skip[跳过处理]
|
||||
Check -->|是| ClickModify[点击修改按钮]
|
||||
|
||||
ClickModify --> WaitSave[等待保存按钮可见]
|
||||
WaitSave --> Expand[点击展开按钮]
|
||||
Expand --> GetForm[获取表单容器]
|
||||
|
||||
GetForm --> LoopStart{遍历物料}
|
||||
|
||||
LoopStart --> GetSerial[定位序号]
|
||||
GetSerial --> GetCode[获取材料编码]
|
||||
GetCode --> GetName[获取材料名称]
|
||||
GetName --> GetQty1[获取累计待发数量]
|
||||
GetQty1 --> GetQty2[获取累计出库数量]
|
||||
|
||||
GetQty2 --> Match{物料编码<br/>在待删除列表中?}
|
||||
|
||||
Match -->|精确匹配| Delete[标记待删除]
|
||||
Match -->|未匹配| Keep[保留]
|
||||
|
||||
Delete --> Next{下一个?}
|
||||
Keep --> Next
|
||||
|
||||
Next -->|是| LoopStart
|
||||
Next -->|否| Done([完成])
|
||||
|
||||
style Check fill:#fff4e1
|
||||
style Match fill:#fff4e1
|
||||
style Done fill:#e1f5ff
|
||||
```
|
||||
|
||||
**代码位置**: `utils/离散备料计划维护数据清理.py:169-261`
|
||||
|
||||
---
|
||||
|
||||
## 关键数据结构
|
||||
|
||||
### DiscreteMaterialPlanCleaner 类
|
||||
|
||||
```mermaid
|
||||
classDiagram
|
||||
class DiscreteMaterialPlanCleaner {
|
||||
+str username
|
||||
+str password
|
||||
+str manager_name
|
||||
+bool headless
|
||||
+bool verbose
|
||||
+_print(args)
|
||||
+get_production_order_numbers(file)
|
||||
+process_order(frame, order_id, ...)
|
||||
+setup_query_interface(frame)
|
||||
+clean(file, debug_mode, ...)
|
||||
}
|
||||
|
||||
class auth {
|
||||
+login(playwright, username, password)
|
||||
+logout(main_frame, verbose)
|
||||
+close_session(browser, context)
|
||||
}
|
||||
|
||||
class materials_to_delete {
|
||||
+get_materials_to_delete(manager_name)
|
||||
+get_all_materials_to_delete()
|
||||
}
|
||||
|
||||
class production_order_query {
|
||||
+read_production_ids(file)
|
||||
+query_production_order_numbers(ids)
|
||||
}
|
||||
|
||||
DiscreteMaterialPlanCleaner --> auth
|
||||
DiscreteMaterialPlanCleaner --> materials_to_delete
|
||||
DiscreteMaterialPlanCleaner --> production_order_query
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 配置参数说明
|
||||
|
||||
| 参数 | 类型 | 默认值 | 说明 |
|
||||
|------|------|--------|------|
|
||||
| `username` | str | - | 登录用户名 |
|
||||
| `password` | str | - | 登录密码 |
|
||||
| `manager_name` | str | - | 负责人姓名（用于查询待删除物料） |
|
||||
| `headless` | bool | False | 是否无头模式运行浏览器 |
|
||||
| `verbose` | bool | True | 是否打印详细日志 |
|
||||
|
||||
---
|
||||
|
||||
## 文件依赖关系
|
||||
|
||||
```mermaid
|
||||
graph TD
|
||||
A[main_clean.py] --> B[utils/离散备料计划维护数据清理.py]
|
||||
B --> C[utils/auth.py]
|
||||
B --> D[db/production_order_query.py]
|
||||
B --> E[db/materials_to_delete.py]
|
||||
B --> F[db/connection.py]
|
||||
|
||||
style A fill:#e1f5ff
|
||||
style B fill:#e1f5ff
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 执行入口
|
||||
|
||||
```bash
|
||||
# 直接运行
|
||||
python main_clean.py
|
||||
|
||||
# 或在虚拟环境中运行
|
||||
.venv\Scripts\activate
|
||||
python main_clean.py
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 注意事项
|
||||
|
||||
1. **浏览器模式**: 默认使用非无头模式 (`headless=False`)，便于调试观察
|
||||
2. **日志输出**: 启用详细日志 (`verbose=True`)，打印每一步操作
|
||||
3. **数据库连接**: 使用上下文管理器自动管理数据库连接
|
||||
4. **异常处理**: 加载超时会自动重试或跳过
|
||||
5. **调试模式**: 支持在指定订单处暂停调试
|
||||
Reference in New Issue
Block a user