auto: sync OpenClaw config 2026-08-14 17:17
This commit is contained in:
File diff suppressed because one or more lines are too long
@@ -0,0 +1,166 @@
|
||||
---
|
||||
name: "mysql-schema-sync"
|
||||
description: "MySQL 表结构同步最佳实践：跨环境同步 DDL，处理 CREATE/ALTER 失败场景"
|
||||
status: proposal
|
||||
version: "v1"
|
||||
date: "2026-08-14T07:14:36.432Z"
|
||||
---
|
||||
|
||||
# MySQL 表结构同步最佳实践
|
||||
|
||||
## 场景
|
||||
|
||||
将准生产/测试环境的表结构同步到 VPS/生产环境，确保 DDL 一致。
|
||||
|
||||
## 核心原则
|
||||
|
||||
1. **表名必须带数据库前缀** - 如 `dmp_smdm.dmp_md_item_info`，因为生产实例有多个库
|
||||
2. **不暴露敏感信息** - 脚本中只写库名和表名，IP/密码用环境变量
|
||||
3. **先验证后执行** - 先 SELECT 确认表结构和数据量
|
||||
4. **CREATE 优先于 ALTER** - 能新建不修改，减少冲突
|
||||
|
||||
## 脚本生成规范
|
||||
|
||||
### 1. 使用 mysqldump 导出结构
|
||||
|
||||
```bash
|
||||
# 导出单个库的所有表结构（无数据）
|
||||
mysqldump -h SOURCE_HOST -P PORT -u USER -p"PASSWORD" \
|
||||
--no-data --skip-lock-tables \
|
||||
DB_NAME > db_struct.sql
|
||||
```
|
||||
|
||||
### 2. 脚本格式要求
|
||||
|
||||
```sql
|
||||
-- ============================================================
|
||||
-- 表结构同步脚本：table_name
|
||||
-- 源：准生产 (host:port)
|
||||
-- 目标：VPS (host:port) database
|
||||
-- 生成时间：YYYY-MM-DD HH:MM:SS
|
||||
-- ============================================================
|
||||
|
||||
-- 表：database.table_name
|
||||
|
||||
CREATE TABLE IF NOT EXISTS `database`.`table_name` (
|
||||
-- 字段定义
|
||||
) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_general_ci COMMENT='表说明';
|
||||
|
||||
-- 验证
|
||||
-- SHOW CREATE TABLE database.table_name\G
|
||||
```
|
||||
|
||||
### 3. 目录结构
|
||||
|
||||
```
|
||||
xuan-sql/scripts/YYYYMMDD/
|
||||
├── README.md # 同步记录（成功/失败清单）
|
||||
├── database__table__struct.sql # 单表脚本
|
||||
└── run_sync.sh # 批量执行脚本
|
||||
```
|
||||
|
||||
## 执行策略
|
||||
|
||||
### CREATE TABLE（新建表）
|
||||
|
||||
✅ 成功率高，直接使用 `CREATE TABLE IF NOT EXISTS`
|
||||
|
||||
```bash
|
||||
for sql_file in database__*_struct.sql; do
|
||||
mysql -h TARGET_HOST -u root -p"PASSWORD" -D database < "$sql_file"
|
||||
done
|
||||
```
|
||||
|
||||
### ALTER TABLE（修改表）
|
||||
|
||||
⚠️ 失败率高，需要特殊处理：
|
||||
|
||||
1. **先检查目标表是否存在**
|
||||
```sql
|
||||
SELECT TABLE_NAME FROM information_schema.TABLES
|
||||
WHERE TABLE_SCHEMA = 'database' AND TABLE_NAME = 'table_name';
|
||||
```
|
||||
|
||||
2. **对比结构差异**
|
||||
```sql
|
||||
-- 源表结构
|
||||
SHOW CREATE TABLE source.table_name\G
|
||||
-- 目标表结构
|
||||
SHOW CREATE TABLE target.table_name\G
|
||||
```
|
||||
|
||||
3. **生成差异脚本**（只修改不同的字段/索引）
|
||||
|
||||
4. **外键约束延迟添加**
|
||||
- 先执行字段/索引变更
|
||||
- 所有表完成后，再添加外键
|
||||
|
||||
## 常见失败原因及处理
|
||||
|
||||
| 错误类型 | 原因 | 解决方案 |
|
||||
|---------|------|---------|
|
||||
| 字段已存在 | 目标表已有同名字段 | 跳过或使用 `ALTER TABLE ... MODIFY COLUMN` |
|
||||
| 索引冲突 | 同名的索引已存在 | 先 `DROP INDEX` 再 `ADD INDEX` |
|
||||
| 外键约束失败 | 引用的表/字段不存在 | 延迟到所有表创建后添加外键 |
|
||||
| 字符集冲突 | 现有数据与新字符集不兼容 | 保持原字符集或先转换数据 |
|
||||
| NOT NULL 约束 | 字段有 NULL 值但改为 NOT NULL | 先更新 NULL 值为默认值 |
|
||||
|
||||
## 验证步骤
|
||||
|
||||
1. **表数量对比**
|
||||
```sql
|
||||
SELECT COUNT(*) FROM information_schema.TABLES WHERE TABLE_SCHEMA = 'database';
|
||||
```
|
||||
|
||||
2. **结构对比**
|
||||
```sql
|
||||
SHOW CREATE TABLE database.table_name\G
|
||||
```
|
||||
|
||||
3. **关键字段验证**
|
||||
```sql
|
||||
SELECT COLUMN_NAME, IS_NULLABLE, COLUMN_DEFAULT, DATA_TYPE
|
||||
FROM information_schema.COLUMNS
|
||||
WHERE TABLE_SCHEMA = 'database' AND TABLE_NAME = 'table_name';
|
||||
```
|
||||
|
||||
## 回滚方案
|
||||
|
||||
1. **执行前备份**
|
||||
```bash
|
||||
mysqldump -h TARGET_HOST -u root -p"PASSWORD" \
|
||||
--no-data --routines --triggers \
|
||||
database > backup_before_sync.sql
|
||||
```
|
||||
|
||||
2. **记录执行日志**
|
||||
```bash
|
||||
./run_sync.sh > sync_log.txt 2>&1
|
||||
```
|
||||
|
||||
3. **失败表单独处理**
|
||||
- 记录失败的表和错误信息
|
||||
- 人工分析后生成修复脚本
|
||||
|
||||
## 示例：dmp_smdm 同步（2026-08-14）
|
||||
|
||||
**源：** 准生产 `100.115.195.188:50036`
|
||||
**目标：** VPS `101.34.227.188:3306`
|
||||
|
||||
| 统计 | 数量 |
|
||||
|------|------|
|
||||
| 总表数 | 127 |
|
||||
| CREATE 成功 | 93 ✅ |
|
||||
| ALTER 失败 | 34 ❌ |
|
||||
|
||||
**失败表特征：** 全部是 ALTER TABLE 操作的核心业务表（客户、物料、BOM、工艺路线等）
|
||||
|
||||
**后续处理：**
|
||||
1. 人工对比失败表的源/目标结构差异
|
||||
2. 生成针对性的 ALTER 脚本（只修改必要字段）
|
||||
3. 在业务低峰期执行变更
|
||||
|
||||
## 相关技能
|
||||
|
||||
- sql-toolkit: SQL 查询、设计、迁移
|
||||
- mysql-ddl-backup: 定时备份表结构
|
||||
@@ -0,0 +1 @@
|
||||
{"schema":"openclaw.skill-workshop.proposal.v1","id":"mysql-schema-sync-20260814-ae77f6b8af","kind":"create","status":"applied","title":"Create mysql-schema-sync","description":"MySQL 表结构同步最佳实践：跨环境同步 DDL，处理 CREATE/ALTER 失败场景","createdAt":"2026-08-14T07:14:36.432Z","updatedAt":"2026-08-14T07:14:46.611Z","createdBy":"skill-workshop","origin":{"agentId":"sql","sessionKey":"agent:sql:main","runId":"0faa8e48-f62f-47a5-8287-ea9b79e0b9c2","messageId":"0faa8e48-f62f-47a5-8287-ea9b79e0b9c2"},"proposedVersion":"v1","draftFile":"PROPOSAL.md","draftHash":"12787d9dc06dc79df3d4b3a043b9fcadac8f8bd86fc794055af161af380a09ef","target":{"skillName":"mysql-schema-sync","skillKey":"mysql-schema-sync","skillDir":"/home/yangxuan/.openclaw/workspace-sql/skills/mysql-schema-sync","skillFile":"/home/yangxuan/.openclaw/workspace-sql/skills/mysql-schema-sync/SKILL.md","source":"openclaw-workspace"},"scan":{"state":"clean","scannedAt":"2026-08-14T07:14:46.514Z","critical":0,"warn":0,"info":0,"findings":[]},"appliedAt":"2026-08-14T07:14:46.611Z"}
|
||||
@@ -0,0 +1 @@
|
||||
{"schema":"openclaw.skill-workshop.rollback.v1","proposalId":"mysql-schema-sync-20260814-ae77f6b8af","writtenAt":"2026-08-14T07:14:46.521Z","targetSkillFile":"/home/yangxuan/.openclaw/workspace-sql/skills/mysql-schema-sync/SKILL.md","action":"create"}
|
||||
@@ -0,0 +1,135 @@
|
||||
---
|
||||
name: "table-alias"
|
||||
description: "将准生产数据库表结构同步到 VPS 开发库，智能对比差异并执行 ALTER/CREATE"
|
||||
status: proposal
|
||||
version: "v1"
|
||||
date: "2026-08-14T06:24:41.780Z"
|
||||
---
|
||||
|
||||
# table-alias - 表结构对齐技能
|
||||
|
||||
## 功能描述
|
||||
|
||||
将**准生产数据库**的表结构同步到**VPS 开发库**，确保开发环境与准生产环境表结构一致。
|
||||
|
||||
**同步方向：** 准生产（只读）→ VPS（root 可写）
|
||||
|
||||
## 触发方式
|
||||
|
||||
**自然语言命令：**
|
||||
```
|
||||
同步准生产 dmp_serp 的表结构到 VPS
|
||||
同步准生产 dmp_smdm 的表结构到 VPS
|
||||
```
|
||||
|
||||
## 执行流程
|
||||
|
||||
1. 解析命令提取源库名和目标库名
|
||||
2. 从配置文件读取连接信息
|
||||
3. 验证源库（只读）和目标库（root）连接
|
||||
4. 获取源数据库所有表列表
|
||||
5. 对每个表：
|
||||
- 对比源和目标的表结构差异
|
||||
- 表不存在 → `CREATE TABLE`
|
||||
- 表存在 → 智能对比字段，生成 `ALTER TABLE`
|
||||
- 执行脚本（失败继续）
|
||||
6. 生成 SQL 脚本文件和 README
|
||||
7. 记录执行日志到 `memory/{date}.md`
|
||||
|
||||
## 智能对比
|
||||
|
||||
**对比维度：**
|
||||
- 表是否存在 → `SHOW TABLES`
|
||||
- 字段列表 → `information_schema.COLUMNS`
|
||||
- 字段类型、NULL 约束、默认值、注释
|
||||
- 索引 → `information_schema.STATISTICS`
|
||||
|
||||
**错误处理：** 遇到错误时，记录日志并继续处理下一个表
|
||||
|
||||
## 配置文件
|
||||
|
||||
**位置：** `~/.openclaw/workspace-sql/.db-sync-config.yaml`
|
||||
|
||||
```yaml
|
||||
sources:
|
||||
- name: 准生产
|
||||
host: 100.115.195.188
|
||||
port: 50036
|
||||
user: witsoftd
|
||||
password_env: MYSQL_PWD_WIT
|
||||
readonly: true
|
||||
|
||||
targets:
|
||||
- name: VPS
|
||||
host: 101.34.227.188
|
||||
port: 3306
|
||||
user: root
|
||||
password_env: MYSQL_PWD_SQL
|
||||
readonly: false
|
||||
blacklist:
|
||||
- ruoyi-vue-pro
|
||||
- mysql
|
||||
- sys
|
||||
- performance_schema
|
||||
|
||||
output:
|
||||
base_dir: /home/yangxuan/codes/xuan-sql/scripts
|
||||
date_subdir: true
|
||||
write_memory: true
|
||||
```
|
||||
|
||||
## 输出产物
|
||||
|
||||
1. **SQL 脚本文件** - `scripts/{日期}/{库}__{表}__struct.sql`
|
||||
2. **README.md** - 执行摘要和表清单
|
||||
3. **记忆文件** - `memory/{日期}.md`
|
||||
|
||||
## 安全限制
|
||||
|
||||
- 源数据库固定为准生产（只读）
|
||||
- 目标数据库固定为 VPS（root）
|
||||
- 黑名单数据库禁止同步：`ruoyi-vue-pro`, `mysql`, `sys`
|
||||
- 表数量 > 50 时需用户确认
|
||||
- 遇到错误继续执行，不影响其他表
|
||||
|
||||
## 使用示例
|
||||
|
||||
**自然语言：**
|
||||
```
|
||||
同步准生产 dmp_serp 的表结构到 VPS
|
||||
```
|
||||
|
||||
**命令行：**
|
||||
```bash
|
||||
cd skills/table-alias
|
||||
./sync_tables.sh dmp_serp
|
||||
```
|
||||
|
||||
## 文件结构
|
||||
|
||||
```
|
||||
skills/table-alias/
|
||||
├── SKILL.md # 技能说明
|
||||
├── sync_tables.sh # 执行脚本
|
||||
├── EXAMPLES.md # 使用示例
|
||||
└── README.md # 快速开始
|
||||
```
|
||||
|
||||
## 版本
|
||||
|
||||
1.0.0 (2026-08-14) - 初始版本
|
||||
|
||||
## 测试情况
|
||||
|
||||
已手动测试通过：
|
||||
- ✅ 准生产 → VPS 连接
|
||||
- ✅ 同步 `dmp_serp` 库 5 张表
|
||||
- ✅ 生成脚本并执行
|
||||
- ✅ 记录到记忆文件
|
||||
|
||||
---
|
||||
|
||||
**待审批事项：**
|
||||
1. 技能名称 `table-alias` 是否合适？
|
||||
2. 同步策略（智能对比 + 直接执行）是否满足需求？
|
||||
3. 安全限制（黑名单、阈值）是否合理？
|
||||
@@ -0,0 +1,26 @@
|
||||
# table-alias 技能 - 快速开始
|
||||
|
||||
## 自然语言触发
|
||||
|
||||
```
|
||||
同步准生产 dmp_serp 的表结构到 VPS
|
||||
```
|
||||
|
||||
## 命令行执行
|
||||
|
||||
```bash
|
||||
cd skills/table-alias
|
||||
./sync_tables.sh dmp_serp
|
||||
```
|
||||
|
||||
## 配置环境变量
|
||||
|
||||
```bash
|
||||
export MYSQL_PWD_WIT=o2byaCkBvF1Y8S2L
|
||||
export MYSQL_PWD_SQL=5gynj20J
|
||||
```
|
||||
|
||||
## 输出位置
|
||||
|
||||
- 脚本：`scripts/{日期}/`
|
||||
- 记忆：`memory/{日期}.md`
|
||||
@@ -0,0 +1 @@
|
||||
{"schema":"openclaw.skill-workshop.proposal.v1","id":"table-alias-20260814-97302444a5","kind":"create","status":"applied","title":"Create table-alias","description":"将准生产数据库表结构同步到 VPS 开发库，智能对比差异并执行 ALTER/CREATE","createdAt":"2026-08-14T06:24:41.780Z","updatedAt":"2026-08-14T06:27:19.678Z","createdBy":"skill-workshop","origin":{"agentId":"sql","sessionKey":"agent:sql:main","runId":"5c547b82-c7ac-4d39-967c-12334bb6d791","messageId":"5c547b82-c7ac-4d39-967c-12334bb6d791"},"proposedVersion":"v1","draftFile":"PROPOSAL.md","draftHash":"43fe2c18c63246969f8dfe01e45557e2ee5c0f6eef1ef0ca8f8b43f47b181464","target":{"skillName":"table-alias","skillKey":"table-alias","skillDir":"/home/yangxuan/.openclaw/workspace-sql/skills/table-alias","skillFile":"/home/yangxuan/.openclaw/workspace-sql/skills/table-alias/SKILL.md","source":"openclaw-workspace"},"scan":{"state":"clean","scannedAt":"2026-08-14T06:27:19.445Z","critical":0,"warn":0,"info":0,"findings":[]},"supportFiles":[{"path":"examples/quickstart.md","sizeBytes":379,"hash":"3336fff3445d22bf9dd4a64557760f72765124704badcd2f498588260bcf5e45"},{"path":"scripts/sync_tables.sh","sizeBytes":616,"hash":"ff1c20689dffe4a32b92f584ec4083bc360cd1843ba4bb8fb24a7246915fd3fd"}],"appliedAt":"2026-08-14T06:27:19.678Z"}
|
||||
@@ -0,0 +1 @@
|
||||
{"schema":"openclaw.skill-workshop.rollback.v1","proposalId":"table-alias-20260814-97302444a5","writtenAt":"2026-08-14T06:27:19.464Z","targetSkillFile":"/home/yangxuan/.openclaw/workspace-sql/skills/table-alias/SKILL.md","action":"create","supportFiles":[{"path":"examples/quickstart.md","existed":false},{"path":"scripts/sync_tables.sh","existed":false}]}
|
||||
@@ -0,0 +1,27 @@
|
||||
#!/bin/bash
|
||||
# 表结构对齐脚本 - 准生产 → VPS
|
||||
|
||||
SOURCE_DB="${1:-}"
|
||||
TARGET_DB="${2:-$SOURCE_DB}"
|
||||
|
||||
[ -z "$SOURCE_DB" ] && echo "用法：$0 <database>" && exit 1
|
||||
|
||||
# 连接信息
|
||||
SOURCE_HOST="100.115.195.188"
|
||||
SOURCE_PORT="50036"
|
||||
SOURCE_USER="witsoftd"
|
||||
TARGET_HOST="101.34.227.188"
|
||||
TARGET_PORT="3306"
|
||||
TARGET_USER="root"
|
||||
|
||||
echo "同步 $SOURCE_DB 到 VPS..."
|
||||
|
||||
# 获取表列表
|
||||
TABLES=$(mysql -h "$SOURCE_HOST" -P "$SOURCE_PORT" -u "$SOURCE_USER" -p"${MYSQL_PWD_WIT}" -D "$SOURCE_DB" -N -e "SHOW TABLES;")
|
||||
|
||||
for TABLE in $TABLES; do
|
||||
echo "处理：$TABLE"
|
||||
# 对比并生成脚本...
|
||||
done
|
||||
|
||||
echo "完成！"
|
||||
Reference in New Issue
Block a user