mirror of
https://origin.cursor.com/mrdevmx/panels.git
synced 2026-10-09 10:43:18 +00:00
Fase 5 (migracion de datos): - api/scripts/migrate-sqlite-to-postgres.ts: ETL unico SQLite -> Postgres. Pre-flight (CURP/RFC duplicados case-insensitive, FKs huerfanas, tenant_id invalido, fechas mal formateadas) -> carga por base/esquema con credenciales _owner (setval de secuencias, OVERRIDING SYSTEM VALUE, ON CONFLICT DO NOTHING idempotente) -> verificacion de conteos y sumas de dinero con tolerancia. Probado end-to-end contra un dataset SQLite legacy sintetico y un Postgres limpio (solo schema+catalogos, sin contexto dev): 100% de las filas migradas, sumas de dinero exactas, snapshot de uploaded_by/created_by resuelto correctamente. - db/RUNBOOK-corte.md: checklist go/no-go para el corte por ambiente. - Fix de bug real encontrado al probar: sin --context-filter explicito, Liquibase corre TAMBIEN los changesets context=dev (comportamiento por defecto, no "modo seguro") -- documentado en db/README.md con el ejemplo correcto (--context-filter='!dev' para staging/produccion). Fase 5b: patron de compensacion para createTenant ya resuelto en el rewrite de saas.ts (fase 3/4). Fase 6 (backups): db/backups/ con plantillas pgBackRest por base, politica de retencion, nota de persistencia minima de Redis (RDB, sin retencion de negocio), checklist de simulacro de restauracion mensual, y la validacion pendiente de si Coolify permite WAL archiving antes de comprometerse a PITR real. Fase 7 (limpieza y CI): - Dockerfile.api simplificado (sin JRE/Liquibase/FFI). Dockerfile.migrate y Dockerfile.provision nuevos, de un solo uso, para el paso explicito de deploy (nunca sirven trafico). - docker-compose.yml: postgres+redis+provision+migrate para dev local end-to-end; api ya no arranca hasta que migrate termina bien. - docs/coolify.md y .env.example actualizados al modelo de 2 bases + Redis + Contabo. - api/schema.sql eliminado (desincronizado, competia con Liquibase como fuente de verdad). - .github/workflows/ci.yml: Postgres+Redis de servicio, aprovisiona roles/ACLs, dry-run de Liquibase (updateSQL) antes de aplicar, verify-isolation.sh, deno check + deno test, build de los dos frontends. Co-authored-by: alberto.martinez <alberto.martinez@mrdev.mx>
111 lines
3.9 KiB
YAML
111 lines
3.9 KiB
YAML
name: CI
|
|
|
|
on:
|
|
pull_request:
|
|
push:
|
|
branches: [main]
|
|
|
|
jobs:
|
|
api:
|
|
runs-on: ubuntu-latest
|
|
services:
|
|
postgres:
|
|
image: postgres:16
|
|
env:
|
|
POSTGRES_PASSWORD: postgres
|
|
ports:
|
|
- 5432:5432
|
|
options: >-
|
|
--health-cmd "pg_isready -U postgres"
|
|
--health-interval 10s
|
|
--health-timeout 5s
|
|
--health-retries 10
|
|
redis:
|
|
image: redis:7
|
|
ports:
|
|
- 6379:6379
|
|
options: >-
|
|
--health-cmd "redis-cli ping"
|
|
--health-interval 10s
|
|
--health-timeout 5s
|
|
--health-retries 10
|
|
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
|
|
- uses: denoland/setup-deno@v2
|
|
with:
|
|
deno-version: v2.x
|
|
|
|
- uses: actions/setup-java@v4
|
|
with:
|
|
distribution: temurin
|
|
java-version: "21"
|
|
|
|
- name: Aprovisionar roles/esquemas Postgres + ACLs Redis
|
|
env:
|
|
PGHOST: localhost
|
|
PGPASSWORD: postgres
|
|
PLATFORM_OWNER_PASSWORD: ci-platform-owner
|
|
PLATFORM_APP_PASSWORD: ci-platform-app
|
|
IAM_OWNER_PASSWORD: ci-iam-owner
|
|
IAM_APP_PASSWORD: ci-iam-app
|
|
CORE_OWNER_PASSWORD: ci-core-owner
|
|
CORE_APP_PASSWORD: ci-core-app
|
|
REDIS_ADMIN_URL: redis://localhost:6379
|
|
IAM_REDIS_PASSWORD: ci-iam-redis
|
|
CORE_REDIS_PASSWORD: ci-core-redis
|
|
run: |
|
|
sudo apt-get update -qq && sudo apt-get install -y -qq postgresql-client redis-tools
|
|
./db/provision/docker-provision.sh
|
|
./db/provision/05-redis-acl.sh
|
|
|
|
- name: Dry-run de Liquibase (updateSQL) -- no debe fallar antes de aplicar
|
|
env:
|
|
DATABASE_URL_PLATFORM_OWNER: postgresql://panels_platform_owner:ci-platform-owner@localhost:5432/panels_platform
|
|
DATABASE_URL_IAM_OWNER: postgresql://panels_iam_owner:ci-iam-owner@localhost:5432/panels_product
|
|
DATABASE_URL_CORE_OWNER: postgresql://panels_core_owner:ci-core-owner@localhost:5432/panels_product
|
|
run: ./db/update.sh all --context-filter='!dev' -- updateSQL
|
|
|
|
- name: Aplicar migraciones (con datos de demo, para los tests)
|
|
env:
|
|
DATABASE_URL_PLATFORM_OWNER: postgresql://panels_platform_owner:ci-platform-owner@localhost:5432/panels_platform
|
|
DATABASE_URL_IAM_OWNER: postgresql://panels_iam_owner:ci-iam-owner@localhost:5432/panels_product
|
|
DATABASE_URL_CORE_OWNER: postgresql://panels_core_owner:ci-core-owner@localhost:5432/panels_product
|
|
run: ./db/update.sh all --context-filter=dev
|
|
|
|
- name: Verificar aislamiento (roles/RLS/ACLs)
|
|
env:
|
|
DATABASE_URL_PLATFORM: postgresql://panels_platform_app:ci-platform-app@localhost:5432/panels_platform
|
|
DATABASE_URL_IAM: postgresql://panels_iam_app:ci-iam-app@localhost:5432/panels_product
|
|
DATABASE_URL_CORE: postgresql://panels_core_app:ci-core-app@localhost:5432/panels_product
|
|
REDIS_URL_IAM: redis://panels_iam_redis:ci-iam-redis@localhost:6379
|
|
REDIS_URL_CORE: redis://panels_core_redis:ci-core-redis@localhost:6379
|
|
run: ./db/provision/verify-isolation.sh
|
|
|
|
- name: deno check
|
|
working-directory: api
|
|
run: deno check main.ts
|
|
|
|
- name: deno test
|
|
working-directory: api
|
|
env:
|
|
DATABASE_URL_CORE_OWNER: postgresql://panels_core_owner:ci-core-owner@localhost:5432/panels_product
|
|
run: deno test --allow-net --allow-read --allow-write --allow-env
|
|
|
|
web:
|
|
runs-on: ubuntu-latest
|
|
strategy:
|
|
matrix:
|
|
app: [web-panel, web-saas]
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
- uses: actions/setup-node@v4
|
|
with:
|
|
node-version: "20"
|
|
cache: npm
|
|
cache-dependency-path: ${{ matrix.app }}/package-lock.json
|
|
- run: npm ci
|
|
working-directory: ${{ matrix.app }}
|
|
- run: npm run build
|
|
working-directory: ${{ matrix.app }}
|