feat: add emote import from legacy source with dry-run mode

Public Access

Add POST /manage/import (auth-protected) that fetches emotes from a
legacy JSON endpoint, downloads each image, uploads it to S3, and
inserts it into the DB with the original timestamps preserved.

- Skip emotes whose name already exists (best-effort duplicate detection
  across SQLite and PostgreSQL via error code + message fallback)
- Validate source_url against a configurable host allowlist
  ([import] allowed_hosts in config, default ["smutba.se"])
- dry_run: true previews the import without writing to S3 or DB;
  result statuses are "would_import" / "would_skip" instead of
  "imported" / "skipped"
- Add db.name_exists() for efficient per-name existence checks used
  by dry-run
- Add reqwest (rustls-tls + json) and url dependencies
- Integration tests: auth guard, allowlist rejection, mirror +
  skip-duplicates, dry-run no-persist

This commit is contained in:

Ganonmaster

2026-05-02 02:48:24 +02:00

parent b7365ef1e9

commit 9c5212de05

10 changed files with 915 additions and 4 deletions

									
										Cargo.toml
									
		+2
		
												View File
												
				@@ -23,6 +23,8 @@ mime_guess = "2"

				tokio-util = { version = "0.7", features = ["io"] }

				bytes = "1"

				base64 = "0.22"

				reqwest = { version = "0.12", default-features = false, features = ["rustls-tls", "json"] }

				url = "2"

				[dev-dependencies]

				tower = { version = "0.5", features = ["util"] }