Harden for production: fsync writes, deployment + backup tooling
All checks were successful
CI / check (push) Successful in 3m55s
All checks were successful
CI / check (push) Successful in 3m55s
The event log is the account/channel authority, so make it durable: persist() now fsyncs every committed event before reporting success, and a serialisation failure is an error instead of a silently-dropped blank line. Add a hardened systemd unit (scripts/echo.service), an atomic gzip backup script with retention (scripts/backup.sh), and a Deployment wiki page (install, durability, backup/restore, upgrade, monitoring).
This commit is contained in:
parent
7d1edefb70
commit
e551a01cbf
4 changed files with 82 additions and 1 deletions
30
scripts/backup.sh
Executable file
30
scripts/backup.sh
Executable file
|
|
@ -0,0 +1,30 @@
|
|||
#!/usr/bin/env bash
|
||||
# Back up Echo's event log. The log is append-only, and compaction replaces it
|
||||
# atomically (temp file + rename), so a plain copy is a consistent snapshot; a
|
||||
# copy taken mid-append has at most a truncated final line, which Echo skips on
|
||||
# load. Run from cron or a systemd timer, e.g. hourly.
|
||||
#
|
||||
# ECHO_DATA_DIR=/opt/echo ECHO_BACKUP_DIR=/opt/echo/backups ./backup.sh
|
||||
#
|
||||
# Restore: stop the service, gunzip a backup over the live log, start again:
|
||||
# systemctl stop echo
|
||||
# gunzip -c /opt/echo/backups/echo.db.<stamp>.jsonl.gz > /opt/echo/echo.db.jsonl
|
||||
# systemctl start echo
|
||||
set -euo pipefail
|
||||
|
||||
DATA_DIR="${ECHO_DATA_DIR:-/opt/echo}"
|
||||
BACKUP_DIR="${ECHO_BACKUP_DIR:-$DATA_DIR/backups}"
|
||||
KEEP="${ECHO_BACKUP_KEEP:-48}"
|
||||
LOG="$DATA_DIR/echo.db.jsonl"
|
||||
|
||||
[ -f "$LOG" ] || { echo "no event log at $LOG" >&2; exit 1; }
|
||||
mkdir -p "$BACKUP_DIR"
|
||||
|
||||
stamp=$(date -u +%Y%m%dT%H%M%SZ)
|
||||
dest="$BACKUP_DIR/echo.db.$stamp.jsonl.gz"
|
||||
gzip -c "$LOG" > "$dest.tmp"
|
||||
mv "$dest.tmp" "$dest"
|
||||
echo "backed up $LOG -> $dest ($(du -h "$dest" | cut -f1))"
|
||||
|
||||
# Keep the most recent $KEEP backups.
|
||||
ls -1t "$BACKUP_DIR"/echo.db.*.jsonl.gz 2>/dev/null | tail -n +"$((KEEP + 1))" | xargs -r rm -f
|
||||
Loading…
Add table
Add a link
Reference in a new issue