tftsr-devops_investigation/LIBSODIUM_FIX_SUMMARY.md
Shaun Arman 44ba1bd4e7
All checks were successful
Test / frontend-tests (pull_request) Successful in 1m45s
Test / frontend-typecheck (pull_request) Successful in 1m52s
PR Review Automation / review (pull_request) Successful in 3m54s
Test / rust-fmt-check (pull_request) Successful in 12m41s
Test / rust-clippy (pull_request) Successful in 14m10s
Test / rust-tests (pull_request) Successful in 16m1s
fix(ci): use vendored libsodium build instead of pkg-config
## Problem
Previous approach with SODIUM_USE_PKG_CONFIG=1 still failed:
"libsodium not found via pkg-config or vcpkg"

pkg-config couldn't locate libsodium.pc in CI containers despite
libsodium-dev being installed.

## Solution
Use vendored build approach: Remove all SODIUM_* environment variables
and let libsodium-sys-stable build from source automatically.

## Changes
- **release-beta.yml**: Removed SODIUM_USE_PKG_CONFIG from linux-amd64 and linux-arm64
- **auto-tag.yml**: Removed SODIUM_USE_PKG_CONFIG from linux-amd64 and linux-arm64
- **Windows**: Kept SODIUM_LIB_DIR approach (uses pre-built from Dockerfile)

## Why This Works
libsodium-sys-stable build priority:
1. SODIUM_LIB_DIR (if set) → use pre-built
2. SODIUM_USE_PKG_CONFIG (if set) → use pkg-config
3. Neither set → build from source (vendored) 

Vendored builds are more reliable in CI as they don't depend on
system package installation or pkg-config configuration.

## Validation
 Local clean build with vendored libsodium: passed
 CI validation: pending

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
2026-06-14 04:48:51 -05:00

6.5 KiB

libsodium Build Failures - Root Cause Analysis & Fix

Issue Summary

All three CI build platforms (linux-amd64, windows-amd64, linux-arm64) were failing with libsodium detection errors in libsodium-sys-stable v1.24.0.

Error Details

linux-amd64 & linux-arm64:

libsodium not found via pkg-config or vcpkg

windows-amd64:

SODIUM_LIB_DIR is incompatible with SODIUM_USE_PKG_CONFIG. 
Set the only one env variable

Root Cause

The libsodium-sys-stable crate (dependency chain: tauri-plugin-strongholdstronghold_enginelibsodium-sys-stable) has strict requirements for environment variable configuration:

  1. Linux builds require SODIUM_USE_PKG_CONFIG=1 to use pkg-config detection
  2. Windows builds require either:
    • SODIUM_LIB_DIR pointing to the pre-built library directory, OR
    • SODIUM_USE_PKG_CONFIG for pkg-config detection
    • BUT NOT BOTH (mutually exclusive)
  3. Cross-compilation requires proper PKG_CONFIG_PATH setup to find architecture-specific .pc files

Original Configuration Issues

release-beta.yml (beta branch releases):

  • linux-amd64: Missing SODIUM_USE_PKG_CONFIG=1
  • windows-amd64: Set SODIUM_LIB_DIR: "" (empty string) which conflicts with implicit pkg-config attempt
  • linux-arm64: Missing SODIUM_USE_PKG_CONFIG=1, incomplete PKG_CONFIG_PATH

auto-tag.yml (master branch releases):

  • linux-amd64: Already had SODIUM_USE_PKG_CONFIG=1
  • windows-amd64: Already had correct configuration
  • linux-arm64: Had SODIUM_USE_PKG_CONFIG=1 but incomplete PKG_CONFIG_PATH

Solution

Revised Approach: Use Vendored libsodium Build

After initial attempt with SODIUM_USE_PKG_CONFIG=1 still failed (pkg-config couldn't find libsodium.pc in CI containers), switched to the vendored build approach: remove all SODIUM_* environment variables and let libsodium-sys-stable build from source.

Changes to .gitea/workflows/release-beta.yml

1. Linux amd64 Build

env:
  APPIMAGE_EXTRACT_AND_RUN: "1"
  # Removed SODIUM_USE_PKG_CONFIG - let it build from source

Why: Vendored build is more reliable in CI. libsodium-sys-stable will download and compile libsodium from source automatically.

2. Windows amd64 Build

env:
  CC_x86_64_pc_windows_gnu: x86_64-w64-mingw32-gcc
  CXX_x86_64_pc_windows_gnu: x86_64-w64-mingw32-g++
  AR_x86_64_pc_windows_gnu: x86_64-w64-mingw32-ar
  CARGO_TARGET_X86_64_PC_WINDOWS_GNU_LINKER: x86_64-w64-mingw32-gcc
  OPENSSL_NO_VENDOR: "0"
  OPENSSL_STATIC: "1"
  SODIUM_LIB_DIR: /usr/x86_64-w64-mingw32/lib  # Changed from ""
  SODIUM_STATIC: "1"                           # Changed from "yes"
  SODIUM_USE_PKG_CONFIG: "no"                  # Added (explicit disable)

Why:

  • Points SODIUM_LIB_DIR to the actual pre-built libsodium location (installed by Dockerfile.windows-cross)
  • Explicitly disables pkg-config to prevent conflict
  • Standardizes SODIUM_STATIC to "1" (matches auto-tag.yml)

3. Linux arm64 Build

env:
  CC_aarch64_unknown_linux_gnu: aarch64-linux-gnu-gcc
  CXX_aarch64_unknown_linux_gnu: aarch64-linux-gnu-g++
  AR_aarch64_unknown_linux_gnu: aarch64-linux-gnu-ar
  CARGO_TARGET_AARCH64_UNKNOWN_LINUX_GNU_LINKER: aarch64-linux-gnu-gcc
  PKG_CONFIG_SYSROOT_DIR: /usr/aarch64-linux-gnu
  PKG_CONFIG_PATH: /usr/lib/aarch64-linux-gnu/pkgconfig:/usr/aarch64-linux-gnu/lib/pkgconfig
  PKG_CONFIG_ALLOW_CROSS: "1"
  # Removed SODIUM_USE_PKG_CONFIG - let it build from source
  OPENSSL_NO_VENDOR: "0"
  OPENSSL_STATIC: "1"
  APPIMAGE_EXTRACT_AND_RUN: "1"

Why:

  • Vendored build approach for consistency with linux-amd64
  • Cross-compilation toolchain env vars still needed for the C compiler

Changes to .gitea/workflows/auto-tag.yml

Linux amd64 & arm64 Builds

Removed SODIUM_USE_PKG_CONFIG=1 from both builds to match release-beta.yml vendored approach.

Technical Details

Docker Image libsodium Installation

Dockerfile.linux-amd64:

RUN apt-get install -y -qq --no-install-recommends \
    libsodium-dev \
    ...

Installs to: /usr/lib/x86_64-linux-gnu/ with pkgconfig in /usr/lib/x86_64-linux-gnu/pkgconfig/

Dockerfile.linux-arm64:

RUN apt-get install -y -qq --no-install-recommends \
    libsodium-dev:arm64 \
    ...

Installs to: /usr/aarch64-linux-gnu/lib/ with pkgconfig in /usr/aarch64-linux-gnu/lib/pkgconfig/

Dockerfile.windows-cross:

RUN set -eu \
    && SODIUM_VER="1.0.20" \
    && curl -fsSL "https://download.libsodium.org/libsodium/releases/libsodium-${SODIUM_VER}.tar.gz" \
       | tar -xz -C /tmp \
    && cd "/tmp/libsodium-${SODIUM_VER}" \
    && ./configure \
         --host=x86_64-w64-mingw32 \
         --prefix=/usr/x86_64-w64-mingw32 \
         --disable-shared \
         --enable-static \
    && make -j"$(nproc)" \
    && make install \
    && rm -rf "/tmp/libsodium-${SODIUM_VER}"

Installs to: /usr/x86_64-w64-mingw32/lib/libsodium.a

libsodium-sys-stable Build Logic

From the error messages, the crate's build.rs checks in this order:

  1. If SODIUM_LIB_DIR is set AND SODIUM_USE_PKG_CONFIG is set → ERROR (mutually exclusive)
  2. If SODIUM_LIB_DIR is set → use direct library path
  3. If SODIUM_USE_PKG_CONFIG is set → use pkg-config
  4. Try pkg-config automatically
  5. Try vcpkg
  6. If all fail → panic with "libsodium not found via pkg-config or vcpkg"

Testing Strategy

Pre-merge Testing

  1. Local syntax validation (yaml parsing)
  2. Git diff review
  3. Push to beta branch and monitor CI runs

Post-merge Validation

  1. Verify all four platform builds succeed in release-beta.yml workflow
  2. Check artifact uploads complete successfully
  3. Download and smoke-test each platform binary

Files Modified

  • .gitea/workflows/release-beta.yml - 3 build job environment sections
  • .gitea/workflows/auto-tag.yml - 1 build job environment section (linux-arm64)
  • PR #101: Initial Windows memset_explicit fix (addressed different issue)
  • PR #102: This fix (libsodium detection across all platforms)

Success Criteria

All platform builds in release-beta.yml workflow must:

  • Complete cargo build without libsodium errors
  • Generate platform-specific bundles (.deb, .rpm, .exe, .msi, .dmg)
  • Successfully upload artifacts to Gitea releases
  • Exit with code 0

References