How to seed my database when cloning an environment and hiding sensitive data

amitpareek · June 4, 2023, 8:17am

Hi ,

I have one question regarding cloning. When cloning the DB, can we do something to obfuscate some part of cloned data? Like you have it on Replibyte? Or how do we set up Replibyte in the process?

I want to clone the DB but do not want user-sensitive info to be available or visible.

Thanks

rophilogene · June 4, 2023, 8:27am

Hi @amitpareek , thanks for asking. Qovery provides all the primitives you need to seed your database when cloning an environment. In the case of Replibyte or even a custom seed script you might want to use, you can use the Lifecycle Jobs feature.

Example

E.g. here is one of my set up where I use a SQL script to seed my database for every new cloned environment.

I have a DB Seed Script Lifecycle Job executed after creating my Postgres database DB.

My DB Seed Script is executed into my stage Migration and seed from my deployment pipeline.

You can take a look at what looks like my DB Seed Script here. Feel free to re-use it.

github.com

Qovery/lifecycle-job-examples/blob/main/examples/seed-postgres-database-with-sql-script/seed.sh

#!/bin/env bash

# set -e at the beginning of the script to cause the shell to exit if any command exits with a non-zero status.
set -e

# set -u to treat unset variables as an error and immediately exit.
# This would reduce the need for manual checks for the presence of environment variables.
set -u

# set -o pipefail to cause the script to fail if any of the commands piped together fail.
set -o pipefail

# Check if psql is installed
if ! command -v psql &> /dev/null; then
  echo "psql could not be found. Please install it and try again."
  exit 1
fi

# Check if curl is installed
if ! command -v curl &> /dev/null; then

This file has been truncated. show original

Resources

Here are two resources you can use to seed your database:

Let me know if you have any other questions.

Topic		Replies	Views
Lifecyle Job Example: How to seed a Postgres database with a simple SQL and Shell script Questions and Answers	1	313	March 25, 2024
Replibyte - a tool to seed your dev database with real data News	0	447	May 7, 2022
Backups of my environments databases Platform Engineering	2	246	March 25, 2024
How to run database migrations? Questions and Answers	2	692	March 25, 2024
After environment variables moved from secret to environment app doesn't deploy Questions and Answers	5	592	August 4, 2021

How to seed my database when cloning an environment and hiding sensitive data

Example

Resources

Related Topics