Content Deployment - Commingled Data
Content Deployment enables you to copy the contents of a source Qrvey application, then pass it into a new target application.
Explanation
This article describes how to perform automated Content Deployment on a baseline shared data application and a baseline content application between two Qrvey instances in separate environments and assumes a commingled tenant data model. For more information on data tenancy, please see Multi-tenant Dataset Architecture.
This can be broken into the following high-level steps.
- Prepare Source App(s) for Deployment
- Prepare Target App(s) for Deployment
- Deploy the Master Data App
- Deploy the Master Content App
- The APIs in this tutorial require an encrypted JWT token in the request header. For details, see [Generating Security Tokens](/docs/software-developer/introduction-to-software-development
- Verify that you have at least one user account created in the Qrvey Admin Center with “Composer” role permissions.
How To Guide
Prepare Source App(s) for Deployment
Within the Qrvey Admin Center UI, ensure that you are in a Dev environment and follow these steps:
- Create a target server that points to the Dev instance with the Dev API key. This step will not need to be repeated for all future content deployments.
- Create a release package with a single version that points to the Master Data App.
- Create a release package with a single version that points to the Master Content App.
- Create a deployment definition sourced from the Master Data App release package with the following configuration:
Mode
= Create New ApplicationContent
= Baseline (i.e. all content)New Application Name
= Master Data Application
- Use the following settings for each Connection in your deployment definition:
Host URL = {{connection.host_url}}
Port = {{connection.port}}
Username = {{connection.user_name}}
Password = {{connection.password}}
Database = {{connection.database}}
- Use the following settings for each Dataset in your deployment definition:
- Select the Share Data with Everyone checkbox
- Select the Load Data checkbox
- Create a deployment definition sourced from the Master Content App release package with the following configuration:
Mode
= Create New ApplicationContent
= Baseline (i.e. all content)New Application Name
= Master Content Application
Note: You will see the shared dataset from the Master Data App added as a dependency to the deployment definition for the Master Content App, but that doesn’t mean that the shared dataset will be deployed again. Rather, you will map the source of the dataset views to the correct shared datasets in the target environment at the time the deployment job is executed.
From the Dev environment, use the API to execute the following steps.
Call the GetAllDeploymentDefinitions() endpoint.
Parse the
items
object array in the response body to find the object with thename
property that matchesMaster Data App
, as well as the object wherename
matchesMaster Content App
.Extract the
definitionId
property value from both objects returned in the response, because you will need them for the next API call.Call the ExportDeploymentDefinition() endpoint, passing in the definition ID for the Master Data App deployment definition, making sure to capture the
jobTrackerId
value from the response.Call the ExportDeploymentDefinition() endpoint, passing in the definition ID for the Master Content App deployment definition, making sure to capture the
jobTrackerId
value from the response.Make a call to the GetJobStatus() endpoint for each of the job tracker IDs.
Repeat this step until the response returns a URL path to collect both of the ZIP files for the exported deployment definitions. The time it takes to export a deployment definition is heavily dependent on the number of content objects selected for deployment.You should now have two separate ZIP files, one for the Master Data App and the other for the Master Content App.
Copy the ZIP files to a location that is accessible from the Prod environment before moving to the next steps.
Prepare Target App(s) for Deployment
From the Prod environment, use the API to execute the following steps.
- Call the CreateServer() endpoint and pass in the following request parameters:
name
= any name you wantdescription
= any description you wanthost
= fully qualified URL to this Qrvey instanceapiKey
= your Prod API key
- Parse the response, extract the value from the
adminserverid
property and save it off somewhere so it can be recalled for future deployments. Perform steps 1 and 2 once…and only once. - Call the GetUploadURL() endpoint for deployment definitions and save the
url
andkey
properties from the response. - Use the URL provided to make a separate POST request to upload the ZIP file for the Master Data App to the target S3 bucket.
- Wait for the ZIP file to finish uploading to the target S3 bucket, and then call the UploadDeploymentDefinition() endpoint, setting the following request parameters:
key
= “key” value from the GetUploadURL() responsedefinitionName
= any name you wantdescription
= any description you want that describes the content you are deploying
- Repeat steps 3 - 5 for the ZIP file associated with the Master Content App.
Before you continue, ensure you have at least one user account in the Qrvey Admin Center with “Composer” role permissions.
Deploy the Master Data App
From the Prod environment, use the API to execute the following steps.
- Call the CreateDeploymentJob() endpoint, passing in any name and description that you want.
- Extract the value from the
deploymentJobId
property in the response. - Call the GetAllDeploymentDefinitions() endpoint.
- Parse the
items
object array in the response body to find the object with thename
property that matchesMaster Data App
. - Extract the
definitionId
property value returned in the response, because you will need it for the next API call. - Call the CreateDeploymentJobBlock() endpoint, passing in the following request parameters:
definitionId
= ID of the Master Data App deployment definitionadminServerId
= ID of the target server to deploy the content to (Prod)selectAllUsers
= false
- Extract the
deploymentJobBlockId
value from the response. - Call the GetUserList() endpoint, parse the
items
array to find the user metadata for the account that will become the owner of this app, and then extract the value from the correspondinguserid
property. - Call the AddRecipientsToDeploymentJobBlock() endpoint, using the
deploymentJobId
anddeploymentJobBlockId
as path parameters for calling the endpoint. Use the following request body JSON:
{
"users": [
{
"updateDate": NOW,
"createDate": NOW,
"userid": APP_OWNER_USER_ID,
"parameters": [
{
"token": HOST_URL_PARAM_NAME,
"value": HOST_URL_PARAM_VALUE
},
{
"token": DB_PORT_PARAM_NAME,
"value": DB_PORT_PARAM_VALUE
},
{
"token": DB_USERNAME_PARAM_NAME,
"value": DB_USERNAME_PARAM_VALUE
},
{
"token": DB_PASSWORD_PARAM_NAME,
"value": DB_PASSWORD_PARAM_VALUE
},
{
"token": DB_NAME_PARAM_NAME,
"value": DB_NAME_PARAM_VALUE
}
],
"status": "PUBLISHED",
"email": APP_OWNER_USER_EMAIL,
"deploymentJobBlockId": DEPLOYMENT_JOB_BLOCK_ID
}
]
}
- Make sure you pass values for each of the parameters you created for the shared dataset’s connection information. You should have at least one parameter for each connection’s host URL, which will need to change when you deploy this app and load the shared datasets.
- Call the ExecuteDeploymentJob() endpoint, passing in the value of the
deploymentJobId
as a path parameter to the endpoint. - Parse the
jobTrackerId
value from the response. - Call the GetJobStatus() endpoint, passing in the value for the
jobTrackerId
and wait until thestatus
property has a value ofCREATED
. This endpoint returns lots of useful information about the deployment of the content objects.
Note: You must wait until the Master Data App has finished deploying before continuing with the deployment of the Master Content App.
Deploy the Master Content App
From the Prod environment, use the API to execute the following steps.
- Call the CreateDeploymentJob() endpoint, passing in any name and description that you want.
- Extract the value from the
deploymentJobId
property in the response. - Call the GetAllDeploymentDefinitions() endpoint.
- Parse the
items
object array in the response body to find the object with thename
property that matchesMaster Content App
. - Extract the
definitionId
property value returned in the response, because you will need it for the next API call. - Call the CreateDeploymentJobBlock() endpoint, passing in the following request parameters:
definitionId
= ID of the Master Content App deployment definitionadminServerId
= ID of the target server to deploy the content to (Prod)selectAllUsers
= false
- Extract the
deploymentJobBlockId
value from the response. - Call the GetUserList() endpoint, parse the
items
array to find the user metadata for the account that will become the owner of this app, and then extract the value from the correspondinguserid
property. - Call the GetAllDatasets() endpoint to find the matching dataset IDs for all shared datasets that the dataset views should reference once deployed to the target environment.
- Call the AddRecipientsToDeploymentJobBlock() endpoint, using the
deploymentJobId
anddeploymentJobBlockId
as path parameters for calling the endpoint. Use the following request body JSON:
{
"users": [
{
"updateDate": NOW,
"createDate": NOW,
"userid": APP_OWNER_USER_ID,
"parameters": [
{
"token": SHARED_DATASET_CONTENT_TOKEN_ID,
"value": SHARED_DATASET_ID
}
],
"status": "PUBLISHED",
"email": APP_OWNER_USER_EMAIL,
"deploymentJobBlockId": DEPLOYMENT_JOB_BLOCK_ID
}
]
}
- Call the ExecuteDeploymentJob() endpoint, passing in the value of the
deploymentJobId
as a path parameter to the endpoint. - Parse the
jobTrackerId
value from the response. - Call the GetJobStatus() endpoint, passing in the value for the
jobTrackerId
and wait until thestatus
property has a value ofCREATED
. This endpoint returns lots of useful information about the deployment of the content objects.
Note: The content token for a shared dataset begins with the string
shared_data
. Here is an example of what the content token might look like for a shared dataset called “Demo Data”:{{shared_data.demo_data}}
Note: You should always pass the shared dataset’s ID when setting the content token for a deployment job block, in case there are multiple datasets with the same name in the target environment.
Final Tips
API Endpoints
Here is a consolidated list of the endpoints used in this article.