Introduction to Datasets

A Qrvey dataset is a structured collection of data used to build dashboards and visualizations within the Qrvey platform. Datasets form the foundation of analytics in Qrvey, defining how data is imported, transformed, stored, and made available for dashboards, reports, and other analytical tools.

Types of Datasets

Qrvey supports the following types of datasets to address distinct use cases.

Dataset Type	Storage	Data Transformation	Real-Time	Joins	Views	Primary Use Case
Managed	Qrvey-Indexed	Yes	No	Yes	Yes	Analytics, dashboards, reports.
Dataset View	Reference	No	No	No	Yes	Share data across applications without duplicating data.
Base	S3/Blob File	Limited	No	Yes	No	Join optimization.
Live Connect	At Source	No	Yes	No	No	Real-time dashboards.
Custom	Snapshot	No	No	No	Yes	Snapshots for advanced analysis or sharing.

Note: Managed datasets, dataset views and base datasets are only available in Qrvey Ultra.

Managed Datasets

Managed datasets store data inside Qrvey’s Elasticsearch-based repository.

• Data is imported and indexed within Qrvey, making it available even if the original connection is offline.
• Supports data transformations, scheduled imports, and full indexing.
• Enables fast performance for dashboards, filters, aggregations, and large-scale analytics.
• Great for any size of dataset, that does not require real-time updates.
• Common use cases: reports, analytics, and so on.

Dataset Views

Dataset Views provide a materialized view of a managed dataset.

• Points to a managed dataset (can be in another application), without duplicating data.

• Cannot alter or add to the source data (cannot be transformed, no joins/unions, and so on.)

• Can superficially hide or redact data (for example, hide columns), set RLS and CLS differently, and so on.

• Common use case: Simplifies dataset design in commingled datasets.

  • Inject tenant-level filtering and security without duplicating data.
  • Maintain one managed dataset, then create dataset views with custom-tailored columns and permissions for different applications and users.
  • When you synchronize the main dataset, all the dataset views are synced as well.

Base Datasets

Base datasets are similar to managed datasets, but data is stored as a file in S3 or Blob Storage. Only used as a data source within other managed datasets.

• Can be shared and referenced in other applications (see platform documentation for sharing instructions).
• Managed datasets (including those with geolocation, internationalization, or shared status) can be saved as base datasets. Saving a shared managed dataset as a base dataset does not make the base dataset shared by default.
  • Used to speed up joins in managed datasets. Joining base datasets is faster than managed datasets.
  • Offers fewer features than managed datasets, due to limitations that arise from being stored in files.
  • Cannot create dataset views from shared base datasets.
  • Not recommended to create base datasets from existing managed datasets unless optimizing for downstream performance; should generally be sourced from a Connection.
  • Can be joined with any other dataset type.
  • Common use cases: intended for use as join sources within managed datasets.

Live Connect Datasets

Live Connect Datasets provide direct, real-time access to data at its source (for example, SQL, REST API).

• Qrvey runs live queries at runtime; no data is stored or indexed in Qrvey.
• Ideal for real-time or near real-time data needs.
• Performance depends on the source system and can be slower for complex queries.
• Joins, Unions, and Formulas are not supported. These must be performed in the source.
• Limited support for advanced analytics on large tables.
• Performance depends on the source database design, including: partitioning, indexes and keys, monitoring source for concurrency, auto-scaling, and so on.
• Common use cases: real-time dashboards, always-fresh operational data.

Custom Datasets

Custom Datasets are created by exporting data from a dataset in a dashboard to be used for advanced analysis, pivoting, or sharing a snapshot of your data.

• Custom datasets are listed in the Data section with a distinct Type label: Custom and are managed separately from other datasets.
• They are automatically kept up to date based on the sync schedule of the source dataset (at most every 12 hours).
• Custom datasets cannot be edited in the design page, and their sync schedule is always tied to the source dataset.

Create a Dataset

1. Navigate to the Data Module and make sure you are in the Datasets tab.
2. Select Create New Dataset. From the dropdown menu, you can create one of the following:
   • New Managed Dataset
   • New Live Connect Dataset
   • New Base Dataset
3. Configure as needed.

Configure a Dataset

To manage a dataset, follow these steps:

1. Navigate to Data > Datasets.
2. Select the dataset.
3. Configure and manage the dataset as needed.

You'll find configuration options under three main tabs: Design, Analyze, and Activity Log.

Design

When you create a dataset, you can customize it in the Design tab.

Analyze

The Analyze tab provides a suite of tools for analyzing datasets. These visualizations can be added into Dashboards and embedded as widgets.

Summary View

Every dataset connected to Qrvey generates a Summary view, offering a quick overview of your data. Access it by selecting a dataset and selecting the Analyze tab.

Each column/field is displayed with relevant summary statistics. Numeric fields are visualized using bar charts, while other field types can use different visual representations.

Options in the panel's top-right menu: Download, Apply Filters, Formulas, and Buckets.

Tabular View

The Tabular view presents data in a spreadsheet format.

Options in the panel's top-right menu: Filters, Formulas, and Buckets.

More Options:

• Filter, Sort, and Show/Hide columns.
• Drag to reorder or resize columns.
• Apply aggregate functions using the option (three-dot) menu in column headers.
• Numeric fields offer multiple aggregation options, with results displayed in the column footer.

Custom View

Custom View treats the Analyze area similar to a Dashboard to create custom visualizations.

1. Navigate to the Analyze tab and select Custom View.

   

2. Select Add Chart to open the Chart Builder.

3. Select the chart's options (three-dot) menu and use the "Size" option to adjust its size.

Options in the panel's top-right menu: Edit, Download, Duplicate, or Delete.

Metric View

The Metric View highlights key performance indicators using different visual formats.

To create a metric:

1. Navigate to the Analyze tab and select Metric View to open the Chart Builder.
2. Choose a metric type: Indicator, Bullet, or Gauge.
3. Drag data into the fields shelf or canvas and style as needed.

Activity Log

Each dataset has its own Activity Log.

Browse Datasets

1. Navigate to Data > Datasets to browse all datasets within the application.
   Each dataset is displayed as a card, displaying the following details:
   • Name — The name assigned to the dataset.
   • Type — Notes if it a Managed or a Live Connect dataset.
   • Status — active (ready to create visualizations), draft (dataset is still loading), or failed (dataset is not properly loaded).
   • Last Loaded — The date that the data was loaded.
   • Data Sync — Indicates if Data Sync is On or Off.
   • Data Source — The connection used by this dataset.
   • Records — Number of records within the dataset.
   • Columns — Number of columns within the dataset.

Mark Dataset as Favorite

To mark a Dataset as a favorite, follow these steps.

1. Navigate to Data > Datasets.
2. Locate the dataset card and select the star in the upper-right corner.

Rename a Dataset

1. Locate the dataset card.

2. Select its name.

3. Add the new text.

   

Share and Un-Share Datasets

By default, datasets are only accessible in the application in which they are created.

1. Navigate to Data > Datasets.
2. Find the dataset and select its option (three-dot) menu.
3. Select either Share Data with my Organization or Unshare with my Organization to open a modal.
4. Confirm your choice in the modal and return to Data > Datasets.

Note: If unshared, any existing datasets and dataset views created from this dataset are no longer available to users building charts and metrics. Any existing charts and metrics that have a dependency on this dataset no longer display data.

Delete a Dataset

1. Navigate to Data > Datasets.
2. Find the dataset and select its options (three-dot) menu.
3. Select Delete to open a modal.
4. Select Delete to confirm your choice in the modal and return to Data > Datasets.

Set a Record-Level Security Column

For Record-Level Security, assign a security name:

1. Select the column's three-dot menu > Enable Record-Level Security.

   

2. Enter a security name and confirm.

For more information, see Record-Level Security.

Remove Record-Level Security Column

To remove security from the dataset:

1. Select the options (three-dot) menu.
2. Select Record-Level Security.
3. Select Remove to reset the dataset configuration.