Data export

Access Type: Marketplace Manage - Editor

Premium Feature: Any data export premium feature (CMP, PMP, or ACM)

Data export enables organizations to automatically export your organization's Didomi data to external cloud storage platforms or secure SFTP servers. In this article, we will cover the following in regards to data exports:

• Overview

• Export data types

• Export destinations

• csv files

Note: The data that can be exported will depend on the data export premium feature you have enabled for your organization and the export destination.

---

Overview

Data export provides a seamless integration with your existing data infrastructure and allows your organization to perform enhanced analysis and reporting outside of the Didomi ecosystem. Below is an overview of capabilities offered via data export:

Cloud and SFTP support	Export to AWS S3, Snowflake, or secure SFTP servers. Click here for more information.
Daily automated exports	Automated daily exports with data from the previous day. Note: Daily exports is on a predetermined schedule and is not configurable. The exact time of export may vary.
Multiple data types	Access to raw tracker data, aggregated vendor information, property-level compliance metrics, SDK and API metrics.
Formats	Export data in CSV, Parquet, or Snowflake sync
Secure authentication	Enterprise-grade security with encrypted credential storage. Data transmission occurs over secure protocols (https/SFTP) and only contain your organization's data.
Connection testing	Built-in validation to ensure proper configuration before activation

The maximum file size exported to your configured destination is dependent on your organization's data volume and destination limits. Please be advised that:

• Large datasets may take longer to export

• Network bandwidth affects transfer times

• Destination storage costs apply based on usage

• Exported data retention is managed by your destination storage policies

Export data types

The data that can be exported will depend on the data export premium feature you have enabled for your organization and the export destination. Refer to the table below for more information on each export data type:

Click here for additional information for each export data type.

Export data	Destinations	Description
ACM Trackers	AWS S3 SFTP Server Snowflake	Raw data for individual tracking events detected during scans.
ACM Vendors	AWS S3 SFTP Server Snowflake	Consolidated information about vendors detected across your properties, aggregated by consent scenarios
ACM Properties	AWS S3 SFTP Server Snowflake	Consolidated information that aggregates property-level compliance status and collection results
API events	Snowflake	Raw data for events generated by the Didomi API
CMP SDK events	Snowflake	Raw data for events generated by the Didomi CMP SDK
PMP SDK events	Snowflake	Raw data for events generated by the Didomi PMP SDK

Export destinations

Note: Support for Google Cloud Platform (GCP) Storage and Microsoft Azure Blob Storage coming soon.

When configuring your data export, your organization can pick from the following export destinations:

• Amazon Web Services (AWS) S3

• SFTP Server

• Snowflake

Amazon Web Services (AWS) S3

Review the table below for required and optional configuration fields to export data to Amazon Web Services (AWS) S3:

Requirements: S3 bucket with appropriate IAM role permissions.

Configuration Field	Description
Bucket name	Name of your organization's S3 bucket
Bucket key (optional)	Path to the object inside the S3 bucket
Region	AWS region where your organization's bucket is located
STS Role ARN	AWS IAM role ARN for secure access

SFTP Server

Review the table below for required and optional configuration fields to export data to an SFTP server:

Requirements: SFTP server with write permissions

Configuration Field	Description
SFTP Server Host	Server hostname or IP address
Username	SFTP username for authentication
Password	SFTP password for authentication

Snowflake

Review the table below for required and optional configuration fields to export data to Snowflake:

Requirements: Ensure that the Admin account configuring the data export within Snowflake has an email associated with their account.

Configuration Field	Description
Snowflake consumer account	ID for a Snowflake account that receives and queries data shared by another account (the provider) via Secure Data Sharing, without copying or storing the actual data itself

Once configured in Didomi, your organization can find the Didomi data being shared with your Snowflake account under Privately shared listings.

The data types selected for the export will determine how many shared listings populate in your Snowflake account. CMP events, PMP events, and API events will be group together in one listing and ACM data will be grouped in a separate listing.

Once the listing(s) are available in your Snowflake account, click Get and follow the instructions to create a local database from the shared listing.

Note: Be advised that the operation can take multiple hours to load the data

The created database from the shared listing will behave like a read-only database and enable your organization to query the tables directly.

csv files

csv files is an option for the export format which is excel compatible, human-readable, and easy to import into analytics tools.

Delivered files have a header row with column names and utilize UTF-8 encoding. Files are organized in a partitioned folder structure by data type and export date:

CSV/
├── acm_trackers/
│   └── date=<date_of_export>/
│       └── file.csv
├── acm_vendors/
│   └── date=<date_of_export>/
│       └── file.csv
└── acm_properties/
    └── date=<date_of_export>/
        └── file.csv