Configure tracker and vendor discovery (XL Scan)
Access Type: Compliance Report - Editor
Premium Feature: XL Scan
The Didomi tracker and vendor discovery (XL scan) is a tool that enables your organization to generate a comprehensive scan of your domain (up to 20,000 pages) and receive a GDPR compliance evaluation from a Didomi perspective. In this article, we will cover how to configure a tracker and vendor discovery (XL scan) for your organization.
Note: XL scan is a premium feature for your organization's Didomi account. Please contact your Didomi representative for more information.
Click Tracker and Vendor Discovery on the left-hand panel and select Add Domain on the subsequent page.
Select XL Scan in the next modal.
Use the provided fields to input the following information:
Give this domain a recognisable name
Internal name used to identify the domain
Target domain
URL of the domain that will be scrapped by the Didomi bot for the tracker and vendor discovery
Example: https://demosite.com
Launched from
Select a country from which the Didomi bot scans. Since the Didomi bot mimics an end-user's behavior (including the location from which the end-user accesses a domain), this field enables the Didomi bot to experience the CMP behavior targeted at end-users in a specific country.
Regulation
Select a regulation that the tracker and vendor discovery XL scan supports.
When configuring the domain for an XL scan, your organization has the option to specify the pages to scan either via:
Auto page discovery
Select the Auto page discovery card to enable the Didomi bot to automatically crawl pages (up to 20,000 pages) for the domain.
Manual input
Select the Manual input card to specify the exact URLs to scan and click Download CSV template.
The csv template will be downloaded onto your machine. Open the file and add the exact URLs that should be scanned by the Didomi bot. When finished, drag and drop the csv file into the provided space.
For XL scans, your organization can select a single default or customized bot scenario to run for the scan.
Accept all
Will locate and click the action to accept all purposes from the first layer of the consent notice.
Refuse all
Will locate and click the action to reject all purposes from the first layer of the consent notice.
No actions
Will perform no actions on the consent notice and/or domain
Custom
Fully customized instructions for the bot to perform
All bot scenarios can be customized with additional instructions when configuring a tracker and vendor discovery (XL scan). For example, your organization can add instructions in the case where your refuse all button is only present on the second layer of your consent notice or if your organization utilizes a multi-step login form for the domain being scanned.
Expand the accordion below for more information on customizing a bot scenario:
Tracker and vendor discovery (XL scan) - Customize bot scenario
In order to customize a bot scenario either expand the accordion for an existing scenario or click Add scenario.
When customizing a default or custom scenario your tracker and vendor discovery your organization can select four different instructions to give to the Didomi bot:
The default scenarios Accept All and Refuse All that are provided by Didomi will always include an Accept and Refuse instruction, respectively. These actions can not be removed from the default scenarios.
Accept
Will locate and click the action to accept all purposes in the consent notice (either programmatically or via specified CSS selector)
Note: This instruction can only be included in a scenario once and will prohibit the use of the Refuse instruction in the same scenario.
Refuse
Will locate and click the action to refuse all purposes in the consent notice (either programmatically or via specified CSS selector).
Note: This instruction can only be included in a scenario once and will prohibit the use of the Accept instruction in the same scenario.
Click
Will click on the specified element (identified by the CSS selector).
Fill in
Will navigate to an input field (identified by the CSS selector) and input the configured text.
For the Click and Fill in instructions, your organization can find the CSS selector by performing the following:
Navigate to your website and load your consent notice
Right-click the desired element on the consent notice where the Didomi bot should click (or insert text)
Select Inspect from the subsequent menu
The element should be highlighted in the Inspector. Right-click the highlighted item in the Inspector and select Copy > Copy selector (or CSS Selector depending on browser).
Repeat as necessary for elements that the Didomi bot will need to click in order to achieve the desired behavior.
Review the table below for actions that can be taken when configuring a scenario:
CSS selector
Enables your organization to direct the Didomi bot to identify an element and execute the desired action.
Label
Each instruction has an optional Label field where your organization can add an internal label to the instruction. This label can be useful in identifying the action taken in the tracker and vendor discovery results.
Reorder instructions
Use the provided arrows to the left of an instruction to order the instructions into the desired sequence.
Next, expand the Compliance Recommendations accordion to select/deselect the factors that will be used to calculate the Didomi rating for the domain.
All factors are enabled by default and will be used to calculate the Didomi rating for your domain unless otherwise configured.
The Didomi tracker and vendor discovery (XL scan) utilizes a bot to scan your configured domains and extract the information relevant to your compliance with GDPR regulations. Defining a custom user agent provides extra security for your domain and eliminates the need to whitelist the default user agent utilized by the Didomi bot.
If required, expand the Advanced tab and use the User agent field to define a custom user agent (UA) that will be used by the Didomi bot while scanning.
If required, expand the Scan logged in environment to configure instructions for the Didomi bot to access a domain that requires credentials.
Didomi currently does not support two-factor authentication (2FA) scanning.
Tracker and vendor discovery (XL scan) - Scan logged in environment
In this section we will cover how to configure a tracker and vendor discovery (XL scan) for a:
Single-step (combined) login
If the login form used by the domain is a traditional login form where the credentials are collected and submitted in a single interaction then your organization can utilize the Scan logged in environment feature.
From the expanded the Scan logged in environment accordion enable the checkbox for Scan logged environment.
Your organization will be prompted to input required credentials and/or optional CSS selectors to aid the Didomi bot in accessing the domain and performing its XL scan.
Login page URL
Login form where URL is present
Username
Username that will be used by the Didomi bot to log into your website
Password
Password associated with the username that will be used by the Didomi bot to log into your website
Note: The password is encrypted by Didomi to avoid causing any security breaches.
Username CSS selector
The Didomi bot will automatically attempt to insert the username when accessing your website. Your organization can directly configure the Didomi bot's actions when selecting and inserting the username by giving it the CSS selector of the appropriate field. See the hint below for how to find the CSS selector
Password CSS selector
The Didomi bot will automatically attempt to insert the password when accessing your website. Your organization can directly configure the Didomi bot's actions when selecting and inserting the password by giving it the CSS selector of the appropriate field. See the hint below for how to find the CSS selector
Submit button CSS selector
The Didomi bot will automatically attempt to click the submit button after inserting the username and password when accessing your website. Your organization can directly configure the Didomi bot's actions when selecting the submit button by giving it the CSS selector of the appropriate field. See the hint below for how to find the CSS selector
Your organization can find the CSS selector by performing the following:
Navigate to your website
Right-click the desired element in the login form where the Didomi bot should click (or insert text)
Select Inspect from the subsequent menu
The element should be highlighted in the Inspector. Right-click the highlighted item in the Inspector and select Copy > Copy selector (or CSS Selector depending on browser).
Repeat as necessary for elements that the Didomi bot will need to click in order to achieve the desired behavior.
Multi-step login
If the login form used by the domain is a multi-step form where end-users provide credentials in separate steps (such as the identifier-first login used by Google or Microsoft) then your organization will need to manually customize the scenario in the tracker and vendor discovery (XL scan).
Note: When configuring a scan for a domain that utilizes a multi-step login, do not enable the Scan logged in environment feature.
Additionally, please be aware that Didomi does not provide password encryption Didomi-side for multi-step login forms.
Before continuing your organization will need to retrieve the CSS selectors for each element the Didomi bot will interact with when logging into your domain.
Navigate to your website
Right-click the desired element in the login form where the Didomi bot should click (or insert text)
Select Inspect from the subsequent menu
The element should be highlighted in the Inspector. Right-click the highlighted item in the Inspector and select Copy > Copy selector (or CSS Selector depending on browser).
Repeat as necessary for elements that the Didomi bot will need to click in order to achieve the desired behavior.
With the CSS selectors copied, expand the accordion for the scenario used in the tracker and vendor (XL scan) and utilize the Add an instruction tools to select the first step in the login flow.
Depending on the instruction selected, your organization will need to input the following:
Click
CSS selector
Fill in
Text to input into the field for your login form
CSS selector of the field where an end-user inputs the text
Repeat as necessary to reproduce the sequential steps needed to successfully login. When finished, use the provided arrows to ensure that the login steps precede any actions performed for the consent notice.
Confirm that you own the domain or acting on behalf of the domain owner to run the discovery and click Save & Run Discovery when finished.
Once successfully added, Didomi will run a discovery for the domain. Once the discovery is complete, the scan will be annotated with a Discovery Complete label.
Click Details inline with the tracker and vendor discovery (XL scan).
The following page provides details about the discovery and allows your organization view a recording of how the Didomi bot interacted with your domain and download a list of discovered pages.
Generate the tracker and vendor discovery (XL scan) by clicking Run XL scan
A subsequent modal will relay the number of XL scans contracted for by your organization, the number of XL scans used, and remaining scans.
Click Proceed with Scan.
Last updated