Configuring the B2B Customers Data Product
This topic describes how to configure the B2B Customers data product.
Adding Data to Your Data Product
Add input data to a data product using a previously uploaded source data file. To learn how to upload sources to Tamr Cloud, see Managing Source Datasets.
To add datasets, go to the Configure Data Product tab, also known as the Settings page. Select the input dropdown to add your sources. Add sources one at a time by selecting the input then Add Source.
Configuring Attributes
Automapping Attributes
Tamr quickly helps you quickly map source columns to appropriate attributes in the predefined unified schema and custom attributes, by:
- Identifying source columns that match previously mapped source columns. AutoMap applies the same mapping for the matching columns.
- Identifying source columns that match unified schema attributes. AutoMap maps these columns to their matching unified schema attributes.
When automapping, Tamr considers columns and attributes to be a match when they contain the same words, not including delimiter characters, plural words, and partial matches. Delimiters recognized include camel case, but not lower case characters. Tamr does not automatically map two columns from a single source to the same output attribute, and does not create an output attribute if no match is found for a selected column.
Two names are considered a match if the names are an exact match when split on:
- The following characters:
- \ _ ( ) / \
- The boundary between lowercase and uppercase letters.
- The boundary between letters and numbers.
- Whitespace characters.
Example | Resulting Action |
---|---|
Match cases | Match: addressLine1 , address_line_1 , and Address Line (1) These 3 columns would be mapped to the unified schema attribute address_line_1 . |
Delimiters accepted | Match: company_id and company id These 2 columns would be mapped to the unified schema attribute company_id . |
Delimiters not accepted | No match: : address|Line|1 and addressLine1 No mapping. Pipe character delimiters are not accepted. |
Plurals | No match: region and regions No mapping. |
Partials | No match: Primary Street Address and Street Address No mapping. |
Mapping Attributes
To map an input attribute from your source, you select the dropdown in your source’s column, and then choose an appropriate value. You can select the icon next to the source name to see a preview of the dataset and help you best determine how to map each attribute.
When mapping attributes, there are required, suggested, and optional attributes for you to map:
- Required: You must map source columns to these attributes. You cannot refresh your data until you do this.
- Suggested: For optimal data quality, enrichment, and clustering results, map source columns to these attributes.
- Optional: These attributes have minimal impact on your clustering and enrichment results. If your source data includes columns that match these attributes, map them to include that source data in your completed data product.
For example, in the image below, the primary key attribute needs to be mapped. Additionally, you can see Tamr Cloud automatically mapped an attribute for Company Name. Alternative names is not required, but you can choose to map the attribute.
Adding Custom Attributes
At the bottom of the attribute list, you can add and map any custom attributes from your source data.
Custom attribute names must be unique and can contain only lowercase letters (a-z), numbers (0-9), and underscores (_).
Record Consolidation Rules
Record consolidation rules create a single golden record, also called the mastered entity record, which best represents a cluster of similar source records.
You can configure rules that determine the appropriate values from the cleaned, standardized, and validated source records to include in the golden record.
Note: By default, these rules select address values from the enhanced source records, which have been cleaned, validated, and standardized by the address data quality services. To use the original address values in the golden records, change the Use Address Enrichment Results in Golden Records setting in the Address Standardization section, as described in Configuring Address Standardization section below.
Select the attribute name to set rules.
You can set attributes to be consolidated to:
- Tamr-recommended value (default). See Tamr Recommended Record Consolidation Rules for the recommended rules for each attribute.
- Distinct values. When you consolidate an attribute to its distinct values, Tamr Cloud concatenates all the attribute’s unique values into a pipe-delimited string.
- Most common value
- Longest value
For Address attributes, configure record consolidation rules at the group level. Select the name of the group (Primary, Office, and so on) to open the configuration rules. In the example below, the primary address attributes are consolidated to the most common primary address from the source record cluster.
Writing Consolidation Rules
When you consolidate an attribute to its distinct values, or the most common or longest value, you can add further conditions to exclude records with empty attributes, or exclude, constrain, or prioritize records based on certain attribute values. See the below examples to understand how the following conditions work.
Exclusion Example
For example, in the image below, Address is set to the most common value, with the condition to exclude any records with empty values for City. This means records with empty values for the specified attribute will be excluded when identifying the most common value from the clustered source records.
Constraint Example
You could set Company Name to the most common value, when considering only records containing the maximum number in the Founding Year column.
Below, Company Name is set to the most common value, when considering only records with the most common value in the Country column.
Prioritization Example
When you prioritize a dataset, this means that when there is a tie for the most common or longest value, the attribute from the prioritized dataset is chosen. Any datasets not specified in the rule are considered lowest priority. In the image below, Postal Code is set to the longest value, with the condition to prioritize records from the source b2b_customers_le_sf_firmographic
and exclude records from the source b2b_customers_le_phone_url
.
Configuring Uniformity Score
For each attribute, select whether to calculate the uniformity score. The uniformity score provides insight into how similar the values for this attribute are within the source record cluster. Uniformity scores range from 0 to 1. A uniformity score of 1 for an attribute means that all records in the cluster have the same value for this attribute, while a uniformity score of 0 indicates that all records in this cluster have different values for this attribute.
Null values are not included when calculating the attribute uniformity score. If all values for the attribute in the cluster are null, a null uniformity score is returned.
When you select to calculate the uniformity score of an attribute, a uniformity score icon appears next to the attribute name.
Additionally, Tamr automatically calculates the overall uniformity score for each cluster, which indicates how similar clustered source records are to each other. Null values are not included when calculating this score.
Selecting Company Validation
Tamr validates that your company records are associated with real-world organizations. After matching a company to a real-world organization, Tamr enriches that company's golden record with attributes from your selected enrichment provider.
Company validation can be performed using either a corpus of public organization data (basic), or a corpus of both public and premium organization data (premium).
Basic validation is faster than premium validation, and provides the best results when your company data includes mainly corporate headquarters. If you are using enrichment from one of the public sources, basic company validation is selected automatically. If you would like to use premium company validation, contact Tamr ([email protected]) to discuss licensing.
Premium validation is best when your company data includes mainly subsidiaries, franchises, or non-headquarter sites. Premium validation is required if you are using a premium, licensed enrichment provider: Pitchbook or S&P Capital IQ. If you have selected a premium enrichment provider, premium company validation is selected automatically.
Configuring Enrichment
Select one or more enrichment sources for this data product. See Tamr Firmographic Enrichment for more information on data providers.
Configuring DUNS Match and Data Blocks Enrichment
If you are entitled for Duns & Bradstreet enrichment and have configured your D&B API secret and key on the Admin > API Keys page, you can enable both DUNS Match and D&B Data Blocks Enrichment.
DUNS Match provides DUNS number for each source record for which a DUNS match is identified in the D&B match reference database.
D&B Data Blocks Enrichment provides provides enriched company data for the golden record based on DUNS number, from the D&B Data Blocks to which you are entitled.
See Dun & Bradstreet Enrichment for more information about DUNS Match and D&B Data Blocks.
You can adjust the criteria used to determine the DUNS match quality and whether the match is accepted. These criteria includes:
- D&B Confidence Code Thresholds for the DUNS match for the United States and the rest of the world. The default threshold for both is 8; matches under this threshold are not used in the clustering logic.
- D&B Match Grade Patterns that define acceptable Match Grade Strings. .
If you specify Match Grade String Patterns:
- If the Confidence Code is not met, Tamr Cloud uses the Match Grade Pattern to determine whether to apply the DUNS match result.
- If either the Confidence Code or Match Grade Pattern is not met, Tamr Cloud does not accept or apply the DUNS match results.
See the D&B Entity Matching Guide for detailed information about these criteria.
Configuring Clustering Rules
You can fine-tune clustering results by applying clustering rules. After the model has clustered source records, these rules can match or split clusters based on values in specific attributes. For example, if you trust that a user’s social security number uniquely identifies a person, you may want to create a rule that always clusters together records with matching social security numbers and does not cluster records with different social security numbers.
Clustering rules are applied only when the specified attribute values are exact, non-null, case-sensitive matches.
You can add up to three rules. See Understanding Clustering for more information on clustering.
There are three types of clustering rules:
- Match: Matches clusters with matching values for the specified attributes, such as a
company_name
. Match rules will not match clusters that contain only null or empty values for the specified attribute. If you specify more than one attribute in the rule, the rule is applied only if the values for both attributes are matching and non-null. - Split: Splits clusters that contain records with different, non-null values for the specific attributes. The rule splits the cluster so that each new cluster contains records with matching values for the attribute. If you specify more than one attribute in the rule, the rule is applied only if the values for both attributes are different and non-null.
- Both: For the specified attributes, matches clusters with matching non-null values and splits clusters that contain records with different non-null values, following the logic in the bullets above.
Each rule is numbered. After the data product runs, the Applied Clustering Rules (clustering_metadata.applied_clustering_rules
) attribute in the source records dataset provides the number assigned to any rules applied to the record.
Configuring Data Cleaning
Tamr automatically replaces specific, common bad values with null
wherever it identifies an exact, case insensitive match in the mapped source record fields. See Automatically Cleaned Data Values for the values that are cleaned automatically.
Additionally, the data cleaning feature enables you to replace known bad values in your source data with null
, when Tamr finds an exact, case insensitive match for an attribute value. This helps to ensure that these values are not used for matching or included in your golden records.
The values that you specify are replaced with null
wherever they appear in the mapped data product schema. For example, you may want to remove values such as 555-5555
, test
, and so on.
Specify a value to be cleaned by selecting Add Value and then entering the exact string to be replaced with null
. You can easily edit or delete values.
After running the data product, the null
replacement values are included in the enhanced source records dataset and in the golden records (with the exception of address fields for which the original values are retained). See Publishing Data Products for more information about enhanced source records.
Configuring Address Standardization
In the Address Standardization section, you can:
- Choose whether golden records include original the source address values or enhanced source values that have been validated and standardized by the address data quality services.
- Choose whether to standardize country and state values to their ISO 3166 country and state codes.
Using Enhanced Source Record Address Values in Golden Records
The Use Address Enrichment Results in Golden Records option allows you to choose whether to use the original source values or enhanced source values for address fields in your golden records. Enhanced source values have been cleaned, validated, and standardized by the address data quality services.
This option is enabled by default.
Standardizing Country and State Values to ISO 3166 Codes
If you have enabled using address enrichment results in golden records, you can also choose to whether to standardize country and state names to two-character ISO 3166 codes.
Country codes are available for all countries; state codes are available only for the United States and Canada. The country and state names must be spelled correctly in order to be standardized to the ISO 3166 code.
See the ISO 3166 reference for more details about these codes.
This option is enabled by default.
Running Your Data Product and Viewing Results
To run your data product and apply all enrichment, clustering, and record consolidation rules, scroll to the top of the page and in the top right corner, select Refresh Data. Below the Refresh Data button, you can see the last time your results were refreshed.
To view your results, go to the Entities page, or go to Insights to see key metrics.
Configuring Your Data Product for Tamr RealTime
If you are using the Tamr RealTime offering with this data product, see About Tamr RealTime for instructions on configuring the data product for real-time use cases.
Updated 1 day ago