Ongoing Tasks for RealTime Data Products

👋

Limited Release

RealTime data products are in limited release. Some functionality is still in development and is subject to change. If you are interested in using these data products, contact Tamr Support ([email protected]).

This topic provides instructions for performing ongoing updates and maintenance for:

• RealTime B2B Customers Data Product
• RealTime B2C Customers Data Product
• RealTime Contacts Data Product
• RealTime Healthcare Providers Data Product

Onboarding New Sources

Onboard a new source in the data product Configuration page.

1. Add the source to Tamr. See Adding Source Data.
2. On the Data Products page, select Configure Data Product on the data product card.
3. In Sources and Schema Mapping, add the source and map its attributes. Add new custom attributes if needed.
4. In Golden Records, update record consolidation rules if needed. For example, you may want to add the new source to source priority tiers.
5. In Pending Changes, Validate your configuration changes and then select Apply Draft and Deploy.
6. Once your configuration changes are deployed, run the Resolve Source Record Changes with the System of Record workflow to match the new records to your existing clusters and create new clusters and golden records as needed. If you adjusted the golden record rules, the updated rules are applied to new and updated golden records.

Adjusting Data Product Schema

If needed, you can adjust attributes mappings and add or remove custom attributes in your data product schema.

After making and deploying the changes run workflows as follows:

• If you want to update the golden records to reflect the changed schema without affecting clustering membership run only the Reconsolidate Records workflow.
• If you want to update record clustering based on the new/removed attributes without updating all golden records, run the Resolve Source Record Changes with the System of Record workflow. In this case, only new golden records and golden records with updated clusters are updated to reflect the changed schema.
• If you want to both update clustering and update all golden records to reflect the updated schema, first run the Resolve Source Record Changes with the System of Record workflow to update clustering. Then, run the Reconsolidate Records workflow to update all golden records.

Adjusting Golden Record Consolidation Rules

If needed, you can adjust record consolidation rules in the data product Configuration page.

After making and deploying the changes, all new and updated golden records will be consolidated using the updated rules.

Optionally, you can run the Reconsolidate Records workflow to recalculate all of your golden records using the new rules. 

1. On the Data Products page, select Configure Data Product on the data product card.
2. In Golden Records, update record consolidation rules as needed
3. In Pending Changes, Validate your configuration changes and then select Apply Draft and Deploy. New and change records will now be consolidated using the updated rules.
4. Optional: Run the Reconsolidate Records workflow to update all of your existing golden records with changes from the new sources and/or adjusted rules.

Updating Records

You can update records by:

• Adding new data sources to the data product. See Onboarding New Sources above.
• Refreshing a source with the latest data, and then running the Resolve Source Record Changes with the System of Record workflow to match new and updated records to your existing clusters and create new clusters and golden records as needed. See Managing Sources for more information on refreshing source data.
• Creating and updating individual records using the Records API. See tamr.api.v1alpha1.Records for details on using the API.

Creating and Adjusting Data Views

You can create and update data views for curation and publishing. In each view, choose which data product attributes to include as well as their display names and order. See Adding and Configuring a RealTime Data Product for instructions on creating views.

Publishing Results

You can publish records from your System of Record for use in downstream systems. See Publishing from the Tamr RealTime Datastore for instructions.

For these RealTime data products, you can also choose a view when configuring a publish destination:

• Leave the view set to None to publish all fields in a data JSON blob.
• Select the view that contains the attributes you want to publish. This flattens the published table and sets the attribute names to the display name values defined in the view.

Curating Data

Perform ongoing record curation in Curator Hub. See Curating Records in the System of Record.

Tip: If you configured views, you can select a view for the golden records table in Curator Hub. Navigate to this table in Curator Hub by selecting the data product card and then the Records tab. Choose the view in the top right corner.

Scheduling Workflows

You can schedule RealTime data product workflows to run at specified intervals through the Jobs API (tamr.api.v1beta1.Jobs) and the Admin Center Schedules page (Managing and Viewing Scheduled Jobs).

Monitoring Activity via Webhooks

You can configure webhooks to monitor platform and record events, including record events for RealTime data products. See Configuring Webhooks.