bigquery-configure-target
Use Connection Profile: Enable if you have a BigQuery connection profile you want to use or want to create one.
Project ID: Specify the BigQuery project ID. See BigQuery Writer initial setup.
Billing Project ID: Optionally, specify a different BigQuery project to which the activity will be billed. See discussion in BigQuery Writer programmer's reference.
Service Account Key: Upload a service account key created as described in BigQuery Writer initial setup. The service account must have the Big Query Read Session User role.
Private Service Connect Endpoint: Optionally, specify a Private Service Connect endpoint. See Using Private Service Connect with Google Cloud adapters.
How do you want Striim to respond to schema changes in the source database? This option appears when the source supports schema evolution. See Handling schema evolution for discussion of the options.
Choose Automatically propagate schema changes to the target to set the source's CDDL Capture property to True, its CDDL Action property to Process, and the target's CDDL Action property to Process.
Choose Do not propagate schema changes to the target and keep the pipeline running to set the source's CDDL Capture property to True, its CDDL Action property to Process, and the target's CDDL Action property to Ignore.
Choose Pause the pipeline when the schema changes to set the source's CDDL Capture property to True, its CDDL Action property to Quiesce, and the target's CDDL Action property to Process.
CDDL Tracking Table When the source is PostgreSQL, specify
striim.ddlcapturetable. You must create this table in PostgreSQL as described in PostgreSQL setup for schema evolution.How would you like to write continuous changes to BigQuery? See Choose which writing mode to use for discussion of Merge mode versus Append Only mode.
Choose Write continuous changes directly to use Merge mode.
Choose Write continuous changes as audit records to use Append Only mode.
If you choose this option, Striim will add two columns to each target table:
STRIIM__OPTIMEwill contain a timestamp of when the data was loaded from the source, andSTRIIM__OPTYPEwill contain a string describing the operation for the record: SELECT for initial load and INSERT, UPDATE, or DELETE for CDC.
Which mode would you like to use to write continuous changes to BigQuery? See Choose which writing method to use for discussion of writing methods.
Enable Streaming Mode to use BigQuery's Storage Write API.
Disable Streaming Mode to use BigQuery's legacy Load method.