Striim Platform 5.0 documentation

Striim Platform requires Java Development Kit 11. For more information, see Upgrading to JDK 11.

The internal Kafka instance has been upgraded to version 2.1. Note that if you do an in-place upgrade, the old Kafka version 0.11 instance will be retained. To upgrade to Kafka 2.1, use the Export-import upgrade method instead.

The web UI has been significantly revised. See the Web UI Guide.

Striim sensitive data governance: Striim provides the following tools to discover and detect sensitive data:

Vector embeddings: Striim allows you to configure an embeddings model that you can use to generate vector embeddings.

Striim CoPilot is an AI chatbot that you can use to help resolve issues or questions that you may encounter during the configuration and operation of Striim applications.

Automated IL CDC wizards handle both initial load (usually using JDBC) and continuous replication using change data capture plus automatic handover from the former to the latter. See Introducing automated pipelines.

Automated IL CDC wizards for MariaDB, MySQL, Oracle, PostgreSQL, Snowflake, and SQL Server sources include form-driven setup for SSL.

Connection profiles allow you to specify the properties required to connect to BigQuery, Databricks, HubSpot, Salesforce, ServiceNow, Snowflake, Stripe, or Zendesk once and use that set of properties in multiple sources and/or targets in multiple applications. Connection profiles also allow you to change connection properties, for example to handle token rotation, without undeploying the applications that use it. They add OAuth support for more sources and targets and simplify OAuth or Entra ID (formerly Azure Active Directory) configuration. See Introducing connection profiles.

Shield allows you to encrypt or decrypt selected fields (columns) of data using your own keys. See Encrypting data using Shield.

Table mapping validation has been improved. For details, see Validating table mapping.

You may use prefixes in the target portion of the Tables property values for some writers. See Using prefixes in the Tables property.

Schema evolution ignores some unsupported DDL commands rather than halting the application. See Handling of unsupported DDL.

Schema evolution supports column-level character sets and ALTER TABLE ... ADD PRIMARY KEY for MySQL. See Handling schema evolution.Handling schema evolution

The schema conversion tool supports Microsoft Fabric Data Warehouse as a target. See Using the schema conversion utility.

Striim Connect allows you to read change events records written by a Kafka source connector. See CREATE EXTERNAL SOURCE.

A Partial Record Policy allows Striim applications to read columns of unsupported data types from a source database. Striim supports two types of PartialRecordPolicy, an open processor that can be used with MongoDB, and an integrated PartialRecordPolicy that is integrated with the OJet, Oracle Reader, MSJet, MS SQL Reader readers. See Using the Partial Record Policy to fetch unsupported columns.

ADLS Reader is a Striim source adapter that is capable of reading objects from a container in an ADLS Gen2 storage account with hierarchical structure enabled.

Database Reader:

Database Reader and Incremental Batch Reader:

Google Ads Reader reads data from a Google Ads instance. Copying ad data to a system such as BigQuery or Snowflake enables sophisticated analysis of advertising data.

HubSpot Reader is a Striim source adapter that uses HubSpot APIs to read data from an instance of the HubSpot CRM platform. HubSpot Reader ingests HubSpot data and emits WAEvents that can be processed with continuous queries or directed to a Striim target.

Intercom Reader reads data from an Intercom instance. (Intercom provides a unified set of messaging tools for sales, marketing, and customer care.)

Jira Reader is a Striim source adapter that moves data from a Jira instance to a Striim target. (Jira is an issue tracking system by Atlassian for bug tracking and project management.)

Kafka Reader supports Kafka 2.1.1.

S3 Reader supports Instance Metadata Service metadata version IMDSv1 and IMDSv2. Previous releases supported only IMDSv1.

Salesforce Reader can return the API name, value, or both for picklist fields.

ServiceNow Reader supports OAuth authentication. See Introducing connection profiles.

Stripe Reader reads transaction data from the Stripe payment service provider, which is geared towards online payments. Stripe Reader ingests Stripe data and emits WAEvents that can be processed with continuous queries or directed to a Striim target. Stripe Reader supports PayoutsSummaryReport.

Zendesk Reader reads Zendesk data and emits WAevents that can be processed with continuous queries or directed to a Striim target. (Zendesk is a customer support platform that provides in-depth tools for managing customer experience.)

HL7v2 Parser parses HL7v2 messages.

BigQuery Writer can use quotas of and charge to a different project than the one containing the tables to be read (see "Billing Project ID" in BigQuery Writer programmer's reference).

Database Writer supports:

Fabric Data Warehouse Writer writes to data warehouses in Microsoft Fabric.

Fabric Lakehouse File Writer writes to lakehouses in Microsoft Fabric.

Microsoft Dataverse Writer write to Microsoft Dataverse using the Dataverse Web API.

S3 Writer supports Instance Metadata Service metadata version IMDSv1 and IMDSv2. Previous releases supported only IMDSv1.

Salesforce Marketing Cloud Writer enables you to write data directly to the B2C platform in Salesforce using REST or SOAP API calls.

Salesforce Writer supports OAuth authentication. See Introducing connection profiles.

ServiceNow Writer supports OAuth authentication. See Introducing connection profiles.

GG Trail Reader:

MongoDB Reader can read from MongoDB 7 (see MongoDB CDC reader).

MSJet (see SQL Server CDC readers):

MS SQL Reader can read from SQL Server 2022 (see SQL Server CDC readers)

OJet:

Oracle Reader supports Oracle native network encryption. See the notes for Connection URL in Oracle Reader properties.

Salesforce CDC Reader reads from Salesforce using change data capture.

Snowflake Reader reads from Snowflake using change data capture.

YugabyteDB CDC reader reads from YugabyteDB using change data capture.

Database Reader supports recovery. See Fast Snapshot Recovery during initial load.

Striim supports single sign-on through Microsoft Entra ID and Okta. See Managing users using single sign-on (SSO).