Salesforce Reader
The Salesforce Reader uses REST APIs to read Salesforce CRM (sObject) data at configured refresh intervals. See also Salesforce Pardot Reader, Salesforce Platform Event Reader, and Salesforce Push Topic Reader.
See API Request Limits and Allocations for information on Salesforce-side limits that may require you to limit how much and how quickly Salesforce Reader ingests data.
You can read from Salesforce as follows, and write to any target supported by Striim.
For initial load, you can use the Salesforce Reader.
For incremental load after initial load, you can use Salesforce Reader.
For near real-time continuous replication after initial load, you can use Salesforce CDC Reader that reads new source data as soon as a change event is emitted from Salesforce.
Typically, you can set up data pipelines that will read from Salesforce in two phases, as explained in this concept article on Pipelines. The first step is the initial load, where you can create a point-in-time copy of the existing source Salesforce dataset at the target. After the initial load has completed, you can start continuous replication by continuously reading the new data created in the same Salesforce dataset after the initial load was started, and then writing this new source data to the target. When set to "Automated" mode, the Salesforce Reader first completes the initial load (as of the start time of the application) and on completion of initial load, it will automatically start polling for incremental changes at the specified interval.
Automated mode
In Automated mode, Salesforce Reader utilizes Incremental mode with a ‘startTimestamp’ of ‘1970-01-01’. This configuration allows it to perform an initial data load and capture any new records during subsequent polling intervals. You can specify Automated mode when establishing a connection to Salesforce, for example when using a connection profile.
In Automated mode, you can select from a list of all the available standard and custom Salesforce objects, enabling you to select any object for data replication. After selecting an object, the system verifies that all required permissions are in place for transferring data to the target system.
Once the setup is complete, the Salesforce Reader continuously loads the initial dataset and captures newly added records at each polling interval for the selected Salesforce objects.
Summary information and supported objects
APIs used/data supported | Standard and custom Salesforce objects |
Security and authentication |
|
Operations/modes supported |
|
Schema management |
|
Resilience / recovery | Configurable automatic retries |
Performance | Striim Platform supported parallel execution |
Programmability |
|
Metrics and auditing | Key metrics available through Striim monitoring |