Building pipelines from YugabyteDB
You can read from YugabyteDB as follows, and write to any target supported by Striim. Typically, you will set up data pipelines that read from YugabyteDB in two phases—initial load, followed by continuous replication—as explained in this concept article on Pipelines.
For initial load, you can use Database Reader to create a point-in-time copy of the existing source YugabyteDB dataset at the target, as described in Initial load.
After initial load has completed, you can start continuous replication by continuously reading the new data created in the same YugabyteDB dataset after the initial load was started, and then writing this new source data to the target.
For real-time continuous replication of new source data using CDC, you can use Yugabyte Reader, as described in Continuous real-time replication.
If you choose not to enable CDC on the source database, you can use Incremental Batch Reader to read the new source data at regular intervals, as described in Continuous incremental replication, allowing for continuous updates in near real time. As discussed in that section, Incremental Batch Reader differs from the CDC readers in several ways, including not capturing DELETE operations at the source.