Datastream enables stream recovery | Google Cloud Blog

Consider a financial institution that uses Datastream to replicate transactional data from its operational databases to BigQuery for analysis. Due to a hardware failure, the primary database instance suffers an unplanned failover to a replica. With the original source no longer available, Datastream's replication pipeline is broken. Stream recovery allows replication to resume from the failover database instance, so no transactional data is lost.

Or consider an online retailer using Datastream to replicate customer feedback to BigQuery for sentiment analysis with BigQuery ML. A prolonged network outage interrupts the connection to the source database. By the time the network connection is restored, some changes will not be available on the database server. In this case, stream recovery allows the user to quickly resume replication from the first available log position. Although some feedback may be lost, the retailer prioritizes having the latest data for ongoing sentiment analysis and trend identification.

Benefits of Stream Recovery

Stream recovery has many advantages:

Reduce data loss: Recover from data loss caused by database instance failover, unintentional log file deletion, and other incidents.

Reduced downtime: Minimize downtime by quickly recovering streams and resuming ongoing CDC ingestion.

Simplified Recovery: Easily recover your streams through a simple and intuitive interface.

How to use Stream Recovery

Stream recovery allows you to choose from several options depending on the specific failure scenario and the availability of recent log files. For MySQL and Oracle, you can choose to retry from the current log position, skip the current position and stream from the next available position, or skip the current position and stream from the most recent position. You can also specify a specific log position (such as a Log Sequence Number (LSN) or Change Sequence Number (CSN)) from which to resume the stream. This allows fine-grained control to ensure that data is not lost or duplicated at the destination.

For PostgreSQL sources, you can instruct Datastream to create a new replication slot in your PostgreSQL database and resume streaming from the new replication slot.

Start the stream from a specified position

In addition to stream recovery, there are some scenarios where you might need to start or resume a stream from a specific log position, for example, when the source database is upgraded or migrated, or when historical data already exists in the destination and you want to merge CDC from a specific point in time (the end of the historical data), etc. In such cases, you can use the stream recovery API to specify the start position before starting the stream.

start

Stream recovery is now generally available in the Google Cloud console and APIs for all Data Stream sources available in all Google Cloud regions.

For more information on stream recovery, see the Datastream documentation.

Sources 1/ https://Google.com/ 2/ https://cloud.google.com/blog/products/data-analytics/datastream-gets-stream-recovery The mention sources can contact us to remove/changing this article

What Are The Main Benefits Of Comparing Car Insurance Quotes Online

LOS ANGELES, CA / ACCESSWIRE / June 24, 2020, / Compare-autoinsurance.Org has launched a new blog post that presents the main benefits of comparing multiple car insurance quotes. For more info and free online quotes, please visit https://compare-autoinsurance.Org/the-advantages-of-comparing-prices-with-car-insurance-quotes-online/ The modern society has numerous technological advantages. One important advantage is the speed at which information is sent and received. With the help of the internet, the shopping habits of many persons have drastically changed. The car insurance industry hasn't remained untouched by these changes. On the internet, drivers can compare insurance prices and find out which sellers have the best offers. View photos The advantages of comparing online car insurance quotes are the following: Online quotes can be obtained from anywhere and at any time. Unlike physical insurance agencies, websites don't have a specific schedule and they are available at any time. Drivers that have busy working schedules, can compare quotes from anywhere and at any time, even at midnight. Multiple choices. Almost all insurance providers, no matter if they are well-known brands or just local insurers, have an online presence. Online quotes will allow policyholders the chance to discover multiple insurance companies and check their prices. Drivers are no longer required to get quotes from just a few known insurance companies. Also, local and regional insurers can provide lower insurance rates for the same services. Accurate insurance estimates. Online quotes can only be accurate if the customers provide accurate and real info about their car models and driving history. Lying about past driving incidents can make the price estimates to be lower, but when dealing with an insurance company lying to them is useless. Usually, insurance companies will do research about a potential customer before granting him coverage. Online quotes can be sorted easily. Although drivers are recommended to not choose a policy just based on its price, drivers can easily sort quotes by insurance price. Using brokerage websites will allow drivers to get quotes from multiple insurers, thus making the comparison faster and easier. For additional info, money-saving tips, and free car insurance quotes, visit https://compare-autoinsurance.Org/ Compare-autoinsurance.Org is an online provider of life, home, health, and auto insurance quotes. This website is unique because it does not simply stick to one kind of insurance provider, but brings the clients the best deals from many different online insurance carriers. In this way, clients have access to offers from multiple carriers all in one place: this website. On this site, customers have access to quotes for insurance plans from various agencies, such as local or nationwide agencies, brand names insurance companies, etc. "Online quotes can easily help drivers obtain better car insurance deals. All they have to do is to complete an online form with accurate and real info, then compare prices", said Russell Rabichev, Marketing Director of Internet Marketing Company. CONTACT: Company Name: Internet Marketing CompanyPerson for contact Name: Gurgu CPhone Number: (818) 359-3898Email: [email protected]: https://compare-autoinsurance.Org/ SOURCE: Compare-autoinsurance.Org View source version on accesswire.Com:https://www.Accesswire.Com/595055/What-Are-The-Main-Benefits-Of-Comparing-Car-Insurance-Quotes-Online View photos