In this section, you learn how to create the following connection profiles:
- A connection profile to an Oracle, a MySQL, SQL Server, PostgreSQL, MongoDB, Salesforce, Salesforce Marketing Cloud, ServiceNow Dataverse, and a Workday source
- A connection profile to destination datasets in BigQuery
- A connection profile to a destination bucket in Cloud Storage
By creating these connection profiles, Datastream can transfer data from the source database into the destination.
Before you begin
- Make sure that you've set up your source database for replication. For information about steps required for each supported source type, see Configure sources.
- Find out what steps might be required to set up your selected destination. For more information, see Configure destinations.
Create a connection profile for Oracle database
Go to the Connection profiles page in the Google Cloud Console.
Click CREATE PROFILE.
In the Create a connection profile page, click the Oracle profile type.
Use the following table to populate the fields of the Define connection settings section of the Create Oracle profile page:
Field Description Connection profile name Enter the display name of the connection profile to the source Oracle database. This is used in the connection profile list as well as when an existing connection profile is selected in the creation of a stream. Connection profile ID Datastream populates this field automatically based on the connection profile name that you enter. You can keep the ID that's auto-generated or change it. Region Select the region where the connection profile is stored. Connection profiles, like all resources, are saved in a region, and a stream can only use connection profiles that are stored in the same region as the stream. Region selection doesn't impact whether Datastream can connect to the source or the destination, but can impact availability if the region experiences downtime. Hostname or IP Enter a hostname or IP address that Datastream can use to connect to the source Oracle database.
If you're using private connectivity to communicate with the source database, then specify the private (internal) IP address for the source database.
For other connectivity methods, such as IP allowlisting, provide the public IP address.
Port Enter the port number that's reserved for the source database (The default port is typically 1521.). Username Enter the username of the account for the source database (for example, ROOT). This is the Datastream user that you created for the database.For more information about creating this user, see Configure your source Oracle database.
Select Secret Manager password Select this option if you want to authenticate with a secret rather than enter the password manually. When select this option, two dropdowns appear: - Secret: you can select a secret from the list (if available), enter it manually, or create a new secret: To enter a secret manually:
- Click Enter secret manually. The Add a secret by resource ID dialog appears.
- Copy and paste your secret resource identifier from Secret Manager. The secret resource ID can have the following format:
projects/PROJECT_NUMBER/secrets/SECRET_NAME(latest version)projects/PROJECT_NUMBER/secrets/SECRET_NAME/versions/VERSION_NUMBER(specific version)- Click the Add secret button.
- Click Create new secret. The Secret details side panel opens.
- Under Name, enter a name for the secret (for example,
my-secret). A secret name can contain uppercase and lowercase letters, numerals, hyphens, and underscores. The maximum allowed length for a name is 255 characters. The name that you create is added as part of the secret resource identifier. - Optional: To also add a secret version when creating the initial secret, in the Secret value field, enter a value for the secret (for example,
abcd1234). The secret value can be in any format but must not be larger than 64 KiB. You can also upload a text file containing the secret value using the Upload file option. - Click the Create secret button.