Google Cloud Pub/Sub
You can integrate Belden Horizon Data Operations with the Google Pub/Sub service. This set of instructions shows you how to create a Google Pub/Sub connector and use it for:
- Publishing data from a topic in your edge device to a Subscription topic in the Google Cloud Platform
- Subscribing to data published by a Publication topic in the Google Cloud Platform
Before You Begin
You need to create a Google Service Account.
Set up the Outbound Connection (Publish to Google Pub/Sub)
Follow the steps below to set up the outbound connection.
Step 1: Create Publication Topic in Google Cloud Platform
In the Google Cloud Platform, create a publication topic. A matching subscription topic is created automatically, with the -sub suffix appended to the topic name.
Step 2: Add Device
Follow the steps to Connect a Device. The device will be used to store tags that will be eventually used to create outbound topics in the connector. Make sure to select the Enable Data Store check box.
Step 3: Add Tags
After connecting the device in Belden Horizon Data Operations, you can Add Tags to the device. Create tags that you want to use to create outbound topics for the connector.
Step 4: Add Connector
Follow the steps to Add a Connector and select the Google Cloud Pub/Sub Connector provider.
Configure the following parameters.
- Name: A recognizable name to identify the connector.
- Service Account Key (.json): Copy the JSON key from your Google Cloud Platform and paste it here.
- The project ID of the cloud project: Copy the ID from your Google Cloud Platform and paste it here.
- Integration Topic: Copy the name of the Publication topic (without the "-sub" suffix) from your Google Cloud Platform and paste it here.
- Parallel Publish Count: The number of messages being published simultaneously. The default value is 100.
- Parallel byte threshold: The minimum size of a batch (in bytes) for the batch to be published. The default value is zero, which means that there is no threshold (limit).
- Publish count threshold: The minimum number of messages in a batch for the batch to be published. The default value is zero, which means that there is no threshold (limit).
- Publish delay threshold (Milliseconds): The maximum time that the client will attempt to publish a batch of messages. The default value is zero, which means that there is no threshold (limit).
- Throttling limit: The maximum number of messages per second to be processed. The default value is zero, which means that there is no limit.
- Persistent storage: When enabled, this will cause messages to undergo a store-and-forward procedure. Messages will be stored within Belden Horizon Data Operations when cloud providers are online.
Step 5: Enable the Google Cloud Connector
To enable the connector:
- Return to the Belden Horizon Data Operations Integration browser tab.
Step 6: Create Outbound Topics for Google Cloud Connector
You will now need to import the tags you added in Step 2 to the connector as topics.
To create outbound topics:
- Click the connector tile. The connector Dashboard appears.
- Click the Topics tab.
Click the Import from DeviceHub tags icon. The DeviceHub Import dialog box appears.
After importing the tag(s), do the following:
- Edit the tag and configure the Remote Data Topic. Copy and paste the name of the Subscription topic (with the -sub suffix) from your Google Cloud Platform.
- Make sure the connector has a CONNECTED status.
Step 7: Enable Topics
Because you imported DeviceHub tags for a CONNECTED connector, all topics will be disabled.
To enable the topics, return to the Topics tab and click the Enable all topics icon.
Step 8: Verify Connection in Google Cloud Platform
To verify the connection in Google Cloud Platform:
Pull the subscription topic to see messages it receives from the Belden Horizon Data Operations outbound topics created previously.
List of Belden Horizon Data Operations outbound topicsView the subscription statistics.
Graph of subscription statistic
Set up the Inbound Connection (Subscribe to Google Pub/Sub)
Follow the steps below to set up the inbound connection.
Step 1: Create Publication Topic in Google Cloud Platform
In the Google Cloud Platform, create a publication topic.
Step 2: Add Device
Follow the steps to Connect a Device. The device will be used to store tags that will be eventually used to create outbound topics in the connector. Make sure to select the Enable Data Store check box.
Step 3: Add Tags
After connecting the device in Belden Horizon Data Operations, you can Add Tags to the device. Create tags that you want to use to create outbound topics for the connector.
Step 4: Add Connector
Follow the steps to Add a Connector and select the Google Cloud Pub/Sub Connector provider.
Configure the following parameters.
- Name: A recognizable name to identify the connector.
- Service Account Key (.json): Copy the JSON key from your Google Cloud Platform and paste it here.
- The project ID of the cloud project: Copy the ID from your Google Cloud Platform and paste it here.
- Integration Topic: Copy the name of the Publication topic from your Google Cloud Platform and paste it here.
- Parallel Publish Count: The number of messages being published simultaneously. The default value is 100.
- Parallel byte threshold: The minimum size of a batch (in bytes) for the batch to be published. The default value is zero, which means that there is no threshold (limit).
- Publish count threshold: The minimum number of messages in a batch for the batch to be published. The default value is zero, which means that there is no threshold (limit).
- Publish delay threshold (Milliseconds): The maximum time that the client will attempt to publish a batch of messages. The default value is zero, which means that there is no threshold (limit).
- Throttling limit: The maximum number of messages per second to be processed. The default value is zero, which means that there is no limit.
- Persistent storage: When enabled, this will cause messages to undergo a store-and-forward procedure. Messages will be stored within Belden Horizon Data Operations when cloud providers are online.
Step 5: Enable the Connector
To enable the connector:
- Return to the Belden Horizon Data Operations Integration browser tab.
Step 6: Create Inbound Topics for Google Cloud Connector
You will now need to create topics from the tags you added in Step 3.
Before creating the topics copy the Raw Topic parameter for all tags you want to use for topics. See Manage Tags for more information
To create inbound topics:
- Navigate to Integration.
- Click the connector tile.
- Click the Topics tab.
Click the Add a new subscription icon.
The Data Integration dialog box appears.
Add a new subscription icon- Configure the following parameters.
- Data Direction: Select Local to Remote - Inbound.
- Local Data Topic: Paste the Raw Topic for the tag created in Step 2.
- Remote Data Topic: Copy and paste the Publication topic from your Google Cloud Platform.
- Enable: Select the toggle to enable the topic.
- Click Yes to add the topic.
From the connector tile, click the toggle to disable and then enable the connector to restart it.
Toggle to enable connector
See the Connector Topics section in Manage Connectors for more details.
Step 7: Enable Topics
To ensure all topics are enabled, return to the Topics tab and click the Enable all topics icon.
Step 8: Send Messages in Google Cloud Platform
Start sending messages through the publication topic (created in Step 1) from the Google Cloud Platform.
Step 9: Verify Connection in Belden Horizon Data Operations
You can do one of the following to verify the connection in Belden Horizon Data Operations: