User's Guide: Inbound Connector

1.0 Introduction

Welcome to the Fortanix Confidential Computing Manager - Inbound Connectors user guide. This guide describes how to create and manage Inbound Connectors in Fortanix Confidential Computing Manager.

One of the elements within the realm of Fortanix Confidential Computing Manager is the Inbound Connector, the purpose of this connector is to enable workflows to import the input data from external sources during runtime into the Confidential Computing Manager environment. 

Using the Inbound Connector menu item in the Fortanix Confidential Computing Manager user interface (UI), you can add, review, and manage the Inbound Data Connectors.

Currently, Fortanix Confidential Computing Manager supports the following inbound connector types:

• Google BigQuery – It facilitates the retrieval and utilization of data stored in BigQuery for further processing, analysis, or integration into Fortanix Confidential Computing Manager workflows.

  NOTE

  Ensure that you have a BigQuery project set up and configured if you want to fetch the data from the Google BigQuery dashboard.

• CSV – It enables the integration of data stored in CSV files. You can utilize this connector to access the CSV file data by providing the pre-signed URL within Fortanix Confidential Computing Manager workflows.

  NOTE

  Ensure to obtain a valid and pre-signed URL for accessing the data if you want to fetch the data from a URL. This URL can be hosted on Amazon Web Services (AWS), Microsoft Azure, or the Google Cloud Platform (GCP).

2.0 Add the Inbound Connectors

Perform the following steps to seamlessly add the inbound connector to the Fortanix Confidential Computing Manager:

1. Click the Dataverse → Inbound Connectors menu item in the Confidential Computing Manager left navigation bar and click the + ADD INBOUND CONNECTOR button to add an inbound connector.

   

2. On the INBOUND CONNECTORS dialog box, select either of the following connecter types:

   • BigQuery: Select this option if you want to import data from BigQuery .

   • CSV: Select this option if your data is in CSV format and you want to import it using this connector.

3. Click the NEXT button to proceed further.

4. On the Create new inbound connector page:

   • If you have selected the BigQuery option in Step 2, enter the following details:

     • Connector name: Enter a required name for the inbound connector.

     • Description (Optional): Add a brief description to provide additional context if needed.

     • Labels: Assign one or more key-value labels to categorize or tag the connector.

     • Group: Select the required group name from the drop down menu to associate this connector with that group.

     • Project ID: Enter the ID of the BigQuery project .

       

     • Dataset name: Enter the name of the dataset from which you want to import data.

     • Table name: Enter the name of the table within the specified dataset.

     • API key: Enter the API key (Service Account JSON) required for accessing the Big Query service in the text box provided. You can also upload the API key in Raw or Base64 format using the browse option. To know the steps for generating this API key, refer to the Google Cloud: Create an API Key documentation.

       NOTE

       The API key cannot be viewed again after submission.

   • If you have selected the CSV option in Step 2, enter the following details:

     • Connector name: Enter a required name for the inbound connector.

     • Description (Optional): Add a brief description to provide additional context if needed.

     • Labels: Assign one or more key-value labels to categorize or tag the connector.

     • Group: Select the required group name from the drop down menu to associate this connector with that group.

     • URL: Enter the URL where the CSV file is located for importing data .

       NOTE

       Ensure to obtain a valid and pre-signed URL for accessing the data if you want to fetch the data from a URL.  This URL can be hosted on Amazon Web Services (AWS), Microsoft Azure, or the Google Cloud Platform (GCP).

5. Click the CREATE INBOUND CONNECTORS button to create the inbound connector.

The inbound data connector is now created successfully.

3.0 Edit the Inbound Connector

Perform the following steps to modify the details of the inbound connector:

1. Click the Inbound Connectors menu item in the Confidential Computing Manager left navigation bar.

2. Locate and click the inbound connector that you wish to edit from the list of available inbound connectors. A new screen opens where you can review and edit the configuration.

3. Click the EDIT button to initiate the editing process.

   NOTE

   Alternatively, you can click the  overflow menu (three dots) for the required connector row and select the EDIT INBOUND CONNECTOR option to modify the connector.

4. Update the configuration as needed.

5. After you have made the necessary edits, click the SAVE button to keep your changes.

The inbound data connector is now updated successfully.

4.0 Inbound Connector Details Overview

4.1 General tab

This tab offers insights into general details, enabling effective management and understanding of your connectors.

The displayed fields on the screen will vary depending on the type of inbound connector created:

• If a Big Query Inbound Connecter is created:

  • Connector type: Displays the type of connector, such as Google BigQuery .

  • Created by: Displays the name of the user who created the connector.

  • Group: Specifies the group to which the connector belongs.

  • Created at: Displays the timestamp when the connector was initially created.

  • Last updated at: Indicates the date and time of the last update made to the connector.

  • Project ID: Refers to the identifier associated with the project.

  • Dataset Name: Displays the name of the dataset.

  • Table Name: Displays the name of the table in the dataset associated with the connector.

  • Labels: Displays any applied labels for additional categorization or identification.

• If a CSV Inbound Connecter is created:

  • Connector type: Displays the type of connector, such as CSV.

  • Created by: Displays the name of the user who created the connector.

  • Group: Specifies the group to which the connector belongs.

  • Created at: Displays the date and time when the connector was initially created.

  • Last updated at: Displays the date and time of the last update made to the connector.

  • URL: Displays the Uniform Resource Locator (URL) associated with the connector from where the CSV data file was imported.

  • Labels: Displays any applied labels for additional categorization or identification.

4.2 Table Schema Tab

This tab allows you to access the structure of the imported or connected tables. It enables you to understand the schema of the data source, which is crucial for writing accurate and efficient scripts. By providing visibility into the table schema, this feature empowers you to develop scripts seamlessly, ensuring compatibility and accuracy in data processing within the Fortanix Confidential Computing Manager environment.

After successfully creating the inbound connector, you can access this tab to add the detailed table schema elements associated with it:

• Field Name: Displays the names of individual columns within the schema.

  NOTE

  Ensure that each name is unique and not repeated to avoid potential conflicts while creating the Workflows.

• Data Type: Determines the SQL data types associated with each column such as, integer, real, text, blob, or unsupported.

• Description: Elaborates the purpose or characteristics of each column.

• Data anonymization: Determines options for implementing anonymization techniques to safeguard sensitive data,

  • None: Indicates that the column undergoes no data anonymization, preserving the data in its original form.

  • Hashed: Indicates that the data is anonymized by replacing it with a hashed representation, enhancing security by masking the original values while preserving their uniqueness for analysis or processing.

• ADD ROW: Allows you to add multiple rows for defining the individual columns in the schema.

  

If you have selected the BigQuery option in Section 2.0: Add the Inbound Connector, you can use the IMPORT FROM BIGQUERY JSON option to import the table details in JSON format into Fortanix Confidential Computing Manager effortlessly.

Perform the following steps:

1. Go to the BigQuery project and copy the required tables in JSON format.

2. Go to the Table Schema tab of the required BigQuery Inbound Connector.

3. Click the + TABLE SCHEMA button.

4. Click the IMPORT FROM BIGQUERY JSON button available at the end of the table.

5. In the dialog box, paste the table schema JSON in the provided space.

6. Click the IMPORT button.

7. After all the details are added, click the SAVE button.

All the table details from BigQuery are imported into Fortanix Confidential Computing Manager successfully.

After you have saved the details of the table, you can either remove or modify any detail.

• DELETE: With this feature, you can delete any column within the schema.

• EDIT: With this feature, you can modify column properties as needed.

5.0 Delete the Inbound Connector

Perform the following steps to delete the inbound connector:

1. Click the Inbound Connectors menu item in the Confidential Computing Manager left navigation bar.

2. Locate and click the inbound connector that you wish to remove from the list of available inbound connectors.

3. Click the DELETE button to remove the connector.

   NOTE

   Alternatively, you can click the  overflow menu (three dots) for the required connector row and select the DELETE INBOUND CONNECTOR option to delete the connector.

4. Click the DELETE button to confirm the action.

The inbound data connector is now deleted successfully.