Skip to main content
Version: v2

Connecting to GCP BigQuery

Before starting

Before you begin, learn how to create a data source

BigQuery Limitations
  • View is not supported
  • Does not support BIGNUMERIC (alias to BIGDECIMAL), GEOGRAPHY etc Type

Step 1: Prepare Service Account​

Canner Enterprise uses Service Account Authentication to operate Google Cloud APIs, so it is necessary to prepare Service Account.

Please refer to Google Cloud Authenticating as a service account > Creating a service account section

  1. Go to Google Cloud Create Service Account page
  2. Select the project
  3. Start to create a service account (Service Account); enter the information like the following connect_bq_sa_step1
  4. Click Continue, and in the second step, grant two roles, BigQuery Data Viewer and BigQuery User.connect_bq_sa_step2
  5. Skip the third step, click Finish, and then return to the list screen. Click the service account just created connect_bq_sa_success
  6. Click Key, click Add Key, select the JSON type connect_bq_sa_key
  7. The downloaded JSON content will be as follows connect_bq_sa_json

Step 2: Create Data Sources​

You can create a data source through the following two operations. The first is to click the "+" button on the sidebar Data Source or click the Create a Data Source button on the Overview page to create.

1_bigquery

Step 3: Set connection information​

In the pop-up form, fill in and set the connection information, and click Submit to send.

3_bigquery

  • Name: database name, for display, can be modified later
  • Data Source Type: database type, please choose BigQuery
  • Project ID: Please fill in the Project ID on GCP
  • Parent Project ID: Please fill in the Parent Project ID of the Project ID on GCP
  • Dataset ID: Dataset ID to be connected
  • Case Insensitive: If the Table name and Column name are both lowercase, checked this setting. The speed of exploring the Table Schema will be faster
  • Explore Timeout: If the database contains a large number of Tables, you can try to increase the timeout time.
How to find Project ID, Parent Project ID, Dataset ID, and other information on GCP BigQuery

  1. On the BigQuery screen, on the Dataset to be connected, click Open in the more options get_bq_info

  2. In the information, you can see the string project_id:dataset_id. Here you can get the Project ID, Dataset ID, and Parent Project ID if there is no particular setting usually the same as Project ID get_bq_info_2

  • Encoded Credentials : Key content of Service Account
How to fill in the key content of the Service Account
  1. Click the pencil icon to the right of the input 4_bigquery
  2. After pasting the JSON content in Step1 in the pop-up window, click "Convert" to return to the form and continue filling in other fields 5_bigquery

Step 4: Complete the build​

After Submitting, the BigQuery data source will show up in the sidebar in a few moments, and you can click to enter the data source details page.

6_bigquery