Skip to main content
Version: v4

BigQuery

BigQuery limitations
  • Views are not supported
  • Types such as BIGNUMERIC (alias to BIGDECIMAL) and GEOGRAPHY are not supported

Step 1: Prepare a service account​

Canner Enterprise authenticates to Google Cloud APIs with a service account, so you need to prepare one.

See the "Creating a service account" section of Google Cloud's Authenticating as a service account.

  1. Go to the Google Cloud Create Service Account page
  2. Select a project
  3. Start creating the service account and enter information like the following connect_bq_sa_step1
  4. Click Continue, and in the second step grant the BigQuery Data Viewer and BigQuery User roles connect_bq_sa_step2
  5. Skip the third step and click Done. Back on the list page, click the service account you just created connect_bq_sa_success
  6. Click Keys, click Add Key, and choose the JSON type connect_bq_sa_key
  7. The downloaded JSON looks like this connect_bq_sa_json

Step 2: Create a data source​

There are two ways to create a data source: click the "+" button next to Data Source in the sidebar, or click the Create a Data Source button on the Overview page.

1_bigquery

Step 3: Configure the connection​

In the dialog form, fill in the connection information and click Submit.

3_bigquery

The connection fields are described below.

Basic​

  • Name: The display name of the database in Canner Enterprise. You can change it later.
  • Data Source Type: The database type. Select BigQuery.

Data Source Properties​

  • Project ID: The Google Cloud Platform project ID of the BigQuery instance you want to connect to.
  • Parent Project ID: The parent project ID of the project above.
  • Dataset ID: The ID of the dataset to connect to.
How to find the Project ID, Parent Project ID, Dataset ID, and other information in GCP BigQuery

  1. In BigQuery, open the more options menu on the dataset you want to connect to and click Open get_bq_info

  2. The info panel shows a string like project_id:dataset_id, which gives you the Project ID and Dataset ID. The Parent Project ID is usually the same as the Project ID, unless a hierarchy was set up when the project was created get_bq_info_2

  • Encoded Credentials: The service account key content
How to fill in the service account key
  1. Click the pencil icon to the right of the input 4_bigquery
  2. In the dialog, paste the JSON content from Step 1 and click Convert, then return to the form to fill in the other fields 5_bigquery
  • Case Insensitive: Table names in Canner Enterprise data sources are displayed in lowercase, and case is not distinguished. If all table and column names in your BigQuery dataset are lowercase, enabling this option speeds up connecting.
  • Explore Timeout: The timeout for connecting to the data source. If connecting takes longer than this, the system stops and shows a connection error. The default timeout is 10000 ms. If the database you are connecting to has many tables, consider increasing this timeout.

Step 4: Finish​

After you submit, the BigQuery data source appears in the sidebar shortly. Click it to open the data source details page.

6_bigquery