Google BigQuery Source¶
Configure Google BigQuery as a source for your data transfers in Pontoon.
Prerequisites¶
Before configuring BigQuery as a destination, ensure you have:
- Google Cloud Project: Active GCP project with BigQuery enabled
- Service Account: Service account with appropriate BigQuery permissions
- Dataset: Target dataset for storing data
- Credentials: Service account key file or workload identity
- Network Access: Network connectivity to BigQuery (VPC connector or public internet)
Configuration¶
Connection Details¶
Parameter | Description | Required | Example |
---|---|---|---|
project_id |
Google Cloud project ID | Yes | my-project-123 |
dataset |
BigQuery dataset ID | Yes | customer_data |
credentials |
Service account credentials | Yes | JSON object |
Setup Instructions¶
Step 1: Create BigQuery Resources¶
Create Dataset¶
Create Service Account¶
# Create service account
gcloud iam service-accounts create pontoon-sa \
--display-name="Pontoon Service Account" \
--project=my-project-123
# Get service account email
SA_EMAIL=$(gcloud iam service-accounts list \
--filter="displayName:Pontoon Service Account" \
--format="value(email)")
Assign BigQuery Permissions¶
# Grant BigQuery Data Editor role
gcloud projects add-iam-policy-binding my-project-123 \
--member="serviceAccount:$SA_EMAIL" \
--role="roles/bigquery.dataEditor"
# Grant BigQuery Job User role
gcloud projects add-iam-policy-binding my-project-123 \
--member="serviceAccount:$SA_EMAIL" \
--role="roles/bigquery.jobUser"
# Grant BigQuery User role
gcloud projects add-iam-policy-binding my-project-123 \
--member="serviceAccount:$SA_EMAIL" \
--role="roles/bigquery.user"
Create Service Account Key¶
# Create and download service account key
gcloud iam service-accounts keys create pontoon-sa-key.json \
--iam-account=$SA_EMAIL
Step 2: Configure Pontoon¶
- Navigate to Sources → New Source
- Select BigQuery as the source type
- Enter connection details:
- Click Test Connection to verify
- Click Save to create the source