To integrate BigQuery as a data source, you will need the following:
Refer to the setup documentation for detailed instructions on creating these components.
For xGen to retrieve data from BigQuery, it must be granted access via a Service Account configured with the appropriate roles:
It’s recommended to create a dedicated Service Account solely for xGen. This ensures clearer access management and easier auditing. However, if you already have a Service Account with the correct permissions, it may be reused.
To create a new Service Account, follow the GCP instructions for Creating a Service Account. After it’s created, retain the Service Account ID (formatted as <account-name>@<project-name>.iam.gserviceaccount.com) as you’ll need it to assign roles.
Next, grant the BigQuery User role at the project level to the new Service Account. Use the Granting Access steps in Google’s documentation, entering the Service Account ID as the member email.
At this point, your Service Account should be properly configured with project-level access to BigQuery.
To allow xGen to authenticate as the Service Account, a Service Account Key is required. These keys enable access to the permissions granted earlier.
Follow the official guide on Creating and Managing Service Account Keys to generate a key. Only the JSON format is supported by xGen, so ensure that you choose this format during creation.
Important: Once the key file is generated, download and store it immediately. Google does not allow you to view the key contents again. After successfully connecting BigQuery in xGen, it’s best practice to delete the key file from your local machine for security purposes.
After completing the above steps, you’ll have the necessary details to set up BigQuery in the xGen interface. The configuration requires: