How to fix ErrorCode=UserErrorInvalidPluginType,'Type=Microsoft.DataTransfer.Common.Shared.PluginNotRegisteredException,Message=Invalid type 'GoogleBigQueryV2 Azure Data Factory

Question

I am trying to copy data from Google Cloud BigQuery datasets to Azure Blob Storage as parquet files. I have followed this documentation to set up the Linked Service to Google Cloud. The connection to BQ is successful. Then, I created a Dataset in ADF using the aforementioned Linked Service to BQ and I can preview data successfully. Finally, I created a pipeline using the copy data block. When trying to sink the data into Azure Blob Storage in the pipeline I get this error:

ErrorCode=UserErrorInvalidPluginType,'Type=Microsoft.DataTransfer.Common.Shared.PluginNotRegisteredException,Message=Invalid type 'GoogleBigQueryV2' is provided in 'linkedServices'. Please correct the type in payload and retry.,Source=Microsoft.DataTransfer.ClientLibrary,'

References:

https://learn.microsoft.com/en-us/azure/data-factory/connector-google-bigquery?tabs=data-factory

https://github.com/MicrosoftDocs/azure-docs/issues/122264

Answer 1

@Rodrigo Morales Alejandre

Welcome to the Microsoft Q&A platform and thank you for posting your question here.

The error message indicates a mismatch between the expected linked service type and the one you provided in your Azure Data Factory (ADF) pipeline. Here's how to troubleshoot and fix the issue:

Understanding the Error:

• ErrorCode=UserErrorInvalidPluginType: This signifies an error related to an invalid plugin type being used.
• Type=Microsoft.DataTransfer.Common.Shared.PluginNotRegisteredException: This exception is thrown when the specified plugin type (linked service) is not registered in ADF.
• Message=Invalid type 'GoogleBigQueryV2' is provided in 'linkedServices'. Please correct the type in payload and retry.: This clarifies that the linked service you provided has the type "GoogleBigQueryV2", which is not recognized by ADF.

Resolving the Issue:

1. Verify Linked Service Type: Double-check the type of the linked service you created for Google BigQuery. It should be "GoogleBigQuery" (not "GoogleBigQueryV2"). Refer to the documentation you linked for creating a Google BigQuery linked service: https://learn.microsoft.com/en-us/fabric/data-factory/connector-google-bigquery
2. Update Pipeline Configuration: In your ADF pipeline, ensure the linked service reference for the source points to the correctly configured Google BigQuery linked service (type: "GoogleBigQuery").
3. Recreate Linked Service (Optional): If the type mismatch persists, consider recreating the linked service for Google BigQuery, ensuring you select the appropriate connector type ("GoogleBigQuery").
4. Refer to the GitHub issue you linked for further insights or workarounds if needed: https://github.com/Index

Hope this helps. Do let us know if you any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Answer 2

Can you double-check the JSON definition of your linked service to ensure that the type is correctly specified. It should look similar to the following (replace with actual values):

{

  "name": "YourLinkedServiceName",

  "properties": {

    "type": "GoogleBigQuery",

    "typeProperties": {

      "project": "<Your-Project-ID>",

      "authenticationType": "ServiceAuthentication",

      "servicePrincipalId": "<Your-Client-ID>",

      "servicePrincipalKey": {

        "type": "SecureString",

        "value": "<Your-Client-Secret>"

      },

      "encryptedCredential": "<Your-Encrypted-Credential>"

    }

  }

}