Microsoft Fabric Lakehouse Process

Targets a Microsoft Lakehouse and loads a file into the Lakehouse tables

Revision History

1.0.0.0 Initial Release
1.0.0.1 Updated Upload Node to handle multiple types of input for File

Properties

Connection

TenantId
Type: String
The Directory (tenant) ID as specified in the Entra App being used for authentication.

ClientId
Type: String
The Application (client) ID as specified in the Entra App being used for authentication.

ClientSecret
Type: Password
The Client Secret Value generated in the Entra App, this value is only displayed once when generating the Secret.

AccessToken
Type: Password
OAuth Access Token

RefreshToken
Type: Password
OAuth Refresh Token

WorkspaceId

Type: String
The Workspace identifier is used to target which workspace your Lakehouse is in.

LakehouseId

Type: String
The Lakehouse identifier is used to target the specific Lakehouse you want to process a file on.

FilePath

Type: String
A relative path to where the file is stored in the Lakehouse. Must contain the correct file extension of .csv or .parquet.

TableName

Type: String
The name of the table the file should be loaded into.

Overwrite

Type: Boolean
Sets whether the data from the file should overwrite existing data in the table.

CsvDelimiter

Type: String
Sets the delimiter that will be used by the CSV file if the given file is CSV format. Not used when file is parquet format. Defaults to ",".

Response

Type: String Output
The response will return a GUID that identifies the load operation.

Remarks

File Types

Only CSV and Parquet file types are supported. Files must have the correct extension of .csv of .parquet depending on the file being loaded.

Authentication

Authentication is done using Microsoft Entra. An Entra Application needs to be created to get the TenantId, ClientId, and ClientSecret that are then used in conjunction with a Microsoft login to generate an AccessToken.

Entra

WorkplaceId and LakehouseId

These can be retrieved by the user when browsing in the Fabric application: https://app.fabric.microsoft.com/groups/{WorkplaceId}/lakehouses/{LakehouseId}
While you have the Lakehouse open in the app, the URL will match the above pattern, ex. https://app.fabric.microsoft.com/groups/c45d2794-fbd7-4287-8763-1da27232f50c/lakehouses/bf45d06a-ab24-4519-a9c6-7fb2e1116b2b