question

CatameoFredTaguigCity1634-6104 avatar image
0 Votes"
CatameoFredTaguigCity1634-6104 asked KranthiPakala-MSFT edited

Can a .NET C# application connect and query from an Azure Databricks or Azure Synapse Spark Delta Lake table?

Is there a recommended way for a .NET C# application to connect and query from an Azure Databricks or Azure Synapse Spark Delta Lake table? Perhaps, there is a framework available we can use?

Can a .NET C# app connect via JDBC or ODBC connection to the delta lake database and query from a table?
Ref: https://stackoverflow.com/questions/66750474/simba-odbc-connection-to-delta-table-read-data-from-delta-format-tables-using

If there is none yet, alternatively, is there a recommended way for a .NET C# application to connect and query from a Data Lake parquet file?
Ref: https://www.reddit.com/r/dotnet/comments/9enqz7/open_source_c_net_libraries_for_reading_and/

Thank you.

dotnet-csharpazure-databricksdotnet-ml-big-data
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @catameofredtaguigcity1634-6104,

Thanks for your query. We are reaching out to internal team to see if there are any possible ways to achieve this requirement and will get back to you as soon as we have an update.

Thank you for your patience.

0 Votes 0 ·
KranthiPakala-MSFT avatar image
2 Votes"
KranthiPakala-MSFT answered KranthiPakala-MSFT edited

Hi @catameofredtaguigcity1634-6104,

Here is a NuGet package available for Delta support in C# : .Net for Apache Spark Extensions

84662-image.png

Could you please try this and see if it helps to achieve your requirement.

And also Synapse supports authoring your Spark applications in .NET. Here are a couple of links that might be useful:

The notebook linked in the second bullet above shows you how you can do basic IO and the third bullet above shows you how you can read a Delta Lake table.


Hope this info helps. Let us know how it goes.

Thanks



Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.






image.png (38.7 KiB)
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Thanks KranthiPakala-MSFT! We'll try this out and let you know how it goes.

0 Votes 0 ·
KranthiPakala-MSFT avatar image KranthiPakala-MSFT CatameoFredTaguigCity1634-6104 ·

Hi @catameofredtaguigcity1634-6104 Thanks for your response. Please do share your findings as it would be helpful for other community members.

Have a good day!

0 Votes 0 ·
DavidBrowne-msft avatar image
1 Vote"
DavidBrowne-msft answered

Also you can use any SQL Server client to query the Data Lake through Synapse Serverless SQL Pool.


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.