你当前正在访问 Microsoft Azure Global Edition 技术文档网站。 如果需要访问由世纪互联运营的 Microsoft Azure 中国技术文档网站，请访问 https://docs.azure.cn。

Azure Cosmos DB OLTP Spark 3 connector

  • 项目

Azure Cosmos DB OLTP Spark 3 connector for Spark 3.2

Azure Cosmos DB OLTP Spark connector provides Apache Spark support for Azure Cosmos DB using the SQL API. Azure Cosmos DB is a globally-distributed database service which allows developers to work with data using a variety of standard APIs, such as SQL, MongoDB, Cassandra, Graph, and Table.

If you have any feedback or ideas on how to improve your experience please let us know here: https://github.com/Azure/azure-sdk-for-java/issues/new

Documentation

Version Compatibility

azure-cosmos-spark_3-1_2-12

Connector Supported Spark Versions Minimum Java Version Supported Scala Versions Supported Databricks Runtimes
4.11.2 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.11.1 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.11.0 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.10.1 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.10.0 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.9.0 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.8.0 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.7.0 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.6.2 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.6.1 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.6.0 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.5.3 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.5.2 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.5.1 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.5.0 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.4.2 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.4.1 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.4.0 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.3.1 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.3.0 3.1.1 - 3.1.2 8 2.12 8.*, 9.*
4.2.0 3.1.1 8 2.12 8.*
4.1.0 3.1.1 8 2.12 8.*
4.0.0 3.1.1 8 2.12 8.*
4.0.0-beta.3 3.1.1 8 2.12 8.*
4.0.0-beta.2 3.1.1 8 2.12 8.*
4.0.0-beta.1 3.1.1 8 2.12 8.*

azure-cosmos-spark_3-2_2-12

Connector Supported Spark Versions Minimum Java Version Supported Scala Versions Supported Databricks Runtimes
4.11.2 3.2.0 - 3.2.1 8 2.12 10.*
4.11.1 3.2.0 - 3.2.1 8 2.12 10.*
4.11.0 3.2.0 - 3.2.1 8 2.12 10.*
4.10.1 3.2.0 - 3.2.1 8 2.12 10.*
4.10.0 3.2.0 - 3.2.1 8 2.12 10.*
4.9.0 3.2.0 - 3.2.1 8 2.12 10.*
4.8.0 3.2.0 - 3.2.1 8 2.12 10.*
4.7.0 3.2.0 - 3.2.1 8 2.12 10.*
4.6.2 3.2.0 - 3.2.1 8 2.12 10.*
4.6.1 3.2.0 - 3.2.1 8 2.12 10.*
4.6.0 3.2.0 - 3.2.1 8 2.12 10.*

Download

You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 8 from Maven: com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.11.2

You can also integrate against Cosmos DB Spark Connector in your SBT project:

libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.11.2"

Cosmos DB Spark Connector is available on Maven Central Repo.

General

If you encounter any bug, please file an issue here.

To suggest a new feature or changes that could be made, file an issue the same way you would for a bug.

License

This project is under MIT license and uses and repackages other third party libraries as an uber jar. See NOTICE.txt.

Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution.

When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.