question

sandmanjp-2585 avatar image
0 Votes"
sandmanjp-2585 asked karishmatiwari-msft edited

Questions about using SQL Server 2019 big data cluster on-premises

We are considering using a big data cluster, which is a function of SQL Server.

However, the data handled by the big data cluster cannot be used externally, and it is supposed to be used in an on-premises environment where the connection with the outside is cut off.

I am trying to deploy a big data cluster by referring to the following WEB in an on-premises environment, but I cannot deploy it. We have installed the necessary tools, docker, and Kubenetes described in the prerequisites.

https://docs.microsoft.com/en-us/sql/big-data-cluster/deploy-offline?view=sql-server-ver15

Is it possible to use big data clusters in an on-premises environment in the first place?

If you have any questions, please give me some advice. #kubernetes

sql-server-general
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Although docker and kubenetes have been installed, they cannot be deployed from the private repository as shown below.
No error message is written, and the message waiting for cluster contorller to start is output.

azdata bdc create --config-profile xxxxx --accept-eula yes

Needed Configuration Values in control.json

Kubernetes Storage Class
- Config Path: spec.storage.data.className
- Description: This indicates the name of the Kubernetes Storage Class to use. You must pre-provision the storage class and the persistent volumes or you can use a built in storage class if the platform you are deploying provides this capability.
- Please provide a value: local-storage

Kubernetes Storage Class
- Config Path: spec.storage.logs.className
- Description: This indicates the name of the Kubernetes Storage Class to use. You must pre-provision the storage class and the persistent volumes or you can use a built in storage class if the platform you are deploying provides this capability.
- Please provide a value: local-storage
NOTE: Cluster creation can take a significant amount of time depending on
configuration, network speed, and the number of nodes in the cluster.

Starting cluster deployment.
Waiting for cluster controller to start.
Waiting for cluster controller to start.
Waiting for cluster controller to start.
Waiting for cluster controller to start.
Waiting for cluster controller to start.
Waiting for cluster controller to start.
Waiting for cluster controller to start.

0 Votes 0 ·

Looks like you need to get Kubernetes up and running first.

If you can edit your question then I suggest adding the #kubernetes tag to it to get more specific assistance.

0 Votes 0 ·

Thank you.
Although kubernetes is started first, it is still unable to be deployed.

I edited my question, can't adding tag the #kubenetes

0 Votes 0 ·
MartinCairney-6481 avatar image
0 Votes"
MartinCairney-6481 answered

It is certainly possible.

I would suggest going back through each prerequisite and testing that it is deployed correctly and running OK then retrying the installation.

If you have any specific error around the installation (rather than just that you cannot deploy it) then please add that to your question to help with suggesting some resolution steps.

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

SeeyaXi-msft avatar image
0 Votes"
SeeyaXi-msft answered

Hi @sandmanjp-2585,

Do some troubleshoots following this: https: //docs.microsoft.com/en-us/sql/big-data-cluster/cluster-troubleshooting-commands?view=sql-server-ver15

an on-premises environment where the connection with the outside is cut off.

Can you describe it more specifically?

Best regards,
Seeya

If the response is helpful, please click "Accept Answer" and upvote it, as this could help other community members looking for similar queries.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

sandmanjp-2585 avatar image
0 Votes"
sandmanjp-2585 answered

I confirmed the troubleshooting.
I will contact you for the part of the processing of them.

I can't use the internet.
I have downloaded the package from an environment where the internet can be used and installed it in the current environment where the internet cannot be used.

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

sandmanjp-2585 avatar image
0 Votes"
sandmanjp-2585 answered

kubectl get pods -n mssql-cluster
NAME READY STATUS RESTARTS AGE
control-xbrtn 0/3 Pending 0 31m
controldb-0 0/2 Pending 0 31m

kubectl describe pod control-xbrtn -n mssql-cluster

Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling <unknown> default-scheduler 0/3 nodes are available: 1 node(s) had taints that the pod didn't tolerate, 2 node(s) didn't find available persistent volumes to bind.
Warning FailedScheduling <unknown> default-scheduler 0/3 nodes are available: 1 node(s) had taints that the pod didn't tolerate, 2 node(s) didn't find available persistent volumes to bind.

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

SeeyaXi-msft avatar image
0 Votes"
SeeyaXi-msft answered

Hi @sandmanjp-2585 ,

See this thread: https://stackoverflow.com/questions/58671234/kubernetes-nodes-didnt-find-available-persistent-volumes-to-bind
Maybe it will be helpful.
You can confirm whether PV has been configured:
kubectl get sc
kubectl get pv

If the local PV has not been configured before, you can refer to this article.


Best regards,
Seeya

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

sandmanjp-2585 avatar image
0 Votes"
sandmanjp-2585 answered

@SeeyaXi-msft
Thank you.

I use the following method.

https://github.com/Microsoft/sql-server-samples/tree/master/samples/features/sql-big-data-cluster/deployment/kubeadm/ubuntu


The current environment is as follows.

/ mnt / local-storage / vol1
/ mnt / local-storage / vol2
...
/ mnt / local-storage / vol24
/ mnt / local-storage / vol25

The following parameters are specified in the file ’local-storage-provisioner.yaml’

/mnt/local-storage/

Is there a different way?

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

SeeyaXi-msft avatar image
0 Votes"
SeeyaXi-msft answered

Hi @sandmanjp-2585,

You can use that way.
And refer to: https://docs.okd.io/3.9/install_config/configuring_local.html

Best regards,
Seeya


If the response is helpful, please click "Accept Answer" and upvote it, as this could help other community members looking for similar queries.

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

sandmanjp-2585 avatar image
0 Votes"
sandmanjp-2585 answered

@SeeyaXi-msft
Sorry for the late reply.
I'm using this file, is it different?

https://github.com/microsoft/sql-server-samples/blob/master/samples/features/sql-big-data-cluster/deployment/kubeadm/ubuntu/local-storage-provisioner.yaml

Will it be deployed to kubernetes with the file you introduced instead of the following file?
I am using kubeadm.

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

SeeyaXi-msft avatar image
0 Votes"
SeeyaXi-msft answered

Hi @sandmanjp-2585,

It seems that there is no problem, you can open the two web pages and read them together, which will help you understand the steps.
The one you are looking for starts from this part of this article. But the files you are looking for are very complete and you don't need to write them yourself.


Best regards,
Seeya

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.