question

RihabBenAicha-3346 avatar image
0 Votes"
RihabBenAicha-3346 asked SaurabhSharma-msft edited

Cassandra throughput change request is locked for unknown time?

My Cassandra RUs request seems to be locked for an hour now, with no success in altering RUs down. I don't seem to find details about how long can such an operation take but do you guys have any thoughts that can help? I see this in the log:

WriteFailure: Error from server: code=1500 [Replica(s) failed to execute write] message="Error from the store: Status Code=423, ActivityID=, Additional Details='Response status code does not indicate success: Locked (423); Substatus: 0; ActivityId: ; Reason: (Message: {"Errors":["Another offer replace operation is in progress. Please retry after sometime."]}


ResourceType: Offer, OperationType: PreReplaceValidation

, SDK: Microsoft.Azure.Documents.Common/2.14.0, Please see CosmosDiagnostics, Windows/10.0.17763 cosmos-netstandard-sdk/3.18.0);'" info={'failures': 1, 'received_responses': 0, 'required_responses': 1, 'consistency': 'QUORUM'}


azure-cosmos-db
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @rihabbenaicha-3346,

Thanks for using Microsoft Q&A !!
sorry for your trouble. Are you still having this issue ? How many documents you are trying to query as query and reading large documents requires many request units (RUs). If there are a large number of such operations, you might end up using most of your provisioned throughput.

Thanks
Saurabh

0 Votes 0 ·

Thank you for your answer @SaurabhSharma-msft. Yes, it still happens and it's reproducible. My RUs are set to 400k during data loads (writes to the DB). I'm writing a dataset that's not large around 320k row. And I'm using spark connector to load this data (with 8-10 executiors). As soon as the load finishes I try to set RUs back to 4k and that's when I hit the lock issue with an error saying that message : Another offer replace operation is in progress. Please retry after sometime.

0 Votes 0 ·

Hi @rihabbenaicha-3346,

Thanks for sharing details. Products team need to investigate this issue further in your environment and you may have to open a support ticket for the same. In case you have a limitation, please send an email to azcommunity[at]microsoft[dot]com with your subscription id with this Q&A thread link and subject as "Attn: Saurabh' and I will help providing a free support ticket for you.

Thanks
Saurabh

1 Vote 1 ·

0 Answers