question

NagasudhakarPatamsetty-2842 avatar image
0 Votes"
NagasudhakarPatamsetty-2842 asked MikeUrnun commented

How to hold session Id in salesforce connector to use in next actions in logic apps

Hi,

I want to query huge number of records (in millions) from salesforce. so I used salesforce connector in logic app and used action as "Get Records" which is returning first 200 records and @odata.nextLink which will have URI for next set of records. but when I tried to do http call as next action with the given url (@odata.nextLink) it's throwing error and I am not seeing any way on how to get session id of salesforce connection so i can use the same in next actions.

will connector support if we need to query millions of records ?
how to hold the session id/access token for of salesforce to use in next actions?

please let me know on your suggestions.

azure-logic-appspower-query-not-supported
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

MikeUrnun avatar image
0 Votes"
MikeUrnun answered MikeUrnun commented

@NagasudhakarPatamsetty-2842 I believe the Salesforce connector supports the Pagination feature so the connector should automatically fetch the records for you. All you'd have to do is turn on Pagination in the Settings of the connector, please review: Get more data, items, or records by using pagination in Azure Logic Apps


· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi MikeUkrnun, Thanks for responding.

I have already seen that option to turn on the pagination. However there we can set threshold maximum as 1 lakh. and it's not returning more than that threshold. mean it's not returning more than 100000 but in my case i have to query around 2 million records using Get Records action under Salesforce connector. please let me know if I am missing something. Thanks!

0 Votes 0 ·
MikeUrnun avatar image MikeUrnun NagasudhakarPatamsetty-2842 ·

@NagasudhakarPatamsetty-2842 In Pagination settings, could you see if there's an option to set the starting index to paginate at each run? If so, you can put the Get Records action in a sequential loop such that each iteration results in yielding 100K records up to the 2million records. I'm not able to confirm this as I don't have an active subscription to Salesforce CRM but in the case of SQL connector which has the same 100K limit, and that is how we overcome the limit.


0 Votes 0 ·

@NagasudhakarPatamsetty-2842 Just to add to and clarify on the starting index mentioned in my comment above, it's the $skip parameter documented here: https://docs.microsoft.com/en-us/connectors/salesforce/#get-records

0 Votes 0 ·