This is what I have at present and not sure how to get to what I am after (i.e. 10 items at a time to build the url string, etc. to be configurable)
Lookup reads a .csv which has column1, column2, column3 in it but uses column1 (Which is named as p_Name to pass to build string).
The lookup feeds the foreach activity.
Later in the pipeline, the other two columns are used for other things (To pass to dataflow, etc.)
There may be a-lot of rows with Names in this column1 of the .csv file...
Inside the download copy activity (see screenshot below) I concatenate a string like:
http://xyz/foldername/ventures in ('Name1', 'Name2','Name3',..., 'Name143')
Please note that at present, I do get the above string but the problem is that because if there are a-lot of Names in p_name column of the .csv, the string gets too long and the url does not accept those many Names and so I would like to send the url in smaller batches say 10 at a time which can perhaps be configured with a parameter...
The copy activity as you se takes the url with the first 10 names and processes them.
I would like this copy activity to process the names in batches of say 10 until it gets to the 143 names