Hi,
I created a pipeline with a dataflow I can read the source and have a visualization, in the sink output in settings when I use: "File name option" it works but when I use "Name file as column data" i have the error below,
I can see that it can create a folder temporary folder in destination directory (Data Lake Gen1) with several files but can't rename them.
I'm using a main service for authentication with "read / write and execute" access what could it be?
{"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'sink1': org.apache.hadoop.security.AccessControlException: RENAME failed with error 0x83090aa2 (Forbidden. ACL verification failed. Either the resource does not exist or the user is not authorized to perform the requested operation.). [7ea176e9-e639-4ff4-932a-da6c8f33d2a8][2021-05-25T05:43:14.9562386-07:00] [ServerRequestId:7ea176e9-e639-4ff4-932a-da6c8f33d2a8]","Details":"at Sink 'sink1': org.apache.hadoop.security.AccessControlException: RENAME failed with error 0x83090aa2 (Forbidden. ACL verification failed. Either the resource does not exist or the user is not authorized to perform the requested operation.). [7ea176e9-e639-4ff4-932a-da6c8f33d2a8][2021-05-25T05:43:14.9562386-07:00] [ServerRequestId:7ea176e9-e639-4ff4-932a-da6c8f33d2a8]"}
Source
Thanks
Charbel