Hello, couple of CSV source related questions…
- How do I indicate, for a CSV-based source is, what the primary key column is for each table, so that an upsert can be properly done?
- Is it possible to move the files to another folder (in the operating system) after Sync has ingested them? We would want to archive the files so they don’t get re-processed the next time. I can do this outside of Sync if necessary, but it would be cleaner if Sync could do this somehow (or call out to a batch file on the OS and run that).
- In my case, I have many source files with a timestamp, like MYFILE_XYZ_20231006.TXT. I would like to use the file Aggregation so that I can just pull them all into the same target table. However when I do that, is there a way to pass along the individual filename being processed, into a column in the target table?
Thank you for any assistance you can provide!
Best answer by TaylorView original