I have Flat files being delivered on a regular basis to my dropbox.
They are placed in various variable subdirectories of a single directory.
Whenever a file becomes "available" in dropbox under that main directory, I need it uploaded to my database for processing.
The data structure is always the same, and the naming convention is
[url removed, login to view]
I need the filename available with the data in the database.
With the filename in a column, all files could be loaded into a single table.
When the file is loaded, a "control table" needs to have that filename added to it so I know there is data to process, and the original flat file can be zipped and archived.
If there are any parameters required for connections, I'd like that to be kept in a parameter file.