Hello
I am an experienced VBA programmer, Excel, Word and Access.
I've look to your's description and there are some distinct steps:
1. copy files form a directory to another: easy, solved but I need info's about directories;
2. import data to your database: easy, but need more data.
I need to see a file to understand the structure of data.
More, to understand why some names are skipped I must see your database (some debug job). A explanation about what a "duplicate" mean might be necessary as well (a name, a name and another field... I don't see your's database, I don't know what its there, I can guess only).
I my opinion the problem can be solved by:
1. parsing each file in folder
2. parsing each line in file
3. check for duplicate. How, that depends by structure of your database (type of indexes in tables); here I might change something, I don't know yet...
4. if a duplicate its founded or malformed data, save it into a report text file (or table in database) for further manipulation.
Code will be accessible from a Form via a button.
A lot of talks, that because I don't see yet the data. Things will become easier when I'll get the files.
For more details please contact me.
Yours, Catalin Bojescu