Sometimes you have several files to read, all with the same structure, but different data. In this recipe, you will see how to read those files in a single step. The example uses a list of files containing names of museums in Italy.
You must have a group of text files in a directory, all with the same format. In this recipe, the names of these files start with museums_italy_ for example, museums_italy_1, museums_italy_2, museums_italy_roma, museums_italy_genova, and so on.
Each file has a list of names of museums, one museum on each line.
Carry out the following steps:
Create a new transformation.
Drop a Text file input step onto the work area.
Under the File or directory tab, type the directory where the files are.
In the Regular Expression textbox, type:
museums_italy_.*\.txtThen click on the Add button. The grid will be populated, as shown in the following screenshot:
