From the course: Data Management with Apache NiFi

Unlock this course with a free trial

Join today to access over 25,300 courses taught by industry experts.

Add GetFile and PutDatabase processors

Add GetFile and PutDatabase processors - Apache NiFi Tutorial

From the course: Data Management with Apache NiFi

Start my 1-month free trial Buy for my team

Add GetFile and PutDatabase processors

“

- [Instructor] We'll set up a NiFi flow to read from our local file system, and we'll have it read from the datasets folder. If you look at this datasets folder that I have under my tools directory, you can see there's exactly one file in here to start off with, car_ad_01.csv. Let's take a look at the contents of this file, and you can see that it contains a bunch of information about cars that were advertised on some kind of site. We have the make and model of the car and a bunch of other details. These are the records that we are going to store into our PostgreSQL database. Now, let's head over to the NiFi user and use a processor to read in data from our local file system. This is going to be the GetFile processor. GetFile is exactly like PutFile except that it reads files from the local file system. GetFile requires the read filesystem and write filesystem permissions because as soon as it reads a file from the…

Contents