From the course: Architecting Big Data Applications: Batch Mode Application Engineering
Join today to access over 25,300 courses taught by industry experts.
Technology selection
From the course: Architecting Big Data Applications: Batch Mode Application Engineering
Technology selection
- [Instructor] Most big data applications are primarily built using out-of-the-box technologies that provide the required scalability and resiliency. Choosing the right technologies for the use case is a set of critical decisions that can make or break the application. Let's briefly discuss the big data technology landscape. Several big data technologies have been developed in the past decade or more. They are a combination of open source enterprise products and software as a service offerings. Multiple categories of technologies are available including processing engines, NoSQL databases, and message queues. Some of the popular technologies are Apache Spark for processing data, Apache Kafka for message queues, MongoDB for NoSQL databases, and Redis for distributed cache. Each of these technologies have their own unique advantages and shortcomings. None of them are perfect in every criteria. Hence, there is no…
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.