From the course: Complete Guide to Parallel and Concurrent Programming with C++
Join today to access over 24,800 courses taught by industry experts.
Shared versus distributed memory - C++ Tutorial
From the course: Complete Guide to Parallel and Concurrent Programming with C++
Shared versus distributed memory
- In addition to a parallel computer's architecture, which can be categorized using Flynn's taxonomy, another aspect to consider is... Uh. (snaps) - Memory. It's important to understand how the memory's organized and how the computer accesses data. - Right. You could put a billion processors in a computer, but if they can't access memory fast enough to get the instructions and data they need, then you won't gain anything from having all those processors. Computer memory usually operates at a much slower speed than processors do, and when one processor is reading or writing to memory, that often prevents any other processors from accessing that same memory element. There are two main memory architectures that exist for parallel computing, shared memory and distributed memory. In a shared memory system, all processors have access to the same memory as part of a global address space. Although each processor operates independently, if one processor changes a memory location, all of the…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.