Parallel & Distributed Computing
This subject walks you through the most important concepts step by step, starting from the foundations and moving towards practical exam-focused preparation. Use this page as your central place to revise topics, jump into notes, and quickly access practice material when you need it.
U1
General Topics
topic 1 to 35
35 topics
01
Asynchronous/synchronous computation/communication
02
Concurrency control
03
Fault tolerance
04
GPU architecture and programming
05
Heterogeneity
06
Interconnection topologies
07
Load balancing
08
Memory consistency model
09
Memory hierarchies
10
Message passing interface (MPI)
11
MIMD/SIMD
12
Multithreaded programming
13
Parallel algorithms & architectures
14
Parallel I/O
15
Performance analysis and tuning
16
Power considerations
17
Programming models
18
Data parallel programming
19
Task parallel programming
20
Process-centric programming
21
Shared memory programming
22
Distributed memory programming
23
Scalability and performance studies
24
Scheduling
25
Storage systems
26
Synchronization
27
Parallel computing tools
28
CUDA, Swift
29
Globus, Condor
30
Amazon AWS, OpenStack
31
Cilk
32
GDB for parallel debugging
33
Threads programming
34
MPICH, OpenMP
35
Hadoop, FUSE
Past Papers
Open this section to load past papers
Click on Show Past Papers to see past papers.
📁 Subject Resources