I think PCA is a good reason to learn enough linear algebra to understand PCA. It means learning about basis, rank, rank approximation, orthogonality, eigenvectors, spectral decomposition, etc. There's a whole iceberg of concepts that go into actually understand PCA without which PCA is not really understood.