Multiplication of large matrix with its transpose
53 vues (au cours des 30 derniers jours)
Afficher commentaires plus anciens
FW
le 15 Déc 2021
Commenté : Chris Wilson
le 15 Avr 2024 à 6:31
What would be the best way to multiply a large matrix A say, 100000 x 10, by its transpose A' in MATLAB 2021b. The output will be a 100000x100000 matrix. This is giving a memory error > 40 GB.
Previous suggestions in Q&A include avoiding creation of A' before multiplication. This certainly helps in reducing time with smaller matrices as tested with 30,000 points. Thanks.
1 commentaire
Chris Wilson
le 15 Avr 2024 à 6:31
Thanks a lot - this is extremely helpful to know - it helped me solve a related problem.
Réponse acceptée
John D'Errico
le 15 Déc 2021
Best is to never create it at all. Instead, use mathematics to work with it. And that depends on what you will do with this matrix. But there are many ways to work with such a matrix, that would completely avoid ever needing to create the matrix at all.
For example, do you want the eigenvalues? I'll do it on a small matrix A, because I want to show how to achieve the same results.
A = randn(1000,5);
[V0,D0] = eig(A*A');
D0(end + [-4:0],end + [-4:0]) % all other eigenvalues will be zero
% now, without computing A*A' at all.
[Q,R] = qr(A,0);
[V,D] = eig(R*R')
We can also compute the eigenvectors.
My point is, there are many things you can do without ever needing to compute that huge mess of a matrix.
0 commentaires
Plus de réponses (1)
James Tursa
le 15 Déc 2021
The fastest way is to simply write it as A * A', because MATLAB will see that the operands are the same and call a special multi-threaded symmetric BLAS library function to do the multiply without explicitly forming the transpose A' first.
As for your memory problems, that is an entirely different issue. If you really need this result and it is full, then you may be forced to chunk out the operation into smaller pieces and work on them individually. If A has lots of 0's then you could look into sparse representations.
0 commentaires
Voir également
Catégories
En savoir plus sur Matrix Indexing dans Help Center et File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!