difficulty filter file with big data
Afficher commentaires plus anciens
I need of help me with this script. I want to filter all the columns but this is very slow.
there I have filtered only two columns.
My file loaded is only example.
clear all
clc
tic
a = 1;
r = zeros(3268760,1);
load ('filter_big_data'); % this file ís a matrix 576x3268760 double
for i = 1:2
z1 = b(b(:,1) == 0, :);
s1 = sum(z1, 1);
s2 = max(s1);
r(a,1) = max(s1);
a = a + 1;
end
toc
Elapsed time is 209.340817 seconds. % this time was elapsed for to filter two columns of
Thank by attention!!!
3 commentaires
load filter_big_data
whos
You do not have any array named a.
You override the b=1 when you load the file, getting b to be a 10 x 3268760 array.
AIRTON
le 21 Sep 2025
Walter Roberson
le 22 Sep 2025
z1 = b(b(:,1) == 0, :);
That code does not depend on a or i so it is going to produce the same result for every iteration of the loop. Because of that, every iteration of the loop is going to perform the same operation.
I would suggest that the code should be closer to
tic
r = zeros(3268760,1);
load ('filter_big_data'); % this file ís a matrix 576x3268760 double
for i = 1:2
z1 = b(b(:,i) == 0, :);
s1 = sum(z1, 1);
s2 = max(s1);
r(i,1) = max(s1);
end
toc
Réponses (0)
Catégories
En savoir plus sur Matrices and Arrays dans Centre d'aide et File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!