group by indexing discontinuous timetable

I am tying to identify groupings based on two temporal criteria from a discontinuous timetable array. The timetable is aggregated to 1-minute intervals.

The criteria are:

1. Minimum of five continuous rowtime minutes,

and

2. at least one rowtime less than 15 minutes from #1 (above) or #2).

Put another way, at least five minutes of data and thereafter if one minute is within 15 consecutive minutes continue to include those minutes to the group.

In the end, I want to be able to perform algebraic and other operations on the variable contained in each new grouping (for example taking the sum of each group).

Example data is provided. It looks like there should be a total of 4 groupings. One of the rows (113) is a time that doesn't meet the critera above and thus should either be discarded or flagged differently from the groups so I can remove it later (maybe by a 'nan' flag?).

Answer 1

[Kelly Kearney]

Here's one possible solution; it first checks for criteria 2 and then goes back to verify #1. You can probably do it all in one fell swoop but finding consecutive runs can get messy so I prefer to keep that on its own. I also opted not to mark the extra groups with a NaN, because splitapply and other grouping functions insist on consecutive-integer groupings; I find it cleaner to filter those out after the fact.

% First group by the within-15-minutes criteria

dt = minutes(diff(test1.TIMESTAMP));
grp = cumsum([true; dt>15]);  

% Now check that each subgroup has at least a 5-minute run of consecutives

maxrun = @(x) max(diff([1; find(minutes(diff(x)) > 1); length(x)+1]));
isgood = splitapply(@(x) maxrun(x)>=5, test1.TIMESTAMP, grp);

% Sum of each group

grpsum = splitapply(@sum, test1.mean_V, grp);
grpsum(~isgood) = NaN;

[Eric Escoto]

Works! Thank you.

Quick follow up,

1. The resulting computation for summing is a new independent variable. How can I relate the summation to the starttime and number of rows (minutes) used?
2. How do I do this for more than one variable in the timetable?

[Eric Escoto]

Looks like all I need to do to get other variables is modify the 'Var' name in any generic 'TT.Var' format.

[Kelly Kearney]

You can use the same splitapply setup to do whatever calculations you need:

nt = splitapply(@length, test1.TIMESTAMP, grp); % number of elements in each
t0 = splitapply(@min,    test1.TIMESTAMP, grp); % earliest time in each