Forum Discussion
Excel: Help! Formula needed
Hi there, I'm a biological research masters student and I have a large data set. I'm working with seals so it is difficult to identify individuals. I'm trying to create a spreadsheet ready for da...
I'm working with seals so it is difficult to identify individuals. I'm trying to create a spreadsheet ready for data collection and have come across two problems.
So at least there are no concerns with violating their privacy here. 🙂 It might be helpful, since that worry doesn't apply, if you could post the actual spreadsheet rather than just an image. Use OneDrive or GoogleDrive and paste a link here that grants access.
That said, let's look at each of your questions:
Problem A: The ID (identity) relates to which individual it is. At present they are named A-F. This is so that when they are identified, the ID that the individual is can be added in, as it may be the case that later in the videos the individual is identified. Is there a way for excel to change all related cells to the new number? For example, when the first "a" changes to "105", I want it to change all the "A's" in the rest of the data set to "105" for that date? There will be multiple different days and times featured on the data collection sheet. So if a formula is created that works for this, will it then change it for the rest even over different dates?
Answer A: yes. That should be fairly easy.
- To be on the safe side, I'd suggest adding a "helper column" to the right of the current ID column, header (perhaps) "Name" or some other heading that indicates "we've actually identified this individual."
- "safer" in that doing it this way doesn't destroy the original ID, just in case there's "re-identification" later in the process. I believe in keeping history, in that sense.
- Then create a table on a separate sheet in the same workbook where you can define the relationship between the temporary letters (your current ID) and the more verified "Name." (I've attached a sample workbook illustrating this, but as noted, if you could post your real one, then we can be fully on the same page.)
- Then in the helper column, use a formula like this (see attached spreadsheet for how it works). This uses the LET function, so you'd need a new version of Excel or a subscription to Microsoft 365. I'm on a Mac myself, so that per se is not an issue.
=LET(known,INDEX(Table2[Name],MATCH([@ID],Table2[ID],0)),IF(known=0,"",known))
Problem B: So far I haven't seen a solution for this yet. Is there a way for Excel to recognise the time patterns? I have tried the control+E method and Excel doesn't recognise the pattern
Answer for the moment: What do you mean by time pattern in this case. What kind of pattern? What is the nature of the pattern you're wanting to recognize? Frequency? Intervals? ??? Duration? etc.
Finally: what version of Excel do you have? And, while we're at it, what Mac OS?
mathetes Thank you for responding to me.
So for problem A:
With my individuals, there are seals moving in and out over time which is another complexity to my data - I have individuals being added and then removed during the data collection (N=40). But I see what you are saying. I have an idea as to what I'll do to solve that problem using your method. So thank you for that!!
Problem B:
So by time pattern I mean purely the pattern within my data so for example:
| Pool | Date | Time | ID |
| 1 | 16/02/2023 | 03:57:05 | A |
| 1 | 16/02/2023 | 03:57:05 | B |
| 1 | 16/02/2023 | 03:57:05 | C |
| 1 | 16/02/2023 | 03:57:05 | D |
| 1 | 16/02/2023 | 03:57:05 | E |
| 1 | 16/02/2023 | 03:57:35 | A |
| 1 | 16/02/2023 | 03:57:35 | B |
| 1 | 16/02/2023 | 03:57:35 | C |
| 1 | 16/02/2023 | 03:57:35 | D |
| 1 | 16/02/2023 | 03:57:35 | E |
| 1 | 16/02/2023 | 03:58:05 | A |
| 1 | 16/02/2023 | 03:58:05 | B |
| 1 | 16/02/2023 | 03:58:05 | C |
| 1 | 16/02/2023 | 03:58:05 | D |
| 1 | 16/02/2023 | 03:58:05 | E |
| 1 | 16/02/2023 | 03:58:35 | A |
| 1 | 16/02/2023 | 03:58:35 | B |
| 1 | 16/02/2023 | 03:58:35 | C |
| 1 | 16/02/2023 | 03:58:35 | D |
| 1 | 16/02/2023 | 03:58:35 | E |
| 1 | 16/02/2023 | 03:59:05 | A |
| 1 | 16/02/2023 | 03:59:05 | B |
| 1 | 16/02/2023 | 03:59:05 | C |
| 1 | 16/02/2023 | 03:59:05 | D |
| 1 | 16/02/2023 | 03:59:05 | E |
I'm using video time-lapsed data which is taking a snapshot every 30s from midnight to midnight (throughout the day). So as you can see in the section of table above, when there is 5 individuals (for example), there will be 5 copies of the same time which then going into the next "bunch" of cells will be 30s later and so forth. If I select all of the above in time to go down, it only repeats what is above it, which doesn't quite work as I have differing start and stop times (caused by issues with cameras).
I don't think this a "pattern" that excel will recognise or duplicate. Hence why I'm doing it manually.
I've attached the link (hopefully) so you should be able to see the document. There is no data inputted into it as of yet. If it doesn't work, let me know.
I also have the latest Microsoft Excel and I'm on a Ventura 13.1
The rightmost 2 columns of your grid could be generate by formula provided they are completely regular.
= LET( sequence, QUOTIENT(SEQUENCE(rows,1,0,1),sealCount), time, startTime + sequence*interval, individual, MOD(SEQUENCE(rows,1,0,1),sealCount), HSTACK(time, INDEX({"A","B","C","D","E"}, 1+individual)) )Does this return the intended result?
Formula in cell E2 in the example and filled down:
=INDEX($C$2:$C$10000,IF(MOD(ROW(A1),5)=0,QUOTIENT(ROW(A1),5),QUOTIENT(ROW(A1),5)+1))Formula in cell C2 in the example and filled down:
=ROW(A1)/2880+1/17280So to answer mathetes questions:
My apologies, it's a hard one to define for me as I'm neurodivergent.
So I think the "pattern" is dependent on how many individuals are within that pool during that day. So for example the max number of seals in pool 1 for the 16/2/2023 is 5. So there will be 5 replicates of the time signature e.g. 12:23:35, before going into the next time signature where there will be another 5 replicates of the same time signature 12:24:05. The start time varies because of malfunctions and other issues in regards to the cameras. So for example this particular clip for the day starts at 13:13:05 and ends at 15:38:35. There is no consistency with the cameras in regards to the time they start the Timelapse so this is near enough always going to be different. However, the times between the start and end will always be 30s as that was what the interval for the Timelapse was set to.
So. OliverScheurich has the wanted outcome however, I need it to duplicate the same time for every 5 rows for example. And then for other days, in other pools I have 12 individuals, so there would need to be 12 replicates of the same time.
I guess what I'm trying to do is to find a way to repeat the same times for x rows (dependent on the number of individuals) and then have the time change for 30s later and then repeat for another x rows for the same day to an unspecified time point. I hope that makes sense!
=INDEX($C$2:$C$10000,IF(MOD(ROW(A1),12)=0,QUOTIENT(ROW(A1),12),QUOTIENT(ROW(A1),12)+1))
This formula duplicates the results in column E for every 12 rows. I've only changed 5 to 12 compared to the already suggested formula.
=ROW(A1)/2880+18006/86400
With this formula you can change the start time to 05:00:36. The formula is in cell C2. The first part ROW(A1)/2880 represents 30 seconds and 18006/86400 represents 05:00:06 because this is the 18006th second of the day. You can fill this formula down until the actual end time for that day.
by time pattern I mean purely the pattern within my data
Of course it's a pattern within the data.
So as you can see in the section of table above, when there is 5 individuals (for example), there will be 5 copies of the same time which then going into the next "bunch" of cells will be 30s later and so forth. If I select all of the above in time to go down, it only repeats what is above it, which doesn't quite work as I have differing start and stop times (caused by issues with cameras).
I don't think this a "pattern" that excel will recognise or duplicate. Hence why I'm doing it manually.
I apologize if I'm being dense, but although I get that there are five instances of the same time, and then another bunch, "and so forth," it's still not quite clear how you're defining what a pattern IS. (And maybe more to the point, what it ISN'T, which is a contrast question that sometimes makes definitions clearer). Where (when?) does a pattern begin and end? What makes it a "pattern" in your definition? Why would some combinations NOT be a pattern?
If we can get a clear definition (clarity being achieved by defining boundaries) of what constitutes a pattern, it is entirely possible that we could create a formula/function that will recognize same.
I was able to open your file on OneDrive. Thank you.
FWIW, my Ventura is 13.3.1 ... a slight update. I'm glad you have the new Excel versions, since that gives us access to some neat new features which might help identifying/recognizing patterns.
