[Guest Blog] Can Technology Help Us Get Back to Sleep?

Published Jun 04 2020 12:41 PM 1,171 Views
Microsoft

This article was written by Microsoft employee Jeff Van Nortwick as part of the Humans of IT Guest Blogger series. Read on to learn how Jeff uses hardware and software to try and determine the root cause of his daughter's sleep walking episodes. 

 

My daughter, Katie, suffers from a combination of Epilepsy and something you might call sleep walking.  This sleep walking behavior happens every night - about twelve or more times per night; at seemingly random intervals. When combined, the two conditions pose a very real and severe threat to her safety because at any moment, while sleep walking, she might suffer a seizure, fall and hurt herself. The problem with this behavior is that she often experiences seizures while sleep walking and ends up stumbling around her room, or falling to the floor, only to get back up and continue the cycle.  Our family has sought out help from numerous medical professionals, followed their advice, participated in sleep studies, etc., but none of that has improved the situation.  Therefore, I am now trying to determine the triggers for this behavior, in order to see if I can improve the situation myself.

One of the first things I did in order to try and understand the root cause of the problem was to install a security camera in her room.  Here, I use a combination of a PC and Blue Iris Software to monitor and record her sleeping.  This video has proven to be the most reliable way to determine what is going on at night.  However, it's very challenging to watch over eight hours of video - even at 128 times speed - every day.  I have therefore tried and had some success in using Microsoft's Video Indexer Service to highlight relevant portions of the video.   My main challenge here is upload speed from my home to the cloud.

jeffvan1018_0-1590772769575.png

 

The next device I tried to use in order to help the situation was a simple Fitbit Alta HR.  I thought that we might learn something by looking at her resting heart rate throughout the night.  So far, the data has not helped me predict when an episode might occur, but it does help me understand where in my video feed I should look for episodes.  The following is a crude screen capture I stitched together to show how heart rate spikes correspond to nightly episodes.

alta-hr.png

Now, more recently, I'm trying to determine if environmental conditions are somehow influencing this behavior.  To do this, I use a Microsoft Azure IoT Starter Kit w/ Adafruit Feather HUZZAH to record temperature and humidity data in Katie's room.  This data is transferred to an instance of Azure IoT Hub.  Then, the data is made available for analysis with Azure Time Series Insights.  This allows me to see if there is any correlation between an episode and her room's temperature or humidity.  I also have a few other temperature and humidity sensors deployed inside and outside our house, so I can add their data into the mix too.  The following image is an example of how this data looks.  Time Series Insights allows me to add markers to the visualization (the vertical bars) that correspond to her episodes.  These make it easier to see what is happening.

tsi.png

So far, I haven't found a root cause for this situation.  However, I am hopeful that technology will someday help us get back to regular sleep. If anyone has good suggestions on how to leverage tech to minimize sleep walking, please share your ideas in the comments section below!

 

#HumansofIT

#TechforGood

3 Comments
%3CLINGO-SUB%20id%3D%22lingo-sub-1443039%22%20slang%3D%22en-US%22%3ERe%3A%20%5BGuest%20Blog%5D%20Can%20technology%20help%20us%20get%20back%20to%20sleep%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1443039%22%20slang%3D%22en-US%22%3E%3CP%3EI%20know%20you%20talked%20with%20expert%20doctors%20and%20you%20have%20more%20knowledge%20than%20me%20on%20this%20issue.%26nbsp%3B%3C%2FP%3E%0A%3CP%3EBut%20I%20may%20share%20some%20tips%20and%20you%20could%20try%20them%20out.%3C%2FP%3E%0A%3CP%3EOne%20method%20is%20using%20motion%20sensors%2C%20there%20are%20normally%20being%20used%20for%20robbery%20%2C%20but%20you%20may%20place%20them%20in%20locations%20where%20no%20one%20moves%20around%20after%20sleep%20and%20set%20timer%20like%20at%20this%20hour%20she%20would%20be%20sleeping%20and%20sensor%20should%20be%20on%20and%20once%20it%20detects%20movement%2C%20then%20trigger%20alert%20and%20let%20you%20know%2C%20so%20you%20could%20see%20the%20exact%20time.%3C%2FP%3E%0A%3CP%3EYou%20may%20monitor%20heartbeat%20through%20a%20day%20and%20compare%20it%20with%20lifestyle%20like%20when%20it%20is%20like%20higher%20rate%2C%20you%20might%20see%20there%20is%20something%20causing%20stress%20and%20investigate%20it.%20I%20believe%20you%20need%20to%20collect%20health%20related%20data%20through%20few%20weeks%20and%20check%20them%20with%20her%20lifestyle%20and%20consult%20with%20doctors.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1443569%22%20slang%3D%22en-US%22%3ERe%3A%20%5BGuest%20Blog%5D%20Can%20technology%20help%20us%20get%20back%20to%20sleep%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1443569%22%20slang%3D%22en-US%22%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F13441%22%20target%3D%22_blank%22%3E%40Reza%20Ameri%3C%2FA%3E%26nbsp%3BThanks!%26nbsp%3B%20That's%20a%20great%20suggestion%20-%20and%20I%20already%20have%20a%20PIR%20sensor%20in%20my%20IOT%20kit.%26nbsp%3B%20I'll%20give%20it%20a%20shot.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1445276%22%20slang%3D%22en-US%22%3ERe%3A%20%5BGuest%20Blog%5D%20Can%20technology%20help%20us%20get%20back%20to%20sleep%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1445276%22%20slang%3D%22en-US%22%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F682640%22%20target%3D%22_blank%22%3E%40jeffvan1018%3C%2FA%3E%26nbsp%3BWelcome%2C%20I%20believe%20you%20will%20need%20to%20also%20collect%20as%20much%20as%20data%20related%20to%20heartbeat%20or%20even%20the%20pattern%20for%20movement%2C%20may%20be%20you%20could%20find%20some%20clue.%3C%2FP%3E%0A%3CP%3EFor%20me%2C%20when%20I%20ran%20into%20a%20problem%20where%20I%20am%20not%20sure%20what%20to%20do%2C%20I%20just%20collect%20data%20and%20observe%20and%20magically%20I%20find%20out%20something%20which%20I%20never%20though%20about%20it%20before.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1427308%22%20slang%3D%22en-US%22%3E%5BGuest%20Blog%5D%20Can%20Technology%20Help%20Us%20Get%20Back%20to%20Sleep%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1427308%22%20slang%3D%22en-US%22%3E%3CP%3E%3CEM%3EThis%20article%20was%20written%20by%20Microsoft%20employee%20Jeff%20Van%20Nortwick%20as%20part%20of%20the%20Humans%20of%20IT%20Guest%20Blogger%20series.%20Read%20on%20to%20learn%20how%20Jeff%20uses%20hardware%20and%20software%20to%20try%20and%20determine%20the%20root%20cause%20of%20his%20daughter's%20sleep%20walking%20episodes.%26nbsp%3B%3C%2FEM%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EMy%20daughter%2C%20Katie%2C%20suffers%20from%20a%20combination%20of%20Epilepsy%20and%20something%20you%20might%20call%20sleep%20walking.%26nbsp%3B%20This%20sleep%20walking%20behavior%20happens%20every%20night%20-%20about%20twelve%20or%20more%20times%20per%20night%3B%20at%20seemingly%20random%20intervals.%20When%20combined%2C%20the%20two%20conditions%20pose%20a%20very%20real%20and%20severe%20threat%20to%20her%20safety%20because%20at%20any%20moment%2C%20while%20sleep%20walking%2C%20she%20might%20suffer%20a%20seizure%2C%20fall%20and%20hurt%20herself.%20The%20problem%20with%20this%20behavior%20is%20that%20she%20often%20experiences%20seizures%20while%20sleep%20walking%20and%20ends%20up%20stumbling%20around%20her%20room%2C%20or%20falling%20to%20the%20floor%2C%20only%20to%20get%20back%20up%20and%20continue%20the%20cycle.%26nbsp%3B%20Our%20family%20has%20sought%20out%20help%20from%20numerous%20medical%20professionals%2C%20followed%20their%20advice%2C%20participated%20in%20sleep%20studies%2C%20etc.%2C%20but%20none%20of%20that%20has%20improved%20the%20situation.%26nbsp%3B%20Therefore%2C%20I%20am%20now%20trying%20to%20determine%20the%20triggers%20for%20this%20behavior%2C%20in%20order%20to%20see%20if%20I%20can%20improve%20the%20situation%20myself.%3CBR%20%2F%3E%3CBR%20%2F%3EOne%20of%20the%20first%20things%20I%20did%20in%20order%20to%20try%20and%20understand%20the%20root%20cause%20of%20the%20problem%20was%20to%20install%20a%20security%20camera%20in%20her%20room.%26nbsp%3B%20Here%2C%20I%20use%20a%20combination%20of%20a%20PC%20and%20-ERR%3AREF-NOT-FOUND-Blue%20Iris%20Software%26nbsp%3Bto%20monitor%20and%20record%20her%20sleeping.%26nbsp%3B%20This%20video%20has%20proven%20to%20be%20the%20most%20reliable%20way%20to%20determine%20what%20is%20going%20on%20at%20night.%26nbsp%3B%20However%2C%20it's%20very%20challenging%20to%20watch%20over%20eight%20hours%20of%20video%20-%20even%20at%20128%20times%20speed%20-%20every%20day.%26nbsp%3B%20I%20have%20therefore%20tried%20and%20had%20some%20success%20in%20using%20-ERR%3AREF-NOT-FOUND-Microsoft's%20Video%20Indexer%20Service%20to%20highlight%20relevant%20portions%20of%20the%20video.%26nbsp%3B%20%26nbsp%3BMy%20main%20challenge%20here%20is%20upload%20speed%20from%20my%20home%20to%20the%20cloud.%3CBR%20%2F%3E%3CBR%20%2F%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22jeffvan1018_0-1590772769575.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F195409iADA19D080DCC3ACC%2Fimage-size%2Fmedium%3Fv%3D1.0%26amp%3Bpx%3D400%22%20title%3D%22jeffvan1018_0-1590772769575.png%22%20alt%3D%22jeffvan1018_0-1590772769575.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThe%20next%20device%20I%20tried%20to%20use%20in%20order%20to%20help%20the%20situation%20was%20a%20simple%20-ERR%3AREF-NOT-FOUND-Fitbit%20Alta%20HR.%26nbsp%3B%20I%20thought%20that%20we%20might%20learn%20something%20by%20looking%20at%20her%20resting%20heart%20rate%20throughout%20the%20night.%26nbsp%3B%20So%20far%2C%20the%20data%20has%20not%20helped%20me%20predict%20when%20an%20episode%20might%20occur%2C%20but%20it%20does%20help%20me%20understand%20where%20in%20my%20video%20feed%20I%20should%20look%20for%20episodes.%26nbsp%3B%20The%20following%20is%20a%20crude%20screen%20capture%20I%20stitched%20together%20to%20show%20how%20heart%20rate%20spikes%20correspond%20to%20nightly%20episodes.%3CBR%20%2F%3E%3CBR%20%2F%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22alta-hr.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F195412iA9CDF7BBC19E7DFA%2Fimage-size%2Fmedium%3Fv%3D1.0%26amp%3Bpx%3D400%22%20title%3D%22alta-hr.png%22%20alt%3D%22alta-hr.png%22%20%2F%3E%3C%2FSPAN%3E%3CBR%20%2F%3E%3CBR%20%2F%3E%3C%2FP%3E%0A%3CP%3ENow%2C%20more%20recently%2C%20I'm%20trying%20to%20determine%20if%20environmental%20conditions%20are%20somehow%20influencing%20this%20behavior.%26nbsp%3B%20To%20do%20this%2C%20I%20use%20a%20-ERR%3AREF-NOT-FOUND-Microsoft%20Azure%20IoT%20Starter%20Kit%20w%2F%20Adafruit%20Feather%20HUZZAH%20to%20record%20temperature%20and%20humidity%20data%20in%20Katie's%20room.%26nbsp%3B%20This%20data%20is%20transferred%20to%20an%20instance%20of%20-ERR%3AREF-NOT-FOUND-Azure%20IoT%20Hub.%26nbsp%3B%20Then%2C%20the%20data%20is%20made%20available%20for%20analysis%20with%20-ERR%3AREF-NOT-FOUND-Azure%20Time%20Series%20Insights.%26nbsp%3B%20This%20allows%20me%20to%20see%20if%20there%20is%20any%20correlation%20between%20an%20episode%20and%20her%20room's%20temperature%20or%20humidity.%26nbsp%3B%20I%20also%20have%20a%20few%20other%20temperature%20and%20humidity%20sensors%20deployed%20inside%20and%20outside%20our%20house%2C%20so%20I%20can%20add%20their%20data%20into%20the%20mix%20too.%26nbsp%3B%20The%20following%20image%20is%20an%20example%20of%20how%20this%20data%20looks.%26nbsp%3B%20Time%20Series%20Insights%20allows%20me%20to%20add%20markers%20to%20the%20visualization%20(the%20vertical%20bars)%20that%20correspond%20to%20her%20episodes.%26nbsp%3B%20These%20make%20it%20easier%20to%20see%20what%20is%20happening.%3CBR%20%2F%3E%3CBR%20%2F%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22tsi.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F195416iB32D3EDE7AD228EE%2Fimage-size%2Fmedium%3Fv%3D1.0%26amp%3Bpx%3D400%22%20title%3D%22tsi.png%22%20alt%3D%22tsi.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3ESo%20far%2C%20I%20haven't%20found%20a%20root%20cause%20for%20this%20situation.%26nbsp%3B%20However%2C%20I%20am%20hopeful%20that%20technology%20will%20someday%20help%20us%20get%20back%20to%20regular%20sleep.%20If%20anyone%20has%20good%20suggestions%20on%20how%20to%20leverage%20tech%20to%20minimize%20sleep%20walking%2C%20please%20share%20your%20ideas%20in%20the%20comments%20section%20below!%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%23HumansofIT%3C%2FP%3E%0A%3CP%3E%23TechforGood%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-1427308%22%20slang%3D%22en-US%22%3E%3CP%3E%3CEM%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-center%22%20image-alt%3D%22sleep.JPG%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F196577i3533173D871BDE98%2Fimage-size%2Flarge%3Fv%3D1.0%26amp%3Bpx%3D999%22%20title%3D%22sleep.JPG%22%20alt%3D%22Can%20technology%20help%20us%20get%20back%20to%20sleep%3F%22%20%2F%3E%3CSPAN%20class%3D%22lia-inline-image-caption%22%20onclick%3D%22event.preventDefault()%3B%22%3ECan%20technology%20help%20us%20get%20back%20to%20sleep%3F%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FEM%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CEM%3EThis%20article%20was%20written%20by%20Microsoft%20employee%20Jeff%20Van%20Nortwick%20as%20part%20of%20the%20Humans%20of%20IT%20Guest%20Blogger%20series.%20Read%20on%20to%20learn%20how%20Jeff%20uses%20hardware%20and%20software%20to%20try%20and%20determine%20the%20root%20cause%20of%20his%20daughter's%20sleep%20walking%20episodes.%26nbsp%3B%3C%2FEM%3E%3C%2FP%3E%3C%2FLINGO-TEASER%3E
Version history
Last update:
‎Jun 29 2020 10:23 AM
Updated by: