Azure Percept Body joint detection applied to Golf swing

%3CLINGO-SUB%20id%3D%22lingo-sub-2446782%22%20slang%3D%22en-US%22%3EAzure%20Percept%20Body%20joint%20detection%20applied%20to%20Golf%20swing%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2446782%22%20slang%3D%22en-US%22%3E%3CP%3EI%20own%20a%20Percept%20DK.%20I%20want%20to%20do%20an%20experiment%20applying%20vision%20to%20golf.%26nbsp%3B%20Possibly%20ball%20to%20club%20contact%20for%20good%20contact%20vs%20bad%2C%20which%20would%20involve%20detection%20at%2090%20mph%20club%20head%20speed.%26nbsp%3B%20Or%20possibly%20something%20that%20tracks%20the%20body%20joints%20during%20a%20swing%20to%20predict%20if%20the%20swing%20is%20optimal%20or%20not%20by%20comparing%20the%20joints%20of%20pro%20golfers.%26nbsp%3B%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI'm%20just%20curious%20if%20anyone%20in%20this%20Percept%20Community%20has%20any%20ideas%20or%20has%20applied%20their's%20to%20golf.%26nbsp%3B%20This%20is%20just%20a%20fun%20project%20I%20want%20to%20do%20with%20my%2016%20year%20old%20daughter%20who%20is%20a%20good%20golfer!%26nbsp%3B%20I%20have%20seen%20some%20examples%20of%20the%20body%20joints%2Fkeypoints%20that%20looks%20close%20and%20might%20work.%26nbsp%3B%20I'd%20prefer%20it%20be%20low%20code%2Fno%20code%20to%20keep%20it%20simple.%26nbsp%3B%3C%2FP%3E%3CP%3EAny%20ideas%3F%20Tips%3F%26nbsp%3B%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-2464162%22%20slang%3D%22en-US%22%3ERe%3A%20Azure%20Percept%20Body%20joint%20detection%20applied%20to%20Golf%20swing%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2464162%22%20slang%3D%22en-US%22%3E%3CP%3EHi%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F1078914%22%20target%3D%22_blank%22%3E%40donnie_kerr%3C%2FA%3E%2C%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EGreat%20idea.%20I%20know%20there%20have%20been%20other%20POCs%20that%20track%20and%20detect%20body%20movements%20but%20I'm%20not%20sure%20how%20well%20they%20apply%20to%20your%20requirements.%20I'm%20looking%20into%20this%20and%20will%20let%20you%20know%20what%20I%20find%20out.%20-Thanks%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-2467301%22%20slang%3D%22en-US%22%3ERe%3A%20Azure%20Percept%20Body%20joint%20detection%20applied%20to%20Golf%20swing%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2467301%22%20slang%3D%22en-US%22%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F1078914%22%20target%3D%22_blank%22%3E%40donnie_kerr%3C%2FA%3E%26nbsp%3Bsounds%20really%20cool.%20Part%20of%20getting%20started%20is%20knowing%20what%20to%20search%20for.%20It%20sounds%20like%20you%20are%20looking%20for%20Body%20Pose%20detection.%20You'll%20need%20to%20find%20a%20good%20model%20that%20does%20this%2C%20and%20make%20sure%20it's%20one%20of%20the%20deployment%20models%20supported%20by%20Azure%20Percept.%20Here's%20a%20general%20article%20on%20Body%20Pose%20detection%20that%20may%20be%20helpful%2C%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fmobidev.biz%2Fblog%2Fhuman-pose-estimation-ai-personal-fitness-coach%22%20target%3D%22_blank%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3EHuman%20Pose%20Estimation%20Technology%202021%20Guide%20(mobidev.biz)%3C%2FA%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EAnother%20place%20that's%20always%20good%20to%20investigate%20is%20the%20%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2Fmicrosoft%2Fazure-percept-advanced-development%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3Emicrosoft%2Fazure-percept-advanced-development%3A%20Azure%20Percept%20DK%20advanced%20topics%20(github.com)%3C%2FA%3E%26nbsp%3Bon%20GitHub.%20On%20that%20page%20you%20will%20see%20%22Model%20URLs%22%2C%20these%20are%20models%20that%20are%20compatible%20with%20Azure%20Percept.%20In%20this%20case%2C%20take%20a%20look%20at%20the%20%22Open%20Pose%22%20model.%3CBR%20%2F%3E%3CBR%20%2F%3EThese%20two%20articles%20should%20be%20enough%20to%20get%20you%20started.%20Let%20us%20know%20how%20it%20goes!%3C%2FP%3E%3C%2FLINGO-BODY%3E
New Contributor

I own a Percept DK. I want to do an experiment applying vision to golf.  Possibly ball to club contact for good contact vs bad, which would involve detection at 90 mph club head speed.  Or possibly something that tracks the body joints during a swing to predict if the swing is optimal or not by comparing the joints of pro golfers.  

 

I'm just curious if anyone in this Percept Community has any ideas or has applied their's to golf.  This is just a fun project I want to do with my 16 year old daughter who is a good golfer!  I have seen some examples of the body joints/keypoints that looks close and might work.  I'd prefer it be low code/no code to keep it simple. 

Any ideas? Tips?  

7 Replies

Hi @donnie_kerr,

 

Great idea. I know there have been other POCs that track and detect body movements but I'm not sure how well they apply to your requirements. I'm looking into this and will let you know what I find out. -Thanks

@donnie_kerr sounds really cool. Part of getting started is knowing what to search for. It sounds like you are looking for Body Pose detection. You'll need to find a good model that does this, and make sure it's one of the deployment models supported by Azure Percept. Here's a general article on Body Pose detection that may be helpful, Human Pose Estimation Technology 2021 Guide (mobidev.biz)

 

Another place that's always good to investigate is the microsoft/azure-percept-advanced-development: Azure Percept DK advanced topics (github.com) on GitHub. On that page you will see "Model URLs", these are models that are compatible with Azure Percept. In this case, take a look at the "Open Pose" model.

These two articles should be enough to get you started. Let us know how it goes!

Thank you Mike. Look forward to hearing what you find out!
Thank you! I will take a look at these. May be bit over my head but I'm wanting to learn in this experiment too.

 Mike McCoy, my company, Centric Consulting is a MSFT Partner. I'm looking for someone on the Percept team that would be willing to help me on this project. We will be using it to help sell Edge AI projects to our clients, in addition to being a cool experiment for my daughter's golf. My email is donnie.kerr at centricconsulting.com , if you or someone can contact me. Thanks!

@donnie_kerr, how about starting simple then. Think Big, Start Small (and put your daughter to work :) ). Before we get into Body Pose detection, how far a
long are the both of you on your journey with the Percept DK.
1. Have you connected it to an IoT Hub?
2. Have you viewed the web stream from the DK Camera?
3. Have you viewed the device in Azure Percept Studio?
If you haven't done those, I suggest you (or your daughter) start there.

If you have completed those, it's time to create your own custom vision model using Azure Percept Studio and Azure Computer Vision. Tell us where you are along the journey, and I can help out a bit.