Monitoring of pushes data

%3CLINGO-SUB%20id%3D%22lingo-sub-212282%22%20slang%3D%22en-US%22%3EMonitoring%20of%20pushes%20data%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-212282%22%20slang%3D%22en-US%22%3E%3CP%3EA%20Data%20Factory%20pipeline%20pushes%20data%20to%20a%20different%20location%20than%20usual%20(e.g.%20different%20folder%20in%20DataLake)%3C%2FP%3E%3CP%3EHow%20to%20detect%20this%20situation%3F%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-212282%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EQuery%20Language%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-213997%22%20slang%3D%22en-US%22%3ERe%3A%20Monitoring%20of%20pushes%20data%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-213997%22%20slang%3D%22en-US%22%3EHello%2C%20Noa%3CBR%20%2F%3EYes%2C%20DataLake%20conected%20to%20LogAnalytic.%3CBR%20%2F%3EFor%20example%3A%3CBR%20%2F%3EWe%20have%20datafactory%20%22df1%2C%20df2%22%20%2C%20pipeline%20%22p1.1%2C%20p1.2%2C%20p2.1%2C%20p2.2%22%2C%20wrong%20pipeline%20wp3%2C%20datalake%20(dl1%2Cdl2)%20and%20wrond%20datafactory%20wdf3.%3CBR%20%2F%3EUsually%20from%20df1--(pushes%20data%20by)--p1.1%2Cp1.2--(to)--%26gt%3Bdl1%20and%20df2--(pushes%20data%20by)--%26gt%3Bp2.1%2Cp2.2--(to)--%26gt%3Bdl2.%3CBR%20%2F%3EBut%20our%20employee%20redirect%20data%20from%20df1-(by)-%26gt%3Bp2.2%2Cp1.2--(to)--%26gt%3Bdl2%20or%3CBR%20%2F%3Edf2-(by)-%26gt%3Bwp3%2Cp2.1--(to)--%26gt%3Bwdf3.%3CBR%20%2F%3EHow%20I%20can%20check%20this%20situations%3F%3CBR%20%2F%3E(I%20need%20to%20detect%20potential%20diversion%20of%20existing%20Data%20Factory%20pipeline.)%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-213141%22%20slang%3D%22en-US%22%3ERe%3A%20Monitoring%20of%20pushes%20data%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-213141%22%20slang%3D%22en-US%22%3E%3CP%3EHi%2C%3C%2FP%3E%0A%3CP%3ENot%20sure%20I%20understand%20your%20question.%20Is%20DataLake%20connected%20somehow%20to%20Log%20Analytics%3F%3C%2FP%3E%3C%2FLINGO-BODY%3E
Highlighted
New Contributor

A Data Factory pipeline pushes data to a different location than usual (e.g. different folder in DataLake)

How to detect this situation?

2 Replies
Highlighted

Hi,

Not sure I understand your question. Is DataLake connected somehow to Log Analytics?

Highlighted
Hello, Noa
Yes, DataLake conected to LogAnalytic.
For example:
We have datafactory "df1, df2" , pipeline "p1.1, p1.2, p2.1, p2.2", wrong pipeline wp3, datalake (dl1,dl2) and wrond datafactory wdf3.
Usually from df1--(pushes data by)--p1.1,p1.2--(to)-->dl1 and df2--(pushes data by)-->p2.1,p2.2--(to)-->dl2.
But our employee redirect data from df1-(by)->p2.2,p1.2--(to)-->dl2 or
df2-(by)->wp3,p2.1--(to)-->wdf3.
How I can check this situations?
(I need to detect potential diversion of existing Data Factory pipeline.)