Word uses a Table as the basis for a Label document. If that is the way you are making the template, if you have the selection in one of the labels, the Table Design and Layout tabs will appear on the ribbon and on the Layout tab, there is a button for "View Gridlines" that can be used to toggle the gridlines on or off.
