How to use an entire column of data for parameters

I have a query that pulls in a pretty large list of results. I want to enter data in a different tab that is then used to filter the results. There may be 100+/- different data points that I want to use in the query to filter by. When I try to enter the entire column to use as the data to filter the results by, I'm prompted that only one cell can be selected. How can I enter an entire column to use as the data to be filtered by. For example if the table was employees by city, I could enter 100 different cities in column A for example, and it would just return the results from the cities that I entered in column A?