Kevin Costner “doesn’t want to get down in the gutter” with ‘Yellowstone’ rumors, insists show was his “priority”