On the left is the default. You want to turn off Everyone. And change Networks so none of your networks will get automatic permission (unless you specifically want that, like old school pictures).
Then choose whether you want Friends of Friends, etc., or to customize, choose Some Friends.
Then start typing the names of your groups and choose the set(s) of people you will allow to see this album.