Matt Stewart (Bob Saget) is a widower trying to raise his two daughters, Sarah (Kat Dennings) and Emily (Brie Larson), with the help of his live-in father, Sam (Jerry Adler), who was a former baseball player for the Boston Red Sox. To further complicate matters, Matt works as an English teacher at Sarah's high school. Matt struggles to keep his nose out of his daughter's social life while attempting to find a social life of his own.