Is It Like the Turtles?

You know how some people say no one has free will, that everything we do is just the product of our upbringing and societal influences. And that the people who brought us up aren't responsible for their behavior either, because they also are the products of their upbringing. And the people who brought them up are just the products of their upbringing, and so on. Well, does it just keep on going and going, all the way back to the first recognizable human? Is there any point at which someone was responsible for his behavior, or is it just upbringing all the way down?