“So long as it remains true that Paul represents the Church of the Living God to be one, founded on one covenant (which the law could not set aside) from Abraham to today, so long it remains true that the promise is to us and our children and that the members of the visible Church consist of believers and their children — all of whom have a right to all the ordinances of the visible Church, each in its appointed season. The argument in a nutshell is simply this: God established His Church in the days of Abraham and put children into it. They must remain there until He puts them out. He has nowhere put them out. They are still then members of His Church and as such entitled to its ordinances. Among these ordinances is baptism, which standing in similar place in the New Dispensation to circumcision in the Old, is like it to be given to children.”
BB Warfield