It's important to understand why the 14th Amendment included a provision for citizenship. The 13th, 14th and 15th Amendments were drafted and passed in the immediate aftermath of the Civil War. The 13th Amendment ended slavery, the 14th Amendment ensured due process and equal protection for former slaves, and the 15th Amendment guaranteed former slaves the right to vote.
The citizenship clause of the 14th Amendment helped overturn the pre-war Dred Scott decision by the Supreme Court holding that slaves were not citizens. Additionally, the citizenship clause of the 14th Amendment helped end any argument that citizenship in the United States was solely founded upon citizenship to a state first.
This had justified the legality of serving in the Confederacy by following one's state citizenship against the United States.
Following the “subject to the jurisdiction thereof” caveat, the citizenship clause did not include all born on the territory of the United States from the beginning. A good example can be seen with citizenship of American Indians.
At the time of the 14th Amendment, and for decades thereafter, native Americans were not granted citizenship despite being born within the geographic boundaries of the United States. Parents were indirectly under the jurisdiction of the United States through treaties with the various tribes, but babies were not considered "subject to the jurisdiction thereof."
Congress, using the provisions of Section 5 of the 14th Amendment (The Congress shall have the power to enforce, by appropriate legislation, the provisions of this article), and the Article 1, Section 8 (congressional power over naturalization/immigration) finally granted citizenship to native Americans born in the US on June 2, 1924.