Had then the different States which united together each a government of its own?

Yes; but they agreed to put themselves all under one general or federal government.