Are there Courts in every State of the United States?

Yes. Each State appoints Judges of its own to see that its state laws are enforced.