If the Vice President, now serving as the President, shall be removed from office or resign, who shall carry out his duties of office?

The Speaker of the House shall become the President in this case. If he should die, leave or be removed from office, the Senate president pro tempore shall serve. From there, there is a line of succession to cabinet members including the Secretary of State, Secretary of the Treasury, Secretary of Defense and so on.