3-D chess

The rules of this game of chess, played on a standard board, call for a theoretically infinite number of other boards reflecting all past and future positions from the present game. A single additional rule is in effect: Each player is allowed, as his turn, to swap a square in the game with that square as it was at a previous OR LATER point in time.

If taken from a previous point in time the game reverts to that point but with that square replaced with the new one, and that many moves ahead that square changes again to reflect the change. For example I move my queen's pawn forward for my first move, my queen forward one for my second move, and my queen back for my third move. On the fourth move it would be legal to put my queen in play from my third move on that square. At that point the game would revert to the game at move three when the queen was there, but without my queen. I would have my move and the next turn I would have two queens, just for that turn. The next turn my queen from the original position would disappear.

The same would happen if I choose to swap a square from later in the game: the game would revert upon that turn being reached, with the square swapped.

EDIT: If the later board position is occupied the time travel can't be done and the extra piece is forfeited.