In order to move or rotate buildings you need to tap the sign with arrows in the upper left corner of the game screen or tap and hold the desired building. You can not delete buildings in the game at this moment.
You can also change design of some buildings in the edit mode.