US President Donald Trump previously said that his ballroom addition would not "interfere with the current building".