When I remove all of the modules using the ui composer then the buttons go away, but the black box where they used to go remains. How do I completely remove the main bar?

You can use some custom CSS for that:

.fpd-mainbar{ display: none !important;}

custom CSS is added via the UI & Layout Composer, custom CSS tab