We're currently working on updating the UI, which is why the floating menu on localhost cannot be deactivated at the moment. In the meantime, you can manage your settings by visiting:

chrome-extension://lkeokcighogdliiajgbbdjibidaaeang/manage.html