I took a look at screenshot and learned I can press TAB to go inside the house I am building, after that I would say it was a very good puzzle design that guided me through the game.
Yeah there's no way to know how to exit the house without text sadly. I somehow missed adding it to the page's controls section. Thanks for pointing it out.