Heya, there is nothing fundamentally wrong with stone buildings or brick buildings, sometimes they can be the best option! What I believe is that people aren’t aware that you can have buildings made from straw etc. and those that do know about building with natural building materials don’t give them the time of day. The first thing I try and think about is the location of the building.
Say, for example, you wanted to build your house next to a wheat field. If you didn’t know that you could build a sturdy house out of straw then you would bring in bricks from far away to build your house, when it could be more environmentally friendly to make use of the straw in the field next to where you want to build your house.
However if you were building your house in the city, using reclaimed bricks from nearby might be more environmentally friendly that bringing in straw from further away to build your house.