Nowadays, it's a requirement to carefully remove all asbestos from a building before demolishing it, so you were likely okay in that regard. If it was a concrete building being demolished, you would be way more likely to be exposed to crystalline silica (from concrete dust) which is an irritant to the lungs and in large enough amounts can lead to silicosis.