The fungus we are discussing here is a specific type, called dimorphic or thermally dimorphic. It basically means that it can change shape and function from mycelium in the environment to a pathogen when it enters a human host.

Generally speaking, any fungi classified as a yeast or dimorphic is bad for you. For instance, Candida Albicans or Saccharomyces (bread and brewers yeast) are bad for many reasons outlined in the pdf. Hope this helps.