Moss spreads over Crystals and Specials if you don't clear it. You can clear Moss by making matches next to it or by hitting it with Specials.