I like to leave the dead material until it rots
I also have a small population of fungus knats in my home but they're harmless to the plants and since I water my plants mostly when the soil is dry that keeps them from becoming too numerous