There are so many factors that could lead to a bad day. I think you just had one.
Maintaining size is a combination of getting your cals right, and training with enough intensity to keep the muscle. Maintaining isn't too hard.
You stimulated the muscle while working out, and it sounded as thought you train with enough intensity, I really don't see why you would lose mass as long as you are eating and resting enough.