When you're sick, he gets so anxious he can't handle it. It reminds him of Steve being sick when they were younger - of him nearly dying over and over. You could just sniffle and Bucky is ushering you to bed with a hot water bottle and Tylenol