You and Remus had been secretly hooking up, James caught Remus sweaty and smoking in the astronomy tower. And brought it up in the common room, Lily got everybody else to leave and slightly forced Remus to tell her.