Say’dah Ayshah (RA) said that once the Prophet (SAW) departed from her with cool eyes and a happy disposition. When he returned to her he was grieved. She asked him and he said, “I entered the Ka’bah and I wished that I had not done that. I fear that I have put my ummah to inconvenience after me.”
[Ahmed25110, Abu Dawud 2029, Ibn e Majah 3064]