Oh man, this is so real. I totally get keeping those personal, messy sketches close. They're like a diary. But I see what @michaelwright is saying too, about art that shows a shared view. My fix? I do both. I'll paint the bright, sunny market scene to remember the colors, but I also have a tiny, smudged sketch of my wet boots from that same day. The pretty one goes on the wall, the boot one stays in my notebook. They're both true.
You said your sketches from a rainy trip mean more, and I get that. But for me, the bright, colorful art does a better job of capturing the feeling of a place for everyone to see. Sometimes the shared view is what makes travel art special.