Yes it is that simple
Finding emails in GMail that you have put a label by prefixing the label that you are searching for with the keyword “label” like: “label:<your label>”
So again, literally in the GMail Search Box Type in: “label:” and then what label you are searching for – see the screenshot below.