Family Eumenidae
There is a common species of wasp which I see which looks a lot like this one but it is larger and only the tip of its abdomen is yellow so can be easily confused with this one.
I was lucky enough to find where it was building its nest and could take pictures of that too. The female normally builds it in existing cavities such as keyholes, ends of pipes and bamboo, holes in trees etc.
The cells in the nest are separated by mud.