I had a nest of yellowjackets take up residence in my compost bin. At least they were outside not in the house. I called in the professionals.

For flies - maybe get a close-up photo and ask the kind folks on r/whatsthisbug - proper species identification can help you hone in on likely breeding sites.