This is not a question about reverse engineering, but you can use the DARPA Cyber Grand Challenge binaries that have been ported to Linux, Mac OS and Windows by the Trail of Bits team:
The DARPA Challenge Binaries (CBs) are custom-made programs specifically designed to contain vulnerabilities that represent a wide variety of crashing software flaws. They are more than simple test cases, they approximate real software with enough complexity to stress both manual and automated vulnerability discovery. The CBs come with extensive functionality tests, triggers for introduced bugs, patches, and performance monitoring tools, enabling benchmarking of patching tools and bug mitigation strategies.
For more information, see their blog post Your tool works better than mine? Prove it.
If this particular suite of binaries is not to your liking, I recommend reading the paper The Art, Science, and Engineering of Fuzzing: A Survey, which includes 240 references. If the paper does not discuss fuzzer benchmark suites, some of the cited papers surely will.
An additional option is to examine fuzzer-related repositories on github such as Google's fuzzer test suite.
If no existing test suites meet your specific, particular requirements, then either a) change your requirements or b) create your own test suite.