2.1 Performance benchmarks

[westonpace]

We need to add performance benchmarks for all of the permutations listed in #3347

We should be able to achieve 100k rows / second and (ideally 3, at minimum 1)GBps running on NVMe (the bencher benchmarks will be testing against S3 however, so the local tests will not be automated for now)