I’ve been working on my own harness / “orchestration layer”, not with the goal of reaching frontier level performance, but rather boosting performance of smaller (locally hostable) models. Unfortunately, I don’t have VC money to burn on running hundreds of evals, but some preliminary results do indicate that it could work[0].
https://deepclause.substack.com/p/how-to-make-small-models-p...