Running multiple models seems smart until you look at the logs. Leveraging...

https://www.oscarbookmarks.win/running-multiple-llms-sounds-smart-until-you-see-the-bill-we-use-them-to

Running multiple models seems smart until you look at the logs. Leveraging different strengths and catching model-specific failure modes is useful for reliability. Just watch out for synthesis