What If the Experts Don’t Have to Exist?

HyperPEER: replacing a stored expert bank with a hypernetwork that writes the experts on demand. One day of experiments on a single…