Poster
Algorithms and Theory for Multiple-Source Adaptation
Judy Hoffman · Mehryar Mohri · Ningshan Zhang

Wed Dec 5th 10:45 AM -- 12:45 PM @ Room 517 AB #154

We present a number of novel contributions to the multiple-source adaptation problem. We derive new normalized solutions with strong theoretical guarantees for the cross-entropy loss and other similar losses. We also provide new guarantees that hold in the case where the conditional probabilities for the source domains are distinct. Moreover, we give new algorithms for determining the distribution-weighted combination solution for the cross-entropy loss and other losses. We report the results of a series of experiments with real-world datasets. We find that our algorithm outperforms competing approaches by producing a single robust model that performs well on any target mixture distribution. Altogether, our theory, algorithms, and empirical results provide a full solution for the multiple-source adaptation problem with very practical benefits.

Author Information

Judy Hoffman (FAIR and Georgia Tech)
Mehryar Mohri (Courant Inst. of Math. Sciences & Google Research)
Ningshan Zhang (NYU)

More from the Same Authors