Poster
Linear Label Ranking with Bounded Noise
Dimitris Fotakis · Alkis Kalavasis · Vasilis Kontonis · Christos Tzamos
Hall J (level 1) #820
Keywords: [ Label Ranking ] [ Gaussian ] [ Linear Sorting Function ] [ Noise ]
Abstract:
Label Ranking (LR) is the supervised task of learning a sorting function that maps feature vectors x∈Rd to rankings σ(x)∈Sk over a finite set of k labels. We focus on the fundamental case of learning linear sorting functions (LSFs) under Gaussian marginals: x is sampled from the d-dimensional standard normal and the ground truth ranking σ⋆(x) is the ordering induced by sorting the coordinates of the vector W⋆x, where W⋆∈Rk×d is unknown. We consider learning LSFs in the presence of bounded noise: assuming that a noiseless example is of the form (x,σ⋆(x)), we observe (x,π), where for any pair of elements i≠j, the probability that the order of i,j is different in π than in σ⋆(x) is at most η<1/2. We design efficient non-proper and proper learning algorithms that learn hypotheses within normalized Kendall's Tau distance ϵ from the ground truth with N=˜O(dlog(k)/ϵ) labeled examples and runtime poly(N,k). For the more challenging top-r disagreement loss, we give an efficient proper learning algorithm that achieves ϵ top-r disagreement with the ground truth with N=˜O(dkr/ϵ) samples and poly(N) runtime.
Chat is not available.