The following flowchart can be used as a guide to select the right estimator.
one
multiple
more samples
more features
known
unknown
How many feature space ?
Data size ?
Hyperparameters ?
KernelRidge
KernelRidgeCV
Ridge
RidgeCV
WeightedKernelRidge
MultipleKernelRidgeCV
BandedRidgeCV