Home computickets L1 and L2 Regularization, L1 and L2 Norm

L1 and L2 Regularization, L1 and L2 Norm

Author

Date

Category

What is common in these concepts and what do they differ?

Do I understand correctly that with L1 regularization, part of the signs are completely discarded, and with L2 regularization, signs are smoothed so that due to one sign did not “fit” the others? And L1 and L2 norm, are it just different options in order to calculate the distance?


Answer 1, Authority 100%

norm – functionality defined in vector space and generalizing the concept of the length of the vector or the absolute value of the number.

General formula for L p norm :

L 1 norm / Distance of city blocks :

l 2 norm / Euclidean metric :


For regularization to the error formula, the corresponding norm is added – with L 1 regularization Add L 1 norm and L 2 Norm in the case of L 2 regularization :

Programmers, Start Your Engines!

Why spend time searching for the correct question and then entering your answer when you can find it in a second? That's what CompuTicket is all about! Here you'll find thousands of questions and answers from hundreds of computer languages.

Recent questions