← Back to list

Manual Derivation Series: Cosine Similarity in Clustering and SVD Exercise

For clustering analysis can man also use cosine similarity except distance.

Chwmwei · 2026-03-07 12:35 · 0 claps · 1.2 min read
#machine-learning #derivation #cosine-similarity #svd #outer-product
Open on Medium ↗
Wiki topics: ML · Machine Learning EDU · Education & Learning 💪 · Fitness & Wellness

Manual Derivation Series: Cosine Similarity in Clustering and SVD Exercise

  1. For clustering analysis can man also use cosine similarity except distance.

Cosine and Distance Exercise

Cosine and Distance Exercise

2.Singular Value Decomposition (SVD) represents decomposing any complex linear transformation into three sequential steps: Rotation, Scaling, and Rotation.

Exercise1

Exercise1

Exercise2

Exercise2

  1. outer product

The first few outer products contain the most significant information (the “signal”), while later terms represent fine details or noise.

Think of the original matrix as a complex image. The outer product sum is like building that image layer by layer:

  • The first outer product captures the strongest global pattern (the “skeleton”).
  • Subsequent outer products add textures and specific features.
  • The final products usually add negligible noise.

In Clustering or NLP, this allows us to reconstruct a “cleaned” version of the data by only summing the most dominant outer products.

Outer an Inner Product

Outer an Inner Product


메타데이터
post_id
331ede71591e
slug
manual-derivation-series-cosine-similarity-in-clustering-and-svd-exercise-331ede71591e
url
https://medium.com/@chwmwei/manual-derivation-series-cosine-similarity-in-clustering-and-svd-exercise-331ede71591e
canonical_url
https://medium.com/@chwmwei/manual-derivation-series-cosine-similarity-in-clustering-and-svd-exercise-331ede71591e
author_url
https://medium.com/@chwmwei
status
ok
fetched_at
2026-06-13 16:00:06