Unit 4.2: Count-based vectors

What is meant if the cosine of two words is 1?

What's the cosine similarity between [-3, 3, 4] and [2, -5, -1]?

Cosine similarity

Give the formula for cosine similarity. Describe what it measures.

What's the cosine similarity between [-68, -92, 21, -19, 54] and [28, 32, 51, -78, -10]?

What's the cosine similarity between [86, -36, -34, -51] and [51, 67, 27, 52]?

What's the cosine similarity between [-53, 81, 96, 3] and [3, 49, 93, -1]?

What's the cosine similarity between [-76.81, 5.51] and [44.62, 36.53]?

When does $cos (a, a) = a \cdot b$ ?

10.

What's the difference between PMI and PPMI, and why is PPMI preferred for NLP problems?

11.

Explain the intuition behind TF-IDF.

12.

Calculate TF-IDF for the documents in Figure A.

13.

Complete the code to calculate the Euclidean distance. Do not use NumPy.

14.

Complete the code to calculate cosine similarity. Do not use NumPy.

15.

Euclidean distance

Implement Euclidean distance using numpy:

$d_{2} (a, b) = \sqrt{\sum_{i = 0}^{| a |} (a_{i} - b_{i})^{2}}$

where $d_{2}$ represents the Euclidean distance of vectors $a$ and $b$ .

16.

Dot product

Implement the function dot_product using numpy. Your function should take two np.ndarrays representing $x$ and $y$ and return a single number.

17.

What is $[3, 9, 1] \cdot [0, 3, - 4]$ ?

18.

Dot product

Implement the function dot_product using numpy. Your function should take two np.ndarrays representing $x$ and $y$ and return a single number.

19.

Given $a = [7, 2]$ , what vector has the same direction, but 3 times the magnitude of $a$ ?

20.

Find the centroid

Implement the function find_centroid using numpy. Your function should take one np.ndarray representing a multirow matrix X and return a vector representing the centroid.

21.

Create a term-term matrix for the sentences in Figure A.

22.

Create a term-term matrix for the sentences in Figure A.

23.

Complete the code to calculate the 2-norm (aka Euclidean norm) of a vector. Do not use NumPy.

24.

Complete the code to normalize a vector to unit length using the 2-norm (aka Euclidean norm). Do not use NumPy for this.

25.

What does a vector's 2-norm represent?

26.

What does a vector's 2-norm represent?

27.

If $\sum_{i = 0}^{| x |} x_{i}^{2} = 1$ , what can you say about $x$ ?

28.

If $\sum_{i = 0}^{| x |} x_{i}^{2} = 1$ , what can you say about $x$ ?

29.

Complete the code to calculate the frequency of words that co-occur within a symmetric window ( $k = 1$ ) for the given word.

30.

When $k = 2$ , what will be target word and context words in the $k$ -window for the sentence "The Spanish galleon disappeared into the night"?

31.

Provide symmetric $k$ -windows of size $k = 1$ , $k = 2$ , $k = 3$ , and $k = 4$ for Shakespeare in the following sentence:

the greatest Shakespeare play is Macbeth

What's the cosine similarity between [86, -36, -34, -51] and [51, 67, 27, 52]?

You answeredJUST NOW

(Student response here)

Did you like this question?

(Voting helps us personalize your learning experience!)

Instructor solution

Alec KretchAPR 18, 2021, 3:53:30 PM

$\frac{(86 \times 51) + (- 36 \times 67) + (- 34 \times 27) + (- 51 \times 52)}{\sqrt{86^{2} + - 36^{2} + - 34^{2} + - 51^{2}} \times \sqrt{51^{2} + 67^{2} + 27^{2} + 52^{2}}}$ $==$ $\frac{(4386) + (- 2412) + (- 918) + (- 2652)}{\sqrt{7396 + 1296 + 1156 + 2601} \times \sqrt{2601 + 4489 + 729 + 2704}}$ $==$ $\frac{- 1596}{\sqrt{12449} \times \sqrt{10523}}$ $\approx$ $- 0.139$