You can use this assignment in your class!
Mastery Progress(100.0%)
i
img  CLOSE REVIEW

Tokenization Review Assignment

Tokenize the following sentence:

Everything you've ever wanted is right here.

You answeredJUST NOW

(Student response here)

Did you like this question?

(Voting helps us personalize your learning experience!)
imgInstructor solution
Alec KretchFEB 3, 2021, 11:50:32 PM

[Everything, you, 've, ever, wanted, is, right, here, .]

Was this helpful?

(Voting helps us personalize your learning experience!)
imgIntro to tokenization clip (0:05 - 1:28)

Was this helpful?

(Voting helps us personalize your learning experience!)
Think you've got it?

Select the best tokenized representation of the following sentence:

You won't get me a smoothie?

Select one of the following options:
  • A.

    [You, won, 't, get, me, a, smoothie, ?]

  • B.

    [You, wo, n't, get, me, a, smoothie, ?]

  • C.

    [You, wo, n't, get, me, a, smoothie]

  • D.

    [You, won, ', t, get, me, a, smoothie, ?]

  • E.

    [You, won't, get, me, a, smoothie?]

Submit answer

Was this helpful?

(Voting helps us personalize your learning experience!)
Continue review

You may exit out of this review and return later without penalty.