You can use this assignment in your class!
Mastery Progress(100.0%)
i
img  CLOSE REVIEW

Tokenization Review Assignment

Tokenize the following sentence:

I think I'm in big trouble.

You answeredJUST NOW

(Student response here)

Did you like this question?

(Voting helps us personalize your learning experience!)
imgInstructor solution
Alec KretchFEB 3, 2021, 11:50:50 PM

[I, think, I, 'm, in, big, trouble, .]

Was this helpful?

(Voting helps us personalize your learning experience!)
imgIntro to tokenization clip (0:05 - 1:28)

Was this helpful?

(Voting helps us personalize your learning experience!)
Think you've got it?

Select the best tokenized representation of the following sentence:

The current time is 8:03 a.m., I think.

Select one of the following options:
  • A.

    [The, current, time, is, 8:03, a.m., ,, I, think, .]

  • B.

    [The, current, time, is, 8:03, a.m., I, think]

  • C.

    [The, current, time, is, 8:03, a.m.,, I, think.]

Submit answer

Was this helpful?

(Voting helps us personalize your learning experience!)
Continue review

You may exit out of this review and return later without penalty.