CLOSE REVIEWTokenize the following sentence:
You're good at English when you know the difference between a man eating chicken and a man-eating chicken.
You answeredJUST NOW
(Student response here)
Did you like this question?
(Voting helps us personalize your learning experience!)
Instructor solution
Alec KretchFEB 3, 2021, 11:49:27 PM
[You, 're, good, at, English, when, you, know, the, difference, between, a, man, eating, chicken, and, a, man-eating, chicken, .]
Was this helpful?
(Voting helps us personalize your learning experience!)
Intro to tokenization clip (0:05 - 1:28)
Was this helpful?
(Voting helps us personalize your learning experience!)
Think you've got it?
Select the best tokenized representation of the following sentence:
He's a big fraud.
Select one of the following options:
- A.
[
He's,a,big,fraud.] - B.
[
He,'s,a,big,fraud] - C.
[
He,',s,a,big,fraud,.] - D.
[
He,'s,a,big,fraud,.]
Was this helpful?
(Voting helps us personalize your learning experience!)
You may exit out of this review and return later without penalty.