Skip to content

tiktoken library issue #762

@dhruv20047228

Description

@dhruv20047228

Bug description

Image in attached file tiktoken = tiktoken.get_encoding("gpt-2") is written, currently while trying to run that particular cell, error of allowed_special variable not defined is arising, it's working and running properly when get_encoding("cl100k_base") is used instead of above written in picture.

What operating system are you using?

Linux

Where do you run your code?

Google Colab

Environment




Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions