Skip to content

Commit e395c5d

Browse files
authored
Update PACKAGE.md
1 parent 70e191b commit e395c5d

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

src/Microsoft.ML.Tokenizers/PACKAGE.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ Microsoft.ML.Tokenizers supports various the implmentation of the tokenization u
1515
using Microsoft.ML.Tokenizers;
1616

1717
// initialize the tokenizer for `gpt-4` model, downloading data files
18-
Tokenizer tokenizer = await Tiktoken.CreateByModelNameAsync("gpt-4");
18+
Tokenizer tokenizer = await Tokenizer.CreateTiktokenForModelAsync("gpt-4");
1919

2020
string source = "Text tokenization is the process of splitting a string into a list of tokens.";
2121

@@ -58,4 +58,4 @@ The main types provided by this library are:
5858

5959
## Feedback & Contributing
6060

61-
Microsoft.ML.Tokenizers is released as open source under the [MIT license](https://licenses.nuget.org/MIT). Bug reports and contributions are welcome at [the GitHub repository](https://github.com/dotnet/machinelearning).
61+
Microsoft.ML.Tokenizers is released as open source under the [MIT license](https://licenses.nuget.org/MIT). Bug reports and contributions are welcome at [the GitHub repository](https://github.com/dotnet/machinelearning).

0 commit comments

Comments
 (0)