Skip to content

Commit a814cc5

Browse files
authored
Make consistent module resource locations (#246)
* Rename FallbackConfigs directory to Resources * Move bert-vocab.txt to Resources directory * Add comment about fallback configuration file locations
1 parent 454afa0 commit a814cc5

File tree

5 files changed

+2
-1
lines changed

5 files changed

+2
-1
lines changed

Package.swift

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -30,7 +30,7 @@ let package = Package(
3030
),
3131
.executableTarget(name: "HubCLI", dependencies: ["Hub", .product(name: "ArgumentParser", package: "swift-argument-parser")]),
3232
.target(name: "Generation", dependencies: ["Tokenizers"]),
33-
.target(name: "Hub", resources: [.process("FallbackConfigs")], swiftSettings: swiftSettings),
33+
.target(name: "Hub", resources: [.process("Resources")], swiftSettings: swiftSettings),
3434
.target(name: "Models", dependencies: ["Tokenizers", "Generation"]),
3535
.target(name: "Tokenizers", dependencies: ["Hub", .product(name: "Jinja", package: "Jinja")]),
3636
.testTarget(name: "GenerationTests", dependencies: ["Generation"]),

Sources/Hub/Hub.swift

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -240,6 +240,7 @@ public final class LanguageModelConfigurationFromHub: Sendable {
240240
}
241241

242242
static func fallbackTokenizerConfig(for modelType: String) -> Config? {
243+
// Fallback tokenizer configuration files are located in the `Sources/Hub/Resources` directory
243244
guard let url = Bundle.module.url(forResource: "\(modelType)_tokenizer_config", withExtension: "json") else {
244245
return nil
245246
}
File renamed without changes.
File renamed without changes.
File renamed without changes.

0 commit comments

Comments
 (0)