You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: specification/inference/put_custom/PutCustomRequest.ts
+38Lines changed: 38 additions & 0 deletions
Original file line number
Diff line number
Diff line change
@@ -32,6 +32,44 @@ import { InferenceChunkingSettings } from '@inference/_types/Services'
32
32
*
33
33
* The custom service gives more control over how to interact with external inference services that aren't explicitly supported through dedicated integrations.
34
34
* The custom service gives you the ability to define the headers, url, query parameters, request body, and secrets.
35
+
* The custom service supports the template replacement functionality, which enables you to define a template that can be replaced with the contents of a value that defines that key.
36
+
* Templates are portions of a string that start with `${` and end with `}`.
37
+
* The parameters `secret_parameters` and `task_settings` are checked for keys for template replacement. Template replacement is supported in the `request`, `headers`, `url`, and `query_parameters`.
38
+
* If the definition (key) is not found for a template, an error message is returned.
39
+
* In case of an endpoint definition like the following:
40
+
* ```
41
+
* PUT _inference/text_embedding/test-text-embedding
0 commit comments