transformers-server

Small FastAPI server for HTTP transformers inference

API

POST /cookie

An application/json data

Field	Description
`text` (str)	Text for inference

{
  "text": "I like butter cookies!"
}

An application/json data

Field	Description
`id` (int)	`0` (`NO`) or `1` (`YES`)
`label` (str)	`NO` or `YES`

{
  "id": 1,
  "label": "YES"
}

Variable	Description
`COOKIE_MODEL_PATH`	Path to a `distilbert-base-cased` model