Skip to content

Commit

Permalink
Remove training bits
Browse files Browse the repository at this point in the history
  • Loading branch information
aliok committed Oct 5, 2023
1 parent 88c338d commit f31e0d2
Show file tree
Hide file tree
Showing 3,674 changed files with 0 additions and 836,905 deletions.
The diff you're trying to view is too large. We only load the first 3000 changed files.
37 changes: 0 additions & 37 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,40 +1,3 @@

Order of things:

1. [training](training)
- Train the model
- Export it
2. [inference_test](inference_test)
- Sanity check the exported model
- Plot the detections onto test images
3. [tensorflow_serving_test](tensorflow_serving_test)
- Use the exported model in a TensorFlow Serving container
- Send inference requests to the container
- Prepare input
- Process output
4. [kserve_test](kserve_test)
- Use the exported model in KServe
- Send inference requests to the KServe InferenceService
- Prepare input
- Process output
5. [prediction_backend](prediction_backend)
- Use the exported model in a Flask app
- Send inference requests to the Flask app from a HTML page


TODO:
- Inference with KServe takes too long and needs too much CPU
- Inference using a 100x83 image takes 1.5s with 5 CPU and 12Gi memory
- Inference using a 960x540 image takes ~4.5s with 5 CPU and 12Gi memory
- Inference using a 6000x8000 image (image to be posted by a phone) takes ~100s with 5 CPU and 12Gi memory
- When CPU is set to 1, durations are ~2.5x longer
- When TensorFlow Serving is used in a Docker container, durations are much shorter (no memory/CPU limit)
- Use secrets for credentials in general

TODO:
- Use Gunicorn for production (containers) (https://blog.miguelgrinberg.com/post/the-flask-mega-tutorial-part-xix-deployment-on-docker-containers)
-

## Building and pushing images

Just use the existing GitHub Actions workflows, by passing some environment variables.
Expand Down
29 changes: 0 additions & 29 deletions inference_test/plot/README.md

This file was deleted.

Empty file.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file removed inference_test/plot/output/test_small.jpeg.png
Binary file not shown.
Binary file removed inference_test/plot/output/test_smaller.jpeg.png
Binary file not shown.
163 changes: 0 additions & 163 deletions inference_test/plot/plot.py

This file was deleted.

110 changes: 0 additions & 110 deletions kserve_test/README.md

This file was deleted.

1 change: 0 additions & 1 deletion ovm_test/.gitignore

This file was deleted.

Loading

0 comments on commit f31e0d2

Please sign in to comment.