Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Internal enhancements and improvements: optimize code and enable parallel processing capabilities #817

Open
amyburness opened this issue Jul 4, 2024 · 2 comments · May be fixed by #841
Assignees
Labels
size 60 It will take between 2 to 3 weeks

Comments

@amyburness
Copy link
Collaborator

Optimize code and enable parallel processing capabilities in Trends.Earth. This will decrease processing
times significantly. Ensure that code uses “QGSTasks” where appropriate so that tasks can more easily be parallelized, that users can view percentage completion, cancel tasks, etc. Also use the “numba” library as appropriate to ensure any processing code that
could benefit from just-in-time compilation does so.

@amyburness
Copy link
Collaborator Author

amyburness commented Jul 4, 2024

Deliverables for Internal enhancements and improvements :

  • Optimized processing algorithm for speed

@Samweli Samweli added size: 40 Ouch this is going to take a week. size 60 It will take between 2 to 3 weeks and removed size: 40 Ouch this is going to take a week. labels Jul 19, 2024
@amyburness
Copy link
Collaborator Author

Notes from UR meetings:

  • parallel processing using QGIS tasks -> requires a processing overhaul
  • user can see the list of jobs but they also need to see the percentage of completion of each job and status category like (processing, success or failure)
  • logs may be useful if there is a failure (particularly in the cloud)

@Samweli Samweli linked a pull request Sep 12, 2024 that will close this issue
@amyburness amyburness added this to the Kartoza Support 2024 milestone Sep 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
size 60 It will take between 2 to 3 weeks
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants