Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

collection based backend selection: go beyond load_collection #162

Open
soxofaan opened this issue Oct 10, 2024 · 0 comments
Open

collection based backend selection: go beyond load_collection #162

soxofaan opened this issue Oct 10, 2024 · 0 comments
Labels
enhancement New feature or request federation design

Comments

@soxofaan
Copy link
Member

Issue brought up by @JanssenBrm .

He is trying to run a UDP on CDSE Federation. The UDP hardcodes a collection TERRASCOPE_S2_FAPAR_V2 (available on "terrascope" backend), but the aggregator does not inspect the UDP to discover that, so it naively dispatches the processing to the classic CDSE backend. This causes of course

OpenEoApiError: [404] CollectionNotFound: Collection 'TERRASCOPE_S2_FAPAR_V2' does not exist. (Upstream ref: 'r-2410102e12434ac3b03783069a2ce770') (ref: r-241010de909b4dbbbe700e87538c5464)

Workaround is the (currently experimental/non-standardized) job option

{
    "_agg_force_backend": "terrascope"
}

to force the selection of "terrascope"

However, if the collection id was not hardcoded inside the UDP, but a parameter, then the aggregator would be able to detect that collection id. Probably best to stick this feature to a well defined parameter name collection_id

@soxofaan soxofaan added enhancement New feature or request federation design labels Oct 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request federation design
Projects
None yet
Development

No branches or pull requests

1 participant