Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Supports single UDAF fallback #577

Open
richox opened this issue Sep 18, 2024 · 0 comments
Open

Supports single UDAF fallback #577

richox opened this issue Sep 18, 2024 · 0 comments
Labels
feature required Functionalities must have

Comments

@richox
Copy link
Collaborator

richox commented Sep 18, 2024

Is your feature request related to a problem? Please describe.
currently we have completed supports to UDF/UDAF fallbacks. but UDAF is not yet supported. a HashAggregate with UDAF will fallback to spark.
in most cases, the bottlesnack of an aggregation is grouping. if we can only fallback the accumulating with UDAF, we may achieve more performance profits than fallback the whole operator.

Describe the solution you'd like
implement UDAF fallback. we have to consider how to reduce the number of JNI calls (one call per record is absolutely slow).

Describe alternatives you've considered

Additional context

@richox richox added the feature required Functionalities must have label Sep 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature required Functionalities must have
Projects
None yet
Development

No branches or pull requests

1 participant