Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable async of data load/async data delivery #397

Open
Lena-Ev opened this issue Aug 22, 2023 · 5 comments
Open

Enable async of data load/async data delivery #397

Lena-Ev opened this issue Aug 22, 2023 · 5 comments

Comments

@Lena-Ev
Copy link
Collaborator

Lena-Ev commented Aug 22, 2023

No description provided.

@Lena-Ev Lena-Ev changed the title Enable async of data load Enable async of data load/async data delivery Aug 22, 2023
@Frisle
Copy link
Contributor

Frisle commented Sep 12, 2023

Asynchronous data transfer can be achieved by switching to DeepSeeRest, but this completely changes the mdx json structure

@Lena-Ev
Copy link
Collaborator Author

Lena-Ev commented Sep 12, 2023

for now workaround like Anton proposed

@Frisle
Copy link
Contributor

Frisle commented Sep 18, 2023

I have developed temporal solution by calling WriteJSONfromMDX after deepsee MDX execution and prepare methods

@Frisle
Copy link
Contributor

Frisle commented Sep 21, 2023

@evshvarov, I did some development and research and this is what I found

The problem with long data calculation is related to the %KPI function in the FTServers cube. The data needs to be calculated every time it is called, hence the "Computing %" and the need to call ResultSet over and over again. Sometimes you need to call it three times in a row to get data.

We can get around this by using ##class(%DeepSee.REST.v1.DataServer) logic to check the state of the data computation and then display the results, but we will have to call the result set twice. We call it first with ##class(%DeepSee.REST.v1.DataServer) logic (waiting for %KPI calculation) and second time with our MDX2JSON logic to create widgets with the current json structure since the new structure (DeepSeeRest) is not implemented .

Using the above method is obviously a hack and it is very expensive for the system to handle. Decent widgets require significant time to calculate the result twice (3.68 seconds)

The most sensible solution here is to convert everything to a new structure

@Lena-Ev
Copy link
Collaborator Author

Lena-Ev commented Sep 26, 2023

paused till the ISC introduce their solution

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants