Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert "Testdata creation" #304

Merged
merged 12 commits into from
Mar 25, 2024
Merged

Revert "Testdata creation" #304

merged 12 commits into from
Mar 25, 2024

Conversation

kyle-messier
Copy link
Collaborator

Reverts #290

@kyle-messier
Copy link
Collaborator Author

@eva0marques The merging of the test dataset creation has caused errors in test-coverage and R-CMD-check. Can you check the 3 failed tests? I tried reverting, but not working. @sigmafelix also if want to resolve. Thanks!

@sigmafelix
Copy link
Collaborator

@kyle-messier @eva0marques I will investigate the issue.

@eva0marques
Copy link
Collaborator

I do not remember why this pull request was not closed but it sounds that some tests about cross validation are no longer valid. I guess it is because @insang you improved the code in that script and merge to main branch? Maybe we can just remove this cross validation file from my pull request? Sorry about that.

@sigmafelix
Copy link
Collaborator

@eva0marques I checked out this branch and all tests in the problem passed in my end. I cleared GitHub Action cache and am rerunning the tests now.

@eva0marques
Copy link
Collaborator

Nice, thanks.

@eva0marques
Copy link
Collaborator

@sigmafelix I have no clue now, I copy the same cross validation functions and tests as main branch and still have troubles to pass the checks 🤔

@eva0marques
Copy link
Collaborator

@sigmafelix I'm updating test-temporal-range, that might be the problem...

@sigmafelix
Copy link
Collaborator

@eva0marques I couldn't figure out what the problem exactly is. I changed the global set.seed part into withr::local_seed in this trial. Let's see what happens.

@eva0marques
Copy link
Collaborator

I hope that merging this branch into main won't remove work done on main branch since then.

@eva0marques
Copy link
Collaborator

I just realized that this pull request erased my script create_testdata.R for test data creation.

@kyle-messier
Copy link
Collaborator Author

@eva0marques @sigmafelix R CMD and test-coverage are both failing beacuse of 3 failed tests:

══ Failed tests ════════════════════════════════════════════════════════════════
── Failure ('test-cross_validation.R:61:3'): leave-ones run without errors ─────
max(index_loto) not equal to tlength.
1/1 mismatches
[1] NA - 10 == NA
── Failure ('test-temporal_range.R:17:3'): covariates are within temporal range. ──
all(iswithin) not equal to TRUE.
1 element mismatch
── Failure ('test-temporal_range.R:27:3'): test_nc_output.nc is within temporal range. ──
all(iswithin) not equal to TRUE.
1 element mismatch

@eva0marques
Copy link
Collaborator

@kyle-messier we see that but we don't understand why.

Insang Song added 3 commits March 25, 2024 14:07
- For test
- Rebuilt NAMESPACE
- Removed vignettes for stcv
- to drop stcv index generation functions
@sigmafelix
Copy link
Collaborator

@kyle-messier @eva0marques Couldn't reproduce errors in my end. As a drastic measure, I removed generate_cv_index and its upstream dependencies, temporal range check, and base learners from the codebase. The cv index functions and base learners are not critical at this moment (possibly not in the future, I believe) as we distributed base learner development tasks to teams. I think temporal range check is controlled in the pipeline level, so we will be fine without it.

Copy link
Collaborator

@eva0marques eva0marques left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I trust you @sigmafelix lol

@eva0marques eva0marques merged commit a7a317d into main Mar 25, 2024
4 checks passed
@sigmafelix sigmafelix deleted the revert-290-testdata_creation branch June 17, 2024 18:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants