Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fetch list of org repos for homepage #37

Open
bennypowers opened this issue Nov 8, 2022 · 7 comments
Open

Fetch list of org repos for homepage #37

bennypowers opened this issue Nov 8, 2022 · 7 comments

Comments

@bennypowers
Copy link
Member

the list of repos on the homepage should automatically include everything under redhat-israel org, perhaps except for this repo itself. we can just fetch the list of repo names and add them to the list

@TomerFi
Copy link
Member

TomerFi commented Nov 8, 2022

suggestion: a list of relevant redhat organizations (like this one).

the repository list can be concatenated from all listed organizations,
filtering out private repos, archived repos, and perhaps a manual maintained list of exclusions.

this list can be merged with the current manual maintained list we have.

@bennypowers
Copy link
Member Author

i like the idea. how do we filter for redhat-israel contributors?

@TomerFi
Copy link
Member

TomerFi commented Nov 8, 2022

how about the members here?

when creating the data for the site,
we'll retrieve all the public non-archived repos from a manual maintained list of organizations.
filtering out repos from a manual maintained excluded repos list,
and grabbing only repos including contributions from our members list.

it might take some io from gh api, but I think it's doable.
maybe we should a pin on this until we tackle the token limitations issue we discussed earlier this week.

@TomerFi
Copy link
Member

TomerFi commented Nov 8, 2022

re-thinking this...
if someone drops from this organization,
unless we have another member contributing in the same repo,
it won't show up anymore from the next build.

@bennypowers
Copy link
Member Author

js Set has unique entries, so just make a Set of the manual entries and add each result from your heuristic, you don't have to worry about duplicates then

@TomerFi
Copy link
Member

TomerFi commented Nov 8, 2022

of course, but the data is not persisted, if we re-generate the entries set for every build based on members in this org,
this means this if I leave this org, in the next build, unless we have another member contributing in the same exact repos, they will not appear in the new set.

@TomerFi
Copy link
Member

TomerFi commented Nov 8, 2022

maybe we should discuss persisting our data.
our current data fetching is a lengthy one, and we're going to add on top of it.

so... maybe it's time to consider persisting this data somewhere and updating it nightly or some other schedule, having this site build quicker by simply retrieving the data from the persistence target.

we can do it with another repo that will host the persistent data and some workflows updating it.
we can also do it in this repo, but I think it will be messy.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants