Releases · CDLUC3/dmsp_api_prototype

Support for Affiliation/Funder typeahead dmsp_aws_protoype repo #84

Added new Harvester for ROR data. Harvester consists of 2 separate lambdas:
- This Lambda is scheduled to run on the first of the month
- Downloader fetches the ROR release metadata from Zenodo, downloads the latest release and stores it in S3 (skips if the file has not changed). It then batches the content of the file into groups of 50k records and kicks off a Processor for each set.
- Processor fetches the latest ZIP file from S3, grabs the records it is supposed to process and updates/adds the record in the new ExternalData DynamoDB table.
Added a new Indexer for the ExternalData DynamoDB table. It watches the Dynamo stream for changes and then adds/updates a pared down version of the record in the Index DynamoDB table (will eventually be updated to write to an OpenSearch index)
Added 2 new API endpoints:
- GetAffiliation fetches a specific record based on the ROR id
- GetAffiliations searches for matching ROR records. The caller may provide. search term and a boolean flag indicating other or not they only want funders in the results (e.g. ?search=national+institutes+of+health&funderOnly=true)

Bug fixes

Added nil checks to the contributors and works sections of the Landing page #3
Updated the EzidPublisher Lambda to ignore contributor entries that are missing a name. The DataCite schema requires them. #7
Updated the Cloudwatch gem to allow for the warn debug level. Updated the Citation gem so that it properly catches and handles failure responses from the External systems we call to fetch BibTex metadata dmsp_aws_prototype repo #110

Provide feedback