Skip to content

main audio data flows (backend)#4

Open
akshaynthakur wants to merge 7 commits intomainfrom
akshay/cleanup
Open

main audio data flows (backend)#4
akshaynthakur wants to merge 7 commits intomainfrom
akshay/cleanup

Conversation

@akshaynthakur
Copy link
Collaborator

🎉 What's new in this PR 🎉

☁️ ☁️ Description ☁️ ☁️

Running firebaseApp.js pushes all available data (mp3s + metadata) from the Cultural Survival RSS Feed into Firestore and Firebase Storage.

  • Set up Firebase Storage/Google Cloud Storage authentication to allow pushing of mp3 files into storage
    • Deletes all local mp3s once pushed
  • Set up Firestore authentication to allow pushing of metadata into storage
  • Consolidated metadata from CS RSS metadata and SoundCloud metadata
    • Transformed comma separated string fields into list of strings

Screenshots 📲

Results of changes can be seen in Firestore and Firebase Storage.

⚡ How to review ⚡

audioScraper.js: RSS feed and SoundCloud API helper functions
server.js: Firebase storage/Google Cloud storage helper functions
firebaseApp.js: "main" file that uses helper functions from above files

🌱 Next steps 🌱

Currently, if the script is run twice on the same RSS feed, no duplicates will be created (any changes will be updated) but the script will still fully run. Need to consider/investigate process for only proceeding with new objects in the RSS feed to minimize runtime.

Relevant Links 🔗

Online sources ℹ️

Related PRs 🙌

CC: @davidqing6432

@akshaynthakur akshaynthakur changed the title completed main audio data flows (backend) main audio data flows (backend) Mar 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants