ramikrispin,
@ramikrispin@mstdn.social avatar

(1/3) I am excited to share that my course - Data Pipeline Automation with GitHub Actions Using R and Python 🚀, is now available on LinkedIn Learning!

The course provides an introduction to setting up automation with GitHub Actions with both R and Python. Throughout the course, we will use a real-life example by working with the U.S. Energy Information Administration (EIA) API for data automation. 🧵👇🏼

ramikrispin,
@ramikrispin@mstdn.social avatar

(2/3) This includes:
✅ Learn how to work with the EIA API
✅ Define the data pipeline scope and characteristics
✅ Set functions to pull data and metadata from the API
✅ Set data backfill and refresh process
✅ Deploy the process to GitHub Actions
✅ Create a monitoring dashboard and deploy it on GitHub Pages

The course has tracks for both R and Python using tools such as Quarto docs, Git, and Docker.

image/png

ramikrispin,
@ramikrispin@mstdn.social avatar

The course is available on the LinkedIn Learning platform 📽️: https://www.linkedin.com/learning/data-pipeline-automation-with-github-actions-using-r-and-python/

transportationtalk,
@transportationtalk@fosstodon.org avatar

@ramikrispin Hi Rami, this is a great course. I am following the course instructions but it seems that the EIAapi R library is outdated? It throws the error Could not parse the metadata JSON. Not sure if I am missing anything.

ramikrispin,
@ramikrispin@mstdn.social avatar

@transportationtalk it would through an error when the GET request is not valid, could you please open an issue over here:
https://github.com/RamiKrispin/EIAapi/issues

It would help if you could point out the series you are trying to pull from the API.

ramikrispin,
@ramikrispin@mstdn.social avatar

@transportationtalk also, please check that you have js installed locally:

https://jqlang.github.io/jq/

  • All
  • Subscribed
  • Moderated
  • Favorites
  • python
  • DreamBathrooms
  • magazineikmin
  • thenastyranch
  • Youngstown
  • slotface
  • khanakhh
  • InstantRegret
  • everett
  • kavyap
  • tsrsr
  • osvaldo12
  • PowerRangers
  • mdbf
  • Durango
  • Leos
  • hgfsjryuu7
  • ngwrru68w68
  • vwfavf
  • modclub
  • rosin
  • ethstaker
  • GTA5RPClips
  • cubers
  • tacticalgear
  • tester
  • normalnudes
  • cisconetworking
  • anitta
  • All magazines