Note

I've almost got my Mastodon scraper working for Untitled #DigitalGarden project! It was getting pretty sketchy so started adding add some unit tests for the more complicated bits

It's quite a mix of tech in there now. It pulls data down using fetch, de-duplicates and threads statuses together, then it processes Mastodon's HTML with Cheerio to strip un-useful stuff and now it's reformatting that as YAML front matter and soon creating files in the repo

It was a pretty big first commit!

https://github.com/robb-j/r0b-garden/commit/143966798b6ef21538526919820b71ee2063e314

metadata

Open on GiHub

{
  "mastodon_status": [
    "https://hyem.tech/@rob/111682384198563558",
    "https://hyem.tech/@rob/111682397378727807",
    "https://hyem.tech/@rob/111683761591516399"
  ],
  "external": [
    "https://github.com/robb-j/r0b-garden/commit/143966798b6ef21538526919820b71ee2063e314"
  ]
}