taylus,

You could probably crawl it with the API

KelsonV,
@KelsonV@lemmy.ml avatar

Hmm, a quick look at the html on the logged-out view of a post with lots of comments shows no sign of a meta robots tag, so the pages are technically crawlable. this one

But it looks like only about 25 comments out of 439 are in the html on that first page view, so probably only those will be picked up by a crawl?

devve,

I guess it is good enough for now, and changes to the frontend will come.

I like the concept of the open web, where no account is needed (other than to interact) and contents are accessible on all sites from indexers.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • lemmy@lemmy.ml
  • tacticalgear
  • magazineikmin
  • thenastyranch
  • Youngstown
  • mdbf
  • everett
  • slotface
  • khanakhh
  • ethstaker
  • rosin
  • kavyap
  • GTA5RPClips
  • InstantRegret
  • DreamBathrooms
  • megavids
  • ngwrru68w68
  • Durango
  • normalnudes
  • cubers
  • modclub
  • cisconetworking
  • tester
  • osvaldo12
  • provamag3
  • anitta
  • Leos
  • JUstTest
  • lostlight
  • All magazines