For those not aware nitter is an opensource twitter frontend which has no ads or javascript.

Now it also bypasses the rate limits and other restrictions.

  • l3mming@lemmy.fmhy.ml
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 year ago

    Don’t need API access to scrape data. That’s the whole point of scraping - you’re indistinguishable from regular traffic. Nitter could even impersonate a Google search crawler if they want.

    • nullishcat@lemmy.fmhy.mlM
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      I could be wrong but when looking at the changed code, it still uses a token, specifically on this line. It’s possibly using user routes instead of the actual paid API, but it’s hard to tell without knowing twitter’s API in depth. Also it’s not possible to get everything just by web scraping, especially after they locked everything behind logins. AFAIK the most you can do is impersonate search crawling and get singular tweets or profile bios.