Tb Watcher Versions Save

A Twitter profile archival tool.

v0.6.0

1 year ago

This update is all about threads⚡! Three main large changes:

  • Adds twitter threads tracking via --depth 2 *Tweets within a thread now have their tweets who they are replying to saved as parent_id.
    • Screenshots are taken for each thread.
  • Adds multi-threading support via --multi-threading N
  • Massive internal architectural changes.

Changes

  • Added --depth and -d for archiving threads.
  • Added --multi-threading and -t to specify number of threads to use.
  • Added parent_id to tweets.json which tracks direct tweet responses.
  • Added threading.py which manages thread workers and queues.
  • Added pages.py which abstracts away a page on Twitter. Useful for multi-threading.
    • Added TwitterPage used for representing a page in Twitter.
    • Added TwitterBio which is used for fetching and obtaining bio pages.
    • Added TwitterThread which represents a tweet thread page.
  • Added TweetExtractor which attempts to fetch all available Tweets on a page.
  • Added Scroller which abstracts away scrolling metrics.
  • Added thread expansion functions: hit_more_replies() and get_recommend_tweets_height().
  • Changed random messages from ChromeDriver, makes logs cleaner.
  • Fixed potential for some posts to be skipped on ad removal.
  • Fixed logger not outputting any info.
  • Fixed logger not printing debug.

v0.5.0

1 year ago

Many thanks to those who have contributed! This release attempts to modularize and add a few changes/guidelines to help aid in the community effort in this project. It also renames our project to make finding from existing tools easier.

Changes

  • Added modularization of code in src/.
  • Added binaries in bin/.
  • Changed project name from BirdWatch -> Twitter Bird Watcher (TBWatcher)
  • Added better logging support via logging module.
  • Added standardization for CHANGELOG.
  • Added better CLI help groups.
  • Fixed README Typos and Divide by Zero Error (@jmallone).

v0.4.0

1 year ago
  • Add example README
  • Update README
  • Add scroll algorithm selection

v0.3.0

1 year ago
  • Add average scrolling to compensate for scroll heights
  • Add Ad removal logic
  • Fix bug where post length was not respected

v0.2.0

1 year ago
  • Add --login for giving users login
  • New aglorithm for scrolling down content to prevent duplications

v0.1.0

1 year ago
  • Adds support for bio-only
  • Snapshots of Twitter posts
  • Adds max Twitter info

v0.1.1

1 year ago
  • Add some code-cleanup
  • Better pop-up removal support
  • Add --url support for single profile scraping
  • Add folder renaming to username functionality
  • Add tweet without login limit check
  • Add faster scrolling for centering content