pyscrapers package

Subpackages

• pyscrapers.core package
  • Submodules
  • pyscrapers.core.ffprobe module
    • duration()
    • height()
    • probe()
    • width()
  • pyscrapers.core.ext_requests module
    • ExtResponse
      • ExtResponse.raise_for_status()
      • ExtResponse.save_binary()
      • ExtResponse.save_text()
    • ExtSession
      • ExtSession.download_url()
      • ExtSession.download_video_if_wider()
      • ExtSession.ext_get()
      • ExtSession.get_timeout()
    • download()
    • setup()
  • pyscrapers.core.url_set module
    • UrlSet
      • UrlSet.append()
      • UrlSet.download()
      • UrlSet.extend()
      • UrlSet.get_filename()
      • UrlSet.print()
      • UrlSet.suggest_filename()
  • pyscrapers.core.utils module
    • add_http()
    • get_http_status_string()
  • Module contents
• pyscrapers.workers package
  • Submodules
  • pyscrapers.workers.drumeo module
    • Course
      • Course.add_lesson()
      • Course.add_video()
    • download_course()
    • get_course_details()
    • get_course_urls()
    • get_courses()
    • get_link_re()
    • get_members_url()
    • get_number_of_pages()
    • get_url()
    • get_videos()
  • pyscrapers.workers.facebook module
    • scrape_facebook()
  • pyscrapers.workers.getpocket module
    • getpocket_download()
  • pyscrapers.workers.instagram module
    • get_urls()
    • is_rate_limit()
    • scrape_instagram()
  • pyscrapers.workers.mamba_ru module
    • scrape_mambaru()
  • pyscrapers.workers.pornhub module
    • download_search()
    • download_url()
    • get_code()
    • get_number_of_pages()
    • get_urls_from_page()
    • print_categories()
    • print_stars_all()
    • print_stars_all_detailed()
    • print_tags()
    • url_generator()
  • pyscrapers.workers.sxyprn module
    • sxyprn_download()
    • url_generator()
  • pyscrapers.workers.travelgirls module
    • scrape_travelgirls()
  • pyscrapers.workers.vk module
    • get_my_content()
    • get_total_images()
    • get_urls()
    • scrape_vk()
    • yield_json_objs_and_base()
  • pyscrapers.workers.youtube_dl_handlers module
    • MyLogger
      • MyLogger.debug()
      • MyLogger.error()
      • MyLogger.warning()
    • youtube_dl_download_url()
    • youtube_dl_download_urls()
    • youtube_dl_handler()
  • Module contents

Submodules

pyscrapers.configs module

All configurations for pyscrapers

class pyscrapers.configs.ConfigCookiesSource

Bases: Config

Configure where to get cookies from

browser = 'chrome'

class pyscrapers.configs.ConfigDebugUrls

Bases: Config

Configure how to debug urls

save = False

class pyscrapers.configs.ConfigDownload

Bases: Config

Configure details about the download process

download = True

download_as_collecting = False

folder = '.'

class pyscrapers.configs.ConfigLogging

Bases: Config

Parameters to control logging

loglevel = 'INFO'

class pyscrapers.configs.ConfigPornhubSearch

Bases: Config

Parameters for search

limit = 100

literal = 'f'

ordering = 'longest'

period = 'weekly'

query = <pytconf.param.Unique object>

tags = []

use_ordering = True

use_period = False

use_tags = False

class pyscrapers.configs.ConfigRequests

Bases: Config

Parameters to config the requests module

connect_timeout = 5

debug = False

progress = False

read_timeout = 5

class pyscrapers.configs.ConfigSiteId

Bases: Config

Parameters for downloading workers

site = <pytconf.param.Unique object>

user_id = <pytconf.param.Unique object>

class pyscrapers.configs.ConfigUrl

Bases: Config

Parameters for what url to download

url = <pytconf.param.Unique object>

class pyscrapers.configs.ConfigUser

Bases: Config

Parameters for a user

user = <pytconf.param.Unique object>

class pyscrapers.configs.ConfigYoutubeDl

Bases: Config

Configuration for youtube downloads

archive_file = '/home/mark/.config/youtube-dl-archive'

use_archive = True

pyscrapers.main module

The default group of operations that pyscrapers has

pyscrapers.main.audible_books()

pyscrapers.main.drumeo()

pyscrapers.main.getpocket()

pyscrapers.main.instagram_stories()

pyscrapers.main.main()

pyscrapers.main.netflix_list()

pyscrapers.main.photos()

pyscrapers.main.pornhub_download_search()

pyscrapers.main.pornhub_download_url()

pyscrapers.main.pornhub_stars_all_detailed()

pyscrapers.main.sxyprn()

pyscrapers.main.youtube_dl()

pyscrapers.static module

version which can be consumed from within the module

pyscrapers.utils module

pyscrapers.utils.get_cookies()

Module contents