pyunique package

Submodules

pyunique.archive module

archive

class pyunique.archive.Archive

Bases: object

abstractmethod add_digest(filename: str, digest: bytes) → None

abstractmethod close() → None

abstractmethod count() → int

abstractmethod delete(filename: str) → None

abstractmethod end_read() → None

abstractmethod end_write() → None

abstractmethod get_digest(filename: str) → bytes | None

abstractmethod start_read() → None

abstractmethod start_write() → None

abstractmethod yield_all_items()

class pyunique.archive.ArchiveLMDB

Bases: Archive

add_digest(filename: str, digest: bytes) → None

close() → None

count() → int

delete(filename: str) → None

end_read() → None

end_write() → None

get_digest(filename: str) → bytes | None

start_read() → None

start_write() → None

yield_all_items()

pyunique.archive.get_archive() → Archive

return correct archive using the currently configured algorithm (factory method)

pyunique.configs module

All configurations for pyunique

class pyunique.configs.ConfigAlgo

Bases: Config

Parameters at the core of the algorithm

digest = 'sha256'

encoding = 'utf-8'

class pyunique.configs.ConfigLMDB

Bases: Config

Parameters that control working with LMDB (experts only)

buffers = False

map_size = 1000000000000

class pyunique.configs.ConfigScan

Bases: Config

Parameters that control the scanning phase

folder = '.'

pyunique.digest module

digest utilities

pyunique.digest.digest_file_bytes(filename: str) → bytes

pyunique.main module

main entry point to the program

pyunique.main.check_filenames() → None

pyunique.main.clean_db() → None

pyunique.main.main()

pyunique.main.scan() → None

pyunique.static module

version which can be consumed from within the module

pyunique.utils module

utilities

pyunique.utils.get_logger()

pyunique.utils.get_number_of_files(folder: str) → int

Module contents

Initialize the module