www/py-scrapy - The NetBSD Packages Collection

High-level Web Crawling and Web Scraping framework

Scrapy is a fast high-level web crawling and web scraping framework, used to
crawl websites and extract structured data from their pages. It can be used for
a wide range of purposes, from data mining to monitoring and automated testing.

Build dependencies

pkgtools/cwrappers

Runtime dependencies

security/py-OpenSSL devel/py-ZopeInterface security/py-cryptography textproc/py-cssselect textproc/py-itemloaders textproc/py-lxml www/py-parsel www/py-protego devel/py-pydispatcher devel/py-queuelib security/py-service_identity lang/py-six net/py-twisted www/py-w3lib devel/py-setuptools lang/python39 lang/python39

Binary packages

OSArchitectureVersion
NetBSD 8.0earmv7hfpy36-scrapy-2.4.1.tgz
NetBSD 8.0earmv7hfpy37-scrapy-2.4.1.tgz
NetBSD 8.0earmv7hfpy38-scrapy-2.4.1.tgz
NetBSD 8.0earmv7hfpy39-scrapy-2.4.1.tgz
NetBSD 8.0earmv7hfpy36-scrapy-2.4.1.tgz
NetBSD 8.0earmv7hfpy37-scrapy-2.4.1.tgz
NetBSD 8.0earmv7hfpy38-scrapy-2.4.1.tgz
NetBSD 8.0earmv7hfpy39-scrapy-2.4.1.tgz
NetBSD 8.0earmv7hfpy36-scrapy-2.4.1.tgz
NetBSD 8.0earmv7hfpy37-scrapy-2.4.1.tgz
NetBSD 8.0earmv7hfpy38-scrapy-2.4.1.tgz
NetBSD 8.0earmv7hfpy39-scrapy-2.4.1.tgz
NetBSD 8.0i386py36-scrapy-2.4.1.tgz
NetBSD 8.0i386py37-scrapy-2.4.1.tgz
NetBSD 8.0i386py38-scrapy-2.4.1.tgz
NetBSD 8.0i386py39-scrapy-2.4.1.tgz
NetBSD 8.0i386py36-scrapy-2.4.1.tgz
NetBSD 8.0i386py37-scrapy-2.4.1.tgz
NetBSD 8.0i386py38-scrapy-2.4.1.tgz
NetBSD 8.0i386py39-scrapy-2.4.1.tgz
NetBSD 8.0powerpcpy36-scrapy-2.4.1.tgz
NetBSD 8.0powerpcpy37-scrapy-2.4.1.tgz
NetBSD 8.0powerpcpy38-scrapy-2.4.1.tgz
NetBSD 8.0powerpcpy39-scrapy-2.4.1.tgz
NetBSD 8.0powerpcpy36-scrapy-2.4.1.tgz
NetBSD 8.0powerpcpy37-scrapy-2.4.1.tgz
NetBSD 8.0powerpcpy38-scrapy-2.4.1.tgz
NetBSD 8.0powerpcpy39-scrapy-2.4.1.tgz
NetBSD 8.0powerpcpy36-scrapy-2.4.1.tgz
NetBSD 8.0powerpcpy37-scrapy-2.4.1.tgz
NetBSD 8.0powerpcpy38-scrapy-2.4.1.tgz
NetBSD 8.0powerpcpy39-scrapy-2.4.1.tgz
NetBSD 8.0powerpcpy36-scrapy-2.4.1.tgz
NetBSD 8.0powerpcpy37-scrapy-2.4.1.tgz
NetBSD 8.0powerpcpy38-scrapy-2.4.1.tgz
NetBSD 8.0powerpcpy39-scrapy-2.4.1.tgz
NetBSD 8.0x86_64py36-scrapy-2.4.1.tgz
NetBSD 8.0x86_64py37-scrapy-2.4.1.tgz
NetBSD 8.0x86_64py38-scrapy-2.4.1.tgz
NetBSD 8.0x86_64py39-scrapy-2.4.1.tgz
NetBSD 8.0x86_64py36-scrapy-2.4.1.tgz
NetBSD 8.0x86_64py37-scrapy-2.4.1.tgz
NetBSD 8.0x86_64py38-scrapy-2.4.1.tgz
NetBSD 8.0x86_64py39-scrapy-2.4.1.tgz
NetBSD 9.0aarch64py36-scrapy-2.4.1.tgz
NetBSD 9.0aarch64py37-scrapy-2.4.1.tgz
NetBSD 9.0aarch64py38-scrapy-2.4.1.tgz
NetBSD 9.0aarch64py39-scrapy-2.4.1.tgz
NetBSD 9.0aarch64py36-scrapy-2.4.1.tgz
NetBSD 9.0aarch64py37-scrapy-2.4.1.tgz
NetBSD 9.0aarch64py38-scrapy-2.4.1.tgz
NetBSD 9.0aarch64py39-scrapy-2.4.1.tgz
NetBSD 9.0aarch64py36-scrapy-2.4.1.tgz
NetBSD 9.0aarch64py37-scrapy-2.4.1.tgz
NetBSD 9.0aarch64py38-scrapy-2.4.1.tgz
NetBSD 9.0aarch64py39-scrapy-2.4.1.tgz
NetBSD 9.0alphapy36-scrapy-2.4.1.tgz
NetBSD 9.0alphapy37-scrapy-2.4.1.tgz
NetBSD 9.0alphapy38-scrapy-2.4.1.tgz
NetBSD 9.0alphapy39-scrapy-2.4.1.tgz
NetBSD 9.0alphapy36-scrapy-2.4.1.tgz
NetBSD 9.0alphapy37-scrapy-2.4.1.tgz
NetBSD 9.0alphapy38-scrapy-2.4.1.tgz
NetBSD 9.0alphapy39-scrapy-2.4.1.tgz
NetBSD 9.0alphapy36-scrapy-2.4.1.tgz
NetBSD 9.0alphapy37-scrapy-2.4.1.tgz
NetBSD 9.0alphapy38-scrapy-2.4.1.tgz
NetBSD 9.0alphapy39-scrapy-2.4.1.tgz
NetBSD 9.0earmv6hfpy36-scrapy-2.4.1.tgz
NetBSD 9.0earmv6hfpy37-scrapy-2.4.1.tgz
NetBSD 9.0earmv6hfpy38-scrapy-2.4.1.tgz
NetBSD 9.0earmv6hfpy39-scrapy-2.4.1.tgz
NetBSD 9.0earmv6hfpy36-scrapy-2.4.1.tgz
NetBSD 9.0earmv6hfpy37-scrapy-2.4.1.tgz
NetBSD 9.0earmv6hfpy38-scrapy-2.4.1.tgz
NetBSD 9.0earmv6hfpy39-scrapy-2.4.1.tgz
NetBSD 9.0earmv6hfpy36-scrapy-2.4.1.tgz
NetBSD 9.0earmv6hfpy37-scrapy-2.4.1.tgz
NetBSD 9.0earmv6hfpy38-scrapy-2.4.1.tgz
NetBSD 9.0earmv6hfpy39-scrapy-2.4.1.tgz
NetBSD 9.0earmv7hfpy36-scrapy-2.4.1.tgz
NetBSD 9.0earmv7hfpy37-scrapy-2.4.1.tgz
NetBSD 9.0earmv7hfpy38-scrapy-2.4.1.tgz
NetBSD 9.0earmv7hfpy39-scrapy-2.4.1.tgz
NetBSD 9.0earmv7hfpy36-scrapy-2.4.1.tgz
NetBSD 9.0earmv7hfpy37-scrapy-2.4.1.tgz
NetBSD 9.0earmv7hfpy38-scrapy-2.4.1.tgz
NetBSD 9.0earmv7hfpy39-scrapy-2.4.1.tgz
NetBSD 9.0earmv7hfpy36-scrapy-2.4.1.tgz
NetBSD 9.0earmv7hfpy37-scrapy-2.4.1.tgz
NetBSD 9.0earmv7hfpy38-scrapy-2.4.1.tgz
NetBSD 9.0earmv7hfpy39-scrapy-2.4.1.tgz
NetBSD 9.0earmv7hfpy36-scrapy-2.4.1.tgz
NetBSD 9.0earmv7hfpy37-scrapy-2.4.1.tgz
NetBSD 9.0earmv7hfpy38-scrapy-2.4.1.tgz
NetBSD 9.0earmv7hfpy39-scrapy-2.4.1.tgz
NetBSD 9.0i386py36-scrapy-2.4.1.tgz
NetBSD 9.0i386py37-scrapy-2.4.1.tgz
NetBSD 9.0i386py38-scrapy-2.4.1.tgz
NetBSD 9.0i386py39-scrapy-2.4.1.tgz
NetBSD 9.0i386py36-scrapy-2.4.1.tgz
NetBSD 9.0i386py37-scrapy-2.4.1.tgz
NetBSD 9.0i386py38-scrapy-2.4.1.tgz
NetBSD 9.0i386py39-scrapy-2.4.1.tgz
NetBSD 9.0mips64ebpy36-scrapy-2.4.1.tgz
NetBSD 9.0mips64ebpy37-scrapy-2.4.1.tgz
NetBSD 9.0mips64ebpy38-scrapy-2.4.1.tgz
NetBSD 9.0mips64ebpy39-scrapy-2.4.1.tgz
NetBSD 9.0mips64ebpy27-scrapy-1.8.0.tgz
NetBSD 9.0mips64ebpy36-scrapy-1.8.0.tgz
NetBSD 9.0mips64ebpy37-scrapy-1.8.0.tgz
NetBSD 9.0mips64ebpy38-scrapy-1.8.0.tgz
NetBSD 9.0mips64ebpy36-scrapy-2.4.1.tgz
NetBSD 9.0mips64ebpy37-scrapy-2.4.1.tgz
NetBSD 9.0mips64ebpy38-scrapy-2.4.1.tgz
NetBSD 9.0mips64ebpy39-scrapy-2.4.1.tgz
NetBSD 9.0mips64ebpy36-scrapy-2.4.1.tgz
NetBSD 9.0mips64ebpy37-scrapy-2.4.1.tgz
NetBSD 9.0mips64ebpy38-scrapy-2.4.1.tgz
NetBSD 9.0mips64ebpy39-scrapy-2.4.1.tgz
NetBSD 9.0powerpcpy36-scrapy-2.4.1.tgz
NetBSD 9.0powerpcpy37-scrapy-2.4.1.tgz
NetBSD 9.0powerpcpy38-scrapy-2.4.1.tgz
NetBSD 9.0powerpcpy39-scrapy-2.4.1.tgz
NetBSD 9.0powerpcpy36-scrapy-2.4.1.tgz
NetBSD 9.0powerpcpy37-scrapy-2.4.1.tgz
NetBSD 9.0powerpcpy38-scrapy-2.4.1.tgz
NetBSD 9.0powerpcpy39-scrapy-2.4.1.tgz
NetBSD 9.0powerpcpy36-scrapy-2.4.1.tgz
NetBSD 9.0powerpcpy37-scrapy-2.4.1.tgz
NetBSD 9.0powerpcpy38-scrapy-2.4.1.tgz
NetBSD 9.0powerpcpy39-scrapy-2.4.1.tgz
NetBSD 9.0powerpcpy36-scrapy-2.4.1.tgz
NetBSD 9.0powerpcpy37-scrapy-2.4.1.tgz
NetBSD 9.0powerpcpy38-scrapy-2.4.1.tgz
NetBSD 9.0powerpcpy39-scrapy-2.4.1.tgz
NetBSD 9.0sparc64py36-scrapy-2.4.1.tgz
NetBSD 9.0sparc64py37-scrapy-2.4.1.tgz
NetBSD 9.0sparc64py38-scrapy-2.4.1.tgz
NetBSD 9.0sparc64py39-scrapy-2.4.1.tgz
NetBSD 9.0sparc64py36-scrapy-2.4.1.tgz
NetBSD 9.0sparc64py37-scrapy-2.4.1.tgz
NetBSD 9.0sparc64py38-scrapy-2.4.1.tgz
NetBSD 9.0sparc64py39-scrapy-2.4.1.tgz
NetBSD 9.0sparc64py36-scrapy-2.4.1.tgz
NetBSD 9.0sparc64py37-scrapy-2.4.1.tgz
NetBSD 9.0sparc64py38-scrapy-2.4.1.tgz
NetBSD 9.0sparc64py39-scrapy-2.4.1.tgz
NetBSD 9.0sparcpy36-scrapy-2.4.1.tgz
NetBSD 9.0sparcpy37-scrapy-2.4.1.tgz
NetBSD 9.0sparcpy38-scrapy-2.4.1.tgz
NetBSD 9.0sparcpy39-scrapy-2.4.1.tgz
NetBSD 9.0sparcpy36-scrapy-2.4.1.tgz
NetBSD 9.0sparcpy37-scrapy-2.4.1.tgz
NetBSD 9.0sparcpy38-scrapy-2.4.1.tgz
NetBSD 9.0sparcpy39-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py36-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py37-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py38-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py39-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py36-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py37-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py38-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py39-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py36-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py37-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py38-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py39-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py36-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py37-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py38-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py39-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py36-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py37-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py38-scrapy-2.4.1.tgz
NetBSD 9.0x86_64py39-scrapy-2.4.1.tgz

Binary packages can be installed with the high-level tool pkgin (which can be installed with pkg_add) or pkg_add(1) (installed by default). The NetBSD packages collection is also designed to permit easy installation from source.

Available build options

(none)

Known vulnerabilities

The pkg_admin audit command locates any installed package which has been mentioned in security advisories as having vulnerabilities.

Please note the vulnerabilities database might not be fully accurate, and not every bug is exploitable with every configuration.


Problem reports, updates or suggestions for this package should be reported with send-pr.