sloth_link_crawler 0.0.2 copy "sloth_link_crawler: ^0.0.2" to clipboard
sloth_link_crawler: ^0.0.2 copied to clipboard

(WIP!) Web crawler to crawl all links of a website. Looking foward to respect robots.txt and use custom user agents.

140/ 160
pub points
9
downloads

We analyzed this package 19 days ago, and awarded it 140 pub points (of a possible 160):

Passed report section
Follow Dart file conventions
30 / 30trigger folding of the section

Passed check 10/10 points: Provide a valid pubspec.yaml

Passed check 5/5 points: Provide a valid README.md

Passed check 5/5 points: Provide a valid CHANGELOG.md

Passed check 10/10 points: Use an OSI-approved license

Detected license: BSD-3-Clause.

Partially passed report section
Provide documentation
10 / 20trigger folding of the section

Partially passed check 0/10 points: 20% or more of the public API has dartdoc comments

0 out of 32 API elements (0.0 %) have documentation comments.

Providing good documentation for libraries, classes, functions, and other API elements improves code readability and helps developers find and use your API. Document at least 20% of the public API elements.

To highlight public API members missing documentation consider enabling the public_member_api_docs lint.

Some symbols that are missing documentation: crawler_interceptor, crawler_interceptor.CrawlerInterceptor, crawler_interceptor.CrawlerInterceptor.CrawlerInterceptor.new, crawler_interceptor.CrawlerInterceptor.interceptRequest, crawler_interceptor.CrawlerInterceptor.interceptResponse.

Passed check 10/10 points: Package has an example

Passed report section
Platform support
20 / 20trigger folding of the section

Passed check 20/20 points: Supports 5 of 6 possible platforms (iOS, Android, Web, Windows, macOS, Linux)

  • ✓ Android

  • ✓ iOS

  • ✓ Windows

  • ✓ Linux

  • ✓ macOS

These platforms are not supported:

Package not compatible with platform Web

Because:

  • package:sloth_link_crawler/sloth_link_crawler.dart that imports:
  • package:sloth_link_crawler/src/sloth_link_crawler.dart that imports:
  • package:sloth_link_crawler/extensions/crawler_interceptor.dart that imports:
  • dart:io
Passed report section
Pass static analysis
50 / 50trigger folding of the section

Passed check 50/50 points: code has no errors, warnings, lints, or formatting issues

Failed report section
Support up-to-date dependencies
30 / 40trigger folding of the section

Failed check 0/10 points: All of the package dependencies are supported in the latest version

Package Constraint Compatible Latest Notes
beautiful_soup_dart ^0.3.0 0.3.0 0.3.0
http ^0.13.5 0.13.6 1.6.0
http_interceptor ^1.0.2 1.0.2 2.0.0
queue ^3.1.0+2 3.4.0 3.4.0
robots_txt ^1.1.1 1.1.1 2.3.1
Transitive dependencies
Package Constraint Compatible Latest Notes
async - 2.13.0 2.13.0
collection - 1.19.1 1.19.1
csslib - 1.0.2 1.0.2
html - 0.15.6 0.15.6
http_parser - 4.1.2 4.1.2
meta - 1.17.0 1.17.0
path - 1.9.1 1.9.1
source_span - 1.10.1 1.10.1
sprint - 1.0.4 3.0.0
string_scanner - 1.4.1 1.4.1
term_glyph - 1.2.2 1.2.2
tint - 2.0.1 2.0.1
typed_data - 1.4.0 1.4.0
web_scraper - 0.1.4 0.1.4

To reproduce run dart pub outdated --no-dev-dependencies --up-to-date --no-dependency-overrides.

Found 3 issues. Showing the first 2:

The constraint `^0.13.5` on http does not support the stable version `1.0.0`.

Try running dart pub upgrade --major-versions http to update the constraint.

The constraint `^1.0.2` on http_interceptor does not support the stable version `2.0.0`.

Try running dart pub upgrade --major-versions http_interceptor to update the constraint.

Passed check 10/10 points: Package supports latest stable Dart and Flutter SDKs

Passed check 20/20 points: Compatible with dependency constraint lower bounds

pub downgrade does not expose any static analysis error.

Analyzed with Pana 0.23.3, Dart 3.10.4.

Check the analysis log for details.

Weekly downloads

Display as:
By versions:
3
likes
140
points
9
downloads

Publisher

verified publisherynnob.com

Weekly Downloads

(WIP!) Web crawler to crawl all links of a website. Looking foward to respect robots.txt and use custom user agents.

Homepage
Repository (GitHub)
View/report issues

Documentation

API reference

License

BSD-3-Clause (license)

Dependencies

beautiful_soup_dart, http, http_interceptor, queue, robots_txt

More

Packages that depend on sloth_link_crawler