No packages match

pslr - Public Suffix List Engine

A focused implementation of the Public Suffix List (PSL). Bundles a reproducible, pinned PSL snapshot and implements the official prevailing-rule algorithm to answer public-suffix (eTLD) and registrable-domain (eTLD+1) queries. Distinguishes ICANN and PRIVATE rule sections, accepts Unicode and ASCII hostnames via 'punycoder' canonicalization, and supports an explicit, validated offline refresh path. The matcher is compiled with 'cpp11' and requires no external system library. Used as the PSL engine by the 'rurl' package.

Last updated

public suffix listpsletldetld+1registrable domainicanndomain parsingdomain extractiondomain namestldcookie domainsidnapublic suffixcpp

6.77 score 6 dependents 17 scripts 1.1k downloads

rurl - Parse, Clean, and Normalize URLs

A lightweight toolkit for extracting structured information from URLs. Includes functions for parsing, normalizing protocols, extracting domains, and constructing clean URLs. Domain and public-suffix extraction is delegated to the 'pslr' package, which implements the Public Suffix List from <https://publicsuffix.org>. Punycode and IDNA encoding is handled by the 'punycoder' package, and IP address facts by the 'raddr' package.

Last updated

url-parsingurl-parserurl-normalizationurl-cleaningurl-cleanerurl-checkerdomain-extractiondomain-name-detectiondomain-name-checkerpublic-suffixtldtldstld-extractiontld-checkertld-verificationidnapunycodeuriurlseoweb-scraping

6.69 score 5 dependents 13 scripts 881 downloads

punycoder - Unicode and Punycode Domain Name Processing

High-performance Unicode and Punycode processing for internationalized domain names. The 'puny_encode()' / 'puny_decode()' helpers are a low-level, RFC 3492 compliant Punycode codec for domain labels (the 'xn--' ASCII-Compatible Encoding of RFC 5890/5891); they perform the raw transform plus letter-digit-hyphen checks and do not apply Unicode IDNA normalization. 'host_normalize()' is the Unicode Technical Standard #46 host-normalization entry point, mapping a host name to a canonical lowercase ASCII comparison form (non-transitional profile, pinned default Unicode version, which a call can override with any version the build ships). Aimed at host normalization and data analysis workflows. Used as the Punycode and IDNA engine by the 'pslr' and 'rurl' packages.

Last updated

punycodepunycode encodepunycode decodeidnaidninternationalized domain namesuts-46rfc 3492unicodehost normalizationhostnamedomain namestldlibidn2cpp

6.62 score 7 dependents 4 scripts 983 downloads

raddr - Show What an IP Address Literal Means Under Every Standard

Standards and implementations disagree about what an IP address literal means: the string "0177.0.0.1" is rejected by the dotted-quad grammar, read as 127.0.0.1 by browsers, and read as 177.0.0.1 by some 'inet_pton' implementations. Most libraries pick one reading and discard the rest. This package reports them all, alongside the reason codes that explain each one, and classifies parsed values against the IANA special-purpose address registries. It is pure R, performs no network access, and returns facts rather than allow or deny verdicts.

Last updated

ip-addressipv4ipv6ip-parserinet-ptoninet-atonwhatwg-urlianaspecial-purpose-registrycidr

6.38 score 4 dependents 9 scripts 869 downloads

pagerankr - Modular Toolkit for PageRank Calculation

Provides a set of modular, pipeable functions to calculate PageRank scores from edge lists and redirect reports, common in SEO analysis. Functions handle URL cleaning, redirect resolution, edge deduplication, isolate handling, and PageRank computation using base R for data manipulation and 'igraph' for core PageRank calculation.

Last updated

pagerankseotechnical-seointernal-linkinglink-graphlink-equitycrawl-analysisscreaming-frogredirectstrustrank

6.14 score 1 dependents 11 scripts 322 downloads

sitemapr - Parse and Validate XML Sitemaps

A deterministic toolkit for reading and validating XML, text, and index sitemaps against the Sitemap Protocol 0.9 and related W3C and RFC standards. It parses sitemap sources into tidy data frames, expands sitemap indexes, and reports schema and protocol findings with stable, reproducible output.

Last updated

4.29 score 1 dependents 6 scripts

robotstxtr - Engine-Aware 'robots.txt' Policy with Google's Matcher Algorithm

Evaluates whether URLs may be crawled according to 'robots.txt' rules. A versioned engine-aware facade keeps neutral fetch evidence, per-engine status policy, robots product tokens, and matcher capabilities separate, returning explicit non-decisions when policy is undocumented or a matcher is unavailable. The available matcher is a bundled, upstream-test-validated snapshot of Google's open-source C++ 'robots.txt' matcher, preserving 'Googlebot' behavior. Fetches use a deterministic, conservative policy built on 'httr2', with fetch origins constructed by 'rurl'. All network access in tests, examples, and vignettes is mocked or served locally, so no internet connection is required to install, test, or check the package. This matcher derives from Google's 'robotstxt' project <https://github.com/google/robotstxt>, distributed under the Apache License 2.0; see the package NOTICE.

Last updated

cpp

3.70 score 6 scripts

seor - Easily Install and Load the 'seor' SEO and Developer Tools

The 'seor' suite bundles a set of focused R packages for search engine optimization and web-developer workflows: URL parsing, punycode and internationalized-domain conversion, public suffix list lookups, XML sitemap parsing and PageRank estimation. Loading 'seor' with a single call to library() installs and attaches all of the member packages at once, in the style of the 'tidyverse' metapackage.

Last updated

seosearch-engine-optimizationmetapackageurl-parsingidnapublic-suffix-listip-addressxml-sitemappagerankrobots-txt

3.56 score 12 scripts

ssrfr - Server-Side Request Forgery Guard for Outbound Requests

Protects R applications that fetch URLs an attacker can influence from server-side request forgery. Each redirect hop is parsed once, resolved once, and every resolved address is classified before the connection is pinned to a validated address, so a hostname cannot be rebound between check and connect. Refusals carry stable reason codes. Provides the guarded fetch of each hop of a redirect chain, a helper that follows a whole chain, structural inspection of a URL without network access, and resolved inspection of every address a name resolves to.

Last updated

ssrfserver-side-request-forgeryurl-validationip-addressdns-rebindingcloud-metadataredirectslibcurlsecurity

3.40 score 6 scripts