Commit Graph

357 Commits (3cdfdc45d386028a0e74a6ec573b570e00ffebde)
 

Author SHA1 Message Date
Sunshine 727a5a410c
add option for custom network request timeout 4 years ago
Sunshine 23af174822
Merge pull request #115 from snshn/remove-javascript-anchors
Nullify JS within As' href attributes when needed
4 years ago
Sunshine 5ef2b7c9dc
nullify JS within As' href attributes when needed 4 years ago
Sunshine 1e8348543a
Merge pull request #111 from snshn/adr
Introduce ADRs
4 years ago
Sunshine f9bafe092d
Introduce ADRs 4 years ago
Sunshine f876e9243c
Merge pull request #109 from snshn/version-bump
version bump (2.1.1 → 2.1.2)
4 years ago
Sunshine b6896febf1
version bump (2.1.1 → 2.1.2) 4 years ago
Sunshine 29d2ba5857
Merge pull request #107 from snshn/update-readme
Update README.md
4 years ago
Sunshine 8b1ebc7871
Update README.md 4 years ago
Sunshine d753c83c76
Merge pull request #108 from rhysd/revert-manual-proxy-support
Revert #106 since reqwest supports system proxies by default
4 years ago
rhysd 47a825f5ed add proxies instruction in README.md 4 years ago
rhysd 0e12cecd85 Revert "Merge pull request #106 from rhysd/proxy-support"
This reverts commit d8def879b2, reversing
changes made to a9d114d04d.
4 years ago
Sunshine d8def879b2
Merge pull request #106 from rhysd/proxy-support
Support HTTP and HTTPS proxies
4 years ago
Linda_pp 0420854ed6
remove '$' from environment variable names in README.md 4 years ago
rhysd d47482fcd9 fix crash at setting empty values to HTTP proxies
with this patch `https_proxy=` and `http_proxy=` will work well.
4 years ago
rhysd b68624f2f3 support HTTP and HTTPS proxies (fix #103) 4 years ago
Sunshine a9d114d04d
Merge pull request #105 from rhysd/refactor-main
Refactoring for main.rs to address several issues
4 years ago
rhysd 4e4ebe9c98 refactor main to address several issues
Addressed issues:

- when specified URL is invalid, it exited successfully with doing
  nothing. There was no way why it does not work for users
- it exited successfully even if invalid User-Agent value is specified
- it created file twice on `--output` option specified. It may cause an
  issue when some file watcher (e.g. FsEvents on macOS) is watching

Improvements:
- handle errors with `Result::expect` consistently it correctly exits
  with non-zero status on error
- define `Output` enum for handling both stdout and file outputs
4 years ago
Sunshine 429217d8f7
Merge pull request #104 from rhysd/complete-dom-event-handlers
Use complete list of DOM event handlers for detecting JS attributes
4 years ago
rhysd 1779f4a374 better comments for JS_DOM_EVENT_ATTRS constant 4 years ago
rhysd 26e89ae6d3 use complete list of DOM event handlers 4 years ago
Sunshine b333d19d04
Update README.md 4 years ago
Sunshine c1dc798ded
Merge pull request #101 from rhysd/ignore-preload
Improve handling preload links and white spaces in attribute values
4 years ago
rhysd 69d99b69e8 remove . in line comment 4 years ago
Sunshine aae53d20f0
Merge pull request #102 from popey/update-snap-config
Update snapcraft configuration
4 years ago
Alan Pope 14cf2ce8a6
Update snapcraft configuration
This changes the build slightly. If snapcraft is triggered when there is a new tagged release in the project github release page, and it's newer than the version in the Snap Store beta channel, we build that stable release. If however, the latest stable release in github releases is already the same as the Snap Store beta channel, then we build the tip of master.

This gives a couple of advantages. 

  * One yaml can be used to build tip-of-git snaps, and stable releases alike
  * Closing the beta channel in the Snap Store will mean the next triggered build will re-build whatever the last stable release is. This is useful to force a rebuild of the stable version in case a dependency (not that there are many) has a security issue.

We also now set the version dynamically based on the git tags.
4 years ago
Emi Simpson 05985583f0
Switch timestamps from rfc822 local time to iso8601 UTC 4 years ago
Emi Simpson 651fa716b4
Clean user, pass, and fragment from URL before writing 4 years ago
rhysd 67b79e92f9 simplify &x.into_iter() to x.iter() 4 years ago
rhysd b51f41fe34 trim attribute values 4 years ago
rhysd 6f158dc6db compare value of 'rel' properties in case-insensitive 4 years ago
rhysd 8d7052b39c ignore preload and prefetch sources
since all resources are embedded as data URL.
4 years ago
rhysd 660511b8a0 define link type of <link> element as enum and prefer match statement
since match statement checks exhaustiveness
4 years ago
Emi Simpson 9be3982dc6
Added --no-context flag to disable adding context comment 4 years ago
Emi Simpson 27c9fb4cd3
Added comment indicating the context under which the page was downloaded 4 years ago
Sunshine 929512f4f5
Merge pull request #97 from rhysd/reqwest-0.10.0
Upgrade reqwest to v0.10.0 for better binary size and build time
4 years ago
Sunshine a46d89cefc
Merge pull request #98 from rhysd/fix-ci
Fix nighly and beta CI
4 years ago
rhysd f93646e17a ignore beta channel again on AppVeyor
since rustc command crashes on combination of
channel=beta & target=i686-pc-windows-gnu
4 years ago
rhysd 9d14b6dfea rename appveyor.yml to .appveyor.yml
align to .travis.yml
4 years ago
rhysd 9783b96524 check beta channel on CI not to break this crate with next Rust version 4 years ago
rhysd 106efe58ce fix nighly and beta on CI are failing
we always use stable rustfmt so checking with nighly/beta rustfmt is not
necessary.
4 years ago
rhysd 6e99ad13e7 upgrade reqwest to v0.10.0
This will improve build time and binary size as follows:

* Before

- **Compile targets**: 220
- **Build time**: `cargo build --release  1264.95s user 39.72s system 335% cpu 6:29.14 total`
- **Binary size**: 6578568 bytes

* After

- **Compile targets**: 170
- **Build time**: `cargo build --release  1130.64s user 32.15s system 359% cpu 5:23.69 total`
- **Binary size**: 6107088 bytes

* Differences

- **Compile targets**: 1.29x smaller
- **Build time**: 1.23x faster
- **Binary size**: 1.07x smaller
4 years ago
Sunshine 413dd66886
Merge pull request #96 from rhysd/refactorings
Refactorings
4 years ago
rhysd dc7ec6e7a8 remove more redundant type annotations 4 years ago
rhysd ed879231af fix test code was broken by refactoring 4 years ago
rhysd ddf4b8ac13 prefer &str to String for reducing allocations 4 years ago
rhysd 84c13f0605 prefer unwrap_or_default to unwrap_or 4 years ago
rhysd ce03e0e487 reduce allocation on checking DOM attributes and do not hard-code number of elements of array constant
`to_lower` allocates new string but the allocation is not necessary
here.
4 years ago
rhysd 63e19998d0 reduce clones and fix some code styles and redundant code 4 years ago
Sunshine e3321bbb07
Merge pull request #95 from rhysd/rust2018
Migrate to Rust2018 edition
4 years ago