Commit Graph

56 Commits (5ac520b4da9e768bbaf425bd823fe02aa4ef9993)

Author SHA1 Message Date
Sunshine 38a6f963ad
account for network errors, add option to ignore them 4 years ago
Sunshine 1d6392cb28
implement support for BASE tag 4 years ago
Sunshine 73c35eaccb
treat minus for output target file path as stdout 4 years ago
Sunshine 09d41d2cf1
automatically obtain favicon.ico 4 years ago
Sunshine bc98aca2a2
indent items in retrieval log to form a tree-like structure 4 years ago
Sunshine ddb97009e9
pass options object instead of using separate parameters 4 years ago
Sunshine 2ac964fae5
include font-src into CSP 4 years ago
Sunshine 0347fd3985
move metadata tag code into a function 4 years ago
Sunshine 5c229c51da
move functions related to URL manipulation into url.rs 4 years ago
Sunshine f9aac6f41b
update crates 4 years ago
Sunshine 4e31d0433e
only attempt to remove credentals from HTTP(S) URLs 4 years ago
Sunshine a18df74946
refactor code and implement integrity validation 4 years ago
Sunshine c4569343a4
improve metadata comments 4 years ago
Sunshine c999359b9f
Merge branch 'context-comment' of github.com:Alch-Emi/monolith into context-comment 4 years ago
Sunshine 9b40dbbf27
add option to exclude web fonts 4 years ago
Sunshine 594ad55bd8
improve data URL media type detection 4 years ago
Sunshine 875481b9a2
update help dialog 4 years ago
Sunshine 4951fea730
implement full CSS parsing 4 years ago
Sunshine 59a8be493d
add support for working with local assets 4 years ago
Sunshine 0d1e21e9ad
add black box tests 4 years ago
Sunshine 3d2d40e7cd
add support for data URL targets 4 years ago
Sunshine 928664dc88
correct is_valid_url to is_http_url 4 years ago
Sunshine 727a5a410c
add option for custom network request timeout 4 years ago
rhysd 0e12cecd85 Revert "Merge pull request #106 from rhysd/proxy-support"
This reverts commit d8def879b2, reversing
changes made to a9d114d04d.
4 years ago
rhysd d47482fcd9 fix crash at setting empty values to HTTP proxies
with this patch `https_proxy=` and `http_proxy=` will work well.
4 years ago
rhysd b68624f2f3 support HTTP and HTTPS proxies (fix #103) 4 years ago
rhysd 4e4ebe9c98 refactor main to address several issues
Addressed issues:

- when specified URL is invalid, it exited successfully with doing
  nothing. There was no way why it does not work for users
- it exited successfully even if invalid User-Agent value is specified
- it created file twice on `--output` option specified. It may cause an
  issue when some file watcher (e.g. FsEvents on macOS) is watching

Improvements:
- handle errors with `Result::expect` consistently it correctly exits
  with non-zero status on error
- define `Output` enum for handling both stdout and file outputs
4 years ago
Emi Simpson 05985583f0
Switch timestamps from rfc822 local time to iso8601 UTC 4 years ago
Emi Simpson 651fa716b4
Clean user, pass, and fragment from URL before writing 4 years ago
Emi Simpson 9be3982dc6
Added --no-context flag to disable adding context comment 4 years ago
Emi Simpson 27c9fb4cd3
Added comment indicating the context under which the page was downloaded 4 years ago
rhysd 6e99ad13e7 upgrade reqwest to v0.10.0
This will improve build time and binary size as follows:

* Before

- **Compile targets**: 220
- **Build time**: `cargo build --release  1264.95s user 39.72s system 335% cpu 6:29.14 total`
- **Binary size**: 6578568 bytes

* After

- **Compile targets**: 170
- **Build time**: `cargo build --release  1130.64s user 32.15s system 359% cpu 5:23.69 total`
- **Binary size**: 6107088 bytes

* Differences

- **Compile targets**: 1.29x smaller
- **Build time**: 1.23x faster
- **Binary size**: 1.07x smaller
4 years ago
rhysd 75fb6961ed migrate to Rust 2018 4 years ago
Sunshine bfb97bd062 add option for saving output to file 4 years ago
Emi Simpson 65d0eab793
Use a shared client initialized in main.rs 4 years ago
voila 1ff5e91087 Use HashMap as cache to minimize the number of HTTP requests (#75)
Use HashMap as cache to minimize the number of HTTP requests
5 years ago
robatipoor 2e48ea90e1 move argument parser section to args mod 5 years ago
Sunshine 0896f2e214 Properly handle 30x redirects 5 years ago
Vincent Flyson 3948ea3aa0 Improve code structure 5 years ago
Vincent Flyson eec05767cf Add support for poster attribute 5 years ago
Vincent Flyson 88a230872c Add CSP isolation, no CSS, and no iframe options 5 years ago
Vincent Flyson 02b717ae54 Add flag to ignore errors related to TLS certificates 5 years ago
Vincent Flyson 2b96f9a32a Add flag for silent mode 5 years ago
Vincent Flyson d8d6437a15
Merge branch 'master' into author-robatipoor 5 years ago
Vincent Flyson c34d77d5d8 Revamp resolve_url() and improve code format 5 years ago
Vincent Flyson 2be5b1c235 Add support for iframes 5 years ago
Vincent Flyson 13429e32d3 Allow HTTP redirects and preserve email links 5 years ago
Vincent Flyson d3497b5db1
Merge branch 'master' into author-robatipoor 5 years ago
Vincent Flyson 7e298b0b02 Add -u flag for custom User-Agent 5 years ago
Vincent Flyson 7b326ee9f5 Add robatipoor to list of authors 5 years ago