You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
Go to file
Carlo Strub 3a95f5cf1b
Use path/filepath for cleaner and safer path generation
6 years ago
docs more docs 7 years ago
sisyphus Use path/filepath for cleaner and safer path generation 6 years ago
test/Maildir Only accept large unicode characters as individual words 7 years ago
.coveralls.yml add coveralls 7 years ago
.gitignore gitignore 7 years ago
.travis.yml duplicate in travis 7 years ago
CHANGELOG.md - backup functionality 6 years ago
CODE_OF_CONDUCT.md Create CODE_OF_CONDUCT.md 7 years ago
CONTRIBUTING.md Create CONTRIBUTING.md 7 years ago
LICENSE Welcome 2018 6 years ago
Makefile add send-coverage 7 years ago
README.md Adjust README 6 years ago
appveyor.yaml add line above appveyor.yaml 7 years ago
classify.go Use path/filepath for cleaner and safer path generation 6 years ago
classify_test.go fix test 7 years ago
database.go Use path/filepath for cleaner and safer path generation 6 years ago
database_test.go make gometalinter happier 7 years ago
glide.lock glide up 6 years ago
glide.yaml Glide up 7 years ago
learn.go please gometalinter 7 years ago
learn_test.go fix tests 7 years ago
mail.go Use path/filepath for cleaner and safer path generation 6 years ago
mail_test.go improve memory footprint 7 years ago
mkdocs.yaml update initial docs 7 years ago
sisyphus_suite_test.go separate out command and package 7 years ago

README.md

Sisyphus: Intelligent Junk Mail Handler

As we all know too well, many mails we receive are undesired for various reasons. Sometimes, we just do not want to be part of a scam, sometimes we really prefer no to have this latest joke mail sent by our beloved friends -- even though we are happy to exchange serious messages with them.

Sisyphus is a junk mail handler of the latest generation. It has the following features:

  • requires zero configuration, neither on the server nor on the client
  • works with any MTA and any client
  • learns about your preferences based on all messages in your inbox and your junk folder
  • can handle multiple mail accounts with independant junk mail preferences
  • requires minimal resources, e.g. learning over 50000 mails and keeping track of roughly 90000 words requires only 10MB of storage

Build Status Go Report Card GoDoc Documentation Codebeat Coverage

How it works

Sisyphus analyzes each mail in the inbox and the junk folder and uses its subject and text to improve the learning algorithm. Whenever a new mail arrives in the Maildir/new directory, Sisyphus classifies this mail based on its content. Junk mails are then moved automatically to the Maildir/.Junk directory, while good mails are left untouched. See the following blog post on a rather non-technical explanation.

Technically, Sisyphus applies a classic Bayesian Update algorithm to classify mails. However, in contrast to many traditional junk mail filters, classification is based on all mails ever received. This includes mails that are classified by the user as junk by moving them manually into the junk folder, or mails that have been correctly classified by Sisyphus previously. This is only possible with limited resources by applying the HyperLogLog algorithm to store the learned mails.

The learned information is stored in a local database called sisyphus.db which is located in each Maildir directory.

Install

Sisyphus can be installed by downloading the released binary package.

To build from source, you can

  1. Clone this repository into $GOPATH/src/github.com/carlostrub/sisyphus and change directory into it
  2. Run make build

This will leave you with ./sisyphus in the sisyphus directory, which you can put in your $PATH. (You can also take a look at make install to install for you.)

Usage

First, set the environment variables necessary for operation:

$ setenv SISYPHUS_DIRS PATHTOMAILDIR
$ setenv SISYPHUS_DURATION 24h

or

$ export SISYPHUS_DIRS=PATHTOMAILDIR
$ export SISYPHUS_DURATION=24h

or for Windows

$ set SISYPHUS_DIRS=PATHTOMAILDIR
$ set SISYPHUS_DURATION=24h

Sisyphus help can be started by running

$ sisyphus help

To start sisyphus, do

$ sisyphus run

To display various statistics, do

$ sisyphus stats

(caveat: run at least one learning cycle)

See the help for more details.

License

Sisyphus is licensed under the 3-Clause BSD license. See the LICENSE file for detailed information.