Content fetch and aggregation bot for hugo data-driven websites
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
Chakib Benziane a948d4bf69 initial 4 years ago
bitcoin initial 4 years ago
config initial 4 years ago
db initial 4 years ago
encoder initial 4 years ago
export initial 4 years ago
feeds initial 4 years ago
filters initial 4 years ago
github initial 4 years ago
handlers initial 4 years ago
logging initial 4 years ago
posts initial 4 years ago
static initial 4 years ago
types initial 4 years ago
utils initial 4 years ago
.gitignore initial 4 years ago
Dockerfile initial 4 years ago
Dockerfile-sqliteweb initial 4 years ago
Makefile initial 4 years ago
README.md initial 4 years ago
api.go initial 4 years ago
commands.go initial 4 years ago
config.toml initial 4 years ago
docker-compose.yml initial 4 years ago
docker-entrypoint.sh initial 4 years ago
feed_commands.go initial 4 years ago
go.mod initial 4 years ago
go.sum initial 4 years ago
jobs.go initial 4 years ago
main.go initial 4 years ago
parse_test.go initial 4 years ago
posts_test.go initial 4 years ago
scheduler.go initial 4 years ago
server.go initial 4 years ago

README.md

MIRRORED FROM: https://git.sp4ke.com/sp4ke/hugobot

HUGOBOT

hugobot is a an automated content fetch and aggregation bot for Hugo data driven websites. It has the following features:

Data fetch

  • Add feeds to the bot in the feeds sqlite table
  • Currently handles these types of feeds: RSS, Github Releases, Newsletters
  • Define your own feed types by implementing the JobHandler interface (see handlers/handlers.go).
  • Hugobot automatically fetch new posts from the feeds you defined
  • It runs periodically to download new posts in the defined feeds.
  • Everything is saved on an sqlite
  • The scheduler can handle any number of tasks and uses leveldb for caching/resuming jobs.

Hugo export

  • Data is automatically exported to the configured Hugo website path.
  • It can export markdwon files or json/toml data files
  • All fields in the exported files can be customized
  • You can define custom output formats by using the FormatHandler interface.

API

  • hugobot also includes a webserver API that can be used with Hugo Data Driven Mode.

  • WIP: Insert and query data

  • An example usage is the automated generation of Bitcoin addresses for new articles on bitcointechweekly.com

Sqliteweb interface

  • See Docker files