Convert email newsletters into Atom feeds
Go to file
Nehal Patel 954dee9489 Add .dockerignore 2021-10-07 01:08:35 -05:00
.github 2021-09-04 13:36:10 +01:00
deployment-example 2021-03-18 14:30:22 +00:00
public 2021-09-06 17:30:26 +01:00
source Prevent ts-node from being reinstalled on launch of Dockerfile 2021-10-06 01:15:36 -05:00
.dockerignore Add .dockerignore 2021-10-07 01:08:35 -05:00
.gitignore 2021-09-04 13:26:26 +01:00
CODE_OF_CONDUCT.md . 2020-03-17 21:05:16 -04:00
Dockerfile Update data volume path in Dockerfile 2021-10-07 00:39:06 -05:00
LICENSE . 2021-01-01 18:46:25 +00:00
README.md 2021-03-29 22:49:48 +01:00
package-lock.json Update package-lock.json 2021-10-07 00:26:20 -05:00
package.json Use node instead of ts-node as Dockerfile entrypoint 2021-10-07 00:25:32 -05:00
tsconfig.json 2021-09-04 13:26:26 +01:00

README.md

Kill the Newsletter!

Convert email newsletters into Atom feeds

Source Package Continuous Integration

Support

Patreon (recurring) · PayPal (one-time)

Videos

Use the Hosted Version

The simplest way to use Kill the Newsletter! is with the hosted version at https://kill-the-newsletter.com.

Kill the Newsletter! is and will always be free; you dont have to create an account; and I dont collect your data or share it with anyone.

Self-Host

You may run Kill the Newsletter! on your own servers if you wish. This guarantees the utmost privacy, and its also a fun system adminstration project. Kill the Newsletter! strikes a good balance between being relatively easy to self-host and being non-trivial at the same time, because it is a web application as well as an email server.

Test on Your Machine

The best way to start self-hosting is to test Kill the Newsletter! on your machine. You cant really use Kill the Newsletter! if its running on your machine because Kill the Newsletter!s email server must be accessible from the internet to receive email and most likely your internet service provider blocks this kind of connection to prevent spam. Still, this is a good first step to get your feet wet by downloading and running Kill the Newsletter! for the first time.

Download the latest release and give it a try. You may send test emails using curl by creating a file like the following:

email.txt

From: Publisher <publisher@example.com>
To: ru9rmeebswmcy7wx@localhost
Subject: Test email with HTML
Date: Sat, 13 Mar 2021 11:30:40

<p>Some HTML</p>

And then running the following command:

$ curl smtp://localhost:2525 --mail-from publisher@example.com --mail-rcpt ru9rmeebswmcy7wx@localhost --upload-file email.txt

Remember to change the ru9rmeebswmcy7wx in the example above to the appropriate email address for your Kill the Newsletter! test inbox.

Pre-Requisites

To install Kill the Newsletter! on your own server youll need:

  1. A domain (for example, kill-the-newsletter.com). I buy domains at Namecheap.

  2. A DNS server. I use the DNS server that comes with the domain I bought at Namecheap (and they even provide free DNS service for domains bought elsewhere).

  3. A server. I rent a $6/month DigitalOcean droplet created with the following configuration:

    Distributions Ubuntu 20.04 (LTS)
    Plan Share CPU · Regular Intel · $5/mo
    Datacenter region I use New York 1, but you should use whatever is closest to you
    Additional options IPv6 & Monitoring
    Authentication SSH keys
    Hostname Your domain, for example, kill-the-newsletter.com
    Backups Enabled (thats what makes the $5/month plan actually cost $6/month)

    I also like to assign the droplet a Floating IP because it allows me to destroy and create droplets without having to change the DNS and wait for the DNS propagation to happen.

    This is the cheapest DigitalOcean offering, and yet it has managed Kill the Newsletter!s traffic for years, even when it occasionally receives extra attention, for example, when it makes the front page of HackerNews.

DNS Configuration

This is where you associate domains to servers. For example, you associate kill-the-newsletter.com to the DigitalOcean droplet on which Kill the Newsletter! runs.

Type Host Value
A @ The (Floating) IP address of the server
Alias www Your domain, for example, kill-the-newsletter.com
MX @ Your domain, for example, kill-the-newsletter.com

Download Kill the Newsletter!

SSH into the server and download Kill the Newsletter!:

[your machine] $ ssh root@kill-the-newsletter.com
[the server] # mkdir kill-the-newsletter && cd kill-the-newsletter
[the server] # curl -O https://github.com/leafac/kill-the-newsletter/releases/download/<version>/kill-the-newsletter--linux--<version>.tgz
[the server] # tar -xzf kill-the-newsletter--linux--<version>.tgz

Create configuration.js

You may adapt deployment-example/configuration.js, which is the configuration running at https://kill-the-newsletter.com. In particular, you must change the following lines:

// ...

webApplication.set("url", "https://kill-the-newsletter.com");
webApplication.set("email", "smtp://kill-the-newsletter.com");
webApplication.set("administrator", "mailto:kill-the-newsletter@leafac.com");

// ...

domains: ["kill-the-newsletter.com", "www.kill-the-newsletter.com"],

// ...

Try Running the Server

At this point youre ready to run Kill the Newsletter! for real:

[the server] # ./kill-the-newsletter configuration.js

Kill the Newsletter! starts a web server and an email server. They include everything you need to run securely in production, including support for HTTPS.

Isnt running the service as root a bad idea?

This practice is frowned upon, but it may be okay in some cases (thats how Ive been running https://kill-the-newsletter.com for years). If the only thing of value on a machine is Kill the Newsletter!, then what would you be protecting by running the service as a unprivileged user? The most important things is the data, but that should be accessible from the unprivileged user anyway. I prefer to treat the machine as disposable and run the service as root—its as simple as it gets.

Install Kill the Newsletter! as a systemd Service

This ensures that Kill the Newsletter! is always running. If it hits an error and halts, systemd restarts it. If the machine reboots, systemd starts Kill the Newsletter! again.

First, stop the server you ran in the previous step.

Then, create a file at /etc/systemd/system/kill-the-newsletter.service with the contents from deployment-example/kill-the-newsletter.service.

Finally, run the following commands:

[the server] # systemctl daemon-reload
[the server] # systemctl enable kill-the-newsletter
[the server] # systemctl restart kill-the-newsletter

You may log out of the server and start enjoying your own Kill the Newsletter! installation.

Maintenance

All the data is stored under the data directory as a SQLite database. If you every have to migrate to a different server, just take the data directory with you.

To update, just download and extract a newer release, and then restart the service with the following command:

[the server] # systemctl restart kill-the-newsletter

Advanced

Other Operating Systems

The guide above covers the basics of running Kill the Newsletter! on a Linux server, which is the most common way of deploying web services, but there are executables for Windows and macOS as well. The process is similar up to the point of installing Kill the Newsletter! as a systemd service, because other operating systems use other process managers.

Other Configuration

The configuration.js file is a JavaScript module that must return a function to be called by the kill-the-newsletter executable. Typically this configuration will start the servers (web and email) for Kill the Newsletter!, but it may do anything you wish. The kill-the-newsletter executable simply calls the configuration.js file and passes a require() function from the perspective of Kill the Newsletter! itself. You may require(".") to get a hold of the killTheNewsletter() function, which produces the webApplication and the emailApplication. You may also require() any of the Kill the Newsletter! production dependencies listed in package.json.

Migration

If you installed Kill the Newsletter! before 2021-03-18 then you need to start from scratch because the deployment process changed (its much simpler now!). You may migrate existing feeds with the migration tools found in the v1.0.1 release or the migration tag. Just make a backup of your feeds/ directory, download the migration executable, and run it from the directory containing feeds/. Itll produce a data/ directory with the data in the new format.

Using the kill-the-newsletter npm Package

For people familiar with TypeScript/JavaScript, Kill the Newsletter! is also distributed as an npm package. You may run it with npx kill-the-newsletter, or npm install kill-the-newsletter into your project to import or require it and mount it as part of a bigger Express application.