How to Install, Configure and Run Flexget
Quick Reference
####PIP3 and Flexget Installation####
mkdir -p '.local/bin'
python3 <(curl https://bootstrap.pypa.io/get-pip.py) --user && pip3 install --user flexget
####change PATH="$HOME/bin:$PATH" to PATH="$HOME/bin:$HOME/.local/bin:$PATH" in .profile#####
####Configuration of Flexget (it uses YAML)####
mkdir '.config/flexget'
cd .config/flexget
nano/vim config.yml ####after editing config.yaml####
flexget check
flexget --test execute
####Running Flexget####
cron: (add own cron expressions here) /homexx/xxx/.local/bin/flexget --cron execute
daemon mode:
add schedules plugin as top level plugin
Create systemd service
####flexget-daemon.service start####
[Unit]
Description=Flexget Daemon
After=network.target
[Service]
Type=simple
ExecStart=/homexx/xxxxx/.local/bin/flexget daemon start
ExecStop=/homexx/xxxxx/.local/bin/flexget daemon stop
ExecReload=/homexx/xxxxx/.local/bin/flexget daemon reload
[Install]
WantedBy=default.target
####flexget-daemon.service end####
systemctl --user daemon-reload && systemctl --user enable --now flexget-daemon.service
Introduction
FlexGet is a multi-purpose automation tool for content like torrents, NZBS, podcasts, comics, series, movies, etc and is able to handle different kinds of sources like RSS feeds, HTML pages and CSV files.
Installation of PIP3 and Flexget
Login to your boxviaSSH.Create a folder in your slot withmkdir -p '.local/bin'. This is important because this is where PIP and subsequently any other python apps will be installed.Now, we will install PIPDo the following command to download PIP:python3 <(curlhttps://bootstrap.pypa.io/get-pip.py) --userThen open up .profile using your preferred text editor (eithernano .profileorvim .profile). In this example, we will use nano.
Save the file with CTRL + O then press Enter. Force refresh.profileby typingsource .profile. Confirm that you configured it correctly by enteringwhich pip3. It should give you the absolute path of your pip3 installation.
After that,pip3 install --user flexget(In the screenshot, you can see that most of the prerequisites are already satisfied. That'python'sbecausevirtualduring this time of writing I already installed flexget. For first time installation tho, you should see progress bars of each prerequisites.)
- To
checkinstallifflexgetyoutoinstalledyouritslot,correctly,justtype
run this command belowflexget
curl https://raw.githubusercontent.com/ultraseedbox/UltraSeedbox-Scripts/master/Flexget/flexget-installer.sh | bash
This script does the following:
- Enable pythib venv in ~/flexget
- Install and
Configuring Flexget
Create a folder withmkdir '.config/flexget'- Navigate to it with
cd .config/flexget
- Open up your fave text editor with
nano config.yml
In this part, depending on what you want to achieve your configuration may vary but take note that:
- Flexget config uses YAML. Indentation and spacing is critical so take care when writing your config.
- YAML uses spaces, not tabs.
For this example, I'll be configuring flexget to monitor RSS feeds every minute and filters out the results using regex I set. Those that are accepted in my regex will be fed directly to deluge for it to download. The config is shown below.
# Example YAML Config
tasks:
test-1:
rss:
url: https://rss.to/any/f4lt3r-h4h4
all_entries: no
regexp:
accept:
- .*1080p.*
deluge:
host: 127.0.0.1
port: 11123
username: xan
password: somepassword
label: flexget
# YAML config with explanation
tasks: # A flexget config's main component are tasks, so we start here.
test-1: # This is the first task. Here, we name our first task "test-1"
# Now, we will now add plugins. There are three main types of plugins we normally want in a task in order: an input, a filter, and an output.
rss: # This is an example of an input plugin, the first one to run in a task. This tells flexget where do you want it to look for things. In this example, we tell to look into rss feeds.
url: https://rss.to/any/f4lt3r-h4h4
all_entries: no # This entry tells flexget to have each entry only created on the first run it is seen.
regexp: # This is an example of a filter plugin. This tells flexget which of the entries the input plugin has that you want. Here, we're using the regexp plugin to filter out entries that you want using regex.
accept:
- .*1080p.* # Here, we tell flexget to accept all torrents with the word 1080p in it.
# TL;DR regex I used is .*, which matches any characters, including line breaks. I added it in the start and the end of 1080p.
# You may refer to https://regexr.com/ to help you learn and build your own regex.
deluge: # This is an output plugin. This is to tell flexget what do with those things you want. Here, I want to use Deluge as my torrent client. Before I run this tho, I need to install another instance of deluge for flexget by running pip3 install --user deluge-client. You'll only need this to communicate to your actual Deluge installation (The one you installed via UCP). Your preferred torrent client's setup may vary so you may look up to flexget's wiki for that.
host: 127.0.0.1
port: 11123
username: xan
password: somepassword
label: flexget
After that, save your work with CTRL + O, press ENTER then CTRL + X.
To check if you config is correctly formatted and configured, you may have to do the following commands:
flexget check
to check the config file for any errorsflexget --test
execute to test run your configuration.
In my example, when you run it the first time, it may grab and download multiple torrents which may affect your ratio. To save the headache:
1. Remove the output plugins from your config
2. Run flexget execute
3. After it finishes put back the output plugins.
This will save the entries accepted so it won't download again in the future.
You may refer to https://flexget.com/Configuration for more information about making your own config as well as https://flexget.com/Cookbook for some of the basic automation tasks that you can do with Flexget.
Running Flexget
Now, depending on your config you can either run it using cron or flexget's daemon mode.
Cron
- Type in your SSH window:
which flexget
. Take note of the output. This is the absolute path of flexget. Here, the absolute path is/homexx/xxx/.local/bin/flexget
- Then type
crontab -e
. If it's your first time running this command, there would be an option asking for your text editor. Select the editor you want but I would suggest selecting 1
- Since I want it to run every minute, I set it as
* * * * *
then the absolute path of flexget, which is/homexx/xxx/.local/bin/flexget
. Then the arguments of flexget which is--cron execute
. If we put it together, we get* * * * * /homexx/xxx/.local/bin/flexget --cron execute
You may refer to https://crontab.guru/ which is an quick and simple editor for cron schedule expressions.
- If you don't want cron to message you whenever there's an error in flexget (which happens quite alot) and will flood your SSH inbox (accessible by typing
mail
in ssh), append> /dev/null 2>&1
right after execute
- Save your work with CTRL + O, press ENTER then CTRL + X
Systemd/Daemon mode
For more information, please refer to https://flexget.com/Plugins/Daemon/scheduler. For running your own systemd services, refer to How to run your own services with systemd
- Open up your flexget config and add the scheduler plugin before tasks
#YAML config with Scheduler Plugin
schedules:
- tasks: [list, of, tasks]
schedule:
minute: X
hour: X
day: X
day_of_week: X
week: X
month: X
year: X
tasks:
test-1:
rss:
url: https://rss.to/any/f4lt3r-h4h4
all_entries: no
regexp:
accept:
- .*1080p.*
deluge:
host: 127.0.0.1
port: 11123
username: xan
password: somepassword
label: flexget
- Say, I want to run test-1 at 22:05, 22:45, 23:05, 23:45 everyday and test-2 every minute, you'll set it as it is below.
- Take note that the scheduler plugin also supports cron expressions.
schedules:
- tasks: [test-1]
schedule:
minute: 5,45
hour: 22,23
- tasks: [test-2]
interval:
minute: 1
tasks:
test-1:
rss:
url: https://rss.to/any/f4lt3r-h4h4
all_entries: no
regexp:
accept:
- .*1080p.*
deluge:
host: 127.0.0.1
port: 11123
username: xan
password: somepassword
label: flexget
test-2:
rss:
url: https://rss.to/any/s4h3rz-d1cz
all_entries: no
regexp:
accept:
- .*2160p.*
deluge:
host: 127.0.0.1
port: 11123
username: xan
password: somepassword
label: flexget
- Save your work with CTRL + O, press ENTER then CTRL + X
- Then navigate to
/homexx/xxxxx/.config/systemd/user/
by typingcd /homexx/xxxxx/.config/systemd/user/
- Create a service file (
nano flexget-daemon.service
) and add the following:
[Unit]
Description=Flexget Daemon
After=network.target
[Service]
Type=simple
ExecStart=/homexx/xxxxx/.local/bin/flexget daemon start
ExecStop=/homexx/xxxxx/.local/bin/flexget daemon stop
ExecReload=/homexx/xxxxx/.local/bin/flexget daemon reload
[Install]
WantedBy=default.target
- Save your work with CTRL + O, press ENTER then CTRL + X
- Run
systemctl --user daemon-reload
- Run
systemctl --user enable --now flexget-daemon.service
to immediately start the daemon and to automatically restart whenever the daemon crashed or if there's a server restart, - To check if the daemon is running, run
flexget daemon status