Tag: Automation

Puppeteer tricks to write a bot/scrapper

I wrote a bot recently that does some actions after it authenticates with an account using puppeteer and it was incredibly easy.
In case you don’t know what puppeteer does, well, it is simply a Node library to control Chromium or Chrome programmatically, now such a library can have many uses but I’ll focus on what you need to know when writing a scrapper/bot.

The first thing to know is what kind of website you are dealing with, it is a traditional website or is more like a SPA type of website? And you need to know that because using the waitForNavigation is practically useless on SPA websites. View full article

Linux Folder / Folders Backup on Yandex

Ok so a little while ago I made a Linux Yandex python script for backing MySQL databases and sync them on Yandex Disk, so if I already did that I thought I should use a part of that script and make a backup script for folders.

Most of the script is self-explanatory, all you have to do is to change the variables before the starting of the class keyword for your own needs. I put some comments that will better explain what you should define in each variable. Most of them are either of type string or number, just one is a bit different is a list of x lists of a 3 element list. View full article

MySQL Backup on Yandex Disk with Cron

I wrote a very small python script that works in conjunction with another MySQL backup script to sync your backup on the Yandex disk service.

First, in order to do this, you should have a Yandex client installed. You can get the packages from the Yandex repo at http://repo.yandex.ru/yandex-disk/ .

More specific in Debian/ubuntu case just do a:

wget http://repo.yandex.ru/yandex-disk/yandex-disk_latest_amd64.deb

After that install the Yandex Console client as usual doing:

dpkg -i yandex-disk_latest_amd64.deb

After installing the package, basic Yandex commands should be available(commands like yandex-disk start, yandex-disk sync, and others).
The script uses the yandex-disk commands.

Next, you should set up your Yandex client with the command Yandex setup. View full article