Tag Automation

Scrap / GET Contribution Table from GitHub

So when it comes to some products like Twitter & GitHub, there are ways to either access non-public APIs or minimum, to scrap info that we can't take easily with the official API.
For Twitter, I think it is more important because you can access a lot of data for free, but I'm not going into that in detail because methods still work for years. And I think people who found ways to scrape data from Twitter data with not much cost should continue. 

About GitHub, you probably know this, for i...

View full article

Puppeteer tricks to write a bot/scrapper

I wrote a bot recently that does some actions after it authenticates with an account using puppeteer and it was incredibly easy.
In case you don't know what puppeteer does, well, it is simply a Node library to control Chromium or Chrome programmatically, now such a library can have many uses but I'll focus on what you need to know when writing a scrapper/bot.

The first thing to know is what kind of website you are dealing with, it is a traditional website or is more like a SPA type of website? A...

View full article

Linux Folder / Folders Backup on Yandex

Ok so a little while ago I made a Linux Yandex python script for backing MySQL databases and sync them on Yandex Disk, so if I already did that I thought I should use a part of that script and make a backup script for folders.

Most of the script is self-explanatory, all you have to do is to change the variables before the starting of the class keyword for your own needs. I put some comments that will better explain what you should define in each variable. Most of them are either of type string ...

View full article

MySQL Backup on Yandex Disk with Cron

I wrote a very small python script that works in conjunction with another MySQL backup script to sync your backup on the Yandex disk service.

First, in order to do this, you should have a Yandex client installed. You can get the packages from the Yandex repo at http://repo.yandex.ru/yandex-disk/ .

More specific in Debian/ubuntu case just do a:

wget http://repo.yandex.ru/yandex-disk/yandex-disk_latest_amd64.deb

After that install the Yandex Console client as usual doing:

wget http://repo.yandex....
View full article