TGP Tools

Spidering and listing galleries is easy, and you provide more content to your visitors which is nice, but cheaters are pain in the ass. Due to huge AT3 database, it is not possible to check 500.000+ galleries everyday.

I created a software, which can check 10.000 galleries in a minute (300~ galleries in one second) on an empty dedicated server. Downside of this it consumes all of system resources when it runs, this results very high server loads. However, it analyzes gallery html codes, not just http status codes (200,302,404 etc) and checks for malicious code such as iframe, meta-refresh, javascript etc.

So, I decided to buy a dedicated server and provide this service remotely to AT3/AT4 users. After installion of required scripts it works very simple:
First, it downloads latest blacklist database from tgptools.com.
Second, it cleans the cheater galleries from mysql
Third, your AT3/AT4 crontab (spider, removedup, check, build etc) works as usual, but you avoid spidering and checking of cheater galleries. Once a gallery url is in blacklist, it will not be re-spidered or re-imported to your database ever. In AT4, I also write a script to clean images after new pages built (otherwise, it may result broken images while pages are building, so this is best time to clean images -after pages are built-)

Dedicated server costs money and time. Unfortunately I can not provide this service for free, but it doesn’t mean it will be expensive. It will be a monthly subscription, which will be around 100$ / year or 10$ / month. I still haven’t decided the price but I promise it will be fair.

Less cheaters = More productivity

Trackback This Post | Subscribe to the comments through RSS Feed