#

crawler-testing

Here are 11 public repositories matching this topic...

BaseMax / StackoverflowCrawler

A web crawler which crawls the stackoverflow website.

Updated Aug 4, 2019
Python

backlink-generator-tool / html-autosurf-iframe-loader

JavaScript-based autosurf tool that loads and rotates local HTML pages in 5 iframes, ideal for automated browsing, SEO backlink testing, and traffic generation bots.

javascript frontend single-page-app load-testing browser-automation web-automation traffic-simulation browser-based crawler-testing page-rotator autosurf bot-simulation html-automation html-automation-tool iframe-rotator client-side-tool autosurfiframe-rotator

Updated Oct 21, 2025
HTML

BaseMax / FakeFaces

This repository contains a crawler that downloads thousands of fake human face images from various sources on the internet. Additionally, the repository includes a dataset of thousands of face images of fake humans.

php crawler curl dataset face php-curl datasets crawlers faces crawler-testing fake-faces crawler-php fake-face face-fake

Updated Mar 17, 2023
PHP

MaxValue / IsJavascriptWorking

test if your damn browser has JS enabled

javascript scrapy-spider scrapy testing-tools web-tool javascript-tools scrapy-crawler browser-testing web-test scrapy-splash crawler-testing scraping-resources scraping-tool scraping-test

Updated Feb 14, 2023
HTML

BaseMax / RondIrCrawler

A crawler for extracting a list of top sim cards and tel numbers from the Rond.ir website. (PHP)

php crawler crawlers php-crawler crawler-testing crawle-php crawlers-php rondir

Updated Oct 7, 2022
PHP

BaseMax / DoostihaaCrawler

A PHP-implemented crawler for Doostihaa.com. (Database of thousands of movies)

php crawler movies movie movie-database-api movie-database crawlers php-crawler movie-db movie-database-website crawler-testing crawler-php movies-database crawler-example doostihaa doostihaa-com database-movie database-movies

Updated Nov 14, 2022
PHP

pete911 / blackhole

simple webserver generating random links

go golang spider-test spider-trap bot-testing crawler-testing

Updated Dec 19, 2025
Go

BaseMax / crawler-news-currency-gold-coins

PHP Crawler to get Persian news related to currency coin and gold.

php crawler currency currency-exchange-rates gold php-crawler crawler-testing crawler-php

Updated Mar 12, 2021
PHP

ihgazni / navegador5

toolsets for web crawler

http-requests crawler-testing

Updated Feb 4, 2019
Python

rivside / study

my first repository

crawler-testing

Updated Dec 28, 2018

NelcifranMagalhaes / WebCrawlerRuby

A web crawler of Quotes in site http://quotes.toscrape.com/

ruby webcrawler crawler-testing

Updated Jan 3, 2023
Ruby

Improve this page

Add a description, image, and links to the crawler-testing topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the crawler-testing topic, visit your repo's landing page and select "manage topics."