Menu
It is able to save crawl data in RAM, or a database.įor crawls, under 100-200k URLs, a 64-bit OS and 8GB of RAM should be sufficient. The SEO Spider is capable of crawling millions of URLs with the correct hardware, memory, and storage.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. Archives
December 2022
Categories |