Wyniki wyszukiwania - BazTech

Ograniczanie wyników

1 Journal of Telecommunications and Information Technology

1 2014

Znaleziono wyników: 1

Liczba wyników na stronie

Wyniki wyszukiwania

Wyszukiwano:
w słowach kluczowych: distributed Web crawling framework

Sortuj według:

Ogranicz wyniki do:

Cassiopeia – Towards a Distributed and Composable Crawling Platform

Siwik L., Marcjan R., Włodarczyk K.

Journal of Telecommunications and Information Technology

2014

nr 2

79--89

When it comes to designing and implementing crawling systems or Internet robots, it is of the utmost importance to first address efficiency and scalability issues (from a technical and architectural point of view), due to the enormous size and unimaginable structural complexity of the World Wide Web. There are, however, a significant number of users for whom flexibility and ease of execution are as important as efficiency. Running, defining, and composing Internet robots and crawlers according to dynamically-changing requirements and use-cases in the easiest possible way (e.g. in a graphical, drag & drop manner) is necessary especially for criminal analysts. The goal of this paper is to present the idea, design, crucial architectural elements, Proof-of-Concept (PoC) implementation, and preliminary experimental assessment of Cassiopeia framework, i.e. an all-in-one studio addressing both of the above-mentioned aspects.