Transactions of KarRC RAS :: Scientific publications
Transactions of KarRC RAS :: Scientific publications

Transactions of KarRC RAS :: Scientific publications
Karelian Research Centre of RAS
ISSN (print): 1997-3217
ISSN (online): 2312-4504
Transactions of KarRC RAS :: Scientific publications
Background Editorial committee Editorial Office For authors For reviewer Russian version
Transactions of KarRC RAS :: Scientific publications

Electronic Journal OJS



Series

Biogeography

Experimental Biology

Mathematical Modeling and Information Technologies

Precambrian Geology

Ecological Studies

Limnology and Oceanology

Research in the Humanities (2010-2015)

Region: Economy and Management (2012-2015)



Issues

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

1999-2008


SCIENTIFIC PUBLICATIONS
А.А. Печников, А.В. Ланкин.
Разработка программы сбора данных о структуре веб-сайтов
A.A. Pechnikov, A.V. Lankin. Development of a program for collection of website structure data // Transactions of Karelian Research Centre of Russian Academy of Science. No 8. Mathematical Modeling and Information Technologies. 2016. Pp. 81-90
Keywords: website; hyperlink; crawler; web-graph

The web graph is the most common mathematical model of a website. Constructing a web graph of a real site requires data about the structure of that site: html-pages and/or documents in the site (in particular, data about URLs of web resources) and hyperlinks linking them. Web servers often use pseudonyms and redirections. They also generate the same pages dynamically via different URL requests. This raises a problem in which there are various URLs but with the same content. Thus, we can get a web graph in which some of its vertices correspond to pages of a site with the same content. The paper describes a crawler called RCCrawler that collects information about websites to build the web graphs of these sites. This crawler largely addresses the above problem as confirmed by a series of experiments conducted
Indexed at RSCI


  Last modified: September 15, 2016