How to check website crawling frequency How to check search frequency

How to check whether the website is crawled by Baidu Spider? Baidu's program for crawling web pages is called Baiduspider-Baiduspider. We mainly analyze the situation of the website being crawled by Baidu. Baidu spider activity in website logs: crawl frequency and returned HTTP status codes.

How to view the log:

Through FTP, find a log file in the root directory of the website. The file name usually contains log. Download and unzip the notepad inside. This is the website's log, which records the website's visits and operations.

Because the situation of each server and host is different, the content recorded by the log function of different hosts is also different, and some even have no log function.

The log content is as follows:

61.135.168.22--[January 11, 2009:04:02:450800]GET/BBS/thread-7303-1-1.htmlHTTP /1.12008450"Baiduspider(/search/spider.htm)

Analysis:

GET/bbs/thread-7303-1-1.html represents, crawl this page /bbs/ thread-7303-1-1.html.

200 means the grab is successful.

850 means 8450 bytes have been captured.

If you. The format in the log is different, indicating that the log format is different.

It can be seen in many logs that 20000 and 200064 represent normal crawling.

By looking at Baidu Spider's daily results. The crawling frequency is determined by the number of crawls in the log. There is no standard schedule or frequency number for crawling. We generally judge by comparing the logs of multiple days. Of course, we hope that the number of crawls per day by Baidu Spider is as high as possible.

How to obtain the website API interface?

About the acquisition and calling of the website API interface, it is relatively common in website development and is a necessary skill for every programmer and developer, such as Developers often encounter calls from interfaces provided by large websites such as Tencent and Sina; therefore, as a developer, you must learn to call API interfaces while writing good code. This article uses C# language to demonstrate sending text messages. API interface calls.

Tools/Materials

Computers

Methods/Steps

1. Be familiar with the concept of what an API is, that is, an application. Programming interfaces, that is, functions predefined during website development, are often referred to as open source functions. They just encapsulate some fixed programs in these functions. When they are called, they only need an excuse to reference, which is convenient and simple. It’s the same as calling the Jquery function.

2. The API interface for getting the interface address and sending SMS can be found in the open source code. You can query it directly on the open source website.

3. The analysis parameters are short. The SMS interface is different from other interfaces. The SMS interface can only be opened by local operators for a fee. Therefore, the successful return of the interface does not mean that the reception is successful. The specific reception status can only be queried by the operator. In addition, the SMS API interface itself does not limit the sending frequency. , the specific sending frequency needs to be set by the user.

4. Call the return value test. Write the calling interface in the html file, and test to see if the call results. The results and failed return parameters are shown in the figure.

5. C# access interface Enter the following code in the C# program to call the SMS interface; usingSystem; usingSystem.Collections.Generic; usingSystem.Linq; usingSystem.Text; usingSystem.Net; usingSystem.IO; usingXfrog .Net;usingSystem.Diagnostics;usingSystem.Web;As shown in the figure: (About the creation of C# programs, no further demonstration)

6. Declaring the calling space Each function needs to be declared in advance before it can be called, so, in When the program starts, you must declare the namespace namespaceConsoleAPI{}

7. Define the request method. The calling methods of the program are generally Post and Get, so you must declare what call to use. Regarding the difference between Post and Get, this article No emphasis is given here.

8. After creating the request function and declaring the request method, you can create the request function, including sending language, delayed response and other parameters

9. After setting the relevant parameters for request parameters and text conversion , convert the program encoding into text encoding, so that the receiver can display the text normally, otherwise it is a piece of code that is incomprehensible to outsiders, so the data stream must be converted into a text object.

10. When releasing resources and testing the written program call, no matter what program it is, the program must be released after the call is completed, otherwise it will continue to occupy resources and consume memory.

How to load frequencies in ansys spectral analysis?

The unit of frequency is of course Hertz or multiples of magnitude. The frequency obtained after ANSYS modal analysis is generally the frequency from 1st to Nth order, the natural frequency. Of course, frequencies of any order can be extracted at will and combined in any way. The natural frequency of an object, according to the description of vibrationology, is mainly contributed by low-order frequencies. As for how to check, you need to look at the post-processor, where there is a display.

Make a spreadsheet excelvba to obtain web page data in real time?

Excel interface operations: Data - Import external data - New Web query: Enter the URL in the address bar of the interface that appears, and then select the data range that needs to be updated - Import - Select the cell where the data is placed (Modify properties if necessary, such as refresh frequency, etc.) - OK. In this way, when the data on the web page changes, the data in the Excel table will also change. If you must use VBA, just use recorded macros and make slight modifications.