Create Page Collector

Create Page Collector

The DigitalStakeout Page Collector provides the ability for you to pull Content from a URL on a recurring frequency supported in your plan.

Navigate to the Setup Page, Select Data Aggregation Tab, Click Add Monitor.
  1. When the "Create Page Monitor" menu appears, adjust the fields.
  2. The Name field is mandatory. Name the monitor whatever you like as long as it's at least three characters.
  3. The URL field is also mandatory. Select "Add" after each entry.  You may add up to 20 URLs for this monitor.
  4. The "Follow Links" field will be defaulted to do not follow.  If you wish to have the ability to follow links in the information obtained by the page collector, change this drop-down box to "follow." The Page Collector will recursively follow each URL in the page AND collect content from the followed pages.
  5. To control/limit Follow Links, you can add regex to the "Include Path" field.  For example, if you are monitoring https://www.example.com/test.html and want to limit follow crawling to example.com, you would add the regex: /example\.com/i
  6. When you are finished, select "Save."

TERMS OF SERVICE ON USING THE PAGE COLLECTOR

You shall use the Page Monitor solely for the purposes of the detection of data from publicly accessible websites. In all cases where copyrighted data may be included as part or all of the detected data, you shall comply with all copyright laws and rules covering such data including (but not limited to) the reproduction and resale of such data. You represent, warrant and undertake to DigitalStakeout on a continuous basis throughout your use of Page Monitor that the monitor you configure will be used legally and ethically and that you will obtain all permissions necessary for you to use it on the targeted data source DigitalStakeout Inc. shall have no liability (in contract, tort (including without limitation, negligence or otherwise) for any Loss suffered or incurred by you arising out of or in connection with any dispute between you and any website which you use Page Monitor, from which you extract data or from which you copy data. In the event of any such dispute, you release DigitalStakeout Inc. (and its officers, directors, agents, subsidiaries, joint ventures and employees) from any and all claims, Losses, demands and damages (actual and consequential) of every kind and nature, known and unknown, suspected and unsuspected, disclosed and undisclosed, arising out of or in any way connected with such disputes. DigitalStakeout accepts no liability or responsibility for any use which may be made by you (or any third party authorized by you) of any of aspect of Page Monitor.



 
 


    Need help with this?

    The DigitalStakeout team is happy to help! To request assistance, open a ticket .




      • Related Articles

      • Create a Webhook Collector

        Using this Collector you can input single or multi-line events over https into DigitalStakeout. Applications can send an HTTP request to the DigitalStakeout endpoint and DigitalStakeout will convert it into an event for subsequent processing. This ...

      • Create Email Collector

        Create Email Collector The DigitalStakeout Email Collector provides the ability for you to send or forward emails to Scout for collection and analysis. You can use this monitor to collect important emails from your organization. Customers also use ...

      • Create an RSS Collector

        RSS (Really Simple Syndication) is a regularly updated XML file containing a list of newly published content from a selected website or websites that can be read by another program. The RSS Collector regularly monitors and centralizes all the feeds ...

      • Create/Edit Email Template

        Navigate to the alerts page by either selecting "create alert" from the home screen or hovering over "setup" and selecting "alerts." Just below the words "Workflow Rules" centered at the top of this screen, on the left side you will see "email ...

      • Create New User

        DigitalStakeout provides the ability to create new user accounts with varying permissions and access to the DigitalStakeout product. Note: The "Create New User" feature can only be created by users with Super User level of permissions.  The "My ...