Get HTML - Technical Specification

A number of objects will be built to support this sub-system. Some objects are related to the location of the target web-site and auditing the fetch and parse process, and these are better placed in the CTL schema. The other objects, which hold and carry actual data are placed in the STA schema because these activities are all about staging the web-page into the data warehouse.

CTL:

• Tables
• HTML_PAGE_ACCESS
  
• HTML_PARSE_PASSES
• Data
• MAPPING_LIBRARIES
• Processes
• CTL_GET_HTML
  

STA:

• Tables
• HTML_PAGES
• HTML_SPECIAL_ENTITY_CODES
  
• HTML_TAGS
• RAW_HTML
  
• PARSED_HTML
• Data
• HTML_SPECIAL_ENTITY_CODES
  
• Processes
• GET_HTML