大数据处理架构介绍

COTS Apps
Develop Apps
External Apps
COTS Component
5
16 May 2016
传统数据仓库的数据处理技术-业务定义
End User Environment Clients Employees
Report Creation and Delivery Regional Deployment Report Access Report Management Code for Static Reports Ad-hoc Reporting Data Analysis & Forecast
Reporting Repositories Vertical Reporting Repositories Reporting DW
GDCPM
B1DM
Capacity Management (Americas / EMEA)
B2DM
CRDW CRDW DW Service Management, AvM / CpM / SLM (Regional DeFra Baidu bibliotekloyment) Base Services
SLM
Uplift Services
Data Collection, Extraction, and Transportation
ESM
External and Internal Data Sources
Service Lines Developed Component External Component
数据处理方法和实践同样适用于数据平 台数据处理
传统数据仓库的数据处理技术-概念定义
Client Employees / Employee Portal Identity and Access Management
Reporting Functions Interactive Report Handling Report Management Report Creation Ad-hoc Reporting Data analysis and Forecast
Identity & Access Mgmt Users, roles, etc.
On-boarding Tools (*)
On-boarding Tools (*)
Config , RM Tree Structure , etc .
+ SLM Reports + Data for analysis
Support Operations SL personnel
User authentication data
On -boarding Team
Business Objects Enterprise
Report Management and Delivery User authorization data Interactive Reports Static Reports Ad-hoc Data Reporting Analysis Create / Manage / Deliver Reports Reporting Data Warehouse file DRS Base Services (CpM , SLM) Data Model Lvl 0 Lvl 1 Lvl 2 DRS Create / Update Facts / Dimensions file Erwin SLM Adapter
Security (Antivirus/Patch Compliance)
Managed Web Services
6
16 May 2016
传统数据仓库的数据处理技术-逻辑定义
Other ITO Reports PDF, DOC , XLS Static Reports End User Environment Clients Employees
Performance Data Oblicore Data Model Reporting Solution SLM Uplift Services
Other Repositories
Uplift
Base Service Management , AvM / CpM / SLM (Regional Deployment )
Reporting Repositories
GDCPM Capacity Management (Americas / EMEA)
Service Operations Management Service Request Management Configuration Management Asset Management Service Desk Management
Objects of Management (Data Sources)
Oblicore Reporting Data warehouse (DW Service Level Management )
Remote Data Extraction Transfer (DRS)
ETL
Data Collection and Transportation
Service Management
大数据处理架构介绍
大数据处理架构介绍
1. 传统数据仓库的数据处理技术及思考
2. 大数据环境下对于公共数据及行为数据的数据 处理技术 3. 由传统数据仓库到大数据数据仓库的数据处理
实践思考及建议
传统数据仓库的数据处理技术
传统数据仓库的数据处理技术是什么？ 从我参与某大型数据仓库项目经历为例来分享： 该过程涵盖传统数据仓库的标准流程和 数据处理规范
Performance Data : Infrastructure
Utility Computing Server Network Storage Backup Databases (AIS)
Performance Data : Software and Services
ERP Messaging Web / App Servers Web Chat Telephony Customer Satisfaction Call Management Knowledge Management