云上大数据解决方案

Cloud-based, Real-Time, Intelligent Analysis

•PB-level data volume •

Low latency (< 10 seconds)

•Streaming data processing •

Millisecond/second-level latency

•Machine learning •

Artificial intelligence

Real-Time Data Analysis

Converged Data Warehouse

Business Intelligence Analysis

•Ultra-Large capacity

and response within seconds •Convergent

RDBMS and Hadoop, SQL on Anywhere

•AI Inside and full data lifecycle

processing

Huawei Big Data Cloud

Data Cleaning

Data Storage

Data Analysis

Data Application

Data Collection

Direct Connect (DC)

Virtual Private Network (VPN)Data Express Service (DES)

Data Ingestion Service (DIS)Data Pipeline Service (DPS)Cloud Stream Service (CS)MapReduce Service (MRS)

Object Storage Service (OBS)

Elastic Volume Service (EVS)CloudTable

Relational Database Service

(RDS)Data Warehouse Service (DWS)

MapReduce Service (MRS)Machine Learning Service

(MLS)

USearch

UQuery Cloud Data Migration (CDM)

Artificial Intelligence (AIS)Third-party applications

…

Massive Data Flush

Overall Solution

Remarkable Effect

•Auto scaling and service continuity during capacity expansion •SQL on Anywhere , “0” data migration and conversion

•

Mobile application analysis and self-tuned SQL, reducing workloads of App developers by 30%

Big Data Cloud Practices for Huawei Consumer BG

MLS

OBS

MRS-Map Reduce

DWS

Mobile App analysis

Marketing recommendation

DCS

DIS

Operation analysis

MRS-Hase

User profile

MRS-Spark Streaming

•

Large access volume: 5 million UV per day, 10 million PV

per day, and 4.5 million orders per second at peak times

•Large data volume: 25 GB traffic at peak times

•High stability: 7*24, 100% available

•x 10 User Click Rate, x 5.6 reservation rate •

200+ million users, 8 Billion user labels

•

Negative opinion control time : 10 minutes -> 3 minutes / order

应用场景：基于云的实时海量数据智能分析

•数据量大，可达PB 量级•

时延要求高（<10秒）

•流式数据处理

•

时延要求高（毫秒、秒）

•机器学习•

人工智能

实时数据分析

融合数据仓库

商业智能分析

•容量无极限，秒级响应

•打通数仓与Hadoop ，SQL on Anywhere •整合人工智能，全数据生命周期处理

华为云上大数据

数据清洗

数据存储

数据分析

数据应用

数据采集

DC-云专线

VPN-虚拟专用

网络

DES-数据快递服务DIS-数据接入服务

DPS-数据调度服务CSS-流处理服务

MRS-MapReduce 服务

OBS-对象存储服务

EVS-云硬盘

CloudTable 服务RDS-关系型数据库

DWS-数仓服务MRS-MapReduce 服务

MLS-机器学习服务

USearch-数据搜

索服务UQuery-统一

查询CDM-云数据迁移

AIS-人工智能服务

第三方合作伙伴应用

…