某电视台智能监管平台设计
合集下载
- 1、下载文档前请自行甄别文档内容的完整性，平台不提供额外的编辑、内容补充、找答案等附加服务。
- 2、"仅部分预览"的文档,不可在线预览部分如存在完整性等问题,可反馈申请退款(可完整预览的文档不适用该条件!)。
- 3、如文档侵犯您的权益，请联系客服反馈,我们会尽快为您处理(人工客服工作时间：9:00-18:30)。
某电视台智能监管平台设计
基于Hadoop的某电视台智能监管平台 摘要 电视台随着高清和4K技术的进展，大量的视频数据需要存储、备份、管理以及提供节目制进行检索和下载，老的技术平台难已满足爆发式的需求，面对慢慢增加的数据量及越来越严峻的网络安全问题，能够实现容灾容错目的，数据保存、管理等技术就必需搭建新的播出管理系统。传统数据备份及管理都是利用单一存储介质实现的，此种方法实现的较为简洁，本钱比较低，但是缺乏较高的安全性及扩展性。目前进展的分布式技术能够实现数据分布式存储和运算，Hadoop技术属于分布式技术代表，其具备分布式文件系统，能够充分使用节点资源，具备多副本特性和良好的扩展性、安全性及效率。所以，基于数据存储、备份及管理的安全性和效率需求，能够通过Hadoop技术实现数据管理，搭建基于分布式技术的智能监管平台。本文主要工作如下：一是调研hadoop和MapReduce的大数据处理机制和原理，结合虚拟机部署大量的终端。二是分析电视播出各业务的实际需求，以安全快速为目标，能够提供数据的安全检索等功能。三是分析数据处理过程中的异样状况并且和原来老的系统进行比较，观看性能和效率是否得到提高。
本文所设计的智能监管平台在数据备份过程中具有较高的安全性、统一性及整体性，还能够恢复数据。在支配资源过程中具有优先级，并且实现数据恢复操作。和传统系统对比，基于Hadoop技术的智能监管平台具有较高的络安全管理；
管理系统 Abstract TV stations with the development of high-definition and 4K technology, a large number of video data needs to be stored, backed up, managed and provided by program makers for retrieval and downloading, the old technology platform has been difficult to meet the needs of explosive, in the face of increasing data volume and increasingly serious network security problems, can achieve disaster tolerance fault-tolerant purposes, data preservation, Management and other technologies will have to build a new broadcast management system. Traditional data backupand management are realized by using a single storage medium, which is simple to implement and has low cost, but lacks high security and extensibility. At present, the developed distributed technology can realize data distributed storage and operation, Hadoop technology belongs to distributed technology representative, it has distributed file system, can fully use node resources, with multi-replica characteristics and good scalability, security and efficiency. Therefore, based on the security and efficiency requirements of data storage, backup and management, we can realize data management through HADOOP technology and build an intelligent supervision platform based on distributed technology. The main work of this paper is as follows: first, to investigate the large data processing mechanism and principle of Hadoop and MapReduce, and to deploy a large number of terminals in combination with virtual machines. The second is to analyze the actual needs of television broadcast business, with the goal of safe and fast, to provide data security retrieval and other functions. Third, analyze the abnormal situation in the data processing process and compare it with the old system to see if the performance and efficiency are improved. The intelligent supervision platform designed in this paper has high security, unity and integrity in the process of data backup, and can also recover data. Prioritize in the allocation of resources and implement data recovery operations. Compared with traditional systems, the intelligent regulatory platform based on HADOOP technology has high efficiency and security. Keywords: Hadoop technology; computer network; network security management; management system 名目 摘要 1 Abstract 2 第一章 绪论 5 1.1商量背景 5 1.2 商量现状 5 1.3 论文主要工作 6 1.4商量内容 6 第二章 关键技术分析 8 2.1 Hadoop云计算平台 8 2.2 HDFS文件操作 8 2.3 HDFS身份认证技术 9 2.4 MapReduce介绍 10 2.5 Hive数据库工具 11 2.6 Hbase开源数据库 12 第三章 计算机网络安全管理系统需求分析 14 3.1 项目概述 14 3.2 系统的需求分析 15 3.2.1 系统的主要功能需求 15 3.2.2系统的非功能性需求 17 第四章 智能监管平台的设计 19 4.1系统的功能架构设计 19 4.2系统的硬件结构设计 20 4.3系统的功能模块设计 21 4.3.1通信模块 21 4.3.2设备管理模块 22 4.3.3事件处理模块 23 4.3.4安全评估模块 24 4.3.5数据备份模块 26 4.4系统的数据备份设计 27 4.4.1用户认证模块 28 4.4.2策略配置模块 29 4.4.3数据备份模块 30 4.5系统的数据恢复设计 31 4.5.1身份认证模块 32 4.5.2数据恢复策略配置模块 32 4.5.3数据恢复模块 32 4.6一次性口令身份认证设计 34 4.6.1符号和标识 35 4.6.2注册过程 35 4.6.3认证过程 35 4.6.4修改口令过程 36 4.6.5方案的安全性 37 第五章 系统的实现和测试 38 5.1 系统主要功能的实现 38 5.1.1 通信模块的实现 38 5.1.2 设备管理模块的实现 39 5.1.3 事件处理模块的实现 40 5.1.4 安全评估模块的实现 40 5.1.5 数据备份模块的实现 41 5.1.6 桌面虚拟化的实现 42 5.2 系统的测试 44 5.2.1 系统部分功能测试 44 5.2.2 系统性能测试 46 5.2.3安全评估 47 第六章
基于Hadoop的某电视台智能监管平台 摘要 电视台随着高清和4K技术的进展，大量的视频数据需要存储、备份、管理以及提供节目制进行检索和下载，老的技术平台难已满足爆发式的需求，面对慢慢增加的数据量及越来越严峻的网络安全问题，能够实现容灾容错目的，数据保存、管理等技术就必需搭建新的播出管理系统。传统数据备份及管理都是利用单一存储介质实现的，此种方法实现的较为简洁，本钱比较低，但是缺乏较高的安全性及扩展性。目前进展的分布式技术能够实现数据分布式存储和运算，Hadoop技术属于分布式技术代表，其具备分布式文件系统，能够充分使用节点资源，具备多副本特性和良好的扩展性、安全性及效率。所以，基于数据存储、备份及管理的安全性和效率需求，能够通过Hadoop技术实现数据管理，搭建基于分布式技术的智能监管平台。本文主要工作如下：一是调研hadoop和MapReduce的大数据处理机制和原理，结合虚拟机部署大量的终端。二是分析电视播出各业务的实际需求，以安全快速为目标，能够提供数据的安全检索等功能。三是分析数据处理过程中的异样状况并且和原来老的系统进行比较，观看性能和效率是否得到提高。
本文所设计的智能监管平台在数据备份过程中具有较高的安全性、统一性及整体性，还能够恢复数据。在支配资源过程中具有优先级，并且实现数据恢复操作。和传统系统对比，基于Hadoop技术的智能监管平台具有较高的络安全管理；
管理系统 Abstract TV stations with the development of high-definition and 4K technology, a large number of video data needs to be stored, backed up, managed and provided by program makers for retrieval and downloading, the old technology platform has been difficult to meet the needs of explosive, in the face of increasing data volume and increasingly serious network security problems, can achieve disaster tolerance fault-tolerant purposes, data preservation, Management and other technologies will have to build a new broadcast management system. Traditional data backupand management are realized by using a single storage medium, which is simple to implement and has low cost, but lacks high security and extensibility. At present, the developed distributed technology can realize data distributed storage and operation, Hadoop technology belongs to distributed technology representative, it has distributed file system, can fully use node resources, with multi-replica characteristics and good scalability, security and efficiency. Therefore, based on the security and efficiency requirements of data storage, backup and management, we can realize data management through HADOOP technology and build an intelligent supervision platform based on distributed technology. The main work of this paper is as follows: first, to investigate the large data processing mechanism and principle of Hadoop and MapReduce, and to deploy a large number of terminals in combination with virtual machines. The second is to analyze the actual needs of television broadcast business, with the goal of safe and fast, to provide data security retrieval and other functions. Third, analyze the abnormal situation in the data processing process and compare it with the old system to see if the performance and efficiency are improved. The intelligent supervision platform designed in this paper has high security, unity and integrity in the process of data backup, and can also recover data. Prioritize in the allocation of resources and implement data recovery operations. Compared with traditional systems, the intelligent regulatory platform based on HADOOP technology has high efficiency and security. Keywords: Hadoop technology; computer network; network security management; management system 名目 摘要 1 Abstract 2 第一章 绪论 5 1.1商量背景 5 1.2 商量现状 5 1.3 论文主要工作 6 1.4商量内容 6 第二章 关键技术分析 8 2.1 Hadoop云计算平台 8 2.2 HDFS文件操作 8 2.3 HDFS身份认证技术 9 2.4 MapReduce介绍 10 2.5 Hive数据库工具 11 2.6 Hbase开源数据库 12 第三章 计算机网络安全管理系统需求分析 14 3.1 项目概述 14 3.2 系统的需求分析 15 3.2.1 系统的主要功能需求 15 3.2.2系统的非功能性需求 17 第四章 智能监管平台的设计 19 4.1系统的功能架构设计 19 4.2系统的硬件结构设计 20 4.3系统的功能模块设计 21 4.3.1通信模块 21 4.3.2设备管理模块 22 4.3.3事件处理模块 23 4.3.4安全评估模块 24 4.3.5数据备份模块 26 4.4系统的数据备份设计 27 4.4.1用户认证模块 28 4.4.2策略配置模块 29 4.4.3数据备份模块 30 4.5系统的数据恢复设计 31 4.5.1身份认证模块 32 4.5.2数据恢复策略配置模块 32 4.5.3数据恢复模块 32 4.6一次性口令身份认证设计 34 4.6.1符号和标识 35 4.6.2注册过程 35 4.6.3认证过程 35 4.6.4修改口令过程 36 4.6.5方案的安全性 37 第五章 系统的实现和测试 38 5.1 系统主要功能的实现 38 5.1.1 通信模块的实现 38 5.1.2 设备管理模块的实现 39 5.1.3 事件处理模块的实现 40 5.1.4 安全评估模块的实现 40 5.1.5 数据备份模块的实现 41 5.1.6 桌面虚拟化的实现 42 5.2 系统的测试 44 5.2.1 系统部分功能测试 44 5.2.2 系统性能测试 46 5.2.3安全评估 47 第六章