On January 10, Zhao Zhihong, a technician from the Information Institute of Lanzhou Petrochemical Automation Research Institute, came to the computer room early in the morning to carefully observe the operation of the big data cloud computing cluster
.
Since the Lanzhou Petrochemical Big Data Cloud Computing Center project was established in July 2020, Lanzhou Petrochemical has adopted the "open source + self-research" model to promote the project
.
At present, the big data cluster construction of 9 nodes in the production environment has been completed, the data integration with 14 major systems such as MES and large units has been realized, and a 4-layer Hive data warehouse model has been constructed
.
.
Since the Lanzhou Petrochemical Big Data Cloud Computing Center project was established in July 2020, Lanzhou Petrochemical has adopted the "open source + self-research" model to promote the project
.
At present, the big data cluster construction of 9 nodes in the production environment has been completed, the data integration with 14 major systems such as MES and large units has been realized, and a 4-layer Hive data warehouse model has been constructed
.
Lanzhou Petrochemical Big Data Cloud Computing Center aims to build the company's unified big data warehouse, realize the automatic collection, standardized processing and index management of important information system data, and break the bottleneck of "information island" in production and operation
.
The project is undertaken by the Information Institute of Lanzhou Petrochemical Automation Research Institute, and adopts the technical route of "open source + self-research" to support batch-stream integration, especially HDFS, Hive, HBase, Kafka, Spark, Spark Streaming, YARN, ZK, Flume , Kettle and other mature mainstream technologies in the big data technology ecosystem
.
At the same time, it has carried out independent research and development closely combined with the actual refining and chemical production and operation of the enterprise, and developed a big data management and control platform through integrated packaging and personalized customization
.
At present, the big data cluster involves production, operation, equipment, safety, environmental protection, etc.
, and has provided data computing services for production decision analysis platforms, production process intelligent management platforms, mobile application halls and other systems
.
.
The project is undertaken by the Information Institute of Lanzhou Petrochemical Automation Research Institute, and adopts the technical route of "open source + self-research" to support batch-stream integration, especially HDFS, Hive, HBase, Kafka, Spark, Spark Streaming, YARN, ZK, Flume , Kettle and other mature mainstream technologies in the big data technology ecosystem
.
At the same time, it has carried out independent research and development closely combined with the actual refining and chemical production and operation of the enterprise, and developed a big data management and control platform through integrated packaging and personalized customization
.
At present, the big data cluster involves production, operation, equipment, safety, environmental protection, etc.
, and has provided data computing services for production decision analysis platforms, production process intelligent management platforms, mobile application halls and other systems
.
While promoting the project, the project team of the Big Data Cloud Computing Center of the Information Institute of Lanzhou Petrochemical Automation Research Institute has applied a large number of mainstream big data technology frameworks and trained a group of engineers who master big data development, management and operation and maintenance technologies
.
In the company's digital transformation pilot demonstration project - Yulin Ethane to Ethylene Project, they undertook the important task of building three basic platforms of data lake, cloud computing and big data, ensuring the smooth progress of the work at each node
.
The digital transformation platform group of Yulin Ethane to Ethylene Project has successfully completed the overall architecture design, scheme comparison, hardware selection and configuration, preliminary design, detailed design, etc.
, laying a good foundation for the company to build a big data cloud computing center.
At present, the company We are making every effort to promote the construction of the environment
.
.
In the company's digital transformation pilot demonstration project - Yulin Ethane to Ethylene Project, they undertook the important task of building three basic platforms of data lake, cloud computing and big data, ensuring the smooth progress of the work at each node
.
The digital transformation platform group of Yulin Ethane to Ethylene Project has successfully completed the overall architecture design, scheme comparison, hardware selection and configuration, preliminary design, detailed design, etc.
, laying a good foundation for the company to build a big data cloud computing center.
At present, the company We are making every effort to promote the construction of the environment
.
"Accelerate the construction of digital transformation pilot demonstration projects.
On the basis of the existing background management functions, key development projects will start new service functions such as data catalog, data map, and data index search
.
At the same time, the platform data service interface will be opened to provide technical personnel with complete The big data technology research and development experimental platform provides big data support for the high-quality development of enterprises
.
" said Zhang Min, president of Lanzhou Petrochemical Automation Research Institute and deputy secretary of the party committee
.
On the basis of the existing background management functions, key development projects will start new service functions such as data catalog, data map, and data index search
.
At the same time, the platform data service interface will be opened to provide technical personnel with complete The big data technology research and development experimental platform provides big data support for the high-quality development of enterprises
.
" said Zhang Min, president of Lanzhou Petrochemical Automation Research Institute and deputy secretary of the party committee
.
