echemi logo
Product
  • Product
  • Supplier
  • Inquiry
    Home > Chemicals Industry > Chemical Technology > Lanzhou Petrochemical "open source + self-research" to build a big data cloud computing center

    Lanzhou Petrochemical "open source + self-research" to build a big data cloud computing center

    • Last Update: 2022-01-22
    • Source: Internet
    • Author: User
    Search more information of high quality chemicals, good prices and reliable suppliers, visit www.echemi.com

      On January 10, Zhao Zhihong, a technician from the Information Institute of Lanzhou Petrochemical Automation Research Institute, came to the computer room early in the morning to carefully observe the operation of the big data cloud computing cluster
    .
    Since the Lanzhou Petrochemical Big Data Cloud Computing Center project was established in July 2020, Lanzhou Petrochemical has adopted the "open source + self-research" model to promote the project

    .
    At present, the big data cluster construction of 9 nodes in the production environment has been completed, the data integration with 14 major systems such as MES and large units has been realized, and a 4-layer Hive data warehouse model has been constructed

    .

      On January 10, Zhao Zhihong, a technician from the Information Institute of Lanzhou Petrochemical Automation Research Institute, came to the computer room early in the morning to carefully observe the operation of the big data cloud computing cluster
    .
    Since the Lanzhou Petrochemical Big Data Cloud Computing Center project was established in July 2020, Lanzhou Petrochemical has adopted the "open source + self-research" model to promote the project

    .
    At present, the big data cluster construction of 9 nodes in the production environment has been completed, the data integration with 14 major systems such as MES and large units has been realized, and a 4-layer Hive data warehouse model has been constructed

    .

      Lanzhou Petrochemical Big Data Cloud Computing Center aims to build the company's unified big data warehouse, realize the automatic collection, standardized processing and index management of important information system data, and break the bottleneck of "information island" in production and operation
    .
    The project is undertaken by the Information Institute of Lanzhou Petrochemical Automation Research Institute, and adopts the technical route of "open source + self-research" to support batch-stream integration, especially HDFS, Hive, HBase, Kafka, Spark, Spark Streaming, YARN, ZK, Flume , Kettle and other mature mainstream technologies in the big data technology ecosystem

    .
    At the same time, it has carried out independent research and development closely combined with the actual refining and chemical production and operation of the enterprise, and developed a big data management and control platform through integrated packaging and personalized customization

    .
    At present, the big data cluster involves production, operation, equipment, safety, environmental protection, etc.
    , and has provided data computing services for production decision analysis platforms, production process intelligent management platforms, mobile application halls and other systems

    .

      Lanzhou Petrochemical Big Data Cloud Computing Center aims to build the company's unified big data warehouse, realize the automatic collection, standardized processing and index management of important information system data, and break the bottleneck of "information island" in production and operation
    .
    The project is undertaken by the Information Institute of Lanzhou Petrochemical Automation Research Institute, and adopts the technical route of "open source + self-research" to support batch-stream integration, especially HDFS, Hive, HBase, Kafka, Spark, Spark Streaming, YARN, ZK, Flume , Kettle and other mature mainstream technologies in the big data technology ecosystem

    .
    At the same time, it has carried out independent research and development closely combined with the actual refining and chemical production and operation of the enterprise, and developed a big data management and control platform through integrated packaging and personalized customization

    .
    At present, the big data cluster involves production, operation, equipment, safety, environmental protection, etc.
    , and has provided data computing services for production decision analysis platforms, production process intelligent management platforms, mobile application halls and other systems

    .
      

      While promoting the project, the project team of the Big Data Cloud Computing Center of the Information Institute of Lanzhou Petrochemical Automation Research Institute has applied a large number of mainstream big data technology frameworks and trained a group of engineers who master big data development, management and operation and maintenance technologies
    .
    In the company's digital transformation pilot demonstration project - Yulin Ethane to Ethylene Project, they undertook the important task of building three basic platforms of data lake, cloud computing and big data, ensuring the smooth progress of the work at each node

    .
    The digital transformation platform group of Yulin Ethane to Ethylene Project has successfully completed the overall architecture design, scheme comparison, hardware selection and configuration, preliminary design, detailed design, etc.
    , laying a good foundation for the company to build a big data cloud computing center.
    At present, the company We are making every effort to promote the construction of the environment

    .

      While promoting the project, the project team of the Big Data Cloud Computing Center of the Information Institute of Lanzhou Petrochemical Automation Research Institute has applied a large number of mainstream big data technology frameworks and trained a group of engineers who master big data development, management and operation and maintenance technologies
    .
    In the company's digital transformation pilot demonstration project - Yulin Ethane to Ethylene Project, they undertook the important task of building three basic platforms of data lake, cloud computing and big data, ensuring the smooth progress of the work at each node

    .
    The digital transformation platform group of Yulin Ethane to Ethylene Project has successfully completed the overall architecture design, scheme comparison, hardware selection and configuration, preliminary design, detailed design, etc.
    , laying a good foundation for the company to build a big data cloud computing center.
    At present, the company We are making every effort to promote the construction of the environment

    .
      

      "Accelerate the construction of digital transformation pilot demonstration projects.
    On the basis of the existing background management functions, key development projects will start new service functions such as data catalog, data map, and data index search

    .
    At the same time, the platform data service interface will be opened to provide technical personnel with complete The big data technology research and development experimental platform provides big data support for the high-quality development of enterprises

    .
    " said Zhang Min, president of Lanzhou Petrochemical Automation Research Institute and deputy secretary of the party committee

    .

      "Accelerate the construction of digital transformation pilot demonstration projects.
    On the basis of the existing background management functions, key development projects will start new service functions such as data catalog, data map, and data index search

    .
    At the same time, the platform data service interface will be opened to provide technical personnel with complete The big data technology research and development experimental platform provides big data support for the high-quality development of enterprises

    .
    " said Zhang Min, president of Lanzhou Petrochemical Automation Research Institute and deputy secretary of the party committee

    .
      



    This article is an English version of an article which is originally in the Chinese language on echemi.com and is provided for information purposes only. This website makes no representation or warranty of any kind, either expressed or implied, as to the accuracy, completeness ownership or reliability of the article or any translations thereof. If you have any concerns or complaints relating to the article, please send an email, providing a detailed description of the concern or complaint, to service@echemi.com. A staff member will contact you within 5 working days. Once verified, infringing content will be removed immediately.

    Contact Us

    The source of this page with content of products and services is from Internet, which doesn't represent ECHEMI's opinion. If you have any queries, please write to service@echemi.com. It will be replied within 5 days.

    Moreover, if you find any instances of plagiarism from the page, please send email to service@echemi.com with relevant evidence.