Approaching zero carbon | Energy saving and carbon reduction in chemical industry need multi-party cooperation

Source: The Paper.

  ·Energy saving and carbon reduction in chemical industry is not only a challenge of the times, but also an opportunity for enterprises to improve their competitiveness and achieve sustainable development. The chemical industry should be laid out as early as possible, take the initiative to make changes, and answer the propositions of "transformation and development" and "energy revolution".

  As a major consumer of energy and carbon emissions, the actions of energy conservation and carbon reduction in chemical industry are very important to achieve the global environmental protection and sustainable development goals.

  Chemical industry is an important factor affecting the emissions of other industries in "Scope 3"

  The overall energy consumption of chemical industry is high, and the extended chain is long.

  All along, the infrastructure of the chemical industry is based on energy and resources such as oil, ore and coal, forming industrial chains such as petrochemical industry, coal chemical industry and salt chemical industry. As one of the six high-energy industries in China, the total energy consumption of chemical industry accounts for about 32% of the national industrial energy consumption. In 2022, the chemical industry in China consumed 1.07 billion tons of standard coal, and the total carbon emission reached about 11.48 billion tons.

  From the perspective of raw materials, China chemical industry is highly dependent on coal. The carbon intensity related to coal is much higher than other raw materials. Taking methanol products as an example, about 75% of China’s methanol production comes from coal chemical industry, while the global proportion is only 35%. From the product side, the energy consumption of the chemical industry mainly comes from bulk chemicals and fine chemicals. The former is located in the upstream of the chemical industry chain, with large production scale and low profit level, while the latter is processed from the former with small scale but higher added value. Among thousands of chemical products, only ammonia and methanol account for three-quarters of the total energy consumption of the whole industry.

Proportion of carbon dioxide emissions from various departments in China. Source: China Energy System Carbon Neutralization Roadmap.

  Fossil energy such as coal and gasoline accounts for a high proportion of energy consumption.

  The energy consumption structure of China chemical industry is dominated by fossil energy represented by coal and gasoline. The Declaration on peak carbon dioxide emissions and Carbon Neutralization of Petroleum and Chemical Industry in China jointly issued by China Petroleum and Chemical Industry Federation and several chemical enterprises, parks and other units in 2021 shows that by the end of 2020, there are about 2,300 enterprises with carbon emissions exceeding 26,000 tons of standard coal in the chemical industry, accounting for about 65% of the total carbon emissions of the whole industry, concentrated in methanol, synthetic ammonia, coal-to-liquids, calcium carbide and PVC and other sub-industries.

  In terms of energy types, fossil energy (such as coal, oil, natural gas, etc.) is still dominant in chemical production at present. With the energy transformation, the application of non-fossil energy (such as wind energy and solar energy) in the chemical industry is gradually increasing.

  From the perspective of energy consumption, it can be divided into four major links: raw material preparation, production process, energy supply and waste treatment, involving raw material treatment, chemical reaction, product separation and purification, equipment operation and other steps.

  The chemical industry greatly affects the emissions of "Scope 3" in other industries.

  The carbon footprint of chemical industry comes from energy consumption, chemical synthesis process, raw material processing and waste treatment. Energy consumption refers to all kinds of equipment and reactions that fossil fuels such as gas, oil and coal are used to drive chemical production. Chemical synthesis refers to the synthesis of chemicals such as polymers, fertilizers and solvents. Raw material processing refers to the process of extracting, processing and transporting raw materials. Waste disposal means that waste is burned or otherwise disposed of. In the above process, the characteristics of energy-intensive and multi-source determine that it will inevitably emit a lot of carbon dioxide.

  According to the report of the International Energy Agency in September, 2022, in 2021, the main chemical products have directly discharged 925 metric tons of carbon dioxide, which is about 5% higher than that in 2020, occupying the third place in all industrial sectors. From the total amount, the total annual carbon emission of the chemical industry is less than 500 million tons, far less than that of steel and electricity. However, in terms of intensity, the carbon emissions per unit GDP of the chemical industry are relatively high. The unit carbon dioxide emission in the coal chemical industry reaches 3-11 tons.

  The chemical industry is also highly correlated with the carbon footprint of other industries. The chemical industry chain is long, there are many kinds of products, the composition of supply chain and industrial chain is complex, and there are many upstream and downstream market segments, which are highly related to many other industries. The chemical industry is an important factor affecting the emissions of other industries in "Scope 3", and more than 95% of industrial products must rely on the chemical industry. Therefore, the chemical industry can boost other industries through its own emission reduction and play a key role in industrial energy saving and carbon reduction.

  Main challenges of energy saving and carbon reduction in chemical industry

  Chemical industry is one of the most difficult heavy industries to reduce emissions. China’s chemical industry emits about 1.3 billion tons of carbon each year, accounting for about 20% of the total industrial emissions. Non-carbon dioxide gas emissions in the chemical industry will also increase carbon emissions. The low-carbon transformation of chemical industry faces the following challenges:

  First, the chemical industry in China is still on the rise, and the overall demand is increasing. With the improvement of domestic economic level and national living standard, the demand for chemical products in China still has a large room for growth.

  Second, chemical production in China is highly dependent on coal, and the carbon intensity related to coal is higher than other raw materials. The coal chemical industry in China is large, which makes it more difficult to save energy and reduce carbon.

  Third, the production capacity related to chemical production in China is relatively short. As shown in Figure 2, China’s relatively new chemical production capacity accounts for more than half of the global total production capacity. "Trade-in" has become a key step to promote the upgrading of old equipment and old technology, improve production efficiency and reduce energy consumption. China chemical industry should carry out carbon emission reduction transformation on the basis of existing facilities. How to solve the problem of "exchanging old facilities for new ones" and properly dispose of existing production capacity is an urgent problem to be solved.

Age composition of global primary chemical products. Source: IEA Energy Technology Outlook Report 2020.

  Energy saving and carbon reduction in chemical industry should play a synergistic role in many ways.

  Strengthen industrial chain coordination

  The chemical industry has a long industrial chain and a wide range of products, and the relationship between supply and demand of subdivided products is complex. It is an arduous task to promote the overall energy saving and carbon reduction in the upstream and downstream of the industry. We can start from the following three aspects:

  First, jointly formulate standards and guidelines for energy conservation and emission reduction. All links in the industrial chain, including upstream raw materials, intermediate products and downstream products, can jointly formulate energy conservation and emission reduction standards and unify the carbon reduction standards of the entire industrial chain in terms of energy use, production technology and equipment renewal, such as the Product Carbon Footprint Guide jointly issued by Bayer, BASF and Hankook Chemical Enterprises.

  The second is to empower the industrial chain to reduce carbon with digital technology. Under the trend of integration of numbers and intelligence, we should actively introduce digital technology, optimize the carbon footprint management process in the upstream of the supply chain, formulate a comprehensive carbon footprint management cloud platform that runs through the whole industrial chain, monitor energy consumption and carbon emissions in real time, implement cleaner production, and strive to create a long-term advantage of green and low-carbon chemical industry. At the same time, we will actively and effectively manage the management of chemical carbon assets through technical equipment skill transformation and negative carbon absorption technology, and jointly promote the low-carbon development of the chemical industry through multiple channels.

  The third is to explore a multi-industry collaborative governance mechanism. We should strengthen the division of labor and cooperation in the green and low-carbon industrial chain, and build a number of "little giant" enterprises specializing in special innovation in key links of the industrial chain; Promote the joint production of chemical industry and building materials, petrochemical industry and steel industry, cooperate in research and development, reduce carbon, form the symbiosis of upstream and downstream industries of multiple industries, deepen the cooperation of multiple industries, promote the green development of industries, and explore the application mode of multi-industry chain coordination.

  Improve supply chain coordination

  There are many kinds of products in the chemical industry, the supply chain network is complex, and the complexity and diversity of chemical reactions mean that in the chemical industry chain, fine adjustment of raw materials, ratio or process often leads to brand-new products. The supply chain carbon emissions of the chemical industry account for 77% of the total chemical industry emissions. Therefore, reshaping the supply chain and deepening cooperation are the core for chemical enterprises, especially leading enterprises, to promote the green development of the industry.

  First, optimize the energy structure, fully optimize the energy structure with new energy, and improve the utilization of clean and green energy such as wind power generation, hydrothermal storage and solar photovoltaic, so as to ensure sustainable energy supply and reduce carbon dioxide emissions.

  The second is to coordinate the production planning of all parties in the supply chain to reduce unnecessary energy consumption and overproduction. Unreasonable arrangement of production plan in chemical industry may lead to waste of resources and increase of carbon emissions. It is necessary to plan production plan together with supply chain partners to avoid overproduction and frequent production adjustment. At the same time, collaborative production planning can also optimize the supply chain network, reduce logistics links and transportation distances, and reduce energy consumption and carbon emissions during transportation.

  The third is to invest in supply chain energy-saving projects. By investing in clean energy power plants, wastewater treatment plants and other projects with supply chain partners, resource sharing, risk sharing and benefit sharing can be realized. In addition, we can also jointly invest in R&D and energy-saving technologies, such as energy-saving and emission-reduction technologies, emission-reduction and carbon sequestration technologies and energy recycling technologies, so as to improve production efficiency and reduce carbon emissions.

  Ensure that the government cooperates with the market.

  Energy saving and carbon reduction in chemical industry need the cooperation of government and market.

  First, the government should play the role of policies, funds and market mechanisms. Relevant policies and regulations such as energy conservation and emission reduction laws and preferential tax policies can promote enterprises to adopt more environmentally friendly production methods in terms of energy efficiency standards, carbon emission quotas and carbon taxes. In terms of financial support, enterprises are encouraged to invest in energy-saving technologies and cleaner production equipment in the form of subsidies, bonuses or low-interest loans. In addition, a carbon trading market can be established or other carbon pricing mechanisms can be adopted to encourage enterprises to reduce carbon emissions through market mechanisms.

  The second is to strengthen the full-cycle supervision and management of the entire chemical related market. The chemical industry is extremely extensible and permeable, so the government should establish a set of energy and carbon reduction management system for chemical products in the whole life cycle, and establish a cooperative management mechanism for stakeholders in the whole process of raw material mining, product synthesis and development, end-use and recycling, so as to promote the chemical industry to move in a green, low-carbon and sustainable direction.

  For example, in 2004, Britain’s energy and climate department joined hands with Ofgem, the government supervision agency of electricity and gas market, to issue Smart Grid Vision and Routemap, which transmitted electricity price information in real time, allowing enterprises to use electricity at peak hours, thus reducing energy waste in industry as a whole. In 2011, the United States launched the Superior Energy Performance Program (SEP) to establish a digital energy management system for many industrial enterprises. In 2023, Germany issued the Climate Protection Act and the Energy Efficiency Act, using big data analysis to help enterprises establish energy management or environmental management systems, and the leading chemical enterprises such as Baffles, Bayer and Henkel, thereby significantly reducing energy waste. Therefore, the government helps enterprises to form a digital energy management system and standards, which can reduce unnecessary energy consumption of the whole industry.

  The third is to strengthen the communication and contact between industrial associations, research institutes and the government. Relevant industry associations are important participants in the formulation of chemical production standards, scientific research institutes are the source of green and low-carbon technology development, and the government is the maker and manager of public policies. It is necessary to strengthen the cooperation among the three parties, maintain close communication, integrate the application of new standards and technologies with the government’s management innovation in time, and ensure the implementation of green and low-carbon standards at all times, thus promoting the formation of a benign interactive cooperation mechanism among industry associations, scientific research institutes and the government to jointly promote the healthy development of green and low-carbon chemical industry.

  Synergy between technology and management

  The coordination of energy saving and carbon reduction technology and management in chemical industry is the key to realize sustainable development.

  First, technological innovation of energy saving and carbon reduction supports management decision-making. The management team needs to understand the latest energy-saving and carbon-reducing technologies and incorporate them into the long-term development planning and management decision-making of the enterprise. Technical support can provide real-time data and information for management to help formulate effective energy-saving and carbon-reducing strategies. For example, the data monitoring system is used to monitor energy consumption and carbon emissions in real time, so as to adjust and optimize them in time.

  Second, the improvement of management mode supports technological development and innovation. Good management systems and processes in enterprises or chemical parks can promote the implementation and operation of energy-saving and carbon-reducing technologies. The management team needs to establish corresponding systems and processes, including energy management system, carbon emission accounting and reporting system, etc., to ensure the effective implementation and continuous improvement of technology. The management team can also establish a performance evaluation and incentive mechanism, incorporate the goal of energy saving and carbon reduction into the enterprise performance appraisal system, and encourage the active participation and contribution of relevant departments and individuals through the reward and punishment system.

  In a word, if China chemical industry wants to realize low-carbon or even zero-carbon transformation in a relatively short period of time, it is bound to need the guidance and drive of policies and mobilize the concerted actions of all relevant parties.

  Energy saving and carbon reduction in chemical industry is not only a challenge of the times, but also an opportunity for enterprises to improve their competitiveness and achieve sustainable development. The chemical industry should be laid out as early as possible, take the initiative to make changes, and answer the propositions of "transformation and development" and "energy revolution".

  (Author of this article: Wang Yukang, Dai Yuehua. Project leaders: Zhang Jun, Li Xianbo, project coordinator: Tian Chunling, and members of the research group: Gu Xiaodan, Dai Yuehua, Wang Yukang and Zhang Yunwei. Thanks to Shanghai Economic and Information Committee and Shanghai Energy Conservation and Environmental Protection Service Association for their help in this survey)

Reporting/feedback

The narrative of international communication theory in the new era needs to be integrated with the world.

  Author: Guo Ke (Director and Professor, China International Public Opinion Research Center, Shanghai International Studies University)

  On May 31st, 2021, when the Political Bureau of the Communist Party of China (CPC) Central Committee held the 30th collective study on strengthening China’s international communication ability, the Supreme Leader General Secretary pointed out that it is necessary to speed up the construction of China discourse and China narrative system, explain China’s practice with China’s theory, sublimate China’s theory with China’s practice, create new concepts, new categories and new expressions that integrate China and foreign countries, and more fully and vividly show China’s story and the ideological and spiritual strength behind it. The important speech of the Supreme Leader General Secretary has pointed out the direction and provided guidance for us to accelerate the construction of China discourse and China narrative system at a new starting point.

  Theoretical narration is mainly based on the theoretical framework of China society and China scene. It is both a theoretical and a practical problem to establish and innovate the narrative system of international communication with China characteristics. In the new era, China needs to continue to increase the narrative innovation of international communication theory, and the core issue is to constantly pursue common integration with other countries in the great changes, and really jump out of the western narrative framework to tell the story of China well. Only in this way can we effectively innovate the narrative system of China’s international communication, thus creating a favorable external public opinion environment for China’s reform, development and stability, and making positive contributions to promoting the building of a community of human destiny.

  First, the concept of community is the narrative moral peak of mutual integration between China and the world.

  Since the 18th National Congress of the Communist Party of China, the CPC Central Committee with the Supreme Leader as the core has put forward the concept of community of human destiny, which has deepened the understanding of the nature of the world and effectively raised the moral peak of China’s international communication narrative.

  The reason why the concept of the community of human destiny can become a moral peak to enhance China’s international communication narrative is that it can guide and refine public ideas that are beneficial to all mankind according to the situation, and provide public products that match it ("Belt and Road Initiative"), and put forward non-Western ideas that are independent of Western ideology, which provides guidance for China and the world to continue to maintain a common and harmonious situation. The concept of community not only provides China’s concept and China’s plan for reshaping the international communication order in theory, but also enhances self-confidence in international communication practice, which will effectively promote the common integration between China and other countries in the world.

  It should be acknowledged that the narrative pattern of international communication dominated by western countries has not changed at present, and the situation of "strong in the west and weak in me" has not been fundamentally reversed. However, with the rapid increase of China’s comprehensive national strength and the continuous improvement of its international status, it is certain that China, as a "civilized country" with a huge population, a vast territory, a long historical tradition and a profound cultural accumulation, will surely have a profound impact on human society and the future of the world, and the "Dongsheng" trend of China’s international communication ability has been unstoppable.

  Second, Socialism with Chinese characteristics’s successful practice is the source of narrative innovation.

  The common integration of China and the world depends to a certain extent on whether China can effectively explain its own development model in international communication, and put forward a theoretical narrative based on China’s international communication practice to form a narrative system with China characteristics. General Secretary of the Supreme Leader pointed out at the symposium on philosophy and social science in 2016 that this is an era that needs theory and will certainly produce theory.

  Over the past 40 years of reform and opening up, China society has made great achievements. China has changed from the country with the largest number of poor people in the world to the country with the largest number of people who have eliminated poverty in the world in the past 40 years; From a backward economy on the verge of collapse to the biggest contributor to global economic growth; From an inward-looking economy closed to the outside world to the world’s largest trading country. In a word, China is playing an increasingly important role in solving the major challenges facing the world. China’s social development achievements are not the result of applying western ready-made theories, and western theories can’t explain China’s practice well. These successful practices of Socialism with Chinese characteristics are the source of narrative innovation of China’s international communication theory, which can promote China’s practice and model to the world, and sublimate the narrative system of international communication with China characteristics in the process of mutual integration with the world.

  In the past 10 years, under the guidance of the core tenet of "telling the story of China well and spreading the voice of China well", the international communication capacity building has achieved a series of great achievements through the cooperation of the central departments, news organizations and scientific research experts in universities, and produced a number of research results with both theoretical awareness and problem orientation. New platforms for international communication think tanks have emerged constantly, and a number of outstanding "international communicators" have emerged who can closely focus on China and the world and actively preach vivid cases of China’s development achievements in foreign practice.

  However, we must realize that we are still faced with some practical difficulties, such as "we can’t tell the truth, we can’t spread it, we can’t spread it, and it’s hard to trust it". China can’t and shouldn’t become a testing ground for the society and media to verify the hypothesis of western theories, but should become an innovative place for independent knowledge. We should not only tell the story of China well, but also build a narrative system of China’s international communication theory in the process of mutual integration with the world.

  In innovating the narrative of China’s international communication theory, we should first get rid of the excessive dependence on the western narrative system, consciously devote ourselves to the social practice scene in China, condense the theoretical narrative concept of China, and then return to the social practice in China to verify it. However, while adhering to the narrative framework of China issue and China, we should not exclude western experience and western knowledge system, and continue to absorb advanced international communication experience and mature knowledge achievements, including the West. Only in this way can we effectively handle the relationship between universality and particularity of global communication knowledge production, and exchange and learn from other countries in the world, including the United States and western countries, in an equal and common manner, so as to achieve the goal of commonality and integration with the world. Only in this way can we effectively innovate the theoretical narrative paradigm of international communication with China characteristics.

  Third, promote common integration to become a worldwide narrative consensus of international communication.

  In the process of international communication practice, we need to abandon prejudice, carry out international communication and intercommunication in a frank and open manner, and form a worldwide narrative consensus of international communication on the basis of achieving international understanding to the greatest extent. Therefore, in this sense, common integration can be regarded as both an important goal of China’s international communication and a means to achieve international communication.

  First of all, China’s concept of common integration in international communication is helpful to gradually dispel the subject paradigm of "binary opposition" in American and western countries. For a long time, there has been a narrative system of "binary opposition" in the academic circles of western countries, such as East and West, "liberal and democratic" countries and "autocratic" countries, capitalist countries and socialist countries, and accordingly the whole world is divided into two camps. This dualism is also reflected in international communication. So far, the United States and western countries still regard themselves as the subjects of "democracy and freedom", and classify other countries as the "other" objects of "non-democracy and freedom", occupying the moral imagination and academic highland of self-superiority to "the other". In the international communication system dominated by the United States and the West, the eastern countries have always been subordinate to the western subject as objects, and the eastern world has fallen into the dilemma that "the East cannot express the East, and the East must be expressed by the West", thus forming an unequal relationship between the subject and the object between the West and the East.

  As the representative of the Eastern countries and the second largest economy in the world, China is exerting a substantial influence on the binary opposition between the East and the West with its successful social practice and governance model, and is gradually challenging it. It can be said that China’s concept of community and the narrative of international communication theory are shaking the "binary opposition" system between the East and the West. At the same time, however, China also pays attention to treating the United States and western countries as equal members of the community, so as to seek the fullest international commonality and mutual understanding and achieve the strategic goal of international understanding.

  Secondly, the concept of common integration can effectively integrate domestic multiple narrative fields and innovate the narrative theory and practice mode of international communication. On the one hand, it has always been the idea of China’s international communication that there are other international narrative practices inside and outside. However, with China approaching the center of the world stage and the popularization of information technology on the Internet, the situation that the international communication channels are clearly defined inside and outside has been gradually broken, and the information dissemination in China can easily cross national boundaries and become a narrative part of international communication. In the environment of international communication in the new era, the boundaries between internal and external differences are becoming more and more blurred, and the trend of internal and external narrative integration is becoming more and more obvious. This trend from international narrative practice with internal and external differences to internal and external narrative integration also puts forward the changes in the theoretical narrative framework and connotation of international communication, which is also the only way for China to move towards the common narrative integration of international communication theory to a certain extent. On the other hand, based on the concept of community and the practice of international communication, the concept of common and inclusive narrative can promote the transformation of China’s increasingly powerful theoretical narrative in the field of communication into a real force to transform the objective world, and provide an innovative choice for the theory and practice mode of international communication narrative and the integration of the world on the basis of further smoothing the common and inclusive national and international communication narrative.

Source: Guangming. com-Theory Channel

"Our Marriage" hit the whole network and exploded. "Champion Lang" turned into a family cook.

Directed by directors Shen Yan and Liu Haibo, the urban emotional drama "Our Marriage", starring Ann Bai Baihe, David, Rulu and other powerful actors, was officially launched on February 23rd. The drama is launched from the perspective of family marriage, showing the current situation of contemporary marriage around four groups of families with completely different modes of getting along, and arousing the audience’s thinking on social topics such as "how to balance family and career". Since its launch, it has gained high attention and discussion, and its reputation has been rising steadily. Ann plays Yuwen Li as a "stay-at-home dad" in the play. In a "strong woman and weak man" family, he and his wife Dong Sijia (Rulu) perform their respective duties. In order to take care of the family, he takes care of his wife, parents and children, and silently pays attention to them, and is dubbed "the ceiling of men’s session" by the audience.

In the first week of the story, in order to fulfill the ambition of his career-oriented wife Dong Sijia, Yuwen Li chose to be a stay-at-home father who "washes, cooks and takes care of the children" and took the initiative to take care of the family. In the eyes of his wife, Yuwen Li is a considerate husband, who will gently read poetry and fall asleep; In the eyes of his parents-in-law, he is a child who will send thoughtful gifts to the elderly on time when his wife forgets his father’s birthday; In the eyes of the child "Brother Xi", he is a knowledgeable and enlightened father who trusts the child in the rowing incident and helps him establish correct values.

This time, An broke through the previous role types and tried a brand-new "stay-at-home dad" design, but he portrayed the role vividly, and his vivid shaping also added a lot of highlights to the play. In the play, Yuwen Li has a pair of gentle eyes, elegant manners, warm and polite speech, and every move shows the delicate, gentle and polite characteristics of the character incisively and vividly. When Yuwen Li heard Dong Sijia ask if he was free this weekend, he thought that his wife finally had time to enjoy the long-lost three-person time. But in the end, when he learned that he was just driving away to attend the venture capital ceremony, he was disappointed for a second, and his eyes changed from expectation to consternation and loneliness. When it was discovered that the other party could bring his own truth, Ann’s performance was subtle and restrained, but it was accurate and vivid. All the sour and mixed flavors were passed to the audience from flashing eyes and slightly pursed corners of the mouth, which made people feel the same. The performance in this detail only makes the audience feel the undercurrent emotions between the couple who have different division of labor from ordinary people, and the performance skills can be seen.

In addition to his brilliant performance in the play, An’s "No.1 Scholar Lang" mixed-cut video has also exploded on the Internet recently. The characters in his previous works were cleverly edited into brand-new videos by "Scissorhands", and he was praised by everyone as "Fresh Clothes Numa Young Lang" with a handsome face, which was relished by many netizens. When Yuwen Li appeared in the audience’s sight with "Our Marriage", netizens also began to ridicule "No.1 scholar turned into a family cook" ~

In the latest plot of Our Marriage, Yuwen Li got to know Jiang Jing, the mother of the same community, during the process of taking care of the baby. Not only were they mistaken for a family of four when they took their children to the movies together, but there were more and more daily intersections, which could not help but arouse the audience’s speculation and heated discussion about "Yuwen Li, a full-time father, would not cheat?" Want to know what stories will happen between Yuwen Li and his wife Dong Sijia and Jiang Jing? Can Yuwen Li, who tried to return to the workplace and was rejected by his wife, get what she wanted? What other wonderful performances will Ann bring us in the play? Then keep "Our Marriage" and continue to pursue the drama ~

[Video] The giant panda genome sequence map has been completed to answer why it is dark circles.

Enter [China News] > >


  CCTV News (China News): shenzhen huada gene research institute announced today (11th) that the genome frame of the giant panda Jingjing has been drawn. This is another milestone contribution made by China scientists in the field of life science after completing the first yellow race genome map last year.

  Why are giant pandas "dark circles"? Why don’t you hibernate as a "bear"? Why do you have a soft spot for "bamboo"? What will the giant panda look like in the future? Scientists’ interpretation of the giant panda "Jingjing" genome provides authoritative answers to these questions.

  Studies have shown that the giant panda has 21 pairs of chromosomes, and the genome size is similar to that of human beings, about 3 billion base pairs, including 20,000-30,000 genes. Compared with the species that have been sequenced, it is also found that the genome of giant panda is the closest to that of dog in structure, and it is also similar to that of human beings, but quite different from that of mice in mammals.

  It is understood that the study of giant panda genome can provide scientific basis and examples for the protection of endangered species, disease monitoring and artificial reproduction from the level of genomics. The most important thing is that this study fills the gap in international related research and provides the possibility for people to understand the giant panda more comprehensively at the genetic and molecular levels.

  Wang Jun, executive vice president of shenzhen huada gene research institute, the project leader: The research level has really reached the scope of the whole genome, which comprehensively interprets the status quo of 30,000 genes in the whole panda. It can make people make a more comprehensive and extensive protection strategy for giant pandas.

  On March 6th this year, scientists from five countries, including China, the United States and Canada, jointly put forward the "International Giant Panda Genome Project", aiming at jointly promoting research results and protecting endangered species. The genome sequence map of the giant panda Jingjing published on 11th is the first part. In the future, scientists in China will complete a detailed map of the giant panda genome within this year.

Editor: Wang Chao

At 0: 00 on the 28th, Changchun gradually lifted social control and resumed normal production and living order in an orderly manner.

  On the afternoon of April 27th, Changchun held the 70th press conference on the prevention and control of epidemic situation in COVID-19 to inform the latest progress of epidemic prevention and control.

  At the press conference, Ma Yanfeng, member of the Standing Committee of Changchun Municipal Committee and executive deputy mayor, introduced: After careful analysis and judgment, the Municipal Epidemic Prevention and Control Headquarters decided to gradually lift the social control of the whole city from 0: 00 on April 28th and restore the normal production and living order in an orderly manner.

  How to let go?

  At 0: 00 on April 28, the prevention zone will be released first, and residents in the prevention zone of the main city will travel one household and one person a day, and they will not leave the main city unless necessary.

  Residents of the county prevention area are allowed to move within the county, and they are not allowed to leave the county (city) unless necessary.

  The current management policies of the closed control area and the control area will remain unchanged for the time being. After the closure and control are lifted, residents have to complete self-health monitoring for 7 days, during which they can’t take public transportation and don’t leave the community unless necessary.

  How to travel?

  Orderly restore the traffic in the city and the intercity traffic with the cities (states) in the province. Rail transit will not operate for the time being, and 175 key bus lines will be resumed, and passengers will scan the code and take the bus; Actively promote the resumption of railway transportation and civil aviation; 1,000 taxis will be released in advance, and the reservation system will be implemented, and the green code will be used to ride and scan the code to pay. According to the changes in the epidemic situation, the taxi supply will be gradually increased and the network car will be restored. "Red and yellow code" personnel are prohibited from taking public transport. It is recommended that private cars do not leave the road unless necessary, do not leave the city unless necessary, do not leave Changchun unless necessary, and travel with other vehicle certificates.

  (Headquarters reporter Zhao Wenbin Zhang Xucheng Liu Yuexin Zi Wang Liang Yang)

170 starts with marketing calls? Scratch the black card of mobile phone with big data

We know that when we change a new mobile phone number, we can get discounts for new registered users on various websites, such as 20-minus-15 for new take-away users, 30-day free ride for new registered users in bike-sharing, etc., and new registered users of some platforms even cash back directly.

What if there are 10 thousand new mobile phone numbers? In addition to the wool that can be multiplied by 10,000 times the benefit, it can also be used to register various platforms as a water army to brush bills, reputation, powder, reading, etc., which not only takes away a lot of activity funds for new user activity merchants, but also greatly reduces the effect of the activity, and also affects the ecology of the whole Internet.

"Cat pond used to raise black cards for mobile phones in large quantities"

For example, as early as December 2016, 21st century business herald once reported that a group of mobile phones blacked out bonus hunter for China Mobile’s love traffic platform activity, and 82,000 g of traffic was stolen in one month, resulting in a loss of more than 4 million yuan. [1]

For example, in September, 2019, the Economic Information Daily reported that the police in Yunnan traced a marriage fraud case and cracked a black and gray industrial chain consisting of "mobile phone card vendors-number theft dens-code receiving platform-online account dealers-downstream crimes", and collected more than 30,000 mobile phone cards for online fraud. [2]

This is the black card of mobile phone. Most of these cards have no real name registration, and they are kept in batches by a device called "cat pool". They are often used to exploit various loopholes to gain profits from various kinds of wool, and sometimes they are suspected of committing crimes.

In addition, some mobile phone black cards take advantage of the psychology that people don’t want to reveal their mobile phone numbers, and build an online code-receiving website to help people receive the verification codes needed for registration and login on various platforms, and make profits through code-receiving fees or website advertising fees.

How did so many mobile phone black cards come from? Which operators and regions have the most mobile phone black cards? Where are these mobile phone black cards used to receive what information?

With the above problems, we have obtained 1503 mobile phone numbers and 79005 SMS verification codes for online code receiving through 20 most common mobile phone code receiving platforms, trying to find out this black card of mobile phone that is flickering in our sight. 

1. What does the black card number of a mobile phone usually start with?

In his years of being harassed by fraudulent phone calls, Alfred summed up a rule: most calls starting with 170 are marketing calls or fraudulent calls. The reason is that the mobile phone numbers starting with 170 are all from virtual operator, and the numbers are relatively easy to obtain, and many of them do not need real-name registration.

So what do these black card numbers usually start with? In other words, what is the number segment of the number? We made statistics on the numbers we got back.

It can be seen that these mobile phone numbers basically belong to the equal-sign segments of 146, 165, 167, 170, 171 and 188, and they are all numbers from China Mobile and China Unicom, and almost none from telecommunications. Except for the number segment of 188 Mobile, the number segment 146 is the number segment of China Unicom’s Internet of Things, and the rest are all virtual operator numbers.

In paragraph 170, there are 1704, 1707 and 1709 belonging to Unicom, 1705 and 1706 belonging to Mobile, but 1700, 1701 and 1702 belonging to Telecom do not appear.

Therefore, it can be considered that these black cards are basically virtual operator cards and Internet of Things cards from China Mobile and China Unicom. 

Second, from which virtual operator?

What is virtual operator? Compared with the three traditional operators of China Telecom, China Mobile and China Unicom, virtual operator relies on renting the communication resources of traditional telecom operators to carry out telecom services.

They don’t need to build a large number of communication facilities like traditional operators, but they need to pay high rental fees to traditional operators, so they must develop users on a large scale as soon as possible in the initial stage of operation. According to the data of China Business News, virtual operator has been developing for seven years since the pilot project was opened in May 2013. Although it has handed over 120 million users, it has not become a catfish in the communication industry to stimulate market vitality, but has become the hardest hit area for harassing phone calls, telecom fraud and other user complaints. [3]

So which virtual operator do the above mobile phone black cards come from? We obtained the virtual operator corresponding to each number and made statistics on it.

Among these black mobile phone cards, 48.5% can’t find their specific corresponding virtual operator, and most of these cards are from Unicom. In addition, among the specific virtual operator numbers corresponding to its number segment, the top three virtual operator are Sharing Online, Langma Information and Boyuan Information respectively.

Third, the geographical distribution of mobile phone black cards

We know that no matter whether we use a mobile card or a Unicom card, every mobile phone number has its home. The package fees in different places are different, and the supervision of mobile phone black cards is also different. We have obtained the attribution of each of the above numbers to see where these black cards of mobile phones come from.

It can be seen that most of these cards come from Shandong, Jiangsu, Henan and other places. Among the top ten provinces, Heilongjiang, Liaoning, Jilin, Zhejiang, Beijing, Hebei and Guangdong are also included. Of course, the situation of different operators is different. We group the numbers according to the operators.

The mobile numbers mainly come from Linyi, Dongying, Jinan and Weihai in Shandong, Songyuan in Jilin and Mudanjiang in Heilongjiang.

Unicom’s number sources are more scattered, mainly from Nanjing and Xuzhou in Jiangsu, Hebi and Jiyuan in Henan and Shenyang in Liaoning.

Fourth, mobile phone black cards from other places

As the mainland’s supervision of black cards for mobile phones is getting stricter and heavier, the industrial chain behind many black cards has turned its attention to mobile phone cards in Hong Kong, Macao and Taiwan and many countries abroad. In the above 20 code receiving platforms, we also obtained 767 mobile phone card numbers from Hong Kong, Macao and Taiwan and many countries abroad.

Most of these black cards are from the United States, Britain, Myanmar and Hong Kong Special Administrative Region. These numbers do not need real-name authentication, and are easy to obtain in batches, and are gradually becoming a substitute for black cards of mainland mobile phones.

Similarly, we analyzed the 20 most frequent mobile phone code-receiving websites, and found in the domain name filing information that 7 websites have servers in the United States, 3 in Panama, and only 3 websites have servers in China. From here, we can also see the importance that this industrial chain attaches to evading supervision.

Five, the platform is online code.

As mentioned above, profiting from online code-receiving websites is a way to realize the black card of mobile phones. We can see which platforms are often used by people to receive the verification code through the SMS verification code information appearing in the online code receiving website, so as to register, log in and bonus hunter.

Therefore, we have obtained 79,005 SMS verification codes from online code receiving websites to see which platforms are online code receiving.

It can be seen that the mobile phone numbers of these online code receiving platforms are often used to receive verification codes of various platforms such as Apple, WeChat, Pinduoduo and Alipay. Among the 79,005 SMS verification codes, there are as many as 7,216 platforms, covering social, e-commerce, internet finance, marriage and love, games, travel, video and other fields.

On the one hand, this means that these areas are plagued by black cards from mobile phones. On the other hand, it means that people are reluctant to use their real numbers to log on to these platforms in order to protect their privacy.

Quote:

[1] Chen Baoliang, Xiao Daming. China Mobile was "robbed" by the "bonus hunter" love traffic of 82,000 g in January. 21st century business herald, 2016-12-14. http://epaper.21jingji.com/html/2016-12/14/content _ 52484.

[2] Li Ziliang, Ji Zhepeng, Wang Yan. Mobile phone "black card" is banned but never stopped. The source of telecom fraud is hard to beat. Economic Information Daily, 2020-03-24. http://www.jjckb.cn/2020-03/24/c_138910147.htm.

[3] Qu Zhongfang, Li Zhenghao. virtual operator these seven years: the business model of relying on wholesale and resale needs to be broken. China Business News, 2020-07-10. http://tech.hexun.com/2020-07-10/201685543.html..

This article was first published on WeChat WeChat official account "Alfred Data Room", please contact the original author for reprinting!

These little things are "design sense" at home.

Do you have to invite big-name designers to have a home with a sense of design? It’s not that complicated. Some home appliances with a sense of design, as long as you can fully agree with them, they really have the magical effect of "having a sense of design at home".

SMEG kitchen electrics

Life in Italy in the 1950s

If you haven’t heard the name of SMEG, your knowledge base of "design sense" needs to be updated. This Italian kitchen electrical appliance brand, established in 1948, has always had a large number of designers. Its elegant, retro-styled design and refined workmanship can make coffee machines and electric kettles, which seem to be commonplace, become the highlights of the home.

Look at their coffee machine. It’s this style:

The electric kettle in their house is this style:

And the widely acclaimed toaster looks like this-this is a toaster that has won the iF design award.

In addition, there are mixers and juicers. Are they also full of 1950s feelings?

The streamlined design and bright macaroon-like color matching make these small household appliances, which should not be very impressive, bring vitality and good taste to the home like works of art. In fact, another signature product of SMEG is the refrigerator. This series of retro refrigerators, which are also full of 1950s style, were once small and fresh online celebrity products. However, the refrigerator line has not officially entered China, but the series of small kitchen appliances can already be bought in the official flagship store of Tmall Mall.

More than that, SMEG and Dolce&Gabbana also launched a limited-edition joint series "Sicily is my Love". The soul designer Renzo Piano of SMEG and the design master Marc Newson cooperated to combine the enthusiasm of Sicily, Italy, which is rich in oranges, lemons and olives, into home appliances.

Get up early to see such a colorful three-piece suit in the kitchen, will the mood of the day become brilliant?

AXOR Yasheng Qiteo basin faucet

The luxury of the second eye

Many people may not realize that the faucet used at home may be a major expression of "design sense".

In fact, in hotel design, this article has long been a major criterion for guest room design, so the bathroom equipment, especially the faucet, used in any high-grade hotel with a sense of design will not be vague. For example, in Bulgari Hotel, Shanghai, it uses AXOR Yasheng Chitrio series basin faucets.

Perhaps many people don’t know much about the brand AXOR, but when it comes to its subordinate group Hansgroya, Germany, I believe many people will suddenly realize it. As its luxury design brand, AXOR has star designer resources including philippe starck and Antonio Chilio, and the Chilio series was designed by the famous Italian architect Antonio Chilio in 2003. This washbasin faucet is inherited from the neoclassical design style in 1930s. It is square and round in shape, angular and round. There are cross handles, one-word handles and lifting single handles to choose from. There is a classic evaluation, which is called "the luxury of the second eye": "Simple lines outline a simple silhouette, which is not a dazzling style at first glance, but its distinct lines reflect diamond-like light in the light."

This luxury can be felt not only in high-end hotels, but also in your own home. Moreover, according to different decoration and color matching styles, the brand also provides AXOR FinishPlus personalized customization service to realize special surface customization in 15 different colors.

BALMUDA The Green Fan

Reproduce the afternoon breeze and make the home feel artistic.

Is it a little cold to turn on the air conditioner again, and it is inevitable that you will sweat if you don’t turn it on? At this time, the most pleasant thing is that there are bursts of natural cool breeze, but in more and more crowded cities, natural wind is inevitably a bit hard to meet. High-quality electric fans should actually be household necessities, and today’s technology can make the wind of electric fans as close to the natural wind as possible.

For example, BALMUDA, an electric fan with unique design style-The Green Fan, uses specially designed double-layer structure blades to let the fan send out fast wind and slow wind at the same time, so that the two winds collide with each other to eliminate the vortex effect and achieve the effect of wide-range air supply, which makes people feel as soft and comfortable as natural wind.

In design, The Green Fan adopts the Japanese minimalist style, which is simple but full of artistic sense. Besides its practical function, it is also a good decoration for decorating the family. Moreover, by simply disassembling the connecting rod, this electric fan can be transformed into floor fan or desk fan mode as required, and there are two power supply modes, wired/wireless, which has higher flexibility in application.

Yang Jingde: Hua Tuo, the "Imperial Doctor" who devoted his life to the aerospace industry.

source map

CCTV News:Speaking of Hua Tuo, everyone must be familiar with it. It is said that this imperial doctor in the Three Kingdoms period has a wonderful hand to rejuvenate the disease. In the Capital Aerospace Machinery Company under the China Academy of Launch Vehicle Technology, there is also a "doctor Hua Tuo". However, this doctor is not a doctor, but an old technician who repairs machine tools. He is Yang Jingde.

Yang Jingde, born in 1937, is a national senior technician, graduated from Shanghai Aviation Industry School (formerly "East China 250 Technical School"), and is one of the earliest military industry technicians trained in New China. At the age of 18, he was assigned to Nanyuan Aviation Repair Factory, today’s Capital Aerospace Machinery Company, and began to deal with cold machine tools.

Now, Nanyuan Aviation Repair Factory has developed into a base for the batch production and development of missiles and rockets in China. From green to old, Yang Jingde never left. He used his life’s wisdom and years to interpret his persistence in the space dream.

Another kind of "magic doctor": "looking, hearing and asking" to repair machine tools

In the 1950s, China’s space industry was still in its infancy, and the conditions were very difficult. Nanyuan aviation repair shop has only a total of hundreds of equipment, all of which are hand-operated machine tools. Yang Jingde doesn’t even have a desk in her dormitory.

However, Yang Jingde was never afraid of hardships, and especially loved to study hard, seizing every opportunity and time to learn advanced technology. Because of his outstanding performance, he was also sent to learn the maintenance of precision machine tools from Soviet experts. For this reason, he made every effort to cherish this hard-won learning opportunity.

At that time, Yang Jingde, who was very young, was already quite famous in the factory. Years of study and research and tempering on the production line have enabled him to practice a stunt: "looking, smelling, asking and cutting" the equipment like an old Chinese doctor.

The oil on the equipment guide rail is more or less, clear or turbid. Yang Jingde can tell the cause of the fault with his eyes.

He can also "listen" to the fault. A few years ago, a British imported equipment was abnormal. Yang Jingde went to the front of the machine tool, leaned down, listened to the noise of the equipment, and then felt the temperature and rotation frequency of the equipment with his hands. The roar in the workshop was extremely noisy, but it did not affect his judgment at all, and he found the "lesion" in a few times.

What’s more, there is another trick, "sound detection from a distance", which makes everyone have to admire the superb skills of this old technician.

One year, Yang Jingde had just finished gallstone surgery, and one of the equipment in the unit was broken. In order not to affect the production, he walked out of the hospital and went back to the workshop for a day. Until he found the cause of the equipment failure and solved the problem, the young comrades of the rest of the equipment could do it by themselves, and he dragged his tired body home. Who knows that at 9 o’clock in the evening, my colleague called and said that the machine that had just been repaired had broken down again. In desperation, he can only instruct the on-site personnel by telephone remote control: "You put your mobile phone next to the machine and I will listen." He vaguely heard the irregular noise in the roar of the machine.

"You put ‘ Lead screw ’ Clean it and see if there is anything extra. " Yang Jingde said.

After the maintenance master took down the "lead screw", he found that there was indeed something superfluous in it. It was aluminium scrap who wore the ball of the "lead screw", which caused the equipment to malfunction. Clean it and reinstall it. Problem solved!

Lay the foundation for your dream with your aerospace peers.

"On October 1, 1997, I began to enter the stage of re-employment, and the specific work was as follows … …” It can be seen from a yellowed Production Task Record Book that this old technician can retire 19 years ago. At that time, Yang Jingde was famous for his stunts, and many units wanted to hire him. The boss of a company came three times and offered him 5000 yuan a month. One company even said, "The salary is up to you, and you are hired as a consultant, so you don’t have to work."

At that time, the salary of rehiring old experts in the factory was 500 yuan per month. Before retiring, the factory leader only said to Yang Jingde: "The factory can’t live without you." He nodded without hesitation.

"I was trained in the factory. Everything I have is given by the factory. I can’t be ungrateful." Yang Jingde said. Not for fame, not for profit, Yang Jingde is like a rock. This firmness is the infinite loyalty of this old technician to the aerospace industry.

After rehiring, the leader always told Yang Jingde that he didn’t have to come to work every day, so call him if he had any questions. But he is still not at ease, coming every day.

Selfless and earnest attitude, marvelous machine repair technology, Yang Jingde has saved a lot of money and made progress for the factory over the years.

In the summer of 2014, an imported machine tool broke down seriously, and there was no maintenance capacity in China, so it had to return to the country of origin, with a maintenance cost of more than 1.3 million yuan and a cycle of at least 3 months. This is a high-precision machine tool, and no one dares to touch it. Yang Jingde looked at it and said, "It can be repaired!"

As a result, 77-year-old Yang Jingde stooped and got in and out of the equipment every day, sweating and working for 20 days. Finally, the machine tool was repaired with only 150,000 yuan. Yang Jingde not only saved "foreign equipment", but also saved more than one million yuan in maintenance costs for the factory. This shocked the original manufacturers.

source map

In 2015, Yang Jingde was 78 years old. Considering his age, the company leaders were really worried about his physical condition, so they ended their re-employment. However, he is still the same as before, and the unit is responsive and has no words.

The old man who repaired machines walked with the aerospace industry all the way, and every progress of this career condensed his life’s hard work and pursuit. He is a witness and a founder. (Text/Liu Chang)

Open source model of apple roll, open code, weight, data set and training process, OpenELM appeared.

Machine heart report

Editor: Chen Ping, saute spicy chicken

Apple released OpenELM, an efficient language model family based on open source training and reasoning framework.

If ChatGPT started the big model competition, then the Meta open source Llama series models set off a craze in the open source field. Among them, the apple doesn’t seem to make a big splash.

However, in the latest paper released by Apple, we can see its contribution in the field of open source.

Recently, Apple released OpenELM with four variants (parameters are 270M, 450M, 1.1B and 3B respectively), which is a series of pre-training and fine-tuning models based on public data sets. The core of OpenELM is layer-by-layer scaling, that is, each Transformer layer in OpenELM has a different configuration (for example, the number of heads and the dimension of feedforward network), which leads to the different number of parameters in each layer of the model, thus achieving more effective cross-layer parameter allocation.

It is worth mentioning that Apple released a complete framework this time, including data preparation, training, fine-tuning and evaluation procedures, as well as a number of pre-trained checkpoint and training logs to promote open source research.

Address: https://arxiv.org/pdf/2404.14619.pdf.

Project address: https://github.com/apple/corenet.

Paper title: open elm: an efficient language model family with open-source training and influence framework.

The results show that the performance of OpenELM is better than the existing open source LLM which is pre-trained with public data sets (Table 1). For example, OpenELM with 1.1 billion parameters outperforms OLMo.

Method introduction

OpenELM architecture

OpenELM adopts transformer architecture with only decoder, and follows the following ways:

(1) Do not use learnable deviation parameters in any fully connected (also called linear) layer;

(2) using RMSNorm for pre-standardization, and rotating position ROPE is used to encode position information;

(3) Use grouped query attention (GQA) instead of multi-head attention (MHA);

(4) replace the feedforward network (FFN) with SwiGLU FFN;

(5) using flash attention to calculate the scalable dot product attention;

(6) Use the same tokenizer as LLama.

Generally speaking, each transformer layer in LLM uses the same configuration, thus realizing the uniform distribution of cross-layer parameters. Different from these models, each Transformer layer in OpenELM has a different configuration (for example, the number of heads and the dimension of feedforward network), which leads to different parameters in each layer of the model. This enables OpenELM to make better use of the available parameter budget to achieve higher accuracy. Apple uses layer-wise scaling to realize the uneven distribution of cross-layer parameters.

Scaling layer by layer: The standard Transformer layer consists of multi-head attention (MHA) and feedforward network (FFN). In order to solve the problem of uneven distribution of parameters in Transformer layer, Apple adjusted the number of attention heads and FFN multipliers in each Transformer layer.

Apple does this. Suppose that the standard Transformer model with uniform parameter distribution has n layers of transformers, and the input dimension of each layer is d_model. MHA has n_h headers, and the dimension of each header is

, the hidden dimension of FFN is:

Apple introduced two superparameters, α and β, to scale the number of attention heads n_h and m in each layer respectively. For layer I, n_h and m are calculated as:

Pre-training data

For pre-training, Apple uses public data sets. Specifically, their pre-training data set includes a subset of RefinedWeb, deduplicated PILE, RedPajama and a subset of Dolma v1.6, totaling about 1.8 trillion token. As shown in the following table.

Training details

Apple used its own open source CoreNet library (formerly known as CVNets, specially used for training deep neural networks) to train OpenELM variants, and the training process was iterated for 350,000 times. Finally, four variants of OpenELM are trained (parameters are 270M, 450M, 1.1B and 3B).

experiment

In this paper, the performance of OpenELM is evaluated under zero sample and few sample settings, as shown in Table 3. The researchers compared OpenELM with the published LLM, including PyThia, Cerebras-GPT, TinyLlama, OpenLM, MobiLlama and OLMo. Related to the work of this paper are MobiLlama and OLMo. These models are all trained on similar data sets and have similar or more pre-training token.

Figure 1 plots the accuracy of OpenELM with the number of training iterations on seven standard zero-sample tasks. It can be found that in most tasks, with the extension of training duration, the accuracy will be improved on the whole. In addition, the accuracy of the checkpoints obtained by averaging the last five checkpoints (collected once every 5000 iterations) is equivalent to or slightly improved by the final checkpoints obtained after 350k iterations. This improvement is probably due to the fact that the average weight reduces the noise. Therefore, in the main evaluation in Table 4, the instruction tuning experiment in Table 5 and the parameter efficiency tuning experiment in Table 6, the researchers used the average checkpoint.

The results in Table 4 span various evaluation frameworks, highlighting the effectiveness of OpenELM compared with existing methods. The results in Table 4 span different evaluation frameworks, highlighting the effectiveness of OpenELM compared with existing methods. For example, compared with OLMo with 1.2 billion parameters, the accuracy of OpenELM with 1.1 billion parameters is improved by 1.28% (Table 4a), 2.36% (Table 4b) and 1.72% (Table 4c), respectively. It is worth noting that OpenELM achieved such accuracy, but used much less pre-training data than OLMo.

As shown in Figure 5, in different evaluation frameworks, instruction fine-tuning can always improve the average accuracy of OpenELM by 1-2%.

Efficient fine tuning of parameters (PEFT) results. Training and evaluation settings for researchers to use common sense reasoning. This setting provides eight 170k training samples of multiple-choice data sets for different methods to study PEFT, including LoRA and DoRA. The researchers integrated OpenELM with these methods, and used eight NVIDIA H100 GPU to fine-tune the generated model for three training cycles. As shown in Table 6, the PEFT method can be applied to OpenELM. On the given CommonSense inference data set, the average accuracy of LoRA and DoRA is similar.

Tables 7a and 7b show the benchmark test results of this work on GPU and MacBook Pro respectively. Although OpenELM is more accurate with similar parameters, its speed is slower than OLMo. Although the main focus of this study is reproducibility rather than reasoning performance, the researcher has conducted a comprehensive performance analysis to determine the bottleneck of the work.

The analysis shows that a considerable part of OpenELM’s processing time can be attributed to the researchers’ simple implementation of RMSNorm (see Table 8). In detail, that is, a simple RMSNorm implementation leads to many separate kernels starting, each processing a small amount of input, instead of starting a single fusion kernel like LayerNorm. By replacing the simple RMSNorm with Apex’s RMSNorm, the researchers found that the throughput of OpenELM was significantly improved. However, compared with the model using optimized LayerNorm, there is still a significant performance gap, partly because (1)OpenELM has 113 layers of RMSNorm, while OLMo has 33 layers of layer norm; (2) The RMSNorm of 2)Apex is not optimized for small input. In order to further illustrate the performance degradation caused by RMSNorm, Apple replaced the LayerNorm in OLMo with RMSNorm, and observed that the generation throughput decreased significantly. In the future work, researchers plan to explore optimization strategies to further improve the reasoning efficiency of OpenELM.

Original title: "Apple Roll Open Source Model, Open Code, Weight, Data Set, Training Process, OpenELM Debut"

Read the original text

Railway departments optimize foreign passengers’ travel services.

CCTV News:According to "China RailwayAccording to WeChat official account news, the new version of the Permanent Residence Identity Card of the People’s Republic of China (hereinafter referred to as the "Permanent Residence Card") will be officially issued and put into use on December 1 this year. According to the requirements of the relevant state departments, the railway department has optimized the 12306 website (including APP, the same below). Passengers with "permanent residence permit" can register and purchase tickets online, complete real-name registration system verification and check-in and check-out through station gates, and enjoy the online and self-service services provided by the railway department as passengers with resident ID cards.

At the same time, since November 28, the railway department has launched an online identity verification service for foreign passports. Previously, foreign tourists had to bring their original passports to the railway station window to verify their identity information when purchasing tickets on the 12306 website. After the introduction of the online identity verification service for foreign passports, passengers can log on to the 12306 website and fill in information such as name, nationality and certificate number according to the system prompts, and the identity verification will be automatically completed by the system. Passengers can also choose to submit photos of passport information pages online, and the background will conduct manual verification. In addition to online verification, passengers can still go to the railway station window for verification. The railway department reminds that foreign passengers can only buy tickets after their identity verification. Passengers with foreign passports are requested to check the status of identity verification in time and complete the identity information verification as soon as possible, so as not to affect the purchase of tickets. More service information can be found on the 12306 website.