Tue Jan 10 2023

Exploring the Carbon Footprint of ChatGPT and the Possibility of Improving Psychotherapy Through Language Analysis

science

The world of finance and economics is ever-evolving, and the origins of money are often overlooked. In this article, we explore the carbon footprint of ChatGPT and provide an estimate of the carbon emissions. Can we use technology to improve psychotherapy by quantifying the language therapists use? Alternatively, could a memristor-based Bayesian machine provide a more sustainable living environment similar to Uruguay? We also discuss the implications of large language models encoding clinical knowledge and every model learned by gradient descent being approximately a kernel machine. Finally, we look at the UN report that states Earth's ozone layer is on course to be healed within decades.

Shelling Out The Origins of Money | Satoshi Nakamoto Institute

Early modern humans used language and precursors of money to solve problems of cooperation that other animals could not, such as reciprocal altruism, kin altruism, and the mitigation of aggression. These precursors were not just symbolic or decorative objects and shared many characteristics with non-fiat currencies. When England's 17th-century colonies in America were established, they needed more coins. The British wanted the colonists to produce large amounts of tobacco, timber, and other goods to send to Britain in exchange for supplies, preventing colonists from keeping the profits. The colonists found a solution in the money used by Native Americans, made up of durable parts of prey like the clam Venus mercenaria and its relatives, strung onto pendants. The beads were counted and removed during trade and sometimes woven into belts or other ceremonial devices to demonstrate the wealth of a tribe.

Shelling Out The Origins of Money | Satoshi Nakamoto Institute

OpenAI Carbon Emissions

ClimateAction. Tech's initial reaction to OpenAI ChatGPT was not to try it out but to consider its carbon footprint. An estimated 350ms of A100 GPU time is needed for each word of response, with a maximum of 10 questions per day for 1 million users resulting in 300,000,000 words per day. Cloud Carbon Footprint lists a minimum power consumption of 46W and a maximum of 407W for an A100 in an Azure data center. It is assumed that ChatGPT processors are consuming the maximum amount of power, equivalent to the CO₂ emission rate of 93 Americans, or three months of an average American's footprint of 15 tCO₂e per year. Cloud Carbon Footprint does have estimates of the remaining two factors, but they were left out for simplicity.

OpenAI Carbon Emissions

The carbon footprint of ChatGPT
The carbon footprint of ChatGPT

An estimate of the carbon emissions from OpenAI’s ChatGPT chatbot service

Measuring Therapist Performance

In talk therapy, Psychotherapists must choose their words carefully and decide when and how to say them. Adam Miner, a licensed clinical psychologist, epidemiologist, Stanford HAI affiliate, and clinical assistant professor in psychiatry and behavioral sciences at Stanford School of Medicine, states that this decision is made by the clinician alone. As a result, there is a high degree of variability in how therapy is provided. Scott Fleming, a graduate student in Stanford's Biomedical Informatics Training Program, explains that it is difficult to understand what aspects of treatment are beneficial, as it is like studying the effect of a medication without knowing if it was properly manufactured, prescribed at the correct dosage, or consistently administered. To address this issue, Miner and Fleming, along with Bruce Arnow, professor of psychiatry and behavioral sciences, and Fleming's advisor, Nigam Shah, professor of medicine, developed a natural language processing tool kit called CRSTL, which quantifies transcribed psychotherapy sessions into 16 features that can be further analyzed using AI. The team also measured how much time therapists spoke in the session and how fast they spoke. The open-source code is available on GitHub to encourage future hypothesis generation and testing work.

Measuring Therapist Performance

Can We Improve Psychotherapy by Quantifying Therapists’ Language?
Can We Improve Psychotherapy by Quantifying Therapists’ Language?

Stanford researchers have created a set of open-source tools to measure therapists’ timing, responsiveness, and consistency to better understand what works.

Bayesian Machine with Distributed Memristors

This article discusses the potential of memristors and other emerging memory technologies to create energy-efficient implementations of neural networks. However, neural networks only sometimes provide an acceptable form of intelligence for certain edge applications, where access to limited data and explainable decisions are required. The article introduces a memristor-based Bayesian machine as a potential solution. A prototype circuit was fabricated, which incorporated 2,048 memristors and 30,080 transistors. The scaled-up design of the machine was more energy efficient than a standard implementation of Bayesian inference on a microcontroller unit. The Bayesian machine offers instant on/off operation and is resilient to single-event upsets.

Bayesian Machine with Distributed Memristors

A memristor-based Bayesian machine
A memristor-based Bayesian machine

Nature Electronics - A Bayesian machine can be implemented in a system with distributed memristors, allowing it to locally perform computation with minimal energy movement.

Leading the Way Reducing Emissions

The typical American household makes around $70,000 a year and consumes 11,000 kilowatt-hours of electricity and 37,000 cubic feet of natural gas. The family flies six or seven times a year and drives about 25,000 miles, buying items from Target twice a month. Despite being aware of the effects of their actions on the climate, they still buy more stuff and bigger houses and cars. This is not a crisis exclusive to America; if global temperatures were to rise by 5 degrees Celsius, it would have disastrous effects.

Leading the Way Reducing Emissions

What Does Sustainable Living Look Like? Maybe Like Uruguay
What Does Sustainable Living Look Like? Maybe Like Uruguay

No greater challenge faces humanity than reducing emissions without backsliding into preindustrial poverty. One tiny country is leading the way.

LLMs and Medical Applications

ArXiv is an online repository of scientific research papers managed by Cornell University Library. It provides access to over 1.8 million articles, which anyone can search and access.ArXiv allows authors to share their research in an open-source environment, eliminating the need for traditional publishing services.This helps to speed up the process of making research available to the public and encourages collaboration between researchers.5. ArXiv is an important resource for those interested in science, technology, and mathematics.

LLMs and Medical Applications

Large Language Models Encode Clinical Knowledge
Large Language Models Encode Clinical Knowledge

Large language models (LLMs) have demonstrated impressive capabilities in natural language understanding and generation,...

Quantifying Bełchatόw CO2 Emissions

This study quantified CO2 emissions from Europe's largest fossil fuel power plant, the Bełchatόw Power Station in Poland, using CO2 observations from NASA's Orbiting Carbon Observatory (OCO) 2 and 3 missions on ten occasions from March 2017 to June 2022. Space-based CO2 emission estimates revealed emission changes consistent with the independent hourly power generation trend, which was affected by both permanent and temporary unit shutdowns. For 9 of the ten occasions, the OCO-2 and OCO-3 emission estimates agreed with the bottom-up emission estimates within their respective 1σ uncertainties. Different methods for defining background values and corresponding uncertainties were explored to understand this important potential error contribution better. These results demonstrate the ability to exist space-based CO2 observations to quantify emission reductions for a large facility when adequate coverage and revisits are available. The results are informative for understanding the expected capability and potential limitations of the planned Copernicus Anthropogenic CO2 Monitoring (CO2M) and other future satellites to support monitoring and verification of CO2 emission reductions resulting from climate change mitigation efforts such as the Paris Agreement. Reducing CO2 emissions from fossil fuel combustion is essential to controlling the rise in global temperatures, the central objective of the United Nations Framework Convention on Climate Change (UNFCCC) Paris Agreement, and about half of global fossil fuel CO2 emissions come from large facilities such as power plants. An observation-based approach for quantifying CO2 emissions from these facilities could support transparency under the Paris Agreement and has been considered for over a decade. This study is a follow-up to Nassar et al. (2021). 29 × 2.

Quantifying Bełchatόw CO2 Emissions

Tracking CO2 emission reductions from space: A case study at Europe’s largest fossil fuel power plant
Tracking CO2 emission reductions from space: A case study at Europe’s largest fossil fuel power plant

We quantify CO2 emissions from Europe’s largest fossil fuel power plant, the Bełchatόw Power Station in Poland, using CO...

UV Layer Recovery by 2040

Nasa released an image of a map of the ozone layer hole over Antarctica on October 20, 2019. The UN assessment has found that the ozone layer is set to be completely healed over most of the world within two decades following decisive action by governments to phase out ozone-depleting substances.The ozone layer is projected to be restored by 2040 across the world, aside from the polar regions, which will take a little longer - the ozone layer will fully bounce back by 2045 over the Arctic and by 2066 over the Antarctic. The 1989 Montreal Protocol, an international agreement, has helped eliminate 99% of ozone-depleting chemicals, such as chlorofluorocarbons (CFCs), used as solvents and refrigerants.The UN stated that the action taken on the ozone layer has also bolstered the more ponderous response to the climate crisis, as CFCs are also greenhouse gases.The World Meteorological Organization unveiled the progress report, which is conducted every four years, on Monday. A series of satellite images over 21 years have captured the hole in the ozone layer above Antarctica.

UV Layer Recovery by 2040

Earth’s ozone layer on course to be healed within decades, UN report finds
Earth’s ozone layer on course to be healed within decades, UN report finds

Most of atmospheric layer that protects planet from ultraviolet radiation likely to be fully recovered for most of world by 2040

Create, Collaborate & Share Lists.

Save & share links you find on hero to unlimited, shareable lists, or build private lists with friends and family, for free!
About The Hero Pages Publication