altmarius

cultură şi spiritualitate

Light, a possible solution for a sustainable AI

25 juillet 2019, 22:18 CEST
French startup LightOn is currently on working on developing light-powered technologies. Dmitriy Rybin / Shutterstock

We are currently witnessing a rapidly growing adoption of artificial intelligence (AI) in our everyday lives, which has the potential to translate into a variety of societal changes, including improvements to economy, better living conditions, easier access to education, well-being, and entertainment. Such a much anticipated future, however, is tainted with issues related to privacy, explainability, accountability, to name a few, that constitute a threat to the smooth adoption of AI, and which are at the center of various debates in the media.

A perhaps more worrying aspect is related to the fact that current AI technologies are completely unsustainable, and unless we act quickly, this will become the major obstacle to the wide adoption of artificial intelligence in society.

AI and Bayesian machine learning

But before diving into the issues of sustainability of AI, what is AI? AI aims at building artificial agents capable of sensing and reasoning about their environment, and ultimately learning by interacting with it. Machine Learning (ML) is an essential component of AI, which makes it possible to establish correlations and causal relationships among variables of interest from data and prior knowledge of the processes characterizing the agent’s environment.

For example, in life sciences, ML can be helpful to determine the relationship between grey matter volume and the progression of Alzheimer disease, whereas in environmental sciences it can be useful to estimate the effect of CO2 emissions on climate. One key aspect of some ML techniques, in particular Bayesian ML, is the possibility to do this by account for the uncertainty due to the lack of knowledge of the system, or the fact that a finite amount of data is available.

Dr. Thomas Wilckens@Thomas_Wilckens

Missed it? Faster, more accurate diagnoses: applications of research http://bit.ly/2GnMS44 

View image on Twitter

See Dr. Thomas Wilckens's other Tweets

Such uncertainty is of fundamental importance in decision making when the cost associated with different outcomes is unbalanced. A couple of examples of domains where AI can be of tremendous help include a variety of medical scenarios (e.g., diagnosis, prognosis, personalised treatment), environmental sciences (e.g., climate, earthquake/tsunami), and policy making (e.g., traffic, tackling social inequality).

Unsustainable AI

Recent spectacular advances in ML have contributed to an unprecedented boost of interest in AI, which has triggered huge amounts of private funding into the domain (Google, Facebook, Amazon, Microsoft, OpenAI). All this is pushing the research in the field, but it is somehow disregarding its impact on the environment. The energy consumption of current computing devices is growing at an uncontrolled pace. It is estimated that within the next ten years the power consumption of computing devices will reach 60% of the total amount of energy that will be produced, and this will become completely unsustainable by 2040.


Chart: MIT Technology Review Source: Strubell et al.

Recent studies show that the ICT industry today is generating approximately 2% of global CO₂ emissions, comparable to the worldwide aviation industry, but the sharp growth curve forecast for ICT-based emissions is truly alarming and far outpaces aviation. Because ML and AI are fast growing ICT disciplines, this is a worrying perspective. Recent studies show that the carbon footprint of training a famous ML model, called auto-encoder, can pollute as much as five cars in their lifetime.

If, in order to create better living conditions and improve our estimation of risk, we are impacting the environment to such a wide extent, we are bound to fail. What can we do to radically change this?

Let there be light

Transistor-based solutions to this problem are starting to appear. Google developed the Tensor Processing Unit (TPU) and made it available in 2018. TPUs offer much lower power consumption than GPUs and CPUs per unit of computation. But can we break away from transistor-based technology for computing with lower power and perhaps faster? The answer is yes! In the last couple of years, there have been attempts to exploit light for fast and low-power computations. Such solutions are somewhat rigid in the design of the hardware and are suitable for specific ML models, e.g., neural networks.

Interestingly, France is at the forefront in this, with hardware development from private funding and national funding for research to make this revolution a concrete possibility. The French company LightOn has recently developed a novel optics-based device, which they named Optical Processing Unit (OPU).


“Optical computing leading the AI scale-up”, Igor Carron, CEO, LightOn (CognitionX video, 2018).

In practice, OPUs perform a specific operation, which is a linear transformation of input vectors followed by a nonlinear transformation. Interestingly, this is done in hardware exploiting the properties of scattering of light, so that in practice these computations happen at the speed of light and with low power consumption. Moreover, it is possible to handle very large matrices (in the order of millions of rows and columns), which would be challenging with CPUs and GPUs. Due to the scattering of light, this linear transformation is the equivalent of a random projection, e.g. the transformation of the input data by a series of random numbers whose distribution can be characterized. Are random projections any useful? Surprisingly yes! A proof-of-concept that this can be useful to scale computations for some ML models (kernel machines, which are alternative to neural networks) has been reported here. Other ML models can also leverage random projections for prediction or change point detection in time series.

We believe this is a remarkable direction to make modern ML scalable and sustainable. The biggest challenge for the future, however, is how to rethink the design and the implementation of Bayesian ML models so as to be able to exploit the computations that OPUs offer. Only now we are starting developing the methodology needed to fully take advantage of this hardware for Bayesian ML. I’ve recently been awarded a French fellowship to make this happen.

It’s fascinating how light and randomness are not only pervasive in nature, they’re also mathematically useful for performing computations that can solve real problems.


https://images.theconversation.com/files/202296/original/file-20180117-53314-hzk3rx.jpg?ixlib=rb-1.1.0&q=30&auto=format&w=600&h=121&fit=crop&dpr=2 1200w, https://images.theconversation.com/files/202296/original/file-20180... 1800w, https://images.theconversation.com/files/202296/original/file-20180... 754w, https://images.theconversation.com/files/202296/original/file-20180... 1508w, https://images.theconversation.com/files/202296/original/file-20180... 2262w" sizes="(min-width: 1466px) 754px, (max-width: 599px) 100vw, (min-width: 600px) 600px, 237px" />

Created in 2007 to help accelerate and share scientific knowledge on key societal issues, the Axa Research Fund has been supporting nearly 600 projects around the world conducted by researchers from 54 countries. To learn more, visit the site of the Axa Research Fund.

Vizualizări: 5

Adaugă un comentariu

Pentru a putea adăuga comentarii trebuie să fii membru al altmarius !

Alătură-te reţelei altmarius

STATISTICI

Free counters!
Din 15 iunie 2009

198 state 

(ultimul: Guyana)

Numar de steaguri: 262

Record vizitatori:    8,782 (3.04.2011)

Record clickuri:

 16,676 (3.04.2011)

Tari lipsa: 44

1 stat are peste 600,000 clickuri (Romania)

1 stat are peste 90.000 clickuri (USA)

1 stat are peste 40,000 clickuri (Moldova)

3 state au peste 10.000 clickuri (ItaliaFranta,  

Germania)

6 state au peste 5.000 clickuri (Olanda, Belgia, Marea Britanie, Canada, UngariaSpania )

10 state au peste 1,000 clickuri (Polonia, Rusia,  Australia, IrlandaIsraelGreciaElvetia ,  Brazilia, Suedia, Austria)

50 state au peste 100 clickuri

23 state au un click

Rating for altmarius.ning.com 

altmarius.ning.com-Google pagerank,alexa rank,Competitor

DE URMĂRIT

1. ANTICARIAT ALBERT

http://anticariatalbert.com/

2. ANTICARIAT ODIN 

http://anticariat-odin.ro/

3. TARGUL CARTII

http://www.targulcartii.ro/

4. PRINTRE CARTI

http://www.printrecarti.ro/

5. MAGAZINUL DE CARTE

http://www.magazinul-de-carte.ro/

6 ANTICARIAT PLUS

http://www.anticariatplus.ro/

7. DEPOZITUL DE CARTI 

http://www.calinblaga.ro/

8. CARTEA DE CITIT

http://www.carteadecitit.ro/

9. ANTICARIAT ON-LINE
http://www.carti-online.com/

10. ANTICARIATUL DE NOAPTE

 http://www.anticariatuldenoapte.ro/

11. ANTICARIATUL NOU

http://www.anticariatulnou.ro

12. ANTICARIAT NOU

https://anticariatnou.wordpress.com/

13. ANTICARIAT ALEPH

https://www.anticariataleph.ro/

14. ANTIKVARIUM.RO

http://antikvarium.ro

15.ANTIKVARIUS.RO

https://www.antikvarius.ro/

16. ANTICARIAT LOGOS

http://www.anticariat-logos.ro/

17. ANTICARIAT.NET

http://www.anticariat.net/informatii-contact.php

18. TIMBREE

www.timbree.ro

19. FILATELIE

 http://www.romaniastamps.com/

20 MAX

http://romanianstampnews.blogspot.com

21. STAMPWORLD

http://www.stampworld.com

22. LIBMAG

https://www.libmag.ro/oferta-carti-polirom/?utm_source=facebook-ads-7-99-polirom&utm_medium=banner-facebook&utm_campaign=7-99-polirom-facebook&utm_content=new-3

23. BUCURESTIUL MEU DRAG

http://www.orasul.ro/

24. MAGIA MUNTELUI

http://magiamuntelui.blogspot.com

25. RAZVAN CODRESCU
http://razvan-codrescu.blogspot.ro/

26.RADIO ARHIVE

https://www.facebook.com/RadioArhive/

27.EDITURA UNIVERSITATII CUZA - IASI

http://www.editura.uaic.ro/produse/colectii/documenta/1

28. EDITURA ISTROS

https://www.muzeulbrailei.ro/editura-istros/

29 ORIZONTURI CULTURALE

http://www.orizonturiculturale.ro/ro_home.html

30. SA NU UITAM

http://sanuuitam.blogspot.ro/

31. MIRON MANEGA
http://www.certitudinea.o

32. NATIONAL GEOGRAPHIC ROMANIA

https://www.natgeo.ro/revista

33. KORUNK

http://ideakonyvter.ro/53-korunk

Insignă

Se încarcă...

Anunturi

Licenţa Creative Commons Această retea este pusă la dispoziţie sub Licenţa Atribuire-Necomercial-FărăModificări 3.0 România Creativ

Note

Erfolgsgeschichte Taunusbahn

Creat de altmariusclassic Sep 13, 2013 at 11:02am. Actualizat ultima dată de altmariusclassic Sep 13, 2013.

Schnell und Steiner

Creat de altmariusplus Iun 19, 2013 at 1:59pm. Actualizat ultima dată de altmariusplus Iun 19, 2013.

Grosse Kunstfuehrer zum Schnell &Steiner

Creat de altmariusclassic Dec 21, 2012 at 6:55pm. Actualizat ultima dată de altmariusclassic Dec 21, 2012.

© 2020   Created by altmarius.   Oferit de

Embleme  |  Raportare eroare  |  Termeni de utilizare a serviciilor