The Computing Community Consortium (CCC) will hold a visioning workshop in Hawaii in early January, 2019 to create a vision for thermodynamic computing, a statement of research needs, and a summary of the current state of understanding of this new area. Workshop attendance will be by invitation only and travel expenses will be available for select participants. We seek short white papers to help create the agenda for the workshop and select attendees. See the application tab for more information.
Thermodynamics has a long history in the engineering of computing systems due to its role in power consumption, scaling, and device performance ,. In a different context, thermodynamically motivated algorithmic techniques are prevalent and highly successful in areas such as machine learning , simulated annealing , and neuromorphic systems. The foundational thinking underlying much of the existing technology derives largely from equilibrium properties of closed thermodynamic systems. We aim to foster a community to extend these foundations into the domain of non-equilibrium thermodynamics toward the development of a new class of technologies that we call open thermodynamic computers.
The overall intuition is that striving for thermodynamic efficiency is not only highly desirable in hardware components, but may also be used as an embedded capability in the creation of algorithms: can dissipated heat be used to trigger adaptation/restructuring of (parts of) the functioning hardware, thus allowing hardware to evolve increasingly efficient computing strategies? Recent theoretical developments in non-equilibrium thermodynamics suggest that thermodynamics drives the organization of open systems as a natural response to external input potentials; that is, that these systems adapt as they dissipate energy, enter low dissipation homeostatic states and as a result ‘learn’ to ‘predict’ future inputs ,. For example, lower bounds on thermodynamic efficiency in driven systems (away from equilibrium), indicate that systems have to retain relevant, predictive information in order to be thermodynamically efficient ,. This strategy is, of course, the same as what is followed in machine learning (and, in general, in science): predictive inference . This interesting connection between energy efficiency and information processing inspires us to bring together researchers in the various disciplines with the goal of building the foundations that would allow us to build radically different computing systems.
This CCC workshop will gather a set of leading researchers working to define open thermodynamic computers, to describe the reasons that they should be studied, to enumerate the major challenges that lay before us, and to create a strategy for a way forward. We seek a diverse group of physical theorists, electrical and computer engineers, and electronic / ionic device researchers with strong understanding of thermodynamics.
- Frank, Michael P. “The physical limits of computing.” Computing in Science & Engineering 4.3 (2002): 16-26.
- Lloyd, Seth. “Ultimate physical limits to computation.” Nature 406.6799 (2000): 1047.
- Dayan, Peter, et al. “The helmholtz machine.” Neural computation 7.5 (1995): 889-904.
- Černý, Vladimír. “Thermodynamical approach to the traveling salesman problem: An efficient simulation algorithm.” Journal of optimization theory and applications 45.1 (1985): 41-51.
- N. Ganesh, “A Thermodynamic Treatment of Intelligent Systems,” 2017 IEEE International Conference on Rebooting Computing (ICRC), Washington, DC, 2017, pp. 1-4.
- Perunov, Nikolay, Robert A. Marsland, and Jeremy L. England. “Statistical physics of adaptation.” Physical Review X6.2 (2016): 021036.
- Still, Susanne, et al. “Thermodynamics of prediction.” Physical review letters 109.12 (2012): 120604.
- Still, Susanne. “Thermodynamic cost and benefit of data representations.” arXiv preprint arXiv:1705.00612 (2017).
- Still, Susanne. “Information bottleneck approach to predictive inference.” Entropy 16.2 (2014): 968-989.
|Tom Conte, Georgia Tech
||Erik DeBenedictis, Sandia National Laboratories
|Natesh Ganesh, University of Massachusetts Amherst
||Todd Hylton, UC San Diego
|Susanne Still, University of Hawaii
||John Paul Strachan, Hewlett Packard Labs, HPE
|R. Stanley Williams, HP Labs
With Support From the CCC Post Moore’s Law Computing Task Force:
|Mark Hill, University of Wisconsin, Madison
||Kathy Yelick, University of California at Berkeley
For this workshop, we request whitepapers of no more than two pages. Topics of interest include, but are not limited to:
- Non-equilibrium thermodynamic theory and its implications for self-organizing computing technologies, such as fluctuation-dissipation theorems and their ramifications regarding homeostasis, learning by prediction, stability, and plasticity.
- Novel device and component concepts that change and retain state (learn) in response to the thermodynamics of their environment, which may be suitable as the evolvable elements for future for thermodynamic computers.
- System concepts that integrate human-directed programmability and thermodynamically evolvable elements.
- Concepts to integrate and embed thermodynamic computers into an open environment of electrical and information potential.
- Non-equilibrium, thermodynamically inspired machine learning techniques and algorithms, such as simulated annealing in complex non-equilibrium environments and unsupervised learning by prediction.
- Challenge problems to motivate the development of thermodynamic computers
Topics out of scope include:
- Machine learning accelerators.
- Established machine-learning techniques.
- Brain simulations / models / simulators.
- Novel, programmable computing systems.
Authors of white papers may be asked to participate in teleconferences to develop an agenda prior to the workshop.
Please submit your white paper by September 15, 2018 via this Wufoo registration form. The organizing committee will notify the selected attendees by October 5th. Should you have any questions, please contact Khari Douglas at email@example.com.