Oireachtas Joint and Select Committees
Wednesday, 29 May 2024
Joint Oireachtas Committee on Jobs, Enterprise and Innovation
Impact of Artificial Intelligence on Businesses: Discussion (Resumed)
Dr. Sasha Rubel:
To complement what my colleague said, we see small language models as one of the key levers for sustainability in, through and on the cloud. Running small language models actually requires fewer computes because of the size of the training data sets, which leads to a smaller carbon footprint. We see the rise in small language models as a promising development, not only in terms of the twin digital and green transitions but also in terms of what it can mean for SMEs. They will be able to fine-tune and also develop models based on their own data for specific use cases. This is specifically promising in areas like health and education, where questions of sensitive data protection and privacy are particularly key. We see it as a growing trend to innovate more efficiently and in a more fine-tuned way, targeting actual impact based on the training data.
No comments