Interest in building an LLM frontend for KDE

[Alexander Semke]

On Montag, 4. Dezember 2023 12:09:43 CET Joseph P. De Veaugh-Geiss wrote:
> I agree with the concerns Josh raises about the energy consumption of
> training LLMs (see, e.g., [1]). A benefit of satisfying the above
> characteristics is it is then possible for us to measure the energy
> consumption for training/using the LLMs. This would enable KDE to be
> transparent about what these tools consume in terms of energy and
> present this information to users.
To make this argument more complete, it's not only the training of such models but also
their usage ("inference") later. For popular generic models the negative impact can quickly
become bigger than the impact of the training itself:
https://www.technologyreview.com/2023/12/01/1084189/making-an-image-with-generative-ai-uses-as-much-energy-as-charging-your-phone/[1]

https://arxiv.org/abs/2311.16863[2]

Though, these and similar arguments mostly tend to ignore the fact that the hyperscalers
have commited to the net-zero imitative and are heavily investing into renewables for
their data centers and also trying to shift heavy workloads into more sustainable time
windows.


--
Alexander

--------
[1] https://www.technologyreview.com/2023/12/01/1084189/making-an-image-with-generative-ai-uses-as-much-energy-as-charging-your-phone/
[2] https://arxiv.org/abs/2311.16863
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.kde.org/pipermail/kde-devel/attachments/20231204/71511a31/attachment.htm>