Large Language Model Development

Large Language Model (LLM) development and hosting technology has developed and diffused making it now widely accessible.

Our investigation and experiments show that it is now possible for virtually any company to host and customise near state-of-the-art models. However, costs are such that it is not realistic to offer full-scale, open-source models at prices that are competitive with the hyperscale providers.

This paper provides a demonstration of what can be done with commodity hardware, and the implications of the change in AI technology that enabled this demonstration are discussed.

Three futures for AI technology are described:

• a future where scale dominates,
• a future where scale is important,
• and a future where scale is irrelevant.

Current evidence points to the ‘scale matters’ future and not the ‘scale dominates’ future, but there are also indications that scale may be even less important. Download our white paper to find out more how it is possible for virtually any company to host and customise near state-of-the-art models