Open-Source GenAI: The Real Costs and Benefits for Small Businesses

Richard Foster-FletcherAugust 5, 2024

The narrative around open-source generative AI (GenAI) models is compelling, especially for small and medium-sized enterprises (SMEs) seeking to harness AI without incurring the high costs of proprietary solutions. However, while open-source AI eliminates licensing fees, it’s crucial to consider whether this approach is genuinely cost-effective in the long run and what potential downsides might exist. This article explores the benefits and hidden costs of open-source GenAI, providing real-world examples to highlight its impact on small businesses.

Cost Savings: A Major Attraction

One of the most attractive aspects of open-source AI models is the elimination of licensing fees. Proprietary AI models can be prohibitively expensive, with initial licensing costs, annual renewals, and per-user fees. In contrast, open-source models, optimised through techniques such as Low Rank Adaptation (LoRA) and quantisation, remove these financial barriers. This democratisation of AI allows even the smallest businesses to integrate advanced AI capabilities into their operations.

Hidden Costs: The Other Side of the Coin

While the absence of licensing fees is a significant advantage, implementing and maintaining open-source AI comes with its own challenges. Businesses must consider the hidden costs, including:

Technical Expertise and Maintenance

Implementing open-source AI requires significant technical expertise. Businesses may need to hire skilled data scientists or AI specialists to manage these systems effectively, which can be costly. Customisation to fit specific business needs often leads to technical debt—where the future cost of maintaining and updating software increases due to initial shortcuts taken during development. Regular updates and patches are necessary to keep the system secure and functional, adding to the overall cost.

Security and Compliance Risks

Proprietary AI solutions typically include built-in security features and compliance certifications that open-source models may lack. Ensuring data privacy and regulatory compliance with frameworks like GDPR can be more challenging with open-source AI, necessitating additional investments in security measures.

Real-World Success Stories

Despite these challenges, many businesses have successfully implemented open-source AI to achieve significant benefits.

Case Study: Flowers For Dreams

Flowers For Dreams, a boutique flower shop, utilised open-source AI tools to streamline its inventory and supply chain management. By implementing predictive analytics and demand forecasting models, they managed to reduce waste and optimise their stock levels. This approach not only saved costs but also improved their ability to meet customer demand promptly, thereby enhancing overall customer satisfaction and business efficiency. Their success demonstrates how small businesses in the retail sector can leverage AI to improve operational efficiency and sustainability. Source: AISolveThat.

Case Study: Bitrix24

Bitrix24, a company providing business communication tools, integrated open-source natural language processing (NLP) models to enhance their customer service operations. By deploying AI chatbots, they managed to automate responses to frequently asked questions and support requests. This automation led to a significant reduction in response times and improved customer service efficiency, allowing their human agents to focus on more complex issues. This case illustrates the potential of AI to enhance customer interaction and service quality in small and medium-sized enterprises (SMEs). Source: AISolveThat.

Case Study: Hypotenuse AI

Hypotenuse AI, a small marketing firm, adopted open-source AI tools for content creation and marketing automation. They used AI to generate high-quality blog posts, product descriptions, and marketing copy, which allowed them to produce content at scale without compromising on quality. This strategic use of AI not only increased their content output but also freed up their creative team to focus on strategy and innovation. The firm’s success highlights how AI can be a game-changer for small businesses in the creative industries, offering cost-effective solutions for high-quality content production. Source: Hypotenuse AI

Is It Worth It?

The decision to adopt open-source AI models depends on a business’s specific needs, resources, and capabilities. While open-source AI offers significant cost savings on licensing, businesses must weigh these savings against the potential hidden costs and risks associated with customisation, maintenance, and security.

Key Questions to Consider:

Do you have the technical expertise to implement and maintain open-source AI models?
Are you prepared to invest in security measures to protect data privacy and compliance?
Can you manage the potential technical debt associated with customisation and updates?

Ethical Considerations

Incorporating open-source AI also involves ethical considerations. Ensuring that AI systems are used responsibly, without bias, and in compliance with data privacy regulations is crucial. Businesses must adopt transparent practices and engage in continuous monitoring to uphold ethical standards.

Final Thoughts

Open-source AI models present an exciting opportunity for SMEs to harness the power of AI without the financial burden of proprietary solutions. While there are challenges and potential hidden costs, the benefits can be substantial when managed correctly. By carefully considering their capabilities and resources, businesses can make informed decisions about integrating open-source AI into their operations, ultimately driving innovation and competitiveness in their respective markets.

Written by

Richard Foster-Fletcher

Richard stands at the forefront of ethical artificial intelligence as an AI Advisor, Author, Speaker, and LinkedIn Top Voice. He is the visionary behind MKAI.org (Morality and Knowledge in Artificial Intelligence), an initiative dedicated to fostering AI’s responsible development and application. Through his stewardship of the Boundless Podcast, Richard delves into discussions about AI inclusivity and digital ethics, contributing to a more equitable technological future. His profound insights have illuminated lecture halls at globally renowned institutions, including the London School of Economics (LSE), University College London (UCL), Oxford University, and Imperial College London, guiding the next generation of tech leaders.

Follow Me

Richard Foster-Fletcher delivered a truly engaging and thought-provoking keynote at the AI Tomorrow Summit 2024 in Türkiye. His insights into the transformative potential of AI for Türkiye’s economy were both enlightening and impactful. Richard’s emphasis on the pivotal role of generative AI for SMEs, the importance of upskilling, and ethical considerations in AI development resonated deeply with our audience. His ability to articulate complex concepts with clarity and relevance made the session highly valuable. AIPA were thrilled to have Richard speak and look forward to future collaborations.

Ulas Malli, Board Member, AIPA

Richard Foster-Fletcher is an asset to humanity. He brings intelligence and heart to our ever-changing future. He’s a team player who cares about people and their important role on the planet as stewards for future generations. He is a great communicator and thinks outside of the box when creating solutions to difficult problems. Richard also sees the value in healthy partnerships when expanding new ideas. It’s an honor to work with Richard.

Laura Cox, Executive Producer

Richard provided an excellent platform for our discussion, skillfully getting to the heart of the matter and allowing me to share my views effectively. His thoughtful questions, combined with a warm and engaging manner, made for a truly insightful conversation. I appreciated his genuine interest and the respectful way he facilitated our discussion.

Sir Anthony Seldon, Author, Historian and Educator

Richard delivered a truly engaging and thought-provoking session at our Director As Strategic Leader programme. His insights into the opportunities and challenges of AI were both enlightening and inspiring. Richard highlighted the need to channel AI advancements into creating new roles and fostering grassroots innovation, emphasising the importance of responsible AI development. His ability to articulate complex concepts in an accessible manner made the session highly impactful. Richard’s emphasis on transparency, accountability, and aligning AI with human values resonated deeply with our participants. We were delighted to have him speak and look forward to future collaborations.

Graham Bell, Director of Digital Education at Cranfield School of Management

Richard is a thorough professional who takes his work seriously, is knowledgeable and possibly the best at spreading the word about AI. Richard’s probing questions about this subject, make you think. He gets the best out of you!

Nikhil Malhotra, Chief Innovation Officer, Tech Mahindra

Richard delivered an insightful and thought-provoking talk on the expansive implications of artificial intelligence on society, the future of work, and ethical considerations. His ability to articulate complex concepts in an accessible manner prompted a dynamic and engaging discussion among attendees. Richard’s presentation not only highlighted the potential risks and rewards of AI adoption but also encouraged a deeper understanding of its impact. The session was very well-received, sparking meaningful dialogue and a multitude of questions from an engaged audience. We are appreciative of Richard’s contribution to our event and his role in advancing the conversation around AI. His expertise and passion for the subject matter were evident and greatly appreciated by all participants.

Andy Murray, Executive Director at Major Projects Association

Richard’s keynote at our recent EMEA Conference was both enlightening and engaging. His presentation, “AI in Action – Balancing Innovation and Integrity in Decision-Making” adeptly addressed the complex interplay of AI innovation and ethics, enhancing our understanding of these critical issues. Richard combined humour and humility to make the intricate topics of bias and the future of work approachable, while his interactive style enriched our session. We are grateful for his significant contribution to the conference and for advancing the conversation on ethical AI.

Megan Hendricks, Executive Director, MBA Career Services & Employee Alliance

I thoroughly enjoyed my recent conversation with Richard Foster-Fletcher. His thoughtful approach to the important intersections of AI, ethics, and education allowed us to explore critical issues in a way that was both engaging and insightful. Richard brings a unique perspective to these discussions, and I appreciated the depth and clarity with which he led our conversation.

Dan Ariely, Professor of psychology and behavioral economics at Duke University

Richard has the unique ability to bring out the best in a person. He has three rare qualities to achieve that: incredible empathy, a deep cultural background, and an open mind second to none! I’ve been interviewed all my life on national television, radio, newspapers, conferences, and podcasts. Richard tops them all! He pierces right through the surface with his eagle vision into the core of how we perceive life. My mind sees connections everywhere and in everything. Richard sees that in everybody. Do not miss a chance to sit down and talk with Richard! You will probably learn incredible things about yourself, your work, and the world! Talking with Richard will take you to the next level.

Denis Rothman, AI Expert & Ethicist | Author & Speaker

The physicist John Wheeler once remarked, “We shape the world by the questions we ask.” If that’s so, then Richard is shaping the world. I had the pleasure of joining him as a guest on his podcast and was *profoundly* impressed with the depth, generosity and thoughtfulness of his questions. He’s a star!

Andrew Zolli, Chief Impact Officer at Planet