Can In-House LLMs Keep Pace with Tech Giants’ AI? An Analysis

Richard Foster-FletcherJuly 30, 2024

The race to integrate advanced artificial intelligence (AI) into business operations has intensified, with major corporations like J.P. Morgan opting to develop their own large language models (LLMs) rather than partnering with established AI firms. This strategy raises a critical question: Can in-house LLMs truly compete with the rapid advancements made by specialized AI companies?

J.P. Morgan’s AI Ambitions

J.P. Morgan has demonstrated its commitment to AI development by allocating $17 billion to technology spending in 2024. This substantial investment, coupled with a team of approximately 2,000 AI/ML experts and data scientists, showcases the bank’s determination to lead in financial technology innovation.

The bank’s decision to develop its own LLM stems from concerns over data security and intellectual property protection. By keeping AI development in-house, J.P. Morgan aims to maintain strict control over sensitive financial data and ensure compliance with regulatory standards.

OpenAI’s Focused Expertise

In contrast, OpenAI, despite its smaller team, has achieved remarkable breakthroughs in AI technology. The company’s singular focus on AI research and development has resulted in the creation of ChatGPT, one of the most advanced AI systems available.

OpenAI’s dedicated approach allows for rapid innovation and continuous improvement of their models. This focused expertise presents a significant challenge for corporations attempting to match the pace of AI advancement through in-house development.

The Innovation Gap

The primary challenge for companies like J.P. Morgan lies in maintaining the relentless pace of innovation set by specialized AI firms. Tech giants and AI-focused companies frequently release updated models with improved capabilities, making it difficult for in-house teams to keep up despite substantial financial resources.

For instance, Meta’s recent release of Llama 3.1, an open-source AI model claiming to outperform ChatGPT on several benchmarks, demonstrates the rapid progress in the field. This constant evolution of AI technology raises questions about the long-term viability of in-house LLM development for non-tech corporations.

Strategic Considerations

The decision between developing in-house AI solutions and partnering with tech giants ultimately depends on a careful assessment of risks, resources, and long-term goals. While J.P. Morgan’s substantial investment in technology positions it well to develop competitive LLMs, the ongoing challenge of matching the innovation pace set by specialized AI companies remains.

Business leaders must weigh the benefits of maintaining control over data and AI development against the risk of falling behind in technological capabilities. The rapid advancements in AI technology suggest that even well-resourced corporations may struggle to keep pace with dedicated AI firms in the long run.

Questions we are left with

As the AI landscape continues to evolve, the question of whether in-house LLMs can truly compete with those developed by specialized AI companies becomes increasingly relevant. The financial sector’s heavy investment in AI underscores its transformative potential but also highlights the challenges of keeping pace with rapid technological advancements.

Ultimately, corporations may need to consider a hybrid approach, balancing internal innovation with strategic partnerships to leverage the best of both worlds. As AI integration becomes increasingly crucial for business success, the choices made today will shape the future of AI in corporate environments, emphasizing the need for a carefully considered and adaptable strategy.

Sources:

J.P. Morgan Technology Spending: https://www.jpmorgan.com/content/dam/jpm/corporate/investor-relations/documents/quarterly-earnings/2023/4th-quarter/4q23-earnings-presentation.pdf
J.P. Morgan AI Initiatives: https://www.jpmorgan.com/technology/artificial-intelligence
J.P. Morgan and ChatGPT Use: https://www.reuters.com/technology/jpmorgan-restricts-chatgpt-use-employees-2023-05-25/
OpenAI Research: https://openai.com/research
Meta Llama 3.1 Release: https://arxiv.org/abs/2303.08774
Meta’s AI Blog: https://ai.meta.com/blog/llama-3-state-of-the-art-open-source-ai-model/

Written by

Richard Foster-Fletcher

Richard stands at the forefront of ethical artificial intelligence as an AI Advisor, Author, Speaker, and LinkedIn Top Voice. He is the visionary behind MKAI.org (Morality and Knowledge in Artificial Intelligence), an initiative dedicated to fostering AI’s responsible development and application. Through his stewardship of the Boundless Podcast, Richard delves into discussions about AI inclusivity and digital ethics, contributing to a more equitable technological future. His profound insights have illuminated lecture halls at globally renowned institutions, including the London School of Economics (LSE), University College London (UCL), Oxford University, and Imperial College London, guiding the next generation of tech leaders.

Follow Me

Richard has the unique ability to bring out the best in a person. He has three rare qualities to achieve that: incredible empathy, a deep cultural background, and an open mind second to none! I’ve been interviewed all my life on national television, radio, newspapers, conferences, and podcasts. Richard tops them all! He pierces right through the surface with his eagle vision into the core of how we perceive life. My mind sees connections everywhere and in everything. Richard sees that in everybody. Do not miss a chance to sit down and talk with Richard! You will probably learn incredible things about yourself, your work, and the world! Talking with Richard will take you to the next level.

Denis Rothman, AI Expert & Ethicist | Author & Speaker

Richard is a thorough professional who takes his work seriously, is knowledgeable and possibly the best at spreading the word about AI. Richard’s probing questions about this subject, make you think. He gets the best out of you!

Nikhil Malhotra, Chief Innovation Officer, Tech Mahindra

The physicist John Wheeler once remarked, “We shape the world by the questions we ask.” If that’s so, then Richard is shaping the world. I had the pleasure of joining him as a guest on his podcast and was *profoundly* impressed with the depth, generosity and thoughtfulness of his questions. He’s a star!

Andrew Zolli, Chief Impact Officer at Planet

Richard Foster-Fletcher is an asset to humanity. He brings intelligence and heart to our ever-changing future. He’s a team player who cares about people and their important role on the planet as stewards for future generations. He is a great communicator and thinks outside of the box when creating solutions to difficult problems. Richard also sees the value in healthy partnerships when expanding new ideas. It’s an honor to work with Richard.

Laura Cox, Executive Producer

Richard delivered an insightful and thought-provoking talk on the expansive implications of artificial intelligence on society, the future of work, and ethical considerations. His ability to articulate complex concepts in an accessible manner prompted a dynamic and engaging discussion among attendees. Richard’s presentation not only highlighted the potential risks and rewards of AI adoption but also encouraged a deeper understanding of its impact. The session was very well-received, sparking meaningful dialogue and a multitude of questions from an engaged audience. We are appreciative of Richard’s contribution to our event and his role in advancing the conversation around AI. His expertise and passion for the subject matter were evident and greatly appreciated by all participants.

Andy Murray, Executive Director at Major Projects Association

Richard’s keynote at our recent EMEA Conference was both enlightening and engaging. His presentation, “AI in Action – Balancing Innovation and Integrity in Decision-Making” adeptly addressed the complex interplay of AI innovation and ethics, enhancing our understanding of these critical issues. Richard combined humour and humility to make the intricate topics of bias and the future of work approachable, while his interactive style enriched our session. We are grateful for his significant contribution to the conference and for advancing the conversation on ethical AI.

Megan Hendricks, Executive Director, MBA Career Services & Employee Alliance

Richard delivered a truly engaging and thought-provoking session at our Director As Strategic Leader programme. His insights into the opportunities and challenges of AI were both enlightening and inspiring. Richard highlighted the need to channel AI advancements into creating new roles and fostering grassroots innovation, emphasising the importance of responsible AI development. His ability to articulate complex concepts in an accessible manner made the session highly impactful. Richard’s emphasis on transparency, accountability, and aligning AI with human values resonated deeply with our participants. We were delighted to have him speak and look forward to future collaborations.

Graham Bell, Director of Digital Education at Cranfield School of Management

I thoroughly enjoyed my recent conversation with Richard Foster-Fletcher. His thoughtful approach to the important intersections of AI, ethics, and education allowed us to explore critical issues in a way that was both engaging and insightful. Richard brings a unique perspective to these discussions, and I appreciated the depth and clarity with which he led our conversation.

Dan Ariely, Professor of psychology and behavioral economics at Duke University

Richard provided an excellent platform for our discussion, skillfully getting to the heart of the matter and allowing me to share my views effectively. His thoughtful questions, combined with a warm and engaging manner, made for a truly insightful conversation. I appreciated his genuine interest and the respectful way he facilitated our discussion.

Sir Anthony Seldon, Author, Historian and Educator

Richard Foster-Fletcher delivered a truly engaging and thought-provoking keynote at the AI Tomorrow Summit 2024 in Türkiye. His insights into the transformative potential of AI for Türkiye’s economy were both enlightening and impactful. Richard’s emphasis on the pivotal role of generative AI for SMEs, the importance of upskilling, and ethical considerations in AI development resonated deeply with our audience. His ability to articulate complex concepts with clarity and relevance made the session highly valuable. AIPA were thrilled to have Richard speak and look forward to future collaborations.

Ulas Malli, Board Member, AIPA