JPMorgan Chase Deploys AI Assistant Powered by OpenAI to Over 60,000 Employees

This week saw JPMorgan Chase introduce a generative AI assistant called LLM Suite to over 60,000 employees, marking the beginning of a broader integration of AI across the bank. This tool assists with tasks such as writing emails, summarizing documents, and problem-solving with Excel. LLM Suite, which taps into external large language models like OpenAI’s ChatGPT, is expected to become as common within the bank as Zoom. This move underscores the rapid adoption of generative AI in the corporate world, with JPMorgan joining other major companies like Morgan Stanley and Apple in leveraging AI to enhance productivity.

“Ultimately, we’d like to be able to move pretty fluidly across models depending on the use cases,” Teresa Heitsenrether, JPMorgan’s chief data and analytics officer, said in an interview. “The plan is not to be beholden to any one model provider.”

The bank is giving employees what is essentially OpenAI’s ChatGPT in a JPMorgan-approved wrapper more than a year after it restricted employees from using ChatGPT. That’s because JPMorgan didn’t want to expose its data to external providers, Heitsenrether said.

“Since our data is a key differentiator, we don’t want it being used to train the model,” she said. “We’ve implemented it in a way that we can leverage the model while still keeping our data protected.”

Heitsenrether also mentioned that it is necessary to teach people how to do prompt engineering relevant to their domain in order to demonstrate its capabilities. She noted that as more people delve deeper into the technology and discover its strengths and limitations, ideas are beginning to flourish. She also stated that the bank’s engineers can use LLM Suite to integrate functions from external AI models directly into their programs.