Don’t miss only the leaders of OpenAI, Chevron, Nvidia, Kaiser Permanente, and Capital One at VentureBeat Transform 2024. Get key insights into GenAI and expand your network at this exclusive three-day event. He learns more
OpenAI is moving to bolster its technology stack. The company announced today its acquisition Roxta vendor known for providing a real-time analytical database to power intelligent enterprise applications.
While terms of the deal have not yet been disclosed, OpenAI has confirmed that it will integrate Rockset’s “word-level indexing and querying” capabilities to enhance retrieval infrastructure across products. The company also added that the entire Rockset team will move to OpenAI as part of the acquisition.
The move marks the second major acquisition that OpenAI has announced publicly following the takeover Acquisition of Global Illumination, Inc. startup in New York City last year.
The move also comes as competition in the field of artificial general intelligence continues to intensify. Just yesterday, Anthropic, one of OpenAI’s biggest competitors, was released Claude 3.5 Sonneta powerful LLM that convincingly outperforms OpenAI’s recently released GPT-4o in benchmarks.
Countdown to VB conversion 2024
Join enterprise leaders in San Francisco July 9-11 for our flagship AI event. Connect with your peers, explore the opportunities and challenges of generative AI, and learn how to integrate AI applications into your industry. Register now
Even Ilya Sutskever, OpenAI’s co-founder and former chief scientist, launched his project Own a new AI startup, Safe SuperIntelligence.
How will Rockset power OpenAI?
Founded in 2016, Rockset provides organizations with a real-time, cloud-based analytics database that allows developers to build data-intensive applications, such as those for personalization and IT automation, at scale.
The product is constantly ingesting and indexing data from sources such as Kafka, MongoDB, DynamoDB, and S3, allowing information to be available and queried in real-time. It can run sub-second SQL queries on semi-structured data, without the need for a pre-defined schema.
At its core, Rockset uses open source RocksDB A persistent key-value store built in Meta (formerly Facebook) as a foundation. It acts as an external secondary index for OLTP databases, data lakes, and streaming platforms, accelerating real-time analytical queries and providing performance isolation for underlying transactional systems. Throughout 2023, the company has been enhancing its product with capabilities aimed at enhancing AI use cases.
Now, with the OpenAI acquisition, the technology stack built by Rockset, especially its “world-class” indexing and querying capabilities, will power OpenAI’s retrieval stack.
The companies have yet to share the exact details of how this integration will take shape, but one thing is abundantly clear: Rockset will enable OpenAI products to answer customer questions with the latest, most relevant information, faster than ever before. Imagine enterprise GPT being able to better address user questions with more accurate data.
“Rockset’s infrastructure enables companies to turn their data into actionable intelligence. We’re excited to deliver these benefits to our customers by integrating Rockset Enterprise into OpenAI’s products,” Brad Lightcap, OpenAI’s COO, said in a statement.
Companies and startups using AI tools like OpenAI models are already trying to leverage a technology known as “boost generation recovery,“It was formulated in a 2020 paper by researchers from Meta, University College London and New York University, which links generative AI with external knowledge bases, ideally improving the model’s ability to handle specific queries and reducing the risk of incorrect answers – such as answering Employee Questions Question about expenditure policy guidelines by pulling organization documents, e.g.
As for Rockset, it is still unclear how the company’s business will change with existing customers. I’ve worked with some of the industry’s leading players, including Klarna, Meta, Whatnot, and Windward. Questions sent by VentureBeat remained unanswered at the time of writing.
“We are excited to join forces with OpenAI to enable users, enterprises and developers to take full advantage of their data by bringing powerful AI retrieval,” said Venkat Venkataramani, CEO of Rockset, in a statement.