OpenAI Launches Foundry: A Platform for Running Machine Learning Models

OpenAI Launches Foundry: A Platform for Running Machine Learning Models
OpenAI Launches Foundry: A Platform for Running Machine Learning Models


OpenAI has announced the launch of Foundry, a new developer platform for running its newer machine learning models like GPT-3.5 on dedicated capacity. Foundry is designed for cutting-edge customers running larger workloads. According to screenshots of documentation published on Twitter by users with early access, Foundry allows inference at scale with full control over the model configuration and performance profile. The platform will offer service-level commitments for instance uptime and on-calendar engineering support.

Features of Foundry

Foundry offers the following features:

Static Allocation of Compute Capacity: Foundry delivers a “static allocation” of compute capacity on Azure, OpenAI’s preferred public cloud platform dedicated to a single customer.

Version Control: Foundry provides some level of version control, letting customers decide whether or not to upgrade to newer model releases, as well as “more robust” fine-tuning for OpenAI’s latest models.

Monitoring Capabilities: Users will be able to monitor specific instances with the same tools and dashboards that OpenAI uses to build and optimize models.

Rentals based on dedicated compute units: Rentals will be based on dedicated compute units with three-month or one-year commitments. Running an individual model instance will require a specific number of compute units.

Pricing: Instances won’t be cheap. Running a lightweight version of GPT-3.5 will cost $78,000 for a three-month commitment or $264,000 over a one-year commitment.

Implications of Foundry

Foundry is expected to be a game-changer for customers running large machine learning workloads. It will allow customers to run OpenAI's latest models with greater control, customization, and performance. Foundry also represents a significant move towards monetization for OpenAI, which has been under pressure to turn a profit after a multibillion-dollar investment from Microsoft. According to reports, the company expects to make $200 million in 2023. Compute costs have been a major hurdle for the company, and Foundry will help OpenAI generate revenue by charging customers for its dedicated compute units.

Possible GPT-4 Launch?

Eagle-eyed Twitter and Reddit users spotted that one of the text-generating models listed in the instance pricing chart has a 32k max context window. GPT-3.5, OpenAI’s latest text-generating model, has a 4k max context window, suggesting that this mysterious new model could be the long-awaited GPT-4 — or a stepping stone toward it.

Conclusion

OpenAI's Foundry platform will enable customers to run its latest machine learning models with greater control and customization. Foundry will help OpenAI generate revenue by charging customers for its dedicated compute units. With the possibility of a GPT-4 launch, OpenAI's tech is expected to play a major role in the future of artificial intelligence.

Comments

Post a Comment

Popular posts from this blog

OpenAI's AI Text Classifier

Image
OpenAI's AI Text Classifier is a state-of-the-art machine learning model designed for text classification tasks. The model is trained to predict the class or category of a given text based on a set of predefined labels. Text classification is an important task in NLP , as it is used in a wide range of applications such as sentiment analysis, spam detection, news categorization, and topic labeling. OpenAI's AI Text Classifier is based on the transformer architecture, which has proven to be highly effective in NLP tasks . The model is trained on a massive corpus of text data, which allows it to learn the patterns and relationships between the input text and its corresponding labels. This training process results in a highly accurate model that can perform text classification with high accuracy. One of the key features of OpenAI's AI Text Classifier is its ability to handle a large number of classes and categories. The model is designed to be highly scalable, allowing it to
Read more

How to Create OpenAPI Swagger Specification?

Image
OpenAPI Specification, also known as Swagger , is a widely-used format for defining RESTful APIs. The specification allows developers to describe the structure of an API, including its endpoints, request and response formats, and authentication methods. Here are the steps to create an OpenAPI specification : Define the structure of your API: Before creating your specification, you should have a clear understanding of the structure of your API. This includes the endpoints (or resources) that your API will expose, as well as the request and response formats for each endpoint. Install the OpenAPI command line tool: In order to create your specification, you will need to install the OpenAPI command line tool. This tool can be installed via npm by running the command "npm install -g @openapitools/openapi-generator-cli" Create a new OpenAPI specification file: Once the command line tool is installed, you can create a new OpenAPI specification file by running the command "op
Read more

Utilizing the Power of ChatGPT in Google Workspace App

Image
Utilizing the Power of ChatGPT in the Google Workspace App Called Magic Slides for Building Projects The OpenAI technology and ChatGPT's abilities are expanding beyond their original interface. A new Google Workspace app called Magic Slides has been developed to assist in building projects within Google Slides . Installing and Using the App The app is a Google Workspaces plug-in that you can install and then use from the Extensions menu in Google Presentations. It is also necessary to create an OpenAI account because you will need an API key to log your usage. In the View API keys area, you may generate a key from your account. App Interface and Usage The app features an intriguing user interface. It appears on the right side of the Google Slides presentation layout and allows you to enter information such as the topic and number of slides. With the last option, which is optional, you can insert whatever else you like in the slideshows, such as a formal or humorous tone. Undernea
Read more